2024-09-21T07:27:20.432 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T07:27:20.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:27:20.574 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913612' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJWuA8puHqMDKAwXKV8StN0FtXRLxJP/hneTmxUmvzRIR5NSBmnnbKzz+Z84DXMO4vKDhFRkd5BndR8KfKmbs6I= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzOezSIsQdqfRBNbQZmqSX7eoavFkFNA7bFeanlMNBC4kmuWmCPDygtXTTIeV4YWa7fFJJZ/9HaBuSJgiN7LjU= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCg/fDVmhsmRy4a2LuHmbylPplP3OweCtnIP0u+CctrEar7Abmx/LSMpwLx7RIIQLqFrzwg6T7W2ZHfw4H+Ne8U= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T07:27:20.575 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T07:27:20.576 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T07:27:20.576 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T07:27:20.577 INFO:teuthology.task.internal:Checking packages... 2024-09-21T07:27:20.599 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T07:27:20.599 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:27:20.599 INFO:teuthology.packaging:ref: None 2024-09-21T07:27:20.599 INFO:teuthology.packaging:tag: None 2024-09-21T07:27:20.599 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:27:20.599 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:27:20.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:27:20.744 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T07:27:20.745 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T07:27:20.753 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T07:27:20.753 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T07:27:20.773 INFO:teuthology.task.internal:Saving configuration 2024-09-21T07:27:20.797 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T07:27:20.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T07:27:20.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:22:07.541956', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJWuA8puHqMDKAwXKV8StN0FtXRLxJP/hneTmxUmvzRIR5NSBmnnbKzz+Z84DXMO4vKDhFRkd5BndR8KfKmbs6I='} 2024-09-21T07:27:20.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:22:07.540838', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzOezSIsQdqfRBNbQZmqSX7eoavFkFNA7bFeanlMNBC4kmuWmCPDygtXTTIeV4YWa7fFJJZ/9HaBuSJgiN7LjU='} 2024-09-21T07:27:20.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:22:07.539084', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCg/fDVmhsmRy4a2LuHmbylPplP3OweCtnIP0u+CctrEar7Abmx/LSMpwLx7RIIQLqFrzwg6T7W2ZHfw4H+Ne8U='} 2024-09-21T07:27:20.870 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T07:27:20.876 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T07:27:20.876 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T07:27:20.876 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T07:27:20.876 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T07:27:20.978 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd030b4c160>, signals=[15]) 2024-09-21T07:27:20.978 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T07:27:20.984 INFO:teuthology.task.internal:Opening connections... 2024-09-21T07:27:20.985 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T07:27:20.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:27:21.061 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T07:27:21.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:27:21.136 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-09-21T07:27:21.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:27:21.214 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T07:27:21.220 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-09-21T07:27:21.239 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-09-21T07:27:21.239 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-09-21T07:27:21.297 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-09-21T07:27:21.297 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-09-21T07:27:21.297 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-09-21T07:27:21.297 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:27:21.297 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-09-21T07:27:21.297 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:27:21.298 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:27:21.299 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-09-21T07:27:21.330 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-21T07:27:21.348 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-21T07:27:21.349 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:27:21.408 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:27:21.409 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:27:21.409 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:27:21.409 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:27:21.409 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-21T07:27:21.438 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-09-21T07:27:21.457 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-09-21T07:27:21.457 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-09-21T07:27:21.515 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:27:21.516 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:27:21.517 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-09-21T07:27:21.546 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T07:27:21.556 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T07:27:21.574 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T07:27:21.574 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:27:21.577 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:27:21.579 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:27:21.597 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T07:27:21.607 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T07:27:21.607 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:27:21.634 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:27:21.636 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:27:21.743 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T07:27:21.818 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T07:27:21.831 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T07:27:21.831 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-21T07:27:21.832 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-21T07:27:21.832 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:27:21.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:27:21.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T07:27:22.003 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:27:22.003 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T07:27:22.003 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-21T07:27:22.021 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-503.el9.x86_64 2024-09-21T07:27:22.021 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:27:22.021 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T07:27:22.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum upgrade -y linux-firmware 2024-09-21T07:27:24.358 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-21T07:27:26.334 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-21T07:27:31.760 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-21T07:27:33.202 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-21T07:27:34.022 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-21T07:27:39.469 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-21T07:27:41.448 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-21T07:27:41.454 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T07:27:41.454 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-09-21T07:27:41.454 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 1 Package 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 388 M 2024-09-21T07:27:41.455 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-21T07:27:47.454 INFO:teuthology.orchestra.run.smithi084.stdout:linux-firmware-20240905-146.el9.noarch.rpm 68 MB/s | 388 MB 00:05 2024-09-21T07:27:47.454 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:27:47.454 INFO:teuthology.orchestra.run.smithi084.stdout:Total 65 MB/s | 388 MB 00:05 2024-09-21T07:27:50.590 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-21T07:27:50.768 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-21T07:27:50.768 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-21T07:27:54.025 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-21T07:27:54.026 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-21T07:28:03.468 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-21T07:28:04.138 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T07:28:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T07:28:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T07:28:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T07:28:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T07:28:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:28:05.853 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-09-21T07:28:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T07:28:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:28:05.853 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-21T07:28:06.186 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T07:28:06.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T07:28:06.347 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T07:28:06.347 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T07:28:06.349 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi084.front.sepia.ceph.com to complete... 2024-09-21T07:28:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21 07:28:12 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T07:28:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:FINISHED --2024-09-21 07:28:12-- 2024-09-21T07:28:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:Total wall clock time: 6.3s 2024-09-21T07:28:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:Downloaded: 1 files, 343M in 6.0s (57.2 MB/s) 2024-09-21T07:28:12.648 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T07:28:12.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T07:28:14.707 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying... ######################################## 2024-09-21T07:28:14.844 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing... ######################################## 2024-09-21T07:28:14.904 INFO:teuthology.orchestra.run.smithi084.stdout:Updating / installing... 2024-09-21T07:28:22.901 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T07:29:02.889 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T07:29:02.890 DEBUG:teuthology.orchestra.run.smithi084:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T07:29:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T07:29:02.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T07:29:02.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T07:29:02.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T07:29:02.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T07:29:02.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T07:29:02.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T07:29:02.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T07:29:02.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T07:29:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T07:29:02.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T07:29:02.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T07:29:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T07:29:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T07:29:03.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T07:29:03.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T07:29:03.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T07:29:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T07:29:03.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T07:29:03.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T07:29:03.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T07:29:03.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T07:29:03.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T07:29:03.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T07:29:03.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T07:29:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T07:29:03.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T07:29:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T07:29:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T07:29:03.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T07:29:03.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T07:29:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T07:29:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T07:29:03.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T07:29:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T07:29:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T07:29:03.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T07:29:03.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T07:29:03.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T07:29:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T07:29:03.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T07:29:03.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T07:29:03.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T07:29:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T07:29:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T07:29:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T07:29:03.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T07:29:03.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T07:29:03.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T07:29:03.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T07:29:03.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T07:29:03.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T07:29:03.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T07:29:03.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T07:29:03.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T07:29:03.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T07:29:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T07:29:03.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T07:29:03.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T07:29:03.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T07:29:03.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T07:29:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T07:29:03.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T07:29:03.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T07:29:03.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T07:29:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T07:29:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T07:29:03.058 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T07:29:03.058 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T07:29:03.058 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T07:29:03.058 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T07:29:03.058 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T07:29:03.058 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T07:29:03.059 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T07:29:03.060 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T07:29:03.061 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T07:29:03.062 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T07:29:03.063 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T07:29:03.064 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T07:29:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T07:29:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T07:29:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T07:29:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T07:29:03.069 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T07:29:03.070 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T07:29:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T07:29:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T07:29:03.073 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T07:29:03.074 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T07:29:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T07:29:03.076 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T07:29:03.077 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T07:29:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T07:29:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T07:29:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T07:29:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T07:29:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T07:29:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T07:29:03.084 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T07:29:03.085 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T07:29:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T07:29:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T07:29:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T07:29:03.089 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T07:29:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T07:29:03.091 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T07:29:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T07:29:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T07:29:03.094 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T07:29:03.095 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T07:29:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T07:29:03.097 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T07:29:03.098 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T07:29:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T07:29:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T07:29:03.101 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T07:29:03.102 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T07:29:03.103 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T07:29:03.104 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T07:29:03.105 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T07:29:03.106 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T07:29:03.107 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T07:29:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T07:29:03.109 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T07:29:03.110 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T07:29:03.111 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T07:29:03.112 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T07:29:03.113 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T07:29:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T07:29:03.115 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T07:29:03.116 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T07:29:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T07:29:03.118 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T07:29:03.119 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T07:29:03.120 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T07:29:03.121 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T07:29:03.122 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T07:29:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T07:29:03.124 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T07:29:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T07:29:03.126 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T07:29:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T07:29:03.128 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T07:29:03.129 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T07:29:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T07:29:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T07:29:03.132 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T07:29:03.133 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T07:29:03.134 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T07:29:03.135 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T07:29:03.136 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T07:29:03.137 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T07:29:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T07:29:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T07:29:03.140 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T07:29:03.141 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T07:29:03.141 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T07:29:03.141 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T07:29:03.144 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:03.145 DEBUG:teuthology.orchestra.run.smithi084:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T07:29:03.168 INFO:teuthology.orchestra.run.smithi084.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T07:29:03.168 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T07:29:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T07:29:03.168 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T07:29:03.168 INFO:teuthology.orchestra.run.smithi084.stdout:for file in vmlinuz System.map config; do 2024-09-21T07:29:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T07:29:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: fi 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:done 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T07:29:03.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-09-21T07:29:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-09-21T07:29:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-09-21T07:29:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2024-09-21T07:29:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 82.el9 2024-09-21T07:29:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-09-21T07:29:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:29:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8274670 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:29:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:29:03.248 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-09-21T07:29:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:29:03.248 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:29:03.249 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:29:03.249 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:03.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:29:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-09-21T07:29:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:29:05.268 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-09-21T07:29:05.271 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-09-21T07:29:05.287 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.O1BytgV1ho 2024-09-21T07:29:05.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.O1BytgV1ho 2024-09-21T07:29:05.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.O1BytgV1ho 2024-09-21T07:29:05.495 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.O1BytgV1ho is 6KB 2024-09-21T07:29:05.543 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.O1BytgV1ho 2024-09-21T07:29:05.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:29:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:29:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:29:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:29:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T07:29:05.622 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:29:05.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-09-21T07:29:35.771 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T07:29:35.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T07:29:35.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:30:35.774 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T07:30:44.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T07:30:44.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:30:45.185 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-21T07:30:45.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T07:30:45.734 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T07:30:45.734 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-21T07:30:45.769 INFO:teuthology.orchestra.run.smithi084.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:30:45.770 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T07:30:45.770 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:30:45.770 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:30:46.772 DEBUG:teuthology.parallel:result is None 2024-09-21T07:30:46.772 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T07:30:46.785 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T07:30:46.785 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:30:46.789 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:30:46.792 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:30:46.820 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T07:30:46.849 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T07:30:46.883 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T07:30:46.883 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:30:46.887 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:30:46.889 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:30:46.935 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T07:30:46.942 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T07:30:46.942 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:30:46.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:30:46.978 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:30:46.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:30:46.996 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:30:46.999 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:30:47.021 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:30:47.078 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:30:47.092 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:30:47.094 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:30:47.100 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:30:47.106 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:30:47.165 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:30:47.168 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T07:30:47.175 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T07:30:47.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:30:47.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:30:47.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:30:47.234 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T07:30:47.243 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T07:30:47.243 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:30:47.247 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:30:47.253 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:30:47.280 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:30:47.380 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:30:47.456 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:30:47.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:30:47.588 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:30:47.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:30:47.669 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:30:47.715 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:30:47.779 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:30:47.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:30:47.866 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:30:47.866 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:30:47.933 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:30:47.980 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:30:48.042 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:30:48.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:30:48.129 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:30:48.129 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:30:48.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-09-21T07:30:48.200 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-21T07:30:48.204 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-09-21T07:30:48.235 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:30:48.277 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:30:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:30:48.606 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T07:30:48.613 INFO:teuthology.task.internal:Starting timer... 2024-09-21T07:30:48.613 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T07:30:48.664 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T07:30:48.742 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T07:30:48.743 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-09-21T07:30:48.844 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-09-21T07:30:48.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-21T07:30:48.912 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-21T07:30:48.914 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-09-21T07:30:49.000 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-09-21T07:30:49.002 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T07:30:49.002 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-09-21T07:30:49.044 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-09-21T07:30:49.044 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-21T07:30:49.072 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-21T07:30:49.072 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-09-21T07:30:49.095 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-09-21T07:30:49.096 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-09-21T07:30:49.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:30:49.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:30:49.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:30:49.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:30:49.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:30:49.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:30:49.210 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T07:30:49.210 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:30:49.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:30:49.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:30:49.358 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T07:30:49.368 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T07:30:49.380 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T07:30:49.381 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi162.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T07:35:28.547 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-09-21T07:35:28.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T07:35:28.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:35:28.638 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-21T07:35:28.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T07:35:28.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T07:35:28.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:35:28.905 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T07:35:28.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T07:35:28.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-21T07:35:28.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:35:29.079 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-09-21T07:35:29.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-21T07:35:29.161 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T07:35:29.171 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T07:35:29.172 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:35:29.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:35:29.176 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:35:29.176 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:35:29.178 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:35:29.178 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:35:29.206 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:35:29.220 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:35:29.233 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:35:29.234 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:35:29.245 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-21T07:35:29.248 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:35:29.256 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-21T07:35:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:35:29.270 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:35:29.273 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-09-21T07:35:29.286 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-09-21T07:35:29.287 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:35:29.299 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:35:29.314 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:35:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-09-21T07:35:29.338 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-09-21T07:35:29.338 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:35:29.343 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:35:29.343 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T07:35:29.343 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.343 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.343 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.343 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:35:29.371 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:35:29.374 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:35:29.374 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-21T07:35:29.374 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.374 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.374 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.374 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:35:29.498 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:35:29.505 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:35:29.505 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-21T07:35:29.505 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.505 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.505 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.505 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:35:29.506 INFO:teuthology.run_tasks:Running task install... 2024-09-21T07:35:29.517 DEBUG:teuthology.task.install:project ceph 2024-09-21T07:35:29.517 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T07:35:29.517 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T07:35:29.517 INFO:teuthology.task.install:Using flavor: default 2024-09-21T07:35:29.524 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T07:35:29.524 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T07:35:29.525 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:35:29.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:35:29.527 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:35:29.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:35:29.528 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:35:29.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:35:29.682 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:35:29.682 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:35:29.688 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:35:29.688 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:35:29.696 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:35:29.696 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:35:29.795 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:35:29.795 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:35:29.795 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:35:29.807 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:35:29.807 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:35:29.807 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:35:29.812 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:35:29.812 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:35:29.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:35:29.821 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:35:29.821 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:35:29.834 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:35:29.834 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:35:29.868 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:35:29.868 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:35:29.887 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:35:29.901 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:35:29.962 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:35:29.966 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:35:29.977 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:35:30.026 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-09-21T07:35:30.028 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-09-21T07:35:30.041 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-21T07:35:30.043 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-21T07:35:30.044 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:35:30.099 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-09-21T07:35:30.102 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-09-21T07:35:30.252 INFO:teuthology.orchestra.run.smithi191.stdout:45 files removed 2024-09-21T07:35:30.266 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-21T07:35:30.279 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:35:30.293 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:35:30.375 INFO:teuthology.orchestra.run.smithi084.stdout:45 files removed 2024-09-21T07:35:30.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:35:30.837 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-21T07:35:30.839 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-21T07:35:31.096 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 286 kB/s | 84 kB 00:00 2024-09-21T07:35:31.113 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-21T07:35:31.140 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T07:35:31.372 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-21T07:35:31.397 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T07:35:31.416 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T07:35:31.673 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T07:35:32.297 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.3 MB 00:00 2024-09-21T07:35:32.589 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.3 MB 00:00 2024-09-21T07:35:33.399 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-21T07:35:36.382 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 20 MB 00:02 2024-09-21T07:35:36.467 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-21T07:35:40.625 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T07:35:40.798 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-21T07:35:42.084 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-21T07:35:42.955 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T07:35:44.399 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:03 2024-09-21T07:35:45.123 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T07:35:45.899 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-21T07:35:46.607 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-21T07:35:46.711 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T07:35:47.403 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T07:35:48.327 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T07:35:50.446 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:35:50.447 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:35:50.458 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:35:50.459 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:35:50.460 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:35:50.460 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:35:50.462 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:35:50.464 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:35:50.465 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:35:50.528 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:35:50.549 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:35:50.550 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:35:50.551 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T07:35:50.552 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:35:50.553 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:35:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:35:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:35:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:35:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:35:50.558 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:35:50.559 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:35:50.560 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout:Install 149 Packages 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 228 M 2024-09-21T07:35:50.561 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T07:35:50.996 INFO:teuthology.orchestra.run.smithi162.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-21T07:35:51.238 INFO:teuthology.orchestra.run.smithi162.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T07:35:51.355 INFO:teuthology.orchestra.run.smithi162.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T07:35:51.380 INFO:teuthology.orchestra.run.smithi162.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.0 MB/s | 148 kB 00:00 2024-09-21T07:35:51.489 INFO:teuthology.orchestra.run.smithi162.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 17 MB/s | 2.3 MB 00:00 2024-09-21T07:35:51.531 INFO:teuthology.orchestra.run.smithi162.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-21T07:35:51.722 INFO:teuthology.orchestra.run.smithi162.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 21 MB/s | 5.0 MB 00:00 2024-09-21T07:35:52.214 INFO:teuthology.orchestra.run.smithi162.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 15 MB/s | 20 MB 00:01 2024-09-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi162.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 760 kB/s | 25 kB 00:00 2024-09-21T07:35:52.357 INFO:teuthology.orchestra.run.smithi162.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 16 MB/s | 10 MB 00:00 2024-09-21T07:35:52.415 INFO:teuthology.orchestra.run.smithi162.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T07:35:52.632 INFO:teuthology.orchestra.run.smithi162.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 16 MB/s | 18 MB 00:01 2024-09-21T07:35:52.657 INFO:teuthology.orchestra.run.smithi162.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 112 kB/s | 27 kB 00:00 2024-09-21T07:35:52.683 INFO:teuthology.orchestra.run.smithi162.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 633 kB/s | 32 kB 00:00 2024-09-21T07:35:52.724 INFO:teuthology.orchestra.run.smithi162.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T07:35:52.750 INFO:teuthology.orchestra.run.smithi162.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T07:35:52.775 INFO:teuthology.orchestra.run.smithi162.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T07:35:52.800 INFO:teuthology.orchestra.run.smithi162.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T07:35:52.850 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T07:35:52.851 INFO:teuthology.orchestra.run.smithi162.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 908 kB/s | 45 kB 00:00 2024-09-21T07:35:52.918 INFO:teuthology.orchestra.run.smithi162.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T07:35:52.985 INFO:teuthology.orchestra.run.smithi162.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T07:35:53.060 INFO:teuthology.orchestra.run.smithi162.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T07:35:53.086 INFO:teuthology.orchestra.run.smithi162.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.1 MB/s | 321 kB 00:00 2024-09-21T07:35:53.092 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-21T07:35:53.119 INFO:teuthology.orchestra.run.smithi162.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T07:35:53.144 INFO:teuthology.orchestra.run.smithi162.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T07:35:53.170 INFO:teuthology.orchestra.run.smithi162.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi162.stdout:(27/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T07:35:53.329 INFO:teuthology.orchestra.run.smithi162.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.0 MB/s | 170 kB 00:00 2024-09-21T07:35:53.354 INFO:teuthology.orchestra.run.smithi162.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 683 kB/s | 34 kB 00:00 2024-09-21T07:35:53.396 INFO:teuthology.orchestra.run.smithi162.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T07:35:54.088 INFO:teuthology.orchestra.run.smithi162.stdout:(31/157): ceph-mgr-dashboard-19.3.0-5120.g18432 19 MB/s | 14 MB 00:00 2024-09-21T07:35:54.213 INFO:teuthology.orchestra.run.smithi162.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 9.0 MB/s | 7.4 MB 00:00 2024-09-21T07:35:54.238 INFO:teuthology.orchestra.run.smithi162.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.9 MB/s | 292 kB 00:00 2024-09-21T07:35:54.272 INFO:teuthology.orchestra.run.smithi162.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 844 kB/s | 49 kB 00:00 2024-09-21T07:35:54.289 INFO:teuthology.orchestra.run.smithi162.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 327 kB/s | 16 kB 00:00 2024-09-21T07:35:54.331 INFO:teuthology.orchestra.run.smithi162.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T07:35:54.373 INFO:teuthology.orchestra.run.smithi162.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-21T07:35:54.390 INFO:teuthology.orchestra.run.smithi162.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 314 kB/s | 18 kB 00:00 2024-09-21T07:35:54.815 INFO:teuthology.orchestra.run.smithi162.stdout:(39/157): ceph-test-19.3.0-5120.g18432218.el9.x 16 MB/s | 40 MB 00:02 2024-09-21T07:35:54.840 INFO:teuthology.orchestra.run.smithi162.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 171 kB/s | 80 kB 00:00 2024-09-21T07:35:54.932 INFO:teuthology.orchestra.run.smithi162.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-21T07:35:54.958 INFO:teuthology.orchestra.run.smithi162.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-21T07:35:54.983 INFO:teuthology.orchestra.run.smithi162.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-21T07:35:55.002 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:35:55.002 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:35:55.014 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:35:55.015 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:35:55.015 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:35:55.016 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:35:55.018 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:35:55.020 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:35:55.021 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:35:55.025 INFO:teuthology.orchestra.run.smithi162.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T07:35:55.058 INFO:teuthology.orchestra.run.smithi162.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-21T07:35:55.081 INFO:teuthology.orchestra.run.smithi162.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-21T07:35:55.082 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-21T07:35:55.106 INFO:teuthology.orchestra.run.smithi162.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:35:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:35:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:35:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:35:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:35:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:35:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:35:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:35:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:35:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:35:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:35:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:35:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:35:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-09-21T07:35:55.122 INFO:teuthology.orchestra.run.smithi191.stdout:Install 149 Packages 2024-09-21T07:35:55.123 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 8 Packages 2024-09-21T07:35:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:35:55.123 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 228 M 2024-09-21T07:35:55.123 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-21T07:35:55.131 INFO:teuthology.orchestra.run.smithi162.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.9 MB/s | 215 kB 00:00 2024-09-21T07:35:55.199 INFO:teuthology.orchestra.run.smithi162.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-09-21T07:35:55.224 INFO:teuthology.orchestra.run.smithi162.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-21T07:35:55.249 INFO:teuthology.orchestra.run.smithi162.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-21T07:35:55.274 INFO:teuthology.orchestra.run.smithi162.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-21T07:35:55.300 INFO:teuthology.orchestra.run.smithi162.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi162.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 432 kB/s | 33 kB 00:00 2024-09-21T07:35:55.409 INFO:teuthology.orchestra.run.smithi162.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-21T07:35:55.428 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:35:55.429 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:35:55.434 INFO:teuthology.orchestra.run.smithi162.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-21T07:35:55.440 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:35:55.441 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:35:55.442 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:35:55.443 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:35:55.445 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:35:55.447 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:35:55.448 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:35:55.459 INFO:teuthology.orchestra.run.smithi162.stdout:(57/157): flexiblas-openblas-openmp-3.0.4-8.el9 114 kB/s | 18 kB 00:00 2024-09-21T07:35:55.493 INFO:teuthology.orchestra.run.smithi162.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T07:35:55.513 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-21T07:35:55.518 INFO:teuthology.orchestra.run.smithi162.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:35:55.531 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:35:55.532 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:35:55.533 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:35:55.534 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:35:55.535 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:35:55.536 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:35:55.537 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:35:55.538 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:35:55.539 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:35:55.540 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:35:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:35:55.542 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:35:55.543 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T07:35:55.544 INFO:teuthology.orchestra.run.smithi084.stdout:Install 149 Packages 2024-09-21T07:35:55.545 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 8 Packages 2024-09-21T07:35:55.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:35:55.545 INFO:teuthology.orchestra.run.smithi162.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 540 kB/s | 45 kB 00:00 2024-09-21T07:35:55.546 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 228 M 2024-09-21T07:35:55.546 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-21T07:35:55.594 INFO:teuthology.orchestra.run.smithi162.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-21T07:35:55.619 INFO:teuthology.orchestra.run.smithi162.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-21T07:35:55.653 INFO:teuthology.orchestra.run.smithi162.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-21T07:35:55.678 INFO:teuthology.orchestra.run.smithi162.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 563 kB/s | 47 kB 00:00 2024-09-21T07:35:55.703 INFO:teuthology.orchestra.run.smithi162.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T07:35:55.737 INFO:teuthology.orchestra.run.smithi162.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T07:35:55.762 INFO:teuthology.orchestra.run.smithi162.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 459 kB/s | 38 kB 00:00 2024-09-21T07:35:55.835 INFO:teuthology.orchestra.run.smithi191.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T07:35:55.863 INFO:teuthology.orchestra.run.smithi162.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-21T07:35:55.904 INFO:teuthology.orchestra.run.smithi162.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T07:35:55.972 INFO:teuthology.orchestra.run.smithi162.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-21T07:35:55.997 INFO:teuthology.orchestra.run.smithi162.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T07:35:56.018 INFO:teuthology.orchestra.run.smithi191.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T07:35:56.064 INFO:teuthology.orchestra.run.smithi162.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T07:35:56.119 INFO:teuthology.orchestra.run.smithi191.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.4 MB/s | 148 kB 00:00 2024-09-21T07:35:56.122 INFO:teuthology.orchestra.run.smithi162.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T07:35:56.147 INFO:teuthology.orchestra.run.smithi162.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T07:35:56.210 INFO:teuthology.orchestra.run.smithi191.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T07:35:56.256 INFO:teuthology.orchestra.run.smithi162.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T07:35:56.282 INFO:teuthology.orchestra.run.smithi162.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 459 kB/s | 61 kB 00:00 2024-09-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi191.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-21T07:35:56.323 INFO:teuthology.orchestra.run.smithi162.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-21T07:35:56.349 INFO:teuthology.orchestra.run.smithi162.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-21T07:35:56.386 INFO:teuthology.orchestra.run.smithi191.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 8.6 MB/s | 2.3 MB 00:00 2024-09-21T07:35:56.441 INFO:teuthology.orchestra.run.smithi162.stdout:(79/157): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-21T07:35:56.458 INFO:teuthology.orchestra.run.smithi162.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 191 kB/s | 26 kB 00:00 2024-09-21T07:35:56.474 INFO:teuthology.orchestra.run.smithi162.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-09-21T07:35:56.500 INFO:teuthology.orchestra.run.smithi162.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T07:35:56.542 INFO:teuthology.orchestra.run.smithi162.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-09-21T07:35:56.567 INFO:teuthology.orchestra.run.smithi162.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T07:35:56.601 INFO:teuthology.orchestra.run.smithi162.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T07:35:56.601 INFO:teuthology.orchestra.run.smithi084.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-09-21T07:35:56.670 INFO:teuthology.orchestra.run.smithi191.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.0 MB 00:00 2024-09-21T07:35:56.676 INFO:teuthology.orchestra.run.smithi162.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-09-21T07:35:56.701 INFO:teuthology.orchestra.run.smithi162.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-21T07:35:56.718 INFO:teuthology.orchestra.run.smithi162.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 512 kB/s | 77 kB 00:00 2024-09-21T07:35:56.752 INFO:teuthology.orchestra.run.smithi162.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T07:35:56.777 INFO:teuthology.orchestra.run.smithi162.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T07:35:56.802 INFO:teuthology.orchestra.run.smithi162.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-21T07:35:56.818 INFO:teuthology.orchestra.run.smithi084.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.9 MB/s | 873 kB 00:00 2024-09-21T07:35:56.828 INFO:teuthology.orchestra.run.smithi162.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-21T07:35:56.853 INFO:teuthology.orchestra.run.smithi162.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 708 kB/s | 54 kB 00:00 2024-09-21T07:35:56.893 INFO:teuthology.orchestra.run.smithi084.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T07:35:56.895 INFO:teuthology.orchestra.run.smithi162.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-21T07:35:56.895 INFO:teuthology.orchestra.run.smithi191.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T07:35:56.920 INFO:teuthology.orchestra.run.smithi162.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-09-21T07:35:56.970 INFO:teuthology.orchestra.run.smithi162.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-21T07:35:56.979 INFO:teuthology.orchestra.run.smithi191.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 303 kB/s | 25 kB 00:00 2024-09-21T07:35:56.996 INFO:teuthology.orchestra.run.smithi162.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 476 kB/s | 36 kB 00:00 2024-09-21T07:35:57.029 INFO:teuthology.orchestra.run.smithi162.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-21T07:35:57.063 INFO:teuthology.orchestra.run.smithi162.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-21T07:35:57.097 INFO:teuthology.orchestra.run.smithi162.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 864 kB/s | 58 kB 00:00 2024-09-21T07:35:57.122 INFO:teuthology.orchestra.run.smithi162.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T07:35:57.164 INFO:teuthology.orchestra.run.smithi162.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-21T07:35:57.189 INFO:teuthology.orchestra.run.smithi162.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-21T07:35:57.310 INFO:teuthology.orchestra.run.smithi084.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 5.5 MB/s | 5.5 MB 00:01 2024-09-21T07:35:57.382 INFO:teuthology.orchestra.run.smithi162.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-21T07:35:57.410 INFO:teuthology.orchestra.run.smithi084.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.4 MB/s | 2.3 MB 00:00 2024-09-21T07:35:57.432 INFO:teuthology.orchestra.run.smithi162.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T07:35:57.457 INFO:teuthology.orchestra.run.smithi162.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T07:35:57.482 INFO:teuthology.orchestra.run.smithi162.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-21T07:35:57.560 INFO:teuthology.orchestra.run.smithi084.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.1 MB/s | 1.5 MB 00:00 2024-09-21T07:35:57.591 INFO:teuthology.orchestra.run.smithi162.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T07:35:57.616 INFO:teuthology.orchestra.run.smithi162.stdout:(109/157): lua-devel-5.4.4-4.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2024-09-21T07:35:57.641 INFO:teuthology.orchestra.run.smithi162.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-21T07:35:57.667 INFO:teuthology.orchestra.run.smithi162.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 3.8 MB/s | 67 kB 00:00 2024-09-21T07:35:57.700 INFO:teuthology.orchestra.run.smithi162.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-21T07:35:57.725 INFO:teuthology.orchestra.run.smithi162.stdout:(113/157): liboath-2.6.7-2.el9.x86_64.rpm 445 kB/s | 49 kB 00:00 2024-09-21T07:35:57.767 INFO:teuthology.orchestra.run.smithi162.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-21T07:35:57.793 INFO:teuthology.orchestra.run.smithi162.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T07:35:57.818 INFO:teuthology.orchestra.run.smithi162.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-21T07:35:57.820 INFO:teuthology.orchestra.run.smithi191.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 9.1 MB/s | 10 MB 00:01 2024-09-21T07:35:57.843 INFO:teuthology.orchestra.run.smithi162.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 645 kB/s | 32 kB 00:00 2024-09-21T07:35:57.868 INFO:teuthology.orchestra.run.smithi162.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T07:35:57.894 INFO:teuthology.orchestra.run.smithi162.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T07:35:57.904 INFO:teuthology.orchestra.run.smithi191.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.7 MB/s | 226 kB 00:00 2024-09-21T07:35:57.919 INFO:teuthology.orchestra.run.smithi162.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-09-21T07:35:57.945 INFO:teuthology.orchestra.run.smithi162.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T07:35:57.970 INFO:teuthology.orchestra.run.smithi162.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T07:35:57.996 INFO:teuthology.orchestra.run.smithi191.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 295 kB/s | 27 kB 00:00 2024-09-21T07:35:58.003 INFO:teuthology.orchestra.run.smithi162.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T07:35:58.029 INFO:teuthology.orchestra.run.smithi162.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T07:35:58.054 INFO:teuthology.orchestra.run.smithi162.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-21T07:35:58.080 INFO:teuthology.orchestra.run.smithi162.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-21T07:35:58.088 INFO:teuthology.orchestra.run.smithi191.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 346 kB/s | 32 kB 00:00 2024-09-21T07:35:58.105 INFO:teuthology.orchestra.run.smithi162.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-21T07:35:58.130 INFO:teuthology.orchestra.run.smithi162.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T07:35:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-21T07:35:58.197 INFO:teuthology.orchestra.run.smithi162.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T07:35:58.214 INFO:teuthology.orchestra.run.smithi162.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-21T07:35:58.239 INFO:teuthology.orchestra.run.smithi162.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-21T07:35:58.271 INFO:teuthology.orchestra.run.smithi191.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 4.1 MB/s | 766 kB 00:00 2024-09-21T07:35:58.273 INFO:teuthology.orchestra.run.smithi162.stdout:(133/157): protobuf-compiler-3.14.0-13.el9.x86_ 797 kB/s | 863 kB 00:01 2024-09-21T07:35:58.307 INFO:teuthology.orchestra.run.smithi162.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T07:35:58.341 INFO:teuthology.orchestra.run.smithi162.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.4 MB/s | 90 kB 00:00 2024-09-21T07:35:58.366 INFO:teuthology.orchestra.run.smithi162.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-21T07:35:58.372 INFO:teuthology.orchestra.run.smithi191.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.5 MB/s | 158 kB 00:00 2024-09-21T07:35:58.391 INFO:teuthology.orchestra.run.smithi162.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 586 kB/s | 28 kB 00:00 2024-09-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi162.stdout:(138/157): python3-portend-3.1.0-2.el9.noarch.r 122 kB/s | 16 kB 00:00 2024-09-21T07:35:58.425 INFO:teuthology.orchestra.run.smithi162.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-09-21T07:35:58.442 INFO:teuthology.orchestra.run.smithi162.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-21T07:35:58.459 INFO:teuthology.orchestra.run.smithi162.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-21T07:35:58.464 INFO:teuthology.orchestra.run.smithi191.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.4 MB/s | 127 kB 00:00 2024-09-21T07:35:58.484 INFO:teuthology.orchestra.run.smithi162.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-21T07:35:58.502 INFO:teuthology.orchestra.run.smithi084.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 4.6 MB/s | 5.0 MB 00:01 2024-09-21T07:35:58.509 INFO:teuthology.orchestra.run.smithi162.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-21T07:35:58.535 INFO:teuthology.orchestra.run.smithi162.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T07:35:58.555 INFO:teuthology.orchestra.run.smithi191.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.4 MB/s | 507 kB 00:00 2024-09-21T07:35:58.560 INFO:teuthology.orchestra.run.smithi162.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-21T07:35:58.585 INFO:teuthology.orchestra.run.smithi162.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-21T07:35:58.610 INFO:teuthology.orchestra.run.smithi162.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T07:35:58.636 INFO:teuthology.orchestra.run.smithi162.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T07:35:58.686 INFO:teuthology.orchestra.run.smithi162.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:35:58.770 INFO:teuthology.orchestra.run.smithi162.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 28 MB/s | 2.3 MB 00:00 2024-09-21T07:35:58.837 INFO:teuthology.orchestra.run.smithi162.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-21T07:35:58.887 INFO:teuthology.orchestra.run.smithi162.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 821 kB/s | 41 kB 00:00 2024-09-21T07:35:58.889 INFO:teuthology.orchestra.run.smithi191.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 7.1 MB/s | 18 MB 00:02 2024-09-21T07:35:58.936 INFO:teuthology.orchestra.run.smithi084.stdout:(8/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 13 MB/s | 18 MB 00:01 2024-09-21T07:35:58.946 INFO:teuthology.orchestra.run.smithi162.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-21T07:35:59.013 INFO:teuthology.orchestra.run.smithi162.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T07:35:59.019 INFO:teuthology.orchestra.run.smithi084.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 303 kB/s | 25 kB 00:00 2024-09-21T07:35:59.039 INFO:teuthology.orchestra.run.smithi191.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 301 kB/s | 45 kB 00:00 2024-09-21T07:35:59.063 INFO:teuthology.orchestra.run.smithi162.stdout:(155/157): librados2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 3.4 MB 00:00 2024-09-21T07:35:59.113 INFO:teuthology.orchestra.run.smithi162.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-21T07:35:59.156 INFO:teuthology.orchestra.run.smithi191.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.2 MB/s | 148 kB 00:00 2024-09-21T07:35:59.163 INFO:teuthology.orchestra.run.smithi162.stdout:(157/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.0 MB/s | 3.2 MB 00:00 2024-09-21T07:35:59.169 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:35:59.169 INFO:teuthology.orchestra.run.smithi162.stdout:Total 26 MB/s | 228 MB 00:08 2024-09-21T07:35:59.249 INFO:teuthology.orchestra.run.smithi191.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.7 MB/s | 161 kB 00:00 2024-09-21T07:35:59.341 INFO:teuthology.orchestra.run.smithi191.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T07:35:59.433 INFO:teuthology.orchestra.run.smithi191.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.3 MB/s | 307 kB 00:00 2024-09-21T07:35:59.508 INFO:teuthology.orchestra.run.smithi191.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 5.5 MB/s | 5.3 MB 00:00 2024-09-21T07:35:59.534 INFO:teuthology.orchestra.run.smithi191.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 989 kB/s | 99 kB 00:00 2024-09-21T07:35:59.926 INFO:teuthology.orchestra.run.smithi191.stdout:(26/157): ceph-test-19.3.0-5120.g18432218.el9.x 14 MB/s | 40 MB 00:02 2024-09-21T07:35:59.959 INFO:teuthology.orchestra.run.smithi191.stdout:(27/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 192 kB/s | 86 kB 00:00 2024-09-21T07:35:59.993 INFO:teuthology.orchestra.run.smithi191.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T07:36:00.026 INFO:teuthology.orchestra.run.smithi191.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 512 kB/s | 34 kB 00:00 2024-09-21T07:36:00.093 INFO:teuthology.orchestra.run.smithi191.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.5 MB/s | 3.1 MB 00:00 2024-09-21T07:36:00.119 INFO:teuthology.orchestra.run.smithi191.stdout:(31/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.2 MB/s | 154 kB 00:00 2024-09-21T07:36:00.136 INFO:teuthology.orchestra.run.smithi084.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 6.4 MB/s | 10 MB 00:01 2024-09-21T07:36:00.169 INFO:teuthology.orchestra.run.smithi191.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T07:36:00.203 INFO:teuthology.orchestra.run.smithi084.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T07:36:00.236 INFO:teuthology.orchestra.run.smithi191.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 740 kB/s | 49 kB 00:00 2024-09-21T07:36:00.261 INFO:teuthology.orchestra.run.smithi084.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 464 kB/s | 27 kB 00:00 2024-09-21T07:36:00.303 INFO:teuthology.orchestra.run.smithi191.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 248 kB/s | 16 kB 00:00 2024-09-21T07:36:00.328 INFO:teuthology.orchestra.run.smithi084.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 478 kB/s | 32 kB 00:00 2024-09-21T07:36:00.378 INFO:teuthology.orchestra.run.smithi191.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T07:36:00.425 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T07:36:00.487 INFO:teuthology.orchestra.run.smithi084.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 4.7 MB/s | 766 kB 00:00 2024-09-21T07:36:00.520 INFO:teuthology.orchestra.run.smithi191.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.4 MB/s | 784 kB 00:00 2024-09-21T07:36:00.554 INFO:teuthology.orchestra.run.smithi084.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T07:36:00.579 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T07:36:00.579 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T07:36:00.587 INFO:teuthology.orchestra.run.smithi191.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T07:36:00.712 INFO:teuthology.orchestra.run.smithi191.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 640 kB/s | 80 kB 00:00 2024-09-21T07:36:00.779 INFO:teuthology.orchestra.run.smithi084.stdout:(16/157): ceph-common-19.3.0-5120.g18432218.el9 4.5 MB/s | 20 MB 00:04 2024-09-21T07:36:00.804 INFO:teuthology.orchestra.run.smithi084.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 507 kB/s | 127 kB 00:00 2024-09-21T07:36:00.838 INFO:teuthology.orchestra.run.smithi191.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 9.9 MB/s | 7.4 MB 00:00 2024-09-21T07:36:00.905 INFO:teuthology.orchestra.run.smithi191.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-21T07:36:00.955 INFO:teuthology.orchestra.run.smithi191.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-21T07:36:00.980 INFO:teuthology.orchestra.run.smithi191.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-21T07:36:01.031 INFO:teuthology.orchestra.run.smithi191.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-21T07:36:01.057 INFO:teuthology.orchestra.run.smithi191.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T07:36:01.081 INFO:teuthology.orchestra.run.smithi191.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T07:36:01.106 INFO:teuthology.orchestra.run.smithi191.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T07:36:01.132 INFO:teuthology.orchestra.run.smithi191.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T07:36:01.180 INFO:teuthology.orchestra.run.smithi084.stdout:(18/157): ceph-test-19.3.0-5120.g18432218.el9.x 18 MB/s | 40 MB 00:02 2024-09-21T07:36:01.222 INFO:teuthology.orchestra.run.smithi084.stdout:(19/157): libradosstriper1-19.3.0-5120.g1843221 1.1 MB/s | 507 kB 00:00 2024-09-21T07:36:01.238 INFO:teuthology.orchestra.run.smithi084.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 776 kB/s | 45 kB 00:00 2024-09-21T07:36:01.265 INFO:teuthology.orchestra.run.smithi191.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-21T07:36:01.289 INFO:teuthology.orchestra.run.smithi084.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T07:36:01.314 INFO:teuthology.orchestra.run.smithi084.stdout:(22/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T07:36:01.347 INFO:teuthology.orchestra.run.smithi084.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T07:36:01.398 INFO:teuthology.orchestra.run.smithi084.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.6 MB/s | 307 kB 00:00 2024-09-21T07:36:01.423 INFO:teuthology.orchestra.run.smithi084.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.3 MB/s | 99 kB 00:00 2024-09-21T07:36:01.424 INFO:teuthology.orchestra.run.smithi191.stdout:(49/157): ceph-mgr-dashboard-19.3.0-5120.g18432 10 MB/s | 14 MB 00:01 2024-09-21T07:36:01.449 INFO:teuthology.orchestra.run.smithi084.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:36:01.449 INFO:teuthology.orchestra.run.smithi191.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 582 kB/s | 107 kB 00:00 2024-09-21T07:36:01.491 INFO:teuthology.orchestra.run.smithi191.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-21T07:36:01.533 INFO:teuthology.orchestra.run.smithi191.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-21T07:36:01.557 INFO:teuthology.orchestra.run.smithi084.stdout:(27/157): librgw2-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 5.3 MB 00:00 2024-09-21T07:36:01.558 INFO:teuthology.orchestra.run.smithi191.stdout:(53/157): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-09-21T07:36:01.574 INFO:teuthology.orchestra.run.smithi084.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.3 MB/s | 170 kB 00:00 2024-09-21T07:36:01.583 INFO:teuthology.orchestra.run.smithi191.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-21T07:36:01.599 INFO:teuthology.orchestra.run.smithi084.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 827 kB/s | 34 kB 00:00 2024-09-21T07:36:01.625 INFO:teuthology.orchestra.run.smithi084.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T07:36:01.634 INFO:teuthology.orchestra.run.smithi191.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-21T07:36:01.659 INFO:teuthology.orchestra.run.smithi191.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-21T07:36:01.709 INFO:teuthology.orchestra.run.smithi191.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-21T07:36:01.735 INFO:teuthology.orchestra.run.smithi191.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-21T07:36:01.760 INFO:teuthology.orchestra.run.smithi191.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-21T07:36:01.802 INFO:teuthology.orchestra.run.smithi191.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-09-21T07:36:01.844 INFO:teuthology.orchestra.run.smithi191.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-21T07:36:01.869 INFO:teuthology.orchestra.run.smithi191.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-21T07:36:01.894 INFO:teuthology.orchestra.run.smithi191.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-21T07:36:01.908 INFO:teuthology.orchestra.run.smithi084.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.4 MB/s | 3.1 MB 00:00 2024-09-21T07:36:01.920 INFO:teuthology.orchestra.run.smithi191.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-21T07:36:01.945 INFO:teuthology.orchestra.run.smithi191.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-21T07:36:01.970 INFO:teuthology.orchestra.run.smithi191.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T07:36:01.996 INFO:teuthology.orchestra.run.smithi191.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 508 kB/s | 38 kB 00:00 2024-09-21T07:36:02.000 INFO:teuthology.orchestra.run.smithi084.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-21T07:36:02.025 INFO:teuthology.orchestra.run.smithi084.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.4 MB/s | 292 kB 00:00 2024-09-21T07:36:02.050 INFO:teuthology.orchestra.run.smithi084.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 991 kB/s | 49 kB 00:00 2024-09-21T07:36:02.076 INFO:teuthology.orchestra.run.smithi084.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T07:36:02.096 INFO:teuthology.orchestra.run.smithi191.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-21T07:36:02.101 INFO:teuthology.orchestra.run.smithi084.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T07:36:02.151 INFO:teuthology.orchestra.run.smithi084.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 369 kB/s | 18 kB 00:00 2024-09-21T07:36:02.196 INFO:teuthology.orchestra.run.smithi191.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-21T07:36:02.201 INFO:teuthology.orchestra.run.smithi084.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 6.1 MB/s | 784 kB 00:00 2024-09-21T07:36:02.238 INFO:teuthology.orchestra.run.smithi191.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-09-21T07:36:02.252 INFO:teuthology.orchestra.run.smithi084.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 798 kB/s | 80 kB 00:00 2024-09-21T07:36:02.263 INFO:teuthology.orchestra.run.smithi191.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T07:36:02.305 INFO:teuthology.orchestra.run.smithi191.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-21T07:36:02.319 INFO:teuthology.orchestra.run.smithi084.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T07:36:02.347 INFO:teuthology.orchestra.run.smithi191.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-21T07:36:02.369 INFO:teuthology.orchestra.run.smithi084.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-21T07:36:02.373 INFO:teuthology.orchestra.run.smithi191.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T07:36:02.399 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T07:36:02.399 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T07:36:02.419 INFO:teuthology.orchestra.run.smithi084.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-21T07:36:02.439 INFO:teuthology.orchestra.run.smithi191.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 921 kB/s | 61 kB 00:00 2024-09-21T07:36:02.461 INFO:teuthology.orchestra.run.smithi084.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T07:36:02.495 INFO:teuthology.orchestra.run.smithi084.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-21T07:36:02.532 INFO:teuthology.orchestra.run.smithi191.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 6.0 MB 00:00 2024-09-21T07:36:02.545 INFO:teuthology.orchestra.run.smithi084.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-21T07:36:02.570 INFO:teuthology.orchestra.run.smithi084.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T07:36:02.596 INFO:teuthology.orchestra.run.smithi084.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T07:36:02.615 INFO:teuthology.orchestra.run.smithi191.stdout:(77/157): postgresql-server-13.16-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-09-21T07:36:02.640 INFO:teuthology.orchestra.run.smithi191.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-21T07:36:02.666 INFO:teuthology.orchestra.run.smithi191.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-21T07:36:02.691 INFO:teuthology.orchestra.run.smithi191.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-21T07:36:02.724 INFO:teuthology.orchestra.run.smithi191.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 228 kB/s | 19 kB 00:00 2024-09-21T07:36:02.750 INFO:teuthology.orchestra.run.smithi191.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T07:36:02.775 INFO:teuthology.orchestra.run.smithi191.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 414 kB/s | 35 kB 00:00 2024-09-21T07:36:02.817 INFO:teuthology.orchestra.run.smithi191.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T07:36:02.838 INFO:teuthology.orchestra.run.smithi084.stdout:(48/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T07:36:02.901 INFO:teuthology.orchestra.run.smithi191.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-09-21T07:36:02.926 INFO:teuthology.orchestra.run.smithi191.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-21T07:36:02.951 INFO:teuthology.orchestra.run.smithi191.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 576 kB/s | 77 kB 00:00 2024-09-21T07:36:02.968 INFO:teuthology.orchestra.run.smithi191.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-21T07:36:03.002 INFO:teuthology.orchestra.run.smithi191.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T07:36:03.027 INFO:teuthology.orchestra.run.smithi191.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T07:36:03.052 INFO:teuthology.orchestra.run.smithi191.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-21T07:36:03.078 INFO:teuthology.orchestra.run.smithi191.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-21T07:36:03.103 INFO:teuthology.orchestra.run.smithi191.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-21T07:36:03.145 INFO:teuthology.orchestra.run.smithi191.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-21T07:36:03.170 INFO:teuthology.orchestra.run.smithi191.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 657 kB/s | 44 kB 00:00 2024-09-21T07:36:03.204 INFO:teuthology.orchestra.run.smithi191.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T07:36:03.229 INFO:teuthology.orchestra.run.smithi191.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-21T07:36:03.254 INFO:teuthology.orchestra.run.smithi191.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T07:36:03.288 INFO:teuthology.orchestra.run.smithi191.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T07:36:03.313 INFO:teuthology.orchestra.run.smithi084.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 225 kB/s | 107 kB 00:00 2024-09-21T07:36:03.314 INFO:teuthology.orchestra.run.smithi191.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-09-21T07:36:03.347 INFO:teuthology.orchestra.run.smithi191.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T07:36:03.372 INFO:teuthology.orchestra.run.smithi191.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T07:36:03.388 INFO:teuthology.orchestra.run.smithi084.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 843 kB/s | 689 kB 00:00 2024-09-21T07:36:03.413 INFO:teuthology.orchestra.run.smithi084.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 217 kB/s | 22 kB 00:00 2024-09-21T07:36:03.480 INFO:teuthology.orchestra.run.smithi084.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-21T07:36:03.505 INFO:teuthology.orchestra.run.smithi084.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T07:36:03.522 INFO:teuthology.orchestra.run.smithi084.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-21T07:36:03.531 INFO:teuthology.orchestra.run.smithi191.stdout:(103/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-21T07:36:03.556 INFO:teuthology.orchestra.run.smithi191.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 214 kB/s | 45 kB 00:00 2024-09-21T07:36:03.606 INFO:teuthology.orchestra.run.smithi191.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T07:36:03.614 INFO:teuthology.orchestra.run.smithi084.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-21T07:36:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-21T07:36:03.632 INFO:teuthology.orchestra.run.smithi191.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T07:36:03.657 INFO:teuthology.orchestra.run.smithi191.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-21T07:36:03.732 INFO:teuthology.orchestra.run.smithi084.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-21T07:36:03.774 INFO:teuthology.orchestra.run.smithi191.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T07:36:03.790 INFO:teuthology.orchestra.run.smithi084.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.7 MB/s | 3.0 MB 00:00 2024-09-21T07:36:03.807 INFO:teuthology.orchestra.run.smithi191.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T07:36:03.832 INFO:teuthology.orchestra.run.smithi084.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 800 kB/s | 160 kB 00:00 2024-09-21T07:36:03.832 INFO:teuthology.orchestra.run.smithi191.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:36:03.849 INFO:teuthology.orchestra.run.smithi084.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-21T07:36:03.858 INFO:teuthology.orchestra.run.smithi191.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T07:36:03.883 INFO:teuthology.orchestra.run.smithi191.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T07:36:03.908 INFO:teuthology.orchestra.run.smithi084.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T07:36:03.917 INFO:teuthology.orchestra.run.smithi191.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T07:36:03.949 INFO:teuthology.orchestra.run.smithi084.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 245 kB/s | 24 kB 00:00 2024-09-21T07:36:03.959 INFO:teuthology.orchestra.run.smithi191.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T07:36:03.984 INFO:teuthology.orchestra.run.smithi191.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T07:36:04.008 INFO:teuthology.orchestra.run.smithi084.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-21T07:36:04.009 INFO:teuthology.orchestra.run.smithi191.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T07:36:04.034 INFO:teuthology.orchestra.run.smithi191.stdout:(117/157): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-09-21T07:36:04.075 INFO:teuthology.orchestra.run.smithi084.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-21T07:36:04.085 INFO:teuthology.orchestra.run.smithi191.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 190 kB/s | 14 kB 00:00 2024-09-21T07:36:04.117 INFO:teuthology.orchestra.run.smithi084.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.0 MB/s | 581 kB 00:00 2024-09-21T07:36:04.118 INFO:teuthology.orchestra.run.smithi191.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 13 MB/s | 358 kB 00:00 2024-09-21T07:36:04.142 INFO:teuthology.orchestra.run.smithi084.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-21T07:36:04.152 INFO:teuthology.orchestra.run.smithi191.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.4 MB/s | 303 kB 00:00 2024-09-21T07:36:04.186 INFO:teuthology.orchestra.run.smithi191.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-21T07:36:04.200 INFO:teuthology.orchestra.run.smithi084.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-21T07:36:04.211 INFO:teuthology.orchestra.run.smithi191.stdout:(122/157): python3-cheroot-8.6.0-4.el9.noarch.r 975 kB/s | 172 kB 00:00 2024-09-21T07:36:04.253 INFO:teuthology.orchestra.run.smithi191.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-21T07:36:04.278 INFO:teuthology.orchestra.run.smithi191.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T07:36:04.312 INFO:teuthology.orchestra.run.smithi191.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 525 kB/s | 18 kB 00:00 2024-09-21T07:36:04.329 INFO:teuthology.orchestra.run.smithi191.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T07:36:04.363 INFO:teuthology.orchestra.run.smithi191.stdout:(127/157): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-09-21T07:36:04.380 INFO:teuthology.orchestra.run.smithi191.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-21T07:36:04.393 INFO:teuthology.orchestra.run.smithi084.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-21T07:36:04.396 INFO:teuthology.orchestra.run.smithi191.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-09-21T07:36:04.422 INFO:teuthology.orchestra.run.smithi191.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T07:36:04.435 INFO:teuthology.orchestra.run.smithi084.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-21T07:36:04.447 INFO:teuthology.orchestra.run.smithi191.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:36:04.472 INFO:teuthology.orchestra.run.smithi191.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T07:36:04.497 INFO:teuthology.orchestra.run.smithi191.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-21T07:36:04.523 INFO:teuthology.orchestra.run.smithi191.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T07:36:04.543 INFO:teuthology.orchestra.run.smithi084.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 5.9 MB/s | 910 kB 00:00 2024-09-21T07:36:04.548 INFO:teuthology.orchestra.run.smithi191.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T07:36:04.568 INFO:teuthology.orchestra.run.smithi084.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-09-21T07:36:04.573 INFO:teuthology.orchestra.run.smithi191.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T07:36:04.599 INFO:teuthology.orchestra.run.smithi191.stdout:(137/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-21T07:36:04.624 INFO:teuthology.orchestra.run.smithi191.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-21T07:36:04.649 INFO:teuthology.orchestra.run.smithi191.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:36:04.675 INFO:teuthology.orchestra.run.smithi191.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T07:36:04.700 INFO:teuthology.orchestra.run.smithi191.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T07:36:04.710 INFO:teuthology.orchestra.run.smithi084.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-21T07:36:04.725 INFO:teuthology.orchestra.run.smithi191.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T07:36:04.750 INFO:teuthology.orchestra.run.smithi191.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T07:36:04.775 INFO:teuthology.orchestra.run.smithi191.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T07:36:04.801 INFO:teuthology.orchestra.run.smithi191.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-21T07:36:04.819 INFO:teuthology.orchestra.run.smithi084.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-21T07:36:04.843 INFO:teuthology.orchestra.run.smithi191.stdout:(146/157): protobuf-compiler-3.14.0-13.el9.x86_ 658 kB/s | 863 kB 00:01 2024-09-21T07:36:04.844 INFO:teuthology.orchestra.run.smithi084.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 656 kB/s | 87 kB 00:00 2024-09-21T07:36:04.876 INFO:teuthology.orchestra.run.smithi191.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T07:36:04.901 INFO:teuthology.orchestra.run.smithi191.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T07:36:04.952 INFO:teuthology.orchestra.run.smithi191.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T07:36:04.969 INFO:teuthology.orchestra.run.smithi084.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 490 kB/s | 61 kB 00:00 2024-09-21T07:36:05.128 INFO:teuthology.orchestra.run.smithi084.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-21T07:36:05.146 INFO:teuthology.orchestra.run.smithi191.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T07:36:05.153 INFO:teuthology.orchestra.run.smithi084.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-21T07:36:05.222 INFO:teuthology.orchestra.run.smithi191.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 10 MB/s | 3.4 MB 00:00 2024-09-21T07:36:05.246 INFO:teuthology.orchestra.run.smithi084.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-21T07:36:05.270 INFO:teuthology.orchestra.run.smithi084.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-21T07:36:05.278 INFO:teuthology.orchestra.run.smithi191.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.4 MB/s | 3.2 MB 00:00 2024-09-21T07:36:05.303 INFO:teuthology.orchestra.run.smithi191.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-21T07:36:05.345 INFO:teuthology.orchestra.run.smithi191.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 9.0 MB/s | 1.8 MB 00:00 2024-09-21T07:36:05.354 INFO:teuthology.orchestra.run.smithi084.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-21T07:36:05.388 INFO:teuthology.orchestra.run.smithi084.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T07:36:05.421 INFO:teuthology.orchestra.run.smithi191.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-21T07:36:05.446 INFO:teuthology.orchestra.run.smithi191.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.5 MB/s | 249 kB 00:00 2024-09-21T07:36:05.463 INFO:teuthology.orchestra.run.smithi084.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-21T07:36:05.504 INFO:teuthology.orchestra.run.smithi191.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 6.7 MB/s | 1.4 MB 00:00 2024-09-21T07:36:05.511 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:36:05.511 INFO:teuthology.orchestra.run.smithi191.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T07:36:05.589 INFO:teuthology.orchestra.run.smithi084.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-21T07:36:05.705 INFO:teuthology.orchestra.run.smithi084.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T07:36:05.823 INFO:teuthology.orchestra.run.smithi084.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 661 kB/s | 77 kB 00:00 2024-09-21T07:36:05.973 INFO:teuthology.orchestra.run.smithi084.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.7 MB/s | 5.1 MB 00:00 2024-09-21T07:36:06.006 INFO:teuthology.orchestra.run.smithi084.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 230 kB/s | 42 kB 00:00 2024-09-21T07:36:06.090 INFO:teuthology.orchestra.run.smithi084.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-21T07:36:06.123 INFO:teuthology.orchestra.run.smithi084.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T07:36:06.207 INFO:teuthology.orchestra.run.smithi084.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T07:36:06.232 INFO:teuthology.orchestra.run.smithi084.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-21T07:36:06.307 INFO:teuthology.orchestra.run.smithi084.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 536 kB/s | 54 kB 00:00 2024-09-21T07:36:06.466 INFO:teuthology.orchestra.run.smithi084.stdout:(93/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.1 MB/s | 4.9 MB 00:02 2024-09-21T07:36:06.483 INFO:teuthology.orchestra.run.smithi084.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 237 kB/s | 42 kB 00:00 2024-09-21T07:36:06.575 INFO:teuthology.orchestra.run.smithi084.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 409 kB/s | 44 kB 00:00 2024-09-21T07:36:06.600 INFO:teuthology.orchestra.run.smithi084.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T07:36:06.692 INFO:teuthology.orchestra.run.smithi084.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-21T07:36:06.709 INFO:teuthology.orchestra.run.smithi084.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-21T07:36:06.763 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-21T07:36:06.826 INFO:teuthology.orchestra.run.smithi084.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 496 kB/s | 58 kB 00:00 2024-09-21T07:36:06.917 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-21T07:36:06.917 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-21T07:36:06.994 INFO:teuthology.orchestra.run.smithi084.stdout:(100/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-21T07:36:07.018 INFO:teuthology.orchestra.run.smithi084.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 935 kB/s | 304 kB 00:00 2024-09-21T07:36:07.043 INFO:teuthology.orchestra.run.smithi084.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 441 kB/s | 96 kB 00:00 2024-09-21T07:36:07.102 INFO:teuthology.orchestra.run.smithi084.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 587 kB/s | 64 kB 00:00 2024-09-21T07:36:07.127 INFO:teuthology.orchestra.run.smithi084.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-21T07:36:07.185 INFO:teuthology.orchestra.run.smithi084.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T07:36:07.219 INFO:teuthology.orchestra.run.smithi084.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T07:36:07.245 INFO:teuthology.orchestra.run.smithi084.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-21T07:36:07.370 INFO:teuthology.orchestra.run.smithi084.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T07:36:07.395 INFO:teuthology.orchestra.run.smithi084.stdout:(109/157): lua-devel-5.4.4-4.el9.x86_64.rpm 63 kB/s | 22 kB 00:00 2024-09-21T07:36:07.420 INFO:teuthology.orchestra.run.smithi084.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-21T07:36:07.453 INFO:teuthology.orchestra.run.smithi084.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-21T07:36:07.479 INFO:teuthology.orchestra.run.smithi084.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-09-21T07:36:07.504 INFO:teuthology.orchestra.run.smithi084.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T07:36:07.546 INFO:teuthology.orchestra.run.smithi084.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T07:36:07.571 INFO:teuthology.orchestra.run.smithi084.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T07:36:07.597 INFO:teuthology.orchestra.run.smithi084.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T07:36:07.730 INFO:teuthology.orchestra.run.smithi084.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-09-21T07:36:07.780 INFO:teuthology.orchestra.run.smithi084.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 77 kB/s | 14 kB 00:00 2024-09-21T07:36:07.823 INFO:teuthology.orchestra.run.smithi084.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-21T07:36:07.864 INFO:teuthology.orchestra.run.smithi084.stdout:(120/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-21T07:36:07.898 INFO:teuthology.orchestra.run.smithi084.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-21T07:36:07.932 INFO:teuthology.orchestra.run.smithi084.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-21T07:36:07.965 INFO:teuthology.orchestra.run.smithi084.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-21T07:36:07.998 INFO:teuthology.orchestra.run.smithi084.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.2 MB/s | 144 kB 00:00 2024-09-21T07:36:08.023 INFO:teuthology.orchestra.run.smithi084.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 186 kB/s | 11 kB 00:00 2024-09-21T07:36:08.048 INFO:teuthology.orchestra.run.smithi084.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-21T07:36:08.082 INFO:teuthology.orchestra.run.smithi084.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 394 kB/s | 23 kB 00:00 2024-09-21T07:36:08.107 INFO:teuthology.orchestra.run.smithi084.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2024-09-21T07:36:08.132 INFO:teuthology.orchestra.run.smithi084.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-21T07:36:08.166 INFO:teuthology.orchestra.run.smithi084.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi084.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:36:08.217 INFO:teuthology.orchestra.run.smithi084.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T07:36:08.251 INFO:teuthology.orchestra.run.smithi084.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T07:36:08.276 INFO:teuthology.orchestra.run.smithi084.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-21T07:36:08.301 INFO:teuthology.orchestra.run.smithi084.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T07:36:08.335 INFO:teuthology.orchestra.run.smithi084.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-21T07:36:08.360 INFO:teuthology.orchestra.run.smithi084.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 484 kB/s | 28 kB 00:00 2024-09-21T07:36:08.385 INFO:teuthology.orchestra.run.smithi084.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-21T07:36:08.410 INFO:teuthology.orchestra.run.smithi084.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:36:08.444 INFO:teuthology.orchestra.run.smithi084.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-09-21T07:36:08.461 INFO:teuthology.orchestra.run.smithi084.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T07:36:08.486 INFO:teuthology.orchestra.run.smithi084.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-21T07:36:08.511 INFO:teuthology.orchestra.run.smithi084.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T07:36:08.536 INFO:teuthology.orchestra.run.smithi084.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T07:36:08.554 INFO:teuthology.orchestra.run.smithi084.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T07:36:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:(146/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.9 MB/s | 2.0 MB 00:00 2024-09-21T07:36:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T07:36:08.679 INFO:teuthology.orchestra.run.smithi084.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-21T07:36:08.706 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T07:36:08.726 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-21T07:36:08.726 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-21T07:36:08.730 INFO:teuthology.orchestra.run.smithi084.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T07:36:08.775 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:36:08.899 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:36:08.913 INFO:teuthology.orchestra.run.smithi084.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T07:36:08.967 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:36:08.988 INFO:teuthology.orchestra.run.smithi084.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-21T07:36:09.001 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:36:09.026 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:36:09.047 INFO:teuthology.orchestra.run.smithi084.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 8.1 MB/s | 3.4 MB 00:00 2024-09-21T07:36:09.069 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:36:09.089 INFO:teuthology.orchestra.run.smithi084.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 409 kB/s | 41 kB 00:00 2024-09-21T07:36:09.131 INFO:teuthology.orchestra.run.smithi084.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 8.3 MB/s | 1.8 MB 00:00 2024-09-21T07:36:09.214 INFO:teuthology.orchestra.run.smithi084.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-21T07:36:09.240 INFO:teuthology.orchestra.run.smithi084.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.3 MB/s | 249 kB 00:00 2024-09-21T07:36:09.282 INFO:teuthology.orchestra.run.smithi084.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-09-21T07:36:09.287 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:36:09.287 INFO:teuthology.orchestra.run.smithi084.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-21T07:36:09.410 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:36:09.536 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:36:09.662 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:36:09.704 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:36:09.786 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:36:09.816 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:36:09.846 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:36:09.999 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:36:10.048 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:36:10.076 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:36:10.181 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:36:10.211 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:36:10.273 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:36:10.295 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:36:10.321 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:36:10.513 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:36:10.645 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:36:10.769 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:36:10.870 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:10.945 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:11.182 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:11.296 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:36:11.349 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:36:11.384 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:36:11.458 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:36:11.502 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:36:11.517 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-21T07:36:11.534 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:36:11.578 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:36:11.610 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:36:11.638 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:36:11.697 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-21T07:36:11.697 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-21T07:36:11.708 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:36:11.761 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:36:11.791 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:36:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:36:12.107 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:36:12.250 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:36:12.293 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:36:12.322 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:36:12.391 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:36:12.437 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:36:12.511 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:36:12.645 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:36:12.697 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:36:13.214 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:36:13.292 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:36:13.322 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:36:13.365 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:36:13.403 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:36:13.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:36:13.605 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:36:13.657 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:36:13.747 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:36:13.812 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:36:13.886 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:36:14.079 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-21T07:36:14.079 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-21T07:36:14.126 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:36:14.163 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:36:14.210 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:36:14.246 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:36:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:36:14.329 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:36:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:36:14.504 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:36:14.545 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:36:14.646 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:36:14.687 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:36:14.727 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:36:14.753 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:36:14.777 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:36:14.851 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:36:14.979 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:36:15.019 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:36:15.047 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:36:15.089 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:36:15.089 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-21T07:36:15.145 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:36:15.177 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:36:15.207 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:36:15.232 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:36:15.241 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:36:15.270 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:36:15.274 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:36:15.316 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:36:15.324 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:36:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:36:15.366 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:36:15.392 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:36:15.434 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:36:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:36:15.481 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:36:15.521 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:36:15.623 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:36:15.671 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:36:15.767 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:36:15.901 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:36:16.027 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:36:16.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:36:16.151 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:36:16.181 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:36:16.211 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:36:16.364 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:36:16.386 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:36:16.420 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:36:16.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:36:16.448 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:36:16.470 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:36:16.554 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:36:16.569 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:36:16.583 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:36:16.633 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:36:16.637 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:36:16.659 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:36:16.678 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:36:16.765 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:36:16.797 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:36:16.843 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:36:16.969 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:36:16.991 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:36:17.020 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:36:17.097 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:36:17.107 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:36:17.207 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:17.295 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:17.510 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:17.620 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:36:17.649 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:36:17.685 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:36:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:36:17.774 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:36:17.818 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:36:17.844 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:36:17.858 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:36:17.902 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:36:17.934 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:36:17.962 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:36:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:36:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:36:18.117 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:36:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:36:18.234 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:36:18.271 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:36:18.314 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:36:18.343 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:36:18.411 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:36:18.466 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:36:18.539 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:36:18.671 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:36:18.726 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:36:19.143 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:36:19.170 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:36:19.203 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:36:19.238 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:36:19.321 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:36:19.351 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:36:19.394 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:36:19.432 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:36:19.482 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:36:19.568 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:36:19.647 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:36:19.710 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:36:19.750 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:36:19.793 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:36:19.850 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:36:19.857 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:36:19.880 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:36:19.917 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:36:19.929 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:36:19.962 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:36:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:36:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:36:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:36:20.124 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:36:20.166 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:36:20.299 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:36:20.351 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:36:20.392 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:36:20.415 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:36:20.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:36:20.495 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:36:20.518 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:36:20.548 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:36:20.693 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:36:20.733 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:36:20.754 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-21T07:36:20.759 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:36:20.783 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:36:20.851 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:36:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:36:20.976 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:36:21.024 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:36:21.043 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:36:21.078 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:36:21.116 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:36:21.148 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:36:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:36:21.178 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:36:21.212 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:36:21.246 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:36:21.287 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:36:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:36:21.322 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:36:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:36:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:36:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:36:21.477 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:36:21.508 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:36:21.610 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:36:21.659 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:36:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:36:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:36:22.077 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:36:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:36:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:36:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:36:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:36:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:36:22.423 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:36:22.456 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:36:22.554 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:36:22.572 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:36:22.615 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:36:22.628 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:36:22.642 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:36:22.673 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:36:22.762 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:36:22.774 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:36:22.793 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:36:22.801 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:36:22.865 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:22.875 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:36:22.895 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:22.902 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:36:22.948 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:36:22.968 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:36:23.007 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:36:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:36:23.220 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:36:23.407 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:36:23.464 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:23.499 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:36:23.584 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:36:23.593 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:36:23.594 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:36:23.594 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:36:23.594 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:23.625 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:36:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:23.717 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:36:23.802 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:36:24.100 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:36:24.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:36:24.283 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:36:24.336 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:36:24.429 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:36:24.480 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:36:24.518 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:36:24.573 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:36:24.645 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:36:24.735 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:36:24.798 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:36:24.836 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:36:24.895 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:36:24.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:36:25.028 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:36:25.038 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:36:25.063 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:36:25.091 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:36:25.137 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:36:25.172 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:36:25.181 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:36:25.205 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:36:25.234 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:36:25.325 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:36:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:36:25.531 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:36:25.537 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:36:25.576 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:36:25.698 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:36:25.734 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:36:26.171 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:36:26.232 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:36:26.262 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:36:26.287 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:36:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:36:26.341 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:36:26.343 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:36:26.372 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:36:26.389 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:36:26.442 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:36:26.622 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:36:26.709 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:36:26.813 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:36:26.886 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:36:26.970 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:36:27.010 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:36:27.046 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:36:27.096 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:36:27.137 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:36:27.182 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:36:27.227 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:36:27.397 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:36:27.444 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:36:27.487 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:36:27.606 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:36:27.644 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:36:27.687 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:36:27.725 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:36:27.741 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:36:27.846 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:36:28.007 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:36:28.048 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:36:28.085 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:36:28.119 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:36:28.159 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:36:28.200 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:36:28.236 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:36:28.271 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:36:28.304 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:36:28.348 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:36:28.380 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:36:28.479 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:36:28.538 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:36:28.585 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:36:28.593 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:28.685 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:28.718 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:36:28.787 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:36:29.254 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:29.297 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:36:29.392 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:36:29.392 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:36:29.392 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:36:29.392 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:29.423 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:36:29.669 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:36:29.722 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:36:29.756 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:36:29.872 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:36:29.933 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:36:29.985 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:36:30.083 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:36:30.126 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:36:30.358 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:36:30.390 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:36:30.482 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:36:31.286 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:36:31.427 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:36:32.983 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:36:33.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:36:33.096 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:36:33.129 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:36:33.479 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:36:33.524 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:36:33.637 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:36:33.672 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:36:33.719 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:36:34.255 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:36:34.602 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:36:34.692 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:36:34.736 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:36:35.710 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:36:35.710 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-21T07:36:35.710 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-21T07:36:35.711 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-21T07:36:35.711 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-21T07:36:35.711 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-21T07:36:35.711 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-21T07:36:35.711 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-21T07:36:35.711 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:36:35.907 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:36:35.907 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:35.907 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:36:35.907 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:37.180 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:37.216 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:37.676 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:36:37.703 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:36:37.703 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:37.703 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:36:37.703 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:36:37.703 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:36:37.703 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:37.878 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:36:37.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:36:37.927 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:38.052 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:36:38.052 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:36:38.052 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:36:38.052 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:36:38.086 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:36:38.411 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:36:38.434 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:36:38.435 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:38.435 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:36:38.435 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:36:38.435 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:36:38.435 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:36:38.597 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:36:38.653 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:36:38.837 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:36:38.887 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:36:38.955 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:36:39.043 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:36:39.182 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:36:39.237 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:36:39.269 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:36:39.297 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:36:39.758 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:36:39.788 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:36:39.828 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:36:39.894 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:36:39.919 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:36:41.537 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:36:41.537 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-09-21T07:36:41.537 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-09-21T07:36:41.538 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-09-21T07:36:41.538 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-09-21T07:36:41.538 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-09-21T07:36:41.538 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-09-21T07:36:41.538 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-09-21T07:36:41.538 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:41.708 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:36:41.724 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:36:41.725 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:41.725 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:36:41.725 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:43.085 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:36:43.142 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:36:43.303 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:36:43.330 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:36:43.331 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:36:43.331 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:43.563 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:36:43.587 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:36:43.587 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:43.588 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:36:43.588 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:36:43.588 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:36:43.588 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:44.055 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:36:44.079 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:36:44.079 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:44.079 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:36:44.080 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:36:44.080 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:36:44.080 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:44.100 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:36:44.125 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:36:44.186 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:36:44.241 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:36:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:36:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:36:44.409 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:36:44.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:36:44.477 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:36:44.478 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:44.481 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:36:44.529 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:36:44.531 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:36:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:36:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:36:44.639 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:36:44.693 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:36:44.697 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:36:44.836 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:36:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:36:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:36:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:36:45.401 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:36:45.431 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:36:45.463 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:36:45.528 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:36:45.554 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:36:45.655 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:36:45.681 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:36:45.705 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:36:45.705 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:45.705 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:36:45.705 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:36:45.705 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:36:45.705 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:45.749 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:36:45.771 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:36:45.771 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:45.771 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:36:45.772 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:45.816 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:36:45.840 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:36:45.840 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:45.840 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:36:45.840 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:36:45.840 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:36:45.840 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:36:46.190 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:36:46.190 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:46.191 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:36:46.191 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:36:46.191 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:36:46.191 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:36:48.735 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:36:48.793 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:36:49.755 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:36:49.785 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:36:49.900 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:36:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:36:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:36:50.120 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:36:50.120 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:50.120 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:36:50.120 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:36:50.120 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:36:50.120 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:50.171 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:36:50.183 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:36:50.196 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:36:50.246 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:36:50.281 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:36:50.286 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:36:50.318 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:36:50.336 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:36:50.354 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:36:50.535 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:36:50.585 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:36:50.615 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:36:50.645 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:36:50.691 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-09-21T07:36:50.858 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-09-21T07:36:50.859 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:36:51.062 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:36:51.098 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:36:51.098 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:51.098 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:36:51.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:36:51.281 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:36:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:36:51.315 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:36:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:36:51.336 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:36:51.356 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:36:51.356 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:51.356 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:36:51.356 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:36:51.356 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:36:51.356 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:51.399 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:36:51.422 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:36:51.422 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:51.422 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:36:51.422 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:51.483 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:36:51.506 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:36:51.507 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:51.507 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:36:51.507 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:36:51.507 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:36:51.507 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:51.834 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:36:51.857 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:36:51.857 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:51.858 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:36:51.858 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:36:51.858 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:36:51.858 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:36:52.183 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:36:52.270 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:36:52.311 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:36:52.392 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:36:52.440 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:36:52.466 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:36:52.500 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:36:52.500 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:36:52.584 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:36:52.669 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:36:52.693 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:36:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:36:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:36:52.857 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:36:52.879 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:36:52.879 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:36:52.915 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:36:52.915 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:52.915 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:36:52.915 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:36:52.915 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:36:52.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:36:52.963 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:36:53.051 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:36:53.166 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:36:53.216 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:36:53.216 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:53.216 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:36:53.216 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:36:53.216 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:36:53.217 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:36:53.733 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:36:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:36:53.784 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:36:53.784 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:36:53.784 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:36:53.784 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:36:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:36:53.917 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:36:53.977 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:36:54.040 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:36:54.266 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:36:54.337 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:36:54.424 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:36:54.531 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:36:54.703 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:36:54.744 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:36:54.784 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:36:54.810 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:36:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:36:55.351 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:36:55.393 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:36:55.474 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:36:55.515 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:36:55.830 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:36:55.871 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:36:55.919 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:36:55.951 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:36:55.979 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:36:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:36:56.209 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:36:56.239 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:36:56.269 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:36:56.315 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:36:56.878 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:36:56.912 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:36:56.933 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:36:57.776 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:36:57.867 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:36:57.908 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:36:57.990 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:36:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:36:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:36:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:36:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:36:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:36:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:36:58.265 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:36:58.289 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:36:58.295 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:36:58.296 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:36:58.475 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:36:58.475 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:36:58.542 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:36:58.606 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:36:59.122 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:36:59.187 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:36:59.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:36:59.312 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:36:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:36:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:36:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:36:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:36:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:36:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:36:59.313 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:36:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:36:59.323 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:36:59.324 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:36:59.325 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:36:59.326 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:36:59.327 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:36:59.328 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:36:59.329 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:36:59.330 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:36:59.331 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:36:59.332 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:36:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:36:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:36:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:36:59.333 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:37:00.264 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:37:00.295 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:37:00.445 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:37:00.622 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:37:00.656 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:37:00.708 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:00.765 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:37:00.791 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:37:00.899 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:37:00.963 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:37:01.970 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:37:01.970 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:37:01.970 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-21T07:37:01.970 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:01.970 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:01.970 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:01.970 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.971 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:37:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:01.975 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:37:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:37:01.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:37:01.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:37:01.980 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:37:01.981 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:37:01.982 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:37:01.982 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T07:37:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:37:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:37:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:37:02.076 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:37:02.076 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:37:02.076 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:37:02.076 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:37:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:37:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:37:02.183 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:37:02.184 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:37:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:37:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:37:02.295 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:37:02.295 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:37:02.295 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:37:02.295 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:37:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:02.390 DEBUG:teuthology.parallel:result is None 2024-09-21T07:37:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:37:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:37:02.695 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:37:02.695 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:37:02.695 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:37:02.695 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:37:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:05.310 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:37:05.310 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:37:05.311 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:37:05.312 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:37:05.324 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:37:05.324 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:37:05.324 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:37:05.324 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:37:05.324 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:37:05.324 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:37:05.325 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:37:05.326 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:37:05.327 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:37:05.328 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:37:05.329 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:37:05.330 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:37:05.331 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:37:05.332 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:37:05.333 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:37:05.334 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:37:05.334 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:37:05.334 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:37:06.999 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:37:07.040 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:37:07.083 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:37:07.112 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:37:07.139 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:37:07.395 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:37:07.443 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:37:07.473 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:37:07.504 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:37:07.581 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:37:07.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:37:07.706 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:37:07.706 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:37:07.707 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.708 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:37:07.709 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.710 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:37:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:37:07.712 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:37:07.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:37:07.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:37:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:37:07.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:37:07.717 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:37:07.718 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:37:07.719 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-21T07:37:08.157 DEBUG:teuthology.parallel:result is None 2024-09-21T07:37:08.329 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:37:08.371 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:37:08.413 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:37:09.716 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:37:09.811 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:37:09.860 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:37:09.973 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:37:10.004 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:37:10.029 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:37:10.067 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:37:10.067 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:37:10.165 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:37:10.165 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:37:10.308 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:37:10.332 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:37:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:37:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:37:10.584 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:37:10.585 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:37:10.694 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:37:10.768 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:37:10.979 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:37:10.980 INFO:teuthology.orchestra.run.smithi084.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T07:37:10.980 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:37:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:37:16.996 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:37:16.997 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:37:16.997 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:37:16.997 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:37:16.997 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:37:16.997 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:37:16.997 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:37:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:37:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:37:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:37:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:37:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:37:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:37:17.010 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:37:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:37:17.012 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:37:17.013 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:37:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:37:17.015 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:37:17.016 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:37:17.017 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:37:17.018 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:37:17.019 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:37:17.020 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:37:17.021 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:37:17.022 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:37:17.022 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:37:17.022 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:37:17.022 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:37:19.218 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:37:19.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:19.218 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-09-21T07:37:19.218 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:37:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:37:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:37:19.223 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:37:19.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:37:19.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:37:19.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:37:19.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:37:19.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.229 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:37:19.230 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-21T07:37:19.912 DEBUG:teuthology.parallel:result is None 2024-09-21T07:37:19.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:37:20.059 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:37:20.106 INFO:teuthology.orchestra.run.smithi084.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:37:20.106 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:37:20.106 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:37:20.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:37:20.254 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:37:20.281 INFO:teuthology.orchestra.run.smithi162.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:37:20.281 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:37:20.281 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:37:20.283 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:37:20.421 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:37:20.447 INFO:teuthology.orchestra.run.smithi191.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:37:20.447 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:37:20.447 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:37:20.449 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T07:37:20.449 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:37:20.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:37:20.512 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:37:20.512 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:37:20.545 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:37:20.545 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:37:20.576 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T07:37:20.576 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:37:20.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:37:20.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:37:20.733 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:37:20.733 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:37:20.764 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:37:20.835 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:37:20.835 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:37:20.865 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:37:20.934 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T07:37:20.934 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:37:20.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:37:20.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:37:21.090 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:37:21.090 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:37:21.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:37:21.181 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:37:21.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:37:21.206 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:37:21.272 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T07:37:21.272 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:37:21.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:37:21.330 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:37:21.427 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:37:21.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:37:21.452 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:37:21.517 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:37:21.517 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:37:21.542 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:37:21.606 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T07:37:21.702 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2}} 2024-09-21T07:37:21.702 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:37:21.702 INFO:tasks.cephadm:Cluster fsid is 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:37:21.703 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T07:37:21.703 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.84', 'mon.b': '172.21.15.162', 'mon.c': '172.21.15.191'} 2024-09-21T07:37:21.703 INFO:tasks.cephadm:First mon is mon.a on smithi084 2024-09-21T07:37:21.703 INFO:tasks.cephadm:First mgr is x 2024-09-21T07:37:21.703 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T07:37:21.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-09-21T07:37:21.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-21T07:37:21.786 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2024-09-21T07:37:21.811 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T07:37:21.811 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:37:21.954 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T07:37:22.099 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:37:22.101 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:37:22.101 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:37:22.101 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:22.727 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:37 /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:22.727 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:23.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:37 /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:23.248 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:23.831 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:37 /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:23.832 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:23.874 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:23.894 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:37:23.931 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T07:37:23.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:37:23.936 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:37:23.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:37:25.572 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:37:25.616 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:37:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:37:58.081 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:37:58.082 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:37:58.082 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:37:58.082 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-09-21T07:37:58.082 INFO:teuthology.orchestra.run.smithi084.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:37:58.082 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T07:37:58.082 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:38:18.652 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-21T07:38:18.652 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:38:18.652 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:38:18.652 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2024-09-21T07:38:18.652 INFO:teuthology.orchestra.run.smithi191.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:38:18.653 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-09-21T07:38:18.653 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-21T07:38:19.808 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T07:38:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:38:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:38:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-21T07:38:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:38:19.809 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-21T07:38:19.809 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T07:38:19.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-09-21T07:38:19.899 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-21T07:38:19.927 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2024-09-21T07:38:19.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-09-21T07:38:20.017 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-21T07:38:20.042 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2024-09-21T07:38:20.071 INFO:tasks.cephadm:Writing seed config... 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T07:38:20.072 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T07:38:20.073 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T07:38:20.074 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:38:20.074 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T07:38:20.109 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 56620f92-77ec-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-21T07:38:20.109 DEBUG:teuthology.orchestra.run.smithi084:mon.a> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T07:38:20.152 DEBUG:teuthology.orchestra.run.smithi084:mgr.x> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T07:38:20.198 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T07:38:20.198 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 56620f92-77ec-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.84 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:38:20.455 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:38:20.455 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.84', '--skip-admin-label'] 2024-09-21T07:38:20.456 INFO:teuthology.orchestra.run.smithi084.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T07:38:20.456 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying podman|docker is present... 2024-09-21T07:38:20.501 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:38:20.501 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying lvm2 is present... 2024-09-21T07:38:20.501 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying time synchronization is in place... 2024-09-21T07:38:20.515 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:38:20.515 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:38:20.527 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:38:20.527 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T07:38:20.541 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-09-21T07:38:20.553 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-09-21T07:38:20.554 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:38:20.554 INFO:teuthology.orchestra.run.smithi084.stdout:Repeating the final host check... 2024-09-21T07:38:20.597 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:38:20.597 INFO:teuthology.orchestra.run.smithi084.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T07:38:20.597 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl is present 2024-09-21T07:38:20.598 INFO:teuthology.orchestra.run.smithi084.stdout:lvcreate is present 2024-09-21T07:38:20.610 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:38:20.610 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:38:20.622 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:38:20.622 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T07:38:20.635 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-09-21T07:38:20.648 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-09-21T07:38:20.648 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:38:20.648 INFO:teuthology.orchestra.run.smithi084.stdout:Host looks OK 2024-09-21T07:38:20.648 INFO:teuthology.orchestra.run.smithi084.stdout:Cluster fsid: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:20.649 INFO:teuthology.orchestra.run.smithi084.stdout:Acquiring lock 140450943786624 on /run/cephadm/56620f92-77ec-11ef-baf5-efdc52797490.lock 2024-09-21T07:38:20.649 INFO:teuthology.orchestra.run.smithi084.stdout:Lock 140450943786624 acquired on /run/cephadm/56620f92-77ec-11ef-baf5-efdc52797490.lock 2024-09-21T07:38:20.649 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 3300 ... 2024-09-21T07:38:20.650 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 6789 ... 2024-09-21T07:38:20.650 INFO:teuthology.orchestra.run.smithi084.stdout:Base mon IP(s) is [172.21.15.84:3300, 172.21.15.84:6789], mon addrv is [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T07:38:20.656 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.84 metric 100 2024-09-21T07:38:20.656 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.84 metric 100 2024-09-21T07:38:20.662 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T07:38:20.662 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T07:38:20.662 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T07:38:20.668 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T07:38:20.668 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T07:38:20.668 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:38:20.669 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T07:38:20.669 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T07:38:20.669 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:38:20.669 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-09-21T07:38:20.669 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-09-21T07:38:20.669 INFO:teuthology.orchestra.run.smithi084.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T07:38:20.670 INFO:teuthology.orchestra.run.smithi084.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T07:38:20.670 INFO:teuthology.orchestra.run.smithi084.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:38:21.177 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:38:21.178 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:38:21.178 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T07:38:21.178 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T07:38:21.178 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T07:38:21.178 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:38:21.178 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T07:38:22.247 INFO:teuthology.orchestra.run.smithi084.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:38:22.248 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:38:22.248 INFO:teuthology.orchestra.run.smithi084.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T07:38:23.380 INFO:teuthology.orchestra.run.smithi084.stdout:stat: stdout 167 167 2024-09-21T07:38:23.380 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial keys... 2024-09-21T07:38:24.417 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDvd+5mxH0iMBAAokzuD7aoi8h2hQw6HUDYdA== 2024-09-21T07:38:25.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDwd+5mzQrbNBAA/+iWYHQ8UCpTSgOM5D5qNw== 2024-09-21T07:38:26.938 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDxd+5mrBoqOhAALhffCKdQ3remT/yAHi8j1A== 2024-09-21T07:38:26.939 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial monmap... 2024-09-21T07:38:28.021 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:38:28.021 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool for a [v2:172.21.15.84:3300,v1:172.21.15.84:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = quincy 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: set fsid to 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:38:28.022 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mon... 2024-09-21T07:38:29.133 INFO:teuthology.orchestra.run.smithi084.stdout:create mon.a on 2024-09-21T07:38:29.447 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T07:38:29.674 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T07:38:29.945 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-56620f92-77ec-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-56620f92-77ec-11ef-baf5-efdc52797490.target. 2024-09-21T07:38:29.945 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-56620f92-77ec-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-56620f92-77ec-11ef-baf5-efdc52797490.target. 2024-09-21T07:38:30.278 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a 2024-09-21T07:38:30.278 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T07:38:30.546 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-56620f92-77ec-11ef-baf5-efdc52797490.target.wants/ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-56620f92-77ec-11ef-baf5-efdc52797490@.service. 2024-09-21T07:38:31.241 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:31 smithi084 podman[30031]: 2024-09-21 07:38:31.144466222 +0000 UTC m=+0.381875311 container start 61a776cfd2267bba4c1384bef500747ca2785b155f0e94ab4a58e3cbd38d4982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T07:38:31.242 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:31 smithi084 bash[30031]: 61a776cfd2267bba4c1384bef500747ca2785b155f0e94ab4a58e3cbd38d4982 2024-09-21T07:38:31.271 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:38:31.271 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T07:38:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:38:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T07:38:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T07:38:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:38:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon to start... 2024-09-21T07:38:31.288 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon... 2024-09-21T07:38:31.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:31 smithi084 systemd[1]: Started Ceph mon.a for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:38:31.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:31 smithi084 ceph-mon[30050]: mkfs 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:31.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:31 smithi084 ceph-mon[30050]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:38:32.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:38:32.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: monmap epoch 1 2024-09-21T07:38:32.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: last_changed 2024-09-21T07:38:27.414531+0000 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: min_mon_release 19 (squid) 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: election_strategy: 1 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: fsmap 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: mgrmap e1: no daemons active 2024-09-21T07:38:32.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:32 smithi084 ceph-mon[30050]: from='client.? 172.21.15.84:0/2515232928' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T07:38:32.785 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T07:38:32.785 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout id: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:32.785 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T07:38:32.785 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:32.785 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout services: 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.645842s) 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout data: 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:mon is available 2024-09-21T07:38:32.786 INFO:teuthology.orchestra.run.smithi084.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T07:38:33.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:33 smithi084 ceph-mon[30050]: from='client.? 172.21.15.84:0/577501988' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T07:38:33.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:33 smithi084 ceph-mon[30050]: from='client.? 172.21.15.84:0/577501988' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T07:38:33.974 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:33.975 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:38:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:38:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:38:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:38:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:38:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:38:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:Generating new minimal ceph.conf... 2024-09-21T07:38:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:34 smithi084 ceph-mon[30050]: from='client.? 172.21.15.84:0/3586743437' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:38:35.197 INFO:teuthology.orchestra.run.smithi084.stdout:Restarting the monitor... 2024-09-21T07:38:35.548 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:35 smithi084 systemd[1]: Stopping Ceph mon.a for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:38:35.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:35 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a[30046]: 2024-09-21T07:38:35.546+0000 7f4de6e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:38:35.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:35 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a[30046]: 2024-09-21T07:38:35.546+0000 7f4de6e00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T07:38:35.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:35 smithi084 podman[30291]: 2024-09-21 07:38:35.577194814 +0000 UTC m=+0.160004865 container died 61a776cfd2267bba4c1384bef500747ca2785b155f0e94ab4a58e3cbd38d4982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T07:38:36.130 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:35 smithi084 podman[30291]: 2024-09-21 07:38:35.925499064 +0000 UTC m=+0.508309108 container cleanup 61a776cfd2267bba4c1384bef500747ca2785b155f0e94ab4a58e3cbd38d4982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:38:36.130 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:35 smithi084 bash[30291]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a 2024-09-21T07:38:36.389 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:36 smithi084 podman[30303]: 2024-09-21 07:38:36.129507804 +0000 UTC m=+0.547812875 container remove 61a776cfd2267bba4c1384bef500747ca2785b155f0e94ab4a58e3cbd38d4982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:38:36.704 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:36 smithi084 systemd[1]: ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T07:38:36.704 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:36 smithi084 systemd[1]: Stopped Ceph mon.a for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:38:36.704 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:36 smithi084 systemd[1]: ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a.service: Consumed 1.288s CPU time. 2024-09-21T07:38:36.704 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:36 smithi084 systemd[1]: Starting Ceph mon.a for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:38:37.054 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:36 smithi084 podman[30392]: 2024-09-21 07:38:36.607136242 +0000 UTC m=+0.027165964 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:38:37.054 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:36 smithi084 podman[30392]: 2024-09-21 07:38:36.927214302 +0000 UTC m=+0.347244013 container create 4570a1287a90ec7be917f2ec07f4b43e31e3a8c906cc3c0bb13fb0129c3ac2ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:38:37.282 INFO:teuthology.orchestra.run.smithi084.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T07:38:37.425 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 podman[30392]: 2024-09-21 07:38:37.171203955 +0000 UTC m=+0.591233665 container init 4570a1287a90ec7be917f2ec07f4b43e31e3a8c906cc3c0bb13fb0129c3ac2ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 podman[30392]: 2024-09-21 07:38:37.17777893 +0000 UTC m=+0.597808642 container start 4570a1287a90ec7be917f2ec07f4b43e31e3a8c906cc3c0bb13fb0129c3ac2ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 bash[30392]: 4570a1287a90ec7be917f2ec07f4b43e31e3a8c906cc3c0bb13fb0129c3ac2ac 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: pidfile_write: ignore empty --pid-file 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 systemd[1]: Started Ceph mon.a for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: load: jerasure load: lrc 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: RocksDB version: 7.9.2 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Git sha 0 2024-09-21T07:38:37.426 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: DB SUMMARY 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: DB Session ID: 1UFKXDGWUKMRW42LJKZC 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94266 ; 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:38:37.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T07:38:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:38:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T07:38:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.env: 0x55e566ae6d60 2024-09-21T07:38:37.428 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T07:38:37.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.info_log: 0x55e56bb77320 2024-09-21T07:38:37.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.statistics: (nil) 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.use_fsync: 0 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:38:37.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:38:37.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:38:37.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:38:37.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:38:37.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.db_log_dir: 2024-09-21T07:38:37.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.wal_dir: 2024-09-21T07:38:37.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:38:37.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:38:37.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:38:37.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:38:37.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:38:37.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:38:37.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:38:37.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:38:37.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.write_buffer_manager: 0x55e56bb7bd60 2024-09-21T07:38:37.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:38:37.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:38:37.434 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:38:37.434 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:38:37.435 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:38:37.435 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:38:37.435 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:38:37.435 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:38:37.435 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.unordered_write: 0 2024-09-21T07:38:37.435 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:38:37.435 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.row_cache: None 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.wal_filter: None 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.wal_compression: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:38:37.436 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:38:37.437 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_open_files: -1 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Compression algorithms supported: 2024-09-21T07:38:37.438 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kZSTD supported: 0 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T07:38:37.439 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.merge_operator: 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_filter: None 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e56bb76f60) 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_type: 0 2024-09-21T07:38:37.440 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_index_type: 0 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_shortening: 1 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: checksum: 4 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: no_block_cache: 0 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache: 0x55e567b3b610 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_options: 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: capacity : 536870912 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_shard_bits : 4 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: strict_capacity_limit : 0 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_compressed: (nil) 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: persistent_cache: (nil) 2024-09-21T07:38:37.441 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size: 4096 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size_deviation: 10 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_restart_interval: 16 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_block_restart_interval: 1 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_block_size: 4096 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: partition_filters: 0 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: use_delta_encoding: 1 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: filter_policy: bloomfilter 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: whole_key_filtering: 1 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: verify_compression: 0 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: format_version: 5 2024-09-21T07:38:37.442 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_index_compression: 1 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_align: 0 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_auto_readahead_size: 262144 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout: prepopulate_block_cache: 0 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout: initial_auto_readahead_size: 8192 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression: NoCompression 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.num_levels: 7 2024-09-21T07:38:37.443 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:38:37.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:38:37.445 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:38:37.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:38:37.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.ttl: 2592000 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:38:37.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e2452a4d-b8fb-45fd-84ba-7c01c5324daf 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726904317282608, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T07:38:37.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726904317284391, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90487, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 281, "table_properties": {"data_size": 88557, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11466, "raw_average_key_size": 47, "raw_value_size": 82087, "raw_average_value_size": 342, "num_data_blocks": 11, "num_entries": 240, "num_filter_entries": 240, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726904317, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e2452a4d-b8fb-45fd-84ba-7c01c5324daf", "db_session_id": "1UFKXDGWUKMRW42LJKZC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726904317284571, "job": 1, "event": "recovery_finished"} 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e56bb9ca80 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: DB pointer 0x55e56c93e000 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** DB Stats ** 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:38:37.450 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 2/0 90.23 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 77.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 90.23 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 77.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 77.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 77.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T07:38:37.451 INFO:journalctl@ceph.mon.a.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 14.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 14.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache BinnedLRUCache@0x55e567b3b610#2 capacity: 512.00 MB usage: 1.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:38:37.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: starting mon.a rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???) e1 preinit fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???).mds e1 new map 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???).mds e1 print_map 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout: e1 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout: btime 2024-09-21T07:38:31:274055+0000 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout: legacy client fscid: -1 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout: No filesystems configured 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:38:37.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: monmap epoch 1 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: last_changed 2024-09-21T07:38:27.414531+0000 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: min_mon_release 19 (squid) 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: election_strategy: 1 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: fsmap 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:38:37.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:37 smithi084 ceph-mon[30411]: mgrmap e1: no daemons active 2024-09-21T07:38:38.644 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mgr... 2024-09-21T07:38:38.670 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T07:38:38.671 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T07:38:39.018 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.x 2024-09-21T07:38:39.019 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T07:38:39.248 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-56620f92-77ec-11ef-baf5-efdc52797490.target.wants/ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-56620f92-77ec-11ef-baf5-efdc52797490@.service. 2024-09-21T07:38:39.277 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:38 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4225644430' entity='client.admin' 2024-09-21T07:38:39.557 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:39 smithi084 systemd[1]: Starting Ceph mgr.x for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:38:39.875 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:39 smithi084 podman[30623]: 2024-09-21 07:38:39.490353954 +0000 UTC m=+0.026559006 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:38:39.875 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:39 smithi084 podman[30623]: 2024-09-21 07:38:39.588227679 +0000 UTC m=+0.124432730 container create 55ff0ac7caf245e8e18d914ae6dee4f749142647b2096f4a4d9534de3e1cfef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:38:39.875 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:39 smithi084 podman[30623]: 2024-09-21 07:38:39.798897078 +0000 UTC m=+0.335102128 container init 55ff0ac7caf245e8e18d914ae6dee4f749142647b2096f4a4d9534de3e1cfef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:38:39.875 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:39 smithi084 podman[30623]: 2024-09-21 07:38:39.805429756 +0000 UTC m=+0.341634807 container start 55ff0ac7caf245e8e18d914ae6dee4f749142647b2096f4a4d9534de3e1cfef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:38:39.901 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:38:39.901 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T07:38:39.915 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:38:39.915 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T07:38:39.915 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T07:38:39.915 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:38:39.932 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:38:39.932 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T07:38:39.946 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:38:39.946 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T07:38:39.946 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T07:38:39.946 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T07:38:39.946 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr to start... 2024-09-21T07:38:39.946 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr... 2024-09-21T07:38:40.230 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:39 smithi084 bash[30623]: 55ff0ac7caf245e8e18d914ae6dee4f749142647b2096f4a4d9534de3e1cfef2 2024-09-21T07:38:40.230 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:39 smithi084 systemd[1]: Started Ceph mgr.x for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:38:40.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:40 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2016952226' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:38:41.281 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:38:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:38:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:38:31:274055+0000", 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:38:41.290 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:38:31.275201+0000", 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:38:41.291 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:38:41.292 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (1/15)... 2024-09-21T07:38:44.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:43 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2669920389' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:38:44.620 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:38:44.621 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:38:44.622 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:38:44.622 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:44.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:38:44.624 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:38:44.624 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:38:44.627 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:38:44.627 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:38:44.627 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:44.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:38:31:274055+0000", 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:38:44.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:44.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:38:31.275201+0000", 2024-09-21T07:38:44.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:38:44.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:44.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:38:44.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:38:44.630 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (2/15)... 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: Activating manager daemon x 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: mgrmap e2: x(active, starting, since 0.00514097s) 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: Manager daemon x is now available 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:38:46.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' 2024-09-21T07:38:46.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' 2024-09-21T07:38:46.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:45 smithi084 ceph-mon[30411]: from='mgr.14100 172.21.15.84:0/1360665729' entity='mgr.x' 2024-09-21T07:38:48.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:47 smithi084 ceph-mon[30411]: mgrmap e3: x(active, since 1.00931s) 2024-09-21T07:38:48.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:47 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3314601168' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:38:48.116 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:38:48.117 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:38:48.118 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:38:48.121 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:48.121 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:38:48.121 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:38:31:274055+0000", 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:38:48.122 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:38:31.275201+0000", 2024-09-21T07:38:48.123 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:38:48.124 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:38:48.124 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:38:48.124 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:38:48.124 INFO:teuthology.orchestra.run.smithi084.stdout:mgr is available 2024-09-21T07:38:49.125 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:48 smithi084 ceph-mon[30411]: mgrmap e4: x(active, since 2s) 2024-09-21T07:38:49.125 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:48 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1974468041' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T07:38:49.413 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:49.413 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:38:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:38:49.415 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:38:49.415 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:38:49.415 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:38:49.415 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling cephadm module... 2024-09-21T07:38:50.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:50 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2261462511' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T07:38:50.557 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ignoring --setuser ceph since I am not root 2024-09-21T07:38:50.557 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ignoring --setgroup ceph since I am not root 2024-09-21T07:38:51.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:51 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2261462511' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T07:38:51.510 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:51 smithi084 ceph-mon[30411]: mgrmap e5: x(active, since 4s) 2024-09-21T07:38:52.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:52 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2272726158' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:38:52.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:38:52.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T07:38:52.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:38:52.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:38:52.522 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:38:52.522 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:38:52.522 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-09-21T07:38:52.522 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 5... 2024-09-21T07:38:56.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: Active manager daemon x restarted 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: Activating manager daemon x 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: mgrmap e6: x(active, starting, since 0.00395722s) 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:38:56.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:56 smithi084 ceph-mon[30411]: Manager daemon x is now available 2024-09-21T07:38:58.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:38:58.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T07:38:58.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:38:58.085 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:38:58.085 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 5 is available 2024-09-21T07:38:58.085 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying orchestrator module is enabled... 2024-09-21T07:38:58.563 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: mgrmap e7: x(active, since 1.00754s) 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:38:58.564 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:38:59.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:38:58.884+0000 7ff89b200640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:38:58] ENGINE Error in HTTPServer.serve 2024-09-21T07:38:59.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: Traceback (most recent call last): 2024-09-21T07:38:59.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:38:59.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._connections.run(self.expiration_interval) 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._run(expiration_interval) 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: s = self.context.wrap_socket( 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: return self.sslsocket_class._create( 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self.do_handshake() 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:38:59.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._sslobj.do_handshake() 2024-09-21T07:38:59.309 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:38:59.309 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:38:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:38:59.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:59 smithi084 ceph-mon[30411]: Found migration_current of "None". Setting to last migration. 2024-09-21T07:38:59.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:59 smithi084 ceph-mon[30411]: mgrmap e8: x(active, since 2s) 2024-09-21T07:38:59.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:59 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:38:59.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:38:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1891871472' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T07:39:00.348 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T07:39:00.348 INFO:teuthology.orchestra.run.smithi084.stdout:Setting orchestrator backend to cephadm... 2024-09-21T07:39:00.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:00 smithi084 ceph-mon[30411]: [21/Sep/2024:07:38:58] ENGINE Bus STARTING 2024-09-21T07:39:00.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:00 smithi084 ceph-mon[30411]: [21/Sep/2024:07:38:58] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T07:39:00.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:00 smithi084 ceph-mon[30411]: [21/Sep/2024:07:38:58] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:00 smithi084 ceph-mon[30411]: [21/Sep/2024:07:38:58] ENGINE Bus STARTED 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:00 smithi084 ceph-mon[30411]: [21/Sep/2024:07:38:58] ENGINE Error in HTTPServer.serve 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:39:00.611 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:00 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1891871472' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T07:39:00.612 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:00 smithi084 ceph-mon[30411]: mgrmap e9: x(active, since 3s) 2024-09-21T07:39:02.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:02 smithi084 ceph-mon[30411]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:02.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:02 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:02.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:02 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:03.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T07:39:03.150 INFO:teuthology.orchestra.run.smithi084.stdout:Generating ssh key... 2024-09-21T07:39:03.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:03 smithi084 ceph-mon[30411]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:04.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: Generating public/private rsa key pair. 2024-09-21T07:39:04.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: Your identification has been saved in /tmp/tmpxalww_c5/key 2024-09-21T07:39:04.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: Your public key has been saved in /tmp/tmpxalww_c5/key.pub 2024-09-21T07:39:04.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: The key fingerprint is: 2024-09-21T07:39:04.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: SHA256:ZqX6hrEQ+2NTDcEF2QkTpZSnYuohJKEbcjLtwFVPAMs ceph-56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:39:04.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: The key's randomart image is: 2024-09-21T07:39:04.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: +---[RSA 3072]----+ 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: | .oo.o*Xo. | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: |. ... o.=o+ | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: |oo.E ..+. | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: |O.+ . o oo | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: |.@ = .So | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: |. o = .+. . | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: | o +.= | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: | . B.. | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: | . +. | 2024-09-21T07:39:04.308 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: +----[SHA256]-----+ 2024-09-21T07:39:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:05 smithi084 ceph-mon[30411]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:05.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:05 smithi084 ceph-mon[30411]: Generating ssh key... 2024-09-21T07:39:05.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:05 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:05.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:05 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:06.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:06 smithi084 ceph-mon[30411]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:06.104 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrz0GA5kNAVeD9B9aYl9AWFKuezx9l3el7r5K/AXqsF1YRgCRkYxUy+IoeWZptN23b6kXlZY2DdnpPKPtJ5YzM4gHNaOFxfiwqipZqng56RweRdjX896AIv0URvAK4fhHDlxEUA1SuYl35BcYkn/KZMRQH1H8MeY6Qs5GKuKWtRfcZV44HE10G/5Zjjq+eLQnatx+lmnN/KiASiJWag7H6jCg1xa3HSwm0ZMVuvMYyQepoUk5weWsCn0xPJ9lAoWfGlWVgRMahonuEU5KpbHWLEzsYp7EnJOgQHz0eASYZb3Mh7vsTI7bdUrpj6BNNTDHHUlqgmSWMEPb6K6A8zHLJs/QHJW4yXgG0Ivy/UsVOElcvUKRR7ATj0SIZW40/PV9zwm8AwWsEsbPv7MYGngkDWQa0mqw6CuIWjV7eORJseDsNRzMTdXfBUO9A7RtjH6GCBXNe5w4A8JKMuqXi8VOGfJ+1l02U+TKuCZVFrVICkhzQUlWX6U3OtlsHNJiIwbE= ceph-56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:39:06.104 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:39:06.104 INFO:teuthology.orchestra.run.smithi084.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T07:39:06.107 INFO:teuthology.orchestra.run.smithi084.stdout:Adding host smithi084... 2024-09-21T07:39:07.804 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:07 smithi084 ceph-mon[30411]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:08.586 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:08 smithi084 ceph-mon[30411]: Deploying cephadm binary to smithi084 2024-09-21T07:39:11.227 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Added host 'smithi084' with addr '172.21.15.84' 2024-09-21T07:39:11.227 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mon service... 2024-09-21T07:39:11.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:11 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:11.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:11 smithi084 ceph-mon[30411]: Added host smithi084 2024-09-21T07:39:11.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:11 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:13.022 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T07:39:13.022 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mgr service... 2024-09-21T07:39:13.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:13 smithi084 ceph-mon[30411]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:13.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:13 smithi084 ceph-mon[30411]: Saving service mon spec with placement count:5 2024-09-21T07:39:13.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:13 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:14.751 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T07:39:15.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:15 smithi084 ceph-mon[30411]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:15 smithi084 ceph-mon[30411]: Saving service mgr spec with placement count:2 2024-09-21T07:39:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:15 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:15 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:15 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:16.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:16 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/888705897' entity='client.admin' 2024-09-21T07:39:16.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:16 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:16.703 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:16 smithi084 ceph-mon[30411]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:18.141 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling the dashboard module... 2024-09-21T07:39:18.724 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:18 smithi084 ceph-mon[30411]: from='mgr.14118 172.21.15.84:0/3224421448' entity='mgr.x' 2024-09-21T07:39:18.724 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:18 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3375127134' entity='client.admin' 2024-09-21T07:39:18.724 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:18 smithi084 ceph-mon[30411]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:19.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:19 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3265016885' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T07:39:20.005 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:19 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ignoring --setuser ceph since I am not root 2024-09-21T07:39:20.005 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:19 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ignoring --setgroup ceph since I am not root 2024-09-21T07:39:20.605 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:20 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3265016885' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T07:39:20.605 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:20 smithi084 ceph-mon[30411]: mgrmap e10: x(active, since 23s) 2024-09-21T07:39:21.796 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:21 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2648441025' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:39:21.800 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:39:21.800 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T07:39:21.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:39:21.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:39:21.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:39:21.801 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:39:21.801 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-09-21T07:39:21.801 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 10... 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: Active manager daemon x restarted 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: Activating manager daemon x 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: mgrmap e11: x(active, starting, since 0.00519556s) 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:39:26.043 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:39:26.044 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:39:26.044 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:25 smithi084 ceph-mon[30411]: Manager daemon x is now available 2024-09-21T07:39:27.044 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:26 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:27.044 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:26 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:39:27.044 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:26 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:39:27.044 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:26 smithi084 ceph-mon[30411]: mgrmap e12: x(active, since 1.00807s) 2024-09-21T07:39:27.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:39:27.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T07:39:27.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:39:27.549 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:39:27.549 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 10 is available 2024-09-21T07:39:27.549 INFO:teuthology.orchestra.run.smithi084.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T07:39:27.691 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:39:27.406+0000 7f4953400640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:39:27] ENGINE Error in HTTPServer.serve 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: Traceback (most recent call last): 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._connections.run(self.expiration_interval) 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._run(expiration_interval) 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:39:27.692 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: s = self.context.wrap_socket( 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: return self.sslsocket_class._create( 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self.do_handshake() 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._sslobj.do_handshake() 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:39:27.693 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:39:27.964 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-mon[30411]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T07:39:27.964 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:27 smithi084 ceph-mon[30411]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T07:39:29.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:28 smithi084 ceph-mon[30411]: [21/Sep/2024:07:39:27] ENGINE Bus STARTING 2024-09-21T07:39:29.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:28 smithi084 ceph-mon[30411]: [21/Sep/2024:07:39:27] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T07:39:29.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:28 smithi084 ceph-mon[30411]: [21/Sep/2024:07:39:27] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T07:39:29.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:28 smithi084 ceph-mon[30411]: [21/Sep/2024:07:39:27] ENGINE Bus STARTED 2024-09-21T07:39:29.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:28 smithi084 ceph-mon[30411]: [21/Sep/2024:07:39:27] ENGINE Error in HTTPServer.serve 2024-09-21T07:39:29.017 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T07:39:29.017 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:39:29.018 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T07:39:29.019 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:39:29.019 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T07:39:29.019 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:39:29.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:28 smithi084 ceph-mon[30411]: mgrmap e13: x(active, since 2s) 2024-09-21T07:39:29.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:28 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:29.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUIdjEtpYVml+aqWZs8U+nUKOhN1cwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA3MzkyOVoXDTM0\nMDkyMjA3MzkyOVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1Ljg0MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAnG2hCJfZcwd0HWTPDhQr3cuv6hq+KIcodoDF\nZtAKUX2tj2/PfKm2okwf3jlrXTJb4qHRmiTkuxTnIBF/3TAGwSuj+kNw84F9m5Xk\nCPu/tIqJvzqrICC4Oby1727oHpaIxxLVacw+zLbaC+oE1h8XxFRlAXp4Np4NMt6s\nARTQCTRCqXmyGBrb0wkVdloIGsO0cxMnUycsoEn1rC2yuhYMu1ZEb6R0JZKryhCB\n5qr4cmpegBuA//78Q7F9QeCacda+iIS4QPdIe5SVpjq9x6QYFoVqNqhMfom+Xudb\nC9OaVX8XT2Q/il2FLQY9ULZTwveSOw2ymwY+QEyp/ykF3TtwK2VJhygb5MCTXbZh\nro/qeW5gs9LkHOhs1n3A8NAS3yzaIho7ukafw0s2NlHgfUlPkfjG3HpK71eHP0Yr\nVoiLQtWJlW1cz1jRAy6mQb7NHhUqzZEcyRotLvy6PpXw2jvr+wGI2gj5vRYBgGac\nHwEbdpsB5AdsIOSS08+mJaBzwvVBw7q6mjCL0UQQXR+fb9/NqL1v2gFdKpy0hK4E\niUavBeUbAO24nTYhY0hojiGlrKun+tmZgvWBTaZDnPD36vSI1XzzZA6+iWv9KrA5\n65oppMn04jk45VLlFX8GM8VaeCjqcKyoMY1+PMgwaZ46GlHBWlPYdkJ7sPwjbn3j\nIOye8n8CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDg0ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPVDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAK\nbHpxuRExUpJd7S7r5sMxQydMam9QbY8VyRuPmTAHVTEeW7Z8fbRq9bHeaho3Dwr6\nogqiz7GGVWqNmtR4kow6ZFrIQno40OH+zf2Q4QA52NJq9O+7yJvOfUGHEVl/sr97\nqalx6oN8ChU/HfjmK0OGJ86rwPsha6Zo47Bh/hHL0vEGHP8QyxsUdn1NDEWj5tFu\nFTi3Ma4b1XO09zOBPlHl07aNl4ZNXDzgWgOj2HNoOoR3uQf7F0dk5hdOR3cdsW4U\n8kqivj5nAljeTnv7J4iAqroFw1AS6dgjltck1a/J1gV+eiMsRnEB10/9UCv3gedu\nK8EErqrkxcIvGVAPJ6yojxQdgft9/g5nPZuPP5MO6Fq8m2NYU038NJytldNpalt/\nAOfFiBIT2cRR6AF2ieSgQv25PzfFFwtkX951qjz8GUs1Hsb1I2bq4YTKKIDKZhBb\n0avTIsUI7N264ISfgDFoCwZ1uyiJb+B0KSc6J6gOMCypf/H9GHCuHtH1u/TPpNhu\nj2UsWCaF/8p9zYrrO95FoF1AetxziYv1UpXDjNF2zKqvhIjDQodw/3o1/THWOCgL\n/UyBYTLmTNZ/LoGAeDFJuO/eMGWGXgougG09K93t+Hza+A9fgXx05Uxga73VAro6\ng0z4X5vIjcNm5FRSqM/ELO9prcCkikrXHsxlOoIKQg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAnG2hCJfZcwd0HWTPDhQr3cuv6hq+KIcodoDFZtAKUX2tj2/P\nfKm2okwf3jlrXTJb4qHRmiTkuxTnIBF/3TAGwSuj+kNw84F9m5XkCPu/tIqJvzqr\nICC4Oby1727oHpaIxxLVacw+zLbaC+oE1h8XxFRlAXp4Np4NMt6sARTQCTRCqXmy\nGBrb0wkVdloIGsO0cxMnUycsoEn1rC2yuhYMu1ZEb6R0JZKryhCB5qr4cmpegBuA\n//78Q7F9QeCacda+iIS4QPdIe5SVpjq9x6QYFoVqNqhMfom+XudbC9OaVX8XT2Q/\nil2FLQY9ULZTwveSOw2ymwY+QEyp/ykF3TtwK2VJhygb5MCTXbZhro/qeW5gs9Lk\nHOhs1n3A8NAS3yzaIho7ukafw0s2NlHgfUlPkfjG3HpK71eHP0YrVoiLQtWJlW1c\nz1jRAy6mQb7NHhUqzZEcyRotLvy6PpXw2jvr+wGI2gj5vRYBgGacHwEbdpsB5Ads\nIOSS08+mJaBzwvVBw7q6mjCL0UQQXR+fb9/NqL1v2gFdKpy0hK4EiUavBeUbAO24\nnTYhY0hojiGlrKun+tmZgvWBTaZDnPD36vSI1XzzZA6+iWv9KrA565oppMn04jk4\n5VLlFX8GM8VaeCjqcKyoMY1+PMgwaZ46GlHBWlPYdkJ7sPwjbn3jIOye8n8CAwEA\nAQKCAgABZiuet45O1z4PIJPc2jUAPAOmnOGe3C1Ho2Q1714Vl4GsuuvIqiiY2q8d\nnjbbHl8Fr7vVB0fHx+qUoK4bl4Pf824j3WQ5EVXtxSaae/dIJpsPy6G0h7EOIdAg\nxEWtjFwh0lsiofHdLoopuXNHSlTnQSKmzjvIBUbfRxrpEZDAxv0M+1Uqnlw2pCn9\nz9VVuUgNEBqgcEUXvpbvbiM0mIuO8LkWTzVou/SZuecSM0JF8l9GVw34JtrbwiPO\n1IhHxLYZ43yrEWsjtn2rfx1WbUh33xlG7t9sRvrIai+oHew59TPgq71eap1ifIqi\nL6yfyEtrCCF/qHZ4aGx20fJG+x1INSmwk5rI8UkvFffYftZCq3KmEhJijRrP6k0h\nAojD7Zh0kJ1dkQN0fZT+Xrcwz2MTZKCl8whIK0vReuysY0iJKaF59GrTNtX1etS9\nMwGT+nPhWWlrbMzV6T74y8m5Zf+GIQi+Z71PIhxmGSEuegtD0cgmOKtb9q5gBTyC\nvY2AQJm42VSvKvHhRa6ePWcjOHLEqK01Z2ukGQSirs3R+k2X/CsEOb3NEDt6MU+a\ngU14TrN4z0TN1gtxqwAp8flOoKYiL3Jic7KOBwQ5caYRD9qkv3fQb4UFx1Frp/Nm\n3weY8ToTRfwTYDr9ZjdITZBDmEHziP7iePkhKhM2NpiSfJ9Z0QKCAQEA064RIGKB\nSgBXApYIr3MmPLNnZ3PZ2mvUg/tYwBdlzRos9SZ+OvabGEQjDxeVV6clW3m0ANBb\nI2npLxcijm70iNFKjzt7LFR9VFZKkAI8NjNj24/Otc8SyMaolGc7s5KH4j4cvETJ\ngrE9iabKl9pvo/mvXjCBDGj7ZsRBlhKchR6bByHz7qQ006fWZ45rZvUtaCXsYfMm\ngU1jIR4g/E9rdVY1nDsfz7FabIzp3Ia96J7CEffZ2H2yseHPm3LjrnV9/QMyrzgA\nrxagD2DAzAmd4av0RchkF1TnKVpHaMutA1Dy9AkDNXUVgglJ95K9WOsZ17YxRq7/\nAb54dCXW/JxHzwKCAQEAvS4ZiC9cAfvA1LnnPBGiqWv/mnrV4A+Ojhjf6DEi42dg\nL/V9+QRu3HqTfz8IJ9ztugj+ZW79ft/tUCbGAuDu8hv5+PCl6zEMUEfyDaAEJC2U\n9sxNo8yDF2V7nZbJFwzkgKqzxYQqWRFs7ER6YaazYeaAu3fDWRIsbsPEIZEOz1tf\n2k5CaCvK7KKAKKb7e0CrU078/2dQnKXJpbhIEFREk5SU1QJFHpOpTl8t9KBzF0be\nomLxdYyTHhdKG4q8B1zby65vf9dOCd/ct6Bx9HfW0VRBANnYpkIW4UGVQz2lTOXr\ndhXjdKC3hn3z+M26D2GpQHtN/6+E+k2K50IX2KSmUQKCAQBhxfH1Mmqjgrqt4B0M\n5TQRL5CgkTtcDxhvCea5e1UzQlbnuSrvEz8aG0bSTsNVZEf2E6XYBmVCW0Yw0Q/O\nGGPs2jcFJ6VCGZh2HxF7qPyk0GHcZXVGNupnQJNXUMObsx/+mU/uihtFuZZCAX9s\nWqHcbJTa/a5tzAPrONVOezQ+rJ9Q0Rb58HDSHqEC3h6vxKl/hJzFtWjgqp0SC/eS\ncyCgZvyGOCz+Yt3wa7oNeVM4ojPj1saRn6WtUi7xj0SpLW3PMu3zTvvJ47p0v+zt\nkbeSKDnBDcllmXrYd/Gp7wHwGTDPFWadB4KyuJWou+enrZgXMflau7Pf21mJ1HyT\n25+zAoIBAQCINTLo3MBwJSUXhKo6k6/8L+ge/6YR5uGK6dn8wbQO6xVUMnr62fhA\nAnlEOsvSd70qHuObgKg/u1aQSPp0hCNGamI2nH25stzcyJA8wyN4MOF6OGsGLm+M\nXuL7+d7bG8tB4KYC5j/fVS6JhlxfBrlNGbtCPt6FuRIIxibmzBxPq8h90674dd9r\nNSz1GBUlDtDL8Kkz8t0VjEB9cwtfxmyBnY7zNukxNLvH07uwz/1Nmxcc8ARN0GL0\nXWxcHC15V6BhLDzXXNuxPF8cTwb9L3OZ0AHlbPQR8K+si52+hhoIHdrEcMoN5NF+\noh0Q3H7EKFrGNIFaQLOLzFzgWLP2pcWhAoIBAQCApR9o6k2/3VdDb9l0kkjcVMcA\nrYupvR6HoCBYd0/DRO68/YWuqMvghqjbFoxkGpTmfYVkWIRdwUR/0cuYX5xTcvN4\ntLWfCPDeJNn0lx2Fs9KzzbUpcUb3/eNyBygXOjryQg5bIVFahGNUrVJcvpFT2xnb\ncRBmHwlTBJtNxL8U0LoPsbGoa4fk+SMYavvE4J41wYisSDVcXf9G0fLnEUisKSka\nAk/pZ+uHFGI2yM2lE9VA2bnGpMLf9onpyTITTW4oWgnTbkvlyfCZarpwhzbtXMv+\nH5qAao7RO49CTbPnud6G450tFgQKM1kXFmLjlb2eDxsDq4LWHlYenqvU6j9z\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T07:39:29.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:29 smithi084 ceph-mon[30411]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:29.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:29 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:31.131 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T07:39:31.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:31 smithi084 ceph-mon[30411]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:31.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:31 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:33.186 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T07:39:33.186 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial admin user... 2024-09-21T07:39:33.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:33 smithi084 ceph-mon[30411]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:33.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:33 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:34.808 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$lBdd7vxrfgJsfvkgzpTWHuTF3/pZjmPSrIQ4BafejEmuZDU2joQea", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726904374, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T07:39:34.808 INFO:teuthology.orchestra.run.smithi084.stdout:Fetching dashboard port number... 2024-09-21T07:39:35.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:35 smithi084 ceph-mon[30411]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:35.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:35 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:36.191 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T07:39:36.210 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:39:36.210 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T07:39:36.224 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:39:36.225 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T07:39:36.225 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T07:39:36.225 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T07:39:36.229 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph Dashboard is now available at: 2024-09-21T07:39:36.229 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:36.229 INFO:teuthology.orchestra.run.smithi084.stdout: URL: https://smithi084.front.sepia.ceph.com:8443/ 2024-09-21T07:39:36.229 INFO:teuthology.orchestra.run.smithi084.stdout: User: admin 2024-09-21T07:39:36.229 INFO:teuthology.orchestra.run.smithi084.stdout: Password: 6dgcfjm46d 2024-09-21T07:39:36.229 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:36.230 INFO:teuthology.orchestra.run.smithi084.stdout:Saving cluster configuration to /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config directory 2024-09-21T07:39:36.528 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:36 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3622883332' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T07:39:37.821 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T07:39:37.822 INFO:teuthology.orchestra.run.smithi084.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T07:39:37.822 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.822 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: ceph telemetry on 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout:For more information see: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:37.823 INFO:teuthology.orchestra.run.smithi084.stdout:Bootstrap complete. 2024-09-21T07:39:37.881 INFO:tasks.cephadm:Fetching config... 2024-09-21T07:39:37.881 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:39:37.882 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T07:39:37.920 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T07:39:37.920 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:39:37.920 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T07:39:37.995 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T07:39:37.995 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:39:37.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T07:39:38.092 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T07:39:38.092 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:39:38.092 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T07:39:38.169 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T07:39:38.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrz0GA5kNAVeD9B9aYl9AWFKuezx9l3el7r5K/AXqsF1YRgCRkYxUy+IoeWZptN23b6kXlZY2DdnpPKPtJ5YzM4gHNaOFxfiwqipZqng56RweRdjX896AIv0URvAK4fhHDlxEUA1SuYl35BcYkn/KZMRQH1H8MeY6Qs5GKuKWtRfcZV44HE10G/5Zjjq+eLQnatx+lmnN/KiASiJWag7H6jCg1xa3HSwm0ZMVuvMYyQepoUk5weWsCn0xPJ9lAoWfGlWVgRMahonuEU5KpbHWLEzsYp7EnJOgQHz0eASYZb3Mh7vsTI7bdUrpj6BNNTDHHUlqgmSWMEPb6K6A8zHLJs/QHJW4yXgG0Ivy/UsVOElcvUKRR7ATj0SIZW40/PV9zwm8AwWsEsbPv7MYGngkDWQa0mqw6CuIWjV7eORJseDsNRzMTdXfBUO9A7RtjH6GCBXNe5w4A8JKMuqXi8VOGfJ+1l02U+TKuCZVFrVICkhzQUlWX6U3OtlsHNJiIwbE= ceph-56620f92-77ec-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:39:38.289 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrz0GA5kNAVeD9B9aYl9AWFKuezx9l3el7r5K/AXqsF1YRgCRkYxUy+IoeWZptN23b6kXlZY2DdnpPKPtJ5YzM4gHNaOFxfiwqipZqng56RweRdjX896AIv0URvAK4fhHDlxEUA1SuYl35BcYkn/KZMRQH1H8MeY6Qs5GKuKWtRfcZV44HE10G/5Zjjq+eLQnatx+lmnN/KiASiJWag7H6jCg1xa3HSwm0ZMVuvMYyQepoUk5weWsCn0xPJ9lAoWfGlWVgRMahonuEU5KpbHWLEzsYp7EnJOgQHz0eASYZb3Mh7vsTI7bdUrpj6BNNTDHHUlqgmSWMEPb6K6A8zHLJs/QHJW4yXgG0Ivy/UsVOElcvUKRR7ATj0SIZW40/PV9zwm8AwWsEsbPv7MYGngkDWQa0mqw6CuIWjV7eORJseDsNRzMTdXfBUO9A7RtjH6GCBXNe5w4A8JKMuqXi8VOGfJ+1l02U+TKuCZVFrVICkhzQUlWX6U3OtlsHNJiIwbE= ceph-56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:39:38.314 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrz0GA5kNAVeD9B9aYl9AWFKuezx9l3el7r5K/AXqsF1YRgCRkYxUy+IoeWZptN23b6kXlZY2DdnpPKPtJ5YzM4gHNaOFxfiwqipZqng56RweRdjX896AIv0URvAK4fhHDlxEUA1SuYl35BcYkn/KZMRQH1H8MeY6Qs5GKuKWtRfcZV44HE10G/5Zjjq+eLQnatx+lmnN/KiASiJWag7H6jCg1xa3HSwm0ZMVuvMYyQepoUk5weWsCn0xPJ9lAoWfGlWVgRMahonuEU5KpbHWLEzsYp7EnJOgQHz0eASYZb3Mh7vsTI7bdUrpj6BNNTDHHUlqgmSWMEPb6K6A8zHLJs/QHJW4yXgG0Ivy/UsVOElcvUKRR7ATj0SIZW40/PV9zwm8AwWsEsbPv7MYGngkDWQa0mqw6CuIWjV7eORJseDsNRzMTdXfBUO9A7RtjH6GCBXNe5w4A8JKMuqXi8VOGfJ+1l02U+TKuCZVFrVICkhzQUlWX6U3OtlsHNJiIwbE= ceph-56620f92-77ec-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:39:38.355 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrz0GA5kNAVeD9B9aYl9AWFKuezx9l3el7r5K/AXqsF1YRgCRkYxUy+IoeWZptN23b6kXlZY2DdnpPKPtJ5YzM4gHNaOFxfiwqipZqng56RweRdjX896AIv0URvAK4fhHDlxEUA1SuYl35BcYkn/KZMRQH1H8MeY6Qs5GKuKWtRfcZV44HE10G/5Zjjq+eLQnatx+lmnN/KiASiJWag7H6jCg1xa3HSwm0ZMVuvMYyQepoUk5weWsCn0xPJ9lAoWfGlWVgRMahonuEU5KpbHWLEzsYp7EnJOgQHz0eASYZb3Mh7vsTI7bdUrpj6BNNTDHHUlqgmSWMEPb6K6A8zHLJs/QHJW4yXgG0Ivy/UsVOElcvUKRR7ATj0SIZW40/PV9zwm8AwWsEsbPv7MYGngkDWQa0mqw6CuIWjV7eORJseDsNRzMTdXfBUO9A7RtjH6GCBXNe5w4A8JKMuqXi8VOGfJ+1l02U+TKuCZVFrVICkhzQUlWX6U3OtlsHNJiIwbE= ceph-56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:39:38.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrz0GA5kNAVeD9B9aYl9AWFKuezx9l3el7r5K/AXqsF1YRgCRkYxUy+IoeWZptN23b6kXlZY2DdnpPKPtJ5YzM4gHNaOFxfiwqipZqng56RweRdjX896AIv0URvAK4fhHDlxEUA1SuYl35BcYkn/KZMRQH1H8MeY6Qs5GKuKWtRfcZV44HE10G/5Zjjq+eLQnatx+lmnN/KiASiJWag7H6jCg1xa3HSwm0ZMVuvMYyQepoUk5weWsCn0xPJ9lAoWfGlWVgRMahonuEU5KpbHWLEzsYp7EnJOgQHz0eASYZb3Mh7vsTI7bdUrpj6BNNTDHHUlqgmSWMEPb6K6A8zHLJs/QHJW4yXgG0Ivy/UsVOElcvUKRR7ATj0SIZW40/PV9zwm8AwWsEsbPv7MYGngkDWQa0mqw6CuIWjV7eORJseDsNRzMTdXfBUO9A7RtjH6GCBXNe5w4A8JKMuqXi8VOGfJ+1l02U+TKuCZVFrVICkhzQUlWX6U3OtlsHNJiIwbE= ceph-56620f92-77ec-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:39:38.368 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:38 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/676099394' entity='client.admin' 2024-09-21T07:39:38.409 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrz0GA5kNAVeD9B9aYl9AWFKuezx9l3el7r5K/AXqsF1YRgCRkYxUy+IoeWZptN23b6kXlZY2DdnpPKPtJ5YzM4gHNaOFxfiwqipZqng56RweRdjX896AIv0URvAK4fhHDlxEUA1SuYl35BcYkn/KZMRQH1H8MeY6Qs5GKuKWtRfcZV44HE10G/5Zjjq+eLQnatx+lmnN/KiASiJWag7H6jCg1xa3HSwm0ZMVuvMYyQepoUk5weWsCn0xPJ9lAoWfGlWVgRMahonuEU5KpbHWLEzsYp7EnJOgQHz0eASYZb3Mh7vsTI7bdUrpj6BNNTDHHUlqgmSWMEPb6K6A8zHLJs/QHJW4yXgG0Ivy/UsVOElcvUKRR7ATj0SIZW40/PV9zwm8AwWsEsbPv7MYGngkDWQa0mqw6CuIWjV7eORJseDsNRzMTdXfBUO9A7RtjH6GCBXNe5w4A8JKMuqXi8VOGfJ+1l02U+TKuCZVFrVICkhzQUlWX6U3OtlsHNJiIwbE= ceph-56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:39:38.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T07:39:38.789 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:39:39.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:39 smithi084 ceph-mon[30411]: mgrmap e14: x(active, since 12s) 2024-09-21T07:39:40.390 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T07:39:40.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T07:39:40.893 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:39:41.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:40 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2034812188' entity='client.admin' 2024-09-21T07:39:42.827 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-21T07:39:42.827 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:39:42.828 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:39:42.848 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:39:42.848 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:39:42.906 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-21T07:39:42.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch host add smithi162 2024-09-21T07:39:43.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:43 smithi084 ceph-mon[30411]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:43.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:43 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:43.507 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:39:44.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:44 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:44.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:44 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:44.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:44 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T07:39:44.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:44 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:39:44.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:44 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:39:44.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:44 smithi084 ceph-mon[30411]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T07:39:44.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:44 smithi084 ceph-mon[30411]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:39:45.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:39:45.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:45 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:46.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:46 smithi084 ceph-mon[30411]: Deploying cephadm binary to smithi162 2024-09-21T07:39:46.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:46 smithi084 ceph-mon[30411]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:47.476 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-21T07:39:48.145 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:39:48.501 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:39:48.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:48 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:48.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:48 smithi084 ceph-mon[30411]: Added host smithi162 2024-09-21T07:39:48.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:48 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:48.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:48 smithi084 ceph-mon[30411]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:48.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:48 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:48.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:48 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:49.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:49.276 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-21T07:39:49.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:49 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:49.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:49 smithi084 ceph-mon[30411]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:39:49.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:49 smithi084 ceph-mon[30411]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:49.991 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2024-09-21T07:39:49.991 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:39:49.991 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:39:50.010 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:39:50.010 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:39:50.068 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2024-09-21T07:39:50.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch host add smithi191 2024-09-21T07:39:50.424 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:39:53.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:53.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:52 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:54.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:53 smithi084 ceph-mon[30411]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:39:54.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:53 smithi084 ceph-mon[30411]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:39:54.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:53 smithi084 ceph-mon[30411]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:39:54.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:53 smithi084 ceph-mon[30411]: Deploying cephadm binary to smithi191 2024-09-21T07:39:54.299 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi191' with addr '172.21.15.191' 2024-09-21T07:39:54.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:54 smithi084 ceph-mon[30411]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:54.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:54 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:54.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:54 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:54.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:54 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:54.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:39:55.262 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:39:55.657 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:55 smithi084 ceph-mon[30411]: Added host smithi191 2024-09-21T07:39:55.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:55 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:55.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:55 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:56.036 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:39:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2024-09-21T07:39:56.642 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:56 smithi084 ceph-mon[30411]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:56.683 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T07:39:56.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T07:39:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:39:57.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:57 smithi084 ceph-mon[30411]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:39:58.617 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-09-21T07:39:58.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:39:58.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3265290111' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:39:58.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:58.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:58.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:58.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:39:59.000 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"} : dispatch 2024-09-21T07:39:59.000 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:39:59.000 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:58 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:39:59.319 INFO:tasks.cephadm:Adding mon.a on smithi084 2024-09-21T07:39:59.319 INFO:tasks.cephadm:Adding mon.b on smithi162 2024-09-21T07:39:59.319 INFO:tasks.cephadm:Adding mon.c on smithi191 2024-09-21T07:39:59.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c' 2024-09-21T07:39:59.553 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3265290111' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:39:59 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:00.223 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2024-09-21T07:40:00.848 DEBUG:teuthology.orchestra.run.smithi162:mon.b> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T07:40:00.851 DEBUG:teuthology.orchestra.run.smithi191:mon.c> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T07:40:00.853 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:40:00.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:40:01.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:00 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:01.797 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:02.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:01 smithi084 ceph-mon[30411]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:40:02.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:01 smithi084 ceph-mon[30411]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c;count:3 2024-09-21T07:40:02.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:01 smithi084 ceph-mon[30411]: Deploying daemon mon.c on smithi191 2024-09-21T07:40:03.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:02 smithi084 ceph-mon[30411]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:40:03.469 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","modified":"2024-09-21T07:38:27.414531Z","created":"2024-09-21T07:38:27.414531Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:40:03.469 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-21T07:40:04.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/2804006772' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:40:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Deploying cephadm binary to smithi191 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Added host smithi191 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3265290111' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3265290111' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:04.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:04.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:40:04.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c;count:3 2024-09-21T07:40:04.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: Deploying daemon mon.c on smithi191 2024-09-21T07:40:04.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:04.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/2804006772' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:04.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 ceph-mon[34667]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T07:40:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 bash[34648]: cedc443a8dfd1cf982cf8f2ef181d2a87de5a3681b43a98699095b740e999807 2024-09-21T07:40:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:04 smithi191 systemd[1]: Started Ceph mon.c for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:40:05.165 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:40:05.165 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:40:05.418 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: mon.a calling monitor election 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: mon.c calling monitor election 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:10.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: monmap epoch 2 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: last_changed 2024-09-21T07:40:04.600774+0000 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: min_mon_release 19 (squid) 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: election_strategy: 1 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:10.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: fsmap 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: mgrmap e14: x(active, since 43s) 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: overall HEALTH_OK 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:10.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:09 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: mon.a calling monitor election 2024-09-21T07:40:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: mon.c calling monitor election 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: monmap epoch 2 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: last_changed 2024-09-21T07:40:04.600774+0000 2024-09-21T07:40:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: min_mon_release 19 (squid) 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: election_strategy: 1 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: fsmap 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: mgrmap e14: x(active, since 43s) 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: overall HEALTH_OK 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:10.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:10.158 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:10.158 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:09 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:10.513 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:40:10.513 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","modified":"2024-09-21T07:40:04.600774Z","created":"2024-09-21T07:38:27.414531Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:40:10.513 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-09-21T07:40:10.809 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:10 smithi191 ceph-mon[34667]: Deploying daemon mon.b on smithi162 2024-09-21T07:40:10.809 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:10 smithi191 ceph-mon[34667]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:10.809 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:10 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/3042582471' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:10.809 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:10 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:11.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:10 smithi084 ceph-mon[30411]: Deploying daemon mon.b on smithi162 2024-09-21T07:40:11.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:10 smithi084 ceph-mon[30411]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:11.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:10 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/3042582471' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:11.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:10 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:12.170 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:40:12.171 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:40:12.423 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:40:12.854 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:12 smithi191 ceph-mon[34667]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 podman[34814]: 2024-09-21 07:40:12.933666395 +0000 UTC m=+0.015793661 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:40:13.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:12 smithi084 ceph-mon[30411]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.120 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:40:13.120 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","modified":"2024-09-21T07:40:04.600774Z","created":"2024-09-21T07:38:27.414531Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:40:13.121 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-09-21T07:40:13.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 podman[34814]: 2024-09-21 07:40:13.225125768 +0000 UTC m=+0.307253019 container init 0788e5b682ab1d9526d84345d086ad49077703b3e2accd75f94dee981043ad42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 podman[34814]: 2024-09-21 07:40:13.228422768 +0000 UTC m=+0.310550028 container start 0788e5b682ab1d9526d84345d086ad49077703b3e2accd75f94dee981043ad42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pidfile_write: ignore empty --pid-file 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: load: jerasure load: lrc 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: RocksDB version: 7.9.2 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Git sha 0 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T07:40:13.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: DB SUMMARY 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: DB Session ID: 399KNI48XKG4YT2IZTII 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:40:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T07:40:13.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.env: 0x562122ba8d60 2024-09-21T07:40:13.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T07:40:13.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.info_log: 0x562127b85360 2024-09-21T07:40:13.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:40:13.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.statistics: (nil) 2024-09-21T07:40:13.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.use_fsync: 0 2024-09-21T07:40:13.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:40:13.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:40:13.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:40:13.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:40:13.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:40:13.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:40:13.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:40:13.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:40:13.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:40:13.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:40:13.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:40:13.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.db_log_dir: 2024-09-21T07:40:13.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.wal_dir: 2024-09-21T07:40:13.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:40:13.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:40:13.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:40:13.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:40:13.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:40:13.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:40:13.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:40:13.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:40:13.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.write_buffer_manager: 0x562127b89d60 2024-09-21T07:40:13.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:40:13.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:40:13.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:40:13.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:40:13.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:40:13.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:40:13.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:40:13.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:40:13.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.unordered_write: 0 2024-09-21T07:40:13.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:40:13.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:40:13.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:40:13.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:40:13.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.row_cache: None 2024-09-21T07:40:13.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.wal_filter: None 2024-09-21T07:40:13.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:40:13.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:40:13.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:40:13.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:40:13.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.wal_compression: 0 2024-09-21T07:40:13.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:40:13.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:40:13.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:40:13.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:40:13.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:40:13.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:40:13.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:40:13.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:40:13.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:40:13.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:40:13.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:40:13.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T07:40:13.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:40:13.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:40:13.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:40:13.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:40:13.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:40:13.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:40:13.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:40:13.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:40:13.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:40:13.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:40:13.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:40:13.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_open_files: -1 2024-09-21T07:40:13.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:40:13.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:40:13.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:40:13.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:40:13.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:40:13.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Compression algorithms supported: 2024-09-21T07:40:13.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kZSTD supported: 0 2024-09-21T07:40:13.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:40:13.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:40:13.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:40:13.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:40:13.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:40:13.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:40:13.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:40:13.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:40:13.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T07:40:13.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T07:40:13.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T07:40:13.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:40:13.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.merge_operator: 2024-09-21T07:40:13.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_filter: None 2024-09-21T07:40:13.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:40:13.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:40:13.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:40:13.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562127b84fa0) 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_type: 0 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_index_type: 0 2024-09-21T07:40:13.572 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_shortening: 1 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: checksum: 4 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: no_block_cache: 0 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache: 0x562123b49610 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_options: 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: capacity : 536870912 2024-09-21T07:40:13.573 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_shard_bits : 4 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: strict_capacity_limit : 0 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_cache_compressed: (nil) 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: persistent_cache: (nil) 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size: 4096 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_size_deviation: 10 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_restart_interval: 16 2024-09-21T07:40:13.574 INFO:journalctl@ceph.mon.b.smithi162.stdout: index_block_restart_interval: 1 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: metadata_block_size: 4096 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: partition_filters: 0 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: use_delta_encoding: 1 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: filter_policy: bloomfilter 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: whole_key_filtering: 1 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: verify_compression: 0 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: format_version: 5 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_index_compression: 1 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: block_align: 0 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: max_auto_readahead_size: 262144 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: prepopulate_block_cache: 0 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: initial_auto_readahead_size: 8192 2024-09-21T07:40:13.575 INFO:journalctl@ceph.mon.b.smithi162.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression: NoCompression 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.num_levels: 7 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:40:13.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:40:13.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:40:13.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:40:13.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:40:13.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.ttl: 2592000 2024-09-21T07:40:13.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T07:40:13.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 824ddb88-15ad-4dca-a8d1-45997df8d420 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726904413265139, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726904413265585, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726904413, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "824ddb88-15ad-4dca-a8d1-45997df8d420", "db_session_id": "399KNI48XKG4YT2IZTII", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726904413265688, "job": 1, "event": "recovery_finished"} 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562127ba8a80 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: DB pointer 0x56212894e000 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T07:40:13.583 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** DB Stats ** 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T07:40:13.584 INFO:journalctl@ceph.mon.b.smithi162.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:40:13.585 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache BinnedLRUCache@0x562123b49610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: using public_addr v2:172.21.15.162:0/0 -> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-21T07:40:13.586 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: starting mon.b rank -1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(???) e0 preinit fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout: e1 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout: btime 2024-09-21T07:38:31:274055+0000 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout: legacy client fscid: -1 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout: 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout: No filesystems configured 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T07:40:13.587 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:13.588 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Deploying cephadm binary to smithi191 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Added host smithi191 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.589 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3265290111' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:13.590 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3265290111' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:13.591 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c;count:3 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Deploying daemon mon.c on smithi191 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/2804006772' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.a calling monitor election 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.c calling monitor election 2024-09-21T07:40:13.592 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: monmap epoch 2 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: last_changed 2024-09-21T07:40:04.600774+0000 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: min_mon_release 19 (squid) 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: election_strategy: 1 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: fsmap 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:13.593 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mgrmap e14: x(active, since 43s) 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: Deploying daemon mon.b on smithi162 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/3042582471' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 ceph-mon[34833]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 bash[34814]: 0788e5b682ab1d9526d84345d086ad49077703b3e2accd75f94dee981043ad42 2024-09-21T07:40:13.594 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:13 smithi162 systemd[1]: Started Ceph mon.b for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:40:14.660 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:40:14.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:40:14.913 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:40:18.598 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:40:18.598 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","modified":"2024-09-21T07:40:13.295136Z","created":"2024-09-21T07:38:27.414531Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:40:18.598 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2024-09-21T07:40:18.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: mon.c calling monitor election 2024-09-21T07:40:18.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:18.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: mon.a calling monitor election 2024-09-21T07:40:18.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: monmap epoch 3 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: last_changed 2024-09-21T07:40:13.295136+0000 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: min_mon_release 19 (squid) 2024-09-21T07:40:18.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: election_strategy: 1 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: fsmap 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: mgrmap e14: x(active, since 52s) 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: overall HEALTH_OK 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:18.657 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:18 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: mon.c calling monitor election 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: mon.a calling monitor election 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: monmap epoch 3 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: last_changed 2024-09-21T07:40:13.295136+0000 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: min_mon_release 19 (squid) 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: election_strategy: 1 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T07:40:18.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: fsmap 2024-09-21T07:40:18.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:18.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: mgrmap e14: x(active, since 52s) 2024-09-21T07:40:18.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: overall HEALTH_OK 2024-09-21T07:40:18.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:18.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:18.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:18.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:18 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:19.213 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T07:40:19.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T07:40:19.533 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:19 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:19.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:19 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/3827141439' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:19.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:19 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:19 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:19 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/3827141439' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:19 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:19.586 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:20.450 INFO:teuthology.orchestra.run.smithi084.stdout:# minimal ceph.conf for 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:20.450 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-09-21T07:40:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: mon_host = [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: mon.c calling monitor election 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: mon.a calling monitor election 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: monmap epoch 3 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: last_changed 2024-09-21T07:40:13.295136+0000 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: min_mon_release 19 (squid) 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: election_strategy: 1 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: fsmap 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: mgrmap e14: x(active, since 52s) 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/3827141439' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:40:20.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:20 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:21.151 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T07:40:21.151 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:40:21.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:40:21.215 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:40:21.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:21.312 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:40:21.312 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:40:21.340 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:40:21.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:21.406 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:40:21.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:40:21.437 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:40:21.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: mon.b calling monitor election 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: mon.b calling monitor election 2024-09-21T07:40:21.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: mon.a calling monitor election 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: mon.c calling monitor election 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: monmap epoch 3 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: last_changed 2024-09-21T07:40:13.295136+0000 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: min_mon_release 19 (squid) 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: election_strategy: 1 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: fsmap 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:21.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: mgrmap e14: x(active, since 54s) 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: overall HEALTH_OK 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/478098397' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:21.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: Reconfiguring daemon mon.a on smithi084 2024-09-21T07:40:21.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:21 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.501 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: mon.b calling monitor election 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: mon.b calling monitor election 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: mon.a calling monitor election 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: mon.c calling monitor election 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:40:21.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: monmap epoch 3 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: last_changed 2024-09-21T07:40:13.295136+0000 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: min_mon_release 19 (squid) 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: election_strategy: 1 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: fsmap 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: mgrmap e14: x(active, since 54s) 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: overall HEALTH_OK 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/478098397' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:21.503 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: Reconfiguring daemon mon.a on smithi084 2024-09-21T07:40:21.504 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:21 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.505 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T07:40:21.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T07:40:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: mon.b calling monitor election 2024-09-21T07:40:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T07:40:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: mon.b calling monitor election 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: mon.a calling monitor election 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: mon.c calling monitor election 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: monmap epoch 3 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: last_changed 2024-09-21T07:40:13.295136+0000 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: created 2024-09-21T07:38:27.414531+0000 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: min_mon_release 19 (squid) 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: election_strategy: 1 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-21T07:40:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: fsmap 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: mgrmap e14: x(active, since 54s) 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/478098397' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:40:21.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:21.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:21.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:21.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: Reconfiguring daemon mon.a on smithi084 2024-09-21T07:40:21.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:21 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:22.040 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:22.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:22 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:22.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:22 smithi084 ceph-mon[30411]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:22.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:22 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:22.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:22 smithi162 ceph-mon[34833]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:22.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:22 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:22.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:22 smithi191 ceph-mon[34667]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:24.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:24.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:24.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:40:24.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:24.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:24.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:24.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: Reconfiguring daemon mon.b on smithi162 2024-09-21T07:40:24.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/693386337' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:40:24.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:23 smithi191 ceph-mon[34667]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: Reconfiguring daemon mon.b on smithi162 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/693386337' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:40:24.199 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:23 smithi162 ceph-mon[34833]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:24.226 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:24.226 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' 2024-09-21T07:40:24.226 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:40:24.226 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:24.226 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:24.227 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: from='mgr.14152 172.21.15.84:0/1365720784' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:24.227 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: Reconfiguring daemon mon.b on smithi162 2024-09-21T07:40:24.227 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/693386337' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T07:40:24.227 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:23 smithi084 ceph-mon[30411]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:24.227 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:24 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ignoring --setuser ceph since I am not root 2024-09-21T07:40:24.227 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:24 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ignoring --setgroup ceph since I am not root 2024-09-21T07:40:24.581 INFO:tasks.cephadm:Adding mgr.x on smithi084 2024-09-21T07:40:24.581 INFO:tasks.cephadm:Adding mgr.y on smithi162 2024-09-21T07:40:24.581 INFO:tasks.cephadm:Adding mgr.z on smithi191 2024-09-21T07:40:24.582 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi084=x;smithi162=y;smithi191=z' 2024-09-21T07:40:24.832 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:40:25.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:24 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/693386337' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:40:25.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:24 smithi191 ceph-mon[34667]: mgrmap e15: x(active, since 58s) 2024-09-21T07:40:25.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:24 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/693386337' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:40:25.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:24 smithi162 ceph-mon[34833]: mgrmap e15: x(active, since 58s) 2024-09-21T07:40:25.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:24 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/693386337' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T07:40:25.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:24 smithi084 ceph-mon[30411]: mgrmap e15: x(active, since 58s) 2024-09-21T07:40:30.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: Active manager daemon x restarted 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: Activating manager daemon x 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: mgrmap e16: x(active, starting, since 0.00517352s) 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:40:30.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:29 smithi191 ceph-mon[34667]: Manager daemon x is now available 2024-09-21T07:40:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: Active manager daemon x restarted 2024-09-21T07:40:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: Activating manager daemon x 2024-09-21T07:40:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:40:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: mgrmap e16: x(active, starting, since 0.00517352s) 2024-09-21T07:40:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:30.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:40:30.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:40:30.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:40:30.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:40:30.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:29 smithi162 ceph-mon[34833]: Manager daemon x is now available 2024-09-21T07:40:30.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: Active manager daemon x restarted 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: Activating manager daemon x 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: mgrmap e16: x(active, starting, since 0.00517352s) 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:40:30.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:29 smithi084 ceph-mon[30411]: Manager daemon x is now available 2024-09-21T07:40:30.889 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2024-09-21T07:40:31.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:31.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:40:31.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:40:31.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:30 smithi084 ceph-mon[30411]: mgrmap e17: x(active, since 1.01137s) 2024-09-21T07:40:31.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:40:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:40:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:30 smithi191 ceph-mon[34667]: mgrmap e17: x(active, since 1.01137s) 2024-09-21T07:40:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:31.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:31.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:40:31.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:40:31.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:30 smithi162 ceph-mon[34833]: mgrmap e17: x(active, since 1.01137s) 2024-09-21T07:40:31.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:31.430 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:40:31.130+0000 7f9801200640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:40:31] ENGINE Error in HTTPServer.serve 2024-09-21T07:40:31.430 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: Traceback (most recent call last): 2024-09-21T07:40:31.430 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:40:31.430 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._connections.run(self.expiration_interval) 2024-09-21T07:40:31.430 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:40:31.430 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._run(expiration_interval) 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: s = self.context.wrap_socket( 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: return self.sslsocket_class._create( 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self.do_handshake() 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: self._sslobj.do_handshake() 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:40:31.431 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:40:31.588 DEBUG:teuthology.orchestra.run.smithi162:mgr.y> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T07:40:31.590 DEBUG:teuthology.orchestra.run.smithi191:mgr.z> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T07:40:31.593 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T07:40:31.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T07:40:31.597 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T07:40:31.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T07:40:31.641 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T07:40:31.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T07:40:31.686 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T07:40:31.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T07:40:31.731 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T07:40:31.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T07:40:31.777 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T07:40:31.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T07:40:31.832 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T07:40:31.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T07:40:31.885 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T07:40:31.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T07:40:31.934 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T07:40:31.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T07:40:31.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: Saving service mgr spec with placement smithi084=x;smithi162=y;smithi191=z;count:3 2024-09-21T07:40:31.941 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: [21/Sep/2024:07:40:30] ENGINE Bus STARTING 2024-09-21T07:40:31.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: [21/Sep/2024:07:40:31] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T07:40:31.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:31.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:31.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:31.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:31.942 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:31.957 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T07:40:31.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T07:40:32.011 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T07:40:32.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T07:40:32.067 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T07:40:32.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T07:40:32.117 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T07:40:32.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T07:40:32.169 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T07:40:32.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T07:40:32.223 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T07:40:32.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T07:40:32.281 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T07:40:32.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T07:40:32.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: Saving service mgr spec with placement smithi084=x;smithi162=y;smithi191=z;count:3 2024-09-21T07:40:32.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: [21/Sep/2024:07:40:30] ENGINE Bus STARTING 2024-09-21T07:40:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: [21/Sep/2024:07:40:31] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T07:40:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:32.332 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T07:40:32.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T07:40:32.387 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T07:40:32.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: Saving service mgr spec with placement smithi084=x;smithi162=y;smithi191=z;count:3 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: [21/Sep/2024:07:40:30] ENGINE Bus STARTING 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: [21/Sep/2024:07:40:31] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:32.452 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T07:40:32.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T07:40:32.505 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T07:40:32.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T07:40:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:32.563 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T07:40:32.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T07:40:32.627 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T07:40:32.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T07:40:32.635 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:32.654 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T07:40:32.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T07:40:32.711 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T07:40:32.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T07:40:32.774 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T07:40:32.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T07:40:32.840 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T07:40:32.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T07:40:32.898 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T07:40:32.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T07:40:32.987 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T07:40:32.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T07:40:33.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: [21/Sep/2024:07:40:31] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: [21/Sep/2024:07:40:31] ENGINE Bus STARTED 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: [21/Sep/2024:07:40:31] ENGINE Error in HTTPServer.serve 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T07:40:33.011 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:32 smithi084 ceph-mon[30411]: mgrmap e18: x(active, since 3s) 2024-09-21T07:40:33.025 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T07:40:33.025 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T07:40:33.087 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T07:40:33.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T07:40:33.159 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T07:40:33.159 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi084') 2024-09-21T07:40:33.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: [21/Sep/2024:07:40:31] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: [21/Sep/2024:07:40:31] ENGINE Bus STARTED 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: [21/Sep/2024:07:40:31] ENGINE Error in HTTPServer.serve 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: Traceback (most recent call last): 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._run(expiration_interval) 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:40:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: s = self.context.wrap_socket( 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: return self.sslsocket_class._create( 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: self.do_handshake() 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: self._sslobj.do_handshake() 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:33.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:32 smithi162 ceph-mon[34833]: mgrmap e18: x(active, since 3s) 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: [21/Sep/2024:07:40:31] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: [21/Sep/2024:07:40:31] ENGINE Bus STARTED 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: [21/Sep/2024:07:40:31] ENGINE Error in HTTPServer.serve 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout: Traceback (most recent call last): 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:40:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout: self._run(expiration_interval) 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: s = self.context.wrap_socket( 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: return self.sslsocket_class._create( 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: self.do_handshake() 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: self._sslobj.do_handshake() 2024-09-21T07:40:33.406 INFO:journalctl@ceph.mon.c.smithi191.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:33.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:32 smithi191 ceph-mon[34667]: mgrmap e18: x(active, since 3s) 2024-09-21T07:40:33.858 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:34.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 -- 172.21.15.84:0/1108954934 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28d003fbb0 msgr2=0x7f28d00420c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:34.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 --2- 172.21.15.84:0/1108954934 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28d003fbb0 0x7f28d00420c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28dc005fd0 tx=0x7f28dc0095c0 comp rx=0 tx=0).stop 2024-09-21T07:40:34.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 -- 172.21.15.84:0/1108954934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28e8109ba0 msgr2=0x7f28e81a0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:34.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 --2- 172.21.15.84:0/1108954934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28e8109ba0 0x7f28e81a0070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28e400d8d0 tx=0x7f28e400dd90 comp rx=0 tx=0).stop 2024-09-21T07:40:34.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 -- 172.21.15.84:0/1108954934 shutdown_connections 2024-09-21T07:40:34.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 --2- 172.21.15.84:0/1108954934 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28d003fbb0 0x7f28d00420c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:34.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 --2- 172.21.15.84:0/1108954934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28e810b5d0 0x7f28e81a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:34.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 --2- 172.21.15.84:0/1108954934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28e810ac30 0x7f28e81a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:34.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 --2- 172.21.15.84:0/1108954934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28e8109ba0 0x7f28e81a0070 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:34.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 -- 172.21.15.84:0/1108954934 >> 172.21.15.84:0/1108954934 conn(0x7f28e8078f40 msgr2=0x7f28e810df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:34.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.487+0000 7f28ef200640 1 -- 172.21.15.84:0/1108954934 shutdown_connections 2024-09-21T07:40:34.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:34.488+0000 7f28ef200640 1 -- 172.21.15.84:0/1108954934 wait complete. 2024-09-21T07:40:35.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4096531397' entity='client.admin' 2024-09-21T07:40:35.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:35 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:35.205 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi084') 2024-09-21T07:40:35.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4096531397' entity='client.admin' 2024-09-21T07:40:35.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:35 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4096531397' entity='client.admin' 2024-09-21T07:40:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:35 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:35.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 -- 172.21.15.84:0/1255399037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104600 msgr2=0x7fa634104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:35.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 --2- 172.21.15.84:0/1255399037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104600 0x7fa634104a10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa620009900 tx=0x7fa62002a480 comp rx=0 tx=0).stop 2024-09-21T07:40:35.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 -- 172.21.15.84:0/1255399037 shutdown_connections 2024-09-21T07:40:35.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 --2- 172.21.15.84:0/1255399037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104fa0 0x7fa63410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:35.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 --2- 172.21.15.84:0/1255399037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104600 0x7fa634104a10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:35.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 --2- 172.21.15.84:0/1255399037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa634103570 0x7fa6341039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 -- 172.21.15.84:0/1255399037 >> 172.21.15.84:0/1255399037 conn(0x7fa6340feec0 msgr2=0x7fa634101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 -- 172.21.15.84:0/1255399037 shutdown_connections 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.921+0000 7fa63a000640 1 -- 172.21.15.84:0/1255399037 wait complete. 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.922+0000 7fa63a000640 1 Processor -- start 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa63a000640 1 -- start start 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa63a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa634103570 0x7fa634076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa63a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104600 0x7fa634075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa63a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104fa0 0x7fa634075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa63a000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa63410eeb0 con 0x7fa634104600 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa63a000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa63410ed30 con 0x7fa634104fa0 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa63a000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa63410f030 con 0x7fa634103570 2024-09-21T07:40:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa633e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104600 0x7fa634075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa633e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104600 0x7fa634075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53746/0 (socket says 172.21.15.84:53746) 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa638c00640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa634103570 0x7fa634076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa633e00640 1 -- 172.21.15.84:0/600578638 learned_addr learned my addr 172.21.15.84:0/600578638 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.923+0000 7fa639600640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104fa0 0x7fa634075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa633e00640 1 -- 172.21.15.84:0/600578638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa634103570 msgr2=0x7fa634076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa633e00640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa634103570 0x7fa634076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa633e00640 1 -- 172.21.15.84:0/600578638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104fa0 msgr2=0x7fa634075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa633e00640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104fa0 0x7fa634075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa633e00640 1 -- 172.21.15.84:0/600578638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa634076350 con 0x7fa634104600 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa638c00640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa634103570 0x7fa634076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa639600640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104fa0 0x7fa634075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa633e00640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104600 0x7fa634075710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa620005ab0 tx=0x7fa620004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62003f070 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6341a3c00 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7fa620003a50 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.924+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620035030 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.925+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6341a3ff0 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.926+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63410f670 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.926+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fa620042070 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.926+0000 7fa631600640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa61c03fb70 0x7fa61c042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.927+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa620074f80 con 0x7fa634104600 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.927+0000 7fa638c00640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa61c03fb70 0x7fa61c042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.927+0000 7fa638c00640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa61c03fb70 0x7fa61c042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa62800bfd0 tx=0x7fa62800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:35.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.932+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa620004770 con 0x7fa634104600 2024-09-21T07:40:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.028+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fa620049ca0 con 0x7fa634104600 2024-09-21T07:40:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.138+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fa63402e810 con 0x7fa634104600 2024-09-21T07:40:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.805+0000 7f8fb5400640 1 -- 172.21.15.84:0/314686790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0103570 msgr2=0x7f8fb01039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.805+0000 7f8fb5400640 1 --2- 172.21.15.84:0/314686790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0103570 0x7f8fb01039e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009860 tx=0x7f8fa002a3d0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.806+0000 7f8fb5400640 1 -- 172.21.15.84:0/314686790 shutdown_connections 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.806+0000 7f8fb5400640 1 --2- 172.21.15.84:0/314686790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0104fa0 0x7f8fb010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.806+0000 7f8fb5400640 1 --2- 172.21.15.84:0/314686790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104600 0x7f8fb0104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.806+0000 7f8fb5400640 1 --2- 172.21.15.84:0/314686790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0103570 0x7f8fb01039e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.806+0000 7f8fb5400640 1 -- 172.21.15.84:0/314686790 >> 172.21.15.84:0/314686790 conn(0x7f8fb00feec0 msgr2=0x7f8fb0101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.806+0000 7f8fb5400640 1 -- 172.21.15.84:0/314686790 shutdown_connections 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.806+0000 7f8fb5400640 1 -- 172.21.15.84:0/314686790 wait complete. 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.807+0000 7f8fb5400640 1 Processor -- start 2024-09-21T07:40:36.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.807+0000 7f8fb5400640 1 -- start start 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0103570 0x7f8fb0199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0104600 0x7f8fb019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104fa0 0x7f8fb019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb5400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010eec0 con 0x7f8fb0104fa0 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010ed40 con 0x7f8fb0104600 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb5400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010f040 con 0x7f8fb0103570 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104fa0 0x7f8fb019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104fa0 0x7f8fb019adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53726/0 (socket says 172.21.15.84:53726) 2024-09-21T07:40:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fafe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0103570 0x7f8fb0199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fb4a00640 1 -- 172.21.15.84:0/1749853059 learned_addr learned my addr 172.21.15.84:0/1749853059 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8faf400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0104600 0x7f8fb019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fafe00640 1 -- 172.21.15.84:0/1749853059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0104600 msgr2=0x7f8fb019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fafe00640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0104600 0x7f8fb019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fafe00640 1 -- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104fa0 msgr2=0x7f8fb019adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fafe00640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104fa0 0x7f8fb019adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.808+0000 7f8fafe00640 1 -- 172.21.15.84:0/1749853059 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb019b5d0 con 0x7f8fb0103570 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.809+0000 7f8fb4a00640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104fa0 0x7f8fb019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.809+0000 7f8faf400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0104600 0x7f8fb019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.809+0000 7f8fafe00640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0103570 0x7f8fb0199ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c00 tx=0x7f8fa0030f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.809+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0004460 con 0x7f8fb0103570 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.809+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb019b860 con 0x7f8fb0103570 2024-09-21T07:40:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.809+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7f8fa0005620 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.809+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00046c0 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.810+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb01a1fc0 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.811+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f8fa0039040 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.811+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb010f680 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.811+0000 7f8facc00640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8f9403fb70 0x7f8f94042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.811+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8fa0075460 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.812+0000 7f8faf400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8f9403fb70 0x7f8f94042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.812+0000 7f8faf400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8f9403fb70 0x7f8f94042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c005fd0 tx=0x7f8f9c009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:35.817+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fa0040030 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.022+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f8fb002e710 con 0x7f8fb0103570 2024-09-21T07:40:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.028+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f8fa0039330 con 0x7f8fb0103570 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.028+0000 7f8facc00640 1 -- 172.21.15.84:0/1749853059 <== mon.1 v2:172.21.15.191:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v12)=0 v12) ==== 114+0+0 (secure 0 0 0) 0x7f8fa00035f0 con 0x7f8fb0103570 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8f9403fb70 msgr2=0x7f8f94042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8f9403fb70 0x7f8f94042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c005fd0 tx=0x7f8f9c009260 comp rx=0 tx=0).stop 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0103570 msgr2=0x7f8fb0199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0103570 0x7f8fb0199ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c00 tx=0x7f8fa0030f80 comp rx=0 tx=0).stop 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 shutdown_connections 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8f9403fb70 0x7f8f94042080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb0104fa0 0x7f8fb019adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb0104600 0x7f8fb019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 --2- 172.21.15.84:0/1749853059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0103570 0x7f8fb0199ba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 >> 172.21.15.84:0/1749853059 conn(0x7f8fb00feec0 msgr2=0x7f8fb0107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:36.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 shutdown_connections 2024-09-21T07:40:36.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.033+0000 7f8fb5400640 1 -- 172.21.15.84:0/1749853059 wait complete. 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.142+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7fa620042e10 con 0x7fa634104600 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.143+0000 7fa631600640 1 -- 172.21.15.84:0/600578638 <== mon.0 v2:172.21.15.84:3300/0 9 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa6200372d0 con 0x7fa634104600 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa61c03fb70 msgr2=0x7fa61c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa61c03fb70 0x7fa61c042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa62800bfd0 tx=0x7fa62800b390 comp rx=0 tx=0).stop 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104600 msgr2=0x7fa634075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104600 0x7fa634075710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa620005ab0 tx=0x7fa620004fa0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 shutdown_connections 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa61c03fb70 0x7fa61c042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa634104fa0 0x7fa634075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa634104600 0x7fa634075710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 --2- 172.21.15.84:0/600578638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa634103570 0x7fa634076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:36.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 >> 172.21.15.84:0/600578638 conn(0x7fa6340feec0 msgr2=0x7fa634107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:36.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 shutdown_connections 2024-09-21T07:40:36.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:36.145+0000 7fa63a000640 1 -- 172.21.15.84:0/600578638 wait complete. 2024-09-21T07:40:37.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:37 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:37 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/600578638' entity='client.admin' 2024-09-21T07:40:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:37 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:37 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/600578638' entity='client.admin' 2024-09-21T07:40:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:37.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:37.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:37.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:37 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:37 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/600578638' entity='client.admin' 2024-09-21T07:40:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T07:40:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:37.487 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:37.750 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:38.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T07:40:38.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:38.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:38.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:38.298 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:40:38.299 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:38.299 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:38.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:40:38.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:38.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 -- 172.21.15.84:0/2785205413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f41062d0 msgr2=0x7fe5f41066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2785205413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f41062d0 0x7fe5f41066e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009900 tx=0x7fe5e002a410 comp rx=0 tx=0).stop 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 -- 172.21.15.84:0/2785205413 shutdown_connections 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2785205413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4106c20 0x7fe5f4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2785205413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f41062d0 0x7fe5f41066e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2785205413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f406bd50 0x7fe5f406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 -- 172.21.15.84:0/2785205413 >> 172.21.15.84:0/2785205413 conn(0x7fe5f40799a0 msgr2=0x7fe5f4079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 -- 172.21.15.84:0/2785205413 shutdown_connections 2024-09-21T07:40:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.471+0000 7fe5fb800640 1 -- 172.21.15.84:0/2785205413 wait complete. 2024-09-21T07:40:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.472+0000 7fe5fb800640 1 Processor -- start 2024-09-21T07:40:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5fb800640 1 -- start start 2024-09-21T07:40:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5fb800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f406bd50 0x7fe5f419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5fb800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f41062d0 0x7fe5f419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5fb800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4106c20 0x7fe5f41a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5fb800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f41139a0 con 0x7fe5f406bd50 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5fb800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113820 con 0x7fe5f4106c20 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5fb800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113b20 con 0x7fe5f41062d0 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5f8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f406bd50 0x7fe5f419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5f8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f406bd50 0x7fe5f419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60064/0 (socket says 172.21.15.84:60064) 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5f8e00640 1 -- 172.21.15.84:0/2610488753 learned_addr learned my addr 172.21.15.84:0/2610488753 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.473+0000 7fe5f3e00640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f41062d0 0x7fe5f419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f9800640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4106c20 0x7fe5f41a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f8e00640 1 -- 172.21.15.84:0/2610488753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f41062d0 msgr2=0x7fe5f419cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f8e00640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f41062d0 0x7fe5f419cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f8e00640 1 -- 172.21.15.84:0/2610488753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4106c20 msgr2=0x7fe5f41a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f8e00640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4106c20 0x7fe5f41a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f8e00640 1 -- 172.21.15.84:0/2610488753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f41a2520 con 0x7fe5f406bd50 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f3e00640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f41062d0 0x7fe5f419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f8e00640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f406bd50 0x7fe5f419c5b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9f0 tx=0x7fe5e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800cd80 con 0x7fe5f406bd50 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe5e80108c0 con 0x7fe5f406bd50 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80187d0 con 0x7fe5f406bd50 2024-09-21T07:40:38.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.474+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f41a2810 con 0x7fe5f406bd50 2024-09-21T07:40:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.475+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f41a8f70 con 0x7fe5f406bd50 2024-09-21T07:40:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.476+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fe5e8010430 con 0x7fe5f406bd50 2024-09-21T07:40:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.476+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f406c160 con 0x7fe5f406bd50 2024-09-21T07:40:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.476+0000 7fe5f1600640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe5dc03fb70 0x7fe5dc042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.476+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe5e8054a70 con 0x7fe5f406bd50 2024-09-21T07:40:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.477+0000 7fe5f3e00640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe5dc03fb70 0x7fe5dc042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.477+0000 7fe5f3e00640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe5dc03fb70 0x7fe5dc042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0004770 tx=0x7fe5e00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:38.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.482+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5e80189b0 con 0x7fe5f406bd50 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:40:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:38.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.697+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe5f41a9260 con 0x7fe5f406bd50 2024-09-21T07:40:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.701+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fe5e8010d50 con 0x7fe5f406bd50 2024-09-21T07:40:38.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.702+0000 7fe5f1600640 1 -- 172.21.15.84:0/2610488753 <== mon.0 v2:172.21.15.84:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e8056e50 con 0x7fe5f406bd50 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.703+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe5dc03fb70 msgr2=0x7fe5dc042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.703+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe5dc03fb70 0x7fe5dc042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0004770 tx=0x7fe5e00058d0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.703+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f406bd50 msgr2=0x7fe5f419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.703+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f406bd50 0x7fe5f419c5b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9f0 tx=0x7fe5e800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 shutdown_connections 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe5dc03fb70 0x7fe5dc042080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4106c20 0x7fe5f41a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f41062d0 0x7fe5f419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 --2- 172.21.15.84:0/2610488753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5f406bd50 0x7fe5f419c5b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 >> 172.21.15.84:0/2610488753 conn(0x7fe5f40799a0 msgr2=0x7fe5f4107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 shutdown_connections 2024-09-21T07:40:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:38.704+0000 7fe5fb800640 1 -- 172.21.15.84:0/2610488753 wait complete. 2024-09-21T07:40:38.960 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:38.965 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:38.965 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:38.974 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi084') 2024-09-21T07:40:38.974 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T07:40:38.974 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T07:40:39.192 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.196 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.196 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.196 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.270 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:39 smithi084 ceph-mon[30411]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:39.271 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:39 smithi084 ceph-mon[30411]: Deploying daemon mgr.z on smithi191 2024-09-21T07:40:39.271 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:39 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2610488753' entity='client.admin' 2024-09-21T07:40:39.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:39 smithi191 ceph-mon[34667]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:39.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:39 smithi191 ceph-mon[34667]: Deploying daemon mgr.z on smithi191 2024-09-21T07:40:39.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:39 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2610488753' entity='client.admin' 2024-09-21T07:40:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.319 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.320 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.322 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.336 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:39 smithi162 ceph-mon[34833]: Updating smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:40:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:39 smithi162 ceph-mon[34833]: Deploying daemon mgr.z on smithi191 2024-09-21T07:40:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:39 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2610488753' entity='client.admin' 2024-09-21T07:40:39.655 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 systemd[1]: Starting Ceph mgr.z for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:40:39.667 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi084') 2024-09-21T07:40:39.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 podman[36531]: 2024-09-21 07:40:39.569981786 +0000 UTC m=+0.015508640 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:40:39.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 podman[36531]: 2024-09-21 07:40:39.668986649 +0000 UTC m=+0.114513534 container create 3da8821866de0469993e4306816416c7c8cee72ecd00f3980fb23f36b72e2159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T07:40:39.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 podman[36531]: 2024-09-21 07:40:39.863172575 +0000 UTC m=+0.308699428 container init 3da8821866de0469993e4306816416c7c8cee72ecd00f3980fb23f36b72e2159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:40:39.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 podman[36531]: 2024-09-21 07:40:39.865964827 +0000 UTC m=+0.311491667 container start 3da8821866de0469993e4306816416c7c8cee72ecd00f3980fb23f36b72e2159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-z, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T07:40:39.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 ceph-mgr[36550]: -- 172.21.15.191:0/3974948927 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b0dec6f0e0 con 0x55b0dec8da80 2024-09-21T07:40:39.939 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 bash[36531]: 3da8821866de0469993e4306816416c7c8cee72ecd00f3980fb23f36b72e2159 2024-09-21T07:40:40.404 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 07:40:39 smithi191 systemd[1]: Started Ceph mgr.z for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:40:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.851+0000 7f9e0be00640 1 -- 172.21.15.84:0/4066996706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10be50 msgr2=0x7f9e0c112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.851+0000 7f9e0be00640 1 --2- 172.21.15.84:0/4066996706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10be50 0x7f9e0c112680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009ca0 tx=0x7f9e0402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:40:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.852+0000 7f9e0be00640 1 -- 172.21.15.84:0/4066996706 shutdown_connections 2024-09-21T07:40:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.852+0000 7f9e0be00640 1 --2- 172.21.15.84:0/4066996706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10be50 0x7f9e0c112680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.852+0000 7f9e0be00640 1 --2- 172.21.15.84:0/4066996706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e0c10b500 0x7f9e0c10b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.852+0000 7f9e0be00640 1 --2- 172.21.15.84:0/4066996706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e0c105bc0 0x7f9e0c105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.852+0000 7f9e0be00640 1 -- 172.21.15.84:0/4066996706 >> 172.21.15.84:0/4066996706 conn(0x7f9e0c101670 msgr2=0x7f9e0c103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.852+0000 7f9e0be00640 1 -- 172.21.15.84:0/4066996706 shutdown_connections 2024-09-21T07:40:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.852+0000 7f9e0be00640 1 -- 172.21.15.84:0/4066996706 wait complete. 2024-09-21T07:40:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 Processor -- start 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 -- start start 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e0c105bc0 0x7f9e0c19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10b500 0x7f9e0c19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e0c10be50 0x7f9e0c1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c115b60 con 0x7f9e0c10b500 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c1159e0 con 0x7f9e0c10be50 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.853+0000 7f9e0be00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c115ce0 con 0x7f9e0c105bc0 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e0c105bc0 0x7f9e0c19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10b500 0x7f9e0c19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e0c10be50 0x7f9e0c1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e0c105bc0 0x7f9e0c19c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53076/0 (socket says 172.21.15.84:53076) 2024-09-21T07:40:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0aa00640 1 -- 172.21.15.84:0/2917198153 learned_addr learned my addr 172.21.15.84:0/2917198153 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0b400640 1 -- 172.21.15.84:0/2917198153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e0c105bc0 msgr2=0x7f9e0c19c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0b400640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e0c105bc0 0x7f9e0c19c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0b400640 1 -- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10b500 msgr2=0x7f9e0c19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0b400640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10b500 0x7f9e0c19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0b400640 1 -- 172.21.15.84:0/2917198153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c1a2420 con 0x7f9e0c10be50 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0a000640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10b500 0x7f9e0c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.854+0000 7f9e0b400640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e0c10be50 0x7f9e0c1a1cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9e04005e30 tx=0x7f9e040317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.855+0000 7f9e03400640 1 -- 172.21.15.84:0/2917198153 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04003b70 con 0x7f9e0c10be50 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.855+0000 7f9e03400640 1 -- 172.21.15.84:0/2917198153 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e04003d10 con 0x7f9e0c10be50 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.855+0000 7f9e03400640 1 -- 172.21.15.84:0/2917198153 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0402f970 con 0x7f9e0c10be50 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.855+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c1a26b0 con 0x7f9e0c10be50 2024-09-21T07:40:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.855+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c1a8e70 con 0x7f9e0c10be50 2024-09-21T07:40:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.856+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0c106e40 con 0x7f9e0c10be50 2024-09-21T07:40:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.856+0000 7f9e03400640 1 -- 172.21.15.84:0/2917198153 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f9e04004040 con 0x7f9e0c10be50 2024-09-21T07:40:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.857+0000 7f9e03400640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9df003fb70 0x7f9df0042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.857+0000 7f9e03400640 1 -- 172.21.15.84:0/2917198153 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9e040757a0 con 0x7f9e0c10be50 2024-09-21T07:40:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.857+0000 7f9e0aa00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9df003fb70 0x7f9df0042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.858+0000 7f9e0aa00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9df003fb70 0x7f9df0042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009c90 tx=0x7f9dfc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:40.862+0000 7f9e03400640 1 -- 172.21.15.84:0/2917198153 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e0402e270 con 0x7f9e0c10be50 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:41.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:41 smithi084 ceph-mon[30411]: Deploying daemon mgr.y on smithi162 2024-09-21T07:40:41.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.057+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f9e0c02e640 con 0x7f9e0c10be50 2024-09-21T07:40:41.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.062+0000 7f9e03400640 1 -- 172.21.15.84:0/2917198153 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v15)=0 v15) ==== 119+0+0 (secure 0 0 0) 0x7f9e040305c0 con 0x7f9e0c10be50 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.064+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9df003fb70 msgr2=0x7f9df0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.064+0000 7f9e0be00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9df003fb70 0x7f9df0042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009c90 tx=0x7f9dfc005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.064+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e0c10be50 msgr2=0x7f9e0c1a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.064+0000 7f9e0be00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e0c10be50 0x7f9e0c1a1cf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9e04005e30 tx=0x7f9e040317c0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 shutdown_connections 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9df003fb70 0x7f9df0042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e0c10be50 0x7f9e0c1a1cf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e0c10b500 0x7f9e0c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 --2- 172.21.15.84:0/2917198153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e0c105bc0 0x7f9e0c19c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 >> 172.21.15.84:0/2917198153 conn(0x7f9e0c101670 msgr2=0x7f9e0c10aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:41.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 shutdown_connections 2024-09-21T07:40:41.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.065+0000 7f9e0be00640 1 -- 172.21.15.84:0/2917198153 wait complete. 2024-09-21T07:40:41.279 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.279 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:41.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:40:41.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:41.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:41.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:41 smithi191 ceph-mon[34667]: Deploying daemon mgr.y on smithi162 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:41.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:41 smithi162 ceph-mon[34833]: Deploying daemon mgr.y on smithi162 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 -- 172.21.15.84:0/517337917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 msgr2=0x7f03f0103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 --2- 172.21.15.84:0/517337917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0103dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009900 tx=0x7f03e002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 -- 172.21.15.84:0/517337917 shutdown_connections 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 --2- 172.21.15.84:0/517337917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03f0109c40 0x7f03f0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 --2- 172.21.15.84:0/517337917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f01092f0 0x7f03f0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 --2- 172.21.15.84:0/517337917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0103dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 -- 172.21.15.84:0/517337917 >> 172.21.15.84:0/517337917 conn(0x7f03f00ff440 msgr2=0x7f03f0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:41.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.623+0000 7f03f5400640 1 -- 172.21.15.84:0/517337917 shutdown_connections 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.624+0000 7f03f5400640 1 -- 172.21.15.84:0/517337917 wait complete. 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.624+0000 7f03f5400640 1 Processor -- start 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f5400640 1 -- start start 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03f01092f0 0x7f03f0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f0109c40 0x7f03f0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f5400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0113950 con 0x7f03f0109c40 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03f01137d0 con 0x7f03f01039b0 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f5400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0113ad0 con 0x7f03f01092f0 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03efe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03e7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03f01092f0 0x7f03f0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03efe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:54740/0 (socket says 172.21.15.84:54740) 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03f4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f0109c40 0x7f03f0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.625+0000 7f03efe00640 1 -- 172.21.15.84:0/1889823946 learned_addr learned my addr 172.21.15.84:0/1889823946 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03efe00640 1 -- 172.21.15.84:0/1889823946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03f01092f0 msgr2=0x7f03f0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03efe00640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03f01092f0 0x7f03f0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03efe00640 1 -- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f0109c40 msgr2=0x7f03f0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03efe00640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f0109c40 0x7f03f0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03efe00640 1 -- 172.21.15.84:0/1889823946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f01a85a0 con 0x7f03f01039b0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03f4a00640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f0109c40 0x7f03f0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03efe00640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0075710 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03e0005ab0 tx=0x7f03e0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03ed600640 1 -- 172.21.15.84:0/1889823946 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e003f070 con 0x7f03f01039b0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03ed600640 1 -- 172.21.15.84:0/1889823946 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03e0031b60 con 0x7f03f01039b0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f01a8830 con 0x7f03f01039b0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.626+0000 7f03ed600640 1 -- 172.21.15.84:0/1889823946 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e0035030 con 0x7f03f01039b0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.627+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f01a8d10 con 0x7f03f01039b0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.627+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f0103dc0 con 0x7f03f01039b0 2024-09-21T07:40:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.628+0000 7f03ed600640 1 -- 172.21.15.84:0/1889823946 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f03e0042070 con 0x7f03f01039b0 2024-09-21T07:40:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.628+0000 7f03ed600640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03d403fb70 0x7f03d4042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.628+0000 7f03ed600640 1 -- 172.21.15.84:0/1889823946 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f03e0074e30 con 0x7f03f01039b0 2024-09-21T07:40:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.628+0000 7f03e7400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03d403fb70 0x7f03d4042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.629+0000 7f03e7400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03d403fb70 0x7f03d4042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f03d80095f0 tx=0x7f03d8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.641+0000 7f03ed600640 1 -- 172.21.15.84:0/1889823946 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03e003b460 con 0x7f03f01039b0 2024-09-21T07:40:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.836+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f03f002e640 con 0x7f03f01039b0 2024-09-21T07:40:41.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.842+0000 7f03ed600640 1 -- 172.21.15.84:0/1889823946 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v16)=0 v16) ==== 125+0+0 (secure 0 0 0) 0x7f03e0031d10 con 0x7f03f01039b0 2024-09-21T07:40:41.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03d403fb70 msgr2=0x7f03d4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03d403fb70 0x7f03d4042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f03d80095f0 tx=0x7f03d8005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 msgr2=0x7f03f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0075710 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03e0005ab0 tx=0x7f03e0003c10 comp rx=0 tx=0).stop 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 shutdown_connections 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03d403fb70 0x7f03d4042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f0109c40 0x7f03f0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03f01092f0 0x7f03f0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.844+0000 7f03f5400640 1 --2- 172.21.15.84:0/1889823946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03f01039b0 0x7f03f0075710 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.845+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 >> 172.21.15.84:0/1889823946 conn(0x7f03f00ff440 msgr2=0x7f03f0101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.845+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 shutdown_connections 2024-09-21T07:40:41.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:41.845+0000 7f03f5400640 1 -- 172.21.15.84:0/1889823946 wait complete. 2024-09-21T07:40:41.989 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:41 smithi162 systemd[1]: Starting Ceph mgr.y for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:40:42.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:42 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:42.276 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:42 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:42.279 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:42 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:42.280 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:42 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:42.280 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:41 smithi162 podman[36350]: 2024-09-21 07:40:41.88981104 +0000 UTC m=+0.016055000 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:40:42.280 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:42 smithi162 podman[36350]: 2024-09-21 07:40:42.005765867 +0000 UTC m=+0.132009818 container create 8bd70be84ff59ae6b9d788fc428e410b7d6997c7f4370587003b95812df3264c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T07:40:42.280 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:42 smithi162 podman[36350]: 2024-09-21 07:40:42.195874057 +0000 UTC m=+0.322118008 container init 8bd70be84ff59ae6b9d788fc428e410b7d6997c7f4370587003b95812df3264c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T07:40:42.280 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:42 smithi162 podman[36350]: 2024-09-21 07:40:42.198746718 +0000 UTC m=+0.324990678 container start 8bd70be84ff59ae6b9d788fc428e410b7d6997c7f4370587003b95812df3264c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T07:40:42.281 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:42 smithi162 ceph-mgr[36371]: -- 172.21.15.162:0/206128761 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ead4fd0e0 con 0x555eb22a0480 2024-09-21T07:40:42.281 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:42 smithi162 bash[36350]: 8bd70be84ff59ae6b9d788fc428e410b7d6997c7f4370587003b95812df3264c 2024-09-21T07:40:42.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:42 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:42.415 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:42 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:42.551 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 07:40:42 smithi162 systemd[1]: Started Ceph mgr.y for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:40:42.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.454+0000 7f7048a00640 1 -- 172.21.15.84:0/247984174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044103990 msgr2=0x7f7044103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.454+0000 7f7048a00640 1 --2- 172.21.15.84:0/247984174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044103990 0x7f7044103da0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7034009900 tx=0x7f703402a410 comp rx=0 tx=0).stop 2024-09-21T07:40:42.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.455+0000 7f7048a00640 1 -- 172.21.15.84:0/247984174 shutdown_connections 2024-09-21T07:40:42.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.455+0000 7f7048a00640 1 --2- 172.21.15.84:0/247984174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7044109c20 0x7f7044110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.455+0000 7f7048a00640 1 --2- 172.21.15.84:0/247984174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70441092d0 0x7f70441096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.455+0000 7f7048a00640 1 --2- 172.21.15.84:0/247984174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044103990 0x7f7044103da0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.455+0000 7f7048a00640 1 -- 172.21.15.84:0/247984174 >> 172.21.15.84:0/247984174 conn(0x7f70440ff3e0 msgr2=0x7f7044101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.455+0000 7f7048a00640 1 -- 172.21.15.84:0/247984174 shutdown_connections 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.455+0000 7f7048a00640 1 -- 172.21.15.84:0/247984174 wait complete. 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.456+0000 7f7048a00640 1 Processor -- start 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.456+0000 7f7048a00640 1 -- start start 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7048a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7044103990 0x7f704419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7048a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70441092d0 0x7f704419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7048a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044109c20 0x7f704419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7048a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7044113930 con 0x7f7044109c20 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7048a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f70441137b0 con 0x7f7044103990 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7048a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7044113ab0 con 0x7f70441092d0 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044109c20 0x7f704419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f703be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70441092d0 0x7f704419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044109c20 0x7f704419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60130/0 (socket says 172.21.15.84:60130) 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7044103990 0x7f704419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 -- 172.21.15.84:0/2541178686 learned_addr learned my addr 172.21.15.84:0/2541178686 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 -- 172.21.15.84:0/2541178686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70441092d0 msgr2=0x7f704419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70441092d0 0x7f704419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 -- 172.21.15.84:0/2541178686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7044103990 msgr2=0x7f704419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7044103990 0x7f704419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.457+0000 7f7043e00640 1 -- 172.21.15.84:0/2541178686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70441a0310 con 0x7f7044109c20 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.458+0000 7f7043e00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044109c20 0x7f704419fbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f703c00eaa0 tx=0x7f703c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.458+0000 7f7040c00640 1 -- 172.21.15.84:0/2541178686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c00cdb0 con 0x7f7044109c20 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.458+0000 7f7040c00640 1 -- 172.21.15.84:0/2541178686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f703c005020 con 0x7f7044109c20 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.458+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70441a0600 con 0x7f7044109c20 2024-09-21T07:40:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.458+0000 7f7040c00640 1 -- 172.21.15.84:0/2541178686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c0116d0 con 0x7f7044109c20 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.458+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70441a6d60 con 0x7f7044109c20 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.459+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7044103da0 con 0x7f7044109c20 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.459+0000 7f7040c00640 1 -- 172.21.15.84:0/2541178686 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f703c011870 con 0x7f7044109c20 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.460+0000 7f7040c00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f702803fb70 0x7f7028042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.460+0000 7f7040c00640 1 -- 172.21.15.84:0/2541178686 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f703c0549a0 con 0x7f7044109c20 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.460+0000 7f7043400640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f702803fb70 0x7f7028042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.461+0000 7f7043400640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f702803fb70 0x7f7028042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7034005ab0 tx=0x7f7034005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.466+0000 7f7040c00640 1 -- 172.21.15.84:0/2541178686 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f703c016030 con 0x7f7044109c20 2024-09-21T07:40:42.565 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:42.565 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:42.568 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:42.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.671+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f704402e640 con 0x7f7044109c20 2024-09-21T07:40:42.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.680+0000 7f7040c00640 1 -- 172.21.15.84:0/2541178686 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f703c021d90 con 0x7f7044109c20 2024-09-21T07:40:42.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f702803fb70 msgr2=0x7f7028042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f702803fb70 0x7f7028042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7034005ab0 tx=0x7f7034005a20 comp rx=0 tx=0).stop 2024-09-21T07:40:42.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044109c20 msgr2=0x7f704419fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044109c20 0x7f704419fbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f703c00eaa0 tx=0x7f703c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:40:42.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 shutdown_connections 2024-09-21T07:40:42.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f702803fb70 0x7f7028042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044109c20 0x7f704419fbe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70441092d0 0x7f704419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 --2- 172.21.15.84:0/2541178686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7044103990 0x7f704419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 >> 172.21.15.84:0/2541178686 conn(0x7f70440ff3e0 msgr2=0x7f7044101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:42.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 shutdown_connections 2024-09-21T07:40:42.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.683+0000 7f7048a00640 1 -- 172.21.15.84:0/2541178686 wait complete. 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 -- 172.21.15.84:0/650969596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc80757b0 msgr2=0x7f7dc8075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/650969596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc80757b0 0x7f7dc8075bc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009900 tx=0x7f7db802a410 comp rx=0 tx=0).stop 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 -- 172.21.15.84:0/650969596 shutdown_connections 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/650969596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc810ff10 0x7f7dc8112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/650969596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dc8076100 0x7f7dc810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/650969596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc80757b0 0x7f7dc8075bc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 -- 172.21.15.84:0/650969596 >> 172.21.15.84:0/650969596 conn(0x7f7dc80ff440 msgr2=0x7f7dc8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 -- 172.21.15.84:0/650969596 shutdown_connections 2024-09-21T07:40:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.667+0000 7f7dc7e00640 1 -- 172.21.15.84:0/650969596 wait complete. 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.668+0000 7f7dc7e00640 1 Processor -- start 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7e00640 1 -- start start 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc80757b0 0x7f7dc819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dc8076100 0x7f7dc819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc810ff10 0x7f7dc81a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8115ac0 con 0x7f7dc810ff10 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8115940 con 0x7f7dc80757b0 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8115c40 con 0x7f7dc8076100 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc810ff10 0x7f7dc81a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc810ff10 0x7f7dc81a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60138/0 (socket says 172.21.15.84:60138) 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc7400640 1 -- 172.21.15.84:0/2271897359 learned_addr learned my addr 172.21.15.84:0/2271897359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc6a00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc80757b0 0x7f7dc819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.669+0000 7f7dc6000640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dc8076100 0x7f7dc819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dc7400640 1 -- 172.21.15.84:0/2271897359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dc8076100 msgr2=0x7f7dc819ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dc7400640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dc8076100 0x7f7dc819ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dc7400640 1 -- 172.21.15.84:0/2271897359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc80757b0 msgr2=0x7f7dc819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dc7400640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc80757b0 0x7f7dc819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dc7400640 1 -- 172.21.15.84:0/2271897359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc81a2440 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dc7400640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc810ff10 0x7f7dc81a1d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000eb10 tx=0x7f7dc000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dcca00640 1 -- 172.21.15.84:0/2271897359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0004b20 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dcca00640 1 -- 172.21.15.84:0/2271897359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dc0004cc0 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dcca00640 1 -- 172.21.15.84:0/2271897359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0010670 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.670+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc81a2730 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.671+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc81a8e90 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.672+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc8075bc0 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.672+0000 7f7dcca00640 1 -- 172.21.15.84:0/2271897359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f7dc0005020 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.672+0000 7f7dcca00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7dac03fb70 0x7f7dac042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.672+0000 7f7dcca00640 1 -- 172.21.15.84:0/2271897359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7dc0054c70 con 0x7f7dc810ff10 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.673+0000 7f7dc6a00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7dac03fb70 0x7f7dac042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.673+0000 7f7dc6a00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7dac03fb70 0x7f7dac042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7db8031440 tx=0x7f7db8009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:42.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.678+0000 7f7dcca00640 1 -- 172.21.15.84:0/2271897359 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7dc001b160 con 0x7f7dc810ff10 2024-09-21T07:40:42.703 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:42.705 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:40:42.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.899+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f7dc81a90f0 con 0x7f7dc810ff10 2024-09-21T07:40:42.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.903+0000 7f7dcca00640 1 -- 172.21.15.84:0/2271897359 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v18)=0 v18) ==== 138+0+0 (secure 0 0 0) 0x7f7dc001fde0 con 0x7f7dc810ff10 2024-09-21T07:40:42.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7dac03fb70 msgr2=0x7f7dac042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7dac03fb70 0x7f7dac042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7db8031440 tx=0x7f7db8009560 comp rx=0 tx=0).stop 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc810ff10 msgr2=0x7f7dc81a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc810ff10 0x7f7dc81a1d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000eb10 tx=0x7f7dc000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 shutdown_connections 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7dac03fb70 0x7f7dac042080 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dc810ff10 0x7f7dc81a1d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dc8076100 0x7f7dc819ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 --2- 172.21.15.84:0/2271897359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dc80757b0 0x7f7dc819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.905+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 >> 172.21.15.84:0/2271897359 conn(0x7f7dc80ff440 msgr2=0x7f7dc8109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.906+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 shutdown_connections 2024-09-21T07:40:42.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:42.906+0000 7f7dc7e00640 1 -- 172.21.15.84:0/2271897359 wait complete. 2024-09-21T07:40:43.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:43.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:43 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2541178686' entity='client.admin' 2024-09-21T07:40:43.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:43 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2271897359' entity='client.admin' 2024-09-21T07:40:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:43 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2541178686' entity='client.admin' 2024-09-21T07:40:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:43 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2271897359' entity='client.admin' 2024-09-21T07:40:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:43 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2541178686' entity='client.admin' 2024-09-21T07:40:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:43 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2271897359' entity='client.admin' 2024-09-21T07:40:43.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 -- 172.21.15.84:0/3348096547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 msgr2=0x7f3f9810fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:43.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 --2- 172.21.15.84:0/3348096547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 0x7f3f9810fab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009860 tx=0x7f3f8402a3d0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 -- 172.21.15.84:0/3348096547 shutdown_connections 2024-09-21T07:40:43.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 --2- 172.21.15.84:0/3348096547 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f9810fff0 0x7f3f98112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 --2- 172.21.15.84:0/3348096547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 0x7f3f9810fab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 --2- 172.21.15.84:0/3348096547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f98102440 0x7f3f98102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 -- 172.21.15.84:0/3348096547 >> 172.21.15.84:0/3348096547 conn(0x7f3f980fe2c0 msgr2=0x7f3f98100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 -- 172.21.15.84:0/3348096547 shutdown_connections 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.438+0000 7f3f9d800640 1 -- 172.21.15.84:0/3348096547 wait complete. 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.439+0000 7f3f9d800640 1 Processor -- start 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.439+0000 7f3f9d800640 1 -- start start 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f9d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f98102440 0x7f3f9819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f9d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 0x7f3f9819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f9d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9810fff0 0x7f3f981a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f9d800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3f98115ae0 con 0x7f3f98102d90 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f9d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3f98115960 con 0x7f3f9810fff0 2024-09-21T07:40:43.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f9d800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3f98115c60 con 0x7f3f98102440 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 0x7f3f9819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f98102440 0x7f3f9819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f9ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9810fff0 0x7f3f981a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f98102440 0x7f3f9819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53158/0 (socket says 172.21.15.84:53158) 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 -- 172.21.15.84:0/195787445 learned_addr learned my addr 172.21.15.84:0/195787445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 -- 172.21.15.84:0/195787445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9810fff0 msgr2=0x7f3f981a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9810fff0 0x7f3f981a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 -- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 msgr2=0x7f3f9819ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 0x7f3f9819ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.440+0000 7f3f97e00640 1 -- 172.21.15.84:0/195787445 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f981a23e0 con 0x7f3f98102440 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.441+0000 7f3f97e00640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f98102440 0x7f3f9819c470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800e9c0 tx=0x7f3f8800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.441+0000 7f3f94c00640 1 -- 172.21.15.84:0/195787445 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800cde0 con 0x7f3f98102440 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.441+0000 7f3f94c00640 1 -- 172.21.15.84:0/195787445 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f880035f0 con 0x7f3f98102440 2024-09-21T07:40:43.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.441+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f981a26d0 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.441+0000 7f3f94c00640 1 -- 172.21.15.84:0/195787445 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88010690 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.441+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f981a8e30 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.442+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f98102850 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.442+0000 7f3f94c00640 1 -- 172.21.15.84:0/195787445 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f3f88010830 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.443+0000 7f3f94c00640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3f7c03fb70 0x7f3f7c042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.443+0000 7f3f94c00640 1 -- 172.21.15.84:0/195787445 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3f880549f0 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.443+0000 7f3f97400640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3f7c03fb70 0x7f3f7c042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.444+0000 7f3f97400640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3f7c03fb70 0x7f3f7c042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3f98111340 tx=0x7f3f84005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.448+0000 7f3f94c00640 1 -- 172.21.15.84:0/195787445 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3f88009510 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.653+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f3f9802e640 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.659+0000 7f3f94c00640 1 -- 172.21.15.84:0/195787445 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f3f88016330 con 0x7f3f98102440 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.661+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3f7c03fb70 msgr2=0x7f3f7c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:43.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.661+0000 7f3f9d800640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3f7c03fb70 0x7f3f7c042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3f98111340 tx=0x7f3f84005c90 comp rx=0 tx=0).stop 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.661+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f98102440 msgr2=0x7f3f9819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.661+0000 7f3f9d800640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f98102440 0x7f3f9819c470 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800e9c0 tx=0x7f3f8800ee80 comp rx=0 tx=0).stop 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 shutdown_connections 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3f7c03fb70 0x7f3f7c042080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9810fff0 0x7f3f981a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f98102d90 0x7f3f9819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 --2- 172.21.15.84:0/195787445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3f98102440 0x7f3f9819c470 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 >> 172.21.15.84:0/195787445 conn(0x7f3f980fe2c0 msgr2=0x7f3f981010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 shutdown_connections 2024-09-21T07:40:43.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:43.662+0000 7f3f9d800640 1 -- 172.21.15.84:0/195787445 wait complete. 2024-09-21T07:40:44.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 -- 172.21.15.84:0/4262523214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 msgr2=0x7fecf810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 --2- 172.21.15.84:0/4262523214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 0x7fecf810d870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fece4009900 tx=0x7fece402a410 comp rx=0 tx=0).stop 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 -- 172.21.15.84:0/4262523214 shutdown_connections 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 --2- 172.21.15.84:0/4262523214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf810de30 0x7fecf8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 --2- 172.21.15.84:0/4262523214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 0x7fecf810d870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 --2- 172.21.15.84:0/4262523214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf81049d0 0x7fecf8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 -- 172.21.15.84:0/4262523214 >> 172.21.15.84:0/4262523214 conn(0x7fecf8079740 msgr2=0x7fecf8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 -- 172.21.15.84:0/4262523214 shutdown_connections 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.448+0000 7fecfe000640 1 -- 172.21.15.84:0/4262523214 wait complete. 2024-09-21T07:40:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.449+0000 7fecfe000640 1 Processor -- start 2024-09-21T07:40:44.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecfe000640 1 -- start start 2024-09-21T07:40:44.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecfe000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf81049d0 0x7fecf819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:44.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecfe000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 0x7fecf819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecfe000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf810de30 0x7fecf819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecfe000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fecf8113a90 con 0x7fecf8105320 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecfe000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecf8113910 con 0x7fecf810de30 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecfe000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fecf8113c10 con 0x7fecf81049d0 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecf7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf81049d0 0x7fecf819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecf7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf81049d0 0x7fecf819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53210/0 (socket says 172.21.15.84:53210) 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecf6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 0x7fecf819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecf7400640 1 -- 172.21.15.84:0/3126429710 learned_addr learned my addr 172.21.15.84:0/3126429710 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.450+0000 7fecf7e00640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf810de30 0x7fecf819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecf7400640 1 -- 172.21.15.84:0/3126429710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf810de30 msgr2=0x7fecf819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecf7400640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf810de30 0x7fecf819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecf7400640 1 -- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 msgr2=0x7fecf819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecf7400640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 0x7fecf819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecf7400640 1 -- 172.21.15.84:0/3126429710 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf81a03f0 con 0x7fecf81049d0 2024-09-21T07:40:44.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecf7400640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf81049d0 0x7fecf819a480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fece800e9c0 tx=0x7fece800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:44.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecefe00640 1 -- 172.21.15.84:0/3126429710 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece800cde0 con 0x7fecf81049d0 2024-09-21T07:40:44.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecefe00640 1 -- 172.21.15.84:0/3126429710 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fece80108e0 con 0x7fecf81049d0 2024-09-21T07:40:44.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.451+0000 7fecefe00640 1 -- 172.21.15.84:0/3126429710 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8018960 con 0x7fecf81049d0 2024-09-21T07:40:44.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.452+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf81a06e0 con 0x7fecf81049d0 2024-09-21T07:40:44.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.452+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf81a6e40 con 0x7fecf81049d0 2024-09-21T07:40:44.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.453+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf806c240 con 0x7fecf81049d0 2024-09-21T07:40:44.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.453+0000 7fecefe00640 1 -- 172.21.15.84:0/3126429710 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fece801f020 con 0x7fecf81049d0 2024-09-21T07:40:44.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.454+0000 7fecefe00640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fecdc03fb70 0x7fecdc042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:44.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.454+0000 7fecefe00640 1 -- 172.21.15.84:0/3126429710 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fece8054980 con 0x7fecf81049d0 2024-09-21T07:40:44.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.454+0000 7fecf6a00640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fecdc03fb70 0x7fecdc042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:44.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.455+0000 7fecf6a00640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fecdc03fb70 0x7fecdc042080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fece4009230 tx=0x7fece4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:44.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.458+0000 7fecefe00640 1 -- 172.21.15.84:0/3126429710 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fece8010db0 con 0x7fecf81049d0 2024-09-21T07:40:44.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:44.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:44 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3131371642' entity='client.admin' 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:40:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:44.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:44.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:44.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T07:40:44.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:44.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:44 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3131371642' entity='client.admin' 2024-09-21T07:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.676+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fecf802e640 con 0x7fecf81049d0 2024-09-21T07:40:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.682+0000 7fecefe00640 1 -- 172.21.15.84:0/3126429710 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v21)=0 v21) ==== 127+0+0 (secure 0 0 0) 0x7fece8010a90 con 0x7fecf81049d0 2024-09-21T07:40:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fecdc03fb70 msgr2=0x7fecdc042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:44.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fecdc03fb70 0x7fecdc042080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fece4009230 tx=0x7fece4031400 comp rx=0 tx=0).stop 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf81049d0 msgr2=0x7fecf819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf81049d0 0x7fecf819a480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fece800e9c0 tx=0x7fece800ee80 comp rx=0 tx=0).stop 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 shutdown_connections 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fecdc03fb70 0x7fecdc042080 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf810de30 0x7fecf819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecf8105320 0x7fecf819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 --2- 172.21.15.84:0/3126429710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecf81049d0 0x7fecf819a480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.684+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 >> 172.21.15.84:0/3126429710 conn(0x7fecf8079740 msgr2=0x7fecf8100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.685+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 shutdown_connections 2024-09-21T07:40:44.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.685+0000 7fecfe000640 1 -- 172.21.15.84:0/3126429710 wait complete. 2024-09-21T07:40:44.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:44.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:44.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:40:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:40:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:40:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T07:40:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:44 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3131371642' entity='client.admin' 2024-09-21T07:40:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 -- 172.21.15.84:0/79337684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a4105d80 msgr2=0x7f08a4106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 --2- 172.21.15.84:0/79337684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a4105d80 0x7f08a4106190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0894009900 tx=0x7f089402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 -- 172.21.15.84:0/79337684 shutdown_connections 2024-09-21T07:40:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 --2- 172.21.15.84:0/79337684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a410c010 0x7f08a4112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 --2- 172.21.15.84:0/79337684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 0x7f08a410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 --2- 172.21.15.84:0/79337684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a4105d80 0x7f08a4106190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 -- 172.21.15.84:0/79337684 >> 172.21.15.84:0/79337684 conn(0x7f08a4101810 msgr2=0x7f08a4103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 -- 172.21.15.84:0/79337684 shutdown_connections 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.071+0000 7f08aa800640 1 -- 172.21.15.84:0/79337684 wait complete. 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 Processor -- start 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 -- start start 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a4105d80 0x7f08a419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 0x7f08a419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a410c010 0x7f08a41a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4115d20 con 0x7f08a410c010 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4115ba0 con 0x7f08a410b6c0 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.072+0000 7f08aa800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4115ea0 con 0x7f08a4105d80 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 0x7f08a419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 0x7f08a419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:54820/0 (socket says 172.21.15.84:54820) 2024-09-21T07:40:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a2a00640 1 -- 172.21.15.84:0/3131371642 learned_addr learned my addr 172.21.15.84:0/3131371642 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a410c010 0x7f08a41a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3400640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a4105d80 0x7f08a419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3e00640 1 -- 172.21.15.84:0/3131371642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a4105d80 msgr2=0x7f08a419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3e00640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a4105d80 0x7f08a419c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3e00640 1 -- 172.21.15.84:0/3131371642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 msgr2=0x7f08a419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3e00640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 0x7f08a419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3e00640 1 -- 172.21.15.84:0/3131371642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a41a2660 con 0x7f08a410c010 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a2a00640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 0x7f08a419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.073+0000 7f08a3e00640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a410c010 0x7f08a41a1f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f089c009fd0 tx=0x7f089c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.074+0000 7f089be00640 1 -- 172.21.15.84:0/3131371642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c00ce20 con 0x7f08a410c010 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.074+0000 7f089be00640 1 -- 172.21.15.84:0/3131371642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f089c005020 con 0x7f08a410c010 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.074+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a41a2950 con 0x7f08a410c010 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.074+0000 7f089be00640 1 -- 172.21.15.84:0/3131371642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c010690 con 0x7f08a410c010 2024-09-21T07:40:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.074+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a41a90b0 con 0x7f08a410c010 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.075+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a4106190 con 0x7f08a410c010 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.075+0000 7f089be00640 1 -- 172.21.15.84:0/3131371642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f089c010830 con 0x7f08a410c010 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.076+0000 7f089be00640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f088803fb70 0x7f0888042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.076+0000 7f089be00640 1 -- 172.21.15.84:0/3131371642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f089c054d00 con 0x7f08a410c010 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.076+0000 7f08a3400640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f088803fb70 0x7f0888042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.076+0000 7f08a3400640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f088803fb70 0x7f0888042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0894005ab0 tx=0x7f0894005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.081+0000 7f089be00640 1 -- 172.21.15.84:0/3131371642 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f089c016370 con 0x7f08a410c010 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.272+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f08a402e640 con 0x7f08a410c010 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.276+0000 7f089be00640 1 -- 172.21.15.84:0/3131371642 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f089c005240 con 0x7f08a410c010 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.278+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f088803fb70 msgr2=0x7f0888042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.278+0000 7f08aa800640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f088803fb70 0x7f0888042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0894005ab0 tx=0x7f0894005a20 comp rx=0 tx=0).stop 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.278+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a410c010 msgr2=0x7f08a41a1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.278+0000 7f08aa800640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a410c010 0x7f08a41a1f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f089c009fd0 tx=0x7f089c00ef10 comp rx=0 tx=0).stop 2024-09-21T07:40:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.278+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 shutdown_connections 2024-09-21T07:40:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.279+0000 7f08aa800640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f088803fb70 0x7f0888042080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.279+0000 7f08aa800640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a410c010 0x7f08a41a1f30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.279+0000 7f08aa800640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a410b6c0 0x7f08a419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.279+0000 7f08aa800640 1 --2- 172.21.15.84:0/3131371642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a4105d80 0x7f08a419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.279+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 >> 172.21.15.84:0/3131371642 conn(0x7f08a4101810 msgr2=0x7f08a410ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.279+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 shutdown_connections 2024-09-21T07:40:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:44.279+0000 7f08aa800640 1 -- 172.21.15.84:0/3131371642 wait complete. 2024-09-21T07:40:46.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:45 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:46.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:45 smithi084 ceph-mon[30411]: Standby manager daemon z started 2024-09-21T07:40:46.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:45 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:40:46.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:45 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:40:46.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:45 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:40:46.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:45 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:40:46.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:45 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:45 smithi162 ceph-mon[34833]: Standby manager daemon z started 2024-09-21T07:40:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:45 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:40:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:45 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:40:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:45 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:40:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:45 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:40:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:45 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:45 smithi191 ceph-mon[34667]: Standby manager daemon z started 2024-09-21T07:40:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:45 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:40:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:45 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:40:46.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:45 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:40:46.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:45 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.191:0/3542905723' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:40:46.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 -- 172.21.15.84:0/3420094715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 msgr2=0x7f4c94109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3420094715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 0x7f4c94109700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009900 tx=0x7f4c8002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 -- 172.21.15.84:0/3420094715 shutdown_connections 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3420094715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94109c40 0x7f4c94110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3420094715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 0x7f4c94109700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3420094715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 0x7f4c94103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 -- 172.21.15.84:0/3420094715 >> 172.21.15.84:0/3420094715 conn(0x7f4c940ff400 msgr2=0x7f4c94101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 -- 172.21.15.84:0/3420094715 shutdown_connections 2024-09-21T07:40:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.807+0000 7f4c99e00640 1 -- 172.21.15.84:0/3420094715 wait complete. 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.808+0000 7f4c99e00640 1 Processor -- start 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.808+0000 7f4c99e00640 1 -- start start 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 0x7f4c9419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 0x7f4c9419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94109c40 0x7f4c9419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94113900 con 0x7f4c941092f0 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94113780 con 0x7f4c94109c40 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94113a80 con 0x7f4c941039b0 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c98a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 0x7f4c9419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c93e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 0x7f4c9419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94109c40 0x7f4c9419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:46.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c98a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 0x7f4c9419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53230/0 (socket says 172.21.15.84:53230) 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c98a00640 1 -- 172.21.15.84:0/3390228277 learned_addr learned my addr 172.21.15.84:0/3390228277 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.809+0000 7f4c99400640 1 -- 172.21.15.84:0/3390228277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 msgr2=0x7f4c9419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c99400640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 0x7f4c9419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c99400640 1 -- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 msgr2=0x7f4c9419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c99400640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 0x7f4c9419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c99400640 1 -- 172.21.15.84:0/3390228277 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c941a0260 con 0x7f4c94109c40 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c98a00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 0x7f4c9419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c99400640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94109c40 0x7f4c9419fb30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00ec50 tx=0x7f4c8c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c91600640 1 -- 172.21.15.84:0/3390228277 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c003b70 con 0x7f4c94109c40 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c941a0550 con 0x7f4c94109c40 2024-09-21T07:40:46.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c91600640 1 -- 172.21.15.84:0/3390228277 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c8c003d10 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c91600640 1 -- 172.21.15.84:0/3390228277 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c010830 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.810+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c941a6cb0 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.811+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c94103dc0 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.812+0000 7f4c91600640 1 -- 172.21.15.84:0/3390228277 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f4c8c003ec0 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.813+0000 7f4c91600640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4c7c07b020 0x7f4c7c07d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.814+0000 7f4c91600640 1 -- 172.21.15.84:0/3390228277 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4c8c09d3f0 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.814+0000 7f4c98a00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4c7c07b020 0x7f4c7c07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.814+0000 7f4c98a00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4c7c07b020 0x7f4c7c07d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c88011550 tx=0x7f4c88005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:45.818+0000 7f4c91600640 1 -- 172.21.15.84:0/3390228277 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c8c069ce0 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.012+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f4c9410b480 con 0x7f4c94109c40 2024-09-21T07:40:46.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.013+0000 7f4c91600640 1 -- 172.21.15.84:0/3390228277 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7f4c8c06eb90 con 0x7f4c94109c40 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4c7c07b020 msgr2=0x7f4c7c07d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4c7c07b020 0x7f4c7c07d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c88011550 tx=0x7f4c88005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94109c40 msgr2=0x7f4c9419fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94109c40 0x7f4c9419fb30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00ec50 tx=0x7f4c8c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 shutdown_connections 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4c7c07b020 0x7f4c7c07d530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94109c40 0x7f4c9419fb30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c941092f0 0x7f4c9419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 --2- 172.21.15.84:0/3390228277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c941039b0 0x7f4c9419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 >> 172.21.15.84:0/3390228277 conn(0x7f4c940ff400 msgr2=0x7f4c94101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 shutdown_connections 2024-09-21T07:40:46.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.016+0000 7f4c99e00640 1 -- 172.21.15.84:0/3390228277 wait complete. 2024-09-21T07:40:47.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:46 smithi162 ceph-mon[34833]: mgrmap e19: x(active, since 15s), standbys: z 2024-09-21T07:40:47.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:40:47.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:46 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:47.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:46 smithi084 ceph-mon[30411]: mgrmap e19: x(active, since 15s), standbys: z 2024-09-21T07:40:47.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:40:47.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:46 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:46 smithi191 ceph-mon[34667]: mgrmap e19: x(active, since 15s), standbys: z 2024-09-21T07:40:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:40:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:46 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:47.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 -- 172.21.15.84:0/3243943688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec109c40 msgr2=0x7fa3ec110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3243943688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec109c40 0x7fa3ec110470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009be0 tx=0x7fa3e402a6c0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 -- 172.21.15.84:0/3243943688 shutdown_connections 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3243943688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec109c40 0x7fa3ec110470 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3243943688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3ec1092f0 0x7fa3ec109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3243943688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec1039b0 0x7fa3ec103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 -- 172.21.15.84:0/3243943688 >> 172.21.15.84:0/3243943688 conn(0x7fa3ec0ff440 msgr2=0x7fa3ec101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 -- 172.21.15.84:0/3243943688 shutdown_connections 2024-09-21T07:40:47.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.459+0000 7fa3f2800640 1 -- 172.21.15.84:0/3243943688 wait complete. 2024-09-21T07:40:47.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 Processor -- start 2024-09-21T07:40:47.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 -- start start 2024-09-21T07:40:47.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec1039b0 0x7fa3ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3ec1092f0 0x7fa3ec075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109c40 0x7fa3ec076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec113900 con 0x7fa3ec109c40 2024-09-21T07:40:47.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec113780 con 0x7fa3ec1039b0 2024-09-21T07:40:47.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.461+0000 7fa3f2800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec113a80 con 0x7fa3ec1092f0 2024-09-21T07:40:47.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec1039b0 0x7fa3ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec1039b0 0x7fa3ec075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:54902/0 (socket says 172.21.15.84:54902) 2024-09-21T07:40:47.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 -- 172.21.15.84:0/3962826413 learned_addr learned my addr 172.21.15.84:0/3962826413 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:47.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1e00640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109c40 0x7fa3ec076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f0a00640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3ec1092f0 0x7fa3ec075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 -- 172.21.15.84:0/3962826413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3ec1092f0 msgr2=0x7fa3ec075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3ec1092f0 0x7fa3ec075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 -- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109c40 msgr2=0x7fa3ec076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109c40 0x7fa3ec076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 -- 172.21.15.84:0/3962826413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec1a85b0 con 0x7fa3ec1039b0 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f0a00640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3ec1092f0 0x7fa3ec075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.462+0000 7fa3f1400640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec1039b0 0x7fa3ec075710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000e9c0 tx=0x7fa3e000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.463+0000 7fa3ea000640 1 -- 172.21.15.84:0/3962826413 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000cde0 con 0x7fa3ec1039b0 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.463+0000 7fa3ea000640 1 -- 172.21.15.84:0/3962826413 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e00035f0 con 0x7fa3ec1039b0 2024-09-21T07:40:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.463+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec1a88a0 con 0x7fa3ec1039b0 2024-09-21T07:40:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.463+0000 7fa3ea000640 1 -- 172.21.15.84:0/3962826413 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0010690 con 0x7fa3ec1039b0 2024-09-21T07:40:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.463+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec1a8e30 con 0x7fa3ec1039b0 2024-09-21T07:40:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.464+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ec103dc0 con 0x7fa3ec1039b0 2024-09-21T07:40:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.465+0000 7fa3ea000640 1 -- 172.21.15.84:0/3962826413 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7fa3e0004020 con 0x7fa3ec1039b0 2024-09-21T07:40:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.466+0000 7fa3ea000640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3d407b020 0x7fa3d407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.466+0000 7fa3ea000640 1 -- 172.21.15.84:0/3962826413 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa3e009d210 con 0x7fa3ec1039b0 2024-09-21T07:40:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.466+0000 7fa3f0a00640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3d407b020 0x7fa3d407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.467+0000 7fa3f0a00640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3d407b020 0x7fa3d407d530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec108dc0 tx=0x7fa3d8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.470+0000 7fa3ea000640 1 -- 172.21.15.84:0/3962826413 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3e0009510 con 0x7fa3ec1039b0 2024-09-21T07:40:47.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.666+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fa3ec02e640 con 0x7fa3ec1039b0 2024-09-21T07:40:47.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.672+0000 7fa3ea000640 1 -- 172.21.15.84:0/3962826413 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fa3e00657a0 con 0x7fa3ec1039b0 2024-09-21T07:40:47.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3d407b020 msgr2=0x7fa3d407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3d407b020 0x7fa3d407d530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec108dc0 tx=0x7fa3d8005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec1039b0 msgr2=0x7fa3ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec1039b0 0x7fa3ec075710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000e9c0 tx=0x7fa3e000ee80 comp rx=0 tx=0).stop 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 shutdown_connections 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3d407b020 0x7fa3d407d530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109c40 0x7fa3ec076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3ec1092f0 0x7fa3ec075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 --2- 172.21.15.84:0/3962826413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec1039b0 0x7fa3ec075710 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.674+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 >> 172.21.15.84:0/3962826413 conn(0x7fa3ec0ff440 msgr2=0x7fa3ec101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.675+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 shutdown_connections 2024-09-21T07:40:47.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.675+0000 7fa3f2800640 1 -- 172.21.15.84:0/3962826413 wait complete. 2024-09-21T07:40:47.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:47 smithi084 ceph-mon[30411]: Standby manager daemon y started 2024-09-21T07:40:47.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:47 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:40:47.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:47 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:40:47.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:47 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:40:47.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:47 smithi084 ceph-mon[30411]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:40:47.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:47 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 -- 172.21.15.84:0/1444483029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8654109c40 msgr2=0x7f8654110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 --2- 172.21.15.84:0/1444483029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8654109c40 0x7f8654110470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f864c009ca0 tx=0x7f864c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 -- 172.21.15.84:0/1444483029 shutdown_connections 2024-09-21T07:40:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 --2- 172.21.15.84:0/1444483029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8654109c40 0x7f8654110470 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 --2- 172.21.15.84:0/1444483029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541092f0 0x7f8654109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 --2- 172.21.15.84:0/1444483029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86541039b0 0x7f8654103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 -- 172.21.15.84:0/1444483029 >> 172.21.15.84:0/1444483029 conn(0x7f86540ff440 msgr2=0x7f8654101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 -- 172.21.15.84:0/1444483029 shutdown_connections 2024-09-21T07:40:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.731+0000 7f865a200640 1 -- 172.21.15.84:0/1444483029 wait complete. 2024-09-21T07:40:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.732+0000 7f865a200640 1 Processor -- start 2024-09-21T07:40:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f865a200640 1 -- start start 2024-09-21T07:40:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f865a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541039b0 0x7f865419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f865a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86541092f0 0x7f865419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f865a200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8654109c40 0x7f865419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f865a200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8654113900 con 0x7f86541092f0 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f865a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8654113780 con 0x7f86541039b0 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f865a200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8654113a80 con 0x7f8654109c40 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f8658e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541039b0 0x7f865419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f8658e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541039b0 0x7f865419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:54912/0 (socket says 172.21.15.84:54912) 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.733+0000 7f8658e00640 1 -- 172.21.15.84:0/2263849734 learned_addr learned my addr 172.21.15.84:0/2263849734 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8653e00640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86541092f0 0x7f865419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8659800640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8654109c40 0x7f865419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8658e00640 1 -- 172.21.15.84:0/2263849734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8654109c40 msgr2=0x7f865419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8658e00640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8654109c40 0x7f865419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8658e00640 1 -- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86541092f0 msgr2=0x7f865419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8658e00640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86541092f0 0x7f865419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8658e00640 1 -- 172.21.15.84:0/2263849734 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86541a01e0 con 0x7f86541039b0 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8659800640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8654109c40 0x7f865419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.734+0000 7f8658e00640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541039b0 0x7f865419a270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f864800e9f0 tx=0x7f864800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.735+0000 7f8651600640 1 -- 172.21.15.84:0/2263849734 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864800cd80 con 0x7f86541039b0 2024-09-21T07:40:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.735+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86541a04d0 con 0x7f86541039b0 2024-09-21T07:40:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.735+0000 7f8651600640 1 -- 172.21.15.84:0/2263849734 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86480108e0 con 0x7f86541039b0 2024-09-21T07:40:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.735+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86541a6c30 con 0x7f86541039b0 2024-09-21T07:40:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.735+0000 7f8651600640 1 -- 172.21.15.84:0/2263849734 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648018980 con 0x7f86541039b0 2024-09-21T07:40:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.736+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8654103dc0 con 0x7f86541039b0 2024-09-21T07:40:47.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.739+0000 7f8651600640 1 -- 172.21.15.84:0/2263849734 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f8648010430 con 0x7f86541039b0 2024-09-21T07:40:47.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.740+0000 7f8651600640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f863c0b64d0 0x7f863c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:47.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.741+0000 7f8651600640 1 -- 172.21.15.84:0/2263849734 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f86480e5ba0 con 0x7f86541039b0 2024-09-21T07:40:47.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.741+0000 7f8653e00640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f863c0b64d0 0x7f863c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:47.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.741+0000 7f8653e00640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f863c0b64d0 0x7f863c0b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8654102d90 tx=0x7f8640005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.744+0000 7f8651600640 1 -- 172.21.15.84:0/2263849734 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86480adf90 con 0x7f86541039b0 2024-09-21T07:40:47.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.945+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f865419b3a0 con 0x7f86541039b0 2024-09-21T07:40:47.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.946+0000 7f8651600640 1 -- 172.21.15.84:0/2263849734 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f86480b2370 con 0x7f86541039b0 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f863c0b64d0 msgr2=0x7f863c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f863c0b64d0 0x7f863c0b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8654102d90 tx=0x7f8640005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541039b0 msgr2=0x7f865419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541039b0 0x7f865419a270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f864800e9f0 tx=0x7f864800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 shutdown_connections 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f863c0b64d0 0x7f863c0b89e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8654109c40 0x7f865419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86541092f0 0x7f865419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 --2- 172.21.15.84:0/2263849734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86541039b0 0x7f865419a270 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:47.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 >> 172.21.15.84:0/2263849734 conn(0x7f86540ff440 msgr2=0x7f8654106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:47.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 shutdown_connections 2024-09-21T07:40:47.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:47.949+0000 7f865a200640 1 -- 172.21.15.84:0/2263849734 wait complete. 2024-09-21T07:40:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:47 smithi162 ceph-mon[34833]: Standby manager daemon y started 2024-09-21T07:40:48.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:47 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:40:48.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:47 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:40:48.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:47 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:40:48.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:47 smithi162 ceph-mon[34833]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:40:48.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:47 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:48.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 -- 172.21.15.84:0/3418777977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 msgr2=0x7f31d81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 --2- 172.21.15.84:0/3418777977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 0x7f31d81098b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009900 tx=0x7f31c402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 -- 172.21.15.84:0/3418777977 shutdown_connections 2024-09-21T07:40:48.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 --2- 172.21.15.84:0/3418777977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 0x7f31d8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 --2- 172.21.15.84:0/3418777977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 0x7f31d81098b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 --2- 172.21.15.84:0/3418777977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d8103b60 0x7f31d8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 -- 172.21.15.84:0/3418777977 >> 172.21.15.84:0/3418777977 conn(0x7f31d807b850 msgr2=0x7f31d807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 -- 172.21.15.84:0/3418777977 shutdown_connections 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.438+0000 7f31e0200640 1 -- 172.21.15.84:0/3418777977 wait complete. 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.439+0000 7f31e0200640 1 Processor -- start 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31e0200640 1 -- start start 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31e0200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d8103b60 0x7f31d819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31e0200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 0x7f31d819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31e0200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 0x7f31d81a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31e0200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8113ab0 con 0x7f31d81094a0 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31e0200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8113930 con 0x7f31d8109df0 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31e0200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8113c30 con 0x7f31d8103b60 2024-09-21T07:40:48.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31de200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 0x7f31d81a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31de200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 0x7f31d81a1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:54882/0 (socket says 172.21.15.84:54882) 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31de200640 1 -- 172.21.15.84:0/1197335799 learned_addr learned my addr 172.21.15.84:0/1197335799 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31dce00640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 0x7f31d819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.440+0000 7f31dd800640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d8103b60 0x7f31d819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31de200640 1 -- 172.21.15.84:0/1197335799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d8103b60 msgr2=0x7f31d819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31de200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d8103b60 0x7f31d819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31de200640 1 -- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 msgr2=0x7f31d819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31de200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 0x7f31d819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31de200640 1 -- 172.21.15.84:0/1197335799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d81a2610 con 0x7f31d8109df0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31de200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 0x7f31d81a1ee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31d000eb10 tx=0x7f31d000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31d6000640 1 -- 172.21.15.84:0/1197335799 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0004b20 con 0x7f31d8109df0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d81a2900 con 0x7f31d8109df0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31d6000640 1 -- 172.21.15.84:0/1197335799 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d0004cc0 con 0x7f31d8109df0 2024-09-21T07:40:48.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31d6000640 1 -- 172.21.15.84:0/1197335799 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0010670 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.441+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d81a9060 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.443+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d8103f70 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.444+0000 7f31d6000640 1 -- 172.21.15.84:0/1197335799 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f31d0005020 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.445+0000 7f31d6000640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c007b020 0x7f31c007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.445+0000 7f31d6000640 1 -- 172.21.15.84:0/1197335799 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f31d009d470 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.445+0000 7f31dd800640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c007b020 0x7f31c007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.445+0000 7f31dd800640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c007b020 0x7f31c007d530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005fd0 tx=0x7f31cc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.449+0000 7f31d6000640 1 -- 172.21.15.84:0/1197335799 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31d0069d60 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.643+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f31d81a9230 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.649+0000 7f31d6000640 1 -- 172.21.15.84:0/1197335799 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7f31d006ec10 con 0x7f31d8109df0 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c007b020 msgr2=0x7f31c007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c007b020 0x7f31c007d530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005fd0 tx=0x7f31cc00b390 comp rx=0 tx=0).stop 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 msgr2=0x7f31d81a1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 0x7f31d81a1ee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31d000eb10 tx=0x7f31d000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 shutdown_connections 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c007b020 0x7f31c007d530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d8109df0 0x7f31d81a1ee0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d81094a0 0x7f31d819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 --2- 172.21.15.84:0/1197335799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d8103b60 0x7f31d819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 >> 172.21.15.84:0/1197335799 conn(0x7f31d807b850 msgr2=0x7f31d8105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 shutdown_connections 2024-09-21T07:40:48.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:46.652+0000 7f31e0200640 1 -- 172.21.15.84:0/1197335799 wait complete. 2024-09-21T07:40:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:47 smithi191 ceph-mon[34667]: Standby manager daemon y started 2024-09-21T07:40:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:47 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:40:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:47 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:40:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:47 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:40:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:47 smithi191 ceph-mon[34667]: from='mgr.? 172.21.15.162:0/195509898' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:40:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:47 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.823+0000 7fa4cb000640 1 -- 172.21.15.84:0/3692839541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c41039b0 msgr2=0x7fa4c4103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.823+0000 7fa4cb000640 1 --2- 172.21.15.84:0/3692839541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c41039b0 0x7fa4c4103dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009900 tx=0x7fa4b802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.824+0000 7fa4cb000640 1 -- 172.21.15.84:0/3692839541 shutdown_connections 2024-09-21T07:40:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.824+0000 7fa4cb000640 1 --2- 172.21.15.84:0/3692839541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4c4109c40 0x7fa4c4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.824+0000 7fa4cb000640 1 --2- 172.21.15.84:0/3692839541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41092f0 0x7fa4c4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.824+0000 7fa4cb000640 1 --2- 172.21.15.84:0/3692839541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c41039b0 0x7fa4c4103dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.824+0000 7fa4cb000640 1 -- 172.21.15.84:0/3692839541 >> 172.21.15.84:0/3692839541 conn(0x7fa4c40ff440 msgr2=0x7fa4c4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.824+0000 7fa4cb000640 1 -- 172.21.15.84:0/3692839541 shutdown_connections 2024-09-21T07:40:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.824+0000 7fa4cb000640 1 -- 172.21.15.84:0/3692839541 wait complete. 2024-09-21T07:40:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.825+0000 7fa4cb000640 1 Processor -- start 2024-09-21T07:40:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.825+0000 7fa4cb000640 1 -- start start 2024-09-21T07:40:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 -- 172.21.15.84:0/1882898782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c1094b0 msgr2=0x7fc09c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/1882898782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c1094b0 0x7fc09c1098c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc088009900 tx=0x7fc08802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 -- 172.21.15.84:0/1882898782 shutdown_connections 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/1882898782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc09c109e00 0x7fc09c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/1882898782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c1094b0 0x7fc09c1098c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/1882898782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc09c103b70 0x7fc09c103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 -- 172.21.15.84:0/1882898782 >> 172.21.15.84:0/1882898782 conn(0x7fc09c0ff5e0 msgr2=0x7fc09c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 -- 172.21.15.84:0/1882898782 shutdown_connections 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.720+0000 7fc0a2a00640 1 -- 172.21.15.84:0/1882898782 wait complete. 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.721+0000 7fc0a2a00640 1 Processor -- start 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.721+0000 7fc0a2a00640 1 -- start start 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c103b70 0x7fc09c19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc09c1094b0 0x7fc09c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc09c109e00 0x7fc09c1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc0a2a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c113b10 con 0x7fc09c103b70 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc0a2a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c113990 con 0x7fc09c1094b0 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc0a2a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc09c113c90 con 0x7fc09c109e00 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc09be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c103b70 0x7fc09c19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc09be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c103b70 0x7fc09c19c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52710/0 (socket says 172.21.15.84:52710) 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc09be00640 1 -- 172.21.15.84:0/2330461903 learned_addr learned my addr 172.21.15.84:0/2330461903 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc09b400640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc09c1094b0 0x7fc09c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.722+0000 7fc0a0a00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc09c109e00 0x7fc09c1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc09be00640 1 -- 172.21.15.84:0/2330461903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc09c109e00 msgr2=0x7fc09c1a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc09be00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc09c109e00 0x7fc09c1a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc09be00640 1 -- 172.21.15.84:0/2330461903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc09c1094b0 msgr2=0x7fc09c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc09be00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc09c1094b0 0x7fc09c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc09be00640 1 -- 172.21.15.84:0/2330461903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09c1a2630 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc09be00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c103b70 0x7fc09c19c6c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00ea60 tx=0x7fc08c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc098c00640 1 -- 172.21.15.84:0/2330461903 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00cde0 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09c1a2920 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc098c00640 1 -- 172.21.15.84:0/2330461903 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc08c0035f0 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc098c00640 1 -- 172.21.15.84:0/2330461903 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c010690 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.723+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09c1a9080 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.725+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09c103f80 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.727+0000 7fc098c00640 1 -- 172.21.15.84:0/2330461903 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fc08c0037a0 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.728+0000 7fc098c00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc0800b64d0 0x7fc0800b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.729+0000 7fc098c00640 1 -- 172.21.15.84:0/2330461903 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc08c0e5ab0 con 0x7fc09c103b70 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.729+0000 7fc09b400640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc0800b64d0 0x7fc0800b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.730+0000 7fc09b400640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc0800b64d0 0x7fc0800b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc08802a9e0 tx=0x7fc088005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.733+0000 7fc098c00640 1 -- 172.21.15.84:0/2330461903 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc08c0adea0 con 0x7fc09c103b70 2024-09-21T07:40:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4cb000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4c41039b0 0x7fa4c419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4cb000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41092f0 0x7fa4c419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4cb000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c4109c40 0x7fa4c41a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4cb000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4113900 con 0x7fa4c4109c40 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4cb000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4113780 con 0x7fa4c41092f0 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4cb000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4113a80 con 0x7fa4c41039b0 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4ca600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c4109c40 0x7fa4c41a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4ca600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c4109c40 0x7fa4c41a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52736/0 (socket says 172.21.15.84:52736) 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4ca600640 1 -- 172.21.15.84:0/1317243073 learned_addr learned my addr 172.21.15.84:0/1317243073 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4c9c00640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4c41039b0 0x7fa4c419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.826+0000 7fa4c9200640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41092f0 0x7fa4c419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4ca600640 1 -- 172.21.15.84:0/1317243073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4c41039b0 msgr2=0x7fa4c419c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4ca600640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4c41039b0 0x7fa4c419c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4ca600640 1 -- 172.21.15.84:0/1317243073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41092f0 msgr2=0x7fa4c419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4ca600640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41092f0 0x7fa4c419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4ca600640 1 -- 172.21.15.84:0/1317243073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c41a24e0 con 0x7fa4c4109c40 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4c9c00640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4c41039b0 0x7fa4c419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4c9200640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41092f0 0x7fa4c419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4ca600640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c4109c40 0x7fa4c41a1db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009fd0 tx=0x7fa4bc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4c2000640 1 -- 172.21.15.84:0/1317243073 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc017070 con 0x7fa4c4109c40 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4c2000640 1 -- 172.21.15.84:0/1317243073 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4bc003e20 con 0x7fa4c4109c40 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4c2000640 1 -- 172.21.15.84:0/1317243073 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc010460 con 0x7fa4c4109c40 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.827+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c41a27d0 con 0x7fa4c4109c40 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.828+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c41a8f30 con 0x7fa4c4109c40 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.829+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c4103dc0 con 0x7fa4c4109c40 2024-09-21T07:40:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.831+0000 7fa4c2000640 1 -- 172.21.15.84:0/1317243073 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fa4bc003970 con 0x7fa4c4109c40 2024-09-21T07:40:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.833+0000 7fa4c2000640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4ac0b6550 0x7fa4ac0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.833+0000 7fa4c2000640 1 -- 172.21.15.84:0/1317243073 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa4bc0e5360 con 0x7fa4c4109c40 2024-09-21T07:40:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.833+0000 7fa4c9c00640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4ac0b6550 0x7fa4ac0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.834+0000 7fa4c9c00640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4ac0b6550 0x7fa4ac0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8031440 tx=0x7fa4b8032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.835+0000 7fa4c2000640 1 -- 172.21.15.84:0/1317243073 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4bc0b1bb0 con 0x7fa4c4109c40 2024-09-21T07:40:48.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.933+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fc09c1a9370 con 0x7fc09c103b70 2024-09-21T07:40:48.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:48 smithi084 ceph-mon[30411]: mgrmap e20: x(active, since 17s), standbys: z, y 2024-09-21T07:40:48.935 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:40:48.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.938+0000 7fc098c00640 1 -- 172.21.15.84:0/2330461903 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v24)=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fc08c0b2280 con 0x7fc09c103b70 2024-09-21T07:40:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc0800b64d0 msgr2=0x7fc0800b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc0800b64d0 0x7fc0800b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc08802a9e0 tx=0x7fc088005a20 comp rx=0 tx=0).stop 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c103b70 msgr2=0x7fc09c19c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c103b70 0x7fc09c19c6c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00ea60 tx=0x7fc08c00ef20 comp rx=0 tx=0).stop 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 shutdown_connections 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc0800b64d0 0x7fc0800b89e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc09c109e00 0x7fc09c1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc09c1094b0 0x7fc09c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 --2- 172.21.15.84:0/2330461903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc09c103b70 0x7fc09c19c6c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 >> 172.21.15.84:0/2330461903 conn(0x7fc09c0ff5e0 msgr2=0x7fc09c106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 shutdown_connections 2024-09-21T07:40:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:48.941+0000 7fc0a2a00640 1 -- 172.21.15.84:0/2330461903 wait complete. 2024-09-21T07:40:49.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.041+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fa4c41a9160 con 0x7fa4c4109c40 2024-09-21T07:40:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.046+0000 7fa4c2000640 1 -- 172.21.15.84:0/1317243073 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) ==== 120+0+0 (secure 0 0 0) 0x7fa4bc0b6af0 con 0x7fa4c4109c40 2024-09-21T07:40:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4ac0b6550 msgr2=0x7fa4ac0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4ac0b6550 0x7fa4ac0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8031440 tx=0x7fa4b8032ed0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c4109c40 msgr2=0x7fa4c41a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c4109c40 0x7fa4c41a1db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009fd0 tx=0x7fa4bc00b260 comp rx=0 tx=0).stop 2024-09-21T07:40:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 shutdown_connections 2024-09-21T07:40:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4ac0b6550 0x7fa4ac0b8a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4c4109c40 0x7fa4c41a1db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41092f0 0x7fa4c419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 --2- 172.21.15.84:0/1317243073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4c41039b0 0x7fa4c419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 >> 172.21.15.84:0/1317243073 conn(0x7fa4c40ff440 msgr2=0x7fa4c4108a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:49.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 shutdown_connections 2024-09-21T07:40:49.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.048+0000 7fa4cb000640 1 -- 172.21.15.84:0/1317243073 wait complete. 2024-09-21T07:40:49.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:48 smithi162 ceph-mon[34833]: mgrmap e20: x(active, since 17s), standbys: z, y 2024-09-21T07:40:49.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:40:49.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:48 smithi191 ceph-mon[34667]: mgrmap e20: x(active, since 17s), standbys: z, y 2024-09-21T07:40:49.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:40:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 -- 172.21.15.84:0/3218707898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81094b0 msgr2=0x7ff3f81098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 --2- 172.21.15.84:0/3218707898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81094b0 0x7ff3f81098c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009900 tx=0x7ff3e402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 -- 172.21.15.84:0/3218707898 shutdown_connections 2024-09-21T07:40:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 --2- 172.21.15.84:0/3218707898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3f8109e00 0x7ff3f8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 --2- 172.21.15.84:0/3218707898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81094b0 0x7ff3f81098c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 --2- 172.21.15.84:0/3218707898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3f8103b70 0x7ff3f8103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 -- 172.21.15.84:0/3218707898 >> 172.21.15.84:0/3218707898 conn(0x7ff3f80ff5e0 msgr2=0x7ff3f8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 -- 172.21.15.84:0/3218707898 shutdown_connections 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.609+0000 7ff400200640 1 -- 172.21.15.84:0/3218707898 wait complete. 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 Processor -- start 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 -- start start 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f8103b70 0x7ff3f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3f81094b0 0x7ff3f8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3f8109e00 0x7ff3f8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8113b10 con 0x7ff3f8103b70 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8113990 con 0x7ff3f81094b0 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff400200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8113c90 con 0x7ff3f8109e00 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff3fd800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f8103b70 0x7ff3f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff3fce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3f81094b0 0x7ff3f8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff3fd800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f8103b70 0x7ff3f8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52768/0 (socket says 172.21.15.84:52768) 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.611+0000 7ff3fd800640 1 -- 172.21.15.84:0/3836170755 learned_addr learned my addr 172.21.15.84:0/3836170755 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.612+0000 7ff3fe200640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3f8109e00 0x7ff3f8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.612+0000 7ff3fce00640 1 -- 172.21.15.84:0/3836170755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3f8109e00 msgr2=0x7ff3f8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.612+0000 7ff3fce00640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3f8109e00 0x7ff3f8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.612+0000 7ff3fce00640 1 -- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f8103b70 msgr2=0x7ff3f8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.612+0000 7ff3fce00640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f8103b70 0x7ff3f8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.612+0000 7ff3fce00640 1 -- 172.21.15.84:0/3836170755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f81a8780 con 0x7ff3f81094b0 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.612+0000 7ff3fce00640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3f81094b0 0x7ff3f8075c50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009230 tx=0x7ff3e4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.613+0000 7ff3f6000640 1 -- 172.21.15.84:0/3836170755 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e403f070 con 0x7ff3f81094b0 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.613+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f81a8a10 con 0x7ff3f81094b0 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.613+0000 7ff3f6000640 1 -- 172.21.15.84:0/3836170755 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e4031b60 con 0x7ff3f81094b0 2024-09-21T07:40:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.613+0000 7ff3f6000640 1 -- 172.21.15.84:0/3836170755 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4035030 con 0x7ff3f81094b0 2024-09-21T07:40:49.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.613+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f81a8f10 con 0x7ff3f81094b0 2024-09-21T07:40:49.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.614+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f8103f80 con 0x7ff3f81094b0 2024-09-21T07:40:49.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.617+0000 7ff3f6000640 1 -- 172.21.15.84:0/3836170755 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7ff3e4042070 con 0x7ff3f81094b0 2024-09-21T07:40:49.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.618+0000 7ff3f6000640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e00b64d0 0x7ff3e00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:49.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.618+0000 7ff3f6000640 1 -- 172.21.15.84:0/3836170755 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff3e4105e60 con 0x7ff3f81094b0 2024-09-21T07:40:49.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.618+0000 7ff3fd800640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e00b64d0 0x7ff3e00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.619+0000 7ff3fd800640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e00b64d0 0x7ff3e00b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8077160 tx=0x7ff3ec00b4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.620+0000 7ff3f6000640 1 -- 172.21.15.84:0/3836170755 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3e40ce250 con 0x7ff3f81094b0 2024-09-21T07:40:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.825+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff3f8076a10 con 0x7ff3f81094b0 2024-09-21T07:40:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.832+0000 7ff3f6000640 1 -- 172.21.15.84:0/3836170755 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v26)=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7ff3f8076a10 con 0x7ff3f81094b0 2024-09-21T07:40:49.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e00b64d0 msgr2=0x7ff3e00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:49.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e00b64d0 0x7ff3e00b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8077160 tx=0x7ff3ec00b4a0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3f81094b0 msgr2=0x7ff3f8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3f81094b0 0x7ff3f8075c50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009230 tx=0x7ff3e4003c10 comp rx=0 tx=0).stop 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 shutdown_connections 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e00b64d0 0x7ff3e00b89e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3f8109e00 0x7ff3f8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3f81094b0 0x7ff3f8075c50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 --2- 172.21.15.84:0/3836170755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f8103b70 0x7ff3f8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.834+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 >> 172.21.15.84:0/3836170755 conn(0x7ff3f80ff5e0 msgr2=0x7ff3f8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.835+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 shutdown_connections 2024-09-21T07:40:49.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.835+0000 7ff400200640 1 -- 172.21.15.84:0/3836170755 wait complete. 2024-09-21T07:40:49.963 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2330461903' entity='client.admin' 2024-09-21T07:40:49.963 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1317243073' entity='client.admin' 2024-09-21T07:40:49.963 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:49 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:49.963 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1021953746' entity='client.admin' 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 -- 172.21.15.84:0/3715626082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf40105bc0 msgr2=0x7fdf40105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/3715626082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf40105bc0 0x7fdf40105fd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009900 tx=0x7fdf3002a410 comp rx=0 tx=0).stop 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 -- 172.21.15.84:0/3715626082 shutdown_connections 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/3715626082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4010be50 0x7fdf40112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/3715626082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4010b500 0x7fdf4010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/3715626082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf40105bc0 0x7fdf40105fd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 -- 172.21.15.84:0/3715626082 >> 172.21.15.84:0/3715626082 conn(0x7fdf40101670 msgr2=0x7fdf40103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 -- 172.21.15.84:0/3715626082 shutdown_connections 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.029+0000 7fdf3fe00640 1 -- 172.21.15.84:0/3715626082 wait complete. 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 Processor -- start 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 -- start start 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf40105bc0 0x7fdf4019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4010b500 0x7fdf4019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4010be50 0x7fdf401a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40115b60 con 0x7fdf4010b500 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf401159e0 con 0x7fdf40105bc0 2024-09-21T07:40:50.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.030+0000 7fdf3fe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf40115ce0 con 0x7fdf4010be50 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf37e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4010b500 0x7fdf4019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf37e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4010b500 0x7fdf4019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52796/0 (socket says 172.21.15.84:52796) 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf37e00640 1 -- 172.21.15.84:0/1243528301 learned_addr learned my addr 172.21.15.84:0/1243528301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf3f400640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4010be50 0x7fdf401a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf3ea00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf40105bc0 0x7fdf4019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf3f400640 1 -- 172.21.15.84:0/1243528301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf40105bc0 msgr2=0x7fdf4019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf3f400640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf40105bc0 0x7fdf4019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf3f400640 1 -- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4010b500 msgr2=0x7fdf4019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf3f400640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4010b500 0x7fdf4019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf3f400640 1 -- 172.21.15.84:0/1243528301 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf401a25a0 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.031+0000 7fdf37e00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4010b500 0x7fdf4019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.032+0000 7fdf3f400640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4010be50 0x7fdf401a1e70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009fd0 tx=0x7fdf3800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.032+0000 7fdf37400640 1 -- 172.21.15.84:0/1243528301 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800ce20 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.032+0000 7fdf37400640 1 -- 172.21.15.84:0/1243528301 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf38005020 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.032+0000 7fdf37400640 1 -- 172.21.15.84:0/1243528301 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38010690 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.032+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf401a2890 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.032+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf401a8ff0 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.033+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf40105fd0 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.036+0000 7fdf37400640 1 -- 172.21.15.84:0/1243528301 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fdf380054d0 con 0x7fdf4010be50 2024-09-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.037+0000 7fdf37400640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf240b6550 0x7fdf240b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.037+0000 7fdf37400640 1 -- 172.21.15.84:0/1243528301 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdf380e5df0 con 0x7fdf4010be50 2024-09-21T07:40:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.037+0000 7fdf3ea00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf240b6550 0x7fdf240b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.038+0000 7fdf3ea00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf240b6550 0x7fdf240b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005ab0 tx=0x7fdf30005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.042+0000 7fdf37400640 1 -- 172.21.15.84:0/1243528301 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf380ae1e0 con 0x7fdf4010be50 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 -- 172.21.15.84:0/510465307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd01092f0 msgr2=0x7f5bd0109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 --2- 172.21.15.84:0/510465307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd01092f0 0x7f5bd0109700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009900 tx=0x7f5bbc02a410 comp rx=0 tx=0).stop 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 -- 172.21.15.84:0/510465307 shutdown_connections 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 --2- 172.21.15.84:0/510465307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd0109c40 0x7f5bd0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 --2- 172.21.15.84:0/510465307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd01092f0 0x7f5bd0109700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 --2- 172.21.15.84:0/510465307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd01039b0 0x7f5bd0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 -- 172.21.15.84:0/510465307 >> 172.21.15.84:0/510465307 conn(0x7f5bd00ff440 msgr2=0x7f5bd0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 -- 172.21.15.84:0/510465307 shutdown_connections 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.700+0000 7f5bd5000640 1 -- 172.21.15.84:0/510465307 wait complete. 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.701+0000 7f5bd5000640 1 Processor -- start 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.701+0000 7f5bd5000640 1 -- start start 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bd5000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd01039b0 0x7f5bd0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bd5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd01092f0 0x7f5bd0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bd5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0109c40 0x7f5bd0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bd5000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0113900 con 0x7f5bd0109c40 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bd5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0113780 con 0x7f5bd01092f0 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bd5000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0113a80 con 0x7f5bd01039b0 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bcfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0109c40 0x7f5bd0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bcfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0109c40 0x7f5bd0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52786/0 (socket says 172.21.15.84:52786) 2024-09-21T07:40:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bcfe00640 1 -- 172.21.15.84:0/1021953746 learned_addr learned my addr 172.21.15.84:0/1021953746 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bcf400640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd01039b0 0x7f5bd0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.702+0000 7f5bcea00640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd01092f0 0x7f5bd0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bcfe00640 1 -- 172.21.15.84:0/1021953746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd01039b0 msgr2=0x7f5bd0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bcfe00640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd01039b0 0x7f5bd0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bcfe00640 1 -- 172.21.15.84:0/1021953746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd01092f0 msgr2=0x7f5bd0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bcfe00640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd01092f0 0x7f5bd0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bcfe00640 1 -- 172.21.15.84:0/1021953746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd01a85f0 con 0x7f5bd0109c40 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bcf400640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd01039b0 0x7f5bd0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bcfe00640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0109c40 0x7f5bd0076190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800eb10 tx=0x7f5bc800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bc7e00640 1 -- 172.21.15.84:0/1021953746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8004b20 con 0x7f5bd0109c40 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bc7e00640 1 -- 172.21.15.84:0/1021953746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bc8004cc0 con 0x7f5bd0109c40 2024-09-21T07:40:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd01a88e0 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bc7e00640 1 -- 172.21.15.84:0/1021953746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8010670 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.703+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd01a8da0 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.705+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd0103dc0 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.707+0000 7f5bc7e00640 1 -- 172.21.15.84:0/1021953746 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f5bc8005020 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.710+0000 7f5bc7e00640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5bb40b64d0 0x7f5bb40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.710+0000 7f5bc7e00640 1 -- 172.21.15.84:0/1021953746 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5bc80e5d40 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.710+0000 7f5bcf400640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5bb40b64d0 0x7f5bb40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.712+0000 7f5bcf400640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5bb40b64d0 0x7f5bb40b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0077160 tx=0x7f5bc0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.716+0000 7f5bc7e00640 1 -- 172.21.15.84:0/1021953746 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bc80ae1b0 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.919+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f5bd002e640 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.924+0000 7f5bc7e00640 1 -- 172.21.15.84:0/1021953746 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v27)=0 v27) ==== 106+0+0 (secure 0 0 0) 0x7f5bc80a9030 con 0x7f5bd0109c40 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5bb40b64d0 msgr2=0x7f5bb40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5bb40b64d0 0x7f5bb40b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0077160 tx=0x7f5bc0005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0109c40 msgr2=0x7f5bd0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0109c40 0x7f5bd0076190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800eb10 tx=0x7f5bc800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 shutdown_connections 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5bb40b64d0 0x7f5bb40b89e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0109c40 0x7f5bd0076190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd01092f0 0x7f5bd0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 --2- 172.21.15.84:0/1021953746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd01039b0 0x7f5bd0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.927+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 >> 172.21.15.84:0/1021953746 conn(0x7f5bd00ff440 msgr2=0x7f5bd0101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.928+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 shutdown_connections 2024-09-21T07:40:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:49.928+0000 7f5bd5000640 1 -- 172.21.15.84:0/1021953746 wait complete. 2024-09-21T07:40:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.236+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fdf4002e640 con 0x7fdf4010be50 2024-09-21T07:40:50.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.242+0000 7fdf37400640 1 -- 172.21.15.84:0/1243528301 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7fdf380b25c0 con 0x7fdf4010be50 2024-09-21T07:40:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf240b6550 msgr2=0x7fdf240b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf240b6550 0x7fdf240b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005ab0 tx=0x7fdf30005a20 comp rx=0 tx=0).stop 2024-09-21T07:40:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4010be50 msgr2=0x7fdf401a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:50.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4010be50 0x7fdf401a1e70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009fd0 tx=0x7fdf3800ef10 comp rx=0 tx=0).stop 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 shutdown_connections 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf240b6550 0x7fdf240b8a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4010be50 0x7fdf401a1e70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4010b500 0x7fdf4019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 --2- 172.21.15.84:0/1243528301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf40105bc0 0x7fdf4019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.245+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 >> 172.21.15.84:0/1243528301 conn(0x7fdf40101670 msgr2=0x7fdf4010ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.246+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 shutdown_connections 2024-09-21T07:40:50.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:50.246+0000 7fdf3fe00640 1 -- 172.21.15.84:0/1243528301 wait complete. 2024-09-21T07:40:50.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2330461903' entity='client.admin' 2024-09-21T07:40:50.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1317243073' entity='client.admin' 2024-09-21T07:40:50.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:49 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:50.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1021953746' entity='client.admin' 2024-09-21T07:40:50.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2330461903' entity='client.admin' 2024-09-21T07:40:50.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1317243073' entity='client.admin' 2024-09-21T07:40:50.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:49 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:50.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1021953746' entity='client.admin' 2024-09-21T07:40:51.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:50 smithi084 ceph-mon[30411]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:51.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:50 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:51.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 -- 172.21.15.84:0/2532316264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c103b70 msgr2=0x7f038c103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:51.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 --2- 172.21.15.84:0/2532316264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c103b70 0x7f038c103f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f037c009860 tx=0x7f037c02a340 comp rx=0 tx=0).stop 2024-09-21T07:40:51.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 -- 172.21.15.84:0/2532316264 shutdown_connections 2024-09-21T07:40:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 --2- 172.21.15.84:0/2532316264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 0x7f038c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 --2- 172.21.15.84:0/2532316264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c1094b0 0x7f038c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 --2- 172.21.15.84:0/2532316264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c103b70 0x7f038c103f80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 -- 172.21.15.84:0/2532316264 >> 172.21.15.84:0/2532316264 conn(0x7f038c0ff5e0 msgr2=0x7f038c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 -- 172.21.15.84:0/2532316264 shutdown_connections 2024-09-21T07:40:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.187+0000 7f0392c00640 1 -- 172.21.15.84:0/2532316264 wait complete. 2024-09-21T07:40:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 Processor -- start 2024-09-21T07:40:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 -- start start 2024-09-21T07:40:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c103b70 0x7f038c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1094b0 0x7f038c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 0x7f038c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f038c113ac0 con 0x7f038c109e00 2024-09-21T07:40:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f038c113940 con 0x7f038c1094b0 2024-09-21T07:40:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.189+0000 7f0392c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f038c113c40 con 0x7f038c103b70 2024-09-21T07:40:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f0390c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 0x7f038c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1094b0 0x7f038c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c103b70 0x7f038c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c103b70 0x7f038c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36536/0 (socket says 172.21.15.84:36536) 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 -- 172.21.15.84:0/55428470 learned_addr learned my addr 172.21.15.84:0/55428470 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f0390c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 0x7f038c19fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52808/0 (socket says 172.21.15.84:52808) 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1094b0 0x7f038c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42842/0 (socket says 172.21.15.84:42842) 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 -- 172.21.15.84:0/55428470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1094b0 msgr2=0x7f038c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1094b0 0x7f038c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 -- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 msgr2=0x7f038c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 0x7f038c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038be00640 1 -- 172.21.15.84:0/55428470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c1a0420 con 0x7f038c103b70 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f038b400640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1094b0 0x7f038c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.190+0000 7f0390c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 0x7f038c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.191+0000 7f038be00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c103b70 0x7f038c19a4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f037c035040 tx=0x7f037c032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.191+0000 7f0388c00640 1 -- 172.21.15.84:0/55428470 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c037040 con 0x7f038c103b70 2024-09-21T07:40:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.191+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c1a06b0 con 0x7f038c103b70 2024-09-21T07:40:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.191+0000 7f0388c00640 1 -- 172.21.15.84:0/55428470 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f037c041070 con 0x7f038c103b70 2024-09-21T07:40:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.191+0000 7f0388c00640 1 -- 172.21.15.84:0/55428470 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c003850 con 0x7f038c103b70 2024-09-21T07:40:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.191+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c1a6e70 con 0x7f038c103b70 2024-09-21T07:40:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.192+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c104df0 con 0x7f038c103b70 2024-09-21T07:40:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.195+0000 7f0388c00640 1 -- 172.21.15.84:0/55428470 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f037c0039f0 con 0x7f038c103b70 2024-09-21T07:40:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.197+0000 7f0388c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03700b64d0 0x7f03700b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.197+0000 7f0388c00640 1 -- 172.21.15.84:0/55428470 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f037c1051a0 con 0x7f038c103b70 2024-09-21T07:40:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.197+0000 7f038b400640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03700b64d0 0x7f03700b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.198+0000 7f038b400640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03700b64d0 0x7f03700b89e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f038c108fd0 tx=0x7f0378005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.201+0000 7f0388c00640 1 -- 172.21.15.84:0/55428470 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f037c0cd590 con 0x7f038c103b70 2024-09-21T07:40:51.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:50 smithi162 ceph-mon[34833]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:51.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:50 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:51.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.398+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f038c10bc30 con 0x7f038c103b70 2024-09-21T07:40:51.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:50 smithi191 ceph-mon[34667]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:51.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:50 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.405+0000 7f0388c00640 1 -- 172.21.15.84:0/55428470 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f037c0d1970 con 0x7f038c103b70 2024-09-21T07:40:51.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03700b64d0 msgr2=0x7f03700b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:51.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03700b64d0 0x7f03700b89e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f038c108fd0 tx=0x7f0378005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c103b70 msgr2=0x7f038c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c103b70 0x7f038c19a4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f037c035040 tx=0x7f037c032d50 comp rx=0 tx=0).stop 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 shutdown_connections 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f03700b64d0 0x7f03700b89e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c109e00 0x7f038c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1094b0 0x7f038c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 --2- 172.21.15.84:0/55428470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c103b70 0x7f038c19a4b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.407+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 >> 172.21.15.84:0/55428470 conn(0x7f038c0ff5e0 msgr2=0x7f038c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.408+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 shutdown_connections 2024-09-21T07:40:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:51.408+0000 7f0392c00640 1 -- 172.21.15.84:0/55428470 wait complete. 2024-09-21T07:40:51.994 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi084') 2024-09-21T07:40:52.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:52 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:52.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:52 smithi191 ceph-mon[34667]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:52 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:52.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:52 smithi162 ceph-mon[34833]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:52.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:52 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:52.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:52 smithi084 ceph-mon[30411]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.291+0000 7fe229e00640 1 -- 172.21.15.84:0/3520870575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410be50 msgr2=0x7fe224112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.291+0000 7fe229e00640 1 --2- 172.21.15.84:0/3520870575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410be50 0x7fe224112680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009ca0 tx=0x7fe21c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.292+0000 7fe229e00640 1 -- 172.21.15.84:0/3520870575 shutdown_connections 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.292+0000 7fe229e00640 1 --2- 172.21.15.84:0/3520870575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410be50 0x7fe224112680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.292+0000 7fe229e00640 1 --2- 172.21.15.84:0/3520870575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22410b500 0x7fe22410b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.292+0000 7fe229e00640 1 --2- 172.21.15.84:0/3520870575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe224105bc0 0x7fe224105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.292+0000 7fe229e00640 1 -- 172.21.15.84:0/3520870575 >> 172.21.15.84:0/3520870575 conn(0x7fe224101670 msgr2=0x7fe224103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.292+0000 7fe229e00640 1 -- 172.21.15.84:0/3520870575 shutdown_connections 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.292+0000 7fe229e00640 1 -- 172.21.15.84:0/3520870575 wait complete. 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 Processor -- start 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 -- start start 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe224105bc0 0x7fe22419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410b500 0x7fe22419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe22410be50 0x7fe2241a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe224115b10 con 0x7fe22410b500 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe224115990 con 0x7fe224105bc0 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe224115c90 con 0x7fe22410be50 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe228a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe224105bc0 0x7fe22419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe223e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410b500 0x7fe22419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe228a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe224105bc0 0x7fe22419c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42846/0 (socket says 172.21.15.84:42846) 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe228a00640 1 -- 172.21.15.84:0/445529011 learned_addr learned my addr 172.21.15.84:0/445529011 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.293+0000 7fe229400640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe22410be50 0x7fe2241a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe223e00640 1 -- 172.21.15.84:0/445529011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe22410be50 msgr2=0x7fe2241a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe223e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe22410be50 0x7fe2241a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe223e00640 1 -- 172.21.15.84:0/445529011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe224105bc0 msgr2=0x7fe22419c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe223e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe224105bc0 0x7fe22419c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe223e00640 1 -- 172.21.15.84:0/445529011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2241a2410 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe228a00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe224105bc0 0x7fe22419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe223e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410b500 0x7fe22419ca40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe22406c8a0 tx=0x7fe21000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe221600640 1 -- 172.21.15.84:0/445529011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21000cc40 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe221600640 1 -- 172.21.15.84:0/445529011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21000cde0 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.294+0000 7fe221600640 1 -- 172.21.15.84:0/445529011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210018780 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.295+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2241a2700 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.295+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2241a8e60 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.296+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe224105fd0 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.301+0000 7fe221600640 1 -- 172.21.15.84:0/445529011 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fe210010a90 con 0x7fe22410b500 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.302+0000 7fe221600640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe20c0b6550 0x7fe20c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.303+0000 7fe221600640 1 -- 172.21.15.84:0/445529011 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe2100e5b90 con 0x7fe22410b500 2024-09-21T07:40:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.303+0000 7fe228a00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe20c0b6550 0x7fe20c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.303+0000 7fe228a00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe20c0b6550 0x7fe20c0b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe218011500 tx=0x7fe218005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.304+0000 7fe221600640 1 -- 172.21.15.84:0/445529011 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2100b23e0 con 0x7fe22410b500 2024-09-21T07:40:53.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.498+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fe22419d5d0 con 0x7fe22410b500 2024-09-21T07:40:53.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.503+0000 7fe221600640 1 -- 172.21.15.84:0/445529011 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7fe2100b7320 con 0x7fe22410b500 2024-09-21T07:40:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe20c0b6550 msgr2=0x7fe20c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe20c0b6550 0x7fe20c0b8a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe218011500 tx=0x7fe218005f90 comp rx=0 tx=0).stop 2024-09-21T07:40:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410b500 msgr2=0x7fe22419ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410b500 0x7fe22419ca40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe22406c8a0 tx=0x7fe21000ee50 comp rx=0 tx=0).stop 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 shutdown_connections 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe20c0b6550 0x7fe20c0b8a60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe22410be50 0x7fe2241a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22410b500 0x7fe22419ca40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 --2- 172.21.15.84:0/445529011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe224105bc0 0x7fe22419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 >> 172.21.15.84:0/445529011 conn(0x7fe224101670 msgr2=0x7fe224103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 shutdown_connections 2024-09-21T07:40:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:53.506+0000 7fe229e00640 1 -- 172.21.15.84:0/445529011 wait complete. 2024-09-21T07:40:54.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:54 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/445529011' entity='client.admin' 2024-09-21T07:40:54.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:54 smithi084 ceph-mon[30411]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:54.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:54 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/445529011' entity='client.admin' 2024-09-21T07:40:54.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:54 smithi162 ceph-mon[34833]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:54.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:54 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/445529011' entity='client.admin' 2024-09-21T07:40:54.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:54 smithi191 ceph-mon[34667]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 -- 172.21.15.84:0/383852024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc109c40 msgr2=0x7faacc110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 --2- 172.21.15.84:0/383852024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc109c40 0x7faacc110470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faac4009900 tx=0x7faac402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 -- 172.21.15.84:0/383852024 shutdown_connections 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 --2- 172.21.15.84:0/383852024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc109c40 0x7faacc110470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 --2- 172.21.15.84:0/383852024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faacc1092f0 0x7faacc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 --2- 172.21.15.84:0/383852024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faacc1039b0 0x7faacc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 -- 172.21.15.84:0/383852024 >> 172.21.15.84:0/383852024 conn(0x7faacc0ff440 msgr2=0x7faacc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 -- 172.21.15.84:0/383852024 shutdown_connections 2024-09-21T07:40:55.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.940+0000 7faad2400640 1 -- 172.21.15.84:0/383852024 wait complete. 2024-09-21T07:40:55.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.942+0000 7faad2400640 1 Processor -- start 2024-09-21T07:40:55.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.942+0000 7faad2400640 1 -- start start 2024-09-21T07:40:55.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.942+0000 7faad2400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faacc1039b0 0x7faacc19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.942+0000 7faad2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc1092f0 0x7faacc19a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faad2400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faacc109c40 0x7faacc19fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faad2400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faacc113900 con 0x7faacc109c40 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faad2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faacc113780 con 0x7faacc1092f0 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faad2400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faacc113a80 con 0x7faacc1039b0 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc1092f0 0x7faacc19a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faad1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faacc109c40 0x7faacc19fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc1092f0 0x7faacc19a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42866/0 (socket says 172.21.15.84:42866) 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faad1000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faacc1039b0 0x7faacc19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:55.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 -- 172.21.15.84:0/3631955601 learned_addr learned my addr 172.21.15.84:0/3631955601 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:55.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 -- 172.21.15.84:0/3631955601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faacc1039b0 msgr2=0x7faacc19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faacc1039b0 0x7faacc19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 -- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faacc109c40 msgr2=0x7faacc19fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faacc109c40 0x7faacc19fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faacbe00640 1 -- 172.21.15.84:0/3631955601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc1a0260 con 0x7faacc1092f0 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.943+0000 7faad1000640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faacc1039b0 0x7faacc19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.944+0000 7faacbe00640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc1092f0 0x7faacc19a890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faab800e970 tx=0x7faab800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.944+0000 7faac9600640 1 -- 172.21.15.84:0/3631955601 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab800cd80 con 0x7faacc1092f0 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.944+0000 7faac9600640 1 -- 172.21.15.84:0/3631955601 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faab80035f0 con 0x7faacc1092f0 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.944+0000 7faac9600640 1 -- 172.21.15.84:0/3631955601 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8010690 con 0x7faacc1092f0 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.944+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc1a0550 con 0x7faacc1092f0 2024-09-21T07:40:55.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.944+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc1a6cb0 con 0x7faacc1092f0 2024-09-21T07:40:55.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.945+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc103dc0 con 0x7faacc1092f0 2024-09-21T07:40:55.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.948+0000 7faac9600640 1 -- 172.21.15.84:0/3631955601 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7faab8003aa0 con 0x7faacc1092f0 2024-09-21T07:40:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.950+0000 7faac9600640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faab40b65d0 0x7faab40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.950+0000 7faac9600640 1 -- 172.21.15.84:0/3631955601 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7faab80e5a60 con 0x7faacc1092f0 2024-09-21T07:40:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.950+0000 7faad1000640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faab40b65d0 0x7faab40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.950+0000 7faac9600640 1 -- 172.21.15.84:0/3631955601 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faab80ade50 con 0x7faacc1092f0 2024-09-21T07:40:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:55.951+0000 7faad1000640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faab40b65d0 0x7faab40b8ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faac0005fd0 tx=0x7faac0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:56.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.153+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7faacc02e640 con 0x7faacc1092f0 2024-09-21T07:40:56.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.160+0000 7faac9600640 1 -- 172.21.15.84:0/3631955601 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v31)=0 v31) ==== 111+0+0 (secure 0 0 0) 0x7faab80b2230 con 0x7faacc1092f0 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faab40b65d0 msgr2=0x7faab40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faab40b65d0 0x7faab40b8ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faac0005fd0 tx=0x7faac0009500 comp rx=0 tx=0).stop 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc1092f0 msgr2=0x7faacc19a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc1092f0 0x7faacc19a890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faab800e970 tx=0x7faab800ee30 comp rx=0 tx=0).stop 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 shutdown_connections 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faab40b65d0 0x7faab40b8ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faacc109c40 0x7faacc19fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faacc1092f0 0x7faacc19a890 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 --2- 172.21.15.84:0/3631955601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faacc1039b0 0x7faacc19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 >> 172.21.15.84:0/3631955601 conn(0x7faacc0ff440 msgr2=0x7faacc101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 shutdown_connections 2024-09-21T07:40:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:56.163+0000 7faad2400640 1 -- 172.21.15.84:0/3631955601 wait complete. 2024-09-21T07:40:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:40:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:57.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:57.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: Reconfiguring daemon mon.b on smithi162 2024-09-21T07:40:57.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:57.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:56 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: Reconfiguring daemon mon.b on smithi162 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:56 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:40:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:57.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: Reconfiguring daemon mon.b on smithi162 2024-09-21T07:40:57.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:57.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:56 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 -- 172.21.15.84:0/2831725300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1092f0 msgr2=0x7f75dc109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2831725300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1092f0 0x7f75dc109700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009900 tx=0x7f75c402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 -- 172.21.15.84:0/2831725300 shutdown_connections 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2831725300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75dc109c40 0x7f75dc110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2831725300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1092f0 0x7f75dc109700 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2831725300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc1039b0 0x7f75dc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 -- 172.21.15.84:0/2831725300 >> 172.21.15.84:0/2831725300 conn(0x7f75dc0ff440 msgr2=0x7f75dc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 -- 172.21.15.84:0/2831725300 shutdown_connections 2024-09-21T07:40:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.658+0000 7f75dbe00640 1 -- 172.21.15.84:0/2831725300 wait complete. 2024-09-21T07:40:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.659+0000 7f75dbe00640 1 Processor -- start 2024-09-21T07:40:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.659+0000 7f75dbe00640 1 -- start start 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75dbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1039b0 0x7f75dc19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75dbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75dc1092f0 0x7f75dc19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75dbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc109c40 0x7f75dc19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75dbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc113950 con 0x7f75dc109c40 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75dbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc1137d0 con 0x7f75dc1092f0 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75dbe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc113ad0 con 0x7f75dc1039b0 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75daa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1039b0 0x7f75dc19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75dc1092f0 0x7f75dc19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75daa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1039b0 0x7f75dc19a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36590/0 (socket says 172.21.15.84:36590) 2024-09-21T07:40:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.660+0000 7f75daa00640 1 -- 172.21.15.84:0/2926308499 learned_addr learned my addr 172.21.15.84:0/2926308499 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75db400640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc109c40 0x7f75dc19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75daa00640 1 -- 172.21.15.84:0/2926308499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75dc1092f0 msgr2=0x7f75dc19a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75daa00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75dc1092f0 0x7f75dc19a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75daa00640 1 -- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc109c40 msgr2=0x7f75dc19fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75daa00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc109c40 0x7f75dc19fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75daa00640 1 -- 172.21.15.84:0/2926308499 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc1a0250 con 0x7f75dc1039b0 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75db400640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc109c40 0x7f75dc19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.661+0000 7f75daa00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1039b0 0x7f75dc19a2e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00e9f0 tx=0x7f75cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.662+0000 7f75d3400640 1 -- 172.21.15.84:0/2926308499 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00cd80 con 0x7f75dc1039b0 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.662+0000 7f75d3400640 1 -- 172.21.15.84:0/2926308499 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75cc0108e0 con 0x7f75dc1039b0 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.662+0000 7f75d3400640 1 -- 172.21.15.84:0/2926308499 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc018980 con 0x7f75dc1039b0 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.662+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc1a0540 con 0x7f75dc1039b0 2024-09-21T07:40:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.662+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc1a6ca0 con 0x7f75dc1039b0 2024-09-21T07:40:57.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.663+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75dc104c30 con 0x7f75dc1039b0 2024-09-21T07:40:57.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.665+0000 7f75d3400640 1 -- 172.21.15.84:0/2926308499 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f75cc010430 con 0x7f75dc1039b0 2024-09-21T07:40:57.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.667+0000 7f75d3400640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75c00b6550 0x7f75c00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.667+0000 7f75d3400640 1 -- 172.21.15.84:0/2926308499 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f75cc0e5fe0 con 0x7f75dc1039b0 2024-09-21T07:40:57.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.667+0000 7f75d3e00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75c00b6550 0x7f75c00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.668+0000 7f75d3e00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75c00b6550 0x7f75c00b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75c402a9e0 tx=0x7f75c4005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:57.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.668+0000 7f75d3400640 1 -- 172.21.15.84:0/2926308499 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75cc0ae3d0 con 0x7f75dc1039b0 2024-09-21T07:40:57.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.883+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f75dc103dc0 con 0x7f75dc1039b0 2024-09-21T07:40:57.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.889+0000 7f75d3400640 1 -- 172.21.15.84:0/2926308499 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v32)=0 v32) ==== 120+0+0 (secure 0 0 0) 0x7f75dc103dc0 con 0x7f75dc1039b0 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 -- 172.21.15.84:0/1552715660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc0105320 msgr2=0x7f6cc010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/1552715660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc0105320 0x7f6cc010d870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009900 tx=0x7f6cac02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 -- 172.21.15.84:0/1552715660 shutdown_connections 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/1552715660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc010de30 0x7f6cc0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/1552715660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc0105320 0x7f6cc010d870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/1552715660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cc01049d0 0x7f6cc0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 -- 172.21.15.84:0/1552715660 >> 172.21.15.84:0/1552715660 conn(0x7f6cc0079740 msgr2=0x7f6cc0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 -- 172.21.15.84:0/1552715660 shutdown_connections 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.826+0000 7f6cc6e00640 1 -- 172.21.15.84:0/1552715660 wait complete. 2024-09-21T07:40:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.827+0000 7f6cc6e00640 1 Processor -- start 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc6e00640 1 -- start start 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc6e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc01049d0 0x7f6cc019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc6e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cc0105320 0x7f6cc019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc6e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc010de30 0x7f6cc019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc6e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0113ae0 con 0x7f6cc01049d0 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc6e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0113960 con 0x7f6cc0105320 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc6e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0113c60 con 0x7f6cc010de30 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cbfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc01049d0 0x7f6cc019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cc0105320 0x7f6cc019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cbfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc01049d0 0x7f6cc019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58710/0 (socket says 172.21.15.84:58710) 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cbfe00640 1 -- 172.21.15.84:0/563363162 learned_addr learned my addr 172.21.15.84:0/563363162 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.828+0000 7f6cc4e00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc010de30 0x7f6cc019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbfe00640 1 -- 172.21.15.84:0/563363162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc010de30 msgr2=0x7f6cc019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbfe00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc010de30 0x7f6cc019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbfe00640 1 -- 172.21.15.84:0/563363162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cc0105320 msgr2=0x7f6cc019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbfe00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cc0105320 0x7f6cc019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbfe00640 1 -- 172.21.15.84:0/563363162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc01a0420 con 0x7f6cc01049d0 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbf400640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cc0105320 0x7f6cc019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbfe00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc01049d0 0x7f6cc019a4b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000d770 tx=0x7f6cb000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbcc00640 1 -- 172.21.15.84:0/563363162 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0017070 con 0x7f6cc01049d0 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbcc00640 1 -- 172.21.15.84:0/563363162 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cb0009c30 con 0x7f6cc01049d0 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.829+0000 7f6cbcc00640 1 -- 172.21.15.84:0/563363162 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0003cc0 con 0x7f6cc01049d0 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.830+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc01a0710 con 0x7f6cc01049d0 2024-09-21T07:40:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.830+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc01a6e70 con 0x7f6cc01049d0 2024-09-21T07:40:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.831+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc006c240 con 0x7f6cc01049d0 2024-09-21T07:40:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.836+0000 7f6cbcc00640 1 -- 172.21.15.84:0/563363162 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f6cb0003e60 con 0x7f6cc01049d0 2024-09-21T07:40:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.837+0000 7f6cbcc00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6ca40b64d0 0x7f6ca40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.837+0000 7f6cbcc00640 1 -- 172.21.15.84:0/563363162 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6cb00e5440 con 0x7f6cc01049d0 2024-09-21T07:40:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.837+0000 7f6cbf400640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6ca40b64d0 0x7f6ca40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.838+0000 7f6cbf400640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6ca40b64d0 0x7f6ca40b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cac02a9e0 tx=0x7f6cac005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.838+0000 7f6cbcc00640 1 -- 172.21.15.84:0/563363162 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cb0009de0 con 0x7f6cc01049d0 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75c00b6550 msgr2=0x7f75c00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75c00b6550 0x7f75c00b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75c402a9e0 tx=0x7f75c4005a20 comp rx=0 tx=0).stop 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1039b0 msgr2=0x7f75dc19a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1039b0 0x7f75dc19a2e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00e9f0 tx=0x7f75cc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 shutdown_connections 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75c00b6550 0x7f75c00b8a60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75dc109c40 0x7f75dc19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75dc1092f0 0x7f75dc19a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 --2- 172.21.15.84:0/2926308499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75dc1039b0 0x7f75dc19a2e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 >> 172.21.15.84:0/2926308499 conn(0x7f75dc0ff440 msgr2=0x7f75dc108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 shutdown_connections 2024-09-21T07:40:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:57.892+0000 7f75dbe00640 1 -- 172.21.15.84:0/2926308499 wait complete. 2024-09-21T07:40:58.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:58.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:58.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:40:58.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:58.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:58.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:58.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: Reconfiguring daemon mon.c on smithi191 2024-09-21T07:40:58.011 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:57 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:58.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.054+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f6cc0104de0 con 0x7f6cc01049d0 2024-09-21T07:40:58.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.058+0000 7f6cbcc00640 1 -- 172.21.15.84:0/563363162 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7f6cb00b1c90 con 0x7f6cc01049d0 2024-09-21T07:40:58.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6ca40b64d0 msgr2=0x7f6ca40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:58.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6ca40b64d0 0x7f6ca40b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cac02a9e0 tx=0x7f6cac005a20 comp rx=0 tx=0).stop 2024-09-21T07:40:58.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc01049d0 msgr2=0x7f6cc019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:58.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc01049d0 0x7f6cc019a4b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000d770 tx=0x7f6cb000dc30 comp rx=0 tx=0).stop 2024-09-21T07:40:58.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 shutdown_connections 2024-09-21T07:40:58.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6ca40b64d0 0x7f6ca40b89e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc010de30 0x7f6cc019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cc0105320 0x7f6cc019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 --2- 172.21.15.84:0/563363162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc01049d0 0x7f6cc019a4b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 >> 172.21.15.84:0/563363162 conn(0x7f6cc0079740 msgr2=0x7f6cc0100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:58.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 shutdown_connections 2024-09-21T07:40:58.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.061+0000 7f6cc6e00640 1 -- 172.21.15.84:0/563363162 wait complete. 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: Reconfiguring daemon mon.c on smithi191 2024-09-21T07:40:58.181 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:57 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:58.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:58.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:58.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:40:58.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:40:58.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:40:58.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:58.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: Reconfiguring daemon mon.c on smithi191 2024-09-21T07:40:58.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:57 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:58.705 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi084') 2024-09-21T07:40:58.705 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi084') 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 -- 172.21.15.84:0/2736725780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1120105d80 msgr2=0x7f1120106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 --2- 172.21.15.84:0/2736725780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1120105d80 0x7f1120106190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1110009900 tx=0x7f111002a410 comp rx=0 tx=0).stop 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 -- 172.21.15.84:0/2736725780 shutdown_connections 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 --2- 172.21.15.84:0/2736725780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f112010c010 0x7f1120112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 --2- 172.21.15.84:0/2736725780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f112010b6c0 0x7f112010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 --2- 172.21.15.84:0/2736725780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1120105d80 0x7f1120106190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 -- 172.21.15.84:0/2736725780 >> 172.21.15.84:0/2736725780 conn(0x7f1120101810 msgr2=0x7f1120103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 -- 172.21.15.84:0/2736725780 shutdown_connections 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.756+0000 7f1127000640 1 -- 172.21.15.84:0/2736725780 wait complete. 2024-09-21T07:40:58.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.757+0000 7f1127000640 1 Processor -- start 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1127000640 1 -- start start 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1127000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1120105d80 0x7f112019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1127000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f112010b6c0 0x7f112019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1127000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f112010c010 0x7f11201a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1127000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1120115d20 con 0x7f112010b6c0 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1127000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1120115ba0 con 0x7f1120105d80 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1127000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1120115ea0 con 0x7f112010c010 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f111f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f112010b6c0 0x7f112019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f111fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1120105d80 0x7f112019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f111f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f112010b6c0 0x7f112019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58730/0 (socket says 172.21.15.84:58730) 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f111f400640 1 -- 172.21.15.84:0/526440543 learned_addr learned my addr 172.21.15.84:0/526440543 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.758+0000 7f1125000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f112010c010 0x7f11201a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f1125000640 1 -- 172.21.15.84:0/526440543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1120105d80 msgr2=0x7f112019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:58.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f1125000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1120105d80 0x7f112019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f1125000640 1 -- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f112010b6c0 msgr2=0x7f112019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f1125000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f112010b6c0 0x7f112019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f1125000640 1 -- 172.21.15.84:0/526440543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11201a2660 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f1125000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f112010c010 0x7f11201a1f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1118009fd0 tx=0x7f111800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f111cc00640 1 -- 172.21.15.84:0/526440543 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111800ce20 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.759+0000 7f111cc00640 1 -- 172.21.15.84:0/526440543 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1118005020 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.760+0000 7f111cc00640 1 -- 172.21.15.84:0/526440543 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118010690 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.760+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11201a2950 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.760+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11201a90b0 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.761+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1120106190 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.763+0000 7f111cc00640 1 -- 172.21.15.84:0/526440543 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f11180054d0 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.764+0000 7f111cc00640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11040b6550 0x7f11040b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.765+0000 7f111cc00640 1 -- 172.21.15.84:0/526440543 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f11180e5e70 con 0x7f112010c010 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.765+0000 7f111fe00640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11040b6550 0x7f11040b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:40:58.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.765+0000 7f111fe00640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11040b6550 0x7f11040b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1110005ab0 tx=0x7f1110005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:40:58.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.766+0000 7f111cc00640 1 -- 172.21.15.84:0/526440543 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11180ae260 con 0x7f112010c010 2024-09-21T07:40:58.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.957+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f112019d820 con 0x7f112010c010 2024-09-21T07:40:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.964+0000 7f111cc00640 1 -- 172.21.15.84:0/526440543 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v34)=0 v34) ==== 115+0+0 (secure 0 0 0) 0x7f112019d820 con 0x7f112010c010 2024-09-21T07:40:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.966+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11040b6550 msgr2=0x7f11040b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.966+0000 7f1127000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11040b6550 0x7f11040b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1110005ab0 tx=0x7f1110005a20 comp rx=0 tx=0).stop 2024-09-21T07:40:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.966+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f112010c010 msgr2=0x7f11201a1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:40:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.966+0000 7f1127000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f112010c010 0x7f11201a1f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1118009fd0 tx=0x7f111800ef10 comp rx=0 tx=0).stop 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 shutdown_connections 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11040b6550 0x7f11040b8a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f112010c010 0x7f11201a1f30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f112010b6c0 0x7f112019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 --2- 172.21.15.84:0/526440543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1120105d80 0x7f112019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 >> 172.21.15.84:0/526440543 conn(0x7f1120101810 msgr2=0x7f1120103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 shutdown_connections 2024-09-21T07:40:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:40:58.967+0000 7f1127000640 1 -- 172.21.15.84:0/526440543 wait complete. 2024-09-21T07:40:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/563363162' entity='client.admin' 2024-09-21T07:40:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:59.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:40:59.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:59.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:59.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:59.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:40:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/563363162' entity='client.admin' 2024-09-21T07:40:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:59.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:40:59.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:59.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:59.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:59.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:40:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/563363162' entity='client.admin' 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:40:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:40:59.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:59.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:59.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:59.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:40:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:00.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 -- 172.21.15.84:0/210830978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c1039b0 msgr2=0x7f020c103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 --2- 172.21.15.84:0/210830978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c1039b0 0x7f020c103dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009900 tx=0x7f01fc02a410 comp rx=0 tx=0).stop 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 -- 172.21.15.84:0/210830978 shutdown_connections 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 --2- 172.21.15.84:0/210830978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c109c40 0x7f020c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 --2- 172.21.15.84:0/210830978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020c1092f0 0x7f020c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 --2- 172.21.15.84:0/210830978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c1039b0 0x7f020c103dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 -- 172.21.15.84:0/210830978 >> 172.21.15.84:0/210830978 conn(0x7f020c0ff440 msgr2=0x7f020c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 -- 172.21.15.84:0/210830978 shutdown_connections 2024-09-21T07:41:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.772+0000 7f020be00640 1 -- 172.21.15.84:0/210830978 wait complete. 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.773+0000 7f020be00640 1 Processor -- start 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020be00640 1 -- start start 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020c1039b0 0x7f020c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c1092f0 0x7f020c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c109c40 0x7f020c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f020c113900 con 0x7f020c109c40 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f020c113780 con 0x7f020c1092f0 2024-09-21T07:41:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020be00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f020c113a80 con 0x7f020c1039b0 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c109c40 0x7f020c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c1092f0 0x7f020c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c109c40 0x7f020c19fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58752/0 (socket says 172.21.15.84:58752) 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020b400640 1 -- 172.21.15.84:0/1083042031 learned_addr learned my addr 172.21.15.84:0/1083042031 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c1092f0 0x7f020c19a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46862/0 (socket says 172.21.15.84:46862) 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.774+0000 7f020aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020c1039b0 0x7f020c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020aa00640 1 -- 172.21.15.84:0/1083042031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c1092f0 msgr2=0x7f020c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020aa00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c1092f0 0x7f020c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020aa00640 1 -- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c109c40 msgr2=0x7f020c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020aa00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c109c40 0x7f020c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020aa00640 1 -- 172.21.15.84:0/1083042031 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020c1a02a0 con 0x7f020c1039b0 2024-09-21T07:41:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020b400640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c109c40 0x7f020c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:41:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020a000640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c1092f0 0x7f020c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:41:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.775+0000 7f020aa00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020c1039b0 0x7f020c19a330 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f01fc02a930 tx=0x7f01fc031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.776+0000 7f0203400640 1 -- 172.21.15.84:0/1083042031 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc03f030 con 0x7f020c1039b0 2024-09-21T07:41:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.776+0000 7f0203400640 1 -- 172.21.15.84:0/1083042031 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01fc004490 con 0x7f020c1039b0 2024-09-21T07:41:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.776+0000 7f0203400640 1 -- 172.21.15.84:0/1083042031 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc035070 con 0x7f020c1039b0 2024-09-21T07:41:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.776+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020c1a0530 con 0x7f020c1039b0 2024-09-21T07:41:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.776+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020c1a6cf0 con 0x7f020c1039b0 2024-09-21T07:41:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.777+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020c103dc0 con 0x7f020c1039b0 2024-09-21T07:41:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.781+0000 7f0203400640 1 -- 172.21.15.84:0/1083042031 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f01fc042030 con 0x7f020c1039b0 2024-09-21T07:41:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.783+0000 7f0203400640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01f00b64d0 0x7f01f00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:00.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.783+0000 7f0203400640 1 -- 172.21.15.84:0/1083042031 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f01fc105fd0 con 0x7f020c1039b0 2024-09-21T07:41:00.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.783+0000 7f020a000640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01f00b64d0 0x7f01f00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:00.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.783+0000 7f0203400640 1 -- 172.21.15.84:0/1083042031 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01fc049030 con 0x7f020c1039b0 2024-09-21T07:41:00.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.784+0000 7f020a000640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01f00b64d0 0x7f01f00b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f020c108ef0 tx=0x7f01f8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.989+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f020c10ba10 con 0x7f020c1039b0 2024-09-21T07:41:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.996+0000 7f0203400640 1 -- 172.21.15.84:0/1083042031 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v35)=0 v35) ==== 129+0+0 (secure 0 0 0) 0x7f01fc0ce440 con 0x7f020c1039b0 2024-09-21T07:41:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01f00b64d0 msgr2=0x7f01f00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01f00b64d0 0x7f01f00b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f020c108ef0 tx=0x7f01f8005f90 comp rx=0 tx=0).stop 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020c1039b0 msgr2=0x7f020c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020c1039b0 0x7f020c19a330 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f01fc02a930 tx=0x7f01fc031a20 comp rx=0 tx=0).stop 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 shutdown_connections 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01f00b64d0 0x7f01f00b89e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020c109c40 0x7f020c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020c1092f0 0x7f020c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 --2- 172.21.15.84:0/1083042031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020c1039b0 0x7f020c19a330 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.998+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 >> 172.21.15.84:0/1083042031 conn(0x7f020c0ff440 msgr2=0x7f020c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.999+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 shutdown_connections 2024-09-21T07:41:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:00.999+0000 7f020be00640 1 -- 172.21.15.84:0/1083042031 wait complete. 2024-09-21T07:41:01.142 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:01 smithi084 ceph-mon[30411]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:01.142 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:01 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' 2024-09-21T07:41:01.142 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:01.142 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:01.142 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:01.142 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:01 smithi191 ceph-mon[34667]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:01 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' 2024-09-21T07:41:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:01 smithi162 ceph-mon[34833]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:01.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:01 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' 2024-09-21T07:41:01.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:01.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:01.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:01.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:03 smithi084 ceph-mon[30411]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1079179258' entity='client.admin' 2024-09-21T07:41:03.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:03 smithi191 ceph-mon[34667]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1079179258' entity='client.admin' 2024-09-21T07:41:03.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:03 smithi162 ceph-mon[34833]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1079179258' entity='client.admin' 2024-09-21T07:41:03.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 -- 172.21.15.84:0/1184055853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800109e00 msgr2=0x7f2800110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 --2- 172.21.15.84:0/1184055853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800109e00 0x7f2800110630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009ca0 tx=0x7f27f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 -- 172.21.15.84:0/1184055853 shutdown_connections 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 --2- 172.21.15.84:0/1184055853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800109e00 0x7f2800110630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 --2- 172.21.15.84:0/1184055853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28001094b0 0x7f28001098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 --2- 172.21.15.84:0/1184055853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2800103b70 0x7f2800103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 -- 172.21.15.84:0/1184055853 >> 172.21.15.84:0/1184055853 conn(0x7f28000ff5e0 msgr2=0x7f2800101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.893+0000 7f2807a00640 1 -- 172.21.15.84:0/1184055853 shutdown_connections 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.894+0000 7f2807a00640 1 -- 172.21.15.84:0/1184055853 wait complete. 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 Processor -- start 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 -- start start 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800103b70 0x7f280019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28001094b0 0x7f280019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:03.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2800109e00 0x7f280019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113ac0 con 0x7f2800103b70 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113940 con 0x7f2800109e00 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2807a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2800113c40 con 0x7f28001094b0 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2805000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800103b70 0x7f280019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2805000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800103b70 0x7f280019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58772/0 (socket says 172.21.15.84:58772) 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.895+0000 7f2805000640 1 -- 172.21.15.84:0/1079179258 learned_addr learned my addr 172.21.15.84:0/1079179258 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f27ffe00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28001094b0 0x7f280019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2800109e00 0x7f280019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805000640 1 -- 172.21.15.84:0/1079179258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28001094b0 msgr2=0x7f280019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805000640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28001094b0 0x7f280019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805000640 1 -- 172.21.15.84:0/1079179258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2800109e00 msgr2=0x7f280019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805000640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2800109e00 0x7f280019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805000640 1 -- 172.21.15.84:0/1079179258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28001a03e0 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2800109e00 0x7f280019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f2805000640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800103b70 0x7f280019a470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27f400e9f0 tx=0x7f27f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.896+0000 7f27fd600640 1 -- 172.21.15.84:0/1079179258 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f400cd80 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.897+0000 7f27fd600640 1 -- 172.21.15.84:0/1079179258 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27f40108e0 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.897+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28001a06d0 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.897+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001a6e30 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.897+0000 7f27fd600640 1 -- 172.21.15.84:0/1079179258 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4018980 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.898+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2800103f80 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.901+0000 7f27fd600640 1 -- 172.21.15.84:0/1079179258 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f27f4010430 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.902+0000 7f27fd600640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27e80b64d0 0x7f27e80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.902+0000 7f27fd600640 1 -- 172.21.15.84:0/1079179258 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f27f40e6050 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.902+0000 7f27ffe00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27e80b64d0 0x7f27e80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.903+0000 7f27ffe00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27e80b64d0 0x7f27e80b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2800102ce0 tx=0x7f27ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:01.904+0000 7f27fd600640 1 -- 172.21.15.84:0/1079179258 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27f40ae440 con 0x7f2800103b70 2024-09-21T07:41:03.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.097+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f280002e640 con 0x7f2800103b70 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.102+0000 7f27fd600640 1 -- 172.21.15.84:0/1079179258 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v36)=0 v36) ==== 116+0+0 (secure 0 0 0) 0x7f27f40b2820 con 0x7f2800103b70 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27e80b64d0 msgr2=0x7f27e80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27e80b64d0 0x7f27e80b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2800102ce0 tx=0x7f27ec005f90 comp rx=0 tx=0).stop 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800103b70 msgr2=0x7f280019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800103b70 0x7f280019a470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27f400e9f0 tx=0x7f27f400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 shutdown_connections 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27e80b64d0 0x7f27e80b89e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2800109e00 0x7f280019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28001094b0 0x7f280019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 --2- 172.21.15.84:0/1079179258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2800103b70 0x7f280019a470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 >> 172.21.15.84:0/1079179258 conn(0x7f28000ff5e0 msgr2=0x7f2800108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 shutdown_connections 2024-09-21T07:41:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:02.104+0000 7f2807a00640 1 -- 172.21.15.84:0/1079179258 wait complete. 2024-09-21T07:41:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 -- 172.21.15.84:0/2589047976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb90105320 msgr2=0x7fbb9010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 --2- 172.21.15.84:0/2589047976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb90105320 0x7fbb9010d870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009900 tx=0x7fbb8002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 -- 172.21.15.84:0/2589047976 shutdown_connections 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 --2- 172.21.15.84:0/2589047976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb9010de30 0x7fbb90110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 --2- 172.21.15.84:0/2589047976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb90105320 0x7fbb9010d870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 --2- 172.21.15.84:0/2589047976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb901049d0 0x7fbb90104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 -- 172.21.15.84:0/2589047976 >> 172.21.15.84:0/2589047976 conn(0x7fbb90079740 msgr2=0x7fbb90079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 -- 172.21.15.84:0/2589047976 shutdown_connections 2024-09-21T07:41:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.588+0000 7fbb98800640 1 -- 172.21.15.84:0/2589047976 wait complete. 2024-09-21T07:41:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.589+0000 7fbb98800640 1 Processor -- start 2024-09-21T07:41:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb98800640 1 -- start start 2024-09-21T07:41:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb98800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901049d0 0x7fbb9019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb98800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb90105320 0x7fbb9019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb98800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb9010de30 0x7fbb901a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb98800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90113a90 con 0x7fbb901049d0 2024-09-21T07:41:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb98800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90113910 con 0x7fbb9010de30 2024-09-21T07:41:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb98800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90113c10 con 0x7fbb90105320 2024-09-21T07:41:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb95e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901049d0 0x7fbb9019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb95e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901049d0 0x7fbb9019c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58798/0 (socket says 172.21.15.84:58798) 2024-09-21T07:41:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb95e00640 1 -- 172.21.15.84:0/1133496498 learned_addr learned my addr 172.21.15.84:0/1133496498 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:41:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb96800640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb9010de30 0x7fbb901a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.590+0000 7fbb95400640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb90105320 0x7fbb9019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb95e00640 1 -- 172.21.15.84:0/1133496498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb90105320 msgr2=0x7fbb9019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb95e00640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb90105320 0x7fbb9019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb95e00640 1 -- 172.21.15.84:0/1133496498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb9010de30 msgr2=0x7fbb901a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb95e00640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb9010de30 0x7fbb901a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb95e00640 1 -- 172.21.15.84:0/1133496498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb901a2690 con 0x7fbb901049d0 2024-09-21T07:41:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb95e00640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901049d0 0x7fbb9019c720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400e9c0 tx=0x7fbb8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb8aa00640 1 -- 172.21.15.84:0/1133496498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400cd80 con 0x7fbb901049d0 2024-09-21T07:41:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb8aa00640 1 -- 172.21.15.84:0/1133496498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb840035f0 con 0x7fbb901049d0 2024-09-21T07:41:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb901a2980 con 0x7fbb901049d0 2024-09-21T07:41:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.591+0000 7fbb8aa00640 1 -- 172.21.15.84:0/1133496498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84010690 con 0x7fbb901049d0 2024-09-21T07:41:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.592+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb901a90e0 con 0x7fbb901049d0 2024-09-21T07:41:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.593+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9006c240 con 0x7fbb901049d0 2024-09-21T07:41:04.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.595+0000 7fbb8aa00640 1 -- 172.21.15.84:0/1133496498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fbb84004000 con 0x7fbb901049d0 2024-09-21T07:41:04.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.596+0000 7fbb8aa00640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb780b6550 0x7fbb780b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:04.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.597+0000 7fbb8aa00640 1 -- 172.21.15.84:0/1133496498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbb840e5a60 con 0x7fbb901049d0 2024-09-21T07:41:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.597+0000 7fbb95400640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb780b6550 0x7fbb780b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.597+0000 7fbb95400640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb780b6550 0x7fbb780b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009230 tx=0x7fbb80031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.601+0000 7fbb8aa00640 1 -- 172.21.15.84:0/1133496498 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb840adef0 con 0x7fbb901049d0 2024-09-21T07:41:04.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.793+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fbb901a93c0 con 0x7fbb901049d0 2024-09-21T07:41:04.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.798+0000 7fbb8aa00640 1 -- 172.21.15.84:0/1133496498 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v37)=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7fbb840b22d0 con 0x7fbb901049d0 2024-09-21T07:41:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb780b6550 msgr2=0x7fbb780b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb780b6550 0x7fbb780b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009230 tx=0x7fbb80031400 comp rx=0 tx=0).stop 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901049d0 msgr2=0x7fbb9019c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901049d0 0x7fbb9019c720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400e9c0 tx=0x7fbb8400ee80 comp rx=0 tx=0).stop 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 shutdown_connections 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb780b6550 0x7fbb780b8a60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb9010de30 0x7fbb901a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb90105320 0x7fbb9019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 --2- 172.21.15.84:0/1133496498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901049d0 0x7fbb9019c720 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.801+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 >> 172.21.15.84:0/1133496498 conn(0x7fbb90079740 msgr2=0x7fbb90100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.802+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 shutdown_connections 2024-09-21T07:41:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:04.802+0000 7fbb98800640 1 -- 172.21.15.84:0/1133496498 wait complete. 2024-09-21T07:41:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:05 smithi084 ceph-mon[30411]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:05.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:05 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1133496498' entity='client.admin' 2024-09-21T07:41:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:05 smithi191 ceph-mon[34667]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:05 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1133496498' entity='client.admin' 2024-09-21T07:41:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:05 smithi162 ceph-mon[34833]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:05.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:05 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1133496498' entity='client.admin' 2024-09-21T07:41:05.645 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi084') 2024-09-21T07:41:05.645 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi084') 2024-09-21T07:41:05.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi084') 2024-09-21T07:41:05.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi084') 2024-09-21T07:41:05.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.076 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.076 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.076 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.076 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '56620f92-77ec-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T07:41:07.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T07:41:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:07 smithi084 ceph-mon[30411]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:07 smithi191 ceph-mon[34667]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:07.435 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:41:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:07 smithi162 ceph-mon[34833]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 -- 172.21.15.84:0/254531475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 msgr2=0x7fe784104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 --2- 172.21.15.84:0/254531475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe784104bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe774009900 tx=0x7fe77402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 -- 172.21.15.84:0/254531475 shutdown_connections 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 --2- 172.21.15.84:0/254531475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78410dc20 0x7fe784110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 --2- 172.21.15.84:0/254531475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe784105110 0x7fe78410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 --2- 172.21.15.84:0/254531475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe784104bd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 -- 172.21.15.84:0/254531475 >> 172.21.15.84:0/254531475 conn(0x7fe7840fe2c0 msgr2=0x7fe784100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 -- 172.21.15.84:0/254531475 shutdown_connections 2024-09-21T07:41:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.001+0000 7fe783e00640 1 -- 172.21.15.84:0/254531475 wait complete. 2024-09-21T07:41:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.002+0000 7fe783e00640 1 Processor -- start 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.002+0000 7fe783e00640 1 -- start start 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe783e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe78419c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe783e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe784105110 0x7fe78419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe783e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe78410dc20 0x7fe7841a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe783e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe7841138f0 con 0x7fe7841047c0 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe783e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe784113770 con 0x7fe784105110 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe783e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe784113a70 con 0x7fe78410dc20 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe782a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe78419c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe77a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe784105110 0x7fe78419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe782a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe78419c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48378/0 (socket says 172.21.15.84:48378) 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe782a00640 1 -- 172.21.15.84:0/1513246137 learned_addr learned my addr 172.21.15.84:0/1513246137 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe77a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe784105110 0x7fe78419caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48950/0 (socket says 172.21.15.84:48950) 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.003+0000 7fe783400640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe78410dc20 0x7fe7841a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe782a00640 1 -- 172.21.15.84:0/1513246137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe78410dc20 msgr2=0x7fe7841a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe782a00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe78410dc20 0x7fe7841a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe782a00640 1 -- 172.21.15.84:0/1513246137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe784105110 msgr2=0x7fe78419caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe782a00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe784105110 0x7fe78419caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe782a00640 1 -- 172.21.15.84:0/1513246137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7841a2470 con 0x7fe7841047c0 2024-09-21T07:41:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe782a00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe78419c500 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe774005ab0 tx=0x7fe774003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe788a00640 1 -- 172.21.15.84:0/1513246137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77403f070 con 0x7fe7841047c0 2024-09-21T07:41:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe788a00640 1 -- 172.21.15.84:0/1513246137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe774031d60 con 0x7fe7841047c0 2024-09-21T07:41:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe788a00640 1 -- 172.21.15.84:0/1513246137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774035030 con 0x7fe7841047c0 2024-09-21T07:41:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.004+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7841a2700 con 0x7fe7841047c0 2024-09-21T07:41:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.005+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7841a8ec0 con 0x7fe7841047c0 2024-09-21T07:41:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.006+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78406b560 con 0x7fe7841047c0 2024-09-21T07:41:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.008+0000 7fe788a00640 1 -- 172.21.15.84:0/1513246137 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fe774042070 con 0x7fe7841047c0 2024-09-21T07:41:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.009+0000 7fe788a00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7680b6550 0x7fe7680b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.010+0000 7fe788a00640 1 -- 172.21.15.84:0/1513246137 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe774106030 con 0x7fe7841047c0 2024-09-21T07:41:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.010+0000 7fe77a000640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7680b6550 0x7fe7680b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.010+0000 7fe77a000640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7680b6550 0x7fe7680b8a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe784101aa0 tx=0x7fe76c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.014+0000 7fe788a00640 1 -- 172.21.15.84:0/1513246137 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7740d2800 con 0x7fe7841047c0 2024-09-21T07:41:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.202+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe7841a90c0 con 0x7fe7841047c0 2024-09-21T07:41:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.203+0000 7fe788a00640 1 -- 172.21.15.84:0/1513246137 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+21924 (secure 0 0 0) 0x7fe7740d7740 con 0x7fe7841047c0 2024-09-21T07:41:08.205 INFO:teuthology.orchestra.run.smithi084.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:41:08.205 INFO:teuthology.orchestra.run.smithi084.stdout:global dev auth_debug true 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_file true 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_journald false 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_stderr false 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_allow_pool_delete true 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T07:41:08.206 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_bug true 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_old_message true 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_skipped_message false 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_mon 20/20 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_ms 1/1 2024-09-21T07:41:08.207 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_paxos 20/20 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T07:41:08.208 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_client 20/20 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T07:41:08.209 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bdev_debug_aio true 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_bluefs 20/20 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_bluestore 20/20 2024-09-21T07:41:08.210 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_ms 1/1 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_osd 20/20 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_op_order true 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_shutdown true 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T07:41:08.211 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds 20/20 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_ms 2/2 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T07:41:08.212 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_size 100 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_frag true 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_verify_scatter true 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced client_mount_timeout 600 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_client 20/20 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_ms 1/1 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:41:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:41:08.214 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T07:41:08.214 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T07:41:08.214 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T07:41:08.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7680b6550 msgr2=0x7fe7680b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:08.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7680b6550 0x7fe7680b8a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe784101aa0 tx=0x7fe76c00b390 comp rx=0 tx=0).stop 2024-09-21T07:41:08.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 msgr2=0x7fe78419c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe78419c500 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe774005ab0 tx=0x7fe774003cd0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 shutdown_connections 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7680b6550 0x7fe7680b8a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe78410dc20 0x7fe7841a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe784105110 0x7fe78419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 --2- 172.21.15.84:0/1513246137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7841047c0 0x7fe78419c500 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 >> 172.21.15.84:0/1513246137 conn(0x7fe7840fe2c0 msgr2=0x7fe784102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 shutdown_connections 2024-09-21T07:41:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:08.206+0000 7fe783e00640 1 -- 172.21.15.84:0/1513246137 wait complete. 2024-09-21T07:41:08.822 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T07:41:08.822 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:41:08.822 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:41:08.858 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:41:08.858 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-09-21T07:41:08.933 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:41:08.933 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:08.933 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-21T07:41:08.933 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:08.933 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:08.933 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 07:39:42.256899725 +0000 2024-09-21T07:41:08.934 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 07:35:05.160466877 +0000 2024-09-21T07:41:08.934 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 07:35:05.160466877 +0000 2024-09-21T07:41:08.934 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 07:35:05.160466877 +0000 2024-09-21T07:41:08.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:41:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T07:41:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T07:41:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000516706 s, 991 kB/s 2024-09-21T07:41:09.029 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:41:09.065 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-09-21T07:41:09.140 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 07:39:42.305898874 +0000 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 07:35:05.611458988 +0000 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 07:35:05.611458988 +0000 2024-09-21T07:41:09.141 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 07:35:05.611458988 +0000 2024-09-21T07:41:09.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:41:09.233 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T07:41:09.233 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T07:41:09.233 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000354097 s, 1.4 MB/s 2024-09-21T07:41:09.236 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:41:09.272 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-09-21T07:41:09.347 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:41:09.347 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:09.348 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-21T07:41:09.348 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:09.348 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:09.348 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 07:39:42.354898023 +0000 2024-09-21T07:41:09.348 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 07:35:06.068450994 +0000 2024-09-21T07:41:09.348 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 07:35:06.068450994 +0000 2024-09-21T07:41:09.348 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 07:35:06.068450994 +0000 2024-09-21T07:41:09.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:41:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:09 smithi191 ceph-mon[34667]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:09 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1513246137' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:41:09.434 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:09 smithi084 ceph-mon[30411]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:09.434 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:09 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1513246137' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:41:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T07:41:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T07:41:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000301527 s, 1.7 MB/s 2024-09-21T07:41:09.442 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:41:09.478 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-09-21T07:41:09.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:09 smithi162 ceph-mon[34833]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:09.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:09 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1513246137' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:41:09.553 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:41:09.553 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:09.553 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-21T07:41:09.553 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:09.554 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:09.554 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 07:39:42.406897120 +0000 2024-09-21T07:41:09.554 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 07:35:06.525443000 +0000 2024-09-21T07:41:09.554 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 07:35:06.525443000 +0000 2024-09-21T07:41:09.554 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 07:35:06.525443000 +0000 2024-09-21T07:41:09.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:41:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T07:41:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T07:41:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000539757 s, 949 kB/s 2024-09-21T07:41:09.648 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:41:09.684 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T07:41:09.684 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:41:09.704 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:41:09.704 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-21T07:41:09.763 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:41:09.763 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:09.763 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T07:41:09.763 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:09.763 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:09.764 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 07:40:41.716944763 +0000 2024-09-21T07:41:09.764 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 07:34:38.033275029 +0000 2024-09-21T07:41:09.764 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 07:34:38.033275029 +0000 2024-09-21T07:41:09.764 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 07:34:38.033275029 +0000 2024-09-21T07:41:09.764 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:41:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T07:41:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T07:41:09.834 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000256889 s, 2.0 MB/s 2024-09-21T07:41:09.836 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:41:09.896 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-21T07:41:09.954 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 07:40:41.716944763 +0000 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 07:34:38.370267859 +0000 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 07:34:38.370267859 +0000 2024-09-21T07:41:09.955 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 07:34:38.370267859 +0000 2024-09-21T07:41:09.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:41:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T07:41:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T07:41:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000207014 s, 2.5 MB/s 2024-09-21T07:41:10.022 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:41:10.080 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 07:40:41.717944742 +0000 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 07:34:38.676261348 +0000 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 07:34:38.676261348 +0000 2024-09-21T07:41:10.137 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 07:34:38.676261348 +0000 2024-09-21T07:41:10.138 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:41:10.202 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T07:41:10.202 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T07:41:10.202 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000190791 s, 2.7 MB/s 2024-09-21T07:41:10.204 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:41:10.262 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-21T07:41:10.317 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 07:40:41.717944742 +0000 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 07:34:39.001254432 +0000 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 07:34:39.001254432 +0000 2024-09-21T07:41:10.318 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 07:34:39.001254432 +0000 2024-09-21T07:41:10.318 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:41:10.382 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T07:41:10.382 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T07:41:10.382 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000198814 s, 2.6 MB/s 2024-09-21T07:41:10.383 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:41:10.439 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-21T07:41:10.439 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:41:10.457 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:41:10.457 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-09-21T07:41:10.512 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:41:10.512 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:10.512 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T07:41:10.513 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:10.513 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:10.513 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-21 07:40:39.401598377 +0000 2024-09-21T07:41:10.513 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-21 07:34:38.589825654 +0000 2024-09-21T07:41:10.513 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-21 07:34:38.589825654 +0000 2024-09-21T07:41:10.513 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-21 07:34:38.589825654 +0000 2024-09-21T07:41:10.513 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:41:10.578 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-21T07:41:10.578 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-21T07:41:10.579 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000252058 s, 2.0 MB/s 2024-09-21T07:41:10.580 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:41:10.636 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-09-21T07:41:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:41:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:10.693 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T07:41:10.693 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:10.693 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:10.693 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-21 07:40:39.401598377 +0000 2024-09-21T07:41:10.693 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-21 07:34:38.915819921 +0000 2024-09-21T07:41:10.693 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-21 07:34:38.915819921 +0000 2024-09-21T07:41:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-21 07:34:38.915819921 +0000 2024-09-21T07:41:10.693 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:41:10.755 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-21T07:41:10.755 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-21T07:41:10.756 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000193059 s, 2.7 MB/s 2024-09-21T07:41:10.757 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:41:10.813 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-09-21T07:41:10.868 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:41:10.868 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:10.868 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T07:41:10.868 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:10.868 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:10.869 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-21 07:40:39.402598360 +0000 2024-09-21T07:41:10.869 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-21 07:34:39.233814328 +0000 2024-09-21T07:41:10.869 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-21 07:34:39.233814328 +0000 2024-09-21T07:41:10.869 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-21 07:34:39.233814328 +0000 2024-09-21T07:41:10.869 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:41:10.932 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-21T07:41:10.932 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-21T07:41:10.932 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000211251 s, 2.4 MB/s 2024-09-21T07:41:10.933 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:41:10.989 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-09-21T07:41:11.044 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:41:11.044 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:41:11.044 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T07:41:11.044 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:41:11.045 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:41:11.045 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-21 07:40:39.402598360 +0000 2024-09-21T07:41:11.045 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-21 07:34:39.543808876 +0000 2024-09-21T07:41:11.045 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-21 07:34:39.543808876 +0000 2024-09-21T07:41:11.045 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-21 07:34:39.543808876 +0000 2024-09-21T07:41:11.045 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:41:11.108 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-21T07:41:11.108 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-21T07:41:11.108 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000191596 s, 2.7 MB/s 2024-09-21T07:41:11.109 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:41:11.166 INFO:tasks.cephadm:Deploying osd.0 on smithi084 with /dev/vg_nvme/lv_4... 2024-09-21T07:41:11.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:41:11.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:11 smithi191 ceph-mon[34667]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:11.424 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:11 smithi162 ceph-mon[34833]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:11.530 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:41:11.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:11 smithi084 ceph-mon[30411]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:13.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:13 smithi084 ceph-mon[30411]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:13 smithi191 ceph-mon[34667]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:13.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:13 smithi162 ceph-mon[34833]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:14.383 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:41:14.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-09-21T07:41:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:41:15.159 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:15 smithi084 ceph-mon[30411]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.332+0000 7f38e7600640 1 -- 172.21.15.84:0/2921257042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e0103b80 msgr2=0x7f38e0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.332+0000 7f38e7600640 1 --2- 172.21.15.84:0/2921257042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e0103b80 0x7f38e0103f90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009900 tx=0x7f38d402a410 comp rx=0 tx=0).stop 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.333+0000 7f38e7600640 1 -- 172.21.15.84:0/2921257042 shutdown_connections 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.333+0000 7f38e7600640 1 --2- 172.21.15.84:0/2921257042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38e0109e10 0x7f38e0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.333+0000 7f38e7600640 1 --2- 172.21.15.84:0/2921257042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38e01094c0 0x7f38e01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.333+0000 7f38e7600640 1 --2- 172.21.15.84:0/2921257042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e0103b80 0x7f38e0103f90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.333+0000 7f38e7600640 1 -- 172.21.15.84:0/2921257042 >> 172.21.15.84:0/2921257042 conn(0x7f38e00ff610 msgr2=0x7f38e0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.333+0000 7f38e7600640 1 -- 172.21.15.84:0/2921257042 shutdown_connections 2024-09-21T07:41:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.333+0000 7f38e7600640 1 -- 172.21.15.84:0/2921257042 wait complete. 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 Processor -- start 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 -- start start 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38e0103b80 0x7f38e019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e01094c0 0x7f38e019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38e0109e10 0x7f38e019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0113ad0 con 0x7f38e01094c0 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0113950 con 0x7f38e0109e10 2024-09-21T07:41:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.334+0000 7f38e7600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0113c50 con 0x7f38e0103b80 2024-09-21T07:41:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e01094c0 0x7f38e019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38e4c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38e0103b80 0x7f38e019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e01094c0 0x7f38e019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48404/0 (socket says 172.21.15.84:48404) 2024-09-21T07:41:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 -- 172.21.15.84:0/3547731302 learned_addr learned my addr 172.21.15.84:0/3547731302 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:41:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38e5600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38e0109e10 0x7f38e019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 -- 172.21.15.84:0/3547731302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38e0103b80 msgr2=0x7f38e019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38e0103b80 0x7f38e019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 -- 172.21.15.84:0/3547731302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38e0109e10 msgr2=0x7f38e019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38e0109e10 0x7f38e019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 -- 172.21.15.84:0/3547731302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e01a03f0 con 0x7f38e01094c0 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38e4c00640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38e0103b80 0x7f38e019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38e5600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38e0109e10 0x7f38e019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.335+0000 7f38dfe00640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e01094c0 0x7f38e019aa20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00e9f0 tx=0x7f38cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.336+0000 7f38dd600640 1 -- 172.21.15.84:0/3547731302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00ccc0 con 0x7f38e01094c0 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.336+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e01a06e0 con 0x7f38e01094c0 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.336+0000 7f38dd600640 1 -- 172.21.15.84:0/3547731302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38cc0108e0 con 0x7f38e01094c0 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.336+0000 7f38dd600640 1 -- 172.21.15.84:0/3547731302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc018860 con 0x7f38e01094c0 2024-09-21T07:41:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.336+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e01a6e40 con 0x7f38e01094c0 2024-09-21T07:41:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.337+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e0104e00 con 0x7f38e01094c0 2024-09-21T07:41:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.342+0000 7f38dd600640 1 -- 172.21.15.84:0/3547731302 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f38cc010430 con 0x7f38e01094c0 2024-09-21T07:41:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.343+0000 7f38dd600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38c80b64d0 0x7f38c80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.344+0000 7f38dd600640 1 -- 172.21.15.84:0/3547731302 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f38cc0e5f00 con 0x7f38e01094c0 2024-09-21T07:41:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.344+0000 7f38e4c00640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38c80b64d0 0x7f38c80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.344+0000 7f38e4c00640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38c80b64d0 0x7f38c80b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38d4031440 tx=0x7f38d4032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.345+0000 7f38dd600640 1 -- 172.21.15.84:0/3547731302 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38cc0b26d0 con 0x7f38e01094c0 2024-09-21T07:41:15.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:15 smithi191 ceph-mon[34667]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:15.541+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f38e0063800 con 0x7f38c80b64d0 2024-09-21T07:41:15.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:15 smithi162 ceph-mon[34833]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:16.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:41:16.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:41:16.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:16.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:41:16.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:41:16.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:16.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:41:16.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:41:16.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:17 smithi084 ceph-mon[30411]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:41:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:17 smithi084 ceph-mon[30411]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:17 smithi191 ceph-mon[34667]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:41:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:17 smithi191 ceph-mon[34667]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:17.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:17 smithi162 ceph-mon[34833]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:41:17.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:17 smithi162 ceph-mon[34833]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:18 smithi084 ceph-mon[30411]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:18 smithi191 ceph-mon[34667]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:18.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:18 smithi162 ceph-mon[34833]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:19 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/320309093' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6"} : dispatch 2024-09-21T07:41:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:19 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/320309093' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6"}]': finished 2024-09-21T07:41:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:19 smithi191 ceph-mon[34667]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:41:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:19 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/320309093' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6"} : dispatch 2024-09-21T07:41:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:19 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/320309093' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6"}]': finished 2024-09-21T07:41:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:19 smithi162 ceph-mon[34833]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:41:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:19 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/320309093' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6"} : dispatch 2024-09-21T07:41:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:19 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/320309093' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6"}]': finished 2024-09-21T07:41:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:19 smithi084 ceph-mon[30411]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:41:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:20 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3870012625' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:41:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:20 smithi191 ceph-mon[34667]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:20.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:20 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3870012625' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:41:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:20 smithi162 ceph-mon[34833]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:20.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:20 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3870012625' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:41:20.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:20 smithi084 ceph-mon[30411]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:23.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:22 smithi162 ceph-mon[34833]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:23.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:22 smithi084 ceph-mon[30411]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:23.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:22 smithi191 ceph-mon[34667]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:25.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:24 smithi162 ceph-mon[34833]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:25.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:24 smithi084 ceph-mon[30411]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:25.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:24 smithi191 ceph-mon[34667]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:27.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:26 smithi084 ceph-mon[30411]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:27.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:26 smithi162 ceph-mon[34833]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:27.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:26 smithi191 ceph-mon[34667]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:29.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:28 smithi084 ceph-mon[30411]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:29.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:41:29.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:29.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:28 smithi084 ceph-mon[30411]: Deploying daemon osd.0 on smithi084 2024-09-21T07:41:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:28 smithi162 ceph-mon[34833]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:41:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:28 smithi162 ceph-mon[34833]: Deploying daemon osd.0 on smithi084 2024-09-21T07:41:29.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:28 smithi191 ceph-mon[34667]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:29.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:41:29.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:29.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:28 smithi191 ceph-mon[34667]: Deploying daemon osd.0 on smithi084 2024-09-21T07:41:31.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:30 smithi084 ceph-mon[30411]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:31.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:30 smithi162 ceph-mon[34833]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:31.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:30 smithi191 ceph-mon[34667]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:33.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:32 smithi162 ceph-mon[34833]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:32 smithi084 ceph-mon[30411]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:32 smithi191 ceph-mon[34667]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:35.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:34 smithi162 ceph-mon[34833]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:35.304 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:34 smithi084 ceph-mon[30411]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:35.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:34 smithi191 ceph-mon[34667]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:37.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:36 smithi084 ceph-mon[30411]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:37.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:37.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:37.291 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:36 smithi162 ceph-mon[34833]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:36 smithi191 ceph-mon[34667]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:39.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:38 smithi084 ceph-mon[30411]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:38 smithi162 ceph-mon[34833]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:39.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:38 smithi191 ceph-mon[34667]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:41.091 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.091 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.091 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:40 smithi084 ceph-mon[30411]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:41.091 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:41.091 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:41.091 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:40 smithi162 ceph-mon[34833]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:41.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:41.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:41.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:40 smithi191 ceph-mon[34667]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.774+0000 7f38dd600640 1 -- 172.21.15.84:0/3547731302 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f38e0063800 con 0x7f38c80b64d0 2024-09-21T07:41:41.776 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 0 on host 'smithi084' 2024-09-21T07:41:41.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38c80b64d0 msgr2=0x7f38c80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38c80b64d0 0x7f38c80b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38d4031440 tx=0x7f38d4032ed0 comp rx=0 tx=0).stop 2024-09-21T07:41:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e01094c0 msgr2=0x7f38e019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e01094c0 0x7f38e019aa20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00e9f0 tx=0x7f38cc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:41:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 shutdown_connections 2024-09-21T07:41:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38c80b64d0 0x7f38c80b89e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38e0109e10 0x7f38e019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38e01094c0 0x7f38e019aa20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 --2- 172.21.15.84:0/3547731302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38e0103b80 0x7f38e019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 >> 172.21.15.84:0/3547731302 conn(0x7f38e00ff610 msgr2=0x7f38e0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 shutdown_connections 2024-09-21T07:41:41.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:41:41.777+0000 7f38e7600640 1 -- 172.21.15.84:0/3547731302 wait complete. 2024-09-21T07:41:42.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:42.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:42.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:42.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:42.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:42.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:42.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:42.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:42.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:42.486 DEBUG:teuthology.orchestra.run.smithi084:osd.0> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T07:41:42.490 INFO:tasks.cephadm:Deploying osd.1 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-21T07:41:42.491 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:41:42.745 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:41:43.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:42 smithi084 ceph-mon[30411]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:43.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:42 smithi191 ceph-mon[34667]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:43.157 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:42 smithi162 ceph-mon[34833]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:43.765 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:41:43 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0[47744]: 2024-09-21T07:41:43.340+0000 7fb1a0818640 -1 osd.0 0 log_to_monitors true 2024-09-21T07:41:44.041 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:43 smithi084 ceph-mon[30411]: from='osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:41:44.041 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:43 smithi084 ceph-mon[30411]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:41:44.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:43 smithi162 ceph-mon[34833]: from='osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:41:44.104 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:43 smithi162 ceph-mon[34833]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:41:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:43 smithi191 ceph-mon[34667]: from='osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:41:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:43 smithi191 ceph-mon[34667]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:41:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:44 smithi162 ceph-mon[34833]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:41:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:44 smithi162 ceph-mon[34833]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:41:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:44 smithi162 ceph-mon[34833]: from='osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:41:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:44 smithi162 ceph-mon[34833]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:41:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:44 smithi162 ceph-mon[34833]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:45.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:44 smithi191 ceph-mon[34667]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:41:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:44 smithi191 ceph-mon[34667]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:41:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:44 smithi191 ceph-mon[34667]: from='osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:41:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:44 smithi191 ceph-mon[34667]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:41:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:44 smithi191 ceph-mon[34667]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:45.204 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:41:45.229 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-21T07:41:45.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-mon[30411]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:41:45.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-mon[30411]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:41:45.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:45.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-mon[30411]: from='osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:41:45.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-mon[30411]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:41:45.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-mon[30411]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:41:45.263 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0[47744]: 2024-09-21T07:41:44.852+0000 7fb19b400640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:41:45.264 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:41:44 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0[47744]: 2024-09-21T07:41:44.856+0000 7fb196400640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:41:45.481 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 -- 172.21.15.162:0/3153223732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c4108cf0 msgr2=0x7f76c410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/3153223732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c4108cf0 0x7f76c410f520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009ca0 tx=0x7f76bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 -- 172.21.15.162:0/3153223732 shutdown_connections 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/3153223732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c4108cf0 0x7f76c410f520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/3153223732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c41083a0 0x7f76c41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/3153223732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4102a60 0x7f76c4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 -- 172.21.15.162:0/3153223732 >> 172.21.15.162:0/3153223732 conn(0x7f76c4079730 msgr2=0x7f76c4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 -- 172.21.15.162:0/3153223732 shutdown_connections 2024-09-21T07:41:45.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 -- 172.21.15.162:0/3153223732 wait complete. 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.934+0000 7f76cb8fe640 1 Processor -- start 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76cb8fe640 1 -- start start 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76cb8fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c4102a60 0x7f76c419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76cb8fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c41083a0 0x7f76c419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76cb8fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4108cf0 0x7f76c419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76cb8fe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76c4112960 con 0x7f76c4108cf0 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76cb8fe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76c41127e0 con 0x7f76c41083a0 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76cb8fe640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76c4112ae0 con 0x7f76c4102a60 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c41083a0 0x7f76c419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c41083a0 0x7f76c419b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58728/0 (socket says 172.21.15.162:58728) 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 -- 172.21.15.162:0/1702651486 learned_addr learned my addr 172.21.15.162:0/1702651486 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T07:41:45.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c969a640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c4102a60 0x7f76c419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c9e9b640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4108cf0 0x7f76c419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 -- 172.21.15.162:0/1702651486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c4102a60 msgr2=0x7f76c419b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c4102a60 0x7f76c419b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 -- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4108cf0 msgr2=0x7f76c419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4108cf0 0x7f76c419bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.935+0000 7f76c8e99640 1 -- 172.21.15.162:0/1702651486 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c41a6550 con 0x7f76c41083a0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.936+0000 7f76c8e99640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c41083a0 0x7f76c419b7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c970 tx=0x7f76b400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.936+0000 7f76ba7fc640 1 -- 172.21.15.162:0/1702651486 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4007bb0 con 0x7f76c41083a0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.936+0000 7f76ba7fc640 1 -- 172.21.15.162:0/1702651486 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76b4007d50 con 0x7f76c41083a0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.936+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c41a6840 con 0x7f76c41083a0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.936+0000 7f76ba7fc640 1 -- 172.21.15.162:0/1702651486 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4018730 con 0x7f76c41083a0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.936+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c41a6d30 con 0x7f76c41083a0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.937+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c4102e70 con 0x7f76c41083a0 2024-09-21T07:41:45.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.939+0000 7f76ba7fc640 1 -- 172.21.15.162:0/1702651486 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f76b400f990 con 0x7f76c41083a0 2024-09-21T07:41:45.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.939+0000 7f76ba7fc640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76b00b64d0 0x7f76b00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:41:45.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.939+0000 7f76ba7fc640 1 -- 172.21.15.162:0/1702651486 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1982+0+0 (secure 0 0 0) 0x7f76b40e5cf0 con 0x7f76c41083a0 2024-09-21T07:41:45.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.940+0000 7f76c969a640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76b00b64d0 0x7f76b00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:41:45.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.940+0000 7f76c969a640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76b00b64d0 0x7f76b00b89e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76c406b9e0 tx=0x7f76c000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:41:45.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:45.943+0000 7f76ba7fc640 1 -- 172.21.15.162:0/1702651486 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76b4014030 con 0x7f76c41083a0 2024-09-21T07:41:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:45 smithi084 ceph-mon[30411]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:41:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:45 smithi084 ceph-mon[30411]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:41:46.005 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:46.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:46.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:41:46.138+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f76c4063800 con 0x7f76b00b64d0 2024-09-21T07:41:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:45 smithi162 ceph-mon[34833]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:41:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:45 smithi162 ceph-mon[34833]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:41:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:46.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:45 smithi191 ceph-mon[34667]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:41:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:45 smithi191 ceph-mon[34667]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T07:41:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:41:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:41:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] boot 2024-09-21T07:41:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:41:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:47.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi084 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi084 to 17089M 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:41:47.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] boot 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi084 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi084 to 17089M 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:41:47.187 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: osd.0 [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] boot 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi084 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:41:47.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi084 to 17089M 2024-09-21T07:41:47.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:47.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:47.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:41:47.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:41:47.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:41:47.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:48.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:48 smithi191 ceph-mon[34667]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:41:48.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:48 smithi191 ceph-mon[34667]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:41:48.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:48 smithi162 ceph-mon[34833]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:41:48.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:48 smithi162 ceph-mon[34833]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:41:48.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:48 smithi084 ceph-mon[30411]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:41:48.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:48 smithi084 ceph-mon[30411]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T07:41:49.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:49 smithi162 ceph-mon[34833]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:49.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/2710206678' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"} : dispatch 2024-09-21T07:41:49.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:49 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"} : dispatch 2024-09-21T07:41:49.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:49 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"}]': finished 2024-09-21T07:41:49.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:49 smithi162 ceph-mon[34833]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:41:49.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:49 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:41:49.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/78886072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:41:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:49 smithi191 ceph-mon[34667]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/2710206678' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"} : dispatch 2024-09-21T07:41:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:49 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"} : dispatch 2024-09-21T07:41:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:49 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"}]': finished 2024-09-21T07:41:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:49 smithi191 ceph-mon[34667]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:41:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:49 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:41:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/78886072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:41:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:49 smithi084 ceph-mon[30411]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/2710206678' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"} : dispatch 2024-09-21T07:41:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:49 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"} : dispatch 2024-09-21T07:41:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:49 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f441b5fe-ade0-49aa-946a-a46da421c736"}]': finished 2024-09-21T07:41:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:49 smithi084 ceph-mon[30411]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:41:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:49 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:41:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/78886072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:41:51.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:51 smithi191 ceph-mon[34667]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:51.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:51 smithi162 ceph-mon[34833]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:51.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:51 smithi084 ceph-mon[30411]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:53.167 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:53 smithi162 ceph-mon[34833]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:53 smithi191 ceph-mon[34667]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:53.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:53 smithi084 ceph-mon[30411]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:55 smithi162 ceph-mon[34833]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:55.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:55 smithi191 ceph-mon[34667]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:55.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:55 smithi084 ceph-mon[30411]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:56.391 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:41:56.391 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:56.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:41:56.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:56.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:41:56.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:57.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:57 smithi162 ceph-mon[34833]: Deploying daemon osd.1 on smithi162 2024-09-21T07:41:57.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:57 smithi162 ceph-mon[34833]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:57.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:57 smithi191 ceph-mon[34667]: Deploying daemon osd.1 on smithi162 2024-09-21T07:41:57.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:57 smithi191 ceph-mon[34667]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:57.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:57 smithi084 ceph-mon[30411]: Deploying daemon osd.1 on smithi162 2024-09-21T07:41:57.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:57 smithi084 ceph-mon[30411]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:59.214 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:41:59 smithi162 ceph-mon[34833]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:59.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:41:59 smithi191 ceph-mon[34667]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:41:59.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:41:59 smithi084 ceph-mon[30411]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:00.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:00 smithi191 ceph-mon[34667]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:00.458 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:00 smithi084 ceph-mon[30411]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:00.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:00 smithi162 ceph-mon[34833]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:03.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:02 smithi162 ceph-mon[34833]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:03.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:02 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:03.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:02 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:03.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:02 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:02 smithi084 ceph-mon[30411]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:02 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:02 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:02 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:02 smithi191 ceph-mon[34667]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:02 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:02 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:02 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:04 smithi162 ceph-mon[34833]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:04 smithi084 ceph-mon[30411]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:05.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:05.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:04 smithi191 ceph-mon[34667]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:06.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.018+0000 7f76ba7fc640 1 -- 172.21.15.162:0/1702651486 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f76c4063800 con 0x7f76b00b64d0 2024-09-21T07:42:06.021 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 1 on host 'smithi162' 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76b00b64d0 msgr2=0x7f76b00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76b00b64d0 0x7f76b00b89e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76c406b9e0 tx=0x7f76c000b390 comp rx=0 tx=0).stop 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c41083a0 msgr2=0x7f76c419b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c41083a0 0x7f76c419b7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c970 tx=0x7f76b400ce30 comp rx=0 tx=0).stop 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 shutdown_connections 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76b00b64d0 0x7f76b00b89e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4108cf0 0x7f76c419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c41083a0 0x7f76c419b7d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 --2- 172.21.15.162:0/1702651486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c4102a60 0x7f76c419b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:06.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.020+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 >> 172.21.15.162:0/1702651486 conn(0x7f76c4079730 msgr2=0x7f76c4104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:42:06.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.021+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 shutdown_connections 2024-09-21T07:42:06.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:42:06.021+0000 7f76cb8fe640 1 -- 172.21.15.162:0/1702651486 wait complete. 2024-09-21T07:42:06.597 DEBUG:teuthology.orchestra.run.smithi162:osd.1> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T07:42:06.599 INFO:tasks.cephadm:Deploying osd.2 on smithi191 with /dev/vg_nvme/lv_4... 2024-09-21T07:42:06.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:42:06.849 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:42:07.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:06 smithi191 ceph-mon[34667]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:07.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:07.209 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:07.210 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:07.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:06 smithi162 ceph-mon[34833]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:06 smithi084 ceph-mon[30411]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:08.302 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1[39591]: 2024-09-21T07:42:08.117+0000 7ff0edcb0640 -1 osd.1 0 log_to_monitors true 2024-09-21T07:42:09.253 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:08 smithi162 ceph-mon[34833]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:09.253 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:08 smithi162 ceph-mon[34833]: from='osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:42:09.253 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:08 smithi162 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:42:09.262 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:08 smithi191 ceph-mon[34667]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:09.262 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:08 smithi191 ceph-mon[34667]: from='osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:42:09.262 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:08 smithi191 ceph-mon[34667]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:42:09.265 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:42:09.292 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2024-09-21T07:42:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:08 smithi084 ceph-mon[30411]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:08 smithi084 ceph-mon[30411]: from='osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:42:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:08 smithi084 ceph-mon[30411]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:42:09.542 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:42:09.997 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.993+0000 7fa96793d640 1 -- 172.21.15.191:0/1796930655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 msgr2=0x7fa960110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:09.997 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.993+0000 7fa96793d640 1 --2- 172.21.15.191:0/1796930655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa960110630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa958009ca0 tx=0x7fa95802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:42:09.997 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.993+0000 7fa96793d640 1 -- 172.21.15.191:0/1796930655 shutdown_connections 2024-09-21T07:42:09.997 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.993+0000 7fa96793d640 1 --2- 172.21.15.191:0/1796930655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa960110630 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:09.997 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.993+0000 7fa96793d640 1 --2- 172.21.15.191:0/1796930655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9601094b0 0x7fa9601098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.993+0000 7fa96793d640 1 --2- 172.21.15.191:0/1796930655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103bc0 0x7fa960103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.993+0000 7fa96793d640 1 -- 172.21.15.191:0/1796930655 >> 172.21.15.191:0/1796930655 conn(0x7fa96007b910 msgr2=0x7fa96007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.994+0000 7fa96793d640 1 -- 172.21.15.191:0/1796930655 shutdown_connections 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.994+0000 7fa96793d640 1 -- 172.21.15.191:0/1796930655 wait complete. 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.994+0000 7fa96793d640 1 Processor -- start 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.994+0000 7fa96793d640 1 -- start start 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa96793d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa960103bc0 0x7fa96019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa96793d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9601094b0 0x7fa96019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa96793d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa96019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa96793d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa960113ac0 con 0x7fa9601094b0 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa96793d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa960113940 con 0x7fa960103bc0 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa96793d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa960113c40 con 0x7fa960109e00 2024-09-21T07:42:09.998 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa965eda640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa96019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa965eda640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa96019fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:37376/0 (socket says 172.21.15.191:37376) 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa9656d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa960103bc0 0x7fa96019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa965eda640 1 -- 172.21.15.191:0/1479586865 learned_addr learned my addr 172.21.15.191:0/1479586865 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa964ed8640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9601094b0 0x7fa96019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa9656d9640 1 -- 172.21.15.191:0/1479586865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 msgr2=0x7fa96019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa9656d9640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa96019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa9656d9640 1 -- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9601094b0 msgr2=0x7fa96019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa9656d9640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9601094b0 0x7fa96019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa9656d9640 1 -- 172.21.15.191:0/1479586865 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9601a03e0 con 0x7fa960103bc0 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa965eda640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa96019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa964ed8640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9601094b0 0x7fa96019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.995+0000 7fa9656d9640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa960103bc0 0x7fa96019a470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00c970 tx=0x7fa95c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.996+0000 7fa9567fc640 1 -- 172.21.15.191:0/1479586865 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c007bb0 con 0x7fa960103bc0 2024-09-21T07:42:09.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.996+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9601a06d0 con 0x7fa960103bc0 2024-09-21T07:42:10.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.996+0000 7fa9567fc640 1 -- 172.21.15.191:0/1479586865 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa95c007d50 con 0x7fa960103bc0 2024-09-21T07:42:10.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.996+0000 7fa9567fc640 1 -- 172.21.15.191:0/1479586865 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c004da0 con 0x7fa960103bc0 2024-09-21T07:42:10.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.996+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9601a6e30 con 0x7fa960103bc0 2024-09-21T07:42:10.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:09.997+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa960103fd0 con 0x7fa960103bc0 2024-09-21T07:42:10.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:10.000+0000 7fa9567fc640 1 -- 172.21.15.191:0/1479586865 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fa95c004fe0 con 0x7fa960103bc0 2024-09-21T07:42:10.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:10.000+0000 7fa9567fc640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa94c0b6550 0x7fa94c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:10.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:10.001+0000 7fa9567fc640 1 -- 172.21.15.191:0/1479586865 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7fa95c0e5bd0 con 0x7fa960103bc0 2024-09-21T07:42:10.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:10.001+0000 7fa964ed8640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa94c0b6550 0x7fa94c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:10.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:10.002+0000 7fa964ed8640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa94c0b6550 0x7fa94c0b8a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa950005fd0 tx=0x7fa9500094d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:42:10.007 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:10.005+0000 7fa9567fc640 1 -- 172.21.15.191:0/1479586865 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa95c014030 con 0x7fa960103bc0 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:10.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.202 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:10.201+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa960063800 con 0x7fa94c0b6550 2024-09-21T07:42:10.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:10.969 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1[39591]: 2024-09-21T07:42:10.709+0000 7ff0e9c32640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:42:10.969 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1[39591]: 2024-09-21T07:42:10.716+0000 7ff0e1a28640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi162 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:10 smithi191 ceph-mon[34667]: from='osd.1 ' entity='osd.1' 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi162 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:42:11.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:42:11.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:11.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:10 smithi162 ceph-mon[34833]: from='osd.1 ' entity='osd.1' 2024-09-21T07:42:11.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi162 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:10 smithi084 ceph-mon[30411]: from='osd.1 ' entity='osd.1' 2024-09-21T07:42:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:11 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:42:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:11 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:42:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:11 smithi191 ceph-mon[34667]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:42:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:11 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:11 smithi191 ceph-mon[34667]: osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] boot 2024-09-21T07:42:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:11 smithi191 ceph-mon[34667]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:42:12.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:11 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:12.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:11 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:42:12.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:11 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:42:12.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:11 smithi162 ceph-mon[34833]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:42:12.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:11 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:12.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:11 smithi162 ceph-mon[34833]: osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] boot 2024-09-21T07:42:12.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:11 smithi162 ceph-mon[34833]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:42:12.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:11 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:12.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:11 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:42:12.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:11 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:42:12.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:11 smithi084 ceph-mon[30411]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:42:12.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:11 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:12.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:11 smithi084 ceph-mon[30411]: osd.1 [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] boot 2024-09-21T07:42:12.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:11 smithi084 ceph-mon[30411]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:42:12.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:11 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:42:13.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:12 smithi191 ceph-mon[34667]: pgmap v53: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:13.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:12 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/2521188096' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"} : dispatch 2024-09-21T07:42:13.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:12 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"} : dispatch 2024-09-21T07:42:13.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:12 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"}]': finished 2024-09-21T07:42:13.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:12 smithi191 ceph-mon[34667]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:42:13.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:13.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:12 smithi162 ceph-mon[34833]: pgmap v53: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:13.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:12 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/2521188096' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"} : dispatch 2024-09-21T07:42:13.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:12 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"} : dispatch 2024-09-21T07:42:13.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:12 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"}]': finished 2024-09-21T07:42:13.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:12 smithi162 ceph-mon[34833]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:42:13.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:13.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:12 smithi084 ceph-mon[30411]: pgmap v53: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:42:13.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:12 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/2521188096' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"} : dispatch 2024-09-21T07:42:13.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:12 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"} : dispatch 2024-09-21T07:42:13.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:12 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "247eb882-3ff7-474e-9367-aaadc4e26a59"}]': finished 2024-09-21T07:42:13.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:12 smithi084 ceph-mon[30411]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:42:13.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:14.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/915775264' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:42:14.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:13 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/915775264' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:42:14.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:13 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/915775264' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:42:15.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:14 smithi162 ceph-mon[34833]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:15.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:14 smithi084 ceph-mon[30411]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:15.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:14 smithi191 ceph-mon[34667]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:16 smithi162 ceph-mon[34833]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:16 smithi084 ceph-mon[30411]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:17.390 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:16 smithi191 ceph-mon[34667]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:19.066 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:18 smithi191 ceph-mon[34667]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:19.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:18 smithi162 ceph-mon[34833]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:18 smithi084 ceph-mon[30411]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:21.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:20 smithi162 ceph-mon[34833]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:21.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:42:21.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:21.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:20 smithi084 ceph-mon[30411]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:21.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:42:21.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:21.320 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:20 smithi191 ceph-mon[34667]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:21.320 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:42:21.321 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:22.124 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:22 smithi191 ceph-mon[34667]: Deploying daemon osd.2 on smithi191 2024-09-21T07:42:22.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:22 smithi162 ceph-mon[34833]: Deploying daemon osd.2 on smithi191 2024-09-21T07:42:22.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:22 smithi084 ceph-mon[30411]: Deploying daemon osd.2 on smithi191 2024-09-21T07:42:23.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:23 smithi162 ceph-mon[34833]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:23.306 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:23 smithi191 ceph-mon[34667]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:23.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:23 smithi084 ceph-mon[30411]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:25.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:25 smithi162 ceph-mon[34833]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:25.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:25 smithi084 ceph-mon[30411]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:25 smithi191 ceph-mon[34667]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:27.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:27 smithi162 ceph-mon[34833]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:27.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:27 smithi084 ceph-mon[30411]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:27.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:27 smithi191 ceph-mon[34667]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:28.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:28.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:28.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:28.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:28.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:28.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:28.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:28.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:28.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:29.297 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:29 smithi191 ceph-mon[34667]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:29.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:29 smithi162 ceph-mon[34833]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:29.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:29 smithi084 ceph-mon[30411]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:30 smithi191 ceph-mon[34667]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:30.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:30.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:30.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:30 smithi162 ceph-mon[34833]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:30.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:30 smithi084 ceph-mon[30411]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:31.205 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.203+0000 7fa9567fc640 1 -- 172.21.15.191:0/1479586865 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa960063800 con 0x7fa94c0b6550 2024-09-21T07:42:31.205 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 2 on host 'smithi191' 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa94c0b6550 msgr2=0x7fa94c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa94c0b6550 0x7fa94c0b8a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa950005fd0 tx=0x7fa9500094d0 comp rx=0 tx=0).stop 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa960103bc0 msgr2=0x7fa96019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa960103bc0 0x7fa96019a470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00c970 tx=0x7fa95c00ce30 comp rx=0 tx=0).stop 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 shutdown_connections 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa94c0b6550 0x7fa94c0b8a60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa960109e00 0x7fa96019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9601094b0 0x7fa96019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 --2- 172.21.15.191:0/1479586865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa960103bc0 0x7fa96019a470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:31.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 >> 172.21.15.191:0/1479586865 conn(0x7fa96007b910 msgr2=0x7fa960107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:42:31.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 shutdown_connections 2024-09-21T07:42:31.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:42:31.206+0000 7fa96793d640 1 -- 172.21.15.191:0/1479586865 wait complete. 2024-09-21T07:42:31.563 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:31.563 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:31.563 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:31.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:31.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:31.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:31.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:31.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:31.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:31.866 DEBUG:teuthology.orchestra.run.smithi191:osd.2> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T07:42:31.868 INFO:tasks.cephadm:Deploying osd.3 on smithi084 with /dev/vg_nvme/lv_3... 2024-09-21T07:42:31.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:42:32.239 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:42:32.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:32 smithi191 ceph-mon[34667]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:32.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:32 smithi084 ceph-mon[30411]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:32.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:32 smithi162 ceph-mon[34833]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:33.237 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2[39798]: 2024-09-21T07:42:33.029+0000 7f4652013640 -1 osd.2 0 log_to_monitors true 2024-09-21T07:42:33.397 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:33 smithi084 ceph-mon[30411]: from='osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:42:33.397 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:33 smithi084 ceph-mon[30411]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:42:33.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:33 smithi191 ceph-mon[34667]: from='osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:42:33.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:33 smithi191 ceph-mon[34667]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:42:33.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:33 smithi162 ceph-mon[34833]: from='osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:42:33.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:33 smithi162 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:42:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:34 smithi191 ceph-mon[34667]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:42:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:34 smithi191 ceph-mon[34667]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:42:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:34 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:34 smithi191 ceph-mon[34667]: from='osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:42:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:34 smithi191 ceph-mon[34667]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:42:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:34 smithi191 ceph-mon[34667]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:34 smithi162 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:42:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:34 smithi162 ceph-mon[34833]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:42:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:34 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:34 smithi162 ceph-mon[34833]: from='osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:42:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:34 smithi162 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:42:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:34 smithi162 ceph-mon[34833]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:34 smithi084 ceph-mon[30411]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:42:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:34 smithi084 ceph-mon[30411]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:42:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:34 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:34 smithi084 ceph-mon[30411]: from='osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:42:34.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:34 smithi084 ceph-mon[30411]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:42:34.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:34 smithi084 ceph-mon[30411]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:35.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:42:35.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-09-21T07:42:35.382 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2[39798]: 2024-09-21T07:42:35.070+0000 7f464df95640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:42:35.382 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2[39798]: 2024-09-21T07:42:35.075+0000 7f4645d8b640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi191 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi191 to 17088M 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:35.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:35 smithi084 ceph-mon[30411]: from='osd.2 ' entity='osd.2' 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi191 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:35.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi191 to 17088M 2024-09-21T07:42:35.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:35.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:35.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:35 smithi191 ceph-mon[34667]: from='osd.2 ' entity='osd.2' 2024-09-21T07:42:35.747 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi191 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi191 to 17088M 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:35.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:35.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:35 smithi162 ceph-mon[34833]: from='osd.2 ' entity='osd.2' 2024-09-21T07:42:36.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 -- 172.21.15.84:0/1976421040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 msgr2=0x7faca41098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:36.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 --2- 172.21.15.84:0/1976421040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 0x7faca41098d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009860 tx=0x7fac8c02a340 comp rx=0 tx=0).stop 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 -- 172.21.15.84:0/1976421040 shutdown_connections 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 --2- 172.21.15.84:0/1976421040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4109e10 0x7faca4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 --2- 172.21.15.84:0/1976421040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 0x7faca41098d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 --2- 172.21.15.84:0/1976421040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4103b80 0x7faca4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 -- 172.21.15.84:0/1976421040 >> 172.21.15.84:0/1976421040 conn(0x7faca40ff5d0 msgr2=0x7faca4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 -- 172.21.15.84:0/1976421040 shutdown_connections 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.366+0000 7facaac00640 1 -- 172.21.15.84:0/1976421040 wait complete. 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.368+0000 7facaac00640 1 Processor -- start 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.368+0000 7facaac00640 1 -- start start 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.368+0000 7facaac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4103b80 0x7faca419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.368+0000 7facaac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 0x7faca419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.368+0000 7facaac00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4109e10 0x7faca419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7facaac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faca4113ad0 con 0x7faca4103b80 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7facaac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faca4113950 con 0x7faca41094c0 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7facaac00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faca4113c50 con 0x7faca4109e10 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4103b80 0x7faca419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4103b80 0x7faca419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45464/0 (socket says 172.21.15.84:45464) 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 -- 172.21.15.84:0/356889092 learned_addr learned my addr 172.21.15.84:0/356889092 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca8c00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4109e10 0x7faca419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7fac9b400640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 0x7faca419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 -- 172.21.15.84:0/356889092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4109e10 msgr2=0x7faca419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4109e10 0x7faca419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 -- 172.21.15.84:0/356889092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 msgr2=0x7faca419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 0x7faca419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.369+0000 7faca3e00640 1 -- 172.21.15.84:0/356889092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca41a0430 con 0x7faca4103b80 2024-09-21T07:42:36.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.370+0000 7faca3e00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4103b80 0x7faca419a4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac9400e9f0 tx=0x7fac9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.370+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9400cd80 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.370+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca41a0720 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.370+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac940108e0 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.370+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94018980 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.370+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca41a6e80 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.371+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca4103f90 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.376+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fac94010430 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.377+0000 7faca1600640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fac880b6550 0x7fac880b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:42:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.378+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3066+0+0 (secure 0 0 0) 0x7fac940e6620 con 0x7faca4103b80 2024-09-21T07:42:36.412 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:42:36.412 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:42:36.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:36.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:36.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] boot 2024-09-21T07:42:36.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:42:36.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:36.413 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:42:36.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.378+0000 7fac9b400640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fac880b6550 0x7fac880b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:42:36.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.378+0000 7fac9b400640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fac880b6550 0x7fac880b8a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac8c035040 tx=0x7fac8c030340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:42:36.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.380+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac940b2750 con 0x7faca4103b80 2024-09-21T07:42:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:36.581+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faca4063800 con 0x7fac880b6550 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] boot 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: osd.2 [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] boot 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:42:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:42:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:37 smithi191 ceph-mon[34667]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:42:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:42:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:42:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:42:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:37 smithi191 ceph-mon[34667]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:42:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:37 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:42:37.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:37 smithi162 ceph-mon[34833]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:42:37.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:42:37.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:42:37.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:37.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:42:37.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:37 smithi162 ceph-mon[34833]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:42:37.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:37 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:42:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:37 smithi084 ceph-mon[30411]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:42:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:42:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:42:37.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:37.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:42:37.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:37 smithi084 ceph-mon[30411]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:42:37.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:37 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:42:38.863 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52270]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:42:38.864 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52270]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:38.864 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:38.864 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52270]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:38.864 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52274]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:42:38.864 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52274]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:38.864 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:38.864 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52274]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43267]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43267]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43267]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43270]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43270]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:38.977 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43270]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.082 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43736]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:42:39.083 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43736]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.083 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.083 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43736]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.083 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43739]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:42:39.083 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43739]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.083 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.083 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43739]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.083 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43730]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:42:39.083 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43730]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.083 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.084 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43730]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.084 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43733]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:42:39.084 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43733]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.084 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.084 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 07:42:38 smithi191 sudo[43733]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.208 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52282]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52282]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52282]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52285]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52285]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:38 smithi084 sudo[52285]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:42:39.209 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:39 smithi084 ceph-mon[30411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43273]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43273]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:38 smithi162 sudo[43273]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 sudo[43276]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 sudo[43276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 sudo[43276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 sudo[43276]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:42:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.304 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:39 smithi162 ceph-mon[34833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.336 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:39.336 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:42:39.336 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:39.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:42:39.338 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:42:39.338 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:42:39.338 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:42:39.338 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:39 smithi191 ceph-mon[34667]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:42:40.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:40 smithi084 ceph-mon[30411]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:42:40.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:40 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2918902360' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b309008a-7e80-4b28-bfa7-9ae80c749072"} : dispatch 2024-09-21T07:42:40.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:40 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2918902360' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b309008a-7e80-4b28-bfa7-9ae80c749072"}]': finished 2024-09-21T07:42:40.400 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:40 smithi084 ceph-mon[30411]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:42:40.401 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:42:40.401 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:40 smithi084 ceph-mon[30411]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:40.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:40 smithi191 ceph-mon[34667]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:42:40.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:40 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2918902360' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b309008a-7e80-4b28-bfa7-9ae80c749072"} : dispatch 2024-09-21T07:42:40.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:40 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2918902360' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b309008a-7e80-4b28-bfa7-9ae80c749072"}]': finished 2024-09-21T07:42:40.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:40 smithi191 ceph-mon[34667]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:42:40.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:42:40.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:40 smithi191 ceph-mon[34667]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:40 smithi162 ceph-mon[34833]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T07:42:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:40 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2918902360' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b309008a-7e80-4b28-bfa7-9ae80c749072"} : dispatch 2024-09-21T07:42:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:40 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2918902360' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b309008a-7e80-4b28-bfa7-9ae80c749072"}]': finished 2024-09-21T07:42:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:40 smithi162 ceph-mon[34833]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:42:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:42:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:40 smithi162 ceph-mon[34833]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:42:40.842+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fac940a9f90 con 0x7faca4103b80 2024-09-21T07:42:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:41 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/150574076' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:42:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:41 smithi191 ceph-mon[34667]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T07:42:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:41 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/150574076' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:42:41.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:41 smithi162 ceph-mon[34833]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T07:42:41.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:41 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/150574076' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:42:41.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:41 smithi084 ceph-mon[30411]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T07:42:42.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:42 smithi162 ceph-mon[34833]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:42.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:42 smithi084 ceph-mon[30411]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:42.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:42 smithi191 ceph-mon[34667]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:45.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:44 smithi162 ceph-mon[34833]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:45.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:44 smithi084 ceph-mon[30411]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:45.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:44 smithi191 ceph-mon[34667]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:47.210 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:46 smithi084 ceph-mon[30411]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:47.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:46 smithi162 ceph-mon[34833]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:47.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:46 smithi191 ceph-mon[34667]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:49.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:48 smithi162 ceph-mon[34833]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:49.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:48 smithi084 ceph-mon[30411]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:49.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:48 smithi191 ceph-mon[34667]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:50.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:49 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:42:50.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:49 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:50.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:49 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:42:50.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:49 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:50.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:49 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:42:50.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:49 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:51.134 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:50 smithi084 ceph-mon[30411]: Deploying daemon osd.3 on smithi084 2024-09-21T07:42:51.134 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:50 smithi084 ceph-mon[30411]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:51.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:50 smithi162 ceph-mon[34833]: Deploying daemon osd.3 on smithi084 2024-09-21T07:42:51.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:50 smithi162 ceph-mon[34833]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:51.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:50 smithi191 ceph-mon[34667]: Deploying daemon osd.3 on smithi084 2024-09-21T07:42:51.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:50 smithi191 ceph-mon[34667]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:53.185 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:52 smithi084 ceph-mon[30411]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:53.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:52 smithi162 ceph-mon[34833]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:53.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:52 smithi191 ceph-mon[34667]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:55.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:54 smithi162 ceph-mon[34833]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:54 smithi084 ceph-mon[30411]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:55.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:54 smithi191 ceph-mon[34667]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:57.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:56 smithi162 ceph-mon[34833]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:57.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:56 smithi084 ceph-mon[30411]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:57.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:56 smithi191 ceph-mon[34667]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:58.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:58.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:58.295 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:58.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:58.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:58.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:58.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:58.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:42:59.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:42:58 smithi162 ceph-mon[34833]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:42:58 smithi084 ceph-mon[30411]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:42:59.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:42:58 smithi191 ceph-mon[34667]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:01.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:00 smithi162 ceph-mon[34833]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:01.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:00 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:01.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:00 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:01.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:00 smithi084 ceph-mon[30411]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:01.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:00 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:01.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:00 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:00 smithi191 ceph-mon[34667]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:00 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:00 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:02.234 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:02.234 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:02.235 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:02.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:02.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:02.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:02.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:02.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:02.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.073+0000 7faca1600640 1 -- 172.21.15.84:0/356889092 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faca4063800 con 0x7fac880b6550 2024-09-21T07:43:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 3 on host 'smithi084' 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fac880b6550 msgr2=0x7fac880b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fac880b6550 0x7fac880b8a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac8c035040 tx=0x7fac8c030340 comp rx=0 tx=0).stop 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4103b80 msgr2=0x7faca419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4103b80 0x7faca419a4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac9400e9f0 tx=0x7fac9400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 shutdown_connections 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fac880b6550 0x7fac880b8a60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4109e10 0x7faca419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faca41094c0 0x7faca419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:03.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 --2- 172.21.15.84:0/356889092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca4103b80 0x7faca419a4c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:03.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 >> 172.21.15.84:0/356889092 conn(0x7faca40ff5d0 msgr2=0x7faca41019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:43:03.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 shutdown_connections 2024-09-21T07:43:03.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:03.076+0000 7facaac00640 1 -- 172.21.15.84:0/356889092 wait complete. 2024-09-21T07:43:03.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:02 smithi162 ceph-mon[34833]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:02 smithi084 ceph-mon[30411]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:03.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:02 smithi191 ceph-mon[34667]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:03.805 DEBUG:teuthology.orchestra.run.smithi084:osd.3> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T07:43:03.809 INFO:tasks.cephadm:Deploying osd.4 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-21T07:43:03.809 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:43:04.039 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:04.039 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:04.039 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:04.039 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 07:43:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T07:43:04.006+0000 7f69d3235640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:43:04.064 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:43:04.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:04.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:04.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:04.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:05.218 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:04 smithi084 ceph-mon[30411]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:05.218 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:04 smithi084 ceph-mon[30411]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:43:05.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:04 smithi162 ceph-mon[34833]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:05.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:04 smithi162 ceph-mon[34833]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:43:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:04 smithi191 ceph-mon[34667]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:04 smithi191 ceph-mon[34667]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:43:06.215 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:06 smithi162 ceph-mon[34833]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:43:06.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:06 smithi162 ceph-mon[34833]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:43:06.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:06 smithi162 ceph-mon[34833]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:43:06.216 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:06.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:06 smithi084 ceph-mon[30411]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:43:06.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:06 smithi084 ceph-mon[30411]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:43:06.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:06 smithi084 ceph-mon[30411]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:43:06.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:06.307 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 07:43:06 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T07:43:06.029+0000 7f69cda00640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:43:06.307 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 07:43:06 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T07:43:06.036+0000 7f69c8a00640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:43:06.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:06 smithi191 ceph-mon[34667]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:43:06.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:06 smithi191 ceph-mon[34667]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:43:06.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:06 smithi191 ceph-mon[34667]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:43:06.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:06.427 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:43:06.453 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-21T07:43:06.702 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:43:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:07 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:43:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:07 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:43:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:07 smithi162 ceph-mon[34833]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:07 smithi162 ceph-mon[34833]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:43:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:07 smithi162 ceph-mon[34833]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:43:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:07.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:07.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 -- 172.21.15.162:0/498429405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774103c30 msgr2=0x7f4774104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:07.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 --2- 172.21.15.162:0/498429405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774103c30 0x7f4774104040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4770009900 tx=0x7f477002a410 comp rx=0 tx=0).stop 2024-09-21T07:43:07.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 -- 172.21.15.162:0/498429405 shutdown_connections 2024-09-21T07:43:07.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 --2- 172.21.15.162:0/498429405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774109ec0 0x7f47741106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:07.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 --2- 172.21.15.162:0/498429405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4774109570 0x7f4774109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:07.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 --2- 172.21.15.162:0/498429405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774103c30 0x7f4774104040 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:07.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 -- 172.21.15.162:0/498429405 >> 172.21.15.162:0/498429405 conn(0x7f477407b8d0 msgr2=0x7f477407bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:43:07.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 -- 172.21.15.162:0/498429405 shutdown_connections 2024-09-21T07:43:07.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.156+0000 7f477c6c3640 1 -- 172.21.15.162:0/498429405 wait complete. 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 Processor -- start 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 -- start start 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4774103c30 0x7f477419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774109570 0x7f477419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774109ec0 0x7f477419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4774113ae0 con 0x7f4774109ec0 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4774113960 con 0x7f4774109570 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f477c6c3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4774113c60 con 0x7f4774103c30 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f4779c5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774109570 0x7f477419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f4779c5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774109570 0x7f477419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:50618/0 (socket says 172.21.15.162:50618) 2024-09-21T07:43:07.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.157+0000 7f4779c5e640 1 -- 172.21.15.162:0/764624035 learned_addr learned my addr 172.21.15.162:0/764624035 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f477ac60640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774109ec0 0x7f477419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f477a45f640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4774103c30 0x7f477419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f4779c5e640 1 -- 172.21.15.162:0/764624035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4774103c30 msgr2=0x7f477419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f4779c5e640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4774103c30 0x7f477419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f4779c5e640 1 -- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774109ec0 msgr2=0x7f477419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f4779c5e640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774109ec0 0x7f477419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f4779c5e640 1 -- 172.21.15.162:0/764624035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47741a0400 con 0x7f4774109570 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f477a45f640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4774103c30 0x7f477419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f4779c5e640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774109570 0x7f477419aa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f476400c970 tx=0x7f476400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f476b7fe640 1 -- 172.21.15.162:0/764624035 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764004220 con 0x7f4774109570 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f476b7fe640 1 -- 172.21.15.162:0/764624035 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47640043c0 con 0x7f4774109570 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47741a06f0 con 0x7f4774109570 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f476b7fe640 1 -- 172.21.15.162:0/764624035 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764004a00 con 0x7f4774109570 2024-09-21T07:43:07.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.158+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47741a6e50 con 0x7f4774109570 2024-09-21T07:43:07.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.160+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4774104040 con 0x7f4774109570 2024-09-21T07:43:07.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.161+0000 7f476b7fe640 1 -- 172.21.15.162:0/764624035 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f4764004ba0 con 0x7f4774109570 2024-09-21T07:43:07.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.162+0000 7f476b7fe640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47600b65e0 0x7f47600b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:07.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.162+0000 7f476b7fe640 1 -- 172.21.15.162:0/764624035 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3917+0+0 (secure 0 0 0) 0x7f47640e5f80 con 0x7f4774109570 2024-09-21T07:43:07.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.162+0000 7f477a45f640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47600b65e0 0x7f47600b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:07.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.163+0000 7f477a45f640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47600b65e0 0x7f47600b8af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4770031440 tx=0x7f4770009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:43:07.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.166+0000 7f476b7fe640 1 -- 172.21.15.162:0/764624035 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4764014030 con 0x7f4774109570 2024-09-21T07:43:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:07 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:43:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:07 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:43:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:07 smithi084 ceph-mon[30411]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:07 smithi084 ceph-mon[30411]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:43:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:07 smithi084 ceph-mon[30411]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:43:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:07 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:43:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:07 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:43:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:07 smithi191 ceph-mon[34667]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:07 smithi191 ceph-mon[34667]: from='osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:43:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:07 smithi191 ceph-mon[34667]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:43:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:07.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:07.413+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4774063800 con 0x7f47600b65e0 2024-09-21T07:43:08.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] boot 2024-09-21T07:43:08.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:43:08.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:08.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:43:08.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:08.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:08.023 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:08.024 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:08 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] boot 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:08.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:08.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:08.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:08.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:08 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: osd.3 [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] boot 2024-09-21T07:43:08.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:43:08.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:43:08.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:43:08.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:08.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:08.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:08.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:08 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:09.279 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:09 smithi162 ceph-mon[34833]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:43:09.279 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:09 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi084 2024-09-21T07:43:09.280 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:09 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T07:43:09.280 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:09 smithi162 ceph-mon[34833]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:09.280 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:09 smithi162 ceph-mon[34833]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:43:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:09 smithi084 ceph-mon[30411]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:43:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:09 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi084 2024-09-21T07:43:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:09 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T07:43:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:09 smithi084 ceph-mon[30411]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:09.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:09 smithi084 ceph-mon[30411]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:43:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:09 smithi191 ceph-mon[34667]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:43:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:09 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi084 2024-09-21T07:43:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:09 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T07:43:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:09 smithi191 ceph-mon[34667]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:43:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:09 smithi191 ceph-mon[34667]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T07:43:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:10 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/2253531518' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"} : dispatch 2024-09-21T07:43:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:10 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"} : dispatch 2024-09-21T07:43:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:10 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"}]': finished 2024-09-21T07:43:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:10 smithi162 ceph-mon[34833]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:43:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:10 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:10 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/2253531518' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"} : dispatch 2024-09-21T07:43:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:10 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"} : dispatch 2024-09-21T07:43:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:10 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"}]': finished 2024-09-21T07:43:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:10 smithi084 ceph-mon[30411]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:43:10.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:10 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:10.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:10 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/2253531518' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"} : dispatch 2024-09-21T07:43:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:10 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"} : dispatch 2024-09-21T07:43:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:10 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad64fba4-4313-4086-9c0e-67226e9c6b23"}]': finished 2024-09-21T07:43:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:10 smithi191 ceph-mon[34667]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:43:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:10 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:11.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:11 smithi162 ceph-mon[34833]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:11.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:11 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/3654321014' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:43:11.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:11 smithi084 ceph-mon[30411]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:11.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:11 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/3654321014' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:43:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:11 smithi191 ceph-mon[34667]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:11 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/3654321014' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:43:13.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:13 smithi162 ceph-mon[34833]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:13.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:13 smithi084 ceph-mon[30411]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:13.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:13 smithi191 ceph-mon[34667]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:15.300 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:15 smithi162 ceph-mon[34833]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T07:43:15.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:15 smithi084 ceph-mon[30411]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T07:43:15.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:15 smithi191 ceph-mon[34667]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T07:43:17.275 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:17 smithi162 ceph-mon[34833]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:43:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:17 smithi084 ceph-mon[30411]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:43:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:17 smithi191 ceph-mon[34667]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:43:19.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:19 smithi162 ceph-mon[34833]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T07:43:19.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:43:19.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:19 smithi084 ceph-mon[30411]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T07:43:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:43:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:19 smithi191 ceph-mon[34667]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T07:43:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:43:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:20.289 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:20 smithi162 ceph-mon[34833]: Deploying daemon osd.4 on smithi162 2024-09-21T07:43:20.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:20 smithi084 ceph-mon[30411]: Deploying daemon osd.4 on smithi162 2024-09-21T07:43:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:20 smithi191 ceph-mon[34667]: Deploying daemon osd.4 on smithi162 2024-09-21T07:43:21.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:21 smithi084 ceph-mon[30411]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T07:43:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:21 smithi191 ceph-mon[34667]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T07:43:21.449 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:21 smithi162 ceph-mon[34833]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T07:43:23.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:23 smithi191 ceph-mon[34667]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:43:23.462 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:23 smithi162 ceph-mon[34833]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:43:23.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:23 smithi084 ceph-mon[30411]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:43:25.314 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:25 smithi162 ceph-mon[34833]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:43:25.314 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:25 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:25.314 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:25 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:25.314 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:25 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:25 smithi191 ceph-mon[34667]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:43:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:25 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:25 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:25 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:25.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:25 smithi084 ceph-mon[30411]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:43:25.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:25 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:25.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:25 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:25.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:25 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:27 smithi162 ceph-mon[34833]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:27 smithi191 ceph-mon[34667]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:27.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:27 smithi084 ceph-mon[30411]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:28.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.075+0000 7f476b7fe640 1 -- 172.21.15.162:0/764624035 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4774063800 con 0x7f47600b65e0 2024-09-21T07:43:28.077 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 4 on host 'smithi162' 2024-09-21T07:43:28.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.078+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47600b65e0 msgr2=0x7f47600b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:28.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.078+0000 7f477c6c3640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47600b65e0 0x7f47600b8af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4770031440 tx=0x7f4770009680 comp rx=0 tx=0).stop 2024-09-21T07:43:28.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.078+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774109570 msgr2=0x7f477419aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:28.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.078+0000 7f477c6c3640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774109570 0x7f477419aa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f476400c970 tx=0x7f476400ce30 comp rx=0 tx=0).stop 2024-09-21T07:43:28.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.078+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 shutdown_connections 2024-09-21T07:43:28.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.078+0000 7f477c6c3640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47600b65e0 0x7f47600b8af0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:28.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.078+0000 7f477c6c3640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774109ec0 0x7f477419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:28.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.079+0000 7f477c6c3640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4774109570 0x7f477419aa30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:28.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.079+0000 7f477c6c3640 1 --2- 172.21.15.162:0/764624035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4774103c30 0x7f477419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:28.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.079+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 >> 172.21.15.162:0/764624035 conn(0x7f477407b8d0 msgr2=0x7f47741075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:43:28.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.079+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 shutdown_connections 2024-09-21T07:43:28.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:43:28.079+0000 7f477c6c3640 1 -- 172.21.15.162:0/764624035 wait complete. 2024-09-21T07:43:28.690 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.690 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.690 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:28.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:28.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:28.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:28.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.717 DEBUG:teuthology.orchestra.run.smithi162:osd.4> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T07:43:28.719 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/vg_nvme/lv_3... 2024-09-21T07:43:28.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:43:28.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:28.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:28.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:28.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:28.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:28.974 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:43:30.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 07:43:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T07:43:30.287+0000 7f3c4eabe640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:43:31.153 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:30 smithi162 ceph-mon[34833]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:31.153 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:30 smithi162 ceph-mon[34833]: from='osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:43:31.153 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:30 smithi162 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:43:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:30 smithi191 ceph-mon[34667]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:30 smithi191 ceph-mon[34667]: from='osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:43:31.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:30 smithi191 ceph-mon[34667]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:43:31.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:30 smithi084 ceph-mon[30411]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:31.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:30 smithi084 ceph-mon[30411]: from='osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:43:31.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:30 smithi084 ceph-mon[30411]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:43:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:43:31.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_3 2024-09-21T07:43:31.799 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:32.088 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.089 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:32.089 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:32.089 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.171 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:43:32.171 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:32.172 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:32.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:32.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.328+0000 7f9cf9403640 1 -- 172.21.15.191:0/4022772477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf41028a0 msgr2=0x7f9cf4102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.328+0000 7f9cf9403640 1 --2- 172.21.15.191:0/4022772477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf41028a0 0x7f9cf4102cb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009900 tx=0x7f9ce402a410 comp rx=0 tx=0).stop 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.328+0000 7f9cf9403640 1 -- 172.21.15.191:0/4022772477 shutdown_connections 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.328+0000 7f9cf9403640 1 --2- 172.21.15.191:0/4022772477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf4108b30 0x7f9cf410f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.328+0000 7f9cf9403640 1 --2- 172.21.15.191:0/4022772477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 0x7f9cf41085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.328+0000 7f9cf9403640 1 --2- 172.21.15.191:0/4022772477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf41028a0 0x7f9cf4102cb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.328+0000 7f9cf9403640 1 -- 172.21.15.191:0/4022772477 >> 172.21.15.191:0/4022772477 conn(0x7f9cf40fe2f0 msgr2=0x7f9cf4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.329+0000 7f9cf9403640 1 -- 172.21.15.191:0/4022772477 shutdown_connections 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.329+0000 7f9cf9403640 1 -- 172.21.15.191:0/4022772477 wait complete. 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.329+0000 7f9cf9403640 1 Processor -- start 2024-09-21T07:43:32.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.329+0000 7f9cf9403640 1 -- start start 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf9403640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf41028a0 0x7f9cf4199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf9403640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 0x7f9cf41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf9403640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf4108b30 0x7f9cf419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf9403640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf41127f0 con 0x7f9cf41028a0 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf9403640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf4112670 con 0x7f9cf41081e0 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf9403640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf4112970 con 0x7f9cf4108b30 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 0x7f9cf41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf37fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf4108b30 0x7f9cf419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 0x7f9cf41997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.191:53960/0 (socket says 172.21.15.191:53960) 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 -- 172.21.15.191:0/669283988 learned_addr learned my addr 172.21.15.191:0/669283988 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf37fe640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf4108b30 0x7f9cf419ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50434/0 (socket says 172.21.15.191:50434) 2024-09-21T07:43:32.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf2ffd640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf41028a0 0x7f9cf4199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 -- 172.21.15.191:0/669283988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf4108b30 msgr2=0x7f9cf419ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf4108b30 0x7f9cf419ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 -- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf41028a0 msgr2=0x7f9cf4199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf41028a0 0x7f9cf4199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 -- 172.21.15.191:0/669283988 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf419f170 con 0x7f9cf41081e0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf2ffd640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf41028a0 0x7f9cf4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf37fe640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf4108b30 0x7f9cf419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.330+0000 7f9cf27fc640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 0x7f9cf41997a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800e9c0 tx=0x7f9ce800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.331+0000 7f9cdbfff640 1 -- 172.21.15.191:0/669283988 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800ccc0 con 0x7f9cf41081e0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.331+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf419f460 con 0x7f9cf41081e0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.331+0000 7f9cdbfff640 1 -- 172.21.15.191:0/669283988 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce80054d0 con 0x7f9cf41081e0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.331+0000 7f9cdbfff640 1 -- 172.21.15.191:0/669283988 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8010430 con 0x7f9cf41081e0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.331+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf41a5bc0 con 0x7f9cf41081e0 2024-09-21T07:43:32.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.332+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf4102cb0 con 0x7f9cf41081e0 2024-09-21T07:43:32.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.333+0000 7f9cdbfff640 1 -- 172.21.15.191:0/669283988 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f9ce8005020 con 0x7f9cf41081e0 2024-09-21T07:43:32.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.334+0000 7f9cdbfff640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9cdc0b6560 0x7f9cdc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:32.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.334+0000 7f9cdbfff640 1 -- 172.21.15.191:0/669283988 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7f9ce80e66e0 con 0x7f9cf41081e0 2024-09-21T07:43:32.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.334+0000 7f9cf2ffd640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9cdc0b6560 0x7f9cdc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:32.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.335+0000 7f9cf2ffd640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9cdc0b6560 0x7f9cdc0b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4031440 tx=0x7f9ce4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:43:32.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.339+0000 7f9cdbfff640 1 -- 172.21.15.191:0/669283988 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ce80ae020 con 0x7f9cf41081e0 2024-09-21T07:43:32.535 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:32.533+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9cf4063800 con 0x7f9cdc0b6560 2024-09-21T07:43:32.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T07:43:32.652+0000 7f3c4aa40640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:43:32.982 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T07:43:32.658+0000 7f3c42836640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi162 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:33.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:33.072 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:33.072 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:32 smithi191 ceph-mon[34667]: from='osd.4 ' entity='osd.4' 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi162 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:33.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:32 smithi162 ceph-mon[34833]: from='osd.4 ' entity='osd.4' 2024-09-21T07:43:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi162 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:32 smithi084 ceph-mon[30411]: from='osd.4 ' entity='osd.4' 2024-09-21T07:43:34.242 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:33 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:43:34.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:33 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:43:34.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:33 smithi191 ceph-mon[34667]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:43:34.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:33 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:34.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:33 smithi191 ceph-mon[34667]: osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] boot 2024-09-21T07:43:34.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:33 smithi191 ceph-mon[34667]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:43:34.243 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:33 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:34.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:33 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:43:34.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:33 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:43:34.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:33 smithi162 ceph-mon[34833]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:43:34.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:33 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:34.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:33 smithi162 ceph-mon[34833]: osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] boot 2024-09-21T07:43:34.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:33 smithi162 ceph-mon[34833]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:43:34.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:33 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:34.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:33 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:43:34.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:33 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:43:34.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:33 smithi084 ceph-mon[30411]: from='client.24458 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:43:34.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:33 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:34.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:33 smithi084 ceph-mon[30411]: osd.4 [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] boot 2024-09-21T07:43:34.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:33 smithi084 ceph-mon[30411]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:43:34.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:33 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:43:35.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:34 smithi191 ceph-mon[34667]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:35.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:34 smithi162 ceph-mon[34833]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:35.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:34 smithi084 ceph-mon[30411]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:43:36.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:35 smithi162 ceph-mon[34833]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:43:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/1760319175' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"} : dispatch 2024-09-21T07:43:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:35 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"} : dispatch 2024-09-21T07:43:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:35 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"}]': finished 2024-09-21T07:43:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:35 smithi162 ceph-mon[34833]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:43:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:35 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/917535299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:43:36.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:35 smithi084 ceph-mon[30411]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:43:36.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/1760319175' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"} : dispatch 2024-09-21T07:43:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:35 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"} : dispatch 2024-09-21T07:43:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:35 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"}]': finished 2024-09-21T07:43:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:35 smithi084 ceph-mon[30411]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:43:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:35 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/917535299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:43:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:35 smithi191 ceph-mon[34667]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T07:43:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/1760319175' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"} : dispatch 2024-09-21T07:43:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:35 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"} : dispatch 2024-09-21T07:43:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:35 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d23cf2e7-5411-45c7-9a4d-c7ca9eccd062"}]': finished 2024-09-21T07:43:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:35 smithi191 ceph-mon[34667]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:43:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:35 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/917535299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:43:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:37 smithi162 ceph-mon[34833]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:37 smithi084 ceph-mon[30411]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:37.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:37 smithi191 ceph-mon[34667]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:39.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:39 smithi162 ceph-mon[34833]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:39.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:39 smithi084 ceph-mon[30411]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:39.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:39 smithi191 ceph-mon[34667]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:41.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:41 smithi162 ceph-mon[34833]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:41.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:41 smithi084 ceph-mon[30411]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:41.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:41 smithi191 ceph-mon[34667]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:43.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:43 smithi191 ceph-mon[34667]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:43.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:43 smithi162 ceph-mon[34833]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:43.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:43 smithi084 ceph-mon[30411]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:43:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:44.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:43:44.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:44.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:43:44.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:45.142 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:45 smithi191 ceph-mon[34667]: Deploying daemon osd.5 on smithi191 2024-09-21T07:43:45.143 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:45 smithi191 ceph-mon[34667]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:45.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:45 smithi162 ceph-mon[34833]: Deploying daemon osd.5 on smithi191 2024-09-21T07:43:45.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:45 smithi162 ceph-mon[34833]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:45.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:45 smithi084 ceph-mon[30411]: Deploying daemon osd.5 on smithi191 2024-09-21T07:43:45.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:45 smithi084 ceph-mon[30411]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:47.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:47 smithi162 ceph-mon[34833]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:47.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:47 smithi084 ceph-mon[30411]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:47.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:47 smithi191 ceph-mon[34667]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:49.139 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:49 smithi191 ceph-mon[34667]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:49.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:49 smithi162 ceph-mon[34833]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:49.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:49 smithi084 ceph-mon[30411]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:50.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:50.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:50.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:50.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:50.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:50.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:50.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:50.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:50.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:51.089 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:51 smithi191 ceph-mon[34667]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:51.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:51 smithi162 ceph-mon[34833]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:51.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:51 smithi084 ceph-mon[30411]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:53.330 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:53 smithi191 ceph-mon[34667]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:53.330 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:53.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:53.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.374 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2024-09-21T07:43:53.374 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.372+0000 7f9cdbfff640 1 -- 172.21.15.191:0/669283988 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9cf4063800 con 0x7f9cdc0b6560 2024-09-21T07:43:53.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.374+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9cdc0b6560 msgr2=0x7f9cdc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:53.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.374+0000 7f9cf9403640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9cdc0b6560 0x7f9cdc0b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4031440 tx=0x7f9ce4009680 comp rx=0 tx=0).stop 2024-09-21T07:43:53.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.374+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 msgr2=0x7f9cf41997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:53.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.374+0000 7f9cf9403640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 0x7f9cf41997a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800e9c0 tx=0x7f9ce800ee80 comp rx=0 tx=0).stop 2024-09-21T07:43:53.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 shutdown_connections 2024-09-21T07:43:53.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9cdc0b6560 0x7f9cdc0b8a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:53.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cf4108b30 0x7f9cf419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:53.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cf41081e0 0x7f9cf41997a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:53.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 --2- 172.21.15.191:0/669283988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf41028a0 0x7f9cf4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:53.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 >> 172.21.15.191:0/669283988 conn(0x7f9cf40fe2f0 msgr2=0x7f9cf4100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:43:53.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 shutdown_connections 2024-09-21T07:43:53.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:43:53.375+0000 7f9cf9403640 1 -- 172.21.15.191:0/669283988 wait complete. 2024-09-21T07:43:53.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:53 smithi162 ceph-mon[34833]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:53.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:53.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:53.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:53 smithi084 ceph-mon[30411]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:53.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:53.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:53.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:53.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:54.020 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T07:43:54.023 INFO:tasks.cephadm:Deploying osd.6 on smithi084 with /dev/vg_nvme/lv_2... 2024-09-21T07:43:54.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:43:54.363 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:54.363 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:54.363 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:54.396 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:43:54.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:54.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:54.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:54.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:54.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:54.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:55 smithi191 ceph-mon[34667]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:55.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:55 smithi162 ceph-mon[34833]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:55.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:55 smithi084 ceph-mon[30411]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:55.687 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 07:43:55 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T07:43:55.466+0000 7fdd540c8640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:43:56.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:56 smithi084 ceph-mon[30411]: from='osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:43:56.297 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:56 smithi084 ceph-mon[30411]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:43:56.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:56 smithi191 ceph-mon[34667]: from='osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:43:56.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:56 smithi191 ceph-mon[34667]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:43:56.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:56 smithi162 ceph-mon[34833]: from='osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:43:56.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:56 smithi162 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:43:57.101 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:57.101 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:43:57.101 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:43:57.101 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:57.101 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:43:57.101 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:57.102 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:57.361 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.405 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T07:43:57.098+0000 7fdd5004a640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:43:57.405 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 07:43:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T07:43:57.107+0000 7fdd4be48640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:43:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:57.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:57.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:43:57.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:43:57.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-09-21T07:43:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi191 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi191 to 8544M 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] boot 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:43:58.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:58 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.479 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi191 2024-09-21T07:43:58.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi191 to 8544M 2024-09-21T07:43:58.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:43:58.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:43:58.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] boot 2024-09-21T07:43:58.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:43:58.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:58 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi191 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi191 to 8544M 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: osd.5 [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] boot 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:43:58.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:58 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:43:58.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 -- 172.21.15.84:0/2078680134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84103990 msgr2=0x7f2e84103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:58.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 --2- 172.21.15.84:0/2078680134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84103990 0x7f2e84103da0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009900 tx=0x7f2e7802a410 comp rx=0 tx=0).stop 2024-09-21T07:43:58.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 -- 172.21.15.84:0/2078680134 shutdown_connections 2024-09-21T07:43:58.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 --2- 172.21.15.84:0/2078680134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e84109c20 0x7f2e84110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:58.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 --2- 172.21.15.84:0/2078680134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e841092d0 0x7f2e841096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:58.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 --2- 172.21.15.84:0/2078680134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84103990 0x7f2e84103da0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:58.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 -- 172.21.15.84:0/2078680134 >> 172.21.15.84:0/2078680134 conn(0x7f2e840ff3e0 msgr2=0x7f2e84101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:43:58.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 -- 172.21.15.84:0/2078680134 shutdown_connections 2024-09-21T07:43:58.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.814+0000 7f2e8a200640 1 -- 172.21.15.84:0/2078680134 wait complete. 2024-09-21T07:43:58.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.815+0000 7f2e8a200640 1 Processor -- start 2024-09-21T07:43:58.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.815+0000 7f2e8a200640 1 -- start start 2024-09-21T07:43:58.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e8a200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e84103990 0x7f2e8419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:58.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e8a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e841092d0 0x7f2e8419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:58.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e8a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84109c20 0x7f2e8419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e8a200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84113930 con 0x7f2e84109c20 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e8a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e841137b0 con 0x7f2e841092d0 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e8a200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84113ab0 con 0x7f2e84103990 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84109c20 0x7f2e8419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e88e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e84103990 0x7f2e8419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84109c20 0x7f2e8419fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39562/0 (socket says 172.21.15.84:39562) 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 -- 172.21.15.84:0/123276333 learned_addr learned my addr 172.21.15.84:0/123276333 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e83e00640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e841092d0 0x7f2e8419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 -- 172.21.15.84:0/123276333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e84103990 msgr2=0x7f2e8419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e84103990 0x7f2e8419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 -- 172.21.15.84:0/123276333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e841092d0 msgr2=0x7f2e8419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e841092d0 0x7f2e8419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.816+0000 7f2e89800640 1 -- 172.21.15.84:0/123276333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e841a0290 con 0x7f2e84109c20 2024-09-21T07:43:58.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.817+0000 7f2e88e00640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e84103990 0x7f2e8419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:43:58.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.817+0000 7f2e89800640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84109c20 0x7f2e8419fb60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009fd0 tx=0x7f2e7c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:43:58.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.817+0000 7f2e81600640 1 -- 172.21.15.84:0/123276333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c017070 con 0x7f2e84109c20 2024-09-21T07:43:58.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.817+0000 7f2e81600640 1 -- 172.21.15.84:0/123276333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e7c003e20 con 0x7f2e84109c20 2024-09-21T07:43:58.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.817+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e841a0580 con 0x7f2e84109c20 2024-09-21T07:43:58.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.817+0000 7f2e81600640 1 -- 172.21.15.84:0/123276333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c010460 con 0x7f2e84109c20 2024-09-21T07:43:58.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.817+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e841a6ce0 con 0x7f2e84109c20 2024-09-21T07:43:58.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.818+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e84103da0 con 0x7f2e84109c20 2024-09-21T07:43:58.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.821+0000 7f2e81600640 1 -- 172.21.15.84:0/123276333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2e7c003970 con 0x7f2e84109c20 2024-09-21T07:43:58.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.823+0000 7f2e81600640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e6c0b65e0 0x7f2e6c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:43:58.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.824+0000 7f2e88e00640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e6c0b65e0 0x7f2e6c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:43:58.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.824+0000 7f2e81600640 1 -- 172.21.15.84:0/123276333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4748+0+0 (secure 0 0 0) 0x7f2e7c0e6270 con 0x7f2e84109c20 2024-09-21T07:43:58.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.824+0000 7f2e88e00640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e6c0b65e0 0x7f2e6c0b8af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e78005ab0 tx=0x7f2e78005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:43:58.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:58.826+0000 7f2e81600640 1 -- 172.21.15.84:0/123276333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e7c0b1cb0 con 0x7f2e84109c20 2024-09-21T07:43:59.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:43:59.021+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2e84063800 con 0x7f2e6c0b65e0 2024-09-21T07:43:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:59 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:43:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:59 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:43:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:59 smithi084 ceph-mon[30411]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:59 smithi084 ceph-mon[30411]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:43:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:43:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:59 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:43:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:59 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:43:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:59 smithi191 ceph-mon[34667]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:59 smithi191 ceph-mon[34667]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:43:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:43:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:59 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:43:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:59 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:43:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:59 smithi162 ceph-mon[34833]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:43:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:59 smithi162 ceph-mon[34833]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:43:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:43:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:43:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:43:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:00.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:00 smithi084 ceph-mon[30411]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:00.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:00 smithi084 ceph-mon[30411]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:44:00.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:00 smithi191 ceph-mon[34667]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:00.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:00 smithi191 ceph-mon[34667]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:44:00.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:00 smithi162 ceph-mon[34833]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:00.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:00 smithi162 ceph-mon[34833]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T07:44:01.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:01 smithi084 ceph-mon[30411]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:01 smithi191 ceph-mon[34667]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:01 smithi162 ceph-mon[34833]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:03 smithi191 ceph-mon[34667]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/182983714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56fec50e-104d-4e8d-aa85-455f1d25bbcc"} : dispatch 2024-09-21T07:44:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/182983714' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56fec50e-104d-4e8d-aa85-455f1d25bbcc"}]': finished 2024-09-21T07:44:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:03 smithi191 ceph-mon[34667]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:44:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/991703313' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:03 smithi162 ceph-mon[34833]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/182983714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56fec50e-104d-4e8d-aa85-455f1d25bbcc"} : dispatch 2024-09-21T07:44:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/182983714' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56fec50e-104d-4e8d-aa85-455f1d25bbcc"}]': finished 2024-09-21T07:44:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:03 smithi162 ceph-mon[34833]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:44:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/991703313' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:03.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:03 smithi084 ceph-mon[30411]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:03.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/182983714' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56fec50e-104d-4e8d-aa85-455f1d25bbcc"} : dispatch 2024-09-21T07:44:03.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/182983714' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56fec50e-104d-4e8d-aa85-455f1d25bbcc"}]': finished 2024-09-21T07:44:03.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:03 smithi084 ceph-mon[30411]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:44:03.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:03.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/991703313' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:05 smithi191 ceph-mon[34667]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:44:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:05 smithi162 ceph-mon[34833]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:44:05.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:05 smithi084 ceph-mon[30411]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:44:07.369 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:07 smithi084 ceph-mon[30411]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T07:44:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:07 smithi191 ceph-mon[34667]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T07:44:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:07 smithi162 ceph-mon[34833]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T07:44:09.177 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:09 smithi084 ceph-mon[30411]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T07:44:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:09 smithi191 ceph-mon[34667]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T07:44:09.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:09 smithi162 ceph-mon[34833]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T07:44:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:10 smithi084 ceph-mon[30411]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:44:10.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:10 smithi191 ceph-mon[34667]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:44:10.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:10 smithi162 ceph-mon[34833]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:44:12.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:11 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:44:12.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:11 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:12.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:11 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:44:12.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:11 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:11 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:44:12.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:11 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:12.836 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:12 smithi084 ceph-mon[30411]: Deploying daemon osd.6 on smithi084 2024-09-21T07:44:12.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:12 smithi084 ceph-mon[30411]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:44:13.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:12 smithi162 ceph-mon[34833]: Deploying daemon osd.6 on smithi084 2024-09-21T07:44:13.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:12 smithi162 ceph-mon[34833]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:44:13.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:12 smithi191 ceph-mon[34667]: Deploying daemon osd.6 on smithi084 2024-09-21T07:44:13.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:12 smithi191 ceph-mon[34667]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:44:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:14 smithi162 ceph-mon[34833]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:14 smithi084 ceph-mon[30411]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:15.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:14 smithi191 ceph-mon[34667]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:17.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:16 smithi084 ceph-mon[30411]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:17.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:16 smithi162 ceph-mon[34833]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:17.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:16 smithi191 ceph-mon[34667]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:19.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:18 smithi162 ceph-mon[34833]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:18 smithi084 ceph-mon[30411]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:18 smithi191 ceph-mon[34667]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:21.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:20 smithi084 ceph-mon[30411]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:21.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:21.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:21.085 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:21.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:20 smithi162 ceph-mon[34833]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:21.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:21.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:21.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:21.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:20 smithi191 ceph-mon[34667]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:23.203 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:22 smithi084 ceph-mon[30411]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:23.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:22 smithi162 ceph-mon[34833]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:22 smithi191 ceph-mon[34667]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:24.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:24 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:24 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:24 smithi191 ceph-mon[34667]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:24.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:24 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:24.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:24 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:24.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:24 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:24 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:24 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:24 smithi162 ceph-mon[34833]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:24.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:24 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:24.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:24 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:24.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:24 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:24 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:24 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:24.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:24 smithi084 ceph-mon[30411]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:24.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:24 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:24.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:24 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:24.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:24 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.324+0000 7f2e81600640 1 -- 172.21.15.84:0/123276333 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2e84063800 con 0x7f2e6c0b65e0 2024-09-21T07:44:25.327 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 6 on host 'smithi084' 2024-09-21T07:44:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e6c0b65e0 msgr2=0x7f2e6c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e6c0b65e0 0x7f2e6c0b8af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e78005ab0 tx=0x7f2e78005a20 comp rx=0 tx=0).stop 2024-09-21T07:44:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84109c20 msgr2=0x7f2e8419fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84109c20 0x7f2e8419fb60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009fd0 tx=0x7f2e7c00b260 comp rx=0 tx=0).stop 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 shutdown_connections 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e6c0b65e0 0x7f2e6c0b8af0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e84109c20 0x7f2e8419fb60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e841092d0 0x7f2e8419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 --2- 172.21.15.84:0/123276333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e84103990 0x7f2e8419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 >> 172.21.15.84:0/123276333 conn(0x7f2e840ff3e0 msgr2=0x7f2e84101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.327+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 shutdown_connections 2024-09-21T07:44:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:44:25.328+0000 7f2e8a200640 1 -- 172.21.15.84:0/123276333 wait complete. 2024-09-21T07:44:25.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:25 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:25.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:25 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:25.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:25 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:25.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:25 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:25.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:25 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:25.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:25 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:25.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:25 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:25.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:25 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:25.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:25 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:26.072 DEBUG:teuthology.orchestra.run.smithi084:osd.6> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T07:44:26.075 INFO:tasks.cephadm:Deploying osd.7 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-21T07:44:26.075 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:44:26.332 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:44:26.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:26 smithi084 ceph-mon[30411]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:26.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:26 smithi084 ceph-mon[30411]: from='osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:44:26.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:26 smithi084 ceph-mon[30411]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:44:26.557 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 07:44:26 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T07:44:26.331+0000 7fcc08273640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:44:26.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:26 smithi191 ceph-mon[34667]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:26.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:26 smithi191 ceph-mon[34667]: from='osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:44:26.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:26 smithi191 ceph-mon[34667]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:44:26.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:26 smithi162 ceph-mon[34833]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:26.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:26 smithi162 ceph-mon[34833]: from='osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:44:26.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:26 smithi162 ceph-mon[34833]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:44:27.558 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 07:44:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T07:44:27.395+0000 7fcc02e00640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:44:27.558 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 07:44:27 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T07:44:27.406+0000 7fcbfde00640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:44:27.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:27 smithi084 ceph-mon[30411]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:44:27.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:27 smithi084 ceph-mon[30411]: from='osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:44:27.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:27 smithi084 ceph-mon[30411]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:44:27.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:27.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:27 smithi084 ceph-mon[30411]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:44:27.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:27 smithi191 ceph-mon[34667]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:44:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:27 smithi191 ceph-mon[34667]: from='osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:44:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:27 smithi191 ceph-mon[34667]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:44:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:27 smithi191 ceph-mon[34667]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:44:27.716 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:27 smithi162 ceph-mon[34833]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:44:27.716 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:27 smithi162 ceph-mon[34833]: from='osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:44:27.716 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:27 smithi162 ceph-mon[34833]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:44:27.717 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:27.717 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:27 smithi162 ceph-mon[34833]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:44:28.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:28 smithi084 ceph-mon[30411]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:44:28.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:28 smithi084 ceph-mon[30411]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:44:28.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:28.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:28 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:28.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:28 smithi084 ceph-mon[30411]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:28.640 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:28 smithi162 ceph-mon[34833]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:44:28.640 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:28 smithi162 ceph-mon[34833]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:44:28.640 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:28.640 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:28 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:28.640 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:28 smithi162 ceph-mon[34833]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:28.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:28 smithi191 ceph-mon[34667]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:44:28.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:28 smithi191 ceph-mon[34667]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T07:44:28.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:28.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:28 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:28.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:28 smithi191 ceph-mon[34667]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:44:29.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:44:29.049 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-21T07:44:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:44:29.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:29 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:44:29.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:29 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:44:29.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:29 smithi191 ceph-mon[34667]: osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] boot 2024-09-21T07:44:29.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:29 smithi191 ceph-mon[34667]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:44:29.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:29.681 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:29 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:44:29.682 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:29 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:44:29.682 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:29 smithi162 ceph-mon[34833]: osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] boot 2024-09-21T07:44:29.682 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:29 smithi162 ceph-mon[34833]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:44:29.682 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 -- 172.21.15.162:0/1432442565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 msgr2=0x7fc360102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 --2- 172.21.15.162:0/1432442565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc360102e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc350009900 tx=0x7fc35002a410 comp rx=0 tx=0).stop 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 -- 172.21.15.162:0/1432442565 shutdown_connections 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 --2- 172.21.15.162:0/1432442565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc360108cf0 0x7fc36010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 --2- 172.21.15.162:0/1432442565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3601083a0 0x7fc3601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 --2- 172.21.15.162:0/1432442565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc360102e70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 -- 172.21.15.162:0/1432442565 >> 172.21.15.162:0/1432442565 conn(0x7fc360079730 msgr2=0x7fc360079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 -- 172.21.15.162:0/1432442565 shutdown_connections 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.774+0000 7fc366396640 1 -- 172.21.15.162:0/1432442565 wait complete. 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.775+0000 7fc366396640 1 Processor -- start 2024-09-21T07:44:29.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.775+0000 7fc366396640 1 -- start start 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.775+0000 7fc366396640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc36010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.775+0000 7fc366396640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3601083a0 0x7fc3601104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc366396640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc360108cf0 0x7fc360110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc366396640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc360113a80 con 0x7fc3601083a0 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc366396640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc360113900 con 0x7fc360102a60 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc366396640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc360113c00 con 0x7fc360108cf0 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc36010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc36010ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:56862/0 (socket says 172.21.15.162:56862) 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 -- 172.21.15.162:0/88298443 learned_addr learned my addr 172.21.15.162:0/88298443 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc364933640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc360108cf0 0x7fc360110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35f7fe640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3601083a0 0x7fc3601104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 -- 172.21.15.162:0/88298443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc360108cf0 msgr2=0x7fc360110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:29.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc360108cf0 0x7fc360110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 -- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3601083a0 msgr2=0x7fc3601104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3601083a0 0x7fc3601104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 -- 172.21.15.162:0/88298443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3601a8790 con 0x7fc360102a60 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35ffff640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc36010ffb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc350005940 tx=0x7fc350004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35d7fa640 1 -- 172.21.15.162:0/88298443 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35003f030 con 0x7fc360102a60 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35d7fa640 1 -- 172.21.15.162:0/88298443 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc350003aa0 con 0x7fc360102a60 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3601a8a20 con 0x7fc360102a60 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.776+0000 7fc35d7fa640 1 -- 172.21.15.162:0/88298443 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350035070 con 0x7fc360102a60 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.777+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3601a8f00 con 0x7fc360102a60 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.777+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc360102e70 con 0x7fc360102a60 2024-09-21T07:44:29.784 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.779+0000 7fc35d7fa640 1 -- 172.21.15.162:0/88298443 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc350042030 con 0x7fc360102a60 2024-09-21T07:44:29.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.780+0000 7fc35d7fa640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3480b6560 0x7fc3480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:29.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.780+0000 7fc35d7fa640 1 -- 172.21.15.162:0/88298443 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5180+0+0 (secure 0 0 0) 0x7fc3501070a0 con 0x7fc360102a60 2024-09-21T07:44:29.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.781+0000 7fc35f7fe640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3480b6560 0x7fc3480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:44:29.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.781+0000 7fc35f7fe640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3480b6560 0x7fc3480b8a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc36007a100 tx=0x7fc35400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:44:29.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.784+0000 7fc35d7fa640 1 -- 172.21.15.162:0/88298443 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3500d2950 con 0x7fc360102a60 2024-09-21T07:44:29.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:29 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:44:29.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:29 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:44:29.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:29 smithi084 ceph-mon[30411]: osd.6 [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] boot 2024-09-21T07:44:29.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:29 smithi084 ceph-mon[30411]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T07:44:29.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:44:29.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:29.974+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc360063800 con 0x7fc3480b6560 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi084 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.601 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:44:30.602 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:30.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi084 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:30.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:30.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:44:30.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:44:30.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi084 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T07:44:30.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:30.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:30.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:30.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:30.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:44:30.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:44:30.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:32 smithi162 ceph-mon[34833]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:32 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/2732891353' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"} : dispatch 2024-09-21T07:44:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:32 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"} : dispatch 2024-09-21T07:44:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:32 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"}]': finished 2024-09-21T07:44:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:32 smithi162 ceph-mon[34833]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:44:33.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:32 smithi084 ceph-mon[30411]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:32 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/2732891353' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"} : dispatch 2024-09-21T07:44:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:32 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"} : dispatch 2024-09-21T07:44:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:32 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"}]': finished 2024-09-21T07:44:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:32 smithi084 ceph-mon[30411]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:44:33.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:32 smithi191 ceph-mon[34667]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:32 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/2732891353' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"} : dispatch 2024-09-21T07:44:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:32 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"} : dispatch 2024-09-21T07:44:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:32 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64539985-2656-47f9-b200-bf9d6cc097a2"}]': finished 2024-09-21T07:44:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:32 smithi191 ceph-mon[34667]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:44:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:34.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:33 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/727340837' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:34.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:33 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/727340837' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:34.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:33 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/727340837' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:35.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:34 smithi162 ceph-mon[34833]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:35.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:34 smithi084 ceph-mon[30411]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:35.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:34 smithi191 ceph-mon[34667]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:37.273 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:36 smithi162 ceph-mon[34833]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:36 smithi084 ceph-mon[30411]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:37.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:36 smithi191 ceph-mon[34667]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:38 smithi162 ceph-mon[34833]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:39.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:38 smithi084 ceph-mon[30411]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:39.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:38 smithi191 ceph-mon[34667]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:41.300 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:40 smithi162 ceph-mon[34833]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:41.300 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:44:41.300 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:41.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:40 smithi084 ceph-mon[30411]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:41.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:44:41.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:40 smithi191 ceph-mon[34667]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:44:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:42.300 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:42 smithi162 ceph-mon[34833]: Deploying daemon osd.7 on smithi162 2024-09-21T07:44:42.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:42 smithi084 ceph-mon[30411]: Deploying daemon osd.7 on smithi162 2024-09-21T07:44:42.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:42 smithi191 ceph-mon[34667]: Deploying daemon osd.7 on smithi162 2024-09-21T07:44:43.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:43 smithi162 ceph-mon[34833]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:43.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:43 smithi084 ceph-mon[30411]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:43.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:43 smithi191 ceph-mon[34667]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:45.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:45 smithi162 ceph-mon[34833]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:45.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:45 smithi084 ceph-mon[30411]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:45.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:45 smithi191 ceph-mon[34667]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:47.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:47 smithi162 ceph-mon[34833]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:47.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:47 smithi084 ceph-mon[30411]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:47.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:47 smithi191 ceph-mon[34667]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:48.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:48.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:48.044 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:48.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:48.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:48.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:48.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:48.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:48.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:49.299 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:49 smithi162 ceph-mon[34833]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:49.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:49 smithi084 ceph-mon[30411]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:49.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:49 smithi191 ceph-mon[34667]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:50.898 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:50.898 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:50.898 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:51.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.016+0000 7fc35d7fa640 1 -- 172.21.15.162:0/88298443 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc360063800 con 0x7fc3480b6560 2024-09-21T07:44:51.019 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 7 on host 'smithi162' 2024-09-21T07:44:51.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.018+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3480b6560 msgr2=0x7fc3480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:51.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.018+0000 7fc366396640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3480b6560 0x7fc3480b8a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc36007a100 tx=0x7fc35400b390 comp rx=0 tx=0).stop 2024-09-21T07:44:51.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.018+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 msgr2=0x7fc36010ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:51.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.018+0000 7fc366396640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc36010ffb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc350005940 tx=0x7fc350004270 comp rx=0 tx=0).stop 2024-09-21T07:44:51.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 shutdown_connections 2024-09-21T07:44:51.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3480b6560 0x7fc3480b8a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:51.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc360108cf0 0x7fc360110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:51.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3601083a0 0x7fc3601104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:51.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 --2- 172.21.15.162:0/88298443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc360102a60 0x7fc36010ffb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:51.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 >> 172.21.15.162:0/88298443 conn(0x7fc360079730 msgr2=0x7fc360101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:44:51.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 shutdown_connections 2024-09-21T07:44:51.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:44:51.019+0000 7fc366396640 1 -- 172.21.15.162:0/88298443 wait complete. 2024-09-21T07:44:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:50 smithi191 ceph-mon[34667]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:51.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:51.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:51.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:50 smithi162 ceph-mon[34833]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:51.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:51.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:51.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:51.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:51.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:51.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:50 smithi084 ceph-mon[30411]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:51.794 DEBUG:teuthology.orchestra.run.smithi162:osd.7> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T07:44:51.797 INFO:tasks.cephadm:Deploying osd.8 on smithi191 with /dev/vg_nvme/lv_2... 2024-09-21T07:44:51.797 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:44:52.050 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:44:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:51 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:51 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:51 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:52.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:51 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:52.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:51 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:52.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:51 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:52.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:51 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:52.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:51 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:52.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:51 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:53.194 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:52 smithi162 ceph-mon[34833]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:53.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:52 smithi162 ceph-mon[34833]: from='osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:44:53.195 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:52 smithi162 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:44:53.195 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 07:44:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T07:44:52.892+0000 7f279abcf640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:44:53.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:52 smithi191 ceph-mon[34667]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:53.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:52 smithi191 ceph-mon[34667]: from='osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:44:53.195 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:52 smithi191 ceph-mon[34667]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:44:53.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:52 smithi084 ceph-mon[30411]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:53.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:52 smithi084 ceph-mon[30411]: from='osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:44:53.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:52 smithi084 ceph-mon[30411]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:44:54.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:53 smithi191 ceph-mon[34667]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:44:54.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:53 smithi191 ceph-mon[34667]: from='osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:44:54.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:53 smithi191 ceph-mon[34667]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:44:54.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:54.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:53 smithi191 ceph-mon[34667]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:44:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:53 smithi162 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:44:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:53 smithi162 ceph-mon[34833]: from='osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:44:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:53 smithi162 ceph-mon[34833]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:44:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:53 smithi162 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:44:54.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:53 smithi084 ceph-mon[30411]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:44:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:53 smithi084 ceph-mon[30411]: from='osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:44:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:53 smithi084 ceph-mon[30411]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:44:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:53 smithi084 ceph-mon[30411]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:44:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:44:54.574 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_2 2024-09-21T07:44:54.825 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:44:54.939 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T07:44:54.667+0000 7f2796b51640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:44:54.939 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T07:44:54.676+0000 7f278e947640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:44:55.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='osd.7 ' entity='osd.7' 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:55.104 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='osd.7 ' entity='osd.7' 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:55.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:55.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='osd.7 ' entity='osd.7' 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:55.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 -- 172.21.15.191:0/1253707503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f41094b0 msgr2=0x7f92f41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 --2- 172.21.15.191:0/1253707503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f41094b0 0x7f92f41098c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009900 tx=0x7f92e402a410 comp rx=0 tx=0).stop 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 -- 172.21.15.191:0/1253707503 shutdown_connections 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 --2- 172.21.15.191:0/1253707503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f4109e00 0x7f92f4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 --2- 172.21.15.191:0/1253707503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f41094b0 0x7f92f41098c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 --2- 172.21.15.191:0/1253707503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92f4103bc0 0x7f92f4103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 -- 172.21.15.191:0/1253707503 >> 172.21.15.191:0/1253707503 conn(0x7f92f407b910 msgr2=0x7f92f407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 -- 172.21.15.191:0/1253707503 shutdown_connections 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.327+0000 7f92fc184640 1 -- 172.21.15.191:0/1253707503 wait complete. 2024-09-21T07:44:55.333 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 Processor -- start 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 -- start start 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f4103bc0 0x7f92f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92f41094b0 0x7f92f4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f4109e00 0x7f92f4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4113b00 con 0x7f92f41094b0 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4113980 con 0x7f92f4103bc0 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fc184640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4113c80 con 0x7f92f4109e00 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fa721640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f4109e00 0x7f92f4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fa721640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f4109e00 0x7f92f4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:47386/0 (socket says 172.21.15.191:47386) 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fa721640 1 -- 172.21.15.191:0/217569567 learned_addr learned my addr 172.21.15.191:0/217569567 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92f9f20640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f4103bc0 0x7f92f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fa721640 1 -- 172.21.15.191:0/217569567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f4103bc0 msgr2=0x7f92f4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fa721640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f4103bc0 0x7f92f4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:55.334 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fa721640 1 -- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92f41094b0 msgr2=0x7f92f4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.328+0000 7f92fa721640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92f41094b0 0x7f92f4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.329+0000 7f92fa721640 1 -- 172.21.15.191:0/217569567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f41a8810 con 0x7f92f4109e00 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.329+0000 7f92fa721640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f4109e00 0x7f92f4076190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e970 tx=0x7f92f000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.329+0000 7f92eaffd640 1 -- 172.21.15.191:0/217569567 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f000ccc0 con 0x7f92f4109e00 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.329+0000 7f92eaffd640 1 -- 172.21.15.191:0/217569567 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f000ce60 con 0x7f92f4109e00 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.329+0000 7f92eaffd640 1 -- 172.21.15.191:0/217569567 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0010430 con 0x7f92f4109e00 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.329+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f41a8b00 con 0x7f92f4109e00 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.329+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f41a9090 con 0x7f92f4109e00 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.330+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f4103fd0 con 0x7f92f4109e00 2024-09-21T07:44:55.335 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.331+0000 7f92eaffd640 1 -- 172.21.15.191:0/217569567 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f92f0004f90 con 0x7f92f4109e00 2024-09-21T07:44:55.336 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.332+0000 7f92eaffd640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92e00b65e0 0x7f92e00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:44:55.336 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.332+0000 7f92eaffd640 1 -- 172.21.15.191:0/217569567 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5645+0+0 (secure 0 0 0) 0x7f92f00e6cf0 con 0x7f92f4109e00 2024-09-21T07:44:55.336 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.333+0000 7f92f9f20640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92e00b65e0 0x7f92e00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:44:55.336 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.333+0000 7f92f9f20640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92e00b65e0 0x7f92e00b8af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f92f4077160 tx=0x7f92ec00d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:44:55.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.341+0000 7f92eaffd640 1 -- 172.21.15.191:0/217569567 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92f00eb070 con 0x7f92f4109e00 2024-09-21T07:44:55.550 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:44:55.549+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f92f4063800 con 0x7f92e00b65e0 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi162 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] boot 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:44:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:56.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi162 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] boot 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:44:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:56.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:44:56.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:44:56.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi162 2024-09-21T07:44:56.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T07:44:56.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: osd.7 [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] boot 2024-09-21T07:44:56.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:44:56.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:44:56.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:44:56.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:44:56.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:57.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:56 smithi191 ceph-mon[34667]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:57.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:56 smithi191 ceph-mon[34667]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:44:57.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:56 smithi191 ceph-mon[34667]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:44:57.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:56 smithi162 ceph-mon[34833]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:57.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:56 smithi162 ceph-mon[34833]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:44:57.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:56 smithi162 ceph-mon[34833]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:44:57.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:56 smithi084 ceph-mon[30411]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:44:57.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:56 smithi084 ceph-mon[30411]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:44:57.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:56 smithi084 ceph-mon[30411]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T07:44:58.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:57 smithi162 ceph-mon[34833]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T07:44:58.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:57 smithi084 ceph-mon[30411]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T07:44:58.330 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:57 smithi191 ceph-mon[34667]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T07:44:59.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:58 smithi162 ceph-mon[34833]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:44:59.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:58 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/1909709624' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"} : dispatch 2024-09-21T07:44:59.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:58 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"} : dispatch 2024-09-21T07:44:59.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:58 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"}]': finished 2024-09-21T07:44:59.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:58 smithi162 ceph-mon[34833]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:44:59.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:58 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:44:59.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:44:58 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/2889007000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:58 smithi084 ceph-mon[30411]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:44:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:58 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/1909709624' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"} : dispatch 2024-09-21T07:44:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:58 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"} : dispatch 2024-09-21T07:44:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:58 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"}]': finished 2024-09-21T07:44:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:58 smithi084 ceph-mon[30411]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:44:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:58 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:44:59.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:44:58 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/2889007000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:44:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:58 smithi191 ceph-mon[34667]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:44:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:58 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/1909709624' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"} : dispatch 2024-09-21T07:44:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:58 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"} : dispatch 2024-09-21T07:44:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:58 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3edf476b-1d78-4981-b8fe-c4a12b2f294b"}]': finished 2024-09-21T07:44:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:58 smithi191 ceph-mon[34667]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:44:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:58 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:44:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:44:58 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/2889007000' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:45:01.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:00 smithi162 ceph-mon[34833]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:01.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:00 smithi084 ceph-mon[30411]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:01.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:00 smithi191 ceph-mon[34667]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:03.263 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:02 smithi191 ceph-mon[34667]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:45:03.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:02 smithi162 ceph-mon[34833]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:45:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:02 smithi084 ceph-mon[30411]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:45:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:04 smithi162 ceph-mon[34833]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:45:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:04 smithi084 ceph-mon[30411]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:45:05.325 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:04 smithi191 ceph-mon[34667]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:45:07.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:06 smithi162 ceph-mon[34833]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T07:45:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:45:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:06 smithi084 ceph-mon[30411]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T07:45:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:45:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:07.308 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:06 smithi191 ceph-mon[34667]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T07:45:07.308 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:45:07.308 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:08.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:07 smithi191 ceph-mon[34667]: Deploying daemon osd.8 on smithi191 2024-09-21T07:45:08.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:07 smithi162 ceph-mon[34833]: Deploying daemon osd.8 on smithi191 2024-09-21T07:45:08.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:07 smithi084 ceph-mon[30411]: Deploying daemon osd.8 on smithi191 2024-09-21T07:45:09.092 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:08 smithi191 ceph-mon[34667]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:45:09.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:08 smithi162 ceph-mon[34833]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:45:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:08 smithi084 ceph-mon[30411]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:45:11.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:10 smithi191 ceph-mon[34667]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:45:11.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:10 smithi162 ceph-mon[34833]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:45:11.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:10 smithi084 ceph-mon[30411]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:45:13.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:12 smithi191 ceph-mon[34667]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:45:13.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:12 smithi162 ceph-mon[34833]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:45:13.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:12 smithi084 ceph-mon[30411]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:45:14.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:13 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:14.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:13 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:14.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:13 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:14.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:13 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:14.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:13 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:14.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:13 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:14.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:13 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:14.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:13 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:14.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:13 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:15.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:14 smithi162 ceph-mon[34833]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:15.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:14 smithi084 ceph-mon[30411]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:15.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:14 smithi191 ceph-mon[34667]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:17.077 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:16 smithi191 ceph-mon[34667]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:17.077 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.077 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.077 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:17.077 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:17.077 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.118+0000 7f92eaffd640 1 -- 172.21.15.191:0/217569567 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f92f4063800 con 0x7f92e00b65e0 2024-09-21T07:45:17.121 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 8 on host 'smithi191' 2024-09-21T07:45:17.126 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92e00b65e0 msgr2=0x7f92e00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:17.126 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92e00b65e0 0x7f92e00b8af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f92f4077160 tx=0x7f92ec00d040 comp rx=0 tx=0).stop 2024-09-21T07:45:17.126 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f4109e00 msgr2=0x7f92f4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:17.126 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f4109e00 0x7f92f4076190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e970 tx=0x7f92f000ed70 comp rx=0 tx=0).stop 2024-09-21T07:45:17.126 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 shutdown_connections 2024-09-21T07:45:17.126 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92e00b65e0 0x7f92e00b8af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:17.127 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f4109e00 0x7f92f4076190 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:17.127 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92f41094b0 0x7f92f4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:17.127 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 --2- 172.21.15.191:0/217569567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f4103bc0 0x7f92f4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:17.127 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 >> 172.21.15.191:0/217569567 conn(0x7f92f407b910 msgr2=0x7f92f4107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:45:17.127 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 shutdown_connections 2024-09-21T07:45:17.127 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:45:17.121+0000 7f92fc184640 1 -- 172.21.15.191:0/217569567 wait complete. 2024-09-21T07:45:17.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:16 smithi162 ceph-mon[34833]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:17.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:16 smithi084 ceph-mon[30411]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:17.809 DEBUG:teuthology.orchestra.run.smithi191:osd.8> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T07:45:17.811 INFO:tasks.cephadm:Deploying osd.9 on smithi084 with /dev/vg_nvme/lv_1... 2024-09-21T07:45:17.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:45:18.128 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:17 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:18.128 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:17 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:18.128 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:17 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:18.188 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:45:18.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:17 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:18.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:17 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:18.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:17 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:17 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:17 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:17 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:19.121 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 07:45:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T07:45:18.850+0000 7fce8e379640 -1 osd.8 0 log_to_monitors true 2024-09-21T07:45:19.383 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:19 smithi191 ceph-mon[34667]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:19.384 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:19 smithi191 ceph-mon[34667]: from='osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:45:19.384 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:19 smithi191 ceph-mon[34667]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:45:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:19 smithi162 ceph-mon[34833]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:19 smithi162 ceph-mon[34833]: from='osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:45:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:19 smithi162 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:45:19.555 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:19 smithi084 ceph-mon[30411]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:19.555 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:19 smithi084 ceph-mon[30411]: from='osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:45:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:19 smithi084 ceph-mon[30411]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:45:20.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:20 smithi084 ceph-mon[30411]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:45:20.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:20 smithi084 ceph-mon[30411]: from='osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:45:20.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:20 smithi084 ceph-mon[30411]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:45:20.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:20.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:20 smithi084 ceph-mon[30411]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:45:20.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:20 smithi084 ceph-mon[30411]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:20.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T07:45:20.141+0000 7fce8a2fb640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T07:45:20.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T07:45:20.153+0000 7fce860f9640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:45:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-mon[34667]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:45:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-mon[34667]: from='osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:45:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-mon[34667]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:45:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-mon[34667]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:45:20.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:20 smithi191 ceph-mon[34667]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:20.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:20 smithi162 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:45:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:20 smithi162 ceph-mon[34833]: from='osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:45:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:20 smithi162 ceph-mon[34833]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:45:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:20 smithi162 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:45:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:20 smithi162 ceph-mon[34833]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi191 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi191 to 5696M 2024-09-21T07:45:21.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:21.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:21.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] boot 2024-09-21T07:45:21.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:45:21.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:45:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T07:45:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi191 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi191 to 5696M 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] boot 2024-09-21T07:45:21.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:45:21.407 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi191 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi191 to 5696M 2024-09-21T07:45:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: osd.8 [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] boot 2024-09-21T07:45:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:45:21.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:45:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:45:21.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_1 2024-09-21T07:45:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:45:22.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:22 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:45:22.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:22 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:45:22.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:22 smithi191 ceph-mon[34667]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:22.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:22 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:45:22.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:22 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:45:22.444 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:22 smithi084 ceph-mon[30411]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:22.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:22 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:45:22.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:22 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:45:22.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:22 smithi162 ceph-mon[34833]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 -- 172.21.15.84:0/3235726751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b4105320 msgr2=0x7f46b410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 --2- 172.21.15.84:0/3235726751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b4105320 0x7f46b410d870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009900 tx=0x7f46a002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 -- 172.21.15.84:0/3235726751 shutdown_connections 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 --2- 172.21.15.84:0/3235726751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46b410de30 0x7f46b4110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 --2- 172.21.15.84:0/3235726751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b4105320 0x7f46b410d870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 --2- 172.21.15.84:0/3235726751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b41049d0 0x7f46b4104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 -- 172.21.15.84:0/3235726751 >> 172.21.15.84:0/3235726751 conn(0x7f46b4079740 msgr2=0x7f46b4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.619+0000 7f46bba00640 1 -- 172.21.15.84:0/3235726751 shutdown_connections 2024-09-21T07:45:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.620+0000 7f46bba00640 1 -- 172.21.15.84:0/3235726751 wait complete. 2024-09-21T07:45:22.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 Processor -- start 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 -- start start 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b41049d0 0x7f46b419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46b4105320 0x7f46b419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b410de30 0x7f46b41a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4113ae0 con 0x7f46b410de30 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4113960 con 0x7f46b4105320 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46bba00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4113c60 con 0x7f46b41049d0 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46b3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46b4105320 0x7f46b419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46b3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46b4105320 0x7f46b419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60834/0 (socket says 172.21.15.84:60834) 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46b9a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b410de30 0x7f46b41a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46b3e00640 1 -- 172.21.15.84:0/2533172736 learned_addr learned my addr 172.21.15.84:0/2533172736 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.621+0000 7f46b9000640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b41049d0 0x7f46b419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b9a00640 1 -- 172.21.15.84:0/2533172736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b41049d0 msgr2=0x7f46b419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b9a00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b41049d0 0x7f46b419c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b9a00640 1 -- 172.21.15.84:0/2533172736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46b4105320 msgr2=0x7f46b419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b9a00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46b4105320 0x7f46b419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b9a00640 1 -- 172.21.15.84:0/2533172736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b41a2660 con 0x7f46b410de30 2024-09-21T07:45:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b9000640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b41049d0 0x7f46b419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:45:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b9a00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b410de30 0x7f46b41a1f30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00e970 tx=0x7f46ac00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:45:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.622+0000 7f46b1600640 1 -- 172.21.15.84:0/2533172736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00ccc0 con 0x7f46b410de30 2024-09-21T07:45:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.623+0000 7f46b1600640 1 -- 172.21.15.84:0/2533172736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46ac005020 con 0x7f46b410de30 2024-09-21T07:45:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.623+0000 7f46b1600640 1 -- 172.21.15.84:0/2533172736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac004a00 con 0x7f46b410de30 2024-09-21T07:45:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.623+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41a2950 con 0x7f46b410de30 2024-09-21T07:45:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.623+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a90b0 con 0x7f46b410de30 2024-09-21T07:45:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.624+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b406c240 con 0x7f46b410de30 2024-09-21T07:45:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.628+0000 7f46b1600640 1 -- 172.21.15.84:0/2533172736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f46ac004ba0 con 0x7f46b410de30 2024-09-21T07:45:22.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.629+0000 7f46b1600640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f469c0b65e0 0x7f469c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.630+0000 7f46b1600640 1 -- 172.21.15.84:0/2533172736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6044+0+0 (secure 0 0 0) 0x7f46ac0e6af0 con 0x7f46b410de30 2024-09-21T07:45:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.630+0000 7f46b9000640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f469c0b65e0 0x7f469c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.630+0000 7f46b9000640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f469c0b65e0 0x7f469c0b8af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46b406c940 tx=0x7f46a8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:45:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.632+0000 7f46b1600640 1 -- 172.21.15.84:0/2533172736 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46ac0adc50 con 0x7f46b410de30 2024-09-21T07:45:22.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:22.831+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f46b410b340 con 0x7f469c0b65e0 2024-09-21T07:45:23.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:23 smithi084 ceph-mon[30411]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:45:23.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:23 smithi084 ceph-mon[30411]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:45:23.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:45:23.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:45:23.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:23 smithi162 ceph-mon[34833]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:45:23.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:23 smithi162 ceph-mon[34833]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:45:23.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:45:23.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:45:23.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:23.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:23 smithi191 ceph-mon[34667]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T07:45:23.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:23 smithi191 ceph-mon[34667]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:45:23.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:45:23.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:45:23.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:24.535 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:24 smithi084 ceph-mon[30411]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T07:45:24.535 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:24 smithi084 ceph-mon[30411]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:24.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:24 smithi162 ceph-mon[34833]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T07:45:24.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:24 smithi162 ceph-mon[34833]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:24.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:24 smithi191 ceph-mon[34667]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T07:45:24.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:24 smithi191 ceph-mon[34667]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:27.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:26 smithi162 ceph-mon[34833]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T07:45:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:26 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3722913455' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57b9d175-b40d-444d-9ff4-fee6682fb3b2"} : dispatch 2024-09-21T07:45:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:26 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3722913455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57b9d175-b40d-444d-9ff4-fee6682fb3b2"}]': finished 2024-09-21T07:45:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:26 smithi162 ceph-mon[34833]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:45:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:26 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:26 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2600566066' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:45:27.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:26 smithi084 ceph-mon[30411]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T07:45:27.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:26 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3722913455' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57b9d175-b40d-444d-9ff4-fee6682fb3b2"} : dispatch 2024-09-21T07:45:27.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:26 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3722913455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57b9d175-b40d-444d-9ff4-fee6682fb3b2"}]': finished 2024-09-21T07:45:27.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:26 smithi084 ceph-mon[30411]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:45:27.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:26 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:27.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:26 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2600566066' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:45:27.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:26 smithi191 ceph-mon[34667]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T07:45:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:26 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3722913455' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57b9d175-b40d-444d-9ff4-fee6682fb3b2"} : dispatch 2024-09-21T07:45:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:26 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3722913455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57b9d175-b40d-444d-9ff4-fee6682fb3b2"}]': finished 2024-09-21T07:45:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:26 smithi191 ceph-mon[34667]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:45:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:26 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:26 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2600566066' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:45:29.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:28 smithi162 ceph-mon[34833]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:45:29.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:28 smithi084 ceph-mon[30411]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:45:29.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:28 smithi191 ceph-mon[34667]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:45:31.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:30 smithi162 ceph-mon[34833]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T07:45:31.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:30 smithi084 ceph-mon[30411]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T07:45:31.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:30 smithi191 ceph-mon[34667]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T07:45:33.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:32 smithi162 ceph-mon[34833]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:45:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:32 smithi084 ceph-mon[30411]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:45:33.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:32 smithi191 ceph-mon[34667]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:45:35.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:35 smithi162 ceph-mon[34833]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:45:35.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:35 smithi084 ceph-mon[30411]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:45:35.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:35 smithi191 ceph-mon[34667]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:45:36.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:45:36.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:36.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:45:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:45:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:37.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:37 smithi162 ceph-mon[34833]: Deploying daemon osd.9 on smithi084 2024-09-21T07:45:37.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:37 smithi162 ceph-mon[34833]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:37 smithi084 ceph-mon[30411]: Deploying daemon osd.9 on smithi084 2024-09-21T07:45:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:37 smithi084 ceph-mon[30411]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:37.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:37 smithi191 ceph-mon[34667]: Deploying daemon osd.9 on smithi084 2024-09-21T07:45:37.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:37 smithi191 ceph-mon[34667]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:39.293 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:39 smithi084 ceph-mon[30411]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:39.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:39 smithi162 ceph-mon[34833]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:39.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:39 smithi191 ceph-mon[34667]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:41.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:41 smithi162 ceph-mon[34833]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:41.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:41 smithi084 ceph-mon[30411]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:41 smithi191 ceph-mon[34667]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:43.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:43 smithi084 ceph-mon[30411]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:43.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:43 smithi162 ceph-mon[34833]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:43.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:43 smithi191 ceph-mon[34667]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:44.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:44.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:44.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:44.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:44.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:44.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:44.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:44.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:44.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:45.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:45 smithi162 ceph-mon[34833]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:45.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:45 smithi084 ceph-mon[30411]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:45.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:45 smithi191 ceph-mon[34667]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:47.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:47 smithi162 ceph-mon[34833]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:47.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:47 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:47.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:47 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:47.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:47 smithi084 ceph-mon[30411]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:47.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:47 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:47.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:47 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:47.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:47 smithi191 ceph-mon[34667]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:47.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:47 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:47.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:47 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:48.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:48.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:48.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:48.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:48.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:48.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:48.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:48.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:48.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.588+0000 7f46b1600640 1 -- 172.21.15.84:0/2533172736 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f46b410b340 con 0x7f469c0b65e0 2024-09-21T07:45:48.590 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 9 on host 'smithi084' 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f469c0b65e0 msgr2=0x7f469c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f469c0b65e0 0x7f469c0b8af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46b406c940 tx=0x7f46a8009500 comp rx=0 tx=0).stop 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b410de30 msgr2=0x7f46b41a1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b410de30 0x7f46b41a1f30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00e970 tx=0x7f46ac00ee30 comp rx=0 tx=0).stop 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 shutdown_connections 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f469c0b65e0 0x7f469c0b8af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b410de30 0x7f46b41a1f30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46b4105320 0x7f46b419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 --2- 172.21.15.84:0/2533172736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b41049d0 0x7f46b419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 >> 172.21.15.84:0/2533172736 conn(0x7f46b4079740 msgr2=0x7f46b4109c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 shutdown_connections 2024-09-21T07:45:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:45:48.591+0000 7f46bba00640 1 -- 172.21.15.84:0/2533172736 wait complete. 2024-09-21T07:45:49.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:49 smithi162 ceph-mon[34833]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:49.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:49 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:49.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:49 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:49.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:49 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:49.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:49 smithi084 ceph-mon[30411]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:49.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:49 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:49.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:49 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:49.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:49 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:49 smithi191 ceph-mon[34667]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:49 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:49 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:49.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:49 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:49.522 DEBUG:teuthology.orchestra.run.smithi084:osd.9> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T07:45:49.526 INFO:tasks.cephadm:Deploying osd.10 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-21T07:45:49.526 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:45:49.785 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:45:49.837 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 07:45:49 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T07:45:49.731+0000 7fb665245640 -1 osd.9 0 log_to_monitors true 2024-09-21T07:45:50.220 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:50 smithi162 ceph-mon[34833]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:45:50.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:50 smithi084 ceph-mon[30411]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:45:50.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:50 smithi191 ceph-mon[34667]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:45:51.243 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:51 smithi162 ceph-mon[34833]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:51.243 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:51 smithi162 ceph-mon[34833]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:45:51.244 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:51 smithi162 ceph-mon[34833]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:45:51.244 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:51 smithi162 ceph-mon[34833]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:45:51.244 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:51 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:51.277 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:51 smithi084 ceph-mon[30411]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:51.277 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:51 smithi084 ceph-mon[30411]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:45:51.277 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:51 smithi084 ceph-mon[30411]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:45:51.277 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:51 smithi084 ceph-mon[30411]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:45:51.277 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:51 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:51.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:51 smithi191 ceph-mon[34667]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:51.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:51 smithi191 ceph-mon[34667]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:45:51.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:51 smithi191 ceph-mon[34667]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T07:45:51.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:51 smithi191 ceph-mon[34667]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T07:45:51.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:51 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:52.049 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 07:45:51 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T07:45:51.903+0000 7fb65fa00640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T07:45:52.049 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 07:45:51 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T07:45:51.927+0000 7fb655a00640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:45:52.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:52 smithi162 ceph-mon[34833]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:45:52.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:52 smithi162 ceph-mon[34833]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T07:45:52.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:52.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:52.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:52 smithi162 ceph-mon[34833]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' 2024-09-21T07:45:52.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:52 smithi084 ceph-mon[30411]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:45:52.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:52 smithi084 ceph-mon[30411]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T07:45:52.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:52.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:52.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:52 smithi084 ceph-mon[30411]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' 2024-09-21T07:45:52.344 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T07:45:52.372 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-21T07:45:52.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:52 smithi191 ceph-mon[34667]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T07:45:52.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:52 smithi191 ceph-mon[34667]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T07:45:52.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:52.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:52.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:52 smithi191 ceph-mon[34667]: from='osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825]' entity='osd.9' 2024-09-21T07:45:52.628 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 -- 172.21.15.162:0/653794192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc01083a0 msgr2=0x7f9bc01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 --2- 172.21.15.162:0/653794192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc01083a0 0x7f9bc01087b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009900 tx=0x7f9ba802a410 comp rx=0 tx=0).stop 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 -- 172.21.15.162:0/653794192 shutdown_connections 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 --2- 172.21.15.162:0/653794192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc0108cf0 0x7f9bc010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 --2- 172.21.15.162:0/653794192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc01083a0 0x7f9bc01087b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 --2- 172.21.15.162:0/653794192 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bc0102a60 0x7f9bc0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 -- 172.21.15.162:0/653794192 >> 172.21.15.162:0/653794192 conn(0x7f9bc0079730 msgr2=0x7f9bc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 -- 172.21.15.162:0/653794192 shutdown_connections 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 -- 172.21.15.162:0/653794192 wait complete. 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 Processor -- start 2024-09-21T07:45:53.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.099+0000 7f9bc5512640 1 -- start start 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bc5512640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0102a60 0x7f9bc01050e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bc5512640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bc01083a0 0x7f9bc0105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bc5512640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc0108cf0 0x7f9bc0105b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bc5512640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc01129c0 con 0x7f9bc0108cf0 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bc5512640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0112840 con 0x7f9bc0102a60 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bc5512640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0112b40 con 0x7f9bc01083a0 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0102a60 0x7f9bc01050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0102a60 0x7f9bc01050e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:54064/0 (socket says 172.21.15.162:54064) 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 -- 172.21.15.162:0/2780891514 learned_addr learned my addr 172.21.15.162:0/2780891514 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bb7fff640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bc01083a0 0x7f9bc0105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbf7fe640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc0108cf0 0x7f9bc0105b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 -- 172.21.15.162:0/2780891514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bc01083a0 msgr2=0x7f9bc0105620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bc01083a0 0x7f9bc0105620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 -- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc0108cf0 msgr2=0x7f9bc0105b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:45:53.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc0108cf0 0x7f9bc0105b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 -- 172.21.15.162:0/2780891514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc01a8750 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbeffd640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0102a60 0x7f9bc01050e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d770 tx=0x7f9bb000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.100+0000 7f9bbcff9640 1 -- 172.21.15.162:0/2780891514 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0017070 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.101+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc01a8a40 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.101+0000 7f9bbcff9640 1 -- 172.21.15.162:0/2780891514 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb00054d0 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.101+0000 7f9bbcff9640 1 -- 172.21.15.162:0/2780891514 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0004c30 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.101+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc01a8fd0 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.102+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc0102e70 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.103+0000 7f9bbcff9640 1 -- 172.21.15.162:0/2780891514 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f9bb0004dd0 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.104+0000 7f9bbcff9640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9bac0b6560 0x7f9bac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.104+0000 7f9bbcff9640 1 -- 172.21.15.162:0/2780891514 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6476+0+0 (secure 0 0 0) 0x7f9bb00e6a30 con 0x7f9bc0102a60 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.104+0000 7f9bb7fff640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9bac0b6560 0x7f9bac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.105+0000 7f9bb7fff640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9bac0b6560 0x7f9bac0b8a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000c00 tx=0x7f9ba8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:45:53.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.107+0000 7f9bbcff9640 1 -- 172.21.15.162:0/2780891514 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9bb00b1dd0 con 0x7f9bc0102a60 2024-09-21T07:45:53.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:53 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:45:53.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:53 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:45:53.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:53 smithi162 ceph-mon[34833]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:53.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:53.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:53 smithi162 ceph-mon[34833]: osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] boot 2024-09-21T07:45:53.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:53 smithi162 ceph-mon[34833]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:45:53.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:53.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:45:53.303+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9bc0063800 con 0x7f9bac0b6560 2024-09-21T07:45:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:53 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:45:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:53 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:45:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:53 smithi084 ceph-mon[30411]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:53 smithi084 ceph-mon[30411]: osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] boot 2024-09-21T07:45:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:53 smithi084 ceph-mon[30411]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:45:53.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:53 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:45:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:53 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:45:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:53 smithi191 ceph-mon[34667]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:45:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:53 smithi191 ceph-mon[34667]: osd.9 [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] boot 2024-09-21T07:45:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:53 smithi191 ceph-mon[34667]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T07:45:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:45:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:45:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:45:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:54.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:54.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:54 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:54.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:54.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:54 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:45:54.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:45:54.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:54.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:45:54.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:54.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:54.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:54.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:54 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:45:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:55 smithi162 ceph-mon[34833]: from='client.24578 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:45:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:55 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi084 2024-09-21T07:45:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:55 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T07:45:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:55 smithi162 ceph-mon[34833]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:55 smithi162 ceph-mon[34833]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T07:45:55.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:55 smithi084 ceph-mon[30411]: from='client.24578 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:45:55.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:55 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi084 2024-09-21T07:45:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:55 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T07:45:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:55 smithi084 ceph-mon[30411]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:55.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:55 smithi084 ceph-mon[30411]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T07:45:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:55 smithi191 ceph-mon[34667]: from='client.24578 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:45:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:55 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi084 2024-09-21T07:45:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:55 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T07:45:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:55 smithi191 ceph-mon[34667]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:55 smithi191 ceph-mon[34667]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T07:45:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:56 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/3682135317' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"} : dispatch 2024-09-21T07:45:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:56 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"} : dispatch 2024-09-21T07:45:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:56 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"}]': finished 2024-09-21T07:45:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:56 smithi162 ceph-mon[34833]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:45:56.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:45:56.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:56 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/3682135317' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"} : dispatch 2024-09-21T07:45:56.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:56 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"} : dispatch 2024-09-21T07:45:56.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:56 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"}]': finished 2024-09-21T07:45:56.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:56 smithi191 ceph-mon[34667]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:45:56.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:45:56.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:56 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/3682135317' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"} : dispatch 2024-09-21T07:45:56.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:56 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"} : dispatch 2024-09-21T07:45:56.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:56 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e440b17d-d229-459b-82ab-3f60f7842cfa"}]': finished 2024-09-21T07:45:56.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:56 smithi084 ceph-mon[30411]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:45:56.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:45:57.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:57 smithi191 ceph-mon[34667]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:57.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:57 smithi191 ceph-mon[34667]: from='client.? 172.21.15.162:0/2681002650' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:45:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:57 smithi162 ceph-mon[34833]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:57.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:57 smithi162 ceph-mon[34833]: from='client.? 172.21.15.162:0/2681002650' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:45:57.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:57 smithi084 ceph-mon[30411]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:57.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:57 smithi084 ceph-mon[30411]: from='client.? 172.21.15.162:0/2681002650' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:45:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:45:59 smithi191 ceph-mon[34667]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:59.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:45:59 smithi162 ceph-mon[34833]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:45:59.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:45:59 smithi084 ceph-mon[30411]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:01.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:01 smithi162 ceph-mon[34833]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:01.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:01 smithi191 ceph-mon[34667]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:01.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:01 smithi084 ceph-mon[30411]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:03.137 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:03 smithi162 ceph-mon[34833]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:03 smithi084 ceph-mon[30411]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:03 smithi191 ceph-mon[34667]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:05 smithi084 ceph-mon[30411]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:05 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:46:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:05 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:05 smithi191 ceph-mon[34667]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:05 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:46:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:05 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:05.459 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:05 smithi162 ceph-mon[34833]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:05.459 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:05 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:46:05.459 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:05 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:06.331 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:06 smithi162 ceph-mon[34833]: Deploying daemon osd.10 on smithi162 2024-09-21T07:46:06.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:06 smithi191 ceph-mon[34667]: Deploying daemon osd.10 on smithi162 2024-09-21T07:46:06.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:06 smithi084 ceph-mon[30411]: Deploying daemon osd.10 on smithi162 2024-09-21T07:46:07.285 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:07 smithi162 ceph-mon[34833]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:07 smithi191 ceph-mon[34667]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:07.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:07 smithi084 ceph-mon[30411]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:09 smithi162 ceph-mon[34833]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:09.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:09 smithi191 ceph-mon[34667]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:09.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:09 smithi084 ceph-mon[30411]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:11.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:11 smithi162 ceph-mon[34833]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:11.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:11 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:11.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:11 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:11.287 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:11 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:11 smithi191 ceph-mon[34667]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:11 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:11 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:11 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:11.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:11 smithi084 ceph-mon[30411]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:11.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:11 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:11.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:11 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:11.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:11 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:13.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:13 smithi162 ceph-mon[34833]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:13.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:13 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:13.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:13 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:13.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:13 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:13.333 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:13 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:13 smithi191 ceph-mon[34667]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:13 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:13 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:13 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:13 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:13.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:13 smithi084 ceph-mon[30411]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:13.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:13 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:13.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:13 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:13.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:13 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:13.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:13 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:13.703 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 10 on host 'smithi162' 2024-09-21T07:46:13.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.701+0000 7f9bbcff9640 1 -- 172.21.15.162:0/2780891514 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9bc0063800 con 0x7f9bac0b6560 2024-09-21T07:46:13.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.703+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9bac0b6560 msgr2=0x7f9bac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:13.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9bac0b6560 0x7f9bac0b8a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000c00 tx=0x7f9ba8031400 comp rx=0 tx=0).stop 2024-09-21T07:46:13.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0102a60 msgr2=0x7f9bc01050e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:13.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0102a60 0x7f9bc01050e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d770 tx=0x7f9bb000dc30 comp rx=0 tx=0).stop 2024-09-21T07:46:13.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 shutdown_connections 2024-09-21T07:46:13.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9bac0b6560 0x7f9bac0b8a70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:13.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc0108cf0 0x7f9bc0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:13.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bc01083a0 0x7f9bc0105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:13.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 --2- 172.21.15.162:0/2780891514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0102a60 0x7f9bc01050e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:13.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 >> 172.21.15.162:0/2780891514 conn(0x7f9bc0079730 msgr2=0x7f9bc006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:13.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 shutdown_connections 2024-09-21T07:46:13.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T07:46:13.704+0000 7f9bc5512640 1 -- 172.21.15.162:0/2780891514 wait complete. 2024-09-21T07:46:14.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:14.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.413 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.413 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:14.413 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.413 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.440 DEBUG:teuthology.orchestra.run.smithi162:osd.10> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T07:46:14.442 INFO:tasks.cephadm:Deploying osd.11 on smithi191 with /dev/vg_nvme/lv_1... 2024-09-21T07:46:14.442 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:46:14.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:14.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:14.701 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:46:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:15 smithi191 ceph-mon[34667]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:15.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:15 smithi162 ceph-mon[34833]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:15.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:15 smithi084 ceph-mon[30411]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:16.802 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 07:46:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T07:46:16.516+0000 7f25ef0d3640 -1 osd.10 0 log_to_monitors true 2024-09-21T07:46:17.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:17 smithi162 ceph-mon[34833]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:17 smithi162 ceph-mon[34833]: from='osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:46:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:17 smithi162 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:46:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:17 smithi191 ceph-mon[34667]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:17 smithi191 ceph-mon[34667]: from='osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:46:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:17 smithi191 ceph-mon[34667]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:46:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-21T07:46:17.502 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi191:vg_nvme/lv_1 2024-09-21T07:46:17.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:17 smithi084 ceph-mon[30411]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:17.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:17 smithi084 ceph-mon[30411]: from='osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:46:17.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:17 smithi084 ceph-mon[30411]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:46:17.759 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:46:18.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 -- 172.21.15.191:0/990574331 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 msgr2=0x7f796410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:18.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 --2- 172.21.15.191:0/990574331 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 0x7f796410f520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f795c009ca0 tx=0x7f795c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 -- 172.21.15.191:0/990574331 shutdown_connections 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 --2- 172.21.15.191:0/990574331 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 0x7f796410f520 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 --2- 172.21.15.191:0/990574331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79641083a0 0x7f79641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 --2- 172.21.15.191:0/990574331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7964102a60 0x7f7964102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 -- 172.21.15.191:0/990574331 >> 172.21.15.191:0/990574331 conn(0x7f7964079730 msgr2=0x7f7964079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 -- 172.21.15.191:0/990574331 shutdown_connections 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.243+0000 7f796a3d9640 1 -- 172.21.15.191:0/990574331 wait complete. 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.244+0000 7f796a3d9640 1 Processor -- start 2024-09-21T07:46:18.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.244+0000 7f796a3d9640 1 -- start start 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f796a3d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7964102a60 0x7f79640ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f796a3d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79641083a0 0x7f79640ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f796a3d9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 0x7f79641000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f796a3d9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7964112960 con 0x7f79641083a0 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f796a3d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79641127e0 con 0x7f7964102a60 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f796a3d9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7964112ae0 con 0x7f7964108cf0 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7968976640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 0x7f79641000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7964102a60 0x7f79640ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7964102a60 0x7f79640ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.191:50634/0 (socket says 172.21.15.191:50634) 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7968976640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 0x7f79641000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:33986/0 (socket says 172.21.15.191:33986) 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 -- 172.21.15.191:0/2195101626 learned_addr learned my addr 172.21.15.191:0/2195101626 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-21T07:46:18.248 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 -- 172.21.15.191:0/2195101626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 msgr2=0x7f79641000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 0x7f79641000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 -- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79641083a0 msgr2=0x7f79640ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f79637fe640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79641083a0 0x7f79640ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79641083a0 0x7f79640ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 -- 172.21.15.191:0/2195101626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79641a8760 con 0x7f7964102a60 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.245+0000 7f7963fff640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7964102a60 0x7f79640ff670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f795400d950 tx=0x7f795400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.246+0000 7f79617fa640 1 -- 172.21.15.191:0/2195101626 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954017070 con 0x7f7964102a60 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.246+0000 7f79617fa640 1 -- 172.21.15.191:0/2195101626 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7954009c30 con 0x7f7964102a60 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.246+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79641a8a50 con 0x7f7964102a60 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.246+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79641a8f90 con 0x7f7964102a60 2024-09-21T07:46:18.249 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.246+0000 7f79617fa640 1 -- 172.21.15.191:0/2195101626 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795400f620 con 0x7f7964102a60 2024-09-21T07:46:18.250 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.247+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7964102e70 con 0x7f7964102a60 2024-09-21T07:46:18.250 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.249+0000 7f79617fa640 1 -- 172.21.15.191:0/2195101626 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f7954005030 con 0x7f7964102a60 2024-09-21T07:46:18.251 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.249+0000 7f79617fa640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f794c0b6560 0x7f794c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:18.251 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.250+0000 7f79617fa640 1 -- 172.21.15.191:0/2195101626 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6629+0+0 (secure 0 0 0) 0x7f79540e6930 con 0x7f7964102a60 2024-09-21T07:46:18.251 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.250+0000 7f79637fe640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f794c0b6560 0x7f794c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:18.251 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.250+0000 7f79637fe640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f794c0b6560 0x7f794c0b8a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f796406a2a0 tx=0x7f7958005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:18.254 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.253+0000 7f79617fa640 1 -- 172.21.15.191:0/2195101626 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79540ad850 con 0x7f7964102a60 2024-09-21T07:46:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:46:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:46:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:46:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:46:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:18.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:18 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.449 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:18.447+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7964063800 con 0x7f794c0b6560 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:18.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:18.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:18.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:18.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:18.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:18.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:18 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:19.122 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T07:46:18.812+0000 7f25eb055640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T07:46:19.122 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 07:46:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T07:46:18.827+0000 7f25e2e4b640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi162 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:19 smithi191 ceph-mon[34667]: from='osd.10 ' entity='osd.10' 2024-09-21T07:46:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi162 2024-09-21T07:46:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:19.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:19 smithi162 ceph-mon[34833]: from='osd.10 ' entity='osd.10' 2024-09-21T07:46:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi162 2024-09-21T07:46:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T07:46:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:19.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:19 smithi084 ceph-mon[30411]: from='osd.10 ' entity='osd.10' 2024-09-21T07:46:20.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:20 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:46:20.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:20 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:46:20.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:20 smithi191 ceph-mon[34667]: from='client.24605 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:46:20.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:20.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:20 smithi191 ceph-mon[34667]: osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] boot 2024-09-21T07:46:20.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:20 smithi191 ceph-mon[34667]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:46:20.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:20 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:46:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:20 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:46:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:20 smithi162 ceph-mon[34833]: from='client.24605 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:46:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:20 smithi162 ceph-mon[34833]: osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] boot 2024-09-21T07:46:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:20 smithi162 ceph-mon[34833]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:46:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:20.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:20 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:46:20.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:20 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:46:20.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:20 smithi084 ceph-mon[30411]: from='client.24605 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:46:20.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:20.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:20 smithi084 ceph-mon[30411]: osd.10 [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] boot 2024-09-21T07:46:20.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:20 smithi084 ceph-mon[30411]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:46:20.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:46:21.377 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:21 smithi191 ceph-mon[34667]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:21.377 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:21 smithi191 ceph-mon[34667]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:46:21.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:21 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/1738707204' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"} : dispatch 2024-09-21T07:46:21.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:21 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"} : dispatch 2024-09-21T07:46:21.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:21 smithi191 ceph-mon[34667]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"}]': finished 2024-09-21T07:46:21.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:21 smithi191 ceph-mon[34667]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:46:21.378 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:21 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:21.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:21 smithi162 ceph-mon[34833]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:21 smithi162 ceph-mon[34833]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:46:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:21 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/1738707204' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"} : dispatch 2024-09-21T07:46:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:21 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"} : dispatch 2024-09-21T07:46:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:21 smithi162 ceph-mon[34833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"}]': finished 2024-09-21T07:46:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:21 smithi162 ceph-mon[34833]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:46:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:21 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:21.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:21 smithi084 ceph-mon[30411]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:46:21.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:21 smithi084 ceph-mon[30411]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T07:46:21.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:21 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/1738707204' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"} : dispatch 2024-09-21T07:46:21.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:21 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"} : dispatch 2024-09-21T07:46:21.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:21 smithi084 ceph-mon[30411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52ebe031-ba58-4e7f-9172-3a61ac5cedaa"}]': finished 2024-09-21T07:46:21.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:21 smithi084 ceph-mon[30411]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:46:21.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:21 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:22.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:22 smithi191 ceph-mon[34667]: from='client.? 172.21.15.191:0/1907563641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:46:22.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:22 smithi162 ceph-mon[34833]: from='client.? 172.21.15.191:0/1907563641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:46:22.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:22 smithi084 ceph-mon[30411]: from='client.? 172.21.15.191:0/1907563641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:46:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:23 smithi191 ceph-mon[34667]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:23 smithi162 ceph-mon[34833]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:23.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:23 smithi084 ceph-mon[30411]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:25 smithi191 ceph-mon[34667]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:25.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:25 smithi162 ceph-mon[34833]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:25.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:25 smithi084 ceph-mon[30411]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:27.331 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:27 smithi191 ceph-mon[34667]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T07:46:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:27 smithi162 ceph-mon[34833]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T07:46:27.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:27 smithi084 ceph-mon[30411]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T07:46:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:28 smithi191 ceph-mon[34667]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:46:28.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:28 smithi162 ceph-mon[34833]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:46:28.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:28 smithi084 ceph-mon[30411]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:46:29.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:46:29.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:30.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:46:30.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:30.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:46:30.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:31.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:30 smithi191 ceph-mon[34667]: Deploying daemon osd.11 on smithi191 2024-09-21T07:46:31.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:30 smithi191 ceph-mon[34667]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T07:46:31.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:30 smithi162 ceph-mon[34833]: Deploying daemon osd.11 on smithi191 2024-09-21T07:46:31.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:30 smithi162 ceph-mon[34833]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T07:46:31.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:30 smithi084 ceph-mon[30411]: Deploying daemon osd.11 on smithi191 2024-09-21T07:46:31.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:30 smithi084 ceph-mon[30411]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T07:46:33.239 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:33 smithi191 ceph-mon[34667]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:46:33.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:33 smithi162 ceph-mon[34833]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:46:33.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:33 smithi084 ceph-mon[30411]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T07:46:35.246 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:35 smithi191 ceph-mon[34667]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:46:35.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:35 smithi162 ceph-mon[34833]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:46:35.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:35 smithi084 ceph-mon[30411]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:46:36.161 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:36.161 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:36.162 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:36.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:36.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:36.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:36.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:37.192 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:37 smithi191 ceph-mon[34667]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:46:37.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:37 smithi162 ceph-mon[34833]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:46:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:37 smithi084 ceph-mon[30411]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:46:38.725 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.724+0000 7f79617fa640 1 -- 172.21.15.191:0/2195101626 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f7964063800 con 0x7f794c0b6560 2024-09-21T07:46:38.726 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 11 on host 'smithi191' 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f794c0b6560 msgr2=0x7f794c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f794c0b6560 0x7f794c0b8a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f796406a2a0 tx=0x7f7958005f90 comp rx=0 tx=0).stop 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7964102a60 msgr2=0x7f79640ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7964102a60 0x7f79640ff670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f795400d950 tx=0x7f795400de10 comp rx=0 tx=0).stop 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 shutdown_connections 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f794c0b6560 0x7f794c0b8a70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7964108cf0 0x7f79641000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:38.728 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79641083a0 0x7f79640ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:38.729 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 --2- 172.21.15.191:0/2195101626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7964102a60 0x7f79640ff670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:38.729 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 >> 172.21.15.191:0/2195101626 conn(0x7f7964079730 msgr2=0x7f796406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:38.729 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.726+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 shutdown_connections 2024-09-21T07:46:38.729 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:38.727+0000 7f796a3d9640 1 -- 172.21.15.191:0/2195101626 wait complete. 2024-09-21T07:46:39.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:39 smithi162 ceph-mon[34833]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:39.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:39.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:39 smithi084 ceph-mon[30411]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:39.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:39.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:39.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:39 smithi191 ceph-mon[34667]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:39.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:39.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:39.507 DEBUG:teuthology.orchestra.run.smithi191:osd.11> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T07:46:39.509 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T07:46:39.509 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:46:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 -- 172.21.15.84:0/4008168496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481039b0 msgr2=0x7fc448103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 --2- 172.21.15.84:0/4008168496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481039b0 0x7fc448103dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc438009900 tx=0x7fc43802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 -- 172.21.15.84:0/4008168496 shutdown_connections 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 --2- 172.21.15.84:0/4008168496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc448109c40 0x7fc448110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 --2- 172.21.15.84:0/4008168496 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481092f0 0x7fc448109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 --2- 172.21.15.84:0/4008168496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481039b0 0x7fc448103dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 -- 172.21.15.84:0/4008168496 >> 172.21.15.84:0/4008168496 conn(0x7fc4480ff440 msgr2=0x7fc448101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.525+0000 7fc447200640 1 -- 172.21.15.84:0/4008168496 shutdown_connections 2024-09-21T07:46:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.526+0000 7fc447200640 1 -- 172.21.15.84:0/4008168496 wait complete. 2024-09-21T07:46:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.526+0000 7fc447200640 1 Processor -- start 2024-09-21T07:46:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc447200640 1 -- start start 2024-09-21T07:46:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc447200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481039b0 0x7fc448075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc447200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481092f0 0x7fc448075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc447200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc448109c40 0x7fc448076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc447200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc448113950 con 0x7fc4481092f0 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc447200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481137d0 con 0x7fc448109c40 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc447200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc448113ad0 con 0x7fc4481039b0 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc445e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481039b0 0x7fc448075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc445400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481092f0 0x7fc448075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc445e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481039b0 0x7fc448075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42260/0 (socket says 172.21.15.84:42260) 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc445e00640 1 -- 172.21.15.84:0/932590599 learned_addr learned my addr 172.21.15.84:0/932590599 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.527+0000 7fc446800640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc448109c40 0x7fc448076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc445e00640 1 -- 172.21.15.84:0/932590599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc448109c40 msgr2=0x7fc448076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc445e00640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc448109c40 0x7fc448076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc445e00640 1 -- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481092f0 msgr2=0x7fc448075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:40.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc445e00640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481092f0 0x7fc448075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc445e00640 1 -- 172.21.15.84:0/932590599 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4481a8680 con 0x7fc4481039b0 2024-09-21T07:46:40.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc445e00640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481039b0 0x7fc448075710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc438005ab0 tx=0x7fc438003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc43ea00640 1 -- 172.21.15.84:0/932590599 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43803f070 con 0x7fc4481039b0 2024-09-21T07:46:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc43ea00640 1 -- 172.21.15.84:0/932590599 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc438031b60 con 0x7fc4481039b0 2024-09-21T07:46:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4481a8910 con 0x7fc4481039b0 2024-09-21T07:46:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.528+0000 7fc43ea00640 1 -- 172.21.15.84:0/932590599 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438035030 con 0x7fc4481039b0 2024-09-21T07:46:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.529+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481a8df0 con 0x7fc4481039b0 2024-09-21T07:46:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.529+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc448103dc0 con 0x7fc4481039b0 2024-09-21T07:46:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.532+0000 7fc43ea00640 1 -- 172.21.15.84:0/932590599 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc438042070 con 0x7fc4481039b0 2024-09-21T07:46:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.533+0000 7fc43ea00640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc42c0b6560 0x7fc42c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.534+0000 7fc43ea00640 1 -- 172.21.15.84:0/932590599 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7fc438107cb0 con 0x7fc4481039b0 2024-09-21T07:46:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.534+0000 7fc445400640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc42c0b6560 0x7fc42c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.534+0000 7fc445400640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc42c0b6560 0x7fc42c0b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc448108e90 tx=0x7fc434005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.535+0000 7fc43ea00640 1 -- 172.21.15.84:0/932590599 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4380d2db0 con 0x7fc4481039b0 2024-09-21T07:46:40.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.728+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc44802e640 con 0x7fc4481039b0 2024-09-21T07:46:40.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.728+0000 7fc43ea00640 1 -- 172.21.15.84:0/932590599 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7fc4380d7cf0 con 0x7fc4481039b0 2024-09-21T07:46:40.730 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:46:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.730+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc42c0b6560 msgr2=0x7fc42c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.730+0000 7fc447200640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc42c0b6560 0x7fc42c0b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc448108e90 tx=0x7fc434005f90 comp rx=0 tx=0).stop 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481039b0 msgr2=0x7fc448075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481039b0 0x7fc448075710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc438005ab0 tx=0x7fc438003c10 comp rx=0 tx=0).stop 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 shutdown_connections 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc42c0b6560 0x7fc42c0b8a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc448109c40 0x7fc448076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4481092f0 0x7fc448075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 --2- 172.21.15.84:0/932590599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4481039b0 0x7fc448075710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 >> 172.21.15.84:0/932590599 conn(0x7fc4480ff440 msgr2=0x7fc448101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 shutdown_connections 2024-09-21T07:46:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:40.731+0000 7fc447200640 1 -- 172.21.15.84:0/932590599 wait complete. 2024-09-21T07:46:40.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:40.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:40.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:40 smithi191 ceph-mon[34667]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:41.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:41.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:41.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:40 smithi162 ceph-mon[34833]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:41.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:41.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:41.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:40 smithi084 ceph-mon[30411]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:41.588 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726904779,"num_in_osds":12,"osd_in_since":1726904781,"num_remapped_pgs":0} 2024-09-21T07:46:41.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:41 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/932590599' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:41.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:41 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/932590599' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:41.905 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 07:46:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T07:46:41.847+0000 7f5eee296640 -1 osd.11 0 log_to_monitors true 2024-09-21T07:46:42.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:41 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/932590599' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:42.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:46:42.796 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:42 smithi191 ceph-mon[34667]: from='osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:46:42.796 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:42 smithi191 ceph-mon[34667]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:46:42.796 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:42 smithi191 ceph-mon[34667]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:42.946 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:42 smithi084 ceph-mon[30411]: from='osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:46:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:42 smithi084 ceph-mon[30411]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:46:42.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:42 smithi084 ceph-mon[30411]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:42.993 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:46:43.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:42 smithi162 ceph-mon[34833]: from='osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:46:43.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:42 smithi162 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:46:43.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:42 smithi162 ceph-mon[34833]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 -- 172.21.15.84:0/2783741283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6810ff70 msgr2=0x7f2f68112390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 --2- 172.21.15.84:0/2783741283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6810ff70 0x7f2f68112390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009ca0 tx=0x7f2f6002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 -- 172.21.15.84:0/2783741283 shutdown_connections 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 --2- 172.21.15.84:0/2783741283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6810ff70 0x7f2f68112390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 --2- 172.21.15.84:0/2783741283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f68076080 0x7f2f6810fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 --2- 172.21.15.84:0/2783741283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68075730 0x7f2f68075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 -- 172.21.15.84:0/2783741283 >> 172.21.15.84:0/2783741283 conn(0x7f2f680ff3e0 msgr2=0x7f2f68101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 -- 172.21.15.84:0/2783741283 shutdown_connections 2024-09-21T07:46:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.587+0000 7f2f67e00640 1 -- 172.21.15.84:0/2783741283 wait complete. 2024-09-21T07:46:43.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.588+0000 7f2f67e00640 1 Processor -- start 2024-09-21T07:46:43.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f67e00640 1 -- start start 2024-09-21T07:46:43.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f67e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f68075730 0x7f2f6819c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f67e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68076080 0x7f2f6819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f67e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f6810ff70 0x7f2f681a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f67e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68115ab0 con 0x7f2f68075730 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f67e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68115930 con 0x7f2f68076080 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f67e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68115c30 con 0x7f2f6810ff70 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f66a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f68075730 0x7f2f6819c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f66000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68076080 0x7f2f6819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f66a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f68075730 0x7f2f6819c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43752/0 (socket says 172.21.15.84:43752) 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f66000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68076080 0x7f2f6819ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:51074/0 (socket says 172.21.15.84:51074) 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.589+0000 7f2f66a00640 1 -- 172.21.15.84:0/3778697025 learned_addr learned my addr 172.21.15.84:0/3778697025 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f67400640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f6810ff70 0x7f2f681a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f66a00640 1 -- 172.21.15.84:0/3778697025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f6810ff70 msgr2=0x7f2f681a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:43.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f66a00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f6810ff70 0x7f2f681a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f66a00640 1 -- 172.21.15.84:0/3778697025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68076080 msgr2=0x7f2f6819ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f66a00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68076080 0x7f2f6819ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f66a00640 1 -- 172.21.15.84:0/3778697025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f681a2450 con 0x7f2f68075730 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f67400640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f6810ff70 0x7f2f681a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f66000640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68076080 0x7f2f6819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f66a00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f68075730 0x7f2f6819c4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800ea60 tx=0x7f2f5800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.590+0000 7f2f5f400640 1 -- 172.21.15.84:0/3778697025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5800cde0 con 0x7f2f68075730 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.591+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f681a2740 con 0x7f2f68075730 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.591+0000 7f2f5f400640 1 -- 172.21.15.84:0/3778697025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f580035f0 con 0x7f2f68075730 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.591+0000 7f2f5f400640 1 -- 172.21.15.84:0/3778697025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58010690 con 0x7f2f68075730 2024-09-21T07:46:43.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.591+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f681a8ea0 con 0x7f2f68075730 2024-09-21T07:46:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.592+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f68075b40 con 0x7f2f68075730 2024-09-21T07:46:43.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.594+0000 7f2f5f400640 1 -- 172.21.15.84:0/3778697025 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2f580037a0 con 0x7f2f68075730 2024-09-21T07:46:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.597+0000 7f2f5f400640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f4c0b65e0 0x7f2f4c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.597+0000 7f2f5f400640 1 -- 172.21.15.84:0/3778697025 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7046+0+0 (secure 0 0 0) 0x7f2f580e7630 con 0x7f2f68075730 2024-09-21T07:46:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.597+0000 7f2f66000640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f4c0b65e0 0x7f2f4c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.598+0000 7f2f66000640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f4c0b65e0 0x7f2f4c0b8af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f68112390 tx=0x7f2f54005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.599+0000 7f2f5f400640 1 -- 172.21.15.84:0/3778697025 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f580ae310 con 0x7f2f68075730 2024-09-21T07:46:43.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.795+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2f681a9270 con 0x7f2f68075730 2024-09-21T07:46:43.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.796+0000 7f2f5f400640 1 -- 172.21.15.84:0/3778697025 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f2f580b26f0 con 0x7f2f68075730 2024-09-21T07:46:43.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:46:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f4c0b65e0 msgr2=0x7f2f4c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f4c0b65e0 0x7f2f4c0b8af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f68112390 tx=0x7f2f54005f90 comp rx=0 tx=0).stop 2024-09-21T07:46:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f68075730 msgr2=0x7f2f6819c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f68075730 0x7f2f6819c4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800ea60 tx=0x7f2f5800ef20 comp rx=0 tx=0).stop 2024-09-21T07:46:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 shutdown_connections 2024-09-21T07:46:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f4c0b65e0 0x7f2f4c0b8af0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f6810ff70 0x7f2f681a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f68076080 0x7f2f6819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 --2- 172.21.15.84:0/3778697025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f68075730 0x7f2f6819c4e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 >> 172.21.15.84:0/3778697025 conn(0x7f2f680ff3e0 msgr2=0x7f2f68109aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 shutdown_connections 2024-09-21T07:46:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:43.798+0000 7f2f67e00640 1 -- 172.21.15.84:0/3778697025 wait complete. 2024-09-21T07:46:43.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:46:43.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:46:43.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:46:43.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:43.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:46:43.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: Detected new or changed devices on smithi191 2024-09-21T07:46:43.953 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi191 to 4272M 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:43.954 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:43 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: Detected new or changed devices on smithi191 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi191 to 4272M 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:44.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:43 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]} : dispatch 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: Detected new or changed devices on smithi191 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi191 to 4272M 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:44.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:44.157 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:43 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:44.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T07:46:44.335+0000 7f5eeaa2d640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T07:46:44.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T07:46:44.348+0000 7f5ee200e640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:46:44.685 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726904779,"num_in_osds":12,"osd_in_since":1726904781,"num_remapped_pgs":0} 2024-09-21T07:46:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:44 smithi162 ceph-mon[34833]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:46:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:44 smithi162 ceph-mon[34833]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:46:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:44 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3778697025' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:44 smithi162 ceph-mon[34833]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:44 smithi162 ceph-mon[34833]: from='osd.11 ' entity='osd.11' 2024-09-21T07:46:45.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:44 smithi084 ceph-mon[30411]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:46:45.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:44 smithi084 ceph-mon[30411]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:46:45.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:45.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:45.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:44 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3778697025' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:45.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:44 smithi084 ceph-mon[30411]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:45.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:44 smithi084 ceph-mon[30411]: from='osd.11 ' entity='osd.11' 2024-09-21T07:46:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-mon[34667]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-21T07:46:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-mon[34667]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T07:46:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3778697025' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-mon[34667]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:46:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:44 smithi191 ceph-mon[34667]: from='osd.11 ' entity='osd.11' 2024-09-21T07:46:45.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:46:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:45 smithi162 ceph-mon[34833]: purged_snaps scrub starts 2024-09-21T07:46:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:45 smithi162 ceph-mon[34833]: purged_snaps scrub ok 2024-09-21T07:46:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:45 smithi162 ceph-mon[34833]: osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] boot 2024-09-21T07:46:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:45 smithi162 ceph-mon[34833]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:46:46.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:46.054 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:46:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:45 smithi084 ceph-mon[30411]: purged_snaps scrub starts 2024-09-21T07:46:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:45 smithi084 ceph-mon[30411]: purged_snaps scrub ok 2024-09-21T07:46:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:45 smithi084 ceph-mon[30411]: osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] boot 2024-09-21T07:46:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:45 smithi084 ceph-mon[30411]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:46:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:46.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:45 smithi191 ceph-mon[34667]: purged_snaps scrub starts 2024-09-21T07:46:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:45 smithi191 ceph-mon[34667]: purged_snaps scrub ok 2024-09-21T07:46:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:45 smithi191 ceph-mon[34667]: osd.11 [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] boot 2024-09-21T07:46:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:45 smithi191 ceph-mon[34667]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:46:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:46:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.704+0000 7fe707600640 1 -- 172.21.15.84:0/401959657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010c040 msgr2=0x7fe700112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.704+0000 7fe707600640 1 --2- 172.21.15.84:0/401959657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010c040 0x7fe700112870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009ca0 tx=0x7fe6f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.705+0000 7fe707600640 1 -- 172.21.15.84:0/401959657 shutdown_connections 2024-09-21T07:46:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.705+0000 7fe707600640 1 --2- 172.21.15.84:0/401959657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010c040 0x7fe700112870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.705+0000 7fe707600640 1 --2- 172.21.15.84:0/401959657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe70010b6f0 0x7fe70010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.705+0000 7fe707600640 1 --2- 172.21.15.84:0/401959657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe700105db0 0x7fe7001061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.705+0000 7fe707600640 1 -- 172.21.15.84:0/401959657 >> 172.21.15.84:0/401959657 conn(0x7fe7001017e0 msgr2=0x7fe700103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.705+0000 7fe707600640 1 -- 172.21.15.84:0/401959657 shutdown_connections 2024-09-21T07:46:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.705+0000 7fe707600640 1 -- 172.21.15.84:0/401959657 wait complete. 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.706+0000 7fe707600640 1 Processor -- start 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.706+0000 7fe707600640 1 -- start start 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.706+0000 7fe707600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe700105db0 0x7fe70019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.706+0000 7fe707600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010b6f0 0x7fe70019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.706+0000 7fe707600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe70010c040 0x7fe7001a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.706+0000 7fe707600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe700115d50 con 0x7fe70010b6f0 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe707600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe700115bd0 con 0x7fe700105db0 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe707600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe700115ed0 con 0x7fe70010c040 2024-09-21T07:46:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe700105db0 0x7fe70019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe6f7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010b6f0 0x7fe70019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe700105db0 0x7fe70019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:51092/0 (socket says 172.21.15.84:51092) 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 -- 172.21.15.84:0/674354655 learned_addr learned my addr 172.21.15.84:0/674354655 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe705600640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe70010c040 0x7fe7001a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 -- 172.21.15.84:0/674354655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe70010c040 msgr2=0x7fe7001a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe70010c040 0x7fe7001a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 -- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010b6f0 msgr2=0x7fe70019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010b6f0 0x7fe70019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe704c00640 1 -- 172.21.15.84:0/674354655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7001a2610 con 0x7fe700105db0 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.707+0000 7fe6f7e00640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010b6f0 0x7fe70019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.708+0000 7fe704c00640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe700105db0 0x7fe70019c6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000e9f0 tx=0x7fe6f000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.708+0000 7fe6fe000640 1 -- 172.21.15.84:0/674354655 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000cd80 con 0x7fe700105db0 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.708+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7001a2900 con 0x7fe700105db0 2024-09-21T07:46:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.708+0000 7fe6fe000640 1 -- 172.21.15.84:0/674354655 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f00054d0 con 0x7fe700105db0 2024-09-21T07:46:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.708+0000 7fe6fe000640 1 -- 172.21.15.84:0/674354655 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0010690 con 0x7fe700105db0 2024-09-21T07:46:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.708+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7001a9060 con 0x7fe700105db0 2024-09-21T07:46:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.709+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7001061c0 con 0x7fe700105db0 2024-09-21T07:46:46.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.711+0000 7fe6fe000640 1 -- 172.21.15.84:0/674354655 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe6f0004e90 con 0x7fe700105db0 2024-09-21T07:46:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.713+0000 7fe6fe000640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6e40b6560 0x7fe6e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.713+0000 7fe6fe000640 1 -- 172.21.15.84:0/674354655 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fe6f00e7410 con 0x7fe700105db0 2024-09-21T07:46:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.713+0000 7fe6f7e00640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6e40b6560 0x7fe6e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.714+0000 7fe6f7e00640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6e40b6560 0x7fe6e40b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe700104ee0 tx=0x7fe6e8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.717+0000 7fe6fe000640 1 -- 172.21.15.84:0/674354655 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6f00adfd0 con 0x7fe700105db0 2024-09-21T07:46:46.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:46 smithi084 ceph-mon[30411]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:46.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.909+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe70010d8a0 con 0x7fe700105db0 2024-09-21T07:46:46.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.910+0000 7fe6fe000640 1 -- 172.21.15.84:0/674354655 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fe6f00b23b0 con 0x7fe700105db0 2024-09-21T07:46:46.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:46:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6e40b6560 msgr2=0x7fe6e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6e40b6560 0x7fe6e40b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe700104ee0 tx=0x7fe6e8005f90 comp rx=0 tx=0).stop 2024-09-21T07:46:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe700105db0 msgr2=0x7fe70019c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe700105db0 0x7fe70019c6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000e9f0 tx=0x7fe6f000edf0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 shutdown_connections 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6e40b6560 0x7fe6e40b8a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe70010c040 0x7fe7001a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70010b6f0 0x7fe70019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 --2- 172.21.15.84:0/674354655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe700105db0 0x7fe70019c6a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.912+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 >> 172.21.15.84:0/674354655 conn(0x7fe7001017e0 msgr2=0x7fe70010aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.913+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 shutdown_connections 2024-09-21T07:46:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:46.913+0000 7fe707600640 1 -- 172.21.15.84:0/674354655 wait complete. 2024-09-21T07:46:47.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:46 smithi162 ceph-mon[34833]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:47.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:46 smithi191 ceph-mon[34667]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:47.716 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726904805,"num_in_osds":12,"osd_in_since":1726904781,"num_remapped_pgs":0} 2024-09-21T07:46:47.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:46:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:47 smithi162 ceph-mon[34833]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:46:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:47 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/674354655' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:48.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:47 smithi084 ceph-mon[30411]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:46:48.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:47 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/674354655' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:46:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:47 smithi191 ceph-mon[34667]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:46:48.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:47 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/674354655' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:46:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.680+0000 7f5512c00640 1 -- 172.21.15.84:0/2093538114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c10de30 msgr2=0x7f550c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.680+0000 7f5512c00640 1 --2- 172.21.15.84:0/2093538114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c10de30 0x7f550c110320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5504009be0 tx=0x7f550402a6c0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.680+0000 7f5512c00640 1 -- 172.21.15.84:0/2093538114 shutdown_connections 2024-09-21T07:46:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.680+0000 7f5512c00640 1 --2- 172.21.15.84:0/2093538114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c10de30 0x7f550c110320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.680+0000 7f5512c00640 1 --2- 172.21.15.84:0/2093538114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f550c105320 0x7f550c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.680+0000 7f5512c00640 1 --2- 172.21.15.84:0/2093538114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c1049d0 0x7f550c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.680+0000 7f5512c00640 1 -- 172.21.15.84:0/2093538114 >> 172.21.15.84:0/2093538114 conn(0x7f550c079740 msgr2=0x7f550c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.681+0000 7f5512c00640 1 -- 172.21.15.84:0/2093538114 shutdown_connections 2024-09-21T07:46:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.681+0000 7f5512c00640 1 -- 172.21.15.84:0/2093538114 wait complete. 2024-09-21T07:46:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 Processor -- start 2024-09-21T07:46:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 -- start start 2024-09-21T07:46:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c1049d0 0x7f550c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c105320 0x7f550c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f550c10de30 0x7f550c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f550c113a90 con 0x7f550c105320 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f550c113910 con 0x7f550c1049d0 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.682+0000 7f5512c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f550c113c10 con 0x7f550c10de30 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c105320 0x7f550c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c105320 0x7f550c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52324/0 (socket says 172.21.15.84:52324) 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 -- 172.21.15.84:0/3437045404 learned_addr learned my addr 172.21.15.84:0/3437045404 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550be00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c1049d0 0x7f550c19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f5510c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f550c10de30 0x7f550c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 -- 172.21.15.84:0/3437045404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f550c10de30 msgr2=0x7f550c1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f550c10de30 0x7f550c1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 -- 172.21.15.84:0/3437045404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c1049d0 msgr2=0x7f550c19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c1049d0 0x7f550c19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.683+0000 7f550b400640 1 -- 172.21.15.84:0/3437045404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c1a25b0 con 0x7f550c105320 2024-09-21T07:46:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.684+0000 7f550b400640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c105320 0x7f550c19cbe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f54f800e970 tx=0x7f54f800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:48.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.686+0000 7f5508c00640 1 -- 172.21.15.84:0/3437045404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f800ccc0 con 0x7f550c105320 2024-09-21T07:46:48.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.686+0000 7f5508c00640 1 -- 172.21.15.84:0/3437045404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54f80035f0 con 0x7f550c105320 2024-09-21T07:46:48.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.686+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1a28a0 con 0x7f550c105320 2024-09-21T07:46:48.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.686+0000 7f5508c00640 1 -- 172.21.15.84:0/3437045404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f800ce60 con 0x7f550c105320 2024-09-21T07:46:48.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.686+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c1a9000 con 0x7f550c105320 2024-09-21T07:46:48.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.687+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550c06c240 con 0x7f550c105320 2024-09-21T07:46:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.690+0000 7f5508c00640 1 -- 172.21.15.84:0/3437045404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f54f8003aa0 con 0x7f550c105320 2024-09-21T07:46:48.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.692+0000 7f5508c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f54f00b6560 0x7f54f00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:48.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.692+0000 7f5508c00640 1 -- 172.21.15.84:0/3437045404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f54f80e7340 con 0x7f550c105320 2024-09-21T07:46:48.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.692+0000 7f550be00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f54f00b6560 0x7f54f00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:48.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.693+0000 7f550be00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f54f00b6560 0x7f54f00b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f550c06c940 tx=0x7f54fc009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:48.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.696+0000 7f5508c00640 1 -- 172.21.15.84:0/3437045404 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54f80adf00 con 0x7f550c105320 2024-09-21T07:46:48.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:48 smithi084 ceph-mon[30411]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:48.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.886+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f550c104de0 con 0x7f550c105320 2024-09-21T07:46:48.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.888+0000 7f5508c00640 1 -- 172.21.15.84:0/3437045404 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18807 (secure 0 0 0) 0x7f54f80b22e0 con 0x7f550c105320 2024-09-21T07:46:48.890 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:46:48.890 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:46:46.667339+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:46:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f54f00b6560 msgr2=0x7f54f00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f54f00b6560 0x7f54f00b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f550c06c940 tx=0x7f54fc009260 comp rx=0 tx=0).stop 2024-09-21T07:46:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c105320 msgr2=0x7f550c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c105320 0x7f550c19cbe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f54f800e970 tx=0x7f54f800ed70 comp rx=0 tx=0).stop 2024-09-21T07:46:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 shutdown_connections 2024-09-21T07:46:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f54f00b6560 0x7f54f00b8a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f550c10de30 0x7f550c1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f550c105320 0x7f550c19cbe0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 --2- 172.21.15.84:0/3437045404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f550c1049d0 0x7f550c19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:48.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 >> 172.21.15.84:0/3437045404 conn(0x7f550c079740 msgr2=0x7f550c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:48.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 shutdown_connections 2024-09-21T07:46:48.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:48.890+0000 7f5512c00640 1 -- 172.21.15.84:0/3437045404 wait complete. 2024-09-21T07:46:49.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:48 smithi162 ceph-mon[34833]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:49.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:48 smithi191 ceph-mon[34667]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:49.656 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:42:36.190783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:46:49.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T07:46:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:46:50.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3437045404' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:46:50.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3437045404' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:46:50.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3437045404' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:46:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 -- 172.21.15.84:0/427554971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 msgr2=0x7fba14112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 --2- 172.21.15.84:0/427554971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba14112850 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009ca0 tx=0x7fba0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 -- 172.21.15.84:0/427554971 shutdown_connections 2024-09-21T07:46:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 --2- 172.21.15.84:0/427554971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba14112850 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 --2- 172.21.15.84:0/427554971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba1410b6d0 0x7fba1410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 --2- 172.21.15.84:0/427554971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba14105d90 0x7fba141061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 -- 172.21.15.84:0/427554971 >> 172.21.15.84:0/427554971 conn(0x7fba14101860 msgr2=0x7fba14103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 -- 172.21.15.84:0/427554971 shutdown_connections 2024-09-21T07:46:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.680+0000 7fba1ba00640 1 -- 172.21.15.84:0/427554971 wait complete. 2024-09-21T07:46:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.681+0000 7fba1ba00640 1 Processor -- start 2024-09-21T07:46:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.681+0000 7fba1ba00640 1 -- start start 2024-09-21T07:46:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba1ba00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba14105d90 0x7fba1419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba1ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba1410b6d0 0x7fba1419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba1ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba141a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba1ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fba14115d30 con 0x7fba1410c020 2024-09-21T07:46:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba1ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba14115bb0 con 0x7fba1410b6d0 2024-09-21T07:46:50.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba1ba00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fba14115eb0 con 0x7fba14105d90 2024-09-21T07:46:50.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba19a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba141a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:50.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba19a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba141a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52344/0 (socket says 172.21.15.84:52344) 2024-09-21T07:46:50.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba19a00640 1 -- 172.21.15.84:0/2329828966 learned_addr learned my addr 172.21.15.84:0/2329828966 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:46:50.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.682+0000 7fba13e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba1410b6d0 0x7fba1419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:50.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.683+0000 7fba19000640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba14105d90 0x7fba1419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:50.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.683+0000 7fba19a00640 1 -- 172.21.15.84:0/2329828966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba14105d90 msgr2=0x7fba1419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:50.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.683+0000 7fba19a00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba14105d90 0x7fba1419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.683+0000 7fba19a00640 1 -- 172.21.15.84:0/2329828966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba1410b6d0 msgr2=0x7fba1419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:50.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.683+0000 7fba19a00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba1410b6d0 0x7fba1419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.683+0000 7fba19a00640 1 -- 172.21.15.84:0/2329828966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba141a25b0 con 0x7fba1410c020 2024-09-21T07:46:50.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.683+0000 7fba19a00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba141a1e80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009430 tx=0x7fba0c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:50.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.684+0000 7fba11600640 1 -- 172.21.15.84:0/2329828966 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c003c30 con 0x7fba1410c020 2024-09-21T07:46:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.684+0000 7fba11600640 1 -- 172.21.15.84:0/2329828966 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba0c003dd0 con 0x7fba1410c020 2024-09-21T07:46:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.684+0000 7fba11600640 1 -- 172.21.15.84:0/2329828966 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c02faa0 con 0x7fba1410c020 2024-09-21T07:46:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.684+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba141a2840 con 0x7fba1410c020 2024-09-21T07:46:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.684+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a9000 con 0x7fba1410c020 2024-09-21T07:46:50.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.685+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba141061a0 con 0x7fba1410c020 2024-09-21T07:46:50.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.689+0000 7fba11600640 1 -- 172.21.15.84:0/2329828966 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fba0c02fc40 con 0x7fba1410c020 2024-09-21T07:46:50.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.690+0000 7fba11600640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9fc0b65e0 0x7fb9fc0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:50.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.690+0000 7fba11600640 1 -- 172.21.15.84:0/2329828966 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fba0c108370 con 0x7fba1410c020 2024-09-21T07:46:50.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.691+0000 7fba19000640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9fc0b65e0 0x7fb9fc0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:50.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.691+0000 7fba19000640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9fc0b65e0 0x7fb9fc0b8af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba08005d00 tx=0x7fba0800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:50.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.693+0000 7fba11600640 1 -- 172.21.15.84:0/2329828966 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba0c0cefd0 con 0x7fba1410c020 2024-09-21T07:46:50.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:50 smithi084 ceph-mon[30411]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.886+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fba1410d880 con 0x7fba1410c020 2024-09-21T07:46:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.886+0000 7fba11600640 1 -- 172.21.15.84:0/2329828966 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fba0c0d33b0 con 0x7fba1410c020 2024-09-21T07:46:50.888 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.888+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9fc0b65e0 msgr2=0x7fb9fc0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.888+0000 7fba1ba00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9fc0b65e0 0x7fb9fc0b8af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba08005d00 tx=0x7fba0800b410 comp rx=0 tx=0).stop 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 msgr2=0x7fba141a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba141a1e80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009430 tx=0x7fba0c0319f0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 shutdown_connections 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9fc0b65e0 0x7fb9fc0b8af0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1410c020 0x7fba141a1e80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba1410b6d0 0x7fba1419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 --2- 172.21.15.84:0/2329828966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba14105d90 0x7fba1419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:50.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 >> 172.21.15.84:0/2329828966 conn(0x7fba14101860 msgr2=0x7fba14108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:50.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 shutdown_connections 2024-09-21T07:46:50.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:50.889+0000 7fba1ba00640 1 -- 172.21.15.84:0/2329828966 wait complete. 2024-09-21T07:46:51.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:50 smithi162 ceph-mon[34833]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:51.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:50 smithi191 ceph-mon[34667]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:51.596 INFO:tasks.cephadm:Adding mds.a on smithi084 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.d on smithi084 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.g on smithi084 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.j on smithi084 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.b on smithi162 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.e on smithi162 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.h on smithi162 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.k on smithi162 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.c on smithi191 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.f on smithi191 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.i on smithi191 2024-09-21T07:46:51.597 INFO:tasks.cephadm:Adding mds.l on smithi191 2024-09-21T07:46:51.598 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l' 2024-09-21T07:46:51.852 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:46:51.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:51 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2329828966' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:46:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:51 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2329828966' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:46:52.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:51 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2329828966' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 -- 172.21.15.191:0/517536952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8103bb0 msgr2=0x7f85e8103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 --2- 172.21.15.191:0/517536952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8103bb0 0x7f85e8103fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009900 tx=0x7f85d802a410 comp rx=0 tx=0).stop 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 -- 172.21.15.191:0/517536952 shutdown_connections 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 --2- 172.21.15.191:0/517536952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85e8109e40 0x7f85e8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 --2- 172.21.15.191:0/517536952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85e81094f0 0x7f85e8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 --2- 172.21.15.191:0/517536952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8103bb0 0x7f85e8103fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 -- 172.21.15.191:0/517536952 >> 172.21.15.191:0/517536952 conn(0x7f85e80ff600 msgr2=0x7f85e8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:52.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 -- 172.21.15.191:0/517536952 shutdown_connections 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.346+0000 7f85ed409640 1 -- 172.21.15.191:0/517536952 wait complete. 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 Processor -- start 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 -- start start 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85e8103bb0 0x7f85e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85e81094f0 0x7f85e8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8109e40 0x7f85e8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85e8113b60 con 0x7f85e8103bb0 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85e81139e0 con 0x7f85e81094f0 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85ed409640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f85e8113ce0 con 0x7f85e8109e40 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85e77fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8109e40 0x7f85e8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85e77fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8109e40 0x7f85e8076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:39752/0 (socket says 172.21.15.191:39752) 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.347+0000 7f85e77fe640 1 -- 172.21.15.191:0/1257929000 learned_addr learned my addr 172.21.15.191:0/1257929000 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85dffff640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85e81094f0 0x7f85e8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:52.353 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e6ffd640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85e8103bb0 0x7f85e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e77fe640 1 -- 172.21.15.191:0/1257929000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85e81094f0 msgr2=0x7f85e8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e77fe640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85e81094f0 0x7f85e8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e77fe640 1 -- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85e8103bb0 msgr2=0x7f85e8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e77fe640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85e8103bb0 0x7f85e8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e77fe640 1 -- 172.21.15.191:0/1257929000 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e81a8810 con 0x7f85e8109e40 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e77fe640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8109e40 0x7f85e8076190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85e000cad0 tx=0x7f85e000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e4ff9640 1 -- 172.21.15.191:0/1257929000 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e000ae20 con 0x7f85e8109e40 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e81a8b00 con 0x7f85e8109e40 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e81a9090 con 0x7f85e8109e40 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e4ff9640 1 -- 172.21.15.191:0/1257929000 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85e0005020 con 0x7f85e8109e40 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.348+0000 7f85e4ff9640 1 -- 172.21.15.191:0/1257929000 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e001d060 con 0x7f85e8109e40 2024-09-21T07:46:52.354 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.349+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c80052c0 con 0x7f85e8109e40 2024-09-21T07:46:52.355 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.352+0000 7f85e4ff9640 1 -- 172.21.15.191:0/1257929000 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f85e0004a40 con 0x7f85e8109e40 2024-09-21T07:46:52.355 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.353+0000 7f85e4ff9640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f85d40b65e0 0x7f85d40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:52.355 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.353+0000 7f85e4ff9640 1 -- 172.21.15.191:0/1257929000 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f85e00e7180 con 0x7f85e8109e40 2024-09-21T07:46:52.355 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.353+0000 7f85e6ffd640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f85d40b65e0 0x7f85d40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:52.356 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.354+0000 7f85e6ffd640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f85d40b65e0 0x7f85d40b8af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000c00 tx=0x7f85d8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:52.357 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.356+0000 7f85e4ff9640 1 -- 172.21.15.191:0/1257929000 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85e0014030 con 0x7f85e8109e40 2024-09-21T07:46:52.553 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.550+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}) -- 0x7f85c8000cf0 con 0x7f85d40b65e0 2024-09-21T07:46:52.672 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.559+0000 7f85e4ff9640 1 -- 172.21.15.191:0/1257929000 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f85c8000cf0 con 0x7f85d40b65e0 2024-09-21T07:46:52.673 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mds.all update... 2024-09-21T07:46:52.673 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f85d40b65e0 msgr2=0x7f85d40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:52.673 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f85d40b65e0 0x7f85d40b8af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000c00 tx=0x7f85d8031400 comp rx=0 tx=0).stop 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8109e40 msgr2=0x7f85e8076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8109e40 0x7f85e8076190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85e000cad0 tx=0x7f85e000cf90 comp rx=0 tx=0).stop 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 shutdown_connections 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f85d40b65e0 0x7f85d40b8af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85e8109e40 0x7f85e8076190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85e81094f0 0x7f85e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 --2- 172.21.15.191:0/1257929000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85e8103bb0 0x7f85e8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 >> 172.21.15.191:0/1257929000 conn(0x7f85e80ff600 msgr2=0x7f85e8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 shutdown_connections 2024-09-21T07:46:52.674 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-21T07:46:52.562+0000 7f85ed409640 1 -- 172.21.15.191:0/1257929000 wait complete. 2024-09-21T07:46:52.890 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:52 smithi191 ceph-mon[34667]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:52.890 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:52.890 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:53.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:52 smithi162 ceph-mon[34833]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:53.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:53.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:53.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:52 smithi084 ceph-mon[30411]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:53.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:53.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:53.245 DEBUG:teuthology.orchestra.run.smithi084:mds.a> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T07:46:53.250 DEBUG:teuthology.orchestra.run.smithi084:mds.d> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T07:46:53.294 DEBUG:teuthology.orchestra.run.smithi084:mds.g> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T07:46:53.338 DEBUG:teuthology.orchestra.run.smithi084:mds.j> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T07:46:53.383 DEBUG:teuthology.orchestra.run.smithi162:mds.b> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T07:46:53.385 DEBUG:teuthology.orchestra.run.smithi162:mds.e> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T07:46:53.429 DEBUG:teuthology.orchestra.run.smithi162:mds.h> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T07:46:53.472 DEBUG:teuthology.orchestra.run.smithi162:mds.k> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T07:46:53.515 DEBUG:teuthology.orchestra.run.smithi191:mds.c> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T07:46:53.517 DEBUG:teuthology.orchestra.run.smithi191:mds.f> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T07:46:53.560 DEBUG:teuthology.orchestra.run.smithi191:mds.i> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T07:46:53.603 DEBUG:teuthology.orchestra.run.smithi191:mds.l> sudo journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T07:46:53.646 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T07:46:53.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:46:53.713 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:46:53.713 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-21T07:46:53.713 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:53.713 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:53.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:46:53.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-21T07:46:53.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:53.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:53.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:53.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:53.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:53.849 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:53 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:54.009 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:46:54.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:54.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:54.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:54.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:53 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:54.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:46:54.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-21T07:46:54.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:54.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:54.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:54.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:54.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:54.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:53 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.619+0000 7ff5b8e00640 1 -- 172.21.15.84:0/1820616064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b4076100 msgr2=0x7ff5b410f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.619+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/1820616064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b4076100 0x7ff5b410f9d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009900 tx=0x7ff5a002a410 comp rx=0 tx=0).stop 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.619+0000 7ff5b8e00640 1 -- 172.21.15.84:0/1820616064 shutdown_connections 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.619+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/1820616064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5b410ff10 0x7ff5b4112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.619+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/1820616064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b4076100 0x7ff5b410f9d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.619+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/1820616064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 0x7ff5b4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.619+0000 7ff5b8e00640 1 -- 172.21.15.84:0/1820616064 >> 172.21.15.84:0/1820616064 conn(0x7ff5b40ff440 msgr2=0x7ff5b4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.620+0000 7ff5b8e00640 1 -- 172.21.15.84:0/1820616064 shutdown_connections 2024-09-21T07:46:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.620+0000 7ff5b8e00640 1 -- 172.21.15.84:0/1820616064 wait complete. 2024-09-21T07:46:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 Processor -- start 2024-09-21T07:46:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 -- start start 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 0x7ff5b419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5b4076100 0x7ff5b419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b410ff10 0x7ff5b41a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4115ac0 con 0x7ff5b410ff10 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4115940 con 0x7ff5b4076100 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b8e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4115c40 con 0x7ff5b40757b0 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.621+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 0x7ff5b419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 0x7ff5b419c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56536/0 (socket says 172.21.15.84:56536) 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 -- 172.21.15.84:0/784598760 learned_addr learned my addr 172.21.15.84:0/784598760 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b2a00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5b4076100 0x7ff5b419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b410ff10 0x7ff5b41a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 -- 172.21.15.84:0/784598760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5b4076100 msgr2=0x7ff5b419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5b4076100 0x7ff5b419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 -- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b410ff10 msgr2=0x7ff5b41a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b410ff10 0x7ff5b41a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 -- 172.21.15.84:0/784598760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b41a2480 con 0x7ff5b40757b0 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b410ff10 0x7ff5b41a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5b3400640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 0x7ff5b419c510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e9f0 tx=0x7ff5a400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.622+0000 7ff5abe00640 1 -- 172.21.15.84:0/784598760 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400cd80 con 0x7ff5b40757b0 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.623+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b41a2770 con 0x7ff5b40757b0 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.623+0000 7ff5abe00640 1 -- 172.21.15.84:0/784598760 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5a40054d0 con 0x7ff5b40757b0 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.623+0000 7ff5abe00640 1 -- 172.21.15.84:0/784598760 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4010690 con 0x7ff5b40757b0 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.623+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b41a8ed0 con 0x7ff5b40757b0 2024-09-21T07:46:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.624+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b4075bc0 con 0x7ff5b40757b0 2024-09-21T07:46:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.626+0000 7ff5abe00640 1 -- 172.21.15.84:0/784598760 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7ff5a4004e30 con 0x7ff5b40757b0 2024-09-21T07:46:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.627+0000 7ff5abe00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff5980b6560 0x7ff5980b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.628+0000 7ff5abe00640 1 -- 172.21.15.84:0/784598760 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ff5a40e76a0 con 0x7ff5b40757b0 2024-09-21T07:46:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.628+0000 7ff5b2a00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff5980b6560 0x7ff5980b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.628+0000 7ff5b2a00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff5980b6560 0x7ff5980b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0000c00 tx=0x7ff5a0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:54.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.630+0000 7ff5abe00640 1 -- 172.21.15.84:0/784598760 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5a4056710 con 0x7ff5b40757b0 2024-09-21T07:46:54.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.854+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5b419d640 con 0x7ff5b40757b0 2024-09-21T07:46:54.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.854+0000 7ff5abe00640 1 -- 172.21.15.84:0/784598760 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7ff5a40ae260 con 0x7ff5b40757b0 2024-09-21T07:46:54.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:46:54.857 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"btime":"2024-09-21T07:38:31:274055+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T07:46:54.857 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 1 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff5980b6560 msgr2=0x7ff5980b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff5980b6560 0x7ff5980b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0000c00 tx=0x7ff5a0031400 comp rx=0 tx=0).stop 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 msgr2=0x7ff5b419c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 0x7ff5b419c510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e9f0 tx=0x7ff5a400edf0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 shutdown_connections 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff5980b6560 0x7ff5980b8a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5b410ff10 0x7ff5b41a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5b4076100 0x7ff5b419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 --2- 172.21.15.84:0/784598760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5b40757b0 0x7ff5b419c510 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:54.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 >> 172.21.15.84:0/784598760 conn(0x7ff5b40ff440 msgr2=0x7ff5b4109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 shutdown_connections 2024-09-21T07:46:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:54.857+0000 7ff5b8e00640 1 -- 172.21.15.84:0/784598760 wait complete. 2024-09-21T07:46:54.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:54 smithi191 ceph-mon[34667]: Deploying daemon mds.l on smithi191 2024-09-21T07:46:54.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:54 smithi191 ceph-mon[34667]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:55.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:54 smithi162 ceph-mon[34833]: Deploying daemon mds.l on smithi191 2024-09-21T07:46:55.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:54 smithi162 ceph-mon[34833]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:55.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:54 smithi084 ceph-mon[30411]: Deploying daemon mds.l on smithi191 2024-09-21T07:46:55.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:54 smithi084 ceph-mon[30411]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:55.302 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 systemd[1]: Starting Ceph mds.l for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:46:55.579 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 podman[63203]: 2024-09-21 07:46:55.202860003 +0000 UTC m=+0.015653313 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:46:55.579 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 podman[63203]: 2024-09-21 07:46:55.332581296 +0000 UTC m=+0.145374607 container create 3ff5971ba17a7618c8e10787ba10da41ada2a8f81f7e7cf2d19d99c524f70fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T07:46:55.579 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 podman[63203]: 2024-09-21 07:46:55.578448108 +0000 UTC m=+0.391241416 container init 3ff5971ba17a7618c8e10787ba10da41ada2a8f81f7e7cf2d19d99c524f70fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T07:46:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:55 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/784598760' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:46:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:55 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6832/2170041322,v1:172.21.15.191:6833/2170041322] up:boot 2024-09-21T07:46:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:55 smithi191 ceph-mon[34667]: fsmap 1 up:standby 2024-09-21T07:46:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:46:55.906 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 podman[63203]: 2024-09-21 07:46:55.581237561 +0000 UTC m=+0.394030869 container start 3ff5971ba17a7618c8e10787ba10da41ada2a8f81f7e7cf2d19d99c524f70fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T07:46:55.906 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 ceph-mds[63222]: -- 172.21.15.191:0/993661853 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe7e7d3c20 con 0x55fe8297b600 2024-09-21T07:46:55.906 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l[63218]: starting mds.l at 2024-09-21T07:46:55.906 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 bash[63203]: 3ff5971ba17a7618c8e10787ba10da41ada2a8f81f7e7cf2d19d99c524f70fa5 2024-09-21T07:46:55.907 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 07:46:55 smithi191 systemd[1]: Started Ceph mds.l for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:46:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:55 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/784598760' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:46:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:55 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6832/2170041322,v1:172.21.15.191:6833/2170041322] up:boot 2024-09-21T07:46:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:55 smithi162 ceph-mon[34833]: fsmap 1 up:standby 2024-09-21T07:46:56.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:46:56.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:55 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/784598760' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:46:56.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:55 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6832/2170041322,v1:172.21.15.191:6833/2170041322] up:boot 2024-09-21T07:46:56.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:55 smithi084 ceph-mon[30411]: fsmap 1 up:standby 2024-09-21T07:46:56.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:46:57.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: Deploying daemon mds.k on smithi162 2024-09-21T07:46:57.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:56 smithi162 ceph-mon[34833]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:57.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: Deploying daemon mds.k on smithi162 2024-09-21T07:46:57.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:56 smithi084 ceph-mon[30411]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: Deploying daemon mds.k on smithi162 2024-09-21T07:46:57.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:56 smithi191 ceph-mon[34667]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:57.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:46:57.982 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:46:58.023 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:57 smithi162 systemd[1]: Starting Ceph mds.k for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:46:58.287 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 podman[63505]: 2024-09-21 07:46:57.924308247 +0000 UTC m=+0.016071968 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:46:58.287 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 podman[63505]: 2024-09-21 07:46:58.050509114 +0000 UTC m=+0.142272873 container create c6a3b88a787d8d72e510a219053030b4a535974364256efcb6b1f164cfa8ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:46:58.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:58 smithi162 ceph-mon[34833]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:58.552 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 podman[63505]: 2024-09-21 07:46:58.286367865 +0000 UTC m=+0.378131582 container init c6a3b88a787d8d72e510a219053030b4a535974364256efcb6b1f164cfa8ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T07:46:58.552 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 podman[63505]: 2024-09-21 07:46:58.289556421 +0000 UTC m=+0.381320144 container start c6a3b88a787d8d72e510a219053030b4a535974364256efcb6b1f164cfa8ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T07:46:58.552 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 ceph-mds[63524]: -- 172.21.15.162:0/2057865907 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55939aecd860 con 0x55939f075180 2024-09-21T07:46:58.552 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k[63520]: starting mds.k at 2024-09-21T07:46:58.552 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 bash[63505]: c6a3b88a787d8d72e510a219053030b4a535974364256efcb6b1f164cfa8ddc4 2024-09-21T07:46:58.552 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 07:46:58 smithi162 systemd[1]: Started Ceph mds.k for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:46:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 -- 172.21.15.84:0/3582891518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 msgr2=0x7f2e2c103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 --2- 172.21.15.84:0/3582891518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c103dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009900 tx=0x7f2e1c02a410 comp rx=0 tx=0).stop 2024-09-21T07:46:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 -- 172.21.15.84:0/3582891518 shutdown_connections 2024-09-21T07:46:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 --2- 172.21.15.84:0/3582891518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e2c109c40 0x7f2e2c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 --2- 172.21.15.84:0/3582891518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e2c1092f0 0x7f2e2c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 --2- 172.21.15.84:0/3582891518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c103dc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 -- 172.21.15.84:0/3582891518 >> 172.21.15.84:0/3582891518 conn(0x7f2e2c0ff440 msgr2=0x7f2e2c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 -- 172.21.15.84:0/3582891518 shutdown_connections 2024-09-21T07:46:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.609+0000 7f2e31c00640 1 -- 172.21.15.84:0/3582891518 wait complete. 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.610+0000 7f2e31c00640 1 Processor -- start 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.610+0000 7f2e31c00640 1 -- start start 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e31c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e31c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e2c1092f0 0x7f2e2c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e31c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e2c109c40 0x7f2e2c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e31c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c113900 con 0x7f2e2c1039b0 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e31c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c113780 con 0x7f2e2c1092f0 2024-09-21T07:46:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e31c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c113a80 con 0x7f2e2c109c40 2024-09-21T07:46:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39478/0 (socket says 172.21.15.84:39478) 2024-09-21T07:46:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e2be00640 1 -- 172.21.15.84:0/1773435817 learned_addr learned my addr 172.21.15.84:0/1773435817 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:46:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e23e00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e2c1092f0 0x7f2e2c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.611+0000 7f2e31200640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e2c109c40 0x7f2e2c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e2be00640 1 -- 172.21.15.84:0/1773435817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e2c109c40 msgr2=0x7f2e2c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e2be00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e2c109c40 0x7f2e2c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e2be00640 1 -- 172.21.15.84:0/1773435817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e2c1092f0 msgr2=0x7f2e2c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e2be00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e2c1092f0 0x7f2e2c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e2be00640 1 -- 172.21.15.84:0/1773435817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c1a02a0 con 0x7f2e2c1039b0 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e2be00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c19a330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c005940 tx=0x7f2e1c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e29600640 1 -- 172.21.15.84:0/1773435817 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c03f030 con 0x7f2e2c1039b0 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e29600640 1 -- 172.21.15.84:0/1773435817 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e1c0044c0 con 0x7f2e2c1039b0 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c1a0530 con 0x7f2e2c1039b0 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.612+0000 7f2e29600640 1 -- 172.21.15.84:0/1773435817 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c035070 con 0x7f2e2c1039b0 2024-09-21T07:46:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.613+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c1a6cf0 con 0x7f2e2c1039b0 2024-09-21T07:46:58.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.614+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c103dc0 con 0x7f2e2c1039b0 2024-09-21T07:46:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.616+0000 7f2e29600640 1 -- 172.21.15.84:0/1773435817 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2e1c042030 con 0x7f2e2c1039b0 2024-09-21T07:46:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.618+0000 7f2e29600640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e100b6560 0x7f2e100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:46:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.618+0000 7f2e29600640 1 -- 172.21.15.84:0/1773435817 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f2e1c1075a0 con 0x7f2e2c1039b0 2024-09-21T07:46:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.618+0000 7f2e23e00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e100b6560 0x7f2e100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:46:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.619+0000 7f2e23e00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e100b6560 0x7f2e100b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c108ed0 tx=0x7f2e14005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:46:58.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.620+0000 7f2e29600640 1 -- 172.21.15.84:0/1773435817 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e1c0d2540 con 0x7f2e2c1039b0 2024-09-21T07:46:58.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:58 smithi084 ceph-mon[30411]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:58.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.871+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e2c02e640 con 0x7f2e2c1039b0 2024-09-21T07:46:58.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.872+0000 7f2e29600640 1 -- 172.21.15.84:0/1773435817 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f2e1c0d7480 con 0x7f2e2c1039b0 2024-09-21T07:46:58.874 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:46:58.874 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"btime":"2024-09-21T07:46:58:403107+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:46:58.875 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2024-09-21T07:46:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e100b6560 msgr2=0x7f2e100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e100b6560 0x7f2e100b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c108ed0 tx=0x7f2e14005f90 comp rx=0 tx=0).stop 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 msgr2=0x7f2e2c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c19a330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c005940 tx=0x7f2e1c0040c0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 shutdown_connections 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2e100b6560 0x7f2e100b8a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e2c109c40 0x7f2e2c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e2c1092f0 0x7f2e2c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 --2- 172.21.15.84:0/1773435817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1039b0 0x7f2e2c19a330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.874+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 >> 172.21.15.84:0/1773435817 conn(0x7f2e2c0ff440 msgr2=0x7f2e2c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.875+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 shutdown_connections 2024-09-21T07:46:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:46:58.875+0000 7f2e31c00640 1 -- 172.21.15.84:0/1773435817 wait complete. 2024-09-21T07:46:58.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:58 smithi191 ceph-mon[34667]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6832/1671465182,v1:172.21.15.162:6833/1671465182] up:boot 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: fsmap 2 up:standby 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:59.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:59.494 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:59.494 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: Deploying daemon mds.j on smithi084 2024-09-21T07:46:59.494 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:46:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1773435817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:46:59.693 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6832/1671465182,v1:172.21.15.162:6833/1671465182] up:boot 2024-09-21T07:46:59.693 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: fsmap 2 up:standby 2024-09-21T07:46:59.693 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:46:59.693 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.694 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.694 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.694 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:59.694 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:59.694 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:59.694 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: Deploying daemon mds.j on smithi084 2024-09-21T07:46:59.694 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:46:59 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1773435817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6832/1671465182,v1:172.21.15.162:6833/1671465182] up:boot 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: fsmap 2 up:standby 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: Deploying daemon mds.j on smithi084 2024-09-21T07:46:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:46:59 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1773435817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:00.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:00 smithi084 ceph-mon[30411]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:00.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:00 smithi162 ceph-mon[34833]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:00.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:00 smithi191 ceph-mon[34667]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:01.693 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:01 smithi084 systemd[1]: Starting Ceph mds.j for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:02.000 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:01 smithi084 podman[72571]: 2024-09-21 07:47:01.595797071 +0000 UTC m=+0.026959697 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:02.000 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:01 smithi084 podman[72571]: 2024-09-21 07:47:01.745950631 +0000 UTC m=+0.177113253 container create 45ec1b410ce861bf72dde676da877d13b9e7cc2c4e79b8c2eede38ce6c3f2b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T07:47:02.000 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:01 smithi084 podman[72571]: 2024-09-21 07:47:01.998779111 +0000 UTC m=+0.429941726 container init 45ec1b410ce861bf72dde676da877d13b9e7cc2c4e79b8c2eede38ce6c3f2b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T07:47:02.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:02.306 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:02 smithi084 podman[72571]: 2024-09-21 07:47:02.005561286 +0000 UTC m=+0.436723902 container start 45ec1b410ce861bf72dde676da877d13b9e7cc2c4e79b8c2eede38ce6c3f2b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:47:02.306 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:02 smithi084 bash[72571]: 45ec1b410ce861bf72dde676da877d13b9e7cc2c4e79b8c2eede38ce6c3f2b6e 2024-09-21T07:47:02.306 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:02 smithi084 systemd[1]: Started Ceph mds.j for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:02.307 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:02 smithi084 ceph-mds[72590]: -- 172.21.15.84:0/376246912 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561caa1cd860 con 0x561cae375600 2024-09-21T07:47:02.307 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 07:47:02 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j[72586]: starting mds.j at 2024-09-21T07:47:02.656 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:03.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:03 smithi162 ceph-mon[34833]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:03 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:03 smithi084 ceph-mon[30411]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:03 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:03 smithi191 ceph-mon[34667]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:03 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:03.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 -- 172.21.15.84:0/1483747177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020410ff10 msgr2=0x7f0204112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:03.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 --2- 172.21.15.84:0/1483747177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020410ff10 0x7f0204112350 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009ca0 tx=0x7f01fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:47:03.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 -- 172.21.15.84:0/1483747177 shutdown_connections 2024-09-21T07:47:03.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 --2- 172.21.15.84:0/1483747177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020410ff10 0x7f0204112350 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:03.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 --2- 172.21.15.84:0/1483747177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0204076100 0x7f020410f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:03.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 --2- 172.21.15.84:0/1483747177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 0x7f0204075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:03.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 -- 172.21.15.84:0/1483747177 >> 172.21.15.84:0/1483747177 conn(0x7f02040ff440 msgr2=0x7f0204101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:03.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 -- 172.21.15.84:0/1483747177 shutdown_connections 2024-09-21T07:47:03.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.856+0000 7f0203200640 1 -- 172.21.15.84:0/1483747177 wait complete. 2024-09-21T07:47:03.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.857+0000 7f0203200640 1 Processor -- start 2024-09-21T07:47:03.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.857+0000 7f0203200640 1 -- start start 2024-09-21T07:47:03.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.857+0000 7f0203200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 0x7f020419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:03.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.857+0000 7f0203200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0204076100 0x7f020419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:03.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0203200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020410ff10 0x7f02041a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0203200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0204115b10 con 0x7f0204076100 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0203200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0204115990 con 0x7f02040757b0 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0203200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0204115c90 con 0x7f020410ff10 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0201400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0204076100 0x7f020419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0201e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 0x7f020419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0201400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0204076100 0x7f020419cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39510/0 (socket says 172.21.15.84:39510) 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0201e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 0x7f020419c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:40884/0 (socket says 172.21.15.84:40884) 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0201e00640 1 -- 172.21.15.84:0/1001242845 learned_addr learned my addr 172.21.15.84:0/1001242845 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0202800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020410ff10 0x7f02041a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0202800640 1 -- 172.21.15.84:0/1001242845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 msgr2=0x7f020419c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0202800640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 0x7f020419c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0202800640 1 -- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0204076100 msgr2=0x7f020419cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0202800640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0204076100 0x7f020419cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0202800640 1 -- 172.21.15.84:0/1001242845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02041a2490 con 0x7f020410ff10 2024-09-21T07:47:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0201e00640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 0x7f020419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:47:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.858+0000 7f0201400640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0204076100 0x7f020419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:47:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.859+0000 7f0202800640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020410ff10 0x7f02041a1d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01fc005e30 tx=0x7f01fc0317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.859+0000 7f01faa00640 1 -- 172.21.15.84:0/1001242845 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc003b70 con 0x7f020410ff10 2024-09-21T07:47:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.859+0000 7f01faa00640 1 -- 172.21.15.84:0/1001242845 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01fc003d10 con 0x7f020410ff10 2024-09-21T07:47:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.859+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02041a2720 con 0x7f020410ff10 2024-09-21T07:47:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.859+0000 7f01faa00640 1 -- 172.21.15.84:0/1001242845 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc02fa00 con 0x7f020410ff10 2024-09-21T07:47:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.859+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02041a8ee0 con 0x7f020410ff10 2024-09-21T07:47:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.861+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0204075bc0 con 0x7f020410ff10 2024-09-21T07:47:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.863+0000 7f01faa00640 1 -- 172.21.15.84:0/1001242845 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f01fc004580 con 0x7f020410ff10 2024-09-21T07:47:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.864+0000 7f01faa00640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e80b6560 0x7f01e80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.865+0000 7f01faa00640 1 -- 172.21.15.84:0/1001242845 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f01fc108260 con 0x7f020410ff10 2024-09-21T07:47:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.865+0000 7f0201e00640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e80b6560 0x7f01e80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.865+0000 7f0201e00640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e80b6560 0x7f01e80b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005fd0 tx=0x7f01f400b4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:03.867+0000 7f01faa00640 1 -- 172.21.15.84:0/1001242845 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01fc0cee20 con 0x7f020410ff10 2024-09-21T07:47:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.122+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02041a9110 con 0x7f020410ff10 2024-09-21T07:47:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.122+0000 7f01faa00640 1 -- 172.21.15.84:0/1001242845 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f01fc0c8e20 con 0x7f020410ff10 2024-09-21T07:47:04.125 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:04.125 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":4,"btime":"2024-09-21T07:47:03:008631+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:47:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 4 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e80b6560 msgr2=0x7f01e80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e80b6560 0x7f01e80b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005fd0 tx=0x7f01f400b4a0 comp rx=0 tx=0).stop 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020410ff10 msgr2=0x7f02041a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020410ff10 0x7f02041a1d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01fc005e30 tx=0x7f01fc0317c0 comp rx=0 tx=0).stop 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 shutdown_connections 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e80b6560 0x7f01e80b8a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020410ff10 0x7f02041a1d60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0204076100 0x7f020419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 --2- 172.21.15.84:0/1001242845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02040757b0 0x7f020419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 >> 172.21.15.84:0/1001242845 conn(0x7f02040ff440 msgr2=0x7f0204109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 shutdown_connections 2024-09-21T07:47:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:04.125+0000 7f0203200640 1 -- 172.21.15.84:0/1001242845 wait complete. 2024-09-21T07:47:04.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:04 smithi084 ceph-mon[30411]: Deploying daemon mds.d on smithi084 2024-09-21T07:47:04.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:04 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.84:6834/1263089342,v1:172.21.15.84:6835/1263089342] up:boot 2024-09-21T07:47:04.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:04 smithi084 ceph-mon[30411]: fsmap 3 up:standby 2024-09-21T07:47:04.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:47:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:04 smithi162 ceph-mon[34833]: Deploying daemon mds.d on smithi084 2024-09-21T07:47:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:04 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.84:6834/1263089342,v1:172.21.15.84:6835/1263089342] up:boot 2024-09-21T07:47:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:04 smithi162 ceph-mon[34833]: fsmap 3 up:standby 2024-09-21T07:47:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:47:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:04 smithi191 ceph-mon[34667]: Deploying daemon mds.d on smithi084 2024-09-21T07:47:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:04 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.84:6834/1263089342,v1:172.21.15.84:6835/1263089342] up:boot 2024-09-21T07:47:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:04 smithi191 ceph-mon[34667]: fsmap 3 up:standby 2024-09-21T07:47:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:47:05.192 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:05 smithi084 ceph-mon[30411]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:05.192 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:05 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1001242845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:05.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:05 smithi162 ceph-mon[34833]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:05.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:05 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1001242845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:05 smithi191 ceph-mon[34667]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:05 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1001242845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:05.898 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 07:47:05 smithi084 podman[72959]: 2024-09-21 07:47:05.626461989 +0000 UTC m=+0.166151797 container create 691526cb28b5aacf7ed3391ce138b3f85160f5ba514b5b156b73bdf0ede325b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T07:47:05.898 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 07:47:05 smithi084 podman[72959]: 2024-09-21 07:47:05.896521121 +0000 UTC m=+0.436210931 container init 691526cb28b5aacf7ed3391ce138b3f85160f5ba514b5b156b73bdf0ede325b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T07:47:06.307 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 07:47:05 smithi084 podman[72959]: 2024-09-21 07:47:05.903035648 +0000 UTC m=+0.442725458 container start 691526cb28b5aacf7ed3391ce138b3f85160f5ba514b5b156b73bdf0ede325b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:47:06.307 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 07:47:05 smithi084 bash[72959]: 691526cb28b5aacf7ed3391ce138b3f85160f5ba514b5b156b73bdf0ede325b1 2024-09-21T07:47:06.307 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 07:47:05 smithi084 systemd[1]: Started Ceph mds.d for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:06.307 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 07:47:06 smithi084 ceph-mds[72978]: -- 172.21.15.84:0/1685854515 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5576a7689860 con 0x5576ab831180 2024-09-21T07:47:06.307 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 07:47:06 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d[72974]: starting mds.d at 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.84:6836/1436382958,v1:172.21.15.84:6837/1436382958] up:boot 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: fsmap 4 up:standby 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:07.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:07 smithi162 ceph-mon[34833]: Deploying daemon mds.e on smithi162 2024-09-21T07:47:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.84:6836/1436382958,v1:172.21.15.84:6837/1436382958] up:boot 2024-09-21T07:47:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: fsmap 4 up:standby 2024-09-21T07:47:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:47:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:07.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:07 smithi084 ceph-mon[30411]: Deploying daemon mds.e on smithi162 2024-09-21T07:47:07.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:07.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.84:6836/1436382958,v1:172.21.15.84:6837/1436382958] up:boot 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: fsmap 4 up:standby 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:07.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:07 smithi191 ceph-mon[34667]: Deploying daemon mds.e on smithi162 2024-09-21T07:47:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:08.190 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:07 smithi162 systemd[1]: Starting Ceph mds.e for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.334+0000 7f40d1400640 1 -- 172.21.15.84:0/499254396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1092f0 msgr2=0x7f40cc109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.334+0000 7f40d1400640 1 --2- 172.21.15.84:0/499254396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1092f0 0x7f40cc109700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009900 tx=0x7f40b402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.334+0000 7f40d1400640 1 -- 172.21.15.84:0/499254396 shutdown_connections 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.334+0000 7f40d1400640 1 --2- 172.21.15.84:0/499254396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40cc109c40 0x7f40cc110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.334+0000 7f40d1400640 1 --2- 172.21.15.84:0/499254396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1092f0 0x7f40cc109700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.334+0000 7f40d1400640 1 --2- 172.21.15.84:0/499254396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc1039b0 0x7f40cc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.334+0000 7f40d1400640 1 -- 172.21.15.84:0/499254396 >> 172.21.15.84:0/499254396 conn(0x7f40cc0ff400 msgr2=0x7f40cc101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.335+0000 7f40d1400640 1 -- 172.21.15.84:0/499254396 shutdown_connections 2024-09-21T07:47:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.335+0000 7f40d1400640 1 -- 172.21.15.84:0/499254396 wait complete. 2024-09-21T07:47:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.336+0000 7f40d1400640 1 Processor -- start 2024-09-21T07:47:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.336+0000 7f40d1400640 1 -- start start 2024-09-21T07:47:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1039b0 0x7f40cc19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40cc1092f0 0x7f40cc19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d1400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc109c40 0x7f40cc19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d1400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc113900 con 0x7f40cc1092f0 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d1400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc113780 con 0x7f40cc1039b0 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d1400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc113a80 con 0x7f40cc109c40 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1039b0 0x7f40cc19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40c3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40cc1092f0 0x7f40cc19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1039b0 0x7f40cc19a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42414/0 (socket says 172.21.15.84:42414) 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 -- 172.21.15.84:0/4179902568 learned_addr learned my addr 172.21.15.84:0/4179902568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d0a00640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc109c40 0x7f40cc19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 -- 172.21.15.84:0/4179902568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc109c40 msgr2=0x7f40cc19fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc109c40 0x7f40cc19fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 -- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40cc1092f0 msgr2=0x7f40cc19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40cc1092f0 0x7f40cc19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40cbe00640 1 -- 172.21.15.84:0/4179902568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc1a0280 con 0x7f40cc1039b0 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.337+0000 7f40d0a00640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc109c40 0x7f40cc19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.338+0000 7f40cbe00640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1039b0 0x7f40cc19a310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00eb90 tx=0x7f40bc00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.338+0000 7f40c9600640 1 -- 172.21.15.84:0/4179902568 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc004d20 con 0x7f40cc1039b0 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.338+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40cc1a0570 con 0x7f40cc1039b0 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.338+0000 7f40c9600640 1 -- 172.21.15.84:0/4179902568 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40bc00ee90 con 0x7f40cc1039b0 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.338+0000 7f40c9600640 1 -- 172.21.15.84:0/4179902568 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc010670 con 0x7f40cc1039b0 2024-09-21T07:47:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.338+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc1a6cd0 con 0x7f40cc1039b0 2024-09-21T07:47:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.339+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40cc103dc0 con 0x7f40cc1039b0 2024-09-21T07:47:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.342+0000 7f40c9600640 1 -- 172.21.15.84:0/4179902568 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f40bc010890 con 0x7f40cc1039b0 2024-09-21T07:47:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.343+0000 7f40c9600640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f40b00b6560 0x7f40b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.343+0000 7f40c9600640 1 -- 172.21.15.84:0/4179902568 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f40bc0e78c0 con 0x7f40cc1039b0 2024-09-21T07:47:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.343+0000 7f40c3400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f40b00b6560 0x7f40b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.344+0000 7f40c3400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f40b00b6560 0x7f40b00b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009230 tx=0x7f40b4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:08.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.345+0000 7f40c9600640 1 -- 172.21.15.84:0/4179902568 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40bc056710 con 0x7f40cc1039b0 2024-09-21T07:47:08.450 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 podman[63789]: 2024-09-21 07:47:08.09140241 +0000 UTC m=+0.015799616 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:08.450 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 podman[63789]: 2024-09-21 07:47:08.222635141 +0000 UTC m=+0.147032339 container create 35cb94b081882b2c82015e62655683c6db33f2c8de90cacea27ff4f2ca0399c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:47:08.450 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 podman[63789]: 2024-09-21 07:47:08.449068173 +0000 UTC m=+0.373465372 container init 35cb94b081882b2c82015e62655683c6db33f2c8de90cacea27ff4f2ca0399c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:47:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.569+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40cc19b440 con 0x7f40cc1039b0 2024-09-21T07:47:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.570+0000 7f40c9600640 1 -- 172.21.15.84:0/4179902568 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f40bc0ae480 con 0x7f40cc1039b0 2024-09-21T07:47:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:08.572 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"btime":"2024-09-21T07:47:06:023861+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2024-09-21T07:47:08.572 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 5 2024-09-21T07:47:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f40b00b6560 msgr2=0x7f40b00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f40b00b6560 0x7f40b00b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009230 tx=0x7f40b4031400 comp rx=0 tx=0).stop 2024-09-21T07:47:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1039b0 msgr2=0x7f40cc19a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1039b0 0x7f40cc19a310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00eb90 tx=0x7f40bc00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 shutdown_connections 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f40b00b6560 0x7f40b00b8a70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc109c40 0x7f40cc19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40cc1092f0 0x7f40cc19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 --2- 172.21.15.84:0/4179902568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40cc1039b0 0x7f40cc19a310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.572+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 >> 172.21.15.84:0/4179902568 conn(0x7f40cc0ff400 msgr2=0x7f40cc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.573+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 shutdown_connections 2024-09-21T07:47:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:08.573+0000 7f40d1400640 1 -- 172.21.15.84:0/4179902568 wait complete. 2024-09-21T07:47:08.801 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 podman[63789]: 2024-09-21 07:47:08.452010397 +0000 UTC m=+0.376407588 container start 35cb94b081882b2c82015e62655683c6db33f2c8de90cacea27ff4f2ca0399c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T07:47:08.802 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 ceph-mds[63809]: -- 172.21.15.162:0/3086739341 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7b60e5860 con 0x55e7ba28d180 2024-09-21T07:47:08.802 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e[63805]: starting mds.e at 2024-09-21T07:47:08.802 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 bash[63789]: 35cb94b081882b2c82015e62655683c6db33f2c8de90cacea27ff4f2ca0399c6 2024-09-21T07:47:08.802 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 07:47:08 smithi162 systemd[1]: Started Ceph mds.e for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4179902568' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:09.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:09 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4179902568' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:09.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:09.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:09 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:09.317 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:09.318 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4179902568' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:09.318 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.318 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.318 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:09.318 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:09.318 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:09.318 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:09 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:10.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:10 smithi162 ceph-mon[34833]: Deploying daemon mds.f on smithi191 2024-09-21T07:47:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:10 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6834/2049364491,v1:172.21.15.162:6835/2049364491] up:boot 2024-09-21T07:47:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:10 smithi162 ceph-mon[34833]: fsmap 5 up:standby 2024-09-21T07:47:10.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:10 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:47:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:10 smithi084 ceph-mon[30411]: Deploying daemon mds.f on smithi191 2024-09-21T07:47:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:10 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6834/2049364491,v1:172.21.15.162:6835/2049364491] up:boot 2024-09-21T07:47:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:10 smithi084 ceph-mon[30411]: fsmap 5 up:standby 2024-09-21T07:47:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:10 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:47:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:10 smithi191 ceph-mon[34667]: Deploying daemon mds.f on smithi191 2024-09-21T07:47:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:10 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6834/2049364491,v1:172.21.15.162:6835/2049364491] up:boot 2024-09-21T07:47:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:10 smithi191 ceph-mon[34667]: fsmap 5 up:standby 2024-09-21T07:47:10.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:10 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:47:10.860 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:10 smithi191 systemd[1]: Starting Ceph mds.f for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:11.141 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:11 smithi191 ceph-mon[34667]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:11.141 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:10 smithi191 podman[63487]: 2024-09-21 07:47:10.761361159 +0000 UTC m=+0.015766085 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:11.141 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:10 smithi191 podman[63487]: 2024-09-21 07:47:10.890563403 +0000 UTC m=+0.144968380 container create ee23b80f296306a649356e8d7bd7f150f11764b03183b19f042ffedca31035e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:47:11.141 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:11 smithi191 podman[63487]: 2024-09-21 07:47:11.140005404 +0000 UTC m=+0.394410316 container init ee23b80f296306a649356e8d7bd7f150f11764b03183b19f042ffedca31035e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:47:11.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:11 smithi162 ceph-mon[34833]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:11.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:11 smithi084 ceph-mon[30411]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:11.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:11.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:11 smithi191 podman[63487]: 2024-09-21 07:47:11.143017277 +0000 UTC m=+0.397422189 container start ee23b80f296306a649356e8d7bd7f150f11764b03183b19f042ffedca31035e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:47:11.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:11 smithi191 ceph-mds[63506]: -- 172.21.15.191:0/355254363 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562857b93860 con 0x56285bd3b600 2024-09-21T07:47:11.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f[63502]: starting mds.f at 2024-09-21T07:47:11.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:11 smithi191 bash[63487]: ee23b80f296306a649356e8d7bd7f150f11764b03183b19f042ffedca31035e9 2024-09-21T07:47:11.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 07:47:11 smithi191 systemd[1]: Started Ceph mds.f for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 -- 172.21.15.84:0/22769234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea8102640 msgr2=0x7feea8102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 --2- 172.21.15.84:0/22769234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea8102640 0x7feea8102a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee98009900 tx=0x7fee9802a480 comp rx=0 tx=0).stop 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 -- 172.21.15.84:0/22769234 shutdown_connections 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 --2- 172.21.15.84:0/22769234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea81101f0 0x7feea8112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 --2- 172.21.15.84:0/22769234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea8102f90 0x7feea810fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 --2- 172.21.15.84:0/22769234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea8102640 0x7feea8102a50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 -- 172.21.15.84:0/22769234 >> 172.21.15.84:0/22769234 conn(0x7feea80796e0 msgr2=0x7feea8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 -- 172.21.15.84:0/22769234 shutdown_connections 2024-09-21T07:47:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.321+0000 7feeaf800640 1 -- 172.21.15.84:0/22769234 wait complete. 2024-09-21T07:47:12.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.322+0000 7feeaf800640 1 Processor -- start 2024-09-21T07:47:12.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeaf800640 1 -- start start 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeaf800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea8102640 0x7feea819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeaf800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea8102f90 0x7feea819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeaf800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea81101f0 0x7feea81a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeaf800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feea8115c90 con 0x7feea8102640 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeaf800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feea8115b10 con 0x7feea8102f90 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeaf800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feea8115e10 con 0x7feea81101f0 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeace00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea8102640 0x7feea819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feead800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea81101f0 0x7feea81a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeace00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea8102640 0x7feea819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58558/0 (socket says 172.21.15.84:58558) 2024-09-21T07:47:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7feeace00640 1 -- 172.21.15.84:0/1223711171 learned_addr learned my addr 172.21.15.84:0/1223711171 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.323+0000 7fee9fe00640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea8102f90 0x7feea819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feead800640 1 -- 172.21.15.84:0/1223711171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea8102f90 msgr2=0x7feea819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feead800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea8102f90 0x7feea819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feead800640 1 -- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea8102640 msgr2=0x7feea819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feead800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea8102640 0x7feea819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feead800640 1 -- 172.21.15.84:0/1223711171 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea81a2650 con 0x7feea81101f0 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feeace00640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea8102640 0x7feea819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feead800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea81101f0 0x7feea81a1f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feea000ec50 tx=0x7feea000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feea6000640 1 -- 172.21.15.84:0/1223711171 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0003b70 con 0x7feea81101f0 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea81a2940 con 0x7feea81101f0 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feea6000640 1 -- 172.21.15.84:0/1223711171 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feea0003d10 con 0x7feea81101f0 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.324+0000 7feea6000640 1 -- 172.21.15.84:0/1223711171 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0010830 con 0x7feea81101f0 2024-09-21T07:47:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.325+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea81a90a0 con 0x7feea81101f0 2024-09-21T07:47:12.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.325+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea806c1a0 con 0x7feea81101f0 2024-09-21T07:47:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.328+0000 7feea6000640 1 -- 172.21.15.84:0/1223711171 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7feea0003ec0 con 0x7feea81101f0 2024-09-21T07:47:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.329+0000 7feea6000640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fee8c0b6560 0x7fee8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.329+0000 7feea6000640 1 -- 172.21.15.84:0/1223711171 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7feea00e7520 con 0x7feea81101f0 2024-09-21T07:47:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.329+0000 7feeace00640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fee8c0b6560 0x7fee8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.330+0000 7feeace00640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fee8c0b6560 0x7fee8c0b8a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fee98031440 tx=0x7fee980058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.333+0000 7feea6000640 1 -- 172.21.15.84:0/1223711171 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feea00ae0e0 con 0x7feea81101f0 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: Deploying daemon mds.c on smithi191 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] up:boot 2024-09-21T07:47:12.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: fsmap 6 up:standby 2024-09-21T07:47:12.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:12 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:47:12.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:12.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:12.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:12.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: Deploying daemon mds.c on smithi191 2024-09-21T07:47:12.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:12.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] up:boot 2024-09-21T07:47:12.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: fsmap 6 up:standby 2024-09-21T07:47:12.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:12 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:47:12.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.558+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feea81a9300 con 0x7feea81101f0 2024-09-21T07:47:12.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.558+0000 7feea6000640 1 -- 172.21.15.84:0/1223711171 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7feea00b24c0 con 0x7feea81101f0 2024-09-21T07:47:12.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:12.561 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"btime":"2024-09-21T07:47:12:047980+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24695,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24712,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T07:47:12.561 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fee8c0b6560 msgr2=0x7fee8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fee8c0b6560 0x7fee8c0b8a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fee98031440 tx=0x7fee980058d0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea81101f0 msgr2=0x7feea81a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea81101f0 0x7feea81a1f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feea000ec50 tx=0x7feea000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 shutdown_connections 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fee8c0b6560 0x7fee8c0b8a70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feea81101f0 0x7feea81a1f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feea8102f90 0x7feea819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 --2- 172.21.15.84:0/1223711171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feea8102640 0x7feea819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 >> 172.21.15.84:0/1223711171 conn(0x7feea80796e0 msgr2=0x7feea8108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 shutdown_connections 2024-09-21T07:47:12.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:12.563+0000 7feeaf800640 1 -- 172.21.15.84:0/1223711171 wait complete. 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: Deploying daemon mds.c on smithi191 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] up:boot 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: fsmap 6 up:standby 2024-09-21T07:47:12.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:12 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:47:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:13 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1223711171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:13.405 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 systemd[1]: Starting Ceph mds.c for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:13.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:13 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1223711171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:13.725 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1223711171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:13.828 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 podman[63752]: 2024-09-21 07:47:13.440884082 +0000 UTC m=+0.015700694 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:13.828 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 podman[63752]: 2024-09-21 07:47:13.573392997 +0000 UTC m=+0.148209636 container create a161ce33b4df8a2a9dafc984d7c44c94f2425ebd8db89d77229091934cb391ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T07:47:13.828 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 podman[63752]: 2024-09-21 07:47:13.827434789 +0000 UTC m=+0.402251382 container init a161ce33b4df8a2a9dafc984d7c44c94f2425ebd8db89d77229091934cb391ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T07:47:14.155 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 podman[63752]: 2024-09-21 07:47:13.83043769 +0000 UTC m=+0.405254292 container start a161ce33b4df8a2a9dafc984d7c44c94f2425ebd8db89d77229091934cb391ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:47:14.155 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 ceph-mds[63771]: -- 172.21.15.191:0/3015510674 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3599af860 con 0x55a35db57600 2024-09-21T07:47:14.155 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c[63767]: starting mds.c at 2024-09-21T07:47:14.155 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 bash[63752]: a161ce33b4df8a2a9dafc984d7c44c94f2425ebd8db89d77229091934cb391ba 2024-09-21T07:47:14.155 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 07:47:13 smithi191 systemd[1]: Started Ceph mds.c for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:15.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: Deploying daemon mds.h on smithi162 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] up:boot 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: fsmap 7 up:standby 2024-09-21T07:47:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:14 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: Deploying daemon mds.h on smithi162 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] up:boot 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: fsmap 7 up:standby 2024-09-21T07:47:15.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:14 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:47:15.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:15.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: Deploying daemon mds.h on smithi162 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] up:boot 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: fsmap 7 up:standby 2024-09-21T07:47:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:14 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:47:15.747 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:16.052 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:15 smithi162 systemd[1]: Starting Ceph mds.h for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:16.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 -- 172.21.15.84:0/3127759249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc54410b4f0 msgr2=0x7fc54410b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 --2- 172.21.15.84:0/3127759249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc54410b4f0 0x7fc54410b900 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc530009900 tx=0x7fc53002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 -- 172.21.15.84:0/3127759249 shutdown_connections 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 --2- 172.21.15.84:0/3127759249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410be40 0x7fc544112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 --2- 172.21.15.84:0/3127759249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc54410b4f0 0x7fc54410b900 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 --2- 172.21.15.84:0/3127759249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc544105bb0 0x7fc544105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 -- 172.21.15.84:0/3127759249 >> 172.21.15.84:0/3127759249 conn(0x7fc544101680 msgr2=0x7fc544103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 -- 172.21.15.84:0/3127759249 shutdown_connections 2024-09-21T07:47:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.410+0000 7fc548a00640 1 -- 172.21.15.84:0/3127759249 wait complete. 2024-09-21T07:47:16.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.411+0000 7fc548a00640 1 Processor -- start 2024-09-21T07:47:16.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc548a00640 1 -- start start 2024-09-21T07:47:16.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc548a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544105bb0 0x7fc54419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:16.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc548a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410b4f0 0x7fc54419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:16.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc548a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54410be40 0x7fc5441a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc548a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc544115b00 con 0x7fc544105bb0 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc548a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc544115980 con 0x7fc54410b4f0 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc548a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc544115c80 con 0x7fc54410be40 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc543400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544105bb0 0x7fc54419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc542a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410b4f0 0x7fc54419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc542a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410b4f0 0x7fc54419cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42464/0 (socket says 172.21.15.84:42464) 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc542a00640 1 -- 172.21.15.84:0/2194462637 learned_addr learned my addr 172.21.15.84:0/2194462637 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.412+0000 7fc543e00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54410be40 0x7fc5441a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc542a00640 1 -- 172.21.15.84:0/2194462637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54410be40 msgr2=0x7fc5441a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc542a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54410be40 0x7fc5441a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc542a00640 1 -- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544105bb0 msgr2=0x7fc54419c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc542a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544105bb0 0x7fc54419c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc542a00640 1 -- 172.21.15.84:0/2194462637 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5441a2480 con 0x7fc54410b4f0 2024-09-21T07:47:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc543e00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54410be40 0x7fc5441a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:47:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc542a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410b4f0 0x7fc54419cab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc53002a910 tx=0x7fc530031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc53be00640 1 -- 172.21.15.84:0/2194462637 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53003f030 con 0x7fc54410b4f0 2024-09-21T07:47:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc53be00640 1 -- 172.21.15.84:0/2194462637 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc530004490 con 0x7fc54410b4f0 2024-09-21T07:47:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5441a2710 con 0x7fc54410b4f0 2024-09-21T07:47:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc53be00640 1 -- 172.21.15.84:0/2194462637 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530035070 con 0x7fc54410b4f0 2024-09-21T07:47:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.413+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5441a8ed0 con 0x7fc54410b4f0 2024-09-21T07:47:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.415+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc544106e30 con 0x7fc54410b4f0 2024-09-21T07:47:16.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.417+0000 7fc53be00640 1 -- 172.21.15.84:0/2194462637 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc530042030 con 0x7fc54410b4f0 2024-09-21T07:47:16.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.418+0000 7fc53be00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5280b6560 0x7fc5280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:16.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.418+0000 7fc53be00640 1 -- 172.21.15.84:0/2194462637 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fc5301073b0 con 0x7fc54410b4f0 2024-09-21T07:47:16.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.418+0000 7fc543400640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5280b6560 0x7fc5280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:16.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.419+0000 7fc543400640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5280b6560 0x7fc5280b8a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc534009bd0 tx=0x7fc534005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:16.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.422+0000 7fc53be00640 1 -- 172.21.15.84:0/2194462637 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5300cdf70 con 0x7fc54410b4f0 2024-09-21T07:47:16.461 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 podman[64072]: 2024-09-21 07:47:16.073119032 +0000 UTC m=+0.016002351 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:16.462 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 podman[64072]: 2024-09-21 07:47:16.199579735 +0000 UTC m=+0.142463056 container create f2f6c6e8ea9455ea8b9c21e2da9e60bff9fd6164154d190ca36fcb1888898444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-21T07:47:16.462 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 podman[64072]: 2024-09-21 07:47:16.460802418 +0000 UTC m=+0.403685751 container init f2f6c6e8ea9455ea8b9c21e2da9e60bff9fd6164154d190ca36fcb1888898444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:47:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.651+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc54410dc10 con 0x7fc54410b4f0 2024-09-21T07:47:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.652+0000 7fc53be00640 1 -- 172.21.15.84:0/2194462637 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6400 (secure 0 0 0) 0x7fc5300d2350 con 0x7fc54410b4f0 2024-09-21T07:47:16.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:16.653 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"btime":"2024-09-21T07:47:14:304504+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24695,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24712,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T07:47:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-09-21T07:47:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5280b6560 msgr2=0x7fc5280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5280b6560 0x7fc5280b8a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc534009bd0 tx=0x7fc534005f90 comp rx=0 tx=0).stop 2024-09-21T07:47:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410b4f0 msgr2=0x7fc54419cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410b4f0 0x7fc54419cab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc53002a910 tx=0x7fc530031a20 comp rx=0 tx=0).stop 2024-09-21T07:47:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 shutdown_connections 2024-09-21T07:47:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5280b6560 0x7fc5280b8a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54410be40 0x7fc5441a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54410b4f0 0x7fc54419cab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 --2- 172.21.15.84:0/2194462637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544105bb0 0x7fc54419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 >> 172.21.15.84:0/2194462637 conn(0x7fc544101680 msgr2=0x7fc544103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 shutdown_connections 2024-09-21T07:47:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:16.654+0000 7fc548a00640 1 -- 172.21.15.84:0/2194462637 wait complete. 2024-09-21T07:47:16.802 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 podman[64072]: 2024-09-21 07:47:16.463880591 +0000 UTC m=+0.406763918 container start f2f6c6e8ea9455ea8b9c21e2da9e60bff9fd6164154d190ca36fcb1888898444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T07:47:16.802 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mds[64091]: -- 172.21.15.162:0/773353112 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562a8d51f860 con 0x562a916c7180 2024-09-21T07:47:16.802 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h[64087]: starting mds.h at 2024-09-21T07:47:16.802 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 bash[64072]: f2f6c6e8ea9455ea8b9c21e2da9e60bff9fd6164154d190ca36fcb1888898444 2024-09-21T07:47:16.802 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 07:47:16 smithi162 systemd[1]: Started Ceph mds.h for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:17.300 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:17.300 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.300 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.300 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.300 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:17.300 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2194462637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:17.300 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:17.301 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:16 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:17.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2194462637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:17.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:16 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2194462637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:17.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:16 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:18.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:17 smithi162 ceph-mon[34833]: Deploying daemon mds.i on smithi191 2024-09-21T07:47:18.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:17 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] up:boot 2024-09-21T07:47:18.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:17 smithi162 ceph-mon[34833]: fsmap 8 up:standby 2024-09-21T07:47:18.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:17 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:47:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:17 smithi084 ceph-mon[30411]: Deploying daemon mds.i on smithi191 2024-09-21T07:47:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:17 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] up:boot 2024-09-21T07:47:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:17 smithi084 ceph-mon[30411]: fsmap 8 up:standby 2024-09-21T07:47:18.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:17 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:47:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:17 smithi191 ceph-mon[34667]: Deploying daemon mds.i on smithi191 2024-09-21T07:47:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:17 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] up:boot 2024-09-21T07:47:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:17 smithi191 ceph-mon[34667]: fsmap 8 up:standby 2024-09-21T07:47:18.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:17 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:47:18.826 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:18 smithi191 systemd[1]: Starting Ceph mds.i for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:19.109 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:18 smithi191 ceph-mon[34667]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:19.109 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:18 smithi191 podman[64021]: 2024-09-21 07:47:18.727902475 +0000 UTC m=+0.015907776 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:19.110 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:18 smithi191 podman[64021]: 2024-09-21 07:47:18.835597445 +0000 UTC m=+0.123602778 container create cd175deb20a899473f75db35850915ea0942b9107299de38db0e44786519aa64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:47:19.110 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:19 smithi191 podman[64021]: 2024-09-21 07:47:19.072566284 +0000 UTC m=+0.360571575 container init cd175deb20a899473f75db35850915ea0942b9107299de38db0e44786519aa64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T07:47:19.110 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:19 smithi191 podman[64021]: 2024-09-21 07:47:19.075387949 +0000 UTC m=+0.363393240 container start cd175deb20a899473f75db35850915ea0942b9107299de38db0e44786519aa64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T07:47:19.110 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:19 smithi191 ceph-mds[64040]: -- 172.21.15.191:0/1198344784 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55869c8c1860 con 0x5586a0a69180 2024-09-21T07:47:19.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:18 smithi162 ceph-mon[34833]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:18 smithi084 ceph-mon[30411]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:19.405 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:19 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i[64036]: starting mds.i at 2024-09-21T07:47:19.405 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:19 smithi191 bash[64021]: cd175deb20a899473f75db35850915ea0942b9107299de38db0e44786519aa64 2024-09-21T07:47:19.405 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 07:47:19 smithi191 systemd[1]: Started Ceph mds.i for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:19.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: Deploying daemon mds.g on smithi084 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] up:boot 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: fsmap 9 up:standby 2024-09-21T07:47:20.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:20 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:47:20.501 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.501 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.501 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: Deploying daemon mds.g on smithi084 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] up:boot 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: fsmap 9 up:standby 2024-09-21T07:47:20.502 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:20 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: Deploying daemon mds.g on smithi084 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] up:boot 2024-09-21T07:47:20.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: fsmap 9 up:standby 2024-09-21T07:47:20.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:20 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:47:21.106 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:21.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1198950071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c18109c40 msgr2=0x7f1c18110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:21.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1198950071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c18109c40 0x7f1c18110470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009ca0 tx=0x7f1c1002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:47:21.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1198950071 shutdown_connections 2024-09-21T07:47:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1198950071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c18109c40 0x7f1c18110470 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1198950071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c181092f0 0x7f1c18109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1198950071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c181039b0 0x7f1c18103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1198950071 >> 172.21.15.84:0/1198950071 conn(0x7f1c180ff440 msgr2=0x7f1c18101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1198950071 shutdown_connections 2024-09-21T07:47:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.772+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1198950071 wait complete. 2024-09-21T07:47:21.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 Processor -- start 2024-09-21T07:47:21.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 -- start start 2024-09-21T07:47:21.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c181039b0 0x7f1c1819c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:21.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c181092f0 0x7f1c1819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:21.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c18109c40 0x7f1c181a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:21.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18113900 con 0x7f1c181092f0 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18113780 con 0x7f1c18109c40 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.774+0000 7f1c1dc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18113a80 con 0x7f1c181039b0 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c181092f0 0x7f1c1819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c181092f0 0x7f1c1819ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48488/0 (socket says 172.21.15.84:48488) 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c181039b0 0x7f1c1819c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17400640 1 -- 172.21.15.84:0/1918272120 learned_addr learned my addr 172.21.15.84:0/1918272120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c1d200640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c18109c40 0x7f1c181a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17e00640 1 -- 172.21.15.84:0/1918272120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c18109c40 msgr2=0x7f1c181a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17e00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c18109c40 0x7f1c181a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17e00640 1 -- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c181092f0 msgr2=0x7f1c1819ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17e00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c181092f0 0x7f1c1819ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.775+0000 7f1c17e00640 1 -- 172.21.15.84:0/1918272120 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c181a2460 con 0x7f1c181039b0 2024-09-21T07:47:21.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.776+0000 7f1c17e00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c181039b0 0x7f1c1819c4f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800e9f0 tx=0x7f1c0800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:21.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.776+0000 7f1c14c00640 1 -- 172.21.15.84:0/1918272120 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800ccc0 con 0x7f1c181039b0 2024-09-21T07:47:21.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.776+0000 7f1c14c00640 1 -- 172.21.15.84:0/1918272120 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c08005020 con 0x7f1c181039b0 2024-09-21T07:47:21.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.776+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c181a2750 con 0x7f1c181039b0 2024-09-21T07:47:21.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.776+0000 7f1c14c00640 1 -- 172.21.15.84:0/1918272120 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08004a00 con 0x7f1c181039b0 2024-09-21T07:47:21.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.776+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c181a8eb0 con 0x7f1c181039b0 2024-09-21T07:47:21.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.778+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c18103dc0 con 0x7f1c181039b0 2024-09-21T07:47:21.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.780+0000 7f1c14c00640 1 -- 172.21.15.84:0/1918272120 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f1c08004ba0 con 0x7f1c181039b0 2024-09-21T07:47:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.781+0000 7f1c14c00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1bfc0b6560 0x7f1bfc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.781+0000 7f1c14c00640 1 -- 172.21.15.84:0/1918272120 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f1c080e6f90 con 0x7f1c181039b0 2024-09-21T07:47:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.782+0000 7f1c17400640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1bfc0b6560 0x7f1bfc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:21.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.782+0000 7f1c17400640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1bfc0b6560 0x7f1bfc0b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c040095f0 tx=0x7f1c04005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:21.785+0000 7f1c14c00640 1 -- 172.21.15.84:0/1918272120 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c080adb50 con 0x7f1c181039b0 2024-09-21T07:47:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.033+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c181a9270 con 0x7f1c181039b0 2024-09-21T07:47:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.034+0000 7f1c14c00640 1 -- 172.21.15.84:0/1918272120 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8058 (secure 0 0 0) 0x7f1c080b1f30 con 0x7f1c181039b0 2024-09-21T07:47:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:22.036 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"btime":"2024-09-21T07:47:19:998749+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24695,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24712,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24719,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24742,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:47:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 10 2024-09-21T07:47:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1bfc0b6560 msgr2=0x7f1bfc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1bfc0b6560 0x7f1bfc0b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c040095f0 tx=0x7f1c04005f90 comp rx=0 tx=0).stop 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c181039b0 msgr2=0x7f1c1819c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c181039b0 0x7f1c1819c4f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800e9f0 tx=0x7f1c0800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 shutdown_connections 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1bfc0b6560 0x7f1bfc0b8a70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c18109c40 0x7f1c181a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c181092f0 0x7f1c1819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 --2- 172.21.15.84:0/1918272120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c181039b0 0x7f1c1819c4f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.036+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 >> 172.21.15.84:0/1918272120 conn(0x7f1c180ff440 msgr2=0x7f1c181068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.037+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 shutdown_connections 2024-09-21T07:47:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:22.037+0000 7f1c1dc00640 1 -- 172.21.15.84:0/1918272120 wait complete. 2024-09-21T07:47:22.291 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 07:47:22 smithi084 podman[73669]: 2024-09-21 07:47:22.167653178 +0000 UTC m=+0.177071265 container create 321154123d54bfd8eda21dcbbe4f834ca845ab7f66418d574e4b77cebec96ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-21T07:47:23.024 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 07:47:22 smithi084 podman[73669]: 2024-09-21 07:47:22.741248979 +0000 UTC m=+0.750667074 container init 321154123d54bfd8eda21dcbbe4f834ca845ab7f66418d574e4b77cebec96ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:47:23.025 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 07:47:22 smithi084 podman[73669]: 2024-09-21 07:47:22.747707008 +0000 UTC m=+0.757125096 container start 321154123d54bfd8eda21dcbbe4f834ca845ab7f66418d574e4b77cebec96ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T07:47:23.025 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 07:47:22 smithi084 ceph-mds[73704]: -- 172.21.15.84:0/1015839761 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb4042fc20 con 0x55bb445d7600 2024-09-21T07:47:23.025 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 07:47:22 smithi084 bash[73669]: 321154123d54bfd8eda21dcbbe4f834ca845ab7f66418d574e4b77cebec96ba7 2024-09-21T07:47:23.025 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 07:47:22 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g[73697]: starting mds.g at 2024-09-21T07:47:23.025 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 07:47:22 smithi084 systemd[1]: Started Ceph mds.g for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:23.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:23.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1918272120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:23.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:23.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:23.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:23 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:23.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:23.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1918272120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:23.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:23.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:23.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:23 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1918272120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:23 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:24.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:24 smithi162 ceph-mon[34833]: Deploying daemon mds.a on smithi084 2024-09-21T07:47:24.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:24 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.84:6838/2332299014,v1:172.21.15.84:6839/2332299014] up:boot 2024-09-21T07:47:24.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:24 smithi162 ceph-mon[34833]: fsmap 10 up:standby 2024-09-21T07:47:24.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:24 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:47:24.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:24 smithi084 ceph-mon[30411]: Deploying daemon mds.a on smithi084 2024-09-21T07:47:24.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:24 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.84:6838/2332299014,v1:172.21.15.84:6839/2332299014] up:boot 2024-09-21T07:47:24.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:24 smithi084 ceph-mon[30411]: fsmap 10 up:standby 2024-09-21T07:47:24.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:24 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:47:24.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:24 smithi191 ceph-mon[34667]: Deploying daemon mds.a on smithi084 2024-09-21T07:47:24.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:24 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.84:6838/2332299014,v1:172.21.15.84:6839/2332299014] up:boot 2024-09-21T07:47:24.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:24 smithi191 ceph-mon[34667]: fsmap 10 up:standby 2024-09-21T07:47:24.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:24 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:47:25.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:25 smithi162 ceph-mon[34833]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:25.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:25.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:25 smithi084 ceph-mon[30411]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:25.252 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 systemd[1]: Starting Ceph mds.a for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:25.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:25 smithi191 ceph-mon[34667]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:25.866 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 podman[73969]: 2024-09-21 07:47:25.496570415 +0000 UTC m=+0.028338976 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:25.866 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 podman[73969]: 2024-09-21 07:47:25.604565316 +0000 UTC m=+0.136333883 container create 3ac567c58e638e94e65fe799f979e3946a860334175f574e89c601b4a451321a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T07:47:25.866 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 podman[73969]: 2024-09-21 07:47:25.864865096 +0000 UTC m=+0.396633654 container init 3ac567c58e638e94e65fe799f979e3946a860334175f574e89c601b4a451321a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T07:47:26.047 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:26.189 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 podman[73969]: 2024-09-21 07:47:25.871476392 +0000 UTC m=+0.403244950 container start 3ac567c58e638e94e65fe799f979e3946a860334175f574e89c601b4a451321a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T07:47:26.189 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 ceph-mds[74014]: -- 172.21.15.84:0/3367655471 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56088d039860 con 0x5608911e1a80 2024-09-21T07:47:26.189 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 bash[73969]: 3ac567c58e638e94e65fe799f979e3946a860334175f574e89c601b4a451321a 2024-09-21T07:47:26.189 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a[74007]: starting mds.a at 2024-09-21T07:47:26.189 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 07:47:25 smithi084 systemd[1]: Started Ceph mds.a for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:26.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 -- 172.21.15.84:0/475859879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa184109c20 msgr2=0x7fa184110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 --2- 172.21.15.84:0/475859879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa184109c20 0x7fa184110450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009ca0 tx=0x7fa17c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 -- 172.21.15.84:0/475859879 shutdown_connections 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 --2- 172.21.15.84:0/475859879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa184109c20 0x7fa184110450 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 --2- 172.21.15.84:0/475859879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1841092d0 0x7fa1841096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 --2- 172.21.15.84:0/475859879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184103990 0x7fa184103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 -- 172.21.15.84:0/475859879 >> 172.21.15.84:0/475859879 conn(0x7fa1840ff3e0 msgr2=0x7fa184101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 -- 172.21.15.84:0/475859879 shutdown_connections 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.660+0000 7fa188e00640 1 -- 172.21.15.84:0/475859879 wait complete. 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.661+0000 7fa188e00640 1 Processor -- start 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.661+0000 7fa188e00640 1 -- start start 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa188e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa184103990 0x7fa18419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa188e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1841092d0 0x7fa18419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa188e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184109c20 0x7fa1841a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa188e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa184113960 con 0x7fa1841092d0 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa188e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841137e0 con 0x7fa184109c20 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa188e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa184113ae0 con 0x7fa184103990 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa182a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1841092d0 0x7fa18419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa183e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184109c20 0x7fa1841a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa182a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1841092d0 0x7fa18419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48526/0 (socket says 172.21.15.84:48526) 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa182a00640 1 -- 172.21.15.84:0/438398127 learned_addr learned my addr 172.21.15.84:0/438398127 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.662+0000 7fa183400640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa184103990 0x7fa18419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa183e00640 1 -- 172.21.15.84:0/438398127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa184103990 msgr2=0x7fa18419c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa183e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa184103990 0x7fa18419c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa183e00640 1 -- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1841092d0 msgr2=0x7fa18419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa183e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1841092d0 0x7fa18419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa183e00640 1 -- 172.21.15.84:0/438398127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1841a24e0 con 0x7fa184109c20 2024-09-21T07:47:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa182a00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1841092d0 0x7fa18419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:47:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa183e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184109c20 0x7fa1841a1db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa17c02ade0 tx=0x7fa17c0316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa17be00640 1 -- 172.21.15.84:0/438398127 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c003b70 con 0x7fa184109c20 2024-09-21T07:47:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1841a2770 con 0x7fa184109c20 2024-09-21T07:47:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa17be00640 1 -- 172.21.15.84:0/438398127 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa17c0318e0 con 0x7fa184109c20 2024-09-21T07:47:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa17be00640 1 -- 172.21.15.84:0/438398127 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c02f8a0 con 0x7fa184109c20 2024-09-21T07:47:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.663+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1841a8f30 con 0x7fa184109c20 2024-09-21T07:47:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.664+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa184103da0 con 0x7fa184109c20 2024-09-21T07:47:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.667+0000 7fa17be00640 1 -- 172.21.15.84:0/438398127 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fa17c004b40 con 0x7fa184109c20 2024-09-21T07:47:26.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.668+0000 7fa17be00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1680b6560 0x7fa1680b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.668+0000 7fa17be00640 1 -- 172.21.15.84:0/438398127 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fa17c1082d0 con 0x7fa184109c20 2024-09-21T07:47:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.668+0000 7fa183400640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1680b6560 0x7fa1680b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.669+0000 7fa183400640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1680b6560 0x7fa1680b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa174009990 tx=0x7fa174009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.670+0000 7fa17be00640 1 -- 172.21.15.84:0/438398127 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa17c0cee90 con 0x7fa184109c20 2024-09-21T07:47:26.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.892+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1841a9190 con 0x7fa184109c20 2024-09-21T07:47:26.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.893+0000 7fa17be00640 1 -- 172.21.15.84:0/438398127 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9710 (secure 0 0 0) 0x7fa17c003d10 con 0x7fa184109c20 2024-09-21T07:47:26.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:26.895 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":12,"btime":"2024-09-21T07:47:26:031677+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24695,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24712,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24719,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24742,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:47:26.896 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1680b6560 msgr2=0x7fa1680b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1680b6560 0x7fa1680b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa174009990 tx=0x7fa174009110 comp rx=0 tx=0).stop 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184109c20 msgr2=0x7fa1841a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184109c20 0x7fa1841a1db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa17c02ade0 tx=0x7fa17c0316f0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 shutdown_connections 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1680b6560 0x7fa1680b8a70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa184109c20 0x7fa1841a1db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1841092d0 0x7fa18419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 --2- 172.21.15.84:0/438398127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa184103990 0x7fa18419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 >> 172.21.15.84:0/438398127 conn(0x7fa1840ff3e0 msgr2=0x7fa184108970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 shutdown_connections 2024-09-21T07:47:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:26.896+0000 7fa188e00640 1 -- 172.21.15.84:0/438398127 wait complete. 2024-09-21T07:47:27.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:27.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.84:6840/1397513983,v1:172.21.15.84:6841/1397513983] up:boot 2024-09-21T07:47:27.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: fsmap 11 up:standby 2024-09-21T07:47:27.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:47:27.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: Deploying daemon mds.b on smithi162 2024-09-21T07:47:27.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:27 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/438398127' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.84:6840/1397513983,v1:172.21.15.84:6841/1397513983] up:boot 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: fsmap 11 up:standby 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:27.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:27.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: Deploying daemon mds.b on smithi162 2024-09-21T07:47:27.303 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:27 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/438398127' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.84:6840/1397513983,v1:172.21.15.84:6841/1397513983] up:boot 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: fsmap 11 up:standby 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:47:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:47:27.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:27.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: Deploying daemon mds.b on smithi162 2024-09-21T07:47:27.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:27 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/438398127' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:28.052 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:27 smithi162 systemd[1]: Starting Ceph mds.b for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T07:47:28.373 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 podman[64342]: 2024-09-21 07:47:28.005271662 +0000 UTC m=+0.015600577 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:47:28.373 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 podman[64342]: 2024-09-21 07:47:28.128034433 +0000 UTC m=+0.138363351 container create 491d461f3f5208b187539805f58c7b6d9db44d6ffcad5707c2f98f1bdc22087d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:47:28.373 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 podman[64342]: 2024-09-21 07:47:28.372357564 +0000 UTC m=+0.382686480 container init 491d461f3f5208b187539805f58c7b6d9db44d6ffcad5707c2f98f1bdc22087d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T07:47:28.802 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 podman[64342]: 2024-09-21 07:47:28.375549082 +0000 UTC m=+0.385877998 container start 491d461f3f5208b187539805f58c7b6d9db44d6ffcad5707c2f98f1bdc22087d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T07:47:28.802 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 ceph-mds[64361]: -- 172.21.15.162:0/2314244962 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5610ab007c20 con 0x5610af1afa80 2024-09-21T07:47:28.802 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b[64357]: starting mds.b at 2024-09-21T07:47:28.802 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 bash[64342]: 491d461f3f5208b187539805f58c7b6d9db44d6ffcad5707c2f98f1bdc22087d 2024-09-21T07:47:28.802 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:28 smithi162 systemd[1]: Started Ceph mds.b for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T07:47:29.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:29 smithi162 ceph-mon[34833]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:29 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:29.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:29 smithi084 ceph-mon[30411]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:29.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:29 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:29 smithi191 ceph-mon[34667]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:29 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:29.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:30.028 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:30 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] up:boot 2024-09-21T07:47:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:30 smithi162 ceph-mon[34833]: fsmap 12 up:standby 2024-09-21T07:47:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:47:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:30.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:30.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:30 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] up:boot 2024-09-21T07:47:30.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:30 smithi084 ceph-mon[30411]: fsmap 12 up:standby 2024-09-21T07:47:30.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:47:30.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:30.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:30.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:30 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] up:boot 2024-09-21T07:47:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:30 smithi191 ceph-mon[34667]: fsmap 12 up:standby 2024-09-21T07:47:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:47:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 -- 172.21.15.84:0/3030352849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee81039b0 msgr2=0x7f5ee8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 --2- 172.21.15.84:0/3030352849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee81039b0 0x7f5ee8103dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009900 tx=0x7f5edc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 -- 172.21.15.84:0/3030352849 shutdown_connections 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 --2- 172.21.15.84:0/3030352849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee8109c40 0x7f5ee8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 --2- 172.21.15.84:0/3030352849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81092f0 0x7f5ee8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 --2- 172.21.15.84:0/3030352849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee81039b0 0x7f5ee8103dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 -- 172.21.15.84:0/3030352849 >> 172.21.15.84:0/3030352849 conn(0x7f5ee80ff440 msgr2=0x7f5ee8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.685+0000 7f5eef200640 1 -- 172.21.15.84:0/3030352849 shutdown_connections 2024-09-21T07:47:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.686+0000 7f5eef200640 1 -- 172.21.15.84:0/3030352849 wait complete. 2024-09-21T07:47:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.687+0000 7f5eef200640 1 Processor -- start 2024-09-21T07:47:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.687+0000 7f5eef200640 1 -- start start 2024-09-21T07:47:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eef200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81039b0 0x7f5ee819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eef200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee81092f0 0x7f5ee819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eef200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee8109c40 0x7f5ee819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eef200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113900 con 0x7f5ee8109c40 2024-09-21T07:47:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eef200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113780 con 0x7f5ee81039b0 2024-09-21T07:47:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eef200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113a80 con 0x7f5ee81092f0 2024-09-21T07:47:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eede00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81039b0 0x7f5ee819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eede00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81039b0 0x7f5ee819a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43826/0 (socket says 172.21.15.84:43826) 2024-09-21T07:47:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eede00640 1 -- 172.21.15.84:0/1072028233 learned_addr learned my addr 172.21.15.84:0/1072028233 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eed400640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee81092f0 0x7f5ee819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eee800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee8109c40 0x7f5ee819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eede00640 1 -- 172.21.15.84:0/1072028233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee81092f0 msgr2=0x7f5ee819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eede00640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee81092f0 0x7f5ee819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eede00640 1 -- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee8109c40 msgr2=0x7f5ee819fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.688+0000 7f5eede00640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee8109c40 0x7f5ee819fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.689+0000 7f5eede00640 1 -- 172.21.15.84:0/1072028233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee81a0260 con 0x7f5ee81039b0 2024-09-21T07:47:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.689+0000 7f5eede00640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81039b0 0x7f5ee819a2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005940 tx=0x7f5edc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.689+0000 7f5ee2a00640 1 -- 172.21.15.84:0/1072028233 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc03f030 con 0x7f5ee81039b0 2024-09-21T07:47:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.689+0000 7f5ee2a00640 1 -- 172.21.15.84:0/1072028233 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5edc003aa0 con 0x7f5ee81039b0 2024-09-21T07:47:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.689+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee81a04f0 con 0x7f5ee81039b0 2024-09-21T07:47:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.689+0000 7f5ee2a00640 1 -- 172.21.15.84:0/1072028233 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc035070 con 0x7f5ee81039b0 2024-09-21T07:47:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.689+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee81a6cb0 con 0x7f5ee81039b0 2024-09-21T07:47:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.690+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee8103dc0 con 0x7f5ee81039b0 2024-09-21T07:47:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.693+0000 7f5ee2a00640 1 -- 172.21.15.84:0/1072028233 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f5edc042030 con 0x7f5ee81039b0 2024-09-21T07:47:30.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.694+0000 7f5ee2a00640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ed00b6560 0x7f5ed00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:30.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.694+0000 7f5ee2a00640 1 -- 172.21.15.84:0/1072028233 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f5edc107970 con 0x7f5ee81039b0 2024-09-21T07:47:30.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.694+0000 7f5eed400640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ed00b6560 0x7f5ed00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:30.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.695+0000 7f5eed400640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ed00b6560 0x7f5ed00b8a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80095f0 tx=0x7f5ed8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:30.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.696+0000 7f5ee2a00640 1 -- 172.21.15.84:0/1072028233 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5edc0d2910 con 0x7f5ee81039b0 2024-09-21T07:47:30.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.950+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ee810ba40 con 0x7f5ee81039b0 2024-09-21T07:47:30.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.951+0000 7f5ee2a00640 1 -- 172.21.15.84:0/1072028233 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10539 (secure 0 0 0) 0x7f5edc0d7850 con 0x7f5ee81039b0 2024-09-21T07:47:30.953 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:30.954 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"btime":"2024-09-21T07:47:29:041178+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24695,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24712,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24719,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24742,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24746,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T07:47:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-09-21T07:47:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ed00b6560 msgr2=0x7f5ed00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ed00b6560 0x7f5ed00b8a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80095f0 tx=0x7f5ed8005f90 comp rx=0 tx=0).stop 2024-09-21T07:47:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81039b0 msgr2=0x7f5ee819a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81039b0 0x7f5ee819a2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005940 tx=0x7f5edc004270 comp rx=0 tx=0).stop 2024-09-21T07:47:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 shutdown_connections 2024-09-21T07:47:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ed00b6560 0x7f5ed00b8a70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ee8109c40 0x7f5ee819fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee81092f0 0x7f5ee819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 --2- 172.21.15.84:0/1072028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ee81039b0 0x7f5ee819a2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 >> 172.21.15.84:0/1072028233 conn(0x7f5ee80ff440 msgr2=0x7f5ee8101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 shutdown_connections 2024-09-21T07:47:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:30.954+0000 7f5eef200640 1 -- 172.21.15.84:0/1072028233 wait complete. 2024-09-21T07:47:31.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:31 smithi084 ceph-mon[30411]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:31.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:31 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1072028233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:31.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:31 smithi191 ceph-mon[34667]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:31 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1072028233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:31 smithi162 ceph-mon[34833]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:31 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1072028233' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:31.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T07:47:32.091 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:32.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.707+0000 7f76c4c00640 1 -- 172.21.15.84:0/3536096879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 msgr2=0x7f76c0106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:32.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.707+0000 7f76c4c00640 1 --2- 172.21.15.84:0/3536096879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 0x7f76c0106190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009be0 tx=0x7f76b002a6c0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.708+0000 7f76c4c00640 1 -- 172.21.15.84:0/3536096879 shutdown_connections 2024-09-21T07:47:32.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.708+0000 7f76c4c00640 1 --2- 172.21.15.84:0/3536096879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010c010 0x7f76c0112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.708+0000 7f76c4c00640 1 --2- 172.21.15.84:0/3536096879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c010b6c0 0x7f76c010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.708+0000 7f76c4c00640 1 --2- 172.21.15.84:0/3536096879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 0x7f76c0106190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.708+0000 7f76c4c00640 1 -- 172.21.15.84:0/3536096879 >> 172.21.15.84:0/3536096879 conn(0x7f76c0101810 msgr2=0x7f76c0103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:32.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.708+0000 7f76c4c00640 1 -- 172.21.15.84:0/3536096879 shutdown_connections 2024-09-21T07:47:32.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.708+0000 7f76c4c00640 1 -- 172.21.15.84:0/3536096879 wait complete. 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.709+0000 7f76c4c00640 1 Processor -- start 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.709+0000 7f76c4c00640 1 -- start start 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.709+0000 7f76c4c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 0x7f76c019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.709+0000 7f76c4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010b6c0 0x7f76c019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.709+0000 7f76c4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c010c010 0x7f76c01a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76c4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0115cd0 con 0x7f76c010c010 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76c4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0115b50 con 0x7f76c010b6c0 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76c4c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76c0115e50 con 0x7f76c0105d80 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010b6c0 0x7f76c019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010b6c0 0x7f76c019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43830/0 (socket says 172.21.15.84:43830) 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 -- 172.21.15.84:0/114711639 learned_addr learned my addr 172.21.15.84:0/114711639 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76be800640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c010c010 0x7f76c01a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76bde00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 0x7f76c019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 -- 172.21.15.84:0/114711639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 msgr2=0x7f76c019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 0x7f76c019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 -- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c010c010 msgr2=0x7f76c01a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c010c010 0x7f76c01a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.710+0000 7f76b5400640 1 -- 172.21.15.84:0/114711639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c01a2630 con 0x7f76c010b6c0 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.711+0000 7f76b5400640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010b6c0 0x7f76c019cc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76a80058c0 tx=0x7f76a800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.711+0000 7f76b7400640 1 -- 172.21.15.84:0/114711639 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a800cd30 con 0x7f76c010b6c0 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.711+0000 7f76b7400640 1 -- 172.21.15.84:0/114711639 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a80035f0 con 0x7f76c010b6c0 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.711+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c01a2920 con 0x7f76c010b6c0 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.711+0000 7f76b7400640 1 -- 172.21.15.84:0/114711639 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a80044e0 con 0x7f76c010b6c0 2024-09-21T07:47:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.711+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c01a9080 con 0x7f76c010b6c0 2024-09-21T07:47:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.712+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c0106190 con 0x7f76c010b6c0 2024-09-21T07:47:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.715+0000 7f76b7400640 1 -- 172.21.15.84:0/114711639 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f76a8003aa0 con 0x7f76c010b6c0 2024-09-21T07:47:32.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.716+0000 7f76b7400640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76a40b65e0 0x7f76a40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:32.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.716+0000 7f76b7400640 1 -- 172.21.15.84:0/114711639 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f76a80e7530 con 0x7f76c010b6c0 2024-09-21T07:47:32.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.716+0000 7f76bde00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76a40b65e0 0x7f76a40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:32.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.717+0000 7f76bde00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76a40b65e0 0x7f76a40b8af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76b0000f80 tx=0x7f76b0005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:32.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.718+0000 7f76b7400640 1 -- 172.21.15.84:0/114711639 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76a80ae0f0 con 0x7f76c010b6c0 2024-09-21T07:47:32.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:32.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:32.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:32.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:32.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:32.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:32 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:32.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:32 smithi084 ceph-mon[30411]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:32.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:32.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:32.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:32.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:32.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:32.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:32 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:32.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:32 smithi191 ceph-mon[34667]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.922+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f76c019d7f0 con 0x7f76c010b6c0 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.923+0000 7f76b7400640 1 -- 172.21.15.84:0/114711639 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f76c019d7f0 con 0x7f76c010b6c0 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:47:32.925 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-09-21T07:47:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.925+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76a40b65e0 msgr2=0x7f76a40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.925+0000 7f76c4c00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76a40b65e0 0x7f76a40b8af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76b0000f80 tx=0x7f76b0005fd0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.925+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010b6c0 msgr2=0x7f76c019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.925+0000 7f76c4c00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010b6c0 0x7f76c019cc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76a80058c0 tx=0x7f76a800ee50 comp rx=0 tx=0).stop 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 shutdown_connections 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76a40b65e0 0x7f76a40b8af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c010c010 0x7f76c01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c010b6c0 0x7f76c019cc60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 --2- 172.21.15.84:0/114711639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c0105d80 0x7f76c019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 >> 172.21.15.84:0/114711639 conn(0x7f76c0101810 msgr2=0x7f76c0103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 shutdown_connections 2024-09-21T07:47:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:32.926+0000 7f76c4c00640 1 -- 172.21.15.84:0/114711639 wait complete. 2024-09-21T07:47:33.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:33.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:33.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:33.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:33.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:33.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:32 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:33.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:32 smithi162 ceph-mon[34833]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:34.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:33 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/114711639' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:47:34.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:33 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:33 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:33 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:33 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:33 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/114711639' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:47:34.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:33 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:33 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:33 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:33 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:33 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/114711639' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:47:34.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:33 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:33 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:33 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:33 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:34.440 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:47:34.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:47:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:35.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:34 smithi084 ceph-mon[30411]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:35.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:34 smithi162 ceph-mon[34833]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:35.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:34 smithi191 ceph-mon[34667]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:35.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 -- 172.21.15.84:0/4160645557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0114440 msgr2=0x7ff8b0116910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:35.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/4160645557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0114440 0x7ff8b0116910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009ca0 tx=0x7ff8a802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 -- 172.21.15.84:0/4160645557 shutdown_connections 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/4160645557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0114440 0x7ff8b0116910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/4160645557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0075dd0 0x7ff8b00761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/4160645557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8b0077380 0x7ff8b00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 -- 172.21.15.84:0/4160645557 >> 172.21.15.84:0/4160645557 conn(0x7ff8b00ff5e0 msgr2=0x7ff8b0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 -- 172.21.15.84:0/4160645557 shutdown_connections 2024-09-21T07:47:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.557+0000 7ff8b6c00640 1 -- 172.21.15.84:0/4160645557 wait complete. 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 Processor -- start 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 -- start start 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0075dd0 0x7ff8b01a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0077380 0x7ff8b01a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8b0114440 0x7ff8b01a6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b011a0d0 con 0x7ff8b0075dd0 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b0119f50 con 0x7ff8b0077380 2024-09-21T07:47:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.559+0000 7ff8b6c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b011a250 con 0x7ff8b0114440 2024-09-21T07:47:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0077380 0x7ff8b01a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0077380 0x7ff8b01a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43848/0 (socket says 172.21.15.84:43848) 2024-09-21T07:47:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 -- 172.21.15.84:0/697201914 learned_addr learned my addr 172.21.15.84:0/697201914 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8b4c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8b0114440 0x7ff8b01a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8afe00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0075dd0 0x7ff8b01a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 -- 172.21.15.84:0/697201914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8b0114440 msgr2=0x7ff8b01a6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8b0114440 0x7ff8b01a6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 -- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0075dd0 msgr2=0x7ff8b01a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0075dd0 0x7ff8b01a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8af400640 1 -- 172.21.15.84:0/697201914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b01a6950 con 0x7ff8b0077380 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.560+0000 7ff8b4c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8b0114440 0x7ff8b01a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.561+0000 7ff8af400640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0077380 0x7ff8b01a0f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00e9a0 tx=0x7ff89c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.561+0000 7ff8acc00640 1 -- 172.21.15.84:0/697201914 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00cd80 con 0x7ff8b0077380 2024-09-21T07:47:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.561+0000 7ff8acc00640 1 -- 172.21.15.84:0/697201914 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff89c0035f0 con 0x7ff8b0077380 2024-09-21T07:47:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.561+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b01a6c40 con 0x7ff8b0077380 2024-09-21T07:47:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.561+0000 7ff8acc00640 1 -- 172.21.15.84:0/697201914 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c010690 con 0x7ff8b0077380 2024-09-21T07:47:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.561+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b01ad3a0 con 0x7ff8b0077380 2024-09-21T07:47:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.563+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b00761e0 con 0x7ff8b0077380 2024-09-21T07:47:35.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.566+0000 7ff8acc00640 1 -- 172.21.15.84:0/697201914 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7ff89c004000 con 0x7ff8b0077380 2024-09-21T07:47:35.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.567+0000 7ff8acc00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8940b6560 0x7ff8940b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:35.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.567+0000 7ff8acc00640 1 -- 172.21.15.84:0/697201914 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ff89c0e77b0 con 0x7ff8b0077380 2024-09-21T07:47:35.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.567+0000 7ff8afe00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8940b6560 0x7ff8940b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:35.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.568+0000 7ff8afe00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8940b6560 0x7ff8940b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009b60 tx=0x7ff8a0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:35.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.569+0000 7ff8acc00640 1 -- 172.21.15.84:0/697201914 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff89c0042f0 con 0x7ff8b0077380 2024-09-21T07:47:35.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:35.792+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff8b01a1b10 con 0x7ff8b0077380 2024-09-21T07:47:36.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.656+0000 7ff8acc00640 1 -- 172.21.15.84:0/697201914 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7ff8b01a1b10 con 0x7ff8b0077380 2024-09-21T07:47:36.659 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-09-21T07:47:36.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.660+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8940b6560 msgr2=0x7ff8940b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:36.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8940b6560 0x7ff8940b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009b60 tx=0x7ff8a0005f90 comp rx=0 tx=0).stop 2024-09-21T07:47:36.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0077380 msgr2=0x7ff8b01a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:36.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0077380 0x7ff8b01a0f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00e9a0 tx=0x7ff89c00ee60 comp rx=0 tx=0).stop 2024-09-21T07:47:36.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 shutdown_connections 2024-09-21T07:47:36.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8940b6560 0x7ff8940b8a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:36.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8b0114440 0x7ff8b01a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:36.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8b0077380 0x7ff8b01a0f80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:36.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 --2- 172.21.15.84:0/697201914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b0075dd0 0x7ff8b01a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:36.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.661+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 >> 172.21.15.84:0/697201914 conn(0x7ff8b00ff5e0 msgr2=0x7ff8b0110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:36.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.662+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 shutdown_connections 2024-09-21T07:47:36.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:36.662+0000 7ff8b6c00640 1 -- 172.21.15.84:0/697201914 wait complete. 2024-09-21T07:47:36.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:36.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:36.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:36.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:36.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:36.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/697201914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:47:36.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:47:36.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:36 smithi191 ceph-mon[34667]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/697201914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:47:37.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:36 smithi162 ceph-mon[34833]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/697201914' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:47:37.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:36 smithi084 ceph-mon[30411]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:37.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T07:47:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:37 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:47:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:37 smithi084 ceph-mon[30411]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:47:37.961 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:37 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:47:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:37 smithi162 ceph-mon[34833]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:47:38.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:37 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:47:38.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:37 smithi191 ceph-mon[34667]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:47:38.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.603+0000 7f73a8e00640 1 -- 172.21.15.84:0/3063135466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a4105bc0 msgr2=0x7f73a4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:38.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.603+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3063135466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a4105bc0 0x7f73a4105fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7394009900 tx=0x7f739402a410 comp rx=0 tx=0).stop 2024-09-21T07:47:38.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.604+0000 7f73a8e00640 1 -- 172.21.15.84:0/3063135466 shutdown_connections 2024-09-21T07:47:38.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.604+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3063135466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a410be50 0x7f73a4112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:38.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.604+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3063135466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a410b500 0x7f73a410b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:38.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.604+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3063135466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a4105bc0 0x7f73a4105fd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.604+0000 7f73a8e00640 1 -- 172.21.15.84:0/3063135466 >> 172.21.15.84:0/3063135466 conn(0x7f73a4101670 msgr2=0x7f73a4103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.604+0000 7f73a8e00640 1 -- 172.21.15.84:0/3063135466 shutdown_connections 2024-09-21T07:47:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.604+0000 7f73a8e00640 1 -- 172.21.15.84:0/3063135466 wait complete. 2024-09-21T07:47:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 Processor -- start 2024-09-21T07:47:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 -- start start 2024-09-21T07:47:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4105bc0 0x7f73a419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a410b500 0x7f73a419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a410be50 0x7f73a41a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4115b60 con 0x7f73a410b500 2024-09-21T07:47:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73a41159e0 con 0x7f73a410be50 2024-09-21T07:47:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a8e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4115ce0 con 0x7f73a4105bc0 2024-09-21T07:47:38.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a410b500 0x7f73a419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:38.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a410be50 0x7f73a41a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:38.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.605+0000 7f73a2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a410b500 0x7f73a419cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55094/0 (socket says 172.21.15.84:55094) 2024-09-21T07:47:38.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a2a00640 1 -- 172.21.15.84:0/3011426421 learned_addr learned my addr 172.21.15.84:0/3011426421 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:38.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a3400640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4105bc0 0x7f73a419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:38.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a2a00640 1 -- 172.21.15.84:0/3011426421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4105bc0 msgr2=0x7f73a419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:38.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a2a00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4105bc0 0x7f73a419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:38.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a2a00640 1 -- 172.21.15.84:0/3011426421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a410be50 msgr2=0x7f73a41a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:38.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a2a00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a410be50 0x7f73a41a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:38.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a2a00640 1 -- 172.21.15.84:0/3011426421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a41a24a0 con 0x7f73a410b500 2024-09-21T07:47:38.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.606+0000 7f73a2a00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a410b500 0x7f73a419cad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f739000e9f0 tx=0x7f739000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:38.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.607+0000 7f739be00640 1 -- 172.21.15.84:0/3011426421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739000ccc0 con 0x7f73a410b500 2024-09-21T07:47:38.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.607+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a41a2790 con 0x7f73a410b500 2024-09-21T07:47:38.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.607+0000 7f739be00640 1 -- 172.21.15.84:0/3011426421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73900108e0 con 0x7f73a410b500 2024-09-21T07:47:38.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.607+0000 7f739be00640 1 -- 172.21.15.84:0/3011426421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390018860 con 0x7f73a410b500 2024-09-21T07:47:38.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.607+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a41a8ef0 con 0x7f73a410b500 2024-09-21T07:47:38.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.608+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a4105fd0 con 0x7f73a410b500 2024-09-21T07:47:38.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.611+0000 7f739be00640 1 -- 172.21.15.84:0/3011426421 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f7390010430 con 0x7f73a410b500 2024-09-21T07:47:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.612+0000 7f739be00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73880b65e0 0x7f73880b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.613+0000 7f739be00640 1 -- 172.21.15.84:0/3011426421 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7f73900e7880 con 0x7f73a410b500 2024-09-21T07:47:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.613+0000 7f73a3400640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73880b65e0 0x7f73880b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.613+0000 7f73a3400640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73880b65e0 0x7f73880b8af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7394005ab0 tx=0x7f7394005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.614+0000 7f739be00640 1 -- 172.21.15.84:0/3011426421 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73900b26d0 con 0x7f73a410b500 2024-09-21T07:47:38.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:38 smithi084 ceph-mon[30411]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:47:38.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:38 smithi084 ceph-mon[30411]: pgmap v274: 33 pgs: 1 creating+peering, 31 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:38.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:38.807+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f73a419d660 con 0x7f73a410b500 2024-09-21T07:47:39.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:38 smithi162 ceph-mon[34833]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:47:39.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:38 smithi162 ceph-mon[34833]: pgmap v274: 33 pgs: 1 creating+peering, 31 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:39.055 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:38 smithi191 ceph-mon[34667]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:47:39.055 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:38 smithi191 ceph-mon[34667]: pgmap v274: 33 pgs: 1 creating+peering, 31 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.679+0000 7f739be00640 1 -- 172.21.15.84:0/3011426421 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v74) ==== 171+0+0 (secure 0 0 0) 0x7f73a419d660 con 0x7f73a410b500 2024-09-21T07:47:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.683+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73880b65e0 msgr2=0x7f73880b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.683+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73880b65e0 0x7f73880b8af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7394005ab0 tx=0x7f7394005a20 comp rx=0 tx=0).stop 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.683+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a410b500 msgr2=0x7f73a419cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.683+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a410b500 0x7f73a419cad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f739000e9f0 tx=0x7f739000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.684+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 shutdown_connections 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.684+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73880b65e0 0x7f73880b8af0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.684+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a410be50 0x7f73a41a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.684+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73a410b500 0x7f73a419cad0 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f739000e9f0 tx=0x7f739000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.684+0000 7f73a8e00640 1 --2- 172.21.15.84:0/3011426421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4105bc0 0x7f73a419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.684+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 >> 172.21.15.84:0/3011426421 conn(0x7f73a4101670 msgr2=0x7f73a410ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.685+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 shutdown_connections 2024-09-21T07:47:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:39.686+0000 7f73a8e00640 1 -- 172.21.15.84:0/3011426421 wait complete. 2024-09-21T07:47:40.045 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:39 smithi084 ceph-mon[30411]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:47:40.045 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:39 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3011426421' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:47:40.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:39 smithi162 ceph-mon[34833]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:47:40.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:39 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3011426421' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:47:40.075 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:39 smithi191 ceph-mon[34667]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:47:40.075 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:39 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3011426421' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T07:47:40.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:47:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:40.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:40 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3011426421' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:47:40.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:40 smithi084 ceph-mon[30411]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:47:40.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:40 smithi084 ceph-mon[30411]: pgmap v277: 97 pgs: 3 creating+activating, 9 creating+peering, 68 unknown, 17 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:40.956 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:40 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3011426421' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:47:40.956 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:40 smithi162 ceph-mon[34833]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:47:40.956 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:40 smithi162 ceph-mon[34833]: pgmap v277: 97 pgs: 3 creating+activating, 9 creating+peering, 68 unknown, 17 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:40 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3011426421' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T07:47:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:40 smithi191 ceph-mon[34667]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:47:41.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:40 smithi191 ceph-mon[34667]: pgmap v277: 97 pgs: 3 creating+activating, 9 creating+peering, 68 unknown, 17 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:41.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 -- 172.21.15.84:0/3652002207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c8105d80 msgr2=0x7fe2c8106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 --2- 172.21.15.84:0/3652002207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c8105d80 0x7fe2c8106190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009900 tx=0x7fe2b802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 -- 172.21.15.84:0/3652002207 shutdown_connections 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 --2- 172.21.15.84:0/3652002207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2c810c010 0x7fe2c8112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 --2- 172.21.15.84:0/3652002207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c810b6c0 0x7fe2c810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 --2- 172.21.15.84:0/3652002207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c8105d80 0x7fe2c8106190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 -- 172.21.15.84:0/3652002207 >> 172.21.15.84:0/3652002207 conn(0x7fe2c8101810 msgr2=0x7fe2c8103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 -- 172.21.15.84:0/3652002207 shutdown_connections 2024-09-21T07:47:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.466+0000 7fe2cec00640 1 -- 172.21.15.84:0/3652002207 wait complete. 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.467+0000 7fe2cec00640 1 Processor -- start 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2cec00640 1 -- start start 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2cec00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c8105d80 0x7fe2c819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2cec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c810b6c0 0x7fe2c819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2cec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2c810c010 0x7fe2c81a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2cec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8115cd0 con 0x7fe2c810b6c0 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2cec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8115b50 con 0x7fe2c810c010 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2cec00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8115e50 con 0x7fe2c8105d80 2024-09-21T07:47:41.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2c7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c810b6c0 0x7fe2c819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2c7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c810b6c0 0x7fe2c819cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55116/0 (socket says 172.21.15.84:55116) 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2c7400640 1 -- 172.21.15.84:0/2025351103 learned_addr learned my addr 172.21.15.84:0/2025351103 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2c7e00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c8105d80 0x7fe2c819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.468+0000 7fe2ccc00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2c810c010 0x7fe2c81a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c7e00640 1 -- 172.21.15.84:0/2025351103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2c810c010 msgr2=0x7fe2c81a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c7e00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2c810c010 0x7fe2c81a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c7e00640 1 -- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c810b6c0 msgr2=0x7fe2c819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c7e00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c810b6c0 0x7fe2c819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c7e00640 1 -- 172.21.15.84:0/2025351103 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c81a2550 con 0x7fe2c8105d80 2024-09-21T07:47:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c7e00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c8105d80 0x7fe2c819c6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8006010 tx=0x7fe2b8004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c4c00640 1 -- 172.21.15.84:0/2025351103 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b803f070 con 0x7fe2c8105d80 2024-09-21T07:47:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2c4c00640 1 -- 172.21.15.84:0/2025351103 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2b8003ca0 con 0x7fe2c8105d80 2024-09-21T07:47:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.469+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c81a27e0 con 0x7fe2c8105d80 2024-09-21T07:47:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.470+0000 7fe2c4c00640 1 -- 172.21.15.84:0/2025351103 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8035070 con 0x7fe2c8105d80 2024-09-21T07:47:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.470+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c81a2cc0 con 0x7fe2c8105d80 2024-09-21T07:47:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.471+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c8106190 con 0x7fe2c8105d80 2024-09-21T07:47:41.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.473+0000 7fe2c4c00640 1 -- 172.21.15.84:0/2025351103 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe2b803b460 con 0x7fe2c8105d80 2024-09-21T07:47:41.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.474+0000 7fe2c4c00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2ac0b6590 0x7fe2ac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:41.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.475+0000 7fe2c4c00640 1 -- 172.21.15.84:0/2025351103 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8094+0+0 (secure 0 0 0) 0x7fe2b8107a70 con 0x7fe2c8105d80 2024-09-21T07:47:41.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.475+0000 7fe2c7400640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2ac0b6590 0x7fe2ac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:41.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.475+0000 7fe2c7400640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2ac0b6590 0x7fe2ac0b8aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2c810b1e0 tx=0x7fe2b400a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:41.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.476+0000 7fe2c4c00640 1 -- 172.21.15.84:0/2025351103 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2b80d2720 con 0x7fe2c8105d80 2024-09-21T07:47:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:41.704+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe2c802e640 con 0x7fe2c8105d80 2024-09-21T07:47:42.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:41 smithi162 ceph-mon[34833]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:47:42.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:41 smithi084 ceph-mon[30411]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:47:42.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:41 smithi191 ceph-mon[34667]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:47:42.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.707+0000 7fe2c4c00640 1 -- 172.21.15.84:0/2025351103 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fe2b80d7660 con 0x7fe2c8105d80 2024-09-21T07:47:42.709 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:47:42.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2ac0b6590 msgr2=0x7fe2ac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:42.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2ac0b6590 0x7fe2ac0b8aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2c810b1e0 tx=0x7fe2b400a380 comp rx=0 tx=0).stop 2024-09-21T07:47:42.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c8105d80 msgr2=0x7fe2c819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:42.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c8105d80 0x7fe2c819c6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8006010 tx=0x7fe2b8004060 comp rx=0 tx=0).stop 2024-09-21T07:47:42.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 shutdown_connections 2024-09-21T07:47:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2ac0b6590 0x7fe2ac0b8aa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2c810c010 0x7fe2c81a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2c810b6c0 0x7fe2c819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 --2- 172.21.15.84:0/2025351103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c8105d80 0x7fe2c819c6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.711+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 >> 172.21.15.84:0/2025351103 conn(0x7fe2c8101810 msgr2=0x7fe2c8103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:42.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.712+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 shutdown_connections 2024-09-21T07:47:42.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:42.712+0000 7fe2cec00640 1 -- 172.21.15.84:0/2025351103 wait complete. 2024-09-21T07:47:43.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:42 smithi162 ceph-mon[34833]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:47:43.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:42 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2025351103' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:47:43.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:42 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:47:43.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:42 smithi162 ceph-mon[34833]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:47:43.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:42 smithi162 ceph-mon[34833]: pgmap v280: 97 pgs: 3 creating+activating, 20 creating+peering, 29 unknown, 45 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:43.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:42 smithi084 ceph-mon[30411]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:47:43.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:42 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2025351103' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:47:43.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:42 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:47:43.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:42 smithi084 ceph-mon[30411]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:47:43.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:42 smithi084 ceph-mon[30411]: pgmap v280: 97 pgs: 3 creating+activating, 20 creating+peering, 29 unknown, 45 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:43.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:42 smithi191 ceph-mon[34667]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:47:43.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:42 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2025351103' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:47:43.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:42 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:47:43.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:42 smithi191 ceph-mon[34667]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:47:43.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:42 smithi191 ceph-mon[34667]: pgmap v280: 97 pgs: 3 creating+activating, 20 creating+peering, 29 unknown, 45 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:43.452 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T07:47:43.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T07:47:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:43.973 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:43 smithi084 ceph-mon[30411]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:47:43.973 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:43 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:47:43.973 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:43 smithi084 ceph-mon[30411]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:47:43.973 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:43 smithi084 ceph-mon[30411]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:47:44.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:43 smithi162 ceph-mon[34833]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:47:44.082 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:43 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:47:44.083 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:43 smithi162 ceph-mon[34833]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:47:44.083 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:43 smithi162 ceph-mon[34833]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:47:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:43 smithi191 ceph-mon[34667]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:47:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:43 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:47:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:43 smithi191 ceph-mon[34667]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:47:44.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:43 smithi191 ceph-mon[34667]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:47:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.435+0000 7fe382200640 1 -- 172.21.15.84:0/407051886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c077940 msgr2=0x7fe37c077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.435+0000 7fe382200640 1 --2- 172.21.15.84:0/407051886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c077940 0x7fe37c077d50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009900 tx=0x7fe36c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.436+0000 7fe382200640 1 -- 172.21.15.84:0/407051886 shutdown_connections 2024-09-21T07:47:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.436+0000 7fe382200640 1 --2- 172.21.15.84:0/407051886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe37c114740 0x7fe37c116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.436+0000 7fe382200640 1 --2- 172.21.15.84:0/407051886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c078290 0x7fe37c114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.436+0000 7fe382200640 1 --2- 172.21.15.84:0/407051886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c077940 0x7fe37c077d50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.436+0000 7fe382200640 1 -- 172.21.15.84:0/407051886 >> 172.21.15.84:0/407051886 conn(0x7fe37c101810 msgr2=0x7fe37c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.436+0000 7fe382200640 1 -- 172.21.15.84:0/407051886 shutdown_connections 2024-09-21T07:47:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.436+0000 7fe382200640 1 -- 172.21.15.84:0/407051886 wait complete. 2024-09-21T07:47:44.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 Processor -- start 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 -- start start 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe37c077940 0x7fe37c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c078290 0x7fe37c1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c114740 0x7fe37c1a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c11a100 con 0x7fe37c114740 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c119f80 con 0x7fe37c078290 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.437+0000 7fe382200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c11a280 con 0x7fe37c077940 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c114740 0x7fe37c1a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe37c077940 0x7fe37c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe37c077940 0x7fe37c1a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47902/0 (socket says 172.21.15.84:47902) 2024-09-21T07:47:44.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37b400640 1 -- 172.21.15.84:0/4208886047 learned_addr learned my addr 172.21.15.84:0/4208886047 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37aa00640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c078290 0x7fe37c1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37be00640 1 -- 172.21.15.84:0/4208886047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe37c077940 msgr2=0x7fe37c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37be00640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe37c077940 0x7fe37c1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37be00640 1 -- 172.21.15.84:0/4208886047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c078290 msgr2=0x7fe37c1a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37be00640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c078290 0x7fe37c1a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37be00640 1 -- 172.21.15.84:0/4208886047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c1a6a60 con 0x7fe37c114740 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.438+0000 7fe37be00640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c114740 0x7fe37c1a6330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe374009fd0 tx=0x7fe37400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.439+0000 7fe373e00640 1 -- 172.21.15.84:0/4208886047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37400ce20 con 0x7fe37c114740 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.439+0000 7fe373e00640 1 -- 172.21.15.84:0/4208886047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe374005020 con 0x7fe37c114740 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.439+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c1a6d50 con 0x7fe37c114740 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.439+0000 7fe373e00640 1 -- 172.21.15.84:0/4208886047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374010690 con 0x7fe37c114740 2024-09-21T07:47:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.439+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c1ad4b0 con 0x7fe37c114740 2024-09-21T07:47:44.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.440+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35c0052c0 con 0x7fe37c114740 2024-09-21T07:47:44.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.442+0000 7fe373e00640 1 -- 172.21.15.84:0/4208886047 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe374004a40 con 0x7fe37c114740 2024-09-21T07:47:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.445+0000 7fe373e00640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3600b65e0 0x7fe3600b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.445+0000 7fe373e00640 1 -- 172.21.15.84:0/4208886047 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7fe3740e77d0 con 0x7fe37c114740 2024-09-21T07:47:44.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.445+0000 7fe37b400640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3600b65e0 0x7fe3600b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:44.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.446+0000 7fe37b400640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3600b65e0 0x7fe3600b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0096c0 tx=0x7fe36c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:44.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.447+0000 7fe373e00640 1 -- 172.21.15.84:0/4208886047 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3740ae020 con 0x7fe37c114740 2024-09-21T07:47:44.551 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 07:47:44 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b[64357]: 2024-09-21T07:47:44.056+0000 7f598b1c0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:47:44.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.642+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fe35c0055b0 con 0x7fe37c114740 2024-09-21T07:47:44.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.715+0000 7fe373e00640 1 -- 172.21.15.84:0/4208886047 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v78) ==== 157+0+0 (secure 0 0 0) 0x7fe3740b2400 con 0x7fe37c114740 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.718+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3600b65e0 msgr2=0x7fe3600b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.718+0000 7fe382200640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3600b65e0 0x7fe3600b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0096c0 tx=0x7fe36c005a20 comp rx=0 tx=0).stop 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.718+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c114740 msgr2=0x7fe37c1a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.718+0000 7fe382200640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c114740 0x7fe37c1a6330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe374009fd0 tx=0x7fe37400ef10 comp rx=0 tx=0).stop 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 shutdown_connections 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3600b65e0 0x7fe3600b8af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c114740 0x7fe37c1a6330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe37c078290 0x7fe37c1a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 --2- 172.21.15.84:0/4208886047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe37c077940 0x7fe37c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 >> 172.21.15.84:0/4208886047 conn(0x7fe37c101810 msgr2=0x7fe37c1167d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 shutdown_connections 2024-09-21T07:47:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:44.719+0000 7fe382200640 1 -- 172.21.15.84:0/4208886047 wait complete. 2024-09-21T07:47:44.972 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:44 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] up:active 2024-09-21T07:47:44.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:44 smithi162 ceph-mon[34833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:44.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:44 smithi162 ceph-mon[34833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:44.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:44 smithi162 ceph-mon[34833]: pgmap v282: 97 pgs: 19 creating+peering, 8 unknown, 70 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s wr, 2 op/s 2024-09-21T07:47:44.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:44 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4208886047' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:47:45.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:44 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] up:active 2024-09-21T07:47:45.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:44 smithi084 ceph-mon[30411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:45.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:44 smithi084 ceph-mon[30411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:45.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:44 smithi084 ceph-mon[30411]: pgmap v282: 97 pgs: 19 creating+peering, 8 unknown, 70 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s wr, 2 op/s 2024-09-21T07:47:45.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:44 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4208886047' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:47:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:44 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] up:active 2024-09-21T07:47:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:44 smithi191 ceph-mon[34667]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:44 smithi191 ceph-mon[34667]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:44 smithi191 ceph-mon[34667]: pgmap v282: 97 pgs: 19 creating+peering, 8 unknown, 70 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s wr, 2 op/s 2024-09-21T07:47:45.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:44 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4208886047' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T07:47:45.569 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:47:45.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:45 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4208886047' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:47:45.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:45 smithi084 ceph-mon[30411]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:47:45.940 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:45 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4208886047' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:47:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:45 smithi162 ceph-mon[34833]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:47:46.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:45 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4208886047' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T07:47:46.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:45 smithi191 ceph-mon[34667]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:47:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 -- 172.21.15.84:0/1417515805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109300 msgr2=0x7f0ebc109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/1417515805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109300 0x7f0ebc109710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009900 tx=0x7f0ea802a410 comp rx=0 tx=0).stop 2024-09-21T07:47:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 -- 172.21.15.84:0/1417515805 shutdown_connections 2024-09-21T07:47:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/1417515805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc109c50 0x7f0ebc110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/1417515805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109300 0x7f0ebc109710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/1417515805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ebc1039c0 0x7f0ebc103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 -- 172.21.15.84:0/1417515805 >> 172.21.15.84:0/1417515805 conn(0x7f0ebc0ff430 msgr2=0x7f0ebc101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 -- 172.21.15.84:0/1417515805 shutdown_connections 2024-09-21T07:47:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.523+0000 7f0ec2a00640 1 -- 172.21.15.84:0/1417515805 wait complete. 2024-09-21T07:47:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 Processor -- start 2024-09-21T07:47:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 -- start start 2024-09-21T07:47:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ebc1039c0 0x7f0ebc19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc109300 0x7f0ebc19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109c50 0x7f0ebc19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc113910 con 0x7f0ebc109c50 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc113790 con 0x7f0ebc109300 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.524+0000 7f0ec2a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc113a90 con 0x7f0ebc1039c0 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109c50 0x7f0ebc19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109c50 0x7f0ebc19fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55146/0 (socket says 172.21.15.84:55146) 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 -- 172.21.15.84:0/4241500072 learned_addr learned my addr 172.21.15.84:0/4241500072 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec0c00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc109300 0x7f0ebc19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec1600640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ebc1039c0 0x7f0ebc19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 -- 172.21.15.84:0/4241500072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ebc1039c0 msgr2=0x7f0ebc19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ebc1039c0 0x7f0ebc19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 -- 172.21.15.84:0/4241500072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc109300 msgr2=0x7f0ebc19a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc109300 0x7f0ebc19a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec2000640 1 -- 172.21.15.84:0/4241500072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc1a0290 con 0x7f0ebc109c50 2024-09-21T07:47:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.525+0000 7f0ec0c00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc109300 0x7f0ebc19a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:47:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.526+0000 7f0ec2000640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109c50 0x7f0ebc19fb60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.526+0000 7f0eba000640 1 -- 172.21.15.84:0/4241500072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4017070 con 0x7f0ebc109c50 2024-09-21T07:47:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.526+0000 7f0eba000640 1 -- 172.21.15.84:0/4241500072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0eb4003e20 con 0x7f0ebc109c50 2024-09-21T07:47:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.526+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ebc1a0580 con 0x7f0ebc109c50 2024-09-21T07:47:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.526+0000 7f0eba000640 1 -- 172.21.15.84:0/4241500072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4010460 con 0x7f0ebc109c50 2024-09-21T07:47:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.526+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ebc1a6ce0 con 0x7f0ebc109c50 2024-09-21T07:47:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.527+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ebc103dd0 con 0x7f0ebc109c50 2024-09-21T07:47:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.530+0000 7f0eba000640 1 -- 172.21.15.84:0/4241500072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f0eb4003970 con 0x7f0ebc109c50 2024-09-21T07:47:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.531+0000 7f0eba000640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ea40b6550 0x7f0ea40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.531+0000 7f0eba000640 1 -- 172.21.15.84:0/4241500072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8492+0+0 (secure 0 0 0) 0x7f0eb40e70d0 con 0x7f0ebc109c50 2024-09-21T07:47:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.531+0000 7f0ec1600640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ea40b6550 0x7f0ea40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.532+0000 7f0ec1600640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ea40b6550 0x7f0ea40b8a60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.533+0000 7f0eba000640 1 -- 172.21.15.84:0/4241500072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0eb40b1ce0 con 0x7f0ebc109c50 2024-09-21T07:47:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:46.721+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0ebc02e640 con 0x7f0ebc109c50 2024-09-21T07:47:47.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:46 smithi162 ceph-mon[34833]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-21T07:47:47.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:46 smithi084 ceph-mon[30411]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-21T07:47:47.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:46 smithi191 ceph-mon[34667]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-21T07:47:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:47 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4241500072' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:47:48.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:47 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4241500072' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:47:48.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:47 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4241500072' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:47:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.723+0000 7f0eba000640 1 -- 172.21.15.84:0/4241500072 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v80) ==== 228+0+0 (secure 0 0 0) 0x7f0eb40b6c20 con 0x7f0ebc109c50 2024-09-21T07:47:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2024-09-21T07:47:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.728+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ea40b6550 msgr2=0x7f0ea40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.728+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ea40b6550 0x7f0ea40b8a60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb000b390 comp rx=0 tx=0).stop 2024-09-21T07:47:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.728+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109c50 msgr2=0x7f0ebc19fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.728+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109c50 0x7f0ebc19fb60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb400b260 comp rx=0 tx=0).stop 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 shutdown_connections 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ea40b6550 0x7f0ea40b8a60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc109c50 0x7f0ebc19fb60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc109300 0x7f0ebc19a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 --2- 172.21.15.84:0/4241500072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ebc1039c0 0x7f0ebc19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 >> 172.21.15.84:0/4241500072 conn(0x7f0ebc0ff430 msgr2=0x7f0ebc101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 shutdown_connections 2024-09-21T07:47:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:48.729+0000 7f0ec2a00640 1 -- 172.21.15.84:0/4241500072 wait complete. 2024-09-21T07:47:49.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:48 smithi162 ceph-mon[34833]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:47:49.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:48 smithi162 ceph-mon[34833]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T07:47:49.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:48 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4241500072' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:47:49.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:48 smithi162 ceph-mon[34833]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:47:49.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:48 smithi084 ceph-mon[30411]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:47:49.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:48 smithi084 ceph-mon[30411]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T07:47:49.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:48 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4241500072' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:47:49.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:48 smithi084 ceph-mon[30411]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:47:49.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:48 smithi191 ceph-mon[34667]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T07:47:49.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:48 smithi191 ceph-mon[34667]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T07:47:49.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:48 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4241500072' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:47:49.156 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:48 smithi191 ceph-mon[34667]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T07:47:49.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T07:47:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 -- 172.21.15.84:0/624217759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4078290 msgr2=0x7f3dd4114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 --2- 172.21.15.84:0/624217759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4078290 0x7f3dd4114030 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002a410 comp rx=0 tx=0).stop 2024-09-21T07:47:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 -- 172.21.15.84:0/624217759 shutdown_connections 2024-09-21T07:47:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 --2- 172.21.15.84:0/624217759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd4114570 0x7f3dd4116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 --2- 172.21.15.84:0/624217759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4078290 0x7f3dd4114030 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 --2- 172.21.15.84:0/624217759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd4077940 0x7f3dd4077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 -- 172.21.15.84:0/624217759 >> 172.21.15.84:0/624217759 conn(0x7f3dd4101680 msgr2=0x7f3dd4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 -- 172.21.15.84:0/624217759 shutdown_connections 2024-09-21T07:47:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.711+0000 7f3dd3200640 1 -- 172.21.15.84:0/624217759 wait complete. 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.712+0000 7f3dd3200640 1 Processor -- start 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.712+0000 7f3dd3200640 1 -- start start 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.712+0000 7f3dd3200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd4077940 0x7f3dd41a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd4078290 0x7f3dd41a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4114570 0x7f3dd41a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd3200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4119ed0 con 0x7f3dd4114570 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4119d50 con 0x7f3dd4078290 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd3200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd411a050 con 0x7f3dd4077940 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4114570 0x7f3dd41a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4114570 0x7f3dd41a6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49550/0 (socket says 172.21.15.84:49550) 2024-09-21T07:47:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 -- 172.21.15.84:0/709919640 learned_addr learned my addr 172.21.15.84:0/709919640 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd1400640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd4078290 0x7f3dd41a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd1e00640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd4077940 0x7f3dd41a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 -- 172.21.15.84:0/709919640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd4077940 msgr2=0x7f3dd41a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd4077940 0x7f3dd41a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 -- 172.21.15.84:0/709919640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd4078290 msgr2=0x7f3dd41a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd4078290 0x7f3dd41a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.713+0000 7f3dd2800640 1 -- 172.21.15.84:0/709919640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd41a6890 con 0x7f3dd4114570 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.714+0000 7f3dd2800640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4114570 0x7f3dd41a6160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00eb10 tx=0x7f3dcc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.714+0000 7f3dcaa00640 1 -- 172.21.15.84:0/709919640 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc004b20 con 0x7f3dd4114570 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.714+0000 7f3dcaa00640 1 -- 172.21.15.84:0/709919640 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dcc004cc0 con 0x7f3dd4114570 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.714+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd41a6b80 con 0x7f3dd4114570 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.714+0000 7f3dcaa00640 1 -- 172.21.15.84:0/709919640 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc010670 con 0x7f3dd4114570 2024-09-21T07:47:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.714+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd41ad2e0 con 0x7f3dd4114570 2024-09-21T07:47:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.715+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd4077d50 con 0x7f3dd4114570 2024-09-21T07:47:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.718+0000 7f3dcaa00640 1 -- 172.21.15.84:0/709919640 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f3dcc005000 con 0x7f3dd4114570 2024-09-21T07:47:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.719+0000 7f3dcaa00640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3db80b6560 0x7f3db80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.720+0000 7f3dcaa00640 1 -- 172.21.15.84:0/709919640 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8985+0+0 (secure 0 0 0) 0x7f3dcc0e7e20 con 0x7f3dd4114570 2024-09-21T07:47:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.720+0000 7f3dd1e00640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3db80b6560 0x7f3db80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.720+0000 7f3dd1e00640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3db80b6560 0x7f3db80b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009bd0 tx=0x7f3dc4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.722+0000 7f3dcaa00640 1 -- 172.21.15.84:0/709919640 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3dcc056710 con 0x7f3dd4114570 2024-09-21T07:47:50.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:50 smithi084 ceph-mon[30411]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:47:50.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:50 smithi084 ceph-mon[30411]: pgmap v289: 129 pgs: 10 creating+peering, 21 unknown, 98 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 5 op/s 2024-09-21T07:47:50.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:50.911+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f3dd41a1a50 con 0x7f3dd4114570 2024-09-21T07:47:51.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:50 smithi162 ceph-mon[34833]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:47:51.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:50 smithi162 ceph-mon[34833]: pgmap v289: 129 pgs: 10 creating+peering, 21 unknown, 98 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 5 op/s 2024-09-21T07:47:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:50 smithi191 ceph-mon[34667]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T07:47:51.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:50 smithi191 ceph-mon[34667]: pgmap v289: 129 pgs: 10 creating+peering, 21 unknown, 98 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 5 op/s 2024-09-21T07:47:51.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.734+0000 7f3dcaa00640 1 -- 172.21.15.84:0/709919640 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v83) ==== 169+0+0 (secure 0 0 0) 0x7f3dd41a1a50 con 0x7f3dd4114570 2024-09-21T07:47:51.736 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T07:47:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.737+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3db80b6560 msgr2=0x7f3db80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.737+0000 7f3dd3200640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3db80b6560 0x7f3db80b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009bd0 tx=0x7f3dc4005f90 comp rx=0 tx=0).stop 2024-09-21T07:47:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.737+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4114570 msgr2=0x7f3dd41a6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.737+0000 7f3dd3200640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4114570 0x7f3dd41a6160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00eb10 tx=0x7f3dcc00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.737+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 shutdown_connections 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.738+0000 7f3dd3200640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3db80b6560 0x7f3db80b8a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.738+0000 7f3dd3200640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd4114570 0x7f3dd41a6160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.738+0000 7f3dd3200640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd4078290 0x7f3dd41a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.738+0000 7f3dd3200640 1 --2- 172.21.15.84:0/709919640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dd4077940 0x7f3dd41a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.738+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 >> 172.21.15.84:0/709919640 conn(0x7f3dd4101680 msgr2=0x7f3dd4116660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.738+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 shutdown_connections 2024-09-21T07:47:51.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:51.738+0000 7f3dd3200640 1 -- 172.21.15.84:0/709919640 wait complete. 2024-09-21T07:47:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:51 smithi162 ceph-mon[34833]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:47:52.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:51 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/709919640' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:47:52.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:51 smithi084 ceph-mon[30411]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:47:52.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:51 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/709919640' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:47:52.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:51 smithi191 ceph-mon[34667]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T07:47:52.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:51 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/709919640' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T07:47:52.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T07:47:52.997 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:53.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:52 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/709919640' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:47:53.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:52 smithi162 ceph-mon[34833]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:47:53.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:52 smithi162 ceph-mon[34833]: pgmap v292: 129 pgs: 10 creating+peering, 11 unknown, 108 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:47:53.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:52 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/709919640' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:47:53.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:52 smithi084 ceph-mon[30411]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:47:53.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:52 smithi084 ceph-mon[30411]: pgmap v292: 129 pgs: 10 creating+peering, 11 unknown, 108 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:47:53.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:52 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/709919640' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T07:47:53.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:52 smithi191 ceph-mon[34667]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T07:47:53.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:52 smithi191 ceph-mon[34667]: pgmap v292: 129 pgs: 10 creating+peering, 11 unknown, 108 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T07:47:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 -- 172.21.15.84:0/389451713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c110440 msgr2=0x7f435c116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 --2- 172.21.15.84:0/389451713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c110440 0x7f435c116c70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4354009ca0 tx=0x7f435402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 -- 172.21.15.84:0/389451713 shutdown_connections 2024-09-21T07:47:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 --2- 172.21.15.84:0/389451713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c110440 0x7f435c116c70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 --2- 172.21.15.84:0/389451713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c10faf0 0x7f435c10ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 --2- 172.21.15.84:0/389451713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f435c10a1b0 0x7f435c10a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 -- 172.21.15.84:0/389451713 >> 172.21.15.84:0/389451713 conn(0x7f435c0780e0 msgr2=0x7f435c1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 -- 172.21.15.84:0/389451713 shutdown_connections 2024-09-21T07:47:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.567+0000 7f4363e00640 1 -- 172.21.15.84:0/389451713 wait complete. 2024-09-21T07:47:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.568+0000 7f4363e00640 1 Processor -- start 2024-09-21T07:47:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.568+0000 7f4363e00640 1 -- start start 2024-09-21T07:47:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4363e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c10a1b0 0x7f435c1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4363e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f435c10faf0 0x7f435c1a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4363e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c110440 0x7f435c1a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4363e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f435c11a140 con 0x7f435c10a1b0 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4363e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f435c119fc0 con 0x7f435c110440 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4363e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f435c11a2c0 con 0x7f435c10faf0 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4361400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c10a1b0 0x7f435c1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4361400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c10a1b0 0x7f435c1a0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49570/0 (socket says 172.21.15.84:49570) 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4361400640 1 -- 172.21.15.84:0/1960168575 learned_addr learned my addr 172.21.15.84:0/1960168575 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4360a00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f435c10faf0 0x7f435c1a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.569+0000 7f4361e00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c110440 0x7f435c1a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4361400640 1 -- 172.21.15.84:0/1960168575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f435c10faf0 msgr2=0x7f435c1a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4361400640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f435c10faf0 0x7f435c1a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4361400640 1 -- 172.21.15.84:0/1960168575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c110440 msgr2=0x7f435c1a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4361400640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c110440 0x7f435c1a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4361400640 1 -- 172.21.15.84:0/1960168575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c1a6a00 con 0x7f435c10a1b0 2024-09-21T07:47:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4361400640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c10a1b0 0x7f435c1a0a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f435000e9f0 tx=0x7f435000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f435a000640 1 -- 172.21.15.84:0/1960168575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000cd80 con 0x7f435c10a1b0 2024-09-21T07:47:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f435a000640 1 -- 172.21.15.84:0/1960168575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43500108e0 con 0x7f435c10a1b0 2024-09-21T07:47:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f435a000640 1 -- 172.21.15.84:0/1960168575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350018980 con 0x7f435c10a1b0 2024-09-21T07:47:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c1a6cf0 con 0x7f435c10a1b0 2024-09-21T07:47:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.570+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c1ad450 con 0x7f435c10a1b0 2024-09-21T07:47:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.571+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435c10a5c0 con 0x7f435c10a1b0 2024-09-21T07:47:53.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.574+0000 7f435a000640 1 -- 172.21.15.84:0/1960168575 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f4350010430 con 0x7f435c10a1b0 2024-09-21T07:47:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.575+0000 7f435a000640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43440b6560 0x7f43440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.576+0000 7f435a000640 1 -- 172.21.15.84:0/1960168575 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8985+0+0 (secure 0 0 0) 0x7f43500e7ea0 con 0x7f435c10a1b0 2024-09-21T07:47:53.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.576+0000 7f4360a00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43440b6560 0x7f43440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:53.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.576+0000 7f4360a00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43440b6560 0x7f43440b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f435c109590 tx=0x7f4348005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:53.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.578+0000 7f435a000640 1 -- 172.21.15.84:0/1960168575 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43500b27c0 con 0x7f435c10a1b0 2024-09-21T07:47:53.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.805+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f435c1a1bc0 con 0x7f435c10a1b0 2024-09-21T07:47:53.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.858+0000 7f435a000640 1 -- 172.21.15.84:0/1960168575 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f43500b7700 con 0x7f435c10a1b0 2024-09-21T07:47:53.860 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 4 to fsmap 2024-09-21T07:47:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43440b6560 msgr2=0x7f43440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43440b6560 0x7f43440b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f435c109590 tx=0x7f4348005f90 comp rx=0 tx=0).stop 2024-09-21T07:47:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c10a1b0 msgr2=0x7f435c1a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c10a1b0 0x7f435c1a0a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f435000e9f0 tx=0x7f435000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 shutdown_connections 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43440b6560 0x7f43440b8a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c110440 0x7f435c1a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f435c10faf0 0x7f435c1a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 --2- 172.21.15.84:0/1960168575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c10a1b0 0x7f435c1a0a90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 >> 172.21.15.84:0/1960168575 conn(0x7f435c0780e0 msgr2=0x7f435c10cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 shutdown_connections 2024-09-21T07:47:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:53.862+0000 7f4363e00640 1 -- 172.21.15.84:0/1960168575 wait complete. 2024-09-21T07:47:54.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:53 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1960168575' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:47:54.193 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:53 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1960168575' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:47:54.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:53 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1960168575' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T07:47:54.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:47:54.935 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:55.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:54 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1960168575' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:47:55.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:54 smithi191 ceph-mon[34667]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T07:47:55.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:54 smithi191 ceph-mon[34667]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:55.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:54 smithi191 ceph-mon[34667]: pgmap v294: 129 pgs: 10 creating+peering, 119 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:55.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:54 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1960168575' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:47:55.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:54 smithi084 ceph-mon[30411]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T07:47:55.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:54 smithi084 ceph-mon[30411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:55.225 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:54 smithi084 ceph-mon[30411]: pgmap v294: 129 pgs: 10 creating+peering, 119 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:55.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:54 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1960168575' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T07:47:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:54 smithi162 ceph-mon[34833]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T07:47:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:54 smithi162 ceph-mon[34833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:47:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:54 smithi162 ceph-mon[34833]: pgmap v294: 129 pgs: 10 creating+peering, 119 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:55.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 -- 172.21.15.84:0/2298605765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd60109e10 msgr2=0x7fcd60110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:55.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 --2- 172.21.15.84:0/2298605765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd60109e10 0x7fcd60110640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009900 tx=0x7fcd5802a410 comp rx=0 tx=0).stop 2024-09-21T07:47:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 -- 172.21.15.84:0/2298605765 shutdown_connections 2024-09-21T07:47:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 --2- 172.21.15.84:0/2298605765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd60109e10 0x7fcd60110640 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 --2- 172.21.15.84:0/2298605765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd601094c0 0x7fcd601098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 --2- 172.21.15.84:0/2298605765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60103b80 0x7fcd60103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 -- 172.21.15.84:0/2298605765 >> 172.21.15.84:0/2298605765 conn(0x7fcd600ff5d0 msgr2=0x7fcd60101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 -- 172.21.15.84:0/2298605765 shutdown_connections 2024-09-21T07:47:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.542+0000 7fcd66600640 1 -- 172.21.15.84:0/2298605765 wait complete. 2024-09-21T07:47:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 Processor -- start 2024-09-21T07:47:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 -- start start 2024-09-21T07:47:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60103b80 0x7fcd6019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd601094c0 0x7fcd6019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60109e10 0x7fcd601a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60113b20 con 0x7fcd601094c0 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601139a0 con 0x7fcd60103b80 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd66600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60113ca0 con 0x7fcd60109e10 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd5ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd601094c0 0x7fcd6019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd5ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd601094c0 0x7fcd6019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49574/0 (socket says 172.21.15.84:49574) 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd5ea00640 1 -- 172.21.15.84:0/800900980 learned_addr learned my addr 172.21.15.84:0/800900980 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd5f400640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60103b80 0x7fcd6019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.544+0000 7fcd5fe00640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60109e10 0x7fcd601a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd5f400640 1 -- 172.21.15.84:0/800900980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60109e10 msgr2=0x7fcd601a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd5f400640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60109e10 0x7fcd601a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd5f400640 1 -- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd601094c0 msgr2=0x7fcd6019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd5f400640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd601094c0 0x7fcd6019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd5f400640 1 -- 172.21.15.84:0/800900980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd601a25e0 con 0x7fcd60103b80 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd5ea00640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd601094c0 0x7fcd6019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd5f400640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60103b80 0x7fcd6019c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000eb00 tx=0x7fcd5000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd57e00640 1 -- 172.21.15.84:0/800900980 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50010430 con 0x7fcd60103b80 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd601a28d0 con 0x7fcd60103b80 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.545+0000 7fcd57e00640 1 -- 172.21.15.84:0/800900980 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd50010a80 con 0x7fcd60103b80 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.546+0000 7fcd57e00640 1 -- 172.21.15.84:0/800900980 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50017a90 con 0x7fcd60103b80 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.546+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd601a9030 con 0x7fcd60103b80 2024-09-21T07:47:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.547+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd60103f90 con 0x7fcd60103b80 2024-09-21T07:47:55.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.549+0000 7fcd57e00640 1 -- 172.21.15.84:0/800900980 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fcd50017c50 con 0x7fcd60103b80 2024-09-21T07:47:55.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.551+0000 7fcd57e00640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd440b6560 0x7fcd440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:55.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.551+0000 7fcd5ea00640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd440b6560 0x7fcd440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:55.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.551+0000 7fcd57e00640 1 -- 172.21.15.84:0/800900980 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fcd500e8190 con 0x7fcd60103b80 2024-09-21T07:47:55.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.551+0000 7fcd5ea00640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd440b6560 0x7fcd440b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd60108d00 tx=0x7fcd4c00b440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:55.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.553+0000 7fcd57e00640 1 -- 172.21.15.84:0/800900980 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd500ae740 con 0x7fcd60103b80 2024-09-21T07:47:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.777+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd6019d7a0 con 0x7fcd60103b80 2024-09-21T07:47:55.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.778+0000 7fcd57e00640 1 -- 172.21.15.84:0/800900980 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11857 (secure 0 0 0) 0x7fcd500b2b20 con 0x7fcd60103b80 2024-09-21T07:47:55.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:55.781 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"btime":"2024-09-21T07:47:53:857359+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24695,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24712,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24719,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24742,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:47:53.807135+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24746},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24746,"qdb_cluster":[24746]},"id":1}]} 2024-09-21T07:47:55.781 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-09-21T07:47:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd440b6560 msgr2=0x7fcd440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd440b6560 0x7fcd440b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd60108d00 tx=0x7fcd4c00b440 comp rx=0 tx=0).stop 2024-09-21T07:47:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60103b80 msgr2=0x7fcd6019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60103b80 0x7fcd6019c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000eb00 tx=0x7fcd5000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 shutdown_connections 2024-09-21T07:47:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd440b6560 0x7fcd440b8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60109e10 0x7fcd601a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd601094c0 0x7fcd6019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 --2- 172.21.15.84:0/800900980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd60103b80 0x7fcd6019c670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 >> 172.21.15.84:0/800900980 conn(0x7fcd600ff5d0 msgr2=0x7fcd60106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 shutdown_connections 2024-09-21T07:47:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:55.781+0000 7fcd66600640 1 -- 172.21.15.84:0/800900980 wait complete. 2024-09-21T07:47:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:55 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/800900980' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:56.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:55 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/800900980' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:55 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/800900980' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:47:56.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:47:56.981 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:57.145 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:56 smithi084 ceph-mon[30411]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:57.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:56 smithi191 ceph-mon[34667]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:57.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:56 smithi162 ceph-mon[34833]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.599+0000 7fce97e00640 1 -- 172.21.15.84:0/3410271183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98103990 msgr2=0x7fce98103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.599+0000 7fce97e00640 1 --2- 172.21.15.84:0/3410271183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98103990 0x7fce98103da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fce88009900 tx=0x7fce8802a410 comp rx=0 tx=0).stop 2024-09-21T07:47:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.600+0000 7fce97e00640 1 -- 172.21.15.84:0/3410271183 shutdown_connections 2024-09-21T07:47:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.600+0000 7fce97e00640 1 --2- 172.21.15.84:0/3410271183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce98109c20 0x7fce98110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.600+0000 7fce97e00640 1 --2- 172.21.15.84:0/3410271183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce981092d0 0x7fce981096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.600+0000 7fce97e00640 1 --2- 172.21.15.84:0/3410271183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98103990 0x7fce98103da0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.600+0000 7fce97e00640 1 -- 172.21.15.84:0/3410271183 >> 172.21.15.84:0/3410271183 conn(0x7fce980ff3e0 msgr2=0x7fce98101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.600+0000 7fce97e00640 1 -- 172.21.15.84:0/3410271183 shutdown_connections 2024-09-21T07:47:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.600+0000 7fce97e00640 1 -- 172.21.15.84:0/3410271183 wait complete. 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 Processor -- start 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 -- start start 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce98103990 0x7fce98075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce981092d0 0x7fce98075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98109c20 0x7fce98076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fce981138e0 con 0x7fce98109c20 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce98113760 con 0x7fce981092d0 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.601+0000 7fce97e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fce98113a60 con 0x7fce98103990 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98109c20 0x7fce98076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce96a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce98103990 0x7fce98075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98109c20 0x7fce98076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49584/0 (socket says 172.21.15.84:49584) 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce96a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce98103990 0x7fce98075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57952/0 (socket says 172.21.15.84:57952) 2024-09-21T07:47:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 -- 172.21.15.84:0/4109139033 learned_addr learned my addr 172.21.15.84:0/4109139033 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce96000640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce981092d0 0x7fce98075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 -- 172.21.15.84:0/4109139033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce98103990 msgr2=0x7fce98075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce98103990 0x7fce98075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 -- 172.21.15.84:0/4109139033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce981092d0 msgr2=0x7fce98075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce981092d0 0x7fce98075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 -- 172.21.15.84:0/4109139033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce981a85b0 con 0x7fce98109c20 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.602+0000 7fce97400640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98109c20 0x7fce98076190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fce9000eaa0 tx=0x7fce9000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.603+0000 7fce8f400640 1 -- 172.21.15.84:0/4109139033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9000cdb0 con 0x7fce98109c20 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.603+0000 7fce8f400640 1 -- 172.21.15.84:0/4109139033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce90005020 con 0x7fce98109c20 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.603+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce981a88a0 con 0x7fce98109c20 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.603+0000 7fce8f400640 1 -- 172.21.15.84:0/4109139033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce900116d0 con 0x7fce98109c20 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.603+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce981a8d90 con 0x7fce98109c20 2024-09-21T07:47:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.604+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce98103da0 con 0x7fce98109c20 2024-09-21T07:47:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.606+0000 7fce8f400640 1 -- 172.21.15.84:0/4109139033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fce900051d0 con 0x7fce98109c20 2024-09-21T07:47:57.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.609+0000 7fce8f400640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fce7c0b6560 0x7fce7c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.609+0000 7fce96a00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fce7c0b6560 0x7fce7c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.609+0000 7fce8f400640 1 -- 172.21.15.84:0/4109139033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fce900e7c40 con 0x7fce98109c20 2024-09-21T07:47:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.610+0000 7fce96a00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fce7c0b6560 0x7fce7c0b8a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce88000c00 tx=0x7fce88031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:57.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.611+0000 7fce8f400640 1 -- 172.21.15.84:0/4109139033 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce90016030 con 0x7fce98109c20 2024-09-21T07:47:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.803+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce98076a10 con 0x7fce98109c20 2024-09-21T07:47:57.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.805+0000 7fce8f400640 1 -- 172.21.15.84:0/4109139033 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24551 (secure 0 0 0) 0x7fce900d10e0 con 0x7fce98109c20 2024-09-21T07:47:57.808 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:47:53.806970+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:47:57.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fce7c0b6560 msgr2=0x7fce7c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:57.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fce7c0b6560 0x7fce7c0b8a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce88000c00 tx=0x7fce88031400 comp rx=0 tx=0).stop 2024-09-21T07:47:57.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98109c20 msgr2=0x7fce98076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:57.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98109c20 0x7fce98076190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fce9000eaa0 tx=0x7fce9000ef60 comp rx=0 tx=0).stop 2024-09-21T07:47:57.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 shutdown_connections 2024-09-21T07:47:57.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fce7c0b6560 0x7fce7c0b8a70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce98109c20 0x7fce98076190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce981092d0 0x7fce98075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 --2- 172.21.15.84:0/4109139033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce98103990 0x7fce98075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 >> 172.21.15.84:0/4109139033 conn(0x7fce980ff3e0 msgr2=0x7fce98101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 shutdown_connections 2024-09-21T07:47:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:57.808+0000 7fce97e00640 1 -- 172.21.15.84:0/4109139033 wait complete. 2024-09-21T07:47:58.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:57 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4109139033' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:47:58.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:57 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4109139033' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:47:58.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:57 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4109139033' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:47:58.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:47:59.018 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:47:59.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:58 smithi191 ceph-mon[34667]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:59.156 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:58 smithi084 ceph-mon[30411]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:59.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:58 smithi162 ceph-mon[34833]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:47:59.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 -- 172.21.15.84:0/2419897556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa81039b0 msgr2=0x7fdaa8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 --2- 172.21.15.84:0/2419897556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa81039b0 0x7fdaa8103dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda98009900 tx=0x7fda9802a410 comp rx=0 tx=0).stop 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 -- 172.21.15.84:0/2419897556 shutdown_connections 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 --2- 172.21.15.84:0/2419897556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa8109c40 0x7fdaa8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 --2- 172.21.15.84:0/2419897556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdaa81092f0 0x7fdaa8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 --2- 172.21.15.84:0/2419897556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa81039b0 0x7fdaa8103dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 -- 172.21.15.84:0/2419897556 >> 172.21.15.84:0/2419897556 conn(0x7fdaa80ff440 msgr2=0x7fdaa8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 -- 172.21.15.84:0/2419897556 shutdown_connections 2024-09-21T07:47:59.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.643+0000 7fdaa7200640 1 -- 172.21.15.84:0/2419897556 wait complete. 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.644+0000 7fdaa7200640 1 Processor -- start 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.644+0000 7fdaa7200640 1 -- start start 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa7200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdaa81039b0 0x7fdaa819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa81092f0 0x7fdaa819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa8109c40 0x7fdaa819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa8113950 con 0x7fdaa8109c40 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81137d0 con 0x7fdaa81092f0 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa7200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa8113ad0 con 0x7fdaa81039b0 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa8109c40 0x7fdaa819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa81092f0 0x7fdaa819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:59.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fda9fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa81092f0 0x7fdaa819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48546/0 (socket says 172.21.15.84:48546) 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa8109c40 0x7fdaa819fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53320/0 (socket says 172.21.15.84:53320) 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fda9fe00640 1 -- 172.21.15.84:0/3034586806 learned_addr learned my addr 172.21.15.84:0/3034586806 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.645+0000 7fdaa5e00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdaa81039b0 0x7fdaa819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9fe00640 1 -- 172.21.15.84:0/3034586806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdaa81039b0 msgr2=0x7fdaa819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9fe00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdaa81039b0 0x7fdaa819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9fe00640 1 -- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa8109c40 msgr2=0x7fdaa819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9fe00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa8109c40 0x7fdaa819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9fe00640 1 -- 172.21.15.84:0/3034586806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa81a0330 con 0x7fdaa81092f0 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fdaa5e00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdaa81039b0 0x7fdaa819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9fe00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa81092f0 0x7fdaa819a960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e9c0 tx=0x7fda9000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9ea00640 1 -- 172.21.15.84:0/3034586806 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9000ccc0 con 0x7fdaa81092f0 2024-09-21T07:47:59.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa81a0620 con 0x7fdaa81092f0 2024-09-21T07:47:59.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9ea00640 1 -- 172.21.15.84:0/3034586806 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda900054d0 con 0x7fdaa81092f0 2024-09-21T07:47:59.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.646+0000 7fda9ea00640 1 -- 172.21.15.84:0/3034586806 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda90010430 con 0x7fdaa81092f0 2024-09-21T07:47:59.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.647+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa80755f0 con 0x7fdaa81092f0 2024-09-21T07:47:59.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.647+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa8104c30 con 0x7fdaa81092f0 2024-09-21T07:47:59.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.650+0000 7fda9ea00640 1 -- 172.21.15.84:0/3034586806 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fda90005000 con 0x7fdaa81092f0 2024-09-21T07:47:59.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.652+0000 7fda9ea00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda8c0b6560 0x7fda8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:47:59.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.652+0000 7fda9ea00640 1 -- 172.21.15.84:0/3034586806 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fda900e7be0 con 0x7fdaa81092f0 2024-09-21T07:47:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.652+0000 7fdaa5e00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda8c0b6560 0x7fda8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:47:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.653+0000 7fdaa5e00640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda8c0b6560 0x7fda8c0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda98005ab0 tx=0x7fda98005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:47:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.654+0000 7fda9ea00640 1 -- 172.21.15.84:0/3034586806 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda90056710 con 0x7fdaa81092f0 2024-09-21T07:47:59.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.842+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdaa810ba10 con 0x7fdaa81092f0 2024-09-21T07:47:59.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.844+0000 7fda9ea00640 1 -- 172.21.15.84:0/3034586806 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24551 (secure 0 0 0) 0x7fda900052f0 con 0x7fdaa81092f0 2024-09-21T07:47:59.846 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:47:59.846 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:47:53.806970+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:47:59.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda8c0b6560 msgr2=0x7fda8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:59.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda8c0b6560 0x7fda8c0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda98005ab0 tx=0x7fda98005a20 comp rx=0 tx=0).stop 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa81092f0 msgr2=0x7fdaa819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa81092f0 0x7fdaa819a960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e9c0 tx=0x7fda9000ee80 comp rx=0 tx=0).stop 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 shutdown_connections 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda8c0b6560 0x7fda8c0b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdaa8109c40 0x7fdaa819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa81092f0 0x7fdaa819a960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 --2- 172.21.15.84:0/3034586806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdaa81039b0 0x7fdaa819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.846+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 >> 172.21.15.84:0/3034586806 conn(0x7fdaa80ff440 msgr2=0x7fdaa8101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.847+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 shutdown_connections 2024-09-21T07:47:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:47:59.847+0000 7fdaa7200640 1 -- 172.21.15.84:0/3034586806 wait complete. 2024-09-21T07:48:00.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:47:59 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3034586806' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:00.208 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:47:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3034586806' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:00.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:47:59 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3034586806' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:00.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:48:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:01.221 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:00 smithi084 ceph-mon[30411]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:01.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:00 smithi162 ceph-mon[34833]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:00 smithi191 ceph-mon[34667]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:01.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 -- 172.21.15.84:0/1624244782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc810ff10 msgr2=0x7f2cc8112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:01.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 --2- 172.21.15.84:0/1624244782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc810ff10 0x7f2cc8112350 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009ca0 tx=0x7f2cc002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 -- 172.21.15.84:0/1624244782 shutdown_connections 2024-09-21T07:48:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 --2- 172.21.15.84:0/1624244782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc810ff10 0x7f2cc8112350 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 --2- 172.21.15.84:0/1624244782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cc8076100 0x7f2cc810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 --2- 172.21.15.84:0/1624244782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc80757b0 0x7f2cc8075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 -- 172.21.15.84:0/1624244782 >> 172.21.15.84:0/1624244782 conn(0x7f2cc80ff440 msgr2=0x7f2cc8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.551+0000 7f2ccca00640 1 -- 172.21.15.84:0/1624244782 shutdown_connections 2024-09-21T07:48:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.552+0000 7f2ccca00640 1 -- 172.21.15.84:0/1624244782 wait complete. 2024-09-21T07:48:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 Processor -- start 2024-09-21T07:48:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 -- start start 2024-09-21T07:48:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cc80757b0 0x7f2cc819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc8076100 0x7f2cc819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc810ff10 0x7f2cc81a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc8115ac0 con 0x7f2cc8076100 2024-09-21T07:48:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc8115940 con 0x7f2cc810ff10 2024-09-21T07:48:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2ccca00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc8115c40 con 0x7f2cc80757b0 2024-09-21T07:48:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc8076100 0x7f2cc819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc8076100 0x7f2cc819ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53340/0 (socket says 172.21.15.84:53340) 2024-09-21T07:48:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2cc5e00640 1 -- 172.21.15.84:0/3253551471 learned_addr learned my addr 172.21.15.84:0/3253551471 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2cc6800640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cc80757b0 0x7f2cc819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.553+0000 7f2cc7200640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc810ff10 0x7f2cc81a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc5e00640 1 -- 172.21.15.84:0/3253551471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cc80757b0 msgr2=0x7f2cc819c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc5e00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cc80757b0 0x7f2cc819c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc5e00640 1 -- 172.21.15.84:0/3253551471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc810ff10 msgr2=0x7f2cc81a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc5e00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc810ff10 0x7f2cc81a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc5e00640 1 -- 172.21.15.84:0/3253551471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc81a23e0 con 0x7f2cc8076100 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc6800640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cc80757b0 0x7f2cc819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc7200640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc810ff10 0x7f2cc81a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cc5e00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc8076100 0x7f2cc819ca10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e9c0 tx=0x7f2cb400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.554+0000 7f2cbf400640 1 -- 172.21.15.84:0/3253551471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400cd80 con 0x7f2cc8076100 2024-09-21T07:48:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.555+0000 7f2cbf400640 1 -- 172.21.15.84:0/3253551471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cb40035f0 con 0x7f2cc8076100 2024-09-21T07:48:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.555+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc81a26d0 con 0x7f2cc8076100 2024-09-21T07:48:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.555+0000 7f2cbf400640 1 -- 172.21.15.84:0/3253551471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4010690 con 0x7f2cc8076100 2024-09-21T07:48:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.555+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc81a8e30 con 0x7f2cc8076100 2024-09-21T07:48:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.556+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc8075bc0 con 0x7f2cc8076100 2024-09-21T07:48:01.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.558+0000 7f2cbf400640 1 -- 172.21.15.84:0/3253551471 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2cb4004000 con 0x7f2cc8076100 2024-09-21T07:48:01.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.559+0000 7f2cbf400640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cac0b6560 0x7f2cac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:01.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.560+0000 7f2cbf400640 1 -- 172.21.15.84:0/3253551471 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7f2cb40e7ca0 con 0x7f2cc8076100 2024-09-21T07:48:01.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.560+0000 7f2cc6800640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cac0b6560 0x7f2cac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:01.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.560+0000 7f2cc6800640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cac0b6560 0x7f2cac0b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009fc0 tx=0x7f2cb8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:01.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.561+0000 7f2cbf400640 1 -- 172.21.15.84:0/3253551471 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cb40ae220 con 0x7f2cc8076100 2024-09-21T07:48:01.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.788+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cc819d5a0 con 0x7f2cc8076100 2024-09-21T07:48:01.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.789+0000 7f2cbf400640 1 -- 172.21.15.84:0/3253551471 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11857 (secure 0 0 0) 0x7f2cc819d5a0 con 0x7f2cc8076100 2024-09-21T07:48:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:01.791 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"btime":"2024-09-21T07:47:53:857359+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24662,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24667,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24695,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24712,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24719,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24742,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:47:53.807135+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24746},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24746,"qdb_cluster":[24746]},"id":1}]} 2024-09-21T07:48:01.792 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cac0b6560 msgr2=0x7f2cac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cac0b6560 0x7f2cac0b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009fc0 tx=0x7f2cb8005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc8076100 msgr2=0x7f2cc819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc8076100 0x7f2cc819ca10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e9c0 tx=0x7f2cb400ee80 comp rx=0 tx=0).stop 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 shutdown_connections 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cac0b6560 0x7f2cac0b8a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cc810ff10 0x7f2cc81a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc8076100 0x7f2cc819ca10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 --2- 172.21.15.84:0/3253551471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cc80757b0 0x7f2cc819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 >> 172.21.15.84:0/3253551471 conn(0x7f2cc80ff440 msgr2=0x7f2cc8109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 shutdown_connections 2024-09-21T07:48:01.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:01.792+0000 7f2ccca00640 1 -- 172.21.15.84:0/3253551471 wait complete. 2024-09-21T07:48:02.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:01 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3253551471' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:48:02.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:01 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3253551471' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:48:02.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:01 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3253551471' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:48:02.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:48:03.053 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:03.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:02 smithi084 ceph-mon[30411]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:03.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:02 smithi162 ceph-mon[34833]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:02 smithi191 ceph-mon[34667]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.686+0000 7f4cd7200640 1 -- 172.21.15.84:0/180022577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd80757b0 msgr2=0x7f4cd8075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.686+0000 7f4cd7200640 1 --2- 172.21.15.84:0/180022577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd80757b0 0x7f4cd8075bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009ca0 tx=0x7f4cc802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.687+0000 7f4cd7200640 1 -- 172.21.15.84:0/180022577 shutdown_connections 2024-09-21T07:48:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.687+0000 7f4cd7200640 1 --2- 172.21.15.84:0/180022577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd810ff10 0x7f4cd8112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.687+0000 7f4cd7200640 1 --2- 172.21.15.84:0/180022577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4cd8076100 0x7f4cd810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.687+0000 7f4cd7200640 1 --2- 172.21.15.84:0/180022577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd80757b0 0x7f4cd8075bc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.687+0000 7f4cd7200640 1 -- 172.21.15.84:0/180022577 >> 172.21.15.84:0/180022577 conn(0x7f4cd80ff440 msgr2=0x7f4cd8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.687+0000 7f4cd7200640 1 -- 172.21.15.84:0/180022577 shutdown_connections 2024-09-21T07:48:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.687+0000 7f4cd7200640 1 -- 172.21.15.84:0/180022577 wait complete. 2024-09-21T07:48:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.688+0000 7f4cd7200640 1 Processor -- start 2024-09-21T07:48:03.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd7200640 1 -- start start 2024-09-21T07:48:03.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd80757b0 0x7f4cd819c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:03.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8076100 0x7f4cd819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:03.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd7200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4cd810ff10 0x7f4cd81a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:03.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8115ac0 con 0x7f4cd8076100 2024-09-21T07:48:03.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8115940 con 0x7f4cd80757b0 2024-09-21T07:48:03.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd7200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8115c40 con 0x7f4cd810ff10 2024-09-21T07:48:03.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd80757b0 0x7f4cd819c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd80757b0 0x7f4cd819c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48582/0 (socket says 172.21.15.84:48582) 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.689+0000 7f4cd5e00640 1 -- 172.21.15.84:0/1017039656 learned_addr learned my addr 172.21.15.84:0/1017039656 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4ccd400640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8076100 0x7f4cd819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4cd6800640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4cd810ff10 0x7f4cd81a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4cd5e00640 1 -- 172.21.15.84:0/1017039656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4cd810ff10 msgr2=0x7f4cd81a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4cd5e00640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4cd810ff10 0x7f4cd81a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4cd5e00640 1 -- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8076100 msgr2=0x7f4cd819ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4cd5e00640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8076100 0x7f4cd819ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4cd5e00640 1 -- 172.21.15.84:0/1017039656 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd81a2460 con 0x7f4cd80757b0 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4ccd400640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8076100 0x7f4cd819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:03.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.690+0000 7f4cd5e00640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd80757b0 0x7f4cd819c4f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8033040 tx=0x7f4cc80316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.691+0000 7f4ccf400640 1 -- 172.21.15.84:0/1017039656 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8003b70 con 0x7f4cd80757b0 2024-09-21T07:48:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.691+0000 7f4ccf400640 1 -- 172.21.15.84:0/1017039656 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cc8003d10 con 0x7f4cd80757b0 2024-09-21T07:48:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.691+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd81a26f0 con 0x7f4cd80757b0 2024-09-21T07:48:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.691+0000 7f4ccf400640 1 -- 172.21.15.84:0/1017039656 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc802f9e0 con 0x7f4cd80757b0 2024-09-21T07:48:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.691+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd81a8eb0 con 0x7f4cd80757b0 2024-09-21T07:48:03.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.692+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd8075bc0 con 0x7f4cd80757b0 2024-09-21T07:48:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.696+0000 7f4ccf400640 1 -- 172.21.15.84:0/1017039656 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f4cc8004b40 con 0x7f4cd80757b0 2024-09-21T07:48:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.698+0000 7f4ccf400640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4cbc0b6560 0x7f4cbc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.698+0000 7f4ccf400640 1 -- 172.21.15.84:0/1017039656 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7f4cc8108a20 con 0x7f4cd80757b0 2024-09-21T07:48:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.698+0000 7f4ccd400640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4cbc0b6560 0x7f4cbc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.698+0000 7f4ccf400640 1 -- 172.21.15.84:0/1017039656 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cc80cefa0 con 0x7f4cd80757b0 2024-09-21T07:48:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.699+0000 7f4ccd400640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4cbc0b6560 0x7f4cbc0b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4cd81123e0 tx=0x7f4cc0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.898+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cd81a9150 con 0x7f4cd80757b0 2024-09-21T07:48:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.899+0000 7f4ccf400640 1 -- 172.21.15.84:0/1017039656 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24551 (secure 0 0 0) 0x7f4cc80d3380 con 0x7f4cd80757b0 2024-09-21T07:48:03.902 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:03.902 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:47:53.806970+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:48:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4cbc0b6560 msgr2=0x7f4cbc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4cbc0b6560 0x7f4cbc0b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4cd81123e0 tx=0x7f4cc0005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd80757b0 msgr2=0x7f4cd819c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd80757b0 0x7f4cd819c4f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8033040 tx=0x7f4cc80316f0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 shutdown_connections 2024-09-21T07:48:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4cbc0b6560 0x7f4cbc0b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4cd810ff10 0x7f4cd81a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8076100 0x7f4cd819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 --2- 172.21.15.84:0/1017039656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd80757b0 0x7f4cd819c4f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 >> 172.21.15.84:0/1017039656 conn(0x7f4cd80ff440 msgr2=0x7f4cd8101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 shutdown_connections 2024-09-21T07:48:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:03.902+0000 7f4cd7200640 1 -- 172.21.15.84:0/1017039656 wait complete. 2024-09-21T07:48:04.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1017039656' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:04.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1017039656' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1017039656' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:04.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:47:41.706708+0000', 'modified': '2024-09-21T07:47:53.807135+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24746}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24746': {'gid': 24746, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.162:6839/3948328826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 3948328826}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 3948328826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24746, 'qdb_cluster': [24746]} 2024-09-21T07:48:04.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:48:04.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:48:05.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:04 smithi084 ceph-mon[30411]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:05.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:04 smithi162 ceph-mon[34833]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:04 smithi191 ceph-mon[34667]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.754+0000 7f78e3200640 1 -- 172.21.15.84:0/2273287824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e410ff90 msgr2=0x7f78e41123b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.754+0000 7f78e3200640 1 --2- 172.21.15.84:0/2273287824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e410ff90 0x7f78e41123b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009ca0 tx=0x7f78dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.755+0000 7f78e3200640 1 -- 172.21.15.84:0/2273287824 shutdown_connections 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.755+0000 7f78e3200640 1 --2- 172.21.15.84:0/2273287824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e410ff90 0x7f78e41123b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.755+0000 7f78e3200640 1 --2- 172.21.15.84:0/2273287824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78e4076080 0x7f78e410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.755+0000 7f78e3200640 1 --2- 172.21.15.84:0/2273287824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4075730 0x7f78e4075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.755+0000 7f78e3200640 1 -- 172.21.15.84:0/2273287824 >> 172.21.15.84:0/2273287824 conn(0x7f78e40ff400 msgr2=0x7f78e4101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.755+0000 7f78e3200640 1 -- 172.21.15.84:0/2273287824 shutdown_connections 2024-09-21T07:48:05.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.755+0000 7f78e3200640 1 -- 172.21.15.84:0/2273287824 wait complete. 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.756+0000 7f78e3200640 1 Processor -- start 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.756+0000 7f78e3200640 1 -- start start 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.756+0000 7f78e3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e4075730 0x7f78e419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.756+0000 7f78e3200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4076080 0x7f78e419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78e410ff90 0x7f78e41a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e3200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f78e4115b20 con 0x7f78e4075730 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78e41159a0 con 0x7f78e410ff90 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e3200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f78e4115ca0 con 0x7f78e4076080 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e4075730 0x7f78e419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4076080 0x7f78e419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4076080 0x7f78e419c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:58594/0 (socket says 172.21.15.84:58594) 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 -- 172.21.15.84:0/1811816918 learned_addr learned my addr 172.21.15.84:0/1811816918 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:05.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e2800640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78e410ff90 0x7f78e41a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 -- 172.21.15.84:0/1811816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78e410ff90 msgr2=0x7f78e41a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78e410ff90 0x7f78e41a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 -- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e4075730 msgr2=0x7f78e419c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e4075730 0x7f78e419c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1400640 1 -- 172.21.15.84:0/1811816918 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e41a2390 con 0x7f78e4076080 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.757+0000 7f78e1e00640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e4075730 0x7f78e419c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.758+0000 7f78e1400640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4076080 0x7f78e419c9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f78d000d950 tx=0x7f78d000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.758+0000 7f78daa00640 1 -- 172.21.15.84:0/1811816918 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0017070 con 0x7f78e4076080 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.758+0000 7f78daa00640 1 -- 172.21.15.84:0/1811816918 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78d0009c30 con 0x7f78e4076080 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.758+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e41a2680 con 0x7f78e4076080 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.758+0000 7f78daa00640 1 -- 172.21.15.84:0/1811816918 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d00047a0 con 0x7f78e4076080 2024-09-21T07:48:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.758+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e41a8de0 con 0x7f78e4076080 2024-09-21T07:48:05.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.761+0000 7f78ef7fe740 1 Processor -- start 2024-09-21T07:48:05.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.761+0000 7f78ef7fe740 1 -- start start 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579ad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561157924d50 con 0x561157606f60 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561157914180 con 0x5611575e6280 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561157917f90 con 0x5611575de0a0 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78e2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78e1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78e2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53388/0 (socket says 172.21.15.84:53388) 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78e2800640 1 -- 172.21.15.84:0/2497416477 learned_addr learned my addr 172.21.15.84:0/2497416477 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78daa00640 1 -- 172.21.15.84:0/1811816918 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f78d0004020 con 0x7f78e4076080 2024-09-21T07:48:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78e1400640 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.762+0000 7f78e2800640 1 -- 172.21.15.84:0/2497416477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 msgr2=0x5611579adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78e2800640 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78e2800640 1 -- 172.21.15.84:0/2497416477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 msgr2=0x5611579ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78e2800640 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78e2800640 1 -- 172.21.15.84:0/2497416477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611578dea70 con 0x561157606f60 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78e1400640 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78e2800640 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579ad650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009ca0 tx=0x7f78dc02f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc8a19e7ab8670 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78cf000640 1 -- 172.21.15.84:0/2497416477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc031db0 con 0x561157606f60 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78cf000640 1 -- 172.21.15.84:0/2497416477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78dc036030 con 0x561157606f60 2024-09-21T07:48:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.763+0000 7f78cf000640 1 -- 172.21.15.84:0/2497416477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0042d0 con 0x561157606f60 2024-09-21T07:48:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 -- 172.21.15.84:0/2497416477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 msgr2=0x5611579ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579ad650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009ca0 tx=0x7f78dc02f310 comp rx=0 tx=0).stop 2024-09-21T07:48:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 -- 172.21.15.84:0/2497416477 shutdown_connections 2024-09-21T07:48:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/2497416477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579ad650 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 -- 172.21.15.84:0/2497416477 >> 172.21.15.84:0/2497416477 conn(0x5611575fb350 msgr2=0x5611579ab540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78daa00640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f78c80b65e0 0x7f78c80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.764+0000 7f78ef7fe740 1 -- 172.21.15.84:0/2497416477 shutdown_connections 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.765+0000 7f78ef7fe740 1 -- 172.21.15.84:0/2497416477 wait complete. 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.765+0000 7f78daa00640 1 -- 172.21.15.84:0/1811816918 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7f78d00e7270 con 0x7f78e4076080 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.765+0000 7f78e2800640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f78c80b65e0 0x7f78c80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.765+0000 7f78ef7fe740 1 -- start start 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.765+0000 7f78e2800640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f78c80b65e0 0x7f78c80b8af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f78dc003d80 tx=0x7f78dc02a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.765+0000 7f78ef7fe740 1 Processor -- start 2024-09-21T07:48:05.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5611577755f0 con 0x561157606f60 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5611578af460 con 0x5611575e6280 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5611579bbc50 con 0x5611575de0a0 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78ef7fe740 10 client.0 _ll_register_callbacks cb 0x5611578bf210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78e2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78e1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78e1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579b96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48618/0 (socket says 172.21.15.84:48618) 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78e1400640 1 -- 172.21.15.84:0/435330514 learned_addr learned my addr 172.21.15.84:0/435330514 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78e2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53390/0 (socket says 172.21.15.84:53390) 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.766+0000 7f78e1e00640 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78e1400640 1 -- 172.21.15.84:0/435330514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 msgr2=0x5611579b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78e1400640 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78e1400640 1 -- 172.21.15.84:0/435330514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 msgr2=0x5611579c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78e1400640 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78e1400640 1 -- 172.21.15.84:0/435330514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561157672540 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78e2800640 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78e1400640 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579b96c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78d00a9660 tx=0x7f78d00ace60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65dd61b5baffcfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78c3400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78c3400640 1 -- 172.21.15.84:0/435330514 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0092e60 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5611578b1a70 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78c3400640 1 -- 172.21.15.84:0/435330514 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7f78d00a8be0 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78c3400640 1 -- 172.21.15.84:0/435330514 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f78d00acba0 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78ef7fe740 10 client.24839 fetch_fsmap learned FSMap version 17 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.767+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5611578cc6f0 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78c3400640 1 -- 172.21.15.84:0/435330514 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5611578b1a70 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78c3400640 1 -- 172.21.15.84:0/435330514 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f78d00abd60 con 0x5611575e6280 2024-09-21T07:48:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78ef7fe740 10 client.24839 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:48:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78ef7fe740 10 client.24839 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:48:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78ef7fe740 20 client.24839 populate_metadata read hostname 'smithi084' 2024-09-21T07:48:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5611575c58e0 0x5611579cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78ef7fe740 4 client.24839 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:48:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.768+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561157926ca0 con 0x5611575c58e0 2024-09-21T07:48:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.769+0000 7f78e1e00640 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5611575c58e0 0x5611579cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.769+0000 7f78e1e00640 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5611575c58e0 0x5611579cb350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa18d67ee0f3b961 server_cookie=b6b364029c0af8d1 in_seq=0 out_seq=0 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.769+0000 7f78c3400640 10 client.24839 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.770+0000 7f78c3400640 1 -- 172.21.15.84:0/435330514 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561157926ca0 con 0x5611575c58e0 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.770+0000 7f78c3400640 10 client.24839 handle_command_reply: tid=0 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.770+0000 7f78ef7fe740 1 client.24839 shutdown 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 msgr2=0x5611579b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579b96c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78d00a9660 tx=0x7f78d00ace60 comp rx=0 tx=0).stop 2024-09-21T07:48:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 shutdown_connections 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561157606f60 0x5611579c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579b96c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5611575c58e0 0x5611579cb350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/435330514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5611575de0a0 0x5611579b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78c3400640 0 client.24839 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 >> 172.21.15.84:0/435330514 conn(0x5611575fb350 msgr2=0x5611579b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 shutdown_connections 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 1 -- 172.21.15.84:0/435330514 wait complete. 2024-09-21T07:48:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.771+0000 7f78ef7fe740 20 client.24839 trim_cache size 0 max 16384 2024-09-21T07:48:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.789+0000 7f78ef7fe740 1 Processor -- start 2024-09-21T07:48:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78ef7fe740 1 -- start start 2024-09-21T07:48:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575de0a0 0x5611579c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579b7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5611579c9690 con 0x5611575de0a0 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5611579c9d60 con 0x5611575e6280 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5611579ca430 con 0x561157606f60 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78e1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575de0a0 0x5611579c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78e1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575de0a0 0x5611579c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53396/0 (socket says 172.21.15.84:53396) 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78e1e00640 1 -- 172.21.15.84:0/4102854190 learned_addr learned my addr 172.21.15.84:0/4102854190 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78e1400640 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78e2800640 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.790+0000 7f78e1e00640 1 -- 172.21.15.84:0/4102854190 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 msgr2=0x5611579b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78e1e00640 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78e1e00640 1 -- 172.21.15.84:0/4102854190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 msgr2=0x5611579c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78e1e00640 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78e1e00640 1 -- 172.21.15.84:0/4102854190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611579af940 con 0x5611575de0a0 2024-09-21T07:48:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78e1e00640 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575de0a0 0x5611579c9ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5611579ac2d0 tx=0x7f78d4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a63af288373ae1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78ce600640 1 -- 172.21.15.84:0/4102854190 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d40107b0 con 0x5611575de0a0 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78ce600640 1 -- 172.21.15.84:0/4102854190 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78d4010e00 con 0x5611575de0a0 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.791+0000 7f78ce600640 1 -- 172.21.15.84:0/4102854190 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d401d410 con 0x5611575de0a0 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4102854190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575de0a0 msgr2=0x5611579c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575de0a0 0x5611579c9ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5611579ac2d0 tx=0x7f78d4005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4102854190 shutdown_connections 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575e6280 0x5611579c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4102854190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575de0a0 0x5611579c9ee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4102854190 >> 172.21.15.84:0/4102854190 conn(0x5611575fb350 msgr2=0x5611579c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4102854190 shutdown_connections 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.792+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4102854190 wait complete. 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 -- start start 2024-09-21T07:48:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 Processor -- start 2024-09-21T07:48:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575de0a0 0x5611579cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575e6280 0x5611579cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5611579cb1d0 con 0x5611575e6280 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5611579cab00 con 0x5611575de0a0 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5611579cb8a0 con 0x561157606f60 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.793+0000 7f78ef7fe740 10 client.0 _ll_register_callbacks cb 0x7f78d00057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575de0a0 0x5611579cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575e6280 0x5611579cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575de0a0 0x5611579cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48644/0 (socket says 172.21.15.84:48644) 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1e00640 1 -- 172.21.15.84:0/4053109333 learned_addr learned my addr 172.21.15.84:0/4053109333 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e2800640 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1400640 1 -- 172.21.15.84:0/4053109333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 msgr2=0x5611579d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1400640 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1400640 1 -- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575de0a0 msgr2=0x5611579cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1400640 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575de0a0 0x5611579cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1400640 1 -- 172.21.15.84:0/4053109333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611579ce820 con 0x5611575e6280 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1e00640 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575de0a0 0x5611579cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78e1400640 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575e6280 0x5611579cdf80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f78d00aa300 tx=0x7f78d00acf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bba0b12178b5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78c3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.794+0000 7f78c3400640 1 -- 172.21.15.84:0/4053109333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0014070 con 0x5611575e6280 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78c3400640 1 -- 172.21.15.84:0/4053109333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7f78d00b2d00 con 0x5611575e6280 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78d4010e00 con 0x5611575e6280 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78c3400640 1 -- 172.21.15.84:0/4053109333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f78d0092e60 con 0x5611575e6280 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 10 client.14865 fetch_fsmap learned FSMap version 17 2024-09-21T07:48:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5611579d3fc0 con 0x5611575e6280 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78c3400640 1 -- 172.21.15.84:0/4053109333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78d4010e00 con 0x5611575e6280 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78c3400640 1 -- 172.21.15.84:0/4053109333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f78d00b2f00 con 0x5611575e6280 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 10 client.14865 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 10 client.14865 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 20 client.14865 populate_metadata read hostname 'smithi084' 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56115759ac90 0x561157a39ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 4 client.14865 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.795+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "status"}) -- 0x5611579c94e0 con 0x56115759ac90 2024-09-21T07:48:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.796+0000 7f78e1e00640 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56115759ac90 0x561157a39ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.796+0000 7f78e1e00640 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56115759ac90 0x561157a39ad0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfa58d99bd5acce server_cookie=1ff65db74f2c5ffb in_seq=0 out_seq=0 2024-09-21T07:48:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.796+0000 7f78c3400640 10 client.14865 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:48:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78c3400640 1 -- 172.21.15.84:0/4053109333 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5611579c94e0 con 0x56115759ac90 2024-09-21T07:48:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78c3400640 10 client.14865 handle_command_reply: tid=0 2024-09-21T07:48:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 client.14865 shutdown 2024-09-21T07:48:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575e6280 msgr2=0x5611579cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575e6280 0x5611579cdf80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f78d00aa300 tx=0x7f78d00acf90 comp rx=0 tx=0).stop 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 shutdown_connections 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56115759ac90 0x561157a39ad0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561157606f60 0x5611579d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611575e6280 0x5611579cdf80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 --2- 172.21.15.84:0/4053109333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5611575de0a0 0x5611579cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78c3400640 0 client.14865 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 >> 172.21.15.84:0/4053109333 conn(0x5611575fb350 msgr2=0x5611579aadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 shutdown_connections 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.797+0000 7f78ef7fe740 1 -- 172.21.15.84:0/4053109333 wait complete. 2024-09-21T07:48:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78ef7fe740 20 client.14865 trim_cache size 0 max 16384 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24746, 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 23.092843491, 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 17, 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 84, 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 37.385842322999999 2024-09-21T07:48:05.803 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f78c80b65e0 msgr2=0x7f78c80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f78c80b65e0 0x7f78c80b8af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f78dc003d80 tx=0x7f78dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4076080 msgr2=0x7f78e419c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4076080 0x7f78e419c9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f78d000d950 tx=0x7f78d000de10 comp rx=0 tx=0).stop 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 shutdown_connections 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f78c80b65e0 0x7f78c80b8af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78e410ff90 0x7f78e41a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78e4076080 0x7f78e419c9c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 --2- 172.21.15.84:0/1811816918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78e4075730 0x7f78e419c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 >> 172.21.15.84:0/1811816918 conn(0x7f78e40ff400 msgr2=0x7f78e4100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 shutdown_connections 2024-09-21T07:48:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:05.798+0000 7f78e3200640 1 -- 172.21.15.84:0/1811816918 wait complete. 2024-09-21T07:48:06.679 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:48:06.679 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:06.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T07:48:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:07.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:07 smithi162 ceph-mon[34833]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:07.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:07 smithi084 ceph-mon[30411]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:07.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:07 smithi191 ceph-mon[34667]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.722+0000 7fb972800640 1 -- 172.21.15.84:0/714344950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1039b0 msgr2=0x7fb96c103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.722+0000 7fb972800640 1 --2- 172.21.15.84:0/714344950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1039b0 0x7fb96c103dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb960009900 tx=0x7fb96002a410 comp rx=0 tx=0).stop 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.722+0000 7fb972800640 1 -- 172.21.15.84:0/714344950 shutdown_connections 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.722+0000 7fb972800640 1 --2- 172.21.15.84:0/714344950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb96c109c40 0x7fb96c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.722+0000 7fb972800640 1 --2- 172.21.15.84:0/714344950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb96c1092f0 0x7fb96c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.722+0000 7fb972800640 1 --2- 172.21.15.84:0/714344950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1039b0 0x7fb96c103dc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.722+0000 7fb972800640 1 -- 172.21.15.84:0/714344950 >> 172.21.15.84:0/714344950 conn(0x7fb96c0ff400 msgr2=0x7fb96c101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.723+0000 7fb972800640 1 -- 172.21.15.84:0/714344950 shutdown_connections 2024-09-21T07:48:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.723+0000 7fb972800640 1 -- 172.21.15.84:0/714344950 wait complete. 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.723+0000 7fb972800640 1 Processor -- start 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb972800640 1 -- start start 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb972800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb96c1039b0 0x7fb96c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb972800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1092f0 0x7fb96c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb972800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb96c109c40 0x7fb96c19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb972800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c113950 con 0x7fb96c1092f0 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb972800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1137d0 con 0x7fb96c1039b0 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb972800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c113ad0 con 0x7fb96c109c40 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb970a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1092f0 0x7fb96c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb970a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1092f0 0x7fb96c19a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53418/0 (socket says 172.21.15.84:53418) 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb970a00640 1 -- 172.21.15.84:0/3418652798 learned_addr learned my addr 172.21.15.84:0/3418652798 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb971400640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb96c1039b0 0x7fb96c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.724+0000 7fb971e00640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb96c109c40 0x7fb96c19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb970a00640 1 -- 172.21.15.84:0/3418652798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb96c109c40 msgr2=0x7fb96c19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb970a00640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb96c109c40 0x7fb96c19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb970a00640 1 -- 172.21.15.84:0/3418652798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb96c1039b0 msgr2=0x7fb96c19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb970a00640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb96c1039b0 0x7fb96c19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb970a00640 1 -- 172.21.15.84:0/3418652798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c1a0270 con 0x7fb96c1092f0 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb970a00640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1092f0 0x7fb96c19a8a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e9c0 tx=0x7fb95800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb96a000640 1 -- 172.21.15.84:0/3418652798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95800ccc0 con 0x7fb96c1092f0 2024-09-21T07:48:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb96a000640 1 -- 172.21.15.84:0/3418652798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9580054d0 con 0x7fb96c1092f0 2024-09-21T07:48:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96c1a0560 con 0x7fb96c1092f0 2024-09-21T07:48:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.725+0000 7fb96a000640 1 -- 172.21.15.84:0/3418652798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958010430 con 0x7fb96c1092f0 2024-09-21T07:48:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.726+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96c0755f0 con 0x7fb96c1092f0 2024-09-21T07:48:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.727+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96c103dc0 con 0x7fb96c1092f0 2024-09-21T07:48:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.731+0000 7fb96a000640 1 -- 172.21.15.84:0/3418652798 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb958005000 con 0x7fb96c1092f0 2024-09-21T07:48:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.733+0000 7fb96a000640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9540b65e0 0x7fb9540b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.733+0000 7fb96a000640 1 -- 172.21.15.84:0/3418652798 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fb9580e7b80 con 0x7fb96c1092f0 2024-09-21T07:48:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.733+0000 7fb971400640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9540b65e0 0x7fb9540b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.734+0000 7fb971400640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9540b65e0 0x7fb9540b8af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb960005ab0 tx=0x7fb960005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.735+0000 7fb96a000640 1 -- 172.21.15.84:0/3418652798 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb958056710 con 0x7fb96c1092f0 2024-09-21T07:48:07.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.958+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb96c19b430 con 0x7fb96c1092f0 2024-09-21T07:48:07.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.959+0000 7fb96a000640 1 -- 172.21.15.84:0/3418652798 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fb96c19b430 con 0x7fb96c1092f0 2024-09-21T07:48:07.961 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:48:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.961+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9540b65e0 msgr2=0x7fb9540b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.961+0000 7fb972800640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9540b65e0 0x7fb9540b8af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb960005ab0 tx=0x7fb960005a20 comp rx=0 tx=0).stop 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.961+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1092f0 msgr2=0x7fb96c19a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.961+0000 7fb972800640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1092f0 0x7fb96c19a8a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e9c0 tx=0x7fb95800ee80 comp rx=0 tx=0).stop 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 shutdown_connections 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb9540b65e0 0x7fb9540b8af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb96c109c40 0x7fb96c19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb96c1092f0 0x7fb96c19a8a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 --2- 172.21.15.84:0/3418652798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb96c1039b0 0x7fb96c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 >> 172.21.15.84:0/3418652798 conn(0x7fb96c0ff400 msgr2=0x7fb96c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 shutdown_connections 2024-09-21T07:48:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:07.962+0000 7fb972800640 1 -- 172.21.15.84:0/3418652798 wait complete. 2024-09-21T07:48:08.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:08 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3418652798' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:48:08.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:08 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3418652798' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:48:08.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:08 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3418652798' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:48:08.669 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:48:08.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:48:08.670 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-09-21T07:48:08.670 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T07:48:08.670 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:08.670 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:48:08.670 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:48:08.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:48:08.670 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:48:08.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:08.670 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-09-21T07:48:08.705 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-09-21T07:48:08.706 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:48:08.707 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:48:08.707 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:48:08.707 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:48:08.707 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:48:08.707 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42154sec preferred_lft 42154sec 2024-09-21T07:48:08.707 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T07:48:08.707 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:48:08.708 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:48:08.708 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:48:08.708 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:48:08.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:48:08.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-09-21T07:48:08.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-09-21T07:48:08.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:48:08.709 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:48:08.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:48:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:48:09.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:09.132 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:48:09.188 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-09-21T07:48:09.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:09.192 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-09-21T07:48:09.244 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-09-21T07:48:09.244 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:48:09.244 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:48:09.244 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:48:09.244 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:48:09.245 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:48:09.245 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:48:09.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:48:09.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:48:09.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:48:09.245 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:48:09.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:09 smithi162 ceph-mon[34833]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:09.306 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:09 smithi191 ceph-mon[34667]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:09 smithi084 ceph-mon[30411]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:48:09.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:48:09.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:09.811 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T07:48:09.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:09.847 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-09-21T07:48:09.922 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:48:09.922 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:48:09.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:48:09.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T07:48:09.923 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:48:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:48:10.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:48:10.104 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T07:48:10.104 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:48:10.105 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:48:10.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T07:48:10.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:48:10.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T07:48:10.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T07:48:10.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T07:48:10.105 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:48:10.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:48:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:48:10.345 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:48:10.345 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:48:10.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-09-21T07:48:10.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:48:10.346 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:48:10.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:48:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:48:10.512 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T07:48:10.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:48:10.512 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:10.547 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T07:48:10.548 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:48:10.548 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:10.622 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-09-21T07:48:10.719 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:48:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-09-21T07:48:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-09-21T07:48:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-09-21T07:48:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-09-21T07:48:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-09-21T07:48:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-09-21T07:48:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:48:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/123ea2336f76d2b6a4407fc5bd5424029afef8ed2d982afb14c3213c9b890862/merged 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/fae588e61a181c281b8e875e70fd2294226bd900b6dd87c7b080d7c6f05be642/merged 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7c76f6e8bb32bd6efbbb8b1c23a59dc6685b95cd361e841dfc9cfeeb1a9d7138/merged 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7a2c1a78d683f7ff81bc1e67a6a7634a82e6f9b1a35cc9db07ea2000e06f8bde/merged 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/789fcd5eb82af20607d1c03a34b52559795a7afd7eda853b5a67db3e79ff81b1/merged 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/a3e6004e7b955812308983d03e407bf7f64dff97e496517299b916a982c4c950/merged 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/fd6f1b33d81cdfdf36b05a8926b4701332a39b09de81bef670a37461be8b3919/merged 2024-09-21T07:48:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/adb5a88bc48717cbd5688ce2537e57f91d9a1aadb4561d083a3b1bcaf78e24a2/merged 2024-09-21T07:48:10.759 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/8982bbcc1bf694bf28c5d506e984282eb35a047a25fecd30cda33e8bc30500e0/merged 2024-09-21T07:48:10.759 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/83c7e43f7a4c3f528adcedb83e6d8f6153d1c077b45a923b585e981cb33dbc3d/merged 2024-09-21T07:48:10.759 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-09-21T07:48:10.759 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:48:10.759 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:48:10.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:10.760 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-09-21T07:48:10.835 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T07:48:10.835 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T07:48:10.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-09-21T07:48:10.936 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:48:10.972 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-09-21T07:48:10.972 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-09-21T07:48:10.972 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-09-21T07:48:10.972 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-09-21T07:48:10.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/123ea2336f76d2b6a4407fc5bd5424029afef8ed2d982afb14c3213c9b890862/merged 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/fae588e61a181c281b8e875e70fd2294226bd900b6dd87c7b080d7c6f05be642/merged 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7c76f6e8bb32bd6efbbb8b1c23a59dc6685b95cd361e841dfc9cfeeb1a9d7138/merged 2024-09-21T07:48:10.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7a2c1a78d683f7ff81bc1e67a6a7634a82e6f9b1a35cc9db07ea2000e06f8bde/merged 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/789fcd5eb82af20607d1c03a34b52559795a7afd7eda853b5a67db3e79ff81b1/merged 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/a3e6004e7b955812308983d03e407bf7f64dff97e496517299b916a982c4c950/merged 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/fd6f1b33d81cdfdf36b05a8926b4701332a39b09de81bef670a37461be8b3919/merged 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/adb5a88bc48717cbd5688ce2537e57f91d9a1aadb4561d083a3b1bcaf78e24a2/merged 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/8982bbcc1bf694bf28c5d506e984282eb35a047a25fecd30cda33e8bc30500e0/merged 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/83c7e43f7a4c3f528adcedb83e6d8f6153d1c077b45a923b585e981cb33dbc3d/merged 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:48:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:48:10.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:10.976 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-09-21T07:48:11.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2024-09-21T07:48:11.134+0000 7f2ab2077480 -1 init, newargv = 0x7f2a98004ba0 newargc=15 2024-09-21T07:48:11.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[77015]: starting ceph client 2024-09-21T07:48:11.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[77015]: starting fuse 2024-09-21T07:48:11.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:11 smithi162 ceph-mon[34833]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:11.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:11 smithi084 ceph-mon[30411]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:11.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:11 smithi191 ceph-mon[34667]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:12.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-09-21T07:48:12.217 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T07:48:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-09-21T07:48:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-09-21T07:48:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-09-21T07:48:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/123ea2336f76d2b6a4407fc5bd5424029afef8ed2d982afb14c3213c9b890862/merged 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/fae588e61a181c281b8e875e70fd2294226bd900b6dd87c7b080d7c6f05be642/merged 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7c76f6e8bb32bd6efbbb8b1c23a59dc6685b95cd361e841dfc9cfeeb1a9d7138/merged 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7a2c1a78d683f7ff81bc1e67a6a7634a82e6f9b1a35cc9db07ea2000e06f8bde/merged 2024-09-21T07:48:12.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/789fcd5eb82af20607d1c03a34b52559795a7afd7eda853b5a67db3e79ff81b1/merged 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/a3e6004e7b955812308983d03e407bf7f64dff97e496517299b916a982c4c950/merged 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/fd6f1b33d81cdfdf36b05a8926b4701332a39b09de81bef670a37461be8b3919/merged 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/adb5a88bc48717cbd5688ce2537e57f91d9a1aadb4561d083a3b1bcaf78e24a2/merged 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/8982bbcc1bf694bf28c5d506e984282eb35a047a25fecd30cda33e8bc30500e0/merged 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/83c7e43f7a4c3f528adcedb83e6d8f6153d1c077b45a923b585e981cb33dbc3d/merged 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:48:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:12.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:12.258 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-09-21T07:48:12.334 INFO:teuthology.orchestra.run.smithi084.stdout:120 2024-09-21T07:48:12.334 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T07:48:12.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2024-09-21T07:48:12.334 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2024-09-21T07:48:12.334 DEBUG:teuthology.orchestra.run.smithi084:> import re 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> import os 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2024-09-21T07:48:12.335 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> return f 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2024-09-21T07:48:12.336 DEBUG:teuthology.orchestra.run.smithi084:> ' 2024-09-21T07:48:12.496 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.77015.asok 2024-09-21T07:48:12.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:48:12.511 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.77015.asok 2024-09-21T07:48:12.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:12.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.77015.asok status 2024-09-21T07:48:12.757 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:48:12.757 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "77015", 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:48:12.758 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 14877, 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 14877 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-09-21T07:48:12.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3826025574 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3826025574 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.14877 192.168.0.1:0/3826025574", 2024-09-21T07:48:12.760 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/3826025574", 2024-09-21T07:48:12.761 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2024-09-21T07:48:12.761 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 17, 2024-09-21T07:48:12.761 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 84, 2024-09-21T07:48:12.761 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2024-09-21T07:48:12.761 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2024-09-21T07:48:12.761 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2024-09-21T07:48:12.761 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:48:12.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:12.776 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2024-09-21T07:48:12.776 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:12.811 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2024-09-21T07:48:12.812 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:12.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:12.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:12.909 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T07:48:12.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:48:13.023 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2024-09-21T07:48:13.023 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T07:48:13.023 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:13.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:48:13.031 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:48:13.031 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:48:13.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:48:13.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:13 smithi162 ceph-mon[34833]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:13.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:13 smithi084 ceph-mon[30411]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:13 smithi191 ceph-mon[34667]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:13.479 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 -- 172.21.15.84:0/2410728754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 msgr2=0x7f4b80112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2410728754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 0x7f4b80112850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009ca0 tx=0x7f4b7802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 -- 172.21.15.84:0/2410728754 shutdown_connections 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2410728754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 0x7f4b80112850 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2410728754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8010b6d0 0x7f4b8010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2410728754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 0x7f4b801061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 -- 172.21.15.84:0/2410728754 >> 172.21.15.84:0/2410728754 conn(0x7f4b801017c0 msgr2=0x7f4b80103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 -- 172.21.15.84:0/2410728754 shutdown_connections 2024-09-21T07:48:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.089+0000 7f4b85a00640 1 -- 172.21.15.84:0/2410728754 wait complete. 2024-09-21T07:48:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 Processor -- start 2024-09-21T07:48:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 -- start start 2024-09-21T07:48:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 0x7f4b8019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8010b6d0 0x7f4b8019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 0x7f4b801a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80115d30 con 0x7f4b8010c020 2024-09-21T07:48:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80115bb0 con 0x7f4b80105d90 2024-09-21T07:48:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.091+0000 7f4b85a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80115eb0 con 0x7f4b8010b6d0 2024-09-21T07:48:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 0x7f4b801a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 0x7f4b8019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 0x7f4b8019c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48214/0 (socket says 172.21.15.84:48214) 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 -- 172.21.15.84:0/2818629180 learned_addr learned my addr 172.21.15.84:0/2818629180 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b76000640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8010b6d0 0x7f4b8019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 -- 172.21.15.84:0/2818629180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8010b6d0 msgr2=0x7f4b8019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8010b6d0 0x7f4b8019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 -- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 msgr2=0x7f4b801a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 0x7f4b801a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 -- 172.21.15.84:0/2818629180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b801a25d0 con 0x7f4b80105d90 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.092+0000 7f4b7ea00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 0x7f4b8019c660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e9f0 tx=0x7f4b7000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.093+0000 7f4b77e00640 1 -- 172.21.15.84:0/2818629180 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000cd80 con 0x7f4b80105d90 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.093+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b801a28c0 con 0x7f4b80105d90 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.093+0000 7f4b77e00640 1 -- 172.21.15.84:0/2818629180 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b700108e0 con 0x7f4b80105d90 2024-09-21T07:48:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.093+0000 7f4b77e00640 1 -- 172.21.15.84:0/2818629180 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70018980 con 0x7f4b80105d90 2024-09-21T07:48:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.093+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b801a9020 con 0x7f4b80105d90 2024-09-21T07:48:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.094+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b801061a0 con 0x7f4b80105d90 2024-09-21T07:48:14.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.096+0000 7f4b77e00640 1 -- 172.21.15.84:0/2818629180 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f4b70010430 con 0x7f4b80105d90 2024-09-21T07:48:14.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.098+0000 7f4b77e00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4b640b6560 0x7f4b640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:14.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.098+0000 7f4b77e00640 1 -- 172.21.15.84:0/2818629180 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7f4b700e7e90 con 0x7f4b80105d90 2024-09-21T07:48:14.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.098+0000 7f4b76000640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4b640b6560 0x7f4b640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:14.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.099+0000 7f4b76000640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4b640b6560 0x7f4b640b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b80105070 tx=0x7f4b68005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:14.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.100+0000 7f4b77e00640 1 -- 172.21.15.84:0/2818629180 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b700b2790 con 0x7f4b80105d90 2024-09-21T07:48:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.306+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4b8019d790 con 0x7f4b80105d90 2024-09-21T07:48:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.307+0000 7f4b77e00640 1 -- 172.21.15.84:0/2818629180 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v84) ==== 81+0+885 (secure 0 0 0) 0x7f4b700b76d0 con 0x7f4b80105d90 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2305492953 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3844740807 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2263664999 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/1624480162 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/1624480162 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/4171591464 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/963010449 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2499433199 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2887533754 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3074211591 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1079969130 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/4129963413 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:14.310 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/963010449 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:14.310 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/4129963413 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:14.310 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/253258973 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:14.310 INFO:teuthology.orchestra.run.smithi084.stderr:listed 15 entries 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4b640b6560 msgr2=0x7f4b640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4b640b6560 0x7f4b640b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b80105070 tx=0x7f4b68005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 msgr2=0x7f4b8019c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 0x7f4b8019c660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e9f0 tx=0x7f4b7000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 shutdown_connections 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4b640b6560 0x7f4b640b8a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b8010c020 0x7f4b801a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8010b6d0 0x7f4b8019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 --2- 172.21.15.84:0/2818629180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b80105d90 0x7f4b8019c660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 >> 172.21.15.84:0/2818629180 conn(0x7f4b801017c0 msgr2=0x7f4b8010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 shutdown_connections 2024-09-21T07:48:14.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:14.309+0000 7f4b85a00640 1 -- 172.21.15.84:0/2818629180 wait complete. 2024-09-21T07:48:15.061 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:48:15.061 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:48:15.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:48:15.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:15 smithi162 ceph-mon[34833]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:15.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:15 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2818629180' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:48:15.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:15 smithi084 ceph-mon[30411]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:15.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:15 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2818629180' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:48:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:15 smithi191 ceph-mon[34667]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:48:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:15 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2818629180' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:48:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 -- 172.21.15.84:0/3275855427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 msgr2=0x7fbc50109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 --2- 172.21.15.84:0/3275855427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 0x7fbc50109700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009900 tx=0x7fbc3c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 -- 172.21.15.84:0/3275855427 shutdown_connections 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 --2- 172.21.15.84:0/3275855427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc50109c40 0x7fbc50110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 --2- 172.21.15.84:0/3275855427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 0x7fbc50109700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 --2- 172.21.15.84:0/3275855427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc501039b0 0x7fbc50103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 -- 172.21.15.84:0/3275855427 >> 172.21.15.84:0/3275855427 conn(0x7fbc500ff440 msgr2=0x7fbc50101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 -- 172.21.15.84:0/3275855427 shutdown_connections 2024-09-21T07:48:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.241+0000 7fbc55c00640 1 -- 172.21.15.84:0/3275855427 wait complete. 2024-09-21T07:48:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 Processor -- start 2024-09-21T07:48:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 -- start start 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc501039b0 0x7fbc50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 0x7fbc50075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc50109c40 0x7fbc50076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbc50113950 con 0x7fbc501092f0 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc501137d0 con 0x7fbc501039b0 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.242+0000 7fbc55c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc50113ad0 con 0x7fbc50109c40 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc501039b0 0x7fbc50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc501039b0 0x7fbc50075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48232/0 (socket says 172.21.15.84:48232) 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 -- 172.21.15.84:0/1356538211 learned_addr learned my addr 172.21.15.84:0/1356538211 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4f400640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 0x7fbc50075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc55200640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc50109c40 0x7fbc50076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 -- 172.21.15.84:0/1356538211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc50109c40 msgr2=0x7fbc50076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc50109c40 0x7fbc50076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 -- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 msgr2=0x7fbc50075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 0x7fbc50075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.243+0000 7fbc4fe00640 1 -- 172.21.15.84:0/1356538211 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc501a85a0 con 0x7fbc501039b0 2024-09-21T07:48:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.244+0000 7fbc4fe00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc501039b0 0x7fbc50075710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000d770 tx=0x7fbc4000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.244+0000 7fbc4cc00640 1 -- 172.21.15.84:0/1356538211 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40017070 con 0x7fbc501039b0 2024-09-21T07:48:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.244+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc501a8890 con 0x7fbc501039b0 2024-09-21T07:48:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.244+0000 7fbc4cc00640 1 -- 172.21.15.84:0/1356538211 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc400054d0 con 0x7fbc501039b0 2024-09-21T07:48:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.244+0000 7fbc4cc00640 1 -- 172.21.15.84:0/1356538211 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40004c30 con 0x7fbc501039b0 2024-09-21T07:48:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.244+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc501a8da0 con 0x7fbc501039b0 2024-09-21T07:48:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.245+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc50103dc0 con 0x7fbc501039b0 2024-09-21T07:48:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.248+0000 7fbc4cc00640 1 -- 172.21.15.84:0/1356538211 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fbc40004dd0 con 0x7fbc501039b0 2024-09-21T07:48:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.249+0000 7fbc4cc00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc340b6560 0x7fbc340b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.249+0000 7fbc4cc00640 1 -- 172.21.15.84:0/1356538211 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fbc400e7530 con 0x7fbc501039b0 2024-09-21T07:48:16.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.249+0000 7fbc4f400640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc340b6560 0x7fbc340b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.250+0000 7fbc4f400640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc340b6560 0x7fbc340b8a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c02a9e0 tx=0x7fbc3c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.251+0000 7fbc4cc00640 1 -- 172.21.15.84:0/1356538211 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc400b1e30 con 0x7fbc501039b0 2024-09-21T07:48:16.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.452+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbc5002e640 con 0x7fbc501039b0 2024-09-21T07:48:16.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.452+0000 7fbc4cc00640 1 -- 172.21.15.84:0/1356538211 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v84) ==== 81+0+885 (secure 0 0 0) 0x7fbc400b6020 con 0x7fbc501039b0 2024-09-21T07:48:16.454 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2305492953 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:16.454 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3844740807 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2263664999 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/1624480162 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/1624480162 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/4171591464 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/963010449 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2499433199 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2887533754 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3074211591 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1079969130 2024-09-22T07:38:56.444167+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/4129963413 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/963010449 2024-09-22T07:40:29.868163+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/4129963413 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:16.455 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/253258973 2024-09-22T07:39:25.647588+0000 2024-09-21T07:48:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:listed 15 entries 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc340b6560 msgr2=0x7fbc340b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc340b6560 0x7fbc340b8a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c02a9e0 tx=0x7fbc3c005a20 comp rx=0 tx=0).stop 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc501039b0 msgr2=0x7fbc50075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc501039b0 0x7fbc50075710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000d770 tx=0x7fbc4000dc30 comp rx=0 tx=0).stop 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 shutdown_connections 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc340b6560 0x7fbc340b8a70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc50109c40 0x7fbc50076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc501092f0 0x7fbc50075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 --2- 172.21.15.84:0/1356538211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc501039b0 0x7fbc50075710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:16.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 >> 172.21.15.84:0/1356538211 conn(0x7fbc500ff440 msgr2=0x7fbc50101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:16.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 shutdown_connections 2024-09-21T07:48:16.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:16.456+0000 7fbc55c00640 1 -- 172.21.15.84:0/1356538211 wait complete. 2024-09-21T07:48:17.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:17 smithi084 ceph-mon[30411]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:17.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:17 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1356538211' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:48:17.201 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2024-09-21T07:48:17.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:17.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T07:48:17.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[77015]: fuse finished with error 0 and tester_r 0 2024-09-21T07:48:17.263 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:48:17.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:17 smithi162 ceph-mon[34833]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:17.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:17 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1356538211' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:48:17.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:17 smithi191 ceph-mon[34667]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:17 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1356538211' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:48:19.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:19 smithi084 ceph-mon[30411]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:19 smithi191 ceph-mon[34667]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:19 smithi162 ceph-mon[34833]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:21 smithi191 ceph-mon[34667]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:21.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:21 smithi162 ceph-mon[34833]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:21.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:21 smithi084 ceph-mon[30411]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T07:48:23.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T07:48:23.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:48:23.365 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T07:48:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:23 smithi191 ceph-mon[34667]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:23.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:48:23.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:23 smithi084 ceph-mon[30411]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:23 smithi162 ceph-mon[34833]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:23.791 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.413+0000 7fb62f200640 1 -- 172.21.15.84:0/3161147851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb628105db0 msgr2=0x7fb6281061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.413+0000 7fb62f200640 1 --2- 172.21.15.84:0/3161147851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb628105db0 0x7fb6281061c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb618009900 tx=0x7fb61802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.413+0000 7fb62f200640 1 -- 172.21.15.84:0/3161147851 shutdown_connections 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.413+0000 7fb62f200640 1 --2- 172.21.15.84:0/3161147851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb62810c040 0x7fb628112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.413+0000 7fb62f200640 1 --2- 172.21.15.84:0/3161147851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb62810b6f0 0x7fb62810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.413+0000 7fb62f200640 1 --2- 172.21.15.84:0/3161147851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb628105db0 0x7fb6281061c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.413+0000 7fb62f200640 1 -- 172.21.15.84:0/3161147851 >> 172.21.15.84:0/3161147851 conn(0x7fb6281017c0 msgr2=0x7fb628103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.414+0000 7fb62f200640 1 -- 172.21.15.84:0/3161147851 shutdown_connections 2024-09-21T07:48:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.414+0000 7fb62f200640 1 -- 172.21.15.84:0/3161147851 wait complete. 2024-09-21T07:48:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 Processor -- start 2024-09-21T07:48:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 -- start start 2024-09-21T07:48:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb628105db0 0x7fb62819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb62810b6f0 0x7fb62819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb62810c040 0x7fb6281a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb628115d50 con 0x7fb62810c040 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb628115bd0 con 0x7fb62810b6f0 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb62f200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb628115ed0 con 0x7fb628105db0 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb627e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb628105db0 0x7fb62819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb627e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb628105db0 0x7fb62819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35404/0 (socket says 172.21.15.84:35404) 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.415+0000 7fb627e00640 1 -- 172.21.15.84:0/1931263985 learned_addr learned my addr 172.21.15.84:0/1931263985 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb62d200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb62810c040 0x7fb6281a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb627400640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb62810b6f0 0x7fb62819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb627e00640 1 -- 172.21.15.84:0/1931263985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb62810b6f0 msgr2=0x7fb62819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb627e00640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb62810b6f0 0x7fb62819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb627e00640 1 -- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb62810c040 msgr2=0x7fb6281a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb627e00640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb62810c040 0x7fb6281a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb627e00640 1 -- 172.21.15.84:0/1931263985 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6281a2610 con 0x7fb628105db0 2024-09-21T07:48:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb62d200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb62810c040 0x7fb6281a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.416+0000 7fb627e00640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb628105db0 0x7fb62819c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb618005ab0 tx=0x7fb618003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.417+0000 7fb624c00640 1 -- 172.21.15.84:0/1931263985 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61803f070 con 0x7fb628105db0 2024-09-21T07:48:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.417+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6281a28a0 con 0x7fb628105db0 2024-09-21T07:48:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.417+0000 7fb624c00640 1 -- 172.21.15.84:0/1931263985 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb618031b60 con 0x7fb628105db0 2024-09-21T07:48:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.417+0000 7fb624c00640 1 -- 172.21.15.84:0/1931263985 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618035030 con 0x7fb628105db0 2024-09-21T07:48:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.417+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6281a9060 con 0x7fb628105db0 2024-09-21T07:48:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.418+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb628107030 con 0x7fb628105db0 2024-09-21T07:48:24.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.421+0000 7fb624c00640 1 -- 172.21.15.84:0/1931263985 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb618042070 con 0x7fb628105db0 2024-09-21T07:48:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.422+0000 7fb624c00640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb60c0b6560 0x7fb60c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.422+0000 7fb624c00640 1 -- 172.21.15.84:0/1931263985 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fb618108480 con 0x7fb628105db0 2024-09-21T07:48:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.422+0000 7fb627400640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb60c0b6560 0x7fb60c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:24.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.423+0000 7fb627400640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb60c0b6560 0x7fb60c0b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb6140095f0 tx=0x7fb614005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:24.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.424+0000 7fb624c00640 1 -- 172.21.15.84:0/1931263985 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6180d2d80 con 0x7fb628105db0 2024-09-21T07:48:24.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.612+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb62810de40 con 0x7fb628105db0 2024-09-21T07:48:24.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.614+0000 7fb624c00640 1 -- 172.21.15.84:0/1931263985 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24551 (secure 0 0 0) 0x7fb6180d7cc0 con 0x7fb628105db0 2024-09-21T07:48:24.616 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:24.616 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:47:53.806970+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:48:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb60c0b6560 msgr2=0x7fb60c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb60c0b6560 0x7fb60c0b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb6140095f0 tx=0x7fb614005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb628105db0 msgr2=0x7fb62819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb628105db0 0x7fb62819c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb618005ab0 tx=0x7fb618003c10 comp rx=0 tx=0).stop 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 shutdown_connections 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb60c0b6560 0x7fb60c0b8a70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb62810c040 0x7fb6281a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb62810b6f0 0x7fb62819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 --2- 172.21.15.84:0/1931263985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb628105db0 0x7fb62819c6a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 >> 172.21.15.84:0/1931263985 conn(0x7fb6281017c0 msgr2=0x7fb62810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 shutdown_connections 2024-09-21T07:48:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:24.617+0000 7fb62f200640 1 -- 172.21.15.84:0/1931263985 wait complete. 2024-09-21T07:48:25.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:25 smithi084 ceph-mon[30411]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:25.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:25 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1931263985' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:25.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:48:25.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:25 smithi191 ceph-mon[34667]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:25 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1931263985' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:25.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:25 smithi162 ceph-mon[34833]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:25.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:25 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1931263985' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 -- 172.21.15.84:0/1566553443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b8109c40 msgr2=0x7fc8b8110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1566553443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b8109c40 0x7fc8b8110470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009ca0 tx=0x7fc8b002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 -- 172.21.15.84:0/1566553443 shutdown_connections 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1566553443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b8109c40 0x7fc8b8110470 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1566553443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8b81092f0 0x7fc8b8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1566553443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b81039b0 0x7fc8b8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 -- 172.21.15.84:0/1566553443 >> 172.21.15.84:0/1566553443 conn(0x7fc8b80ff440 msgr2=0x7fc8b8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 -- 172.21.15.84:0/1566553443 shutdown_connections 2024-09-21T07:48:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.572+0000 7fc8bd400640 1 -- 172.21.15.84:0/1566553443 wait complete. 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.573+0000 7fc8bd400640 1 Processor -- start 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.573+0000 7fc8bd400640 1 -- start start 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8bd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b81039b0 0x7fc8b819c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8bd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b81092f0 0x7fc8b819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8bd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8b8109c40 0x7fc8b81a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8bd400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8113900 con 0x7fc8b81039b0 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8bd400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8113780 con 0x7fc8b81092f0 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8bd400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8113a80 con 0x7fc8b8109c40 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b81039b0 0x7fc8b819c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b81039b0 0x7fc8b819c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56892/0 (socket says 172.21.15.84:56892) 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8b7e00640 1 -- 172.21.15.84:0/1122152500 learned_addr learned my addr 172.21.15.84:0/1122152500 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8afe00640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b81092f0 0x7fc8b819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.574+0000 7fc8bca00640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8b8109c40 0x7fc8b81a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b7e00640 1 -- 172.21.15.84:0/1122152500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8b8109c40 msgr2=0x7fc8b81a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b7e00640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8b8109c40 0x7fc8b81a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b7e00640 1 -- 172.21.15.84:0/1122152500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b81092f0 msgr2=0x7fc8b819cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b7e00640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b81092f0 0x7fc8b819cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b7e00640 1 -- 172.21.15.84:0/1122152500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b81a2480 con 0x7fc8b81039b0 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b7e00640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b81039b0 0x7fc8b819c510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800e9f0 tx=0x7fc8a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b5600640 1 -- 172.21.15.84:0/1122152500 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a800cd80 con 0x7fc8b81039b0 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b5600640 1 -- 172.21.15.84:0/1122152500 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a80108e0 con 0x7fc8b81039b0 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8b5600640 1 -- 172.21.15.84:0/1122152500 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8018980 con 0x7fc8b81039b0 2024-09-21T07:48:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b81a2770 con 0x7fc8b81039b0 2024-09-21T07:48:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.575+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b81a8ed0 con 0x7fc8b81039b0 2024-09-21T07:48:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.576+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b8103dc0 con 0x7fc8b81039b0 2024-09-21T07:48:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.579+0000 7fc8b5600640 1 -- 172.21.15.84:0/1122152500 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc8a8010430 con 0x7fc8b81039b0 2024-09-21T07:48:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.580+0000 7fc8b5600640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc89c0b6560 0x7fc89c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.580+0000 7fc8b5600640 1 -- 172.21.15.84:0/1122152500 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fc8a80e7ac0 con 0x7fc8b81039b0 2024-09-21T07:48:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.580+0000 7fc8afe00640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc89c0b6560 0x7fc89c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.581+0000 7fc8afe00640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc89c0b6560 0x7fc89c0b8a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8109b10 tx=0x7fc8a0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.584+0000 7fc8b5600640 1 -- 172.21.15.84:0/1122152500 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8a80adfe0 con 0x7fc8b81039b0 2024-09-21T07:48:26.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.772+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8b81a91a0 con 0x7fc8b81039b0 2024-09-21T07:48:26.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.774+0000 7fc8b5600640 1 -- 172.21.15.84:0/1122152500 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24551 (secure 0 0 0) 0x7fc8a80b23c0 con 0x7fc8b81039b0 2024-09-21T07:48:26.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:26.776 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:47:53.806970+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc89c0b6560 msgr2=0x7fc89c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc89c0b6560 0x7fc89c0b8a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8109b10 tx=0x7fc8a0005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b81039b0 msgr2=0x7fc8b819c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b81039b0 0x7fc8b819c510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800e9f0 tx=0x7fc8a800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 shutdown_connections 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc89c0b6560 0x7fc89c0b8a70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8b8109c40 0x7fc8b81a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b81092f0 0x7fc8b819cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 --2- 172.21.15.84:0/1122152500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8b81039b0 0x7fc8b819c510 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:26.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.776+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 >> 172.21.15.84:0/1122152500 conn(0x7fc8b80ff440 msgr2=0x7fc8b8107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:26.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.777+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 shutdown_connections 2024-09-21T07:48:26.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:26.777+0000 7fc8bd400640 1 -- 172.21.15.84:0/1122152500 wait complete. 2024-09-21T07:48:27.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:27 smithi191 ceph-mon[34667]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:27.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:27 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1122152500' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:27.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:27 smithi084 ceph-mon[30411]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:27.432 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:27 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1122152500' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:27.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:48:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:27 smithi162 ceph-mon[34833]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T07:48:27.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:27 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1122152500' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:27.842 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.471+0000 7fc815600640 1 -- 172.21.15.84:0/1603223187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc810105bb0 msgr2=0x7fc810105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.471+0000 7fc815600640 1 --2- 172.21.15.84:0/1603223187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc810105bb0 0x7fc810105fc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc800009900 tx=0x7fc80002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.472+0000 7fc815600640 1 -- 172.21.15.84:0/1603223187 shutdown_connections 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.472+0000 7fc815600640 1 --2- 172.21.15.84:0/1603223187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc81010be40 0x7fc810112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.472+0000 7fc815600640 1 --2- 172.21.15.84:0/1603223187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc81010b4f0 0x7fc81010b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.472+0000 7fc815600640 1 --2- 172.21.15.84:0/1603223187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc810105bb0 0x7fc810105fc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.472+0000 7fc815600640 1 -- 172.21.15.84:0/1603223187 >> 172.21.15.84:0/1603223187 conn(0x7fc810101680 msgr2=0x7fc810103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.472+0000 7fc815600640 1 -- 172.21.15.84:0/1603223187 shutdown_connections 2024-09-21T07:48:28.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.472+0000 7fc815600640 1 -- 172.21.15.84:0/1603223187 wait complete. 2024-09-21T07:48:28.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 Processor -- start 2024-09-21T07:48:28.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 -- start start 2024-09-21T07:48:28.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc810105bb0 0x7fc81019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc81010b4f0 0x7fc81019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81010be40 0x7fc8101a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc810115b00 con 0x7fc81010be40 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc810115980 con 0x7fc810105bb0 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.473+0000 7fc815600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc810115c80 con 0x7fc81010b4f0 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81010be40 0x7fc8101a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc80fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc810105bb0 0x7fc81019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81010be40 0x7fc8101a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36740/0 (socket says 172.21.15.84:36740) 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 -- 172.21.15.84:0/2593365219 learned_addr learned my addr 172.21.15.84:0/2593365219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:28.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc80f400640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc81010b4f0 0x7fc81019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:28.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 -- 172.21.15.84:0/2593365219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc81010b4f0 msgr2=0x7fc81019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:28.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc81010b4f0 0x7fc81019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:28.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 -- 172.21.15.84:0/2593365219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc810105bb0 msgr2=0x7fc81019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:28.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc810105bb0 0x7fc81019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:28.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 -- 172.21.15.84:0/2593365219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8101a2520 con 0x7fc81010be40 2024-09-21T07:48:28.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc80fe00640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc810105bb0 0x7fc81019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:28.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.474+0000 7fc814c00640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81010be40 0x7fc8101a1df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc80800efd0 tx=0x7fc80800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:28.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.475+0000 7fc80cc00640 1 -- 172.21.15.84:0/2593365219 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808003b70 con 0x7fc81010be40 2024-09-21T07:48:28.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.475+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8101a2810 con 0x7fc81010be40 2024-09-21T07:48:28.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.475+0000 7fc80cc00640 1 -- 172.21.15.84:0/2593365219 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc808003d10 con 0x7fc81010be40 2024-09-21T07:48:28.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.475+0000 7fc80cc00640 1 -- 172.21.15.84:0/2593365219 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8080108a0 con 0x7fc81010be40 2024-09-21T07:48:28.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.475+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8101a8f70 con 0x7fc81010be40 2024-09-21T07:48:28.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.476+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc810105fc0 con 0x7fc81010be40 2024-09-21T07:48:28.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.478+0000 7fc80cc00640 1 -- 172.21.15.84:0/2593365219 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc808004b40 con 0x7fc81010be40 2024-09-21T07:48:28.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.480+0000 7fc80cc00640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7f40b6560 0x7fc7f40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:28.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.480+0000 7fc80cc00640 1 -- 172.21.15.84:0/2593365219 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9017+0+0 (secure 0 0 0) 0x7fc8080e7e10 con 0x7fc81010be40 2024-09-21T07:48:28.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.480+0000 7fc80fe00640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7f40b6560 0x7fc7f40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:28.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.481+0000 7fc80fe00640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7f40b6560 0x7fc7f40b8a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc800031440 tx=0x7fc800032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.482+0000 7fc80cc00640 1 -- 172.21.15.84:0/2593365219 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8080ae330 con 0x7fc81010be40 2024-09-21T07:48:28.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:28.706+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc81019d6e0 con 0x7fc81010be40 2024-09-21T07:48:29.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.069+0000 7fc80cc00640 1 -- 172.21.15.84:0/2593365219 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fc81019d6e0 con 0x7fc81010be40 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7f40b6560 msgr2=0x7fc7f40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7f40b6560 0x7fc7f40b8a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc800031440 tx=0x7fc800032ed0 comp rx=0 tx=0).stop 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81010be40 msgr2=0x7fc8101a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81010be40 0x7fc8101a1df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc80800efd0 tx=0x7fc80800c6a0 comp rx=0 tx=0).stop 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 shutdown_connections 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7f40b6560 0x7fc7f40b8a70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81010be40 0x7fc8101a1df0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc81010b4f0 0x7fc81019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 --2- 172.21.15.84:0/2593365219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc810105bb0 0x7fc81019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 >> 172.21.15.84:0/2593365219 conn(0x7fc810101680 msgr2=0x7fc810103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:29.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 shutdown_connections 2024-09-21T07:48:29.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:29.072+0000 7fc815600640 1 -- 172.21.15.84:0/2593365219 wait complete. 2024-09-21T07:48:29.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:29 smithi191 ceph-mon[34667]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:48:29.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:29 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2593365219' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:48:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:29 smithi084 ceph-mon[30411]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:48:29.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:29 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2593365219' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:48:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:29 smithi162 ceph-mon[34833]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:48:29.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:29 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2593365219' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:48:29.813 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-21T07:48:29.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T07:48:30.190 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2593365219' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]} : dispatch 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]} : dispatch 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]} : dispatch 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:48:30.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T07:48:30.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2593365219' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T07:48:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-09-21T07:48:30.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2593365219' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T07:48:30.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.817+0000 7f7804a00640 1 -- 172.21.15.84:0/973258661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78001023e0 msgr2=0x7f78001027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.817+0000 7f7804a00640 1 --2- 172.21.15.84:0/973258661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78001023e0 0x7f78001027f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009900 tx=0x7f77f002a480 comp rx=0 tx=0).stop 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.818+0000 7f7804a00640 1 -- 172.21.15.84:0/973258661 shutdown_connections 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.818+0000 7f7804a00640 1 --2- 172.21.15.84:0/973258661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f780010ff90 0x7f78001123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.818+0000 7f7804a00640 1 --2- 172.21.15.84:0/973258661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7800102d30 0x7f780010fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.818+0000 7f7804a00640 1 --2- 172.21.15.84:0/973258661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78001023e0 0x7f78001027f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.818+0000 7f7804a00640 1 -- 172.21.15.84:0/973258661 >> 172.21.15.84:0/973258661 conn(0x7f78000fe2c0 msgr2=0x7f7800100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.818+0000 7f7804a00640 1 -- 172.21.15.84:0/973258661 shutdown_connections 2024-09-21T07:48:30.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.818+0000 7f7804a00640 1 -- 172.21.15.84:0/973258661 wait complete. 2024-09-21T07:48:30.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.819+0000 7f7804a00640 1 Processor -- start 2024-09-21T07:48:30.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.819+0000 7f7804a00640 1 -- start start 2024-09-21T07:48:30.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.819+0000 7f7804a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78001023e0 0x7f780019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:30.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f7804a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7800102d30 0x7f780019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:30.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f7804a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780010ff90 0x7f78001a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:30.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f7804a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7800115a80 con 0x7f780010ff90 2024-09-21T07:48:30.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f7804a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7800115900 con 0x7f78001023e0 2024-09-21T07:48:30.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f7804a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7800115c00 con 0x7f7800102d30 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780010ff90 0x7f78001a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780010ff90 0x7f78001a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36760/0 (socket says 172.21.15.84:36760) 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78001023e0 0x7f780019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 -- 172.21.15.84:0/1696365607 learned_addr learned my addr 172.21.15.84:0/1696365607 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77fde00640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7800102d30 0x7f780019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 -- 172.21.15.84:0/1696365607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7800102d30 msgr2=0x7f780019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7800102d30 0x7f780019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:30.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 -- 172.21.15.84:0/1696365607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78001023e0 msgr2=0x7f780019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78001023e0 0x7f780019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.820+0000 7f77ff200640 1 -- 172.21.15.84:0/1696365607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78001a23e0 con 0x7f780010ff90 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.821+0000 7f77ff200640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780010ff90 0x7f78001a1cb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77f800eb10 tx=0x7f77f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.821+0000 7f77f7400640 1 -- 172.21.15.84:0/1696365607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8004b20 con 0x7f780010ff90 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.821+0000 7f77f7400640 1 -- 172.21.15.84:0/1696365607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f8004cc0 con 0x7f780010ff90 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.821+0000 7f77f7400640 1 -- 172.21.15.84:0/1696365607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8010670 con 0x7f780010ff90 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.821+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78001a26d0 con 0x7f780010ff90 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.821+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78001a8e30 con 0x7f780010ff90 2024-09-21T07:48:30.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.823+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78001027f0 con 0x7f780010ff90 2024-09-21T07:48:30.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.827+0000 7f77f7400640 1 -- 172.21.15.84:0/1696365607 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f77f8005000 con 0x7f780010ff90 2024-09-21T07:48:30.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.828+0000 7f77f7400640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77e40b65e0 0x7f77e40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:30.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.828+0000 7f77f7400640 1 -- 172.21.15.84:0/1696365607 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9286+0+0 (secure 0 0 0) 0x7f77f80e7ea0 con 0x7f780010ff90 2024-09-21T07:48:30.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.828+0000 7f77fe800640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77e40b65e0 0x7f77e40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:30.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.829+0000 7f77fe800640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77e40b65e0 0x7f77e40b8af0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77f0031440 tx=0x7f77f0009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:30.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:30.830+0000 7f77f7400640 1 -- 172.21.15.84:0/1696365607 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77f80ae3a0 con 0x7f780010ff90 2024-09-21T07:48:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.058+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f780010b180 con 0x7f780010ff90 2024-09-21T07:48:31.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.090+0000 7f77f7400640 1 -- 172.21.15.84:0/1696365607 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f77f80b2780 con 0x7f780010ff90 2024-09-21T07:48:31.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.093+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77e40b65e0 msgr2=0x7f77e40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.093+0000 7f7804a00640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77e40b65e0 0x7f77e40b8af0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77f0031440 tx=0x7f77f0009560 comp rx=0 tx=0).stop 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.093+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780010ff90 msgr2=0x7f78001a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.093+0000 7f7804a00640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780010ff90 0x7f78001a1cb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77f800eb10 tx=0x7f77f800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.093+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 shutdown_connections 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.094+0000 7f7804a00640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77e40b65e0 0x7f77e40b8af0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.094+0000 7f7804a00640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780010ff90 0x7f78001a1cb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.094+0000 7f7804a00640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7800102d30 0x7f780019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.094+0000 7f7804a00640 1 --2- 172.21.15.84:0/1696365607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78001023e0 0x7f780019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.094+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 >> 172.21.15.84:0/1696365607 conn(0x7f78000fe2c0 msgr2=0x7f7800112140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.094+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 shutdown_connections 2024-09-21T07:48:31.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:31.094+0000 7f7804a00640 1 -- 172.21.15.84:0/1696365607 wait complete. 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]}]': finished 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:48:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T07:48:31.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-21T07:48:31.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T07:48:31.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:31 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1696365607' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:48:31.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T07:48:31.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:31 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1696365607' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:48:31.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8, 5, 9]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T07:48:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:31 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1696365607' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:48:31.838 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T07:48:32.213 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:32.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:32 smithi084 ceph-mon[30411]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:48:32.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:32 smithi084 ceph-mon[30411]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T07:48:32.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:32 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1696365607' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:48:32.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:32 smithi084 ceph-mon[30411]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:48:32.351 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:32 smithi084 ceph-mon[30411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:48:32.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:32 smithi084 ceph-mon[30411]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T07:48:32.352 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:32 smithi084 ceph-mon[30411]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T07:48:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:32 smithi191 ceph-mon[34667]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:48:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:32 smithi191 ceph-mon[34667]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T07:48:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:32 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1696365607' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:48:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:32 smithi191 ceph-mon[34667]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:48:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:32 smithi191 ceph-mon[34667]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:48:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:32 smithi191 ceph-mon[34667]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T07:48:32.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:32 smithi191 ceph-mon[34667]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T07:48:32.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:32 smithi162 ceph-mon[34833]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:48:32.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:32 smithi162 ceph-mon[34833]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T07:48:32.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:32 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1696365607' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:48:32.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:32 smithi162 ceph-mon[34833]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:48:32.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:32 smithi162 ceph-mon[34833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:48:32.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:32 smithi162 ceph-mon[34833]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T07:48:32.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:32 smithi162 ceph-mon[34833]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T07:48:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 -- 172.21.15.84:0/3641730474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 msgr2=0x7fdf04075b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/3641730474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf04075b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009900 tx=0x7fdef802a410 comp rx=0 tx=0).stop 2024-09-21T07:48:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 -- 172.21.15.84:0/3641730474 shutdown_connections 2024-09-21T07:48:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/3641730474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf0410ff50 0x7fdf04112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/3641730474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf040760a0 0x7fdf0410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/3641730474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf04075b60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 -- 172.21.15.84:0/3641730474 >> 172.21.15.84:0/3641730474 conn(0x7fdf040ff3e0 msgr2=0x7fdf04101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 -- 172.21.15.84:0/3641730474 shutdown_connections 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.862+0000 7fdf0ae00640 1 -- 172.21.15.84:0/3641730474 wait complete. 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.863+0000 7fdf0ae00640 1 Processor -- start 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.863+0000 7fdf0ae00640 1 -- start start 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf0ae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf0419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf0ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf040760a0 0x7fdf0419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf0ae00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf0410ff50 0x7fdf041a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf0ae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04115ac0 con 0x7fdf04075750 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf0ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04115940 con 0x7fdf040760a0 2024-09-21T07:48:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf0ae00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04115c40 con 0x7fdf0410ff50 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf09a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf0419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf09a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf0419c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36770/0 (socket says 172.21.15.84:36770) 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf09a00640 1 -- 172.21.15.84:0/4053214563 learned_addr learned my addr 172.21.15.84:0/4053214563 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf09000640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf040760a0 0x7fdf0419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.864+0000 7fdf0a400640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf0410ff50 0x7fdf041a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf09a00640 1 -- 172.21.15.84:0/4053214563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf0410ff50 msgr2=0x7fdf041a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf09a00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf0410ff50 0x7fdf041a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf09a00640 1 -- 172.21.15.84:0/4053214563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf040760a0 msgr2=0x7fdf0419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf09a00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf040760a0 0x7fdf0419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf09a00640 1 -- 172.21.15.84:0/4053214563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf041a2480 con 0x7fdf04075750 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf09a00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf0419c510 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdef8005940 tx=0x7fdef80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf02000640 1 -- 172.21.15.84:0/4053214563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef803f030 con 0x7fdf04075750 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf02000640 1 -- 172.21.15.84:0/4053214563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdef8003cb0 con 0x7fdf04075750 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf02000640 1 -- 172.21.15.84:0/4053214563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8035070 con 0x7fdf04075750 2024-09-21T07:48:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.865+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf041a2710 con 0x7fdf04075750 2024-09-21T07:48:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.866+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf041a8ed0 con 0x7fdf04075750 2024-09-21T07:48:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.867+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf04076c60 con 0x7fdf04075750 2024-09-21T07:48:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.869+0000 7fdf02000640 1 -- 172.21.15.84:0/4053214563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fdef8042030 con 0x7fdf04075750 2024-09-21T07:48:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.871+0000 7fdf02000640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdeec0b65e0 0x7fdeec0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.871+0000 7fdf02000640 1 -- 172.21.15.84:0/4053214563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fdef81081d0 con 0x7fdf04075750 2024-09-21T07:48:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.871+0000 7fdf09000640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdeec0b65e0 0x7fdeec0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.872+0000 7fdf09000640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdeec0b65e0 0x7fdeec0b8af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf04112450 tx=0x7fdef000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:32.873+0000 7fdf02000640 1 -- 172.21.15.84:0/4053214563 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdef80d29c0 con 0x7fdf04075750 2024-09-21T07:48:33.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.099+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fdf041a9150 con 0x7fdf04075750 2024-09-21T07:48:33.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.115+0000 7fdf02000640 1 -- 172.21.15.84:0/4053214563 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fdef80d7900 con 0x7fdf04075750 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdeec0b65e0 msgr2=0x7fdeec0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdeec0b65e0 0x7fdeec0b8af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf04112450 tx=0x7fdef000b410 comp rx=0 tx=0).stop 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 msgr2=0x7fdf0419c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf0419c510 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdef8005940 tx=0x7fdef80042f0 comp rx=0 tx=0).stop 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 shutdown_connections 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdeec0b65e0 0x7fdeec0b8af0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf0410ff50 0x7fdf041a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf040760a0 0x7fdf0419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:33.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 --2- 172.21.15.84:0/4053214563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf04075750 0x7fdf0419c510 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:33.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 >> 172.21.15.84:0/4053214563 conn(0x7fdf040ff3e0 msgr2=0x7fdf041089e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:33.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 shutdown_connections 2024-09-21T07:48:33.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:33.118+0000 7fdf0ae00640 1 -- 172.21.15.84:0/4053214563 wait complete. 2024-09-21T07:48:33.380 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:33 smithi084 ceph-mon[30411]: pgmap v315: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T07:48:33.380 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:33 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] up:active 2024-09-21T07:48:33.380 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:33 smithi084 ceph-mon[30411]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:48:33.380 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:33 smithi084 ceph-mon[30411]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T07:48:33.380 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:33 smithi084 ceph-mon[30411]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T07:48:33.380 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:33 smithi084 ceph-mon[30411]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T07:48:33.380 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:33 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4053214563' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:48:33.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:33 smithi191 ceph-mon[34667]: pgmap v315: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T07:48:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:33 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] up:active 2024-09-21T07:48:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:33 smithi191 ceph-mon[34667]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:48:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:33 smithi191 ceph-mon[34667]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T07:48:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:33 smithi191 ceph-mon[34667]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T07:48:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:33 smithi191 ceph-mon[34667]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T07:48:33.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:33 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4053214563' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:48:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:33 smithi162 ceph-mon[34833]: pgmap v315: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T07:48:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:33 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] up:active 2024-09-21T07:48:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:33 smithi162 ceph-mon[34833]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:48:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:33 smithi162 ceph-mon[34833]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T07:48:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:33 smithi162 ceph-mon[34833]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T07:48:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:33 smithi162 ceph-mon[34833]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T07:48:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:33 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4053214563' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:48:33.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T07:48:34.272 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:34.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:34 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4053214563' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:48:34.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:34 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] up:active 2024-09-21T07:48:34.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:34 smithi191 ceph-mon[34667]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:48:34.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:34 smithi191 ceph-mon[34667]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T07:48:34.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:34 smithi191 ceph-mon[34667]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-21T07:48:34.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:34 smithi191 ceph-mon[34667]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-21T07:48:34.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:34 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4053214563' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:48:34.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:34 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] up:active 2024-09-21T07:48:34.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:34 smithi084 ceph-mon[30411]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:48:34.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:34 smithi084 ceph-mon[30411]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T07:48:34.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:34 smithi084 ceph-mon[30411]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-21T07:48:34.411 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:34 smithi084 ceph-mon[30411]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-21T07:48:34.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:34 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4053214563' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:48:34.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:34 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] up:active 2024-09-21T07:48:34.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:34 smithi162 ceph-mon[34833]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:48:34.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:34 smithi162 ceph-mon[34833]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T07:48:34.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:34 smithi162 ceph-mon[34833]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-21T07:48:34.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:34 smithi162 ceph-mon[34833]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-21T07:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 -- 172.21.15.84:0/1246213332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600114570 msgr2=0x7f1600116990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 --2- 172.21.15.84:0/1246213332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600114570 0x7f1600116990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009ca0 tx=0x7f15f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 -- 172.21.15.84:0/1246213332 shutdown_connections 2024-09-21T07:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 --2- 172.21.15.84:0/1246213332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600114570 0x7f1600116990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 --2- 172.21.15.84:0/1246213332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1600078290 0x7f1600114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 --2- 172.21.15.84:0/1246213332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1600077940 0x7f1600077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 -- 172.21.15.84:0/1246213332 >> 172.21.15.84:0/1246213332 conn(0x7f1600101680 msgr2=0x7f1600103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 -- 172.21.15.84:0/1246213332 shutdown_connections 2024-09-21T07:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.859+0000 7f15ff200640 1 -- 172.21.15.84:0/1246213332 wait complete. 2024-09-21T07:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.860+0000 7f15ff200640 1 Processor -- start 2024-09-21T07:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.860+0000 7f15ff200640 1 -- start start 2024-09-21T07:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.860+0000 7f15ff200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600077940 0x7f16001a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.860+0000 7f15ff200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1600078290 0x7f16001a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.860+0000 7f15ff200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1600114570 0x7f16001a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15ff200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1600119ed0 con 0x7f1600077940 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15ff200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1600119d50 con 0x7f1600114570 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15ff200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f160011a050 con 0x7f1600078290 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600077940 0x7f16001a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600077940 0x7f16001a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36796/0 (socket says 172.21.15.84:36796) 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 -- 172.21.15.84:0/1441243719 learned_addr learned my addr 172.21.15.84:0/1441243719 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fd400640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1600078290 0x7f16001a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fe800640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1600114570 0x7f16001a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 -- 172.21.15.84:0/1441243719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1600078290 msgr2=0x7f16001a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1600078290 0x7f16001a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 -- 172.21.15.84:0/1441243719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1600114570 msgr2=0x7f16001a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1600114570 0x7f16001a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.861+0000 7f15fde00640 1 -- 172.21.15.84:0/1441243719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16001a67f0 con 0x7f1600077940 2024-09-21T07:48:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.862+0000 7f15fde00640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600077940 0x7f16001a0880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f15f000d950 tx=0x7f15f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.862+0000 7f15f6a00640 1 -- 172.21.15.84:0/1441243719 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0017030 con 0x7f1600077940 2024-09-21T07:48:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.862+0000 7f15f6a00640 1 -- 172.21.15.84:0/1441243719 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15f0004020 con 0x7f1600077940 2024-09-21T07:48:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.862+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16001a6ae0 con 0x7f1600077940 2024-09-21T07:48:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.862+0000 7f15f6a00640 1 -- 172.21.15.84:0/1441243719 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f00047a0 con 0x7f1600077940 2024-09-21T07:48:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.862+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16001ad240 con 0x7f1600077940 2024-09-21T07:48:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.863+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1600077d50 con 0x7f1600077940 2024-09-21T07:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.866+0000 7f15f6a00640 1 -- 172.21.15.84:0/1441243719 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f15f0009a30 con 0x7f1600077940 2024-09-21T07:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.867+0000 7f15f6a00640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15e40b6560 0x7f15e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.867+0000 7f15f6a00640 1 -- 172.21.15.84:0/1441243719 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f15f00e7870 con 0x7f1600077940 2024-09-21T07:48:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.867+0000 7f15fd400640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15e40b6560 0x7f15e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.868+0000 7f15fd400640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15e40b6560 0x7f15e40b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1600079ac0 tx=0x7f15ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:34.869+0000 7f15f6a00640 1 -- 172.21.15.84:0/1441243719 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15f00adc80 con 0x7f1600077940 2024-09-21T07:48:35.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.094+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f160002e640 con 0x7f1600077940 2024-09-21T07:48:35.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.136+0000 7f15f6a00640 1 -- 172.21.15.84:0/1441243719 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7f15f00b2060 con 0x7f1600077940 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15e40b6560 msgr2=0x7f15e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15e40b6560 0x7f15e40b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1600079ac0 tx=0x7f15ec005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600077940 msgr2=0x7f16001a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600077940 0x7f16001a0880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f15f000d950 tx=0x7f15f000de10 comp rx=0 tx=0).stop 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 shutdown_connections 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15e40b6560 0x7f15e40b8a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1600114570 0x7f16001a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1600078290 0x7f16001a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 --2- 172.21.15.84:0/1441243719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600077940 0x7f16001a0880 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 >> 172.21.15.84:0/1441243719 conn(0x7f1600101680 msgr2=0x7f16001165f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 shutdown_connections 2024-09-21T07:48:35.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:35.139+0000 7f15ff200640 1 -- 172.21.15.84:0/1441243719 wait complete. 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: pgmap v316: 129 pgs: 3 peering, 126 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 3 op/s 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] up:active 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: Cluster is now healthy 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T07:48:35.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1441243719' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:48:35.487 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: pgmap v316: 129 pgs: 3 peering, 126 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 3 op/s 2024-09-21T07:48:35.487 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] up:active 2024-09-21T07:48:35.487 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:48:35.487 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:48:35.487 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: Cluster is now healthy 2024-09-21T07:48:35.488 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-21T07:48:35.488 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:48:35.488 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T07:48:35.488 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1441243719' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:48:35.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: pgmap v316: 129 pgs: 3 peering, 126 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 3 op/s 2024-09-21T07:48:35.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] up:active 2024-09-21T07:48:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:48:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:48:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: Cluster is now healthy 2024-09-21T07:48:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-21T07:48:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:48:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T07:48:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1441243719' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:48:35.886 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-21T07:48:35.886 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T07:48:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:36 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1441243719' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:48:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:36 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] up:active 2024-09-21T07:48:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:36 smithi191 ceph-mon[34667]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:48:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:36 smithi191 ceph-mon[34667]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:48:36.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:36 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:48:36.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:36 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1441243719' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:48:36.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:36 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] up:active 2024-09-21T07:48:36.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:36 smithi084 ceph-mon[30411]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:48:36.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:36 smithi084 ceph-mon[30411]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:48:36.422 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:36 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:48:36.440 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:36 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1441243719' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:48:36.441 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:36 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] up:active 2024-09-21T07:48:36.441 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:36 smithi162 ceph-mon[34833]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:48:36.441 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:36 smithi162 ceph-mon[34833]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:48:36.441 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:36 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:48:37.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:37 smithi191 ceph-mon[34667]: pgmap v317: 129 pgs: 129 active+clean; 584 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 3.4 KiB/s wr, 13 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:37.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:37 smithi084 ceph-mon[30411]: pgmap v317: 129 pgs: 129 active+clean; 584 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 3.4 KiB/s wr, 13 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:37.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:37 smithi162 ceph-mon[34833]: pgmap v317: 129 pgs: 129 active+clean; 584 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 3.4 KiB/s wr, 13 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:37.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 -- 172.21.15.84:0/4172851399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb808105bc0 msgr2=0x7fb808105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:37.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 --2- 172.21.15.84:0/4172851399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb808105bc0 0x7fb808105fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009900 tx=0x7fb7f802a410 comp rx=0 tx=0).stop 2024-09-21T07:48:37.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 -- 172.21.15.84:0/4172851399 shutdown_connections 2024-09-21T07:48:37.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 --2- 172.21.15.84:0/4172851399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb80810be50 0x7fb808112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 --2- 172.21.15.84:0/4172851399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb80810b500 0x7fb80810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 --2- 172.21.15.84:0/4172851399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb808105bc0 0x7fb808105fd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 -- 172.21.15.84:0/4172851399 >> 172.21.15.84:0/4172851399 conn(0x7fb808101670 msgr2=0x7fb808103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:37.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 -- 172.21.15.84:0/4172851399 shutdown_connections 2024-09-21T07:48:37.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.596+0000 7fb807200640 1 -- 172.21.15.84:0/4172851399 wait complete. 2024-09-21T07:48:37.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.598+0000 7fb807200640 1 Processor -- start 2024-09-21T07:48:37.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.598+0000 7fb807200640 1 -- start start 2024-09-21T07:48:37.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.598+0000 7fb807200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb808105bc0 0x7fb80819c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.598+0000 7fb807200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb80810b500 0x7fb80819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.598+0000 7fb807200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb80810be50 0x7fb8081a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb807200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb808115b10 con 0x7fb80810be50 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb807200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb808115990 con 0x7fb808105bc0 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb807200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb808115c90 con 0x7fb80810b500 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb808105bc0 0x7fb80819c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb808105bc0 0x7fb80819c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56926/0 (socket says 172.21.15.84:56926) 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 -- 172.21.15.84:0/1698592704 learned_addr learned my addr 172.21.15.84:0/1698592704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb806800640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb80810be50 0x7fb8081a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb80810b500 0x7fb80819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 -- 172.21.15.84:0/1698592704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb80810b500 msgr2=0x7fb80819caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb80810b500 0x7fb80819caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 -- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb80810be50 msgr2=0x7fb8081a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb80810be50 0x7fb8081a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.599+0000 7fb805e00640 1 -- 172.21.15.84:0/1698592704 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8081a2470 con 0x7fb808105bc0 2024-09-21T07:48:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.600+0000 7fb805e00640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb808105bc0 0x7fb80819c500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8005940 tx=0x7fb7f80040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.600+0000 7fb7fea00640 1 -- 172.21.15.84:0/1698592704 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f803f030 con 0x7fb808105bc0 2024-09-21T07:48:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.600+0000 7fb7fea00640 1 -- 172.21.15.84:0/1698592704 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7f80044c0 con 0x7fb808105bc0 2024-09-21T07:48:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.600+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8081a2700 con 0x7fb808105bc0 2024-09-21T07:48:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.600+0000 7fb7fea00640 1 -- 172.21.15.84:0/1698592704 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8035070 con 0x7fb808105bc0 2024-09-21T07:48:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.600+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8081a8ec0 con 0x7fb808105bc0 2024-09-21T07:48:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.601+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb808105fd0 con 0x7fb808105bc0 2024-09-21T07:48:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.604+0000 7fb7fea00640 1 -- 172.21.15.84:0/1698592704 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb7f8042030 con 0x7fb808105bc0 2024-09-21T07:48:37.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.605+0000 7fb7fea00640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7ec0b6560 0x7fb7ec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:37.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.605+0000 7fb7fea00640 1 -- 172.21.15.84:0/1698592704 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fb7f8108060 con 0x7fb808105bc0 2024-09-21T07:48:37.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.606+0000 7fb7ffe00640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7ec0b6560 0x7fb7ec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:37.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.606+0000 7fb7ffe00640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7ec0b6560 0x7fb7ec0b8a70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb80810aeb0 tx=0x7fb7f0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:37.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.607+0000 7fb7fea00640 1 -- 172.21.15.84:0/1698592704 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7f8049030 con 0x7fb808105bc0 2024-09-21T07:48:37.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.840+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb80810dc80 con 0x7fb7ec0b6560 2024-09-21T07:48:37.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.871+0000 7fb7fea00640 1 -- 172.21.15.84:0/1698592704 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb80810dc80 con 0x7fb7ec0b6560 2024-09-21T07:48:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7ec0b6560 msgr2=0x7fb7ec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7ec0b6560 0x7fb7ec0b8a70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb80810aeb0 tx=0x7fb7f0005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb808105bc0 msgr2=0x7fb80819c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb808105bc0 0x7fb80819c500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8005940 tx=0x7fb7f80040c0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 shutdown_connections 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7ec0b6560 0x7fb7ec0b8a70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb80810be50 0x7fb8081a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb80810b500 0x7fb80819caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 --2- 172.21.15.84:0/1698592704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb808105bc0 0x7fb80819c500 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.874+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 >> 172.21.15.84:0/1698592704 conn(0x7fb808101670 msgr2=0x7fb808103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.875+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 shutdown_connections 2024-09-21T07:48:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:37.875+0000 7fb807200640 1 -- 172.21.15.84:0/1698592704 wait complete. 2024-09-21T07:48:38.160 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:48:37 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:48:37.847+0000 7f9810800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:48:38.160 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:48:37 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:48:37.847+0000 7f9810800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:48:38.160 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:48:37 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:48:37.847+0000 7f9810800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:48:38.160 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:48:37 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:48:37.847+0000 7f9810800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:48:38.160 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:48:37 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:48:37.847+0000 7f9810800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:48:38.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:38 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:38 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T07:48:38.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:38.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:38 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:39.007 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:39.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:39 smithi084 ceph-mon[30411]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:39.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:39 smithi084 ceph-mon[30411]: pgmap v318: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.7 KiB/s wr, 18 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:39.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:39 smithi084 ceph-mon[30411]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T07:48:39.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:39.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:39.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:39 smithi162 ceph-mon[34833]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:39 smithi162 ceph-mon[34833]: pgmap v318: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.7 KiB/s wr, 18 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:39 smithi162 ceph-mon[34833]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T07:48:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:39.556 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:39 smithi191 ceph-mon[34667]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:39.556 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:39 smithi191 ceph-mon[34667]: pgmap v318: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.7 KiB/s wr, 18 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:39.556 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:39 smithi191 ceph-mon[34667]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T07:48:39.556 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:39.556 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:39.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 -- 172.21.15.84:0/3551392673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7441049d0 msgr2=0x7fb744104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:39.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 --2- 172.21.15.84:0/3551392673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7441049d0 0x7fb744104de0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb734009900 tx=0x7fb73402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 -- 172.21.15.84:0/3551392673 shutdown_connections 2024-09-21T07:48:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 --2- 172.21.15.84:0/3551392673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb74410de30 0x7fb744110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 --2- 172.21.15.84:0/3551392673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb744105320 0x7fb74410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 --2- 172.21.15.84:0/3551392673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7441049d0 0x7fb744104de0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 -- 172.21.15.84:0/3551392673 >> 172.21.15.84:0/3551392673 conn(0x7fb744079740 msgr2=0x7fb744079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 -- 172.21.15.84:0/3551392673 shutdown_connections 2024-09-21T07:48:39.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.633+0000 7fb749600640 1 -- 172.21.15.84:0/3551392673 wait complete. 2024-09-21T07:48:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.634+0000 7fb749600640 1 Processor -- start 2024-09-21T07:48:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.634+0000 7fb749600640 1 -- start start 2024-09-21T07:48:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb749600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7441049d0 0x7fb744102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb749600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb744105320 0x7fb744102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb749600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb74410de30 0x7fb744103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb749600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb744113ab0 con 0x7fb74410de30 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb749600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb744113930 con 0x7fb744105320 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb749600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb744113c30 con 0x7fb7441049d0 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb743400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb74410de30 0x7fb744103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb743400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb74410de30 0x7fb744103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48512/0 (socket says 172.21.15.84:48512) 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb742a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7441049d0 0x7fb744102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb743400640 1 -- 172.21.15.84:0/3501812661 learned_addr learned my addr 172.21.15.84:0/3501812661 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.635+0000 7fb73be00640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb744105320 0x7fb744102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb742a00640 1 -- 172.21.15.84:0/3501812661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb744105320 msgr2=0x7fb744102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb742a00640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb744105320 0x7fb744102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb742a00640 1 -- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb74410de30 msgr2=0x7fb744103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb742a00640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb74410de30 0x7fb744103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb742a00640 1 -- 172.21.15.84:0/3501812661 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7441a8780 con 0x7fb7441049d0 2024-09-21T07:48:39.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb742a00640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7441049d0 0x7fb744102710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb734006010 tx=0x7fb734004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:39.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb73b400640 1 -- 172.21.15.84:0/3501812661 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73403f070 con 0x7fb7441049d0 2024-09-21T07:48:39.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb73b400640 1 -- 172.21.15.84:0/3501812661 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb734003ca0 con 0x7fb7441049d0 2024-09-21T07:48:39.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7441a8a10 con 0x7fb7441049d0 2024-09-21T07:48:39.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb73b400640 1 -- 172.21.15.84:0/3501812661 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734035070 con 0x7fb7441049d0 2024-09-21T07:48:39.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.636+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7441a8ef0 con 0x7fb7441049d0 2024-09-21T07:48:39.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.637+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74406c240 con 0x7fb7441049d0 2024-09-21T07:48:39.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.640+0000 7fb73b400640 1 -- 172.21.15.84:0/3501812661 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb73403b460 con 0x7fb7441049d0 2024-09-21T07:48:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.642+0000 7fb73b400640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7280b65f0 0x7fb7280b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.642+0000 7fb73b400640 1 -- 172.21.15.84:0/3501812661 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fb734108380 con 0x7fb7441049d0 2024-09-21T07:48:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.642+0000 7fb73be00640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7280b65f0 0x7fb7280b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.643+0000 7fb73be00640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7280b65f0 0x7fb7280b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb744102460 tx=0x7fb72c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.643+0000 7fb73b400640 1 -- 172.21.15.84:0/3501812661 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb734048070 con 0x7fb7441049d0 2024-09-21T07:48:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.857+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb744063800 con 0x7fb7280b65f0 2024-09-21T07:48:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.887+0000 7fb73b400640 1 -- 172.21.15.84:0/3501812661 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb744063800 con 0x7fb7280b65f0 2024-09-21T07:48:39.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7280b65f0 msgr2=0x7fb7280b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:39.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7280b65f0 0x7fb7280b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb744102460 tx=0x7fb72c005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:39.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7441049d0 msgr2=0x7fb744102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:39.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7441049d0 0x7fb744102710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb734006010 tx=0x7fb734004060 comp rx=0 tx=0).stop 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 shutdown_connections 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7280b65f0 0x7fb7280b8b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb74410de30 0x7fb744103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb744105320 0x7fb744102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 --2- 172.21.15.84:0/3501812661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7441049d0 0x7fb744102710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 >> 172.21.15.84:0/3501812661 conn(0x7fb744079740 msgr2=0x7fb7441007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 shutdown_connections 2024-09-21T07:48:39.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:39.890+0000 7fb749600640 1 -- 172.21.15.84:0/3501812661 wait complete. 2024-09-21T07:48:40.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:48:40.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:48:40.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:40.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:48:40.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:48:40.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:40.574 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:48:40.575 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:48:40.575 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:48:40.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T07:48:41.018 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:41.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:41 smithi084 ceph-mon[30411]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:41.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:41 smithi084 ceph-mon[30411]: pgmap v319: 129 pgs: 129 active+clean; 587 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.0 KiB/s wr, 21 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:41.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:41 smithi162 ceph-mon[34833]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:41 smithi162 ceph-mon[34833]: pgmap v319: 129 pgs: 129 active+clean; 587 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.0 KiB/s wr, 21 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:41.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.605+0000 7fb23cc00640 1 -- 172.21.15.84:0/3333065179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238078290 msgr2=0x7fb238114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.605+0000 7fb23cc00640 1 --2- 172.21.15.84:0/3333065179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238078290 0x7fb238114200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb220009860 tx=0x7fb22002a340 comp rx=0 tx=0).stop 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.606+0000 7fb23cc00640 1 -- 172.21.15.84:0/3333065179 shutdown_connections 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.606+0000 7fb23cc00640 1 --2- 172.21.15.84:0/3333065179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb238114740 0x7fb238116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.606+0000 7fb23cc00640 1 --2- 172.21.15.84:0/3333065179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238078290 0x7fb238114200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.606+0000 7fb23cc00640 1 --2- 172.21.15.84:0/3333065179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb238077940 0x7fb238077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.606+0000 7fb23cc00640 1 -- 172.21.15.84:0/3333065179 >> 172.21.15.84:0/3333065179 conn(0x7fb238101810 msgr2=0x7fb238103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.606+0000 7fb23cc00640 1 -- 172.21.15.84:0/3333065179 shutdown_connections 2024-09-21T07:48:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.606+0000 7fb23cc00640 1 -- 172.21.15.84:0/3333065179 wait complete. 2024-09-21T07:48:41.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 Processor -- start 2024-09-21T07:48:41.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 -- start start 2024-09-21T07:48:41.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238077940 0x7fb2381a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:41.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb238078290 0x7fb2381a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:41.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb238114740 0x7fb2381a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb23811a080 con 0x7fb238078290 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb238119f00 con 0x7fb238114740 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.607+0000 7fb23cc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb23811a200 con 0x7fb238077940 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238077940 0x7fb2381a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238077940 0x7fb2381a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52988/0 (socket says 172.21.15.84:52988) 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 -- 172.21.15.84:0/972637886 learned_addr learned my addr 172.21.15.84:0/972637886 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb22d400640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb238078290 0x7fb2381a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb236800640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb238114740 0x7fb2381a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 -- 172.21.15.84:0/972637886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb238114740 msgr2=0x7fb2381a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb238114740 0x7fb2381a6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 -- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb238078290 msgr2=0x7fb2381a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb238078290 0x7fb2381a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 -- 172.21.15.84:0/972637886 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2381a6a40 con 0x7fb238077940 2024-09-21T07:48:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.608+0000 7fb235e00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238077940 0x7fb2381a0ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e9f0 tx=0x7fb22800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:41.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.609+0000 7fb22f400640 1 -- 172.21.15.84:0/972637886 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22800cd80 con 0x7fb238077940 2024-09-21T07:48:41.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.609+0000 7fb22f400640 1 -- 172.21.15.84:0/972637886 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2280054d0 con 0x7fb238077940 2024-09-21T07:48:41.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.609+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2381a6d30 con 0x7fb238077940 2024-09-21T07:48:41.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.609+0000 7fb22f400640 1 -- 172.21.15.84:0/972637886 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228010690 con 0x7fb238077940 2024-09-21T07:48:41.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.609+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2381ad490 con 0x7fb238077940 2024-09-21T07:48:41.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.610+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb238077d50 con 0x7fb238077940 2024-09-21T07:48:41.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.612+0000 7fb22f400640 1 -- 172.21.15.84:0/972637886 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb228004e30 con 0x7fb238077940 2024-09-21T07:48:41.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.614+0000 7fb22f400640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb21c0b65f0 0x7fb21c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:41.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.614+0000 7fb22f400640 1 -- 172.21.15.84:0/972637886 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fb2280e7fe0 con 0x7fb238077940 2024-09-21T07:48:41.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.614+0000 7fb22d400640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb21c0b65f0 0x7fb21c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:41.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.615+0000 7fb22d400640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb21c0b65f0 0x7fb21c0b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb220035040 tx=0x7fb220030340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:41.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.619+0000 7fb22f400640 1 -- 172.21.15.84:0/972637886 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb228056710 con 0x7fb238077940 2024-09-21T07:48:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:41 smithi191 ceph-mon[34667]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:41 smithi191 ceph-mon[34667]: pgmap v319: 129 pgs: 129 active+clean; 587 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.0 KiB/s wr, 21 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T07:48:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.837+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fb238063800 con 0x7fb21c0b65f0 2024-09-21T07:48:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.844+0000 7fb22f400640 1 -- 172.21.15.84:0/972637886 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb238063800 con 0x7fb21c0b65f0 2024-09-21T07:48:41.845 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/qa/sv_0/42a16af7-1966-421a-9ee9-680e1e4552b7 2024-09-21T07:48:41.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb21c0b65f0 msgr2=0x7fb21c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:41.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb21c0b65f0 0x7fb21c0b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb220035040 tx=0x7fb220030340 comp rx=0 tx=0).stop 2024-09-21T07:48:41.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238077940 msgr2=0x7fb2381a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:41.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238077940 0x7fb2381a0ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e9f0 tx=0x7fb22800edf0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 shutdown_connections 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb21c0b65f0 0x7fb21c0b8b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb238114740 0x7fb2381a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb238078290 0x7fb2381a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 --2- 172.21.15.84:0/972637886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb238077940 0x7fb2381a0ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.846+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 >> 172.21.15.84:0/972637886 conn(0x7fb238101810 msgr2=0x7fb238116810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.847+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 shutdown_connections 2024-09-21T07:48:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:41.847+0000 7fb23cc00640 1 -- 172.21.15.84:0/972637886 wait complete. 2024-09-21T07:48:42.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:42 smithi162 ceph-mon[34833]: from='client.24952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:42.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:42 smithi162 ceph-mon[34833]: pgmap v320: 129 pgs: 129 active+clean; 610 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 KiB/s wr, 23 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:42.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:42 smithi084 ceph-mon[30411]: from='client.24952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:42.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:42 smithi084 ceph-mon[30411]: pgmap v320: 129 pgs: 129 active+clean; 610 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 KiB/s wr, 23 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:42.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T07:48:42.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:42 smithi191 ceph-mon[34667]: from='client.24952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:42.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:42 smithi191 ceph-mon[34667]: pgmap v320: 129 pgs: 129 active+clean; 610 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 KiB/s wr, 23 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:42.970 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 -- 172.21.15.84:0/3162624485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab0105380 msgr2=0x7f0ab010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/3162624485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab0105380 0x7f0ab010d8d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009900 tx=0x7f0a9802a410 comp rx=0 tx=0).stop 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 -- 172.21.15.84:0/3162624485 shutdown_connections 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/3162624485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ab010de90 0x7f0ab0110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/3162624485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab0105380 0x7f0ab010d8d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/3162624485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ab0104a30 0x7f0ab0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 -- 172.21.15.84:0/3162624485 >> 172.21.15.84:0/3162624485 conn(0x7f0ab0079770 msgr2=0x7f0ab0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 -- 172.21.15.84:0/3162624485 shutdown_connections 2024-09-21T07:48:43.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.592+0000 7f0ab7c00640 1 -- 172.21.15.84:0/3162624485 wait complete. 2024-09-21T07:48:43.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.593+0000 7f0ab7c00640 1 Processor -- start 2024-09-21T07:48:43.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab7c00640 1 -- start start 2024-09-21T07:48:43.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab7c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ab0104a30 0x7f0ab019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:43.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab7c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ab0105380 0x7f0ab019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:43.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab7c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab010de90 0x7f0ab019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:43.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab7c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0113af0 con 0x7f0ab010de90 2024-09-21T07:48:43.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab7c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0113970 con 0x7f0ab0105380 2024-09-21T07:48:43.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab7c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0113c70 con 0x7f0ab0104a30 2024-09-21T07:48:43.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab5c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab010de90 0x7f0ab019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:43.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab5c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab010de90 0x7f0ab019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48556/0 (socket says 172.21.15.84:48556) 2024-09-21T07:48:43.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab5200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ab0104a30 0x7f0ab019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:43.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0ab5c00640 1 -- 172.21.15.84:0/1366328313 learned_addr learned my addr 172.21.15.84:0/1366328313 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:43.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.594+0000 7f0aa7e00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ab0105380 0x7f0ab019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0ab5200640 1 -- 172.21.15.84:0/1366328313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ab0105380 msgr2=0x7f0ab019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0ab5200640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ab0105380 0x7f0ab019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0ab5200640 1 -- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab010de90 msgr2=0x7f0ab019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0ab5200640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab010de90 0x7f0ab019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0ab5200640 1 -- 172.21.15.84:0/1366328313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab01a0470 con 0x7f0ab0104a30 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0ab5c00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab010de90 0x7f0ab019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0ab5200640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ab0104a30 0x7f0ab019a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000e9f0 tx=0x7f0aa000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.595+0000 7f0aae000640 1 -- 172.21.15.84:0/1366328313 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000ccc0 con 0x7f0ab0104a30 2024-09-21T07:48:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.596+0000 7f0aae000640 1 -- 172.21.15.84:0/1366328313 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa0005020 con 0x7f0ab0104a30 2024-09-21T07:48:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.596+0000 7f0aae000640 1 -- 172.21.15.84:0/1366328313 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0004a00 con 0x7f0ab0104a30 2024-09-21T07:48:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.596+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab01a0760 con 0x7f0ab0104a30 2024-09-21T07:48:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.596+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab01a6ec0 con 0x7f0ab0104a30 2024-09-21T07:48:43.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.597+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab006c260 con 0x7f0ab0104a30 2024-09-21T07:48:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.599+0000 7f0aae000640 1 -- 172.21.15.84:0/1366328313 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f0aa0004ba0 con 0x7f0ab0104a30 2024-09-21T07:48:43.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.601+0000 7f0aae000640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a940b65f0 0x7f0a940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.601+0000 7f0aae000640 1 -- 172.21.15.84:0/1366328313 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f0aa00e7cb0 con 0x7f0ab0104a30 2024-09-21T07:48:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.601+0000 7f0aa7e00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a940b65f0 0x7f0a940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.602+0000 7f0aa7e00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a940b65f0 0x7f0a940b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009230 tx=0x7f0a98031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:43.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.603+0000 7f0aae000640 1 -- 172.21.15.84:0/1366328313 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0aa00adf60 con 0x7f0ab0104a30 2024-09-21T07:48:43.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.817+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0ab0063800 con 0x7f0a940b65f0 2024-09-21T07:48:43.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.847+0000 7f0aae000640 1 -- 172.21.15.84:0/1366328313 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0ab0063800 con 0x7f0a940b65f0 2024-09-21T07:48:43.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.849+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a940b65f0 msgr2=0x7f0a940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.849+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a940b65f0 0x7f0a940b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009230 tx=0x7f0a98031400 comp rx=0 tx=0).stop 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.849+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ab0104a30 msgr2=0x7f0ab019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.849+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ab0104a30 0x7f0ab019a500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000e9f0 tx=0x7f0aa000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 shutdown_connections 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a940b65f0 0x7f0a940b8b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ab010de90 0x7f0ab019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ab0105380 0x7f0ab019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 --2- 172.21.15.84:0/1366328313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ab0104a30 0x7f0ab019a500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 >> 172.21.15.84:0/1366328313 conn(0x7f0ab0079770 msgr2=0x7f0ab0100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 shutdown_connections 2024-09-21T07:48:43.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:43.850+0000 7f0ab7c00640 1 -- 172.21.15.84:0/1366328313 wait complete. 2024-09-21T07:48:44.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T07:48:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:45.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:45 smithi162 ceph-mon[34833]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:45.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:45 smithi162 ceph-mon[34833]: pgmap v321: 129 pgs: 129 active+clean; 610 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.5 KiB/s wr, 21 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:45.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:45 smithi084 ceph-mon[30411]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:45.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:45 smithi084 ceph-mon[30411]: pgmap v321: 129 pgs: 129 active+clean; 610 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.5 KiB/s wr, 21 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:45.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:45 smithi191 ceph-mon[34667]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:45.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:45 smithi191 ceph-mon[34667]: pgmap v321: 129 pgs: 129 active+clean; 610 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.5 KiB/s wr, 21 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:45.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.563+0000 7f070b400640 1 -- 172.21.15.84:0/3414976023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f070406c0e0 msgr2=0x7f070406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.563+0000 7f070b400640 1 --2- 172.21.15.84:0/3414976023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f070406c0e0 0x7f070406c4f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009900 tx=0x7f06f002a410 comp rx=0 tx=0).stop 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.564+0000 7f070b400640 1 -- 172.21.15.84:0/3414976023 shutdown_connections 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.564+0000 7f070b400640 1 --2- 172.21.15.84:0/3414976023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0704110040 0x7f0704112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.564+0000 7f070b400640 1 --2- 172.21.15.84:0/3414976023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f070406c0e0 0x7f070406c4f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.564+0000 7f070b400640 1 --2- 172.21.15.84:0/3414976023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07041046a0 0x7f070406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.564+0000 7f070b400640 1 -- 172.21.15.84:0/3414976023 >> 172.21.15.84:0/3414976023 conn(0x7f07040799a0 msgr2=0x7f0704079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.564+0000 7f070b400640 1 -- 172.21.15.84:0/3414976023 shutdown_connections 2024-09-21T07:48:45.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.564+0000 7f070b400640 1 -- 172.21.15.84:0/3414976023 wait complete. 2024-09-21T07:48:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.565+0000 7f070b400640 1 Processor -- start 2024-09-21T07:48:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.565+0000 7f070b400640 1 -- start start 2024-09-21T07:48:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.565+0000 7f070b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070406c0e0 0x7f070419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.565+0000 7f070b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07041046a0 0x7f070419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:45.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f070b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0704110040 0x7f07041a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f070b400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0704115cc0 con 0x7f0704110040 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f070b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0704115b40 con 0x7f070406c0e0 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f070b400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0704115e40 con 0x7f07041046a0 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0709400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0704110040 0x7f07041a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0708a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070406c0e0 0x7f070419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0709400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0704110040 0x7f07041a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48576/0 (socket says 172.21.15.84:48576) 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0709400640 1 -- 172.21.15.84:0/1759157954 learned_addr learned my addr 172.21.15.84:0/1759157954 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:45.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0703e00640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07041046a0 0x7f070419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:45.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0708a00640 1 -- 172.21.15.84:0/1759157954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07041046a0 msgr2=0x7f070419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:45.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0708a00640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07041046a0 0x7f070419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0708a00640 1 -- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0704110040 msgr2=0x7f07041a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:45.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0708a00640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0704110040 0x7f07041a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0708a00640 1 -- 172.21.15.84:0/1759157954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07041a2600 con 0x7f070406c0e0 2024-09-21T07:48:45.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.566+0000 7f0709400640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0704110040 0x7f07041a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:45.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.567+0000 7f0708a00640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070406c0e0 0x7f070419c690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06f800e9f0 tx=0x7f06f800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:45.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.567+0000 7f0701600640 1 -- 172.21.15.84:0/1759157954 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f800ccc0 con 0x7f070406c0e0 2024-09-21T07:48:45.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.567+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07041a28f0 con 0x7f070406c0e0 2024-09-21T07:48:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.567+0000 7f0701600640 1 -- 172.21.15.84:0/1759157954 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06f80044d0 con 0x7f070406c0e0 2024-09-21T07:48:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.567+0000 7f0701600640 1 -- 172.21.15.84:0/1759157954 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f801c070 con 0x7f070406c0e0 2024-09-21T07:48:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.567+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07041a9050 con 0x7f070406c0e0 2024-09-21T07:48:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.568+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070406c4f0 con 0x7f070406c0e0 2024-09-21T07:48:45.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.571+0000 7f0701600640 1 -- 172.21.15.84:0/1759157954 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f06f8005020 con 0x7f070406c0e0 2024-09-21T07:48:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.572+0000 7f0701600640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06ec0b65f0 0x7f06ec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:45.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.572+0000 7f0701600640 1 -- 172.21.15.84:0/1759157954 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f06f80e79e0 con 0x7f070406c0e0 2024-09-21T07:48:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.573+0000 7f0703e00640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06ec0b65f0 0x7f06ec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.573+0000 7f0703e00640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06ec0b65f0 0x7f06ec0b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009230 tx=0x7f06f0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.574+0000 7f0701600640 1 -- 172.21.15.84:0/1759157954 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06f80add20 con 0x7f070406c0e0 2024-09-21T07:48:45.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.790+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0704101c00 con 0x7f06ec0b65f0 2024-09-21T07:48:45.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.795+0000 7f0701600640 1 -- 172.21.15.84:0/1759157954 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0704101c00 con 0x7f06ec0b65f0 2024-09-21T07:48:45.797 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/qa/sv_1/e73e0f04-a2c3-42ea-8489-c117528eaa5d 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06ec0b65f0 msgr2=0x7f06ec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06ec0b65f0 0x7f06ec0b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009230 tx=0x7f06f0031400 comp rx=0 tx=0).stop 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070406c0e0 msgr2=0x7f070419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070406c0e0 0x7f070419c690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06f800e9f0 tx=0x7f06f800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 shutdown_connections 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06ec0b65f0 0x7f06ec0b8b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0704110040 0x7f07041a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07041046a0 0x7f070419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 --2- 172.21.15.84:0/1759157954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070406c0e0 0x7f070419c690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 >> 172.21.15.84:0/1759157954 conn(0x7f07040799a0 msgr2=0x7f07041014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 shutdown_connections 2024-09-21T07:48:45.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:45.798+0000 7f070b400640 1 -- 172.21.15.84:0/1759157954 wait complete. 2024-09-21T07:48:46.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:48:46.984 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:47.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:47 smithi162 ceph-mon[34833]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:47.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:47 smithi162 ceph-mon[34833]: pgmap v322: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 23 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:47.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:47 smithi084 ceph-mon[30411]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:47.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:47 smithi084 ceph-mon[30411]: pgmap v322: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 23 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:47.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:47 smithi191 ceph-mon[34667]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:48:47.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:47 smithi191 ceph-mon[34667]: pgmap v322: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 23 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T07:48:47.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 -- 172.21.15.84:0/3761198062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8114450 msgr2=0x7feec8116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:47.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 --2- 172.21.15.84:0/3761198062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8114450 0x7feec8116920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feec0009ca0 tx=0x7feec002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 -- 172.21.15.84:0/3761198062 shutdown_connections 2024-09-21T07:48:47.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 --2- 172.21.15.84:0/3761198062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8114450 0x7feec8116920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 --2- 172.21.15.84:0/3761198062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 0x7feec80761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 --2- 172.21.15.84:0/3761198062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec8077380 0x7feec80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 -- 172.21.15.84:0/3761198062 >> 172.21.15.84:0/3761198062 conn(0x7feec80ff590 msgr2=0x7feec81019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:47.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 -- 172.21.15.84:0/3761198062 shutdown_connections 2024-09-21T07:48:47.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.609+0000 7feecfa00640 1 -- 172.21.15.84:0/3761198062 wait complete. 2024-09-21T07:48:47.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 Processor -- start 2024-09-21T07:48:47.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 -- start start 2024-09-21T07:48:47.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 0x7feec81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:47.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8077380 0x7feec81a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:47.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec8114450 0x7feec81a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:47.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feec811a0a0 con 0x7feec8114450 2024-09-21T07:48:47.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feec8119f20 con 0x7feec8077380 2024-09-21T07:48:47.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.611+0000 7feecfa00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feec811a220 con 0x7feec8075dd0 2024-09-21T07:48:47.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feec7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8077380 0x7feec81a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:47.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecda00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec8114450 0x7feec81a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:47.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecd000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 0x7feec81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:47.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feec7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8077380 0x7feec81a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37434/0 (socket says 172.21.15.84:37434) 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feec7e00640 1 -- 172.21.15.84:0/402883622 learned_addr learned my addr 172.21.15.84:0/402883622 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecd000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 0x7feec81a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53036/0 (socket says 172.21.15.84:53036) 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecd000640 1 -- 172.21.15.84:0/402883622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8077380 msgr2=0x7feec81a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecd000640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8077380 0x7feec81a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecd000640 1 -- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec8114450 msgr2=0x7feec81a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecd000640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec8114450 0x7feec81a6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.612+0000 7feecd000640 1 -- 172.21.15.84:0/402883622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec81a69c0 con 0x7feec8075dd0 2024-09-21T07:48:47.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.613+0000 7feecd000640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 0x7feec81a0a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feebc00e9f0 tx=0x7feebc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:47.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.613+0000 7feec5600640 1 -- 172.21.15.84:0/402883622 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc00ccc0 con 0x7feec8075dd0 2024-09-21T07:48:47.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.613+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec81a6cb0 con 0x7feec8075dd0 2024-09-21T07:48:47.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.613+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec81ad410 con 0x7feec8075dd0 2024-09-21T07:48:47.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.613+0000 7feec5600640 1 -- 172.21.15.84:0/402883622 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feebc0108e0 con 0x7feec8075dd0 2024-09-21T07:48:47.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.613+0000 7feec5600640 1 -- 172.21.15.84:0/402883622 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc018750 con 0x7feec8075dd0 2024-09-21T07:48:47.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.614+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea8005290 con 0x7feec8075dd0 2024-09-21T07:48:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.618+0000 7feec5600640 1 -- 172.21.15.84:0/402883622 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7feebc010430 con 0x7feec8075dd0 2024-09-21T07:48:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.619+0000 7feec5600640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feeb00b6670 0x7feeb00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.619+0000 7feec5600640 1 -- 172.21.15.84:0/402883622 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7feebc0e7a40 con 0x7feec8075dd0 2024-09-21T07:48:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.619+0000 7feec7e00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feeb00b6670 0x7feeb00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:47.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.620+0000 7feec7e00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feeb00b6670 0x7feeb00b8b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feec8102ac0 tx=0x7feeb4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:47.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.620+0000 7feec5600640 1 -- 172.21.15.84:0/402883622 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feebc0b20d0 con 0x7feec8075dd0 2024-09-21T07:48:47.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.853+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feea8005580 con 0x7feec8075dd0 2024-09-21T07:48:47.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.854+0000 7feec5600640 1 -- 172.21.15.84:0/402883622 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11993 (secure 0 0 0) 0x7feebc0b7010 con 0x7feec8075dd0 2024-09-21T07:48:47.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:47.856 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"btime":"2024-09-21T07:48:35:141169+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:48:35.141139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24746,24742,24724,24719,24712]},"id":1}]} 2024-09-21T07:48:47.857 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feeb00b6670 msgr2=0x7feeb00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feeb00b6670 0x7feeb00b8b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feec8102ac0 tx=0x7feeb4005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 msgr2=0x7feec81a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 0x7feec81a0a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feebc00e9f0 tx=0x7feebc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 shutdown_connections 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feeb00b6670 0x7feeb00b8b80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec8114450 0x7feec81a6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec8077380 0x7feec81a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 --2- 172.21.15.84:0/402883622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec8075dd0 0x7feec81a0a50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 >> 172.21.15.84:0/402883622 conn(0x7feec80ff590 msgr2=0x7feec8110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 shutdown_connections 2024-09-21T07:48:47.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:47.857+0000 7feecfa00640 1 -- 172.21.15.84:0/402883622 wait complete. 2024-09-21T07:48:48.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:48 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/402883622' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:48:48.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:48 smithi084 ceph-mon[30411]: pgmap v323: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 17 op/s 2024-09-21T07:48:48.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:48:48.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:48 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/402883622' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:48:48.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:48 smithi162 ceph-mon[34833]: pgmap v323: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 17 op/s 2024-09-21T07:48:48.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:48 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/402883622' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:48:48.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:48 smithi191 ceph-mon[34667]: pgmap v323: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 17 op/s 2024-09-21T07:48:49.064 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:49.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 -- 172.21.15.84:0/730222576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 msgr2=0x7fd068106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:49.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 --2- 172.21.15.84:0/730222576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd068106190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd058009900 tx=0x7fd05802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 -- 172.21.15.84:0/730222576 shutdown_connections 2024-09-21T07:48:49.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 --2- 172.21.15.84:0/730222576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06810c010 0x7fd068112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 --2- 172.21.15.84:0/730222576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd06810b6c0 0x7fd06810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 --2- 172.21.15.84:0/730222576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd068106190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 -- 172.21.15.84:0/730222576 >> 172.21.15.84:0/730222576 conn(0x7fd068101810 msgr2=0x7fd068103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:49.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 -- 172.21.15.84:0/730222576 shutdown_connections 2024-09-21T07:48:49.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.695+0000 7fd06e600640 1 -- 172.21.15.84:0/730222576 wait complete. 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.696+0000 7fd06e600640 1 Processor -- start 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.696+0000 7fd06e600640 1 -- start start 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd06e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd06819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd06e600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd06810b6c0 0x7fd06819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd06e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06810c010 0x7fd0681a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd06e600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd068115cd0 con 0x7fd068105d80 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd06e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd068115b50 con 0x7fd06810c010 2024-09-21T07:48:49.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd06e600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd068115e50 con 0x7fd06810b6c0 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd067400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd06819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd067400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd06819c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49220/0 (socket says 172.21.15.84:49220) 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd067400640 1 -- 172.21.15.84:0/502710093 learned_addr learned my addr 172.21.15.84:0/502710093 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd067e00640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06810c010 0x7fd0681a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:49.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.697+0000 7fd05ea00640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd06810b6c0 0x7fd06819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd067400640 1 -- 172.21.15.84:0/502710093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd06810b6c0 msgr2=0x7fd06819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd067400640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd06810b6c0 0x7fd06819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd067400640 1 -- 172.21.15.84:0/502710093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06810c010 msgr2=0x7fd0681a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd067400640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06810c010 0x7fd0681a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd067400640 1 -- 172.21.15.84:0/502710093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0681a2630 con 0x7fd068105d80 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd05ea00640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd06810b6c0 0x7fd06819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd067400640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd06819c6c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd058005940 tx=0x7fd0580040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd064c00640 1 -- 172.21.15.84:0/502710093 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05803f030 con 0x7fd068105d80 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd064c00640 1 -- 172.21.15.84:0/502710093 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0580044c0 con 0x7fd068105d80 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.698+0000 7fd064c00640 1 -- 172.21.15.84:0/502710093 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058035070 con 0x7fd068105d80 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.699+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0681a28c0 con 0x7fd068105d80 2024-09-21T07:48:49.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.699+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0681a9080 con 0x7fd068105d80 2024-09-21T07:48:49.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.700+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd068107000 con 0x7fd068105d80 2024-09-21T07:48:49.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.702+0000 7fd064c00640 1 -- 172.21.15.84:0/502710093 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd058042030 con 0x7fd068105d80 2024-09-21T07:48:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.703+0000 7fd064c00640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd04c0b65f0 0x7fd04c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.704+0000 7fd064c00640 1 -- 172.21.15.84:0/502710093 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fd058107f90 con 0x7fd068105d80 2024-09-21T07:48:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.704+0000 7fd05ea00640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd04c0b65f0 0x7fd04c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:49.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.704+0000 7fd05ea00640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd04c0b65f0 0x7fd04c0b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd06810b200 tx=0x7fd050005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:49.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.706+0000 7fd064c00640 1 -- 172.21.15.84:0/502710093 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0580ce240 con 0x7fd068105d80 2024-09-21T07:48:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.898+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd06810dde0 con 0x7fd068105d80 2024-09-21T07:48:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.899+0000 7fd064c00640 1 -- 172.21.15.84:0/502710093 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25051 (secure 0 0 0) 0x7fd0580d2620 con 0x7fd068105d80 2024-09-21T07:48:49.901 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:49.902 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:48:31.082446+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd04c0b65f0 msgr2=0x7fd04c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd04c0b65f0 0x7fd04c0b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd06810b200 tx=0x7fd050005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 msgr2=0x7fd06819c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd06819c6c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd058005940 tx=0x7fd0580040c0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 shutdown_connections 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd04c0b65f0 0x7fd04c0b8b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06810c010 0x7fd0681a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd06810b6c0 0x7fd06819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 --2- 172.21.15.84:0/502710093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd068105d80 0x7fd06819c6c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 >> 172.21.15.84:0/502710093 conn(0x7fd068101810 msgr2=0x7fd068103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 shutdown_connections 2024-09-21T07:48:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:49.902+0000 7fd06e600640 1 -- 172.21.15.84:0/502710093 wait complete. 2024-09-21T07:48:50.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/502710093' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:50.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/502710093' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:50.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/502710093' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:48:50.774 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:48:50.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:48:51.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:50 smithi084 ceph-mon[30411]: pgmap v324: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-09-21T07:48:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:51.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:50 smithi191 ceph-mon[34667]: pgmap v324: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-09-21T07:48:51.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:50 smithi162 ceph-mon[34833]: pgmap v324: 129 pgs: 129 active+clean; 631 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-09-21T07:48:51.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.767+0000 7f1af1000640 1 -- 172.21.15.84:0/3576771543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec1039b0 msgr2=0x7f1aec103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.767+0000 7f1af1000640 1 --2- 172.21.15.84:0/3576771543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec1039b0 0x7f1aec103dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009900 tx=0x7f1adc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.767+0000 7f1af1000640 1 -- 172.21.15.84:0/3576771543 shutdown_connections 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.767+0000 7f1af1000640 1 --2- 172.21.15.84:0/3576771543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aec109c40 0x7f1aec110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.767+0000 7f1af1000640 1 --2- 172.21.15.84:0/3576771543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aec1092f0 0x7f1aec109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.767+0000 7f1af1000640 1 --2- 172.21.15.84:0/3576771543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec1039b0 0x7f1aec103dc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.767+0000 7f1af1000640 1 -- 172.21.15.84:0/3576771543 >> 172.21.15.84:0/3576771543 conn(0x7f1aec0ff440 msgr2=0x7f1aec101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.768+0000 7f1af1000640 1 -- 172.21.15.84:0/3576771543 shutdown_connections 2024-09-21T07:48:51.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.768+0000 7f1af1000640 1 -- 172.21.15.84:0/3576771543 wait complete. 2024-09-21T07:48:51.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.769+0000 7f1af1000640 1 Processor -- start 2024-09-21T07:48:51.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.769+0000 7f1af1000640 1 -- start start 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1af1000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aec1039b0 0x7f1aec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1af1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aec1092f0 0x7f1aec075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1af1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec109c40 0x7f1aec076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1af1000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec113950 con 0x7f1aec109c40 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1af1000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec1137d0 con 0x7f1aec1092f0 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1af1000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec113ad0 con 0x7f1aec1039b0 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec109c40 0x7f1aec076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec109c40 0x7f1aec076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49236/0 (socket says 172.21.15.84:49236) 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aebe00640 1 -- 172.21.15.84:0/4031479403 learned_addr learned my addr 172.21.15.84:0/4031479403 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:51.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aeb400640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aec1039b0 0x7f1aec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:51.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aeaa00640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aec1092f0 0x7f1aec075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:51.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aebe00640 1 -- 172.21.15.84:0/4031479403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aec1039b0 msgr2=0x7f1aec075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:51.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aebe00640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aec1039b0 0x7f1aec075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aebe00640 1 -- 172.21.15.84:0/4031479403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aec1092f0 msgr2=0x7f1aec075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.770+0000 7f1aebe00640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aec1092f0 0x7f1aec075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.771+0000 7f1aebe00640 1 -- 172.21.15.84:0/4031479403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aec1a8680 con 0x7f1aec109c40 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.771+0000 7f1aebe00640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec109c40 0x7f1aec076190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400eb10 tx=0x7f1ae400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.771+0000 7f1ae3e00640 1 -- 172.21.15.84:0/4031479403 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4004b20 con 0x7f1aec109c40 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.771+0000 7f1ae3e00640 1 -- 172.21.15.84:0/4031479403 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ae4004cc0 con 0x7f1aec109c40 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.771+0000 7f1ae3e00640 1 -- 172.21.15.84:0/4031479403 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4010670 con 0x7f1aec109c40 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.771+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aec1a8970 con 0x7f1aec109c40 2024-09-21T07:48:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.771+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aec1a8e30 con 0x7f1aec109c40 2024-09-21T07:48:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.772+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aec103dc0 con 0x7f1aec109c40 2024-09-21T07:48:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.775+0000 7f1ae3e00640 1 -- 172.21.15.84:0/4031479403 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1ae4005000 con 0x7f1aec109c40 2024-09-21T07:48:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.776+0000 7f1ae3e00640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1ad00b6670 0x7f1ad00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.776+0000 7f1ae3e00640 1 -- 172.21.15.84:0/4031479403 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f1ae40e7ff0 con 0x7f1aec109c40 2024-09-21T07:48:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.776+0000 7f1aeb400640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1ad00b6670 0x7f1ad00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.777+0000 7f1aeb400640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1ad00b6670 0x7f1ad00b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1adc005ab0 tx=0x7f1adc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.778+0000 7f1ae3e00640 1 -- 172.21.15.84:0/4031479403 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ae4056710 con 0x7f1aec109c40 2024-09-21T07:48:51.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.960+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1aec063800 con 0x7f1ad00b6670 2024-09-21T07:48:51.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.968+0000 7f1ae3e00640 1 -- 172.21.15.84:0/4031479403 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340403 (secure 0 0 0) 0x7f1aec063800 con 0x7f1ad00b6670 2024-09-21T07:48:51.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:51.976 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:48:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1ad00b6670 msgr2=0x7f1ad00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1ad00b6670 0x7f1ad00b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1adc005ab0 tx=0x7f1adc005a20 comp rx=0 tx=0).stop 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec109c40 msgr2=0x7f1aec076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec109c40 0x7f1aec076190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ae400eb10 tx=0x7f1ae400c2d0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 shutdown_connections 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1ad00b6670 0x7f1ad00b8b80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec109c40 0x7f1aec076190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aec1092f0 0x7f1aec075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 --2- 172.21.15.84:0/4031479403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aec1039b0 0x7f1aec075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.972+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 >> 172.21.15.84:0/4031479403 conn(0x7f1aec0ff440 msgr2=0x7f1aec101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.973+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 shutdown_connections 2024-09-21T07:48:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:51.973+0000 7f1af1000640 1 -- 172.21.15.84:0/4031479403 wait complete. 2024-09-21T07:48:52.681 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-21T07:48:49.987230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646425,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":240,"num_read_kb":209,"num_write":362,"num_write_kb":2275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387968,"kb_used_data":13760,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553856,"statfs":{"total":1151940427776,"available":1151543148544,"internally_reserved":0,"allocated":14090240,"data_stored":7986797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46589,"num_objects":14,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":145,"num_read_kb":128,"num_write":55,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003766"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":67,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:46.168995+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:48:46.168995+0000","last_peered":"2024-09-21T07:48:46.168995+0000","last_clean":"2024-09-21T07:48:46.168995+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:48:46.168995+0000","last_undegraded":"2024-09-21T07:48:46.168995+0000","last_fullsized":"2024-09-21T07:48:46.168995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.094147+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:48:31.094147+0000","last_peered":"2024-09-21T07:48:31.094147+0000","last_clean":"2024-09-21T07:48:31.094147+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:48:31.094147+0000","last_undegraded":"2024-09-21T07:48:31.094147+0000","last_fullsized":"2024-09-21T07:48:31.094147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089220+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:48:31.089220+0000","last_peered":"2024-09-21T07:48:31.089220+0000","last_clean":"2024-09-21T07:48:31.089220+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:48:31.089220+0000","last_undegraded":"2024-09-21T07:48:31.089220+0000","last_fullsized":"2024-09-21T07:48:31.089220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.094379+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:48:31.094379+0000","last_peered":"2024-09-21T07:48:31.094379+0000","last_clean":"2024-09-21T07:48:31.094379+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:48:31.094379+0000","last_undegraded":"2024-09-21T07:48:31.094379+0000","last_fullsized":"2024-09-21T07:48:31.094379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111723+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:48:31.111723+0000","last_peered":"2024-09-21T07:48:31.111723+0000","last_clean":"2024-09-21T07:48:31.111723+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:48:31.111723+0000","last_undegraded":"2024-09-21T07:48:31.111723+0000","last_fullsized":"2024-09-21T07:48:31.111723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111879+0000","last_change":"2024-09-21T07:47:49.755746+0000","last_active":"2024-09-21T07:48:31.111879+0000","last_peered":"2024-09-21T07:48:31.111879+0000","last_clean":"2024-09-21T07:48:31.111879+0000","last_became_active":"2024-09-21T07:47:49.755319+0000","last_became_peered":"2024-09-21T07:47:49.755319+0000","last_unstale":"2024-09-21T07:48:31.111879+0000","last_undegraded":"2024-09-21T07:48:31.111879+0000","last_fullsized":"2024-09-21T07:48:31.111879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:03.244616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:35.140924+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:48:35.140924+0000","last_peered":"2024-09-21T07:48:35.140924+0000","last_clean":"2024-09-21T07:48:35.140924+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:48:35.140924+0000","last_undegraded":"2024-09-21T07:48:35.140924+0000","last_fullsized":"2024-09-21T07:48:35.140924+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096433+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:48:31.096433+0000","last_peered":"2024-09-21T07:48:31.096433+0000","last_clean":"2024-09-21T07:48:31.096433+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:48:31.096433+0000","last_undegraded":"2024-09-21T07:48:31.096433+0000","last_fullsized":"2024-09-21T07:48:31.096433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112663+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:48:31.112663+0000","last_peered":"2024-09-21T07:48:31.112663+0000","last_clean":"2024-09-21T07:48:31.112663+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:48:31.112663+0000","last_undegraded":"2024-09-21T07:48:31.112663+0000","last_fullsized":"2024-09-21T07:48:31.112663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147475+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:48:34.147475+0000","last_peered":"2024-09-21T07:48:34.147475+0000","last_clean":"2024-09-21T07:48:34.147475+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:48:34.147475+0000","last_undegraded":"2024-09-21T07:48:34.147475+0000","last_fullsized":"2024-09-21T07:48:34.147475+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.088063+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:48:31.088063+0000","last_peered":"2024-09-21T07:48:31.088063+0000","last_clean":"2024-09-21T07:48:31.088063+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:48:31.088063+0000","last_undegraded":"2024-09-21T07:48:31.088063+0000","last_fullsized":"2024-09-21T07:48:31.088063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112023+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:48:31.112023+0000","last_peered":"2024-09-21T07:48:31.112023+0000","last_clean":"2024-09-21T07:48:31.112023+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:48:31.112023+0000","last_undegraded":"2024-09-21T07:48:31.112023+0000","last_fullsized":"2024-09-21T07:48:31.112023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091342+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:48:31.091342+0000","last_peered":"2024-09-21T07:48:31.091342+0000","last_clean":"2024-09-21T07:48:31.091342+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:48:31.091342+0000","last_undegraded":"2024-09-21T07:48:31.091342+0000","last_fullsized":"2024-09-21T07:48:31.091342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113541+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:48:31.113541+0000","last_peered":"2024-09-21T07:48:31.113541+0000","last_clean":"2024-09-21T07:48:31.113541+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:48:31.113541+0000","last_undegraded":"2024-09-21T07:48:31.113541+0000","last_fullsized":"2024-09-21T07:48:31.113541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111719+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:48:31.111719+0000","last_peered":"2024-09-21T07:48:31.111719+0000","last_clean":"2024-09-21T07:48:31.111719+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:48:31.111719+0000","last_undegraded":"2024-09-21T07:48:31.111719+0000","last_fullsized":"2024-09-21T07:48:31.111719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092574+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:48:31.092574+0000","last_peered":"2024-09-21T07:48:31.092574+0000","last_clean":"2024-09-21T07:48:31.092574+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:48:31.092574+0000","last_undegraded":"2024-09-21T07:48:31.092574+0000","last_fullsized":"2024-09-21T07:48:31.092574+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.133080+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:48:33.133080+0000","last_peered":"2024-09-21T07:48:33.133080+0000","last_clean":"2024-09-21T07:48:33.133080+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:48:33.133080+0000","last_undegraded":"2024-09-21T07:48:33.133080+0000","last_fullsized":"2024-09-21T07:48:33.133080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111800+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:48:31.111800+0000","last_peered":"2024-09-21T07:48:31.111800+0000","last_clean":"2024-09-21T07:48:31.111800+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:48:31.111800+0000","last_undegraded":"2024-09-21T07:48:31.111800+0000","last_fullsized":"2024-09-21T07:48:31.111800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090374+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:48:31.090374+0000","last_peered":"2024-09-21T07:48:31.090374+0000","last_clean":"2024-09-21T07:48:31.090374+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:48:31.090374+0000","last_undegraded":"2024-09-21T07:48:31.090374+0000","last_fullsized":"2024-09-21T07:48:31.090374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.149409+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:48:34.149409+0000","last_peered":"2024-09-21T07:48:34.149409+0000","last_clean":"2024-09-21T07:48:34.149409+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:48:34.149409+0000","last_undegraded":"2024-09-21T07:48:34.149409+0000","last_fullsized":"2024-09-21T07:48:34.149409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086786+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:48:31.086786+0000","last_peered":"2024-09-21T07:48:31.086786+0000","last_clean":"2024-09-21T07:48:31.086786+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:48:31.086786+0000","last_undegraded":"2024-09-21T07:48:31.086786+0000","last_fullsized":"2024-09-21T07:48:31.086786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092946+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:48:31.092946+0000","last_peered":"2024-09-21T07:48:31.092946+0000","last_clean":"2024-09-21T07:48:31.092946+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:48:31.092946+0000","last_undegraded":"2024-09-21T07:48:31.092946+0000","last_fullsized":"2024-09-21T07:48:31.092946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.114737+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:48:31.114737+0000","last_peered":"2024-09-21T07:48:31.114737+0000","last_clean":"2024-09-21T07:48:31.114737+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:48:31.114737+0000","last_undegraded":"2024-09-21T07:48:31.114737+0000","last_fullsized":"2024-09-21T07:48:31.114737+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.115263+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:48:31.115263+0000","last_peered":"2024-09-21T07:48:31.115263+0000","last_clean":"2024-09-21T07:48:31.115263+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:48:31.115263+0000","last_undegraded":"2024-09-21T07:48:31.115263+0000","last_fullsized":"2024-09-21T07:48:31.115263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113349+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:48:31.113349+0000","last_peered":"2024-09-21T07:48:31.113349+0000","last_clean":"2024-09-21T07:48:31.113349+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:48:31.113349+0000","last_undegraded":"2024-09-21T07:48:31.113349+0000","last_fullsized":"2024-09-21T07:48:31.113349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.146326+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:48:34.146326+0000","last_peered":"2024-09-21T07:48:34.146326+0000","last_clean":"2024-09-21T07:48:34.146326+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:48:34.146326+0000","last_undegraded":"2024-09-21T07:48:34.146326+0000","last_fullsized":"2024-09-21T07:48:34.146326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089368+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:48:31.089368+0000","last_peered":"2024-09-21T07:48:31.089368+0000","last_clean":"2024-09-21T07:48:31.089368+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:48:31.089368+0000","last_undegraded":"2024-09-21T07:48:31.089368+0000","last_fullsized":"2024-09-21T07:48:31.089368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.093515+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:48:31.093515+0000","last_peered":"2024-09-21T07:48:31.093515+0000","last_clean":"2024-09-21T07:48:31.093515+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:48:31.093515+0000","last_undegraded":"2024-09-21T07:48:31.093515+0000","last_fullsized":"2024-09-21T07:48:31.093515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'13","reported_seq":53,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:46.720006+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:48:46.720006+0000","last_peered":"2024-09-21T07:48:46.720006+0000","last_clean":"2024-09-21T07:48:46.720006+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:48:46.720006+0000","last_undegraded":"2024-09-21T07:48:46.720006+0000","last_fullsized":"2024-09-21T07:48:46.720006+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092183+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:48:31.092183+0000","last_peered":"2024-09-21T07:48:31.092183+0000","last_clean":"2024-09-21T07:48:31.092183+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:48:31.092183+0000","last_undegraded":"2024-09-21T07:48:31.092183+0000","last_fullsized":"2024-09-21T07:48:31.092183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119577+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:48:31.119577+0000","last_peered":"2024-09-21T07:48:31.119577+0000","last_clean":"2024-09-21T07:48:31.119577+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:48:31.119577+0000","last_undegraded":"2024-09-21T07:48:31.119577+0000","last_fullsized":"2024-09-21T07:48:31.119577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.148580+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:48:34.148580+0000","last_peered":"2024-09-21T07:48:34.148580+0000","last_clean":"2024-09-21T07:48:34.148580+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:48:34.148580+0000","last_undegraded":"2024-09-21T07:48:34.148580+0000","last_fullsized":"2024-09-21T07:48:34.148580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090655+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:48:31.090655+0000","last_peered":"2024-09-21T07:48:31.090655+0000","last_clean":"2024-09-21T07:48:31.090655+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:48:31.090655+0000","last_undegraded":"2024-09-21T07:48:31.090655+0000","last_fullsized":"2024-09-21T07:48:31.090655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086741+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:48:31.086741+0000","last_peered":"2024-09-21T07:48:31.086741+0000","last_clean":"2024-09-21T07:48:31.086741+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:48:31.086741+0000","last_undegraded":"2024-09-21T07:48:31.086741+0000","last_fullsized":"2024-09-21T07:48:31.086741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086723+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:48:31.086723+0000","last_peered":"2024-09-21T07:48:31.086723+0000","last_clean":"2024-09-21T07:48:31.086723+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:48:31.086723+0000","last_undegraded":"2024-09-21T07:48:31.086723+0000","last_fullsized":"2024-09-21T07:48:31.086723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.098151+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:48:31.098151+0000","last_peered":"2024-09-21T07:48:31.098151+0000","last_clean":"2024-09-21T07:48:31.098151+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:48:31.098151+0000","last_undegraded":"2024-09-21T07:48:31.098151+0000","last_fullsized":"2024-09-21T07:48:31.098151+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087026+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:48:31.087026+0000","last_peered":"2024-09-21T07:48:31.087026+0000","last_clean":"2024-09-21T07:48:31.087026+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:48:31.087026+0000","last_undegraded":"2024-09-21T07:48:31.087026+0000","last_fullsized":"2024-09-21T07:48:31.087026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:48.172483+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:48:48.172483+0000","last_peered":"2024-09-21T07:48:48.172483+0000","last_clean":"2024-09-21T07:48:48.172483+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:48:48.172483+0000","last_undegraded":"2024-09-21T07:48:48.172483+0000","last_fullsized":"2024-09-21T07:48:48.172483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119321+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:48:31.119321+0000","last_peered":"2024-09-21T07:48:31.119321+0000","last_clean":"2024-09-21T07:48:31.119321+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:48:31.119321+0000","last_undegraded":"2024-09-21T07:48:31.119321+0000","last_fullsized":"2024-09-21T07:48:31.119321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086528+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:48:31.086528+0000","last_peered":"2024-09-21T07:48:31.086528+0000","last_clean":"2024-09-21T07:48:31.086528+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:48:31.086528+0000","last_undegraded":"2024-09-21T07:48:31.086528+0000","last_fullsized":"2024-09-21T07:48:31.086528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:48.172773+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:48:48.172773+0000","last_peered":"2024-09-21T07:48:48.172773+0000","last_clean":"2024-09-21T07:48:48.172773+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:48:48.172773+0000","last_undegraded":"2024-09-21T07:48:48.172773+0000","last_fullsized":"2024-09-21T07:48:48.172773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119969+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:48:31.119969+0000","last_peered":"2024-09-21T07:48:31.119969+0000","last_clean":"2024-09-21T07:48:31.119969+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:48:31.119969+0000","last_undegraded":"2024-09-21T07:48:31.119969+0000","last_fullsized":"2024-09-21T07:48:31.119969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.116261+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:48:31.116261+0000","last_peered":"2024-09-21T07:48:31.116261+0000","last_clean":"2024-09-21T07:48:31.116261+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:48:31.116261+0000","last_undegraded":"2024-09-21T07:48:31.116261+0000","last_fullsized":"2024-09-21T07:48:31.116261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:32.126424+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:48:32.126424+0000","last_peered":"2024-09-21T07:48:32.126424+0000","last_clean":"2024-09-21T07:48:32.126424+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:48:32.126424+0000","last_undegraded":"2024-09-21T07:48:32.126424+0000","last_fullsized":"2024-09-21T07:48:32.126424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.088678+0000","last_change":"2024-09-21T07:47:50.065836+0000","last_active":"2024-09-21T07:48:31.088678+0000","last_peered":"2024-09-21T07:48:31.088678+0000","last_clean":"2024-09-21T07:48:31.088678+0000","last_became_active":"2024-09-21T07:47:50.065284+0000","last_became_peered":"2024-09-21T07:47:50.065284+0000","last_unstale":"2024-09-21T07:48:31.088678+0000","last_undegraded":"2024-09-21T07:48:31.088678+0000","last_fullsized":"2024-09-21T07:48:31.088678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:51.956063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092698+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:48:31.092698+0000","last_peered":"2024-09-21T07:48:31.092698+0000","last_clean":"2024-09-21T07:48:31.092698+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:48:31.092698+0000","last_undegraded":"2024-09-21T07:48:31.092698+0000","last_fullsized":"2024-09-21T07:48:31.092698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:35.149320+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:48:35.149320+0000","last_peered":"2024-09-21T07:48:35.149320+0000","last_clean":"2024-09-21T07:48:35.149320+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:48:35.149320+0000","last_undegraded":"2024-09-21T07:48:35.149320+0000","last_fullsized":"2024-09-21T07:48:35.149320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091214+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:48:31.091214+0000","last_peered":"2024-09-21T07:48:31.091214+0000","last_clean":"2024-09-21T07:48:31.091214+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:48:31.091214+0000","last_undegraded":"2024-09-21T07:48:31.091214+0000","last_fullsized":"2024-09-21T07:48:31.091214+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091969+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:48:31.091969+0000","last_peered":"2024-09-21T07:48:31.091969+0000","last_clean":"2024-09-21T07:48:31.091969+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:48:31.091969+0000","last_undegraded":"2024-09-21T07:48:31.091969+0000","last_fullsized":"2024-09-21T07:48:31.091969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092053+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:48:31.092053+0000","last_peered":"2024-09-21T07:48:31.092053+0000","last_clean":"2024-09-21T07:48:31.092053+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:48:31.092053+0000","last_undegraded":"2024-09-21T07:48:31.092053+0000","last_fullsized":"2024-09-21T07:48:31.092053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:45.168949+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:48:45.168949+0000","last_peered":"2024-09-21T07:48:45.168949+0000","last_clean":"2024-09-21T07:48:45.168949+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:48:45.168949+0000","last_undegraded":"2024-09-21T07:48:45.168949+0000","last_fullsized":"2024-09-21T07:48:45.168949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096217+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:48:31.096217+0000","last_peered":"2024-09-21T07:48:31.096217+0000","last_clean":"2024-09-21T07:48:31.096217+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:48:31.096217+0000","last_undegraded":"2024-09-21T07:48:31.096217+0000","last_fullsized":"2024-09-21T07:48:31.096217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091814+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:48:31.091814+0000","last_peered":"2024-09-21T07:48:31.091814+0000","last_clean":"2024-09-21T07:48:31.091814+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:48:31.091814+0000","last_undegraded":"2024-09-21T07:48:31.091814+0000","last_fullsized":"2024-09-21T07:48:31.091814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.149031+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:48:34.149031+0000","last_peered":"2024-09-21T07:48:34.149031+0000","last_clean":"2024-09-21T07:48:34.149031+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:48:34.149031+0000","last_undegraded":"2024-09-21T07:48:34.149031+0000","last_fullsized":"2024-09-21T07:48:34.149031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112453+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:48:31.112453+0000","last_peered":"2024-09-21T07:48:31.112453+0000","last_clean":"2024-09-21T07:48:31.112453+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:48:31.112453+0000","last_undegraded":"2024-09-21T07:48:31.112453+0000","last_fullsized":"2024-09-21T07:48:31.112453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092064+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:48:31.092064+0000","last_peered":"2024-09-21T07:48:31.092064+0000","last_clean":"2024-09-21T07:48:31.092064+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:48:31.092064+0000","last_undegraded":"2024-09-21T07:48:31.092064+0000","last_fullsized":"2024-09-21T07:48:31.092064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147947+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:48:34.147947+0000","last_peered":"2024-09-21T07:48:34.147947+0000","last_clean":"2024-09-21T07:48:34.147947+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:48:34.147947+0000","last_undegraded":"2024-09-21T07:48:34.147947+0000","last_fullsized":"2024-09-21T07:48:34.147947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086291+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:48:31.086291+0000","last_peered":"2024-09-21T07:48:31.086291+0000","last_clean":"2024-09-21T07:48:31.086291+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:48:31.086291+0000","last_undegraded":"2024-09-21T07:48:31.086291+0000","last_fullsized":"2024-09-21T07:48:31.086291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090536+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:48:31.090536+0000","last_peered":"2024-09-21T07:48:31.090536+0000","last_clean":"2024-09-21T07:48:31.090536+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:48:31.090536+0000","last_undegraded":"2024-09-21T07:48:31.090536+0000","last_fullsized":"2024-09-21T07:48:31.090536+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.121471+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:48:33.121471+0000","last_peered":"2024-09-21T07:48:33.121471+0000","last_clean":"2024-09-21T07:48:33.121471+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:48:33.121471+0000","last_undegraded":"2024-09-21T07:48:33.121471+0000","last_fullsized":"2024-09-21T07:48:33.121471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086483+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:48:31.086483+0000","last_peered":"2024-09-21T07:48:31.086483+0000","last_clean":"2024-09-21T07:48:31.086483+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:48:31.086483+0000","last_undegraded":"2024-09-21T07:48:31.086483+0000","last_fullsized":"2024-09-21T07:48:31.086483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.118700+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:48:31.118700+0000","last_peered":"2024-09-21T07:48:31.118700+0000","last_clean":"2024-09-21T07:48:31.118700+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:48:31.118700+0000","last_undegraded":"2024-09-21T07:48:31.118700+0000","last_fullsized":"2024-09-21T07:48:31.118700+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.145954+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:48:34.145954+0000","last_peered":"2024-09-21T07:48:34.145954+0000","last_clean":"2024-09-21T07:48:34.145954+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:48:34.145954+0000","last_undegraded":"2024-09-21T07:48:34.145954+0000","last_fullsized":"2024-09-21T07:48:34.145954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119920+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:48:31.119920+0000","last_peered":"2024-09-21T07:48:31.119920+0000","last_clean":"2024-09-21T07:48:31.119920+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:48:31.119920+0000","last_undegraded":"2024-09-21T07:48:31.119920+0000","last_fullsized":"2024-09-21T07:48:31.119920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090964+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:48:31.090964+0000","last_peered":"2024-09-21T07:48:31.090964+0000","last_clean":"2024-09-21T07:48:31.090964+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:48:31.090964+0000","last_undegraded":"2024-09-21T07:48:31.090964+0000","last_fullsized":"2024-09-21T07:48:31.090964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:47.171863+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:48:47.171863+0000","last_peered":"2024-09-21T07:48:47.171863+0000","last_clean":"2024-09-21T07:48:47.171863+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:48:47.171863+0000","last_undegraded":"2024-09-21T07:48:47.171863+0000","last_fullsized":"2024-09-21T07:48:47.171863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.116685+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:48:31.116685+0000","last_peered":"2024-09-21T07:48:31.116685+0000","last_clean":"2024-09-21T07:48:31.116685+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:48:31.116685+0000","last_undegraded":"2024-09-21T07:48:31.116685+0000","last_fullsized":"2024-09-21T07:48:31.116685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091668+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:48:31.091668+0000","last_peered":"2024-09-21T07:48:31.091668+0000","last_clean":"2024-09-21T07:48:31.091668+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:48:31.091668+0000","last_undegraded":"2024-09-21T07:48:31.091668+0000","last_fullsized":"2024-09-21T07:48:31.091668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.149136+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:48:34.149136+0000","last_peered":"2024-09-21T07:48:34.149136+0000","last_clean":"2024-09-21T07:48:34.149136+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:48:34.149136+0000","last_undegraded":"2024-09-21T07:48:34.149136+0000","last_fullsized":"2024-09-21T07:48:34.149136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091646+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:48:31.091646+0000","last_peered":"2024-09-21T07:48:31.091646+0000","last_clean":"2024-09-21T07:48:31.091646+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:48:31.091646+0000","last_undegraded":"2024-09-21T07:48:31.091646+0000","last_fullsized":"2024-09-21T07:48:31.091646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.117466+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:48:31.117466+0000","last_peered":"2024-09-21T07:48:31.117466+0000","last_clean":"2024-09-21T07:48:31.117466+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:48:31.117466+0000","last_undegraded":"2024-09-21T07:48:31.117466+0000","last_fullsized":"2024-09-21T07:48:31.117466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:35.149201+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:48:35.149201+0000","last_peered":"2024-09-21T07:48:35.149201+0000","last_clean":"2024-09-21T07:48:35.149201+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:48:35.149201+0000","last_undegraded":"2024-09-21T07:48:35.149201+0000","last_fullsized":"2024-09-21T07:48:35.149201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087918+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:48:31.087918+0000","last_peered":"2024-09-21T07:48:31.087918+0000","last_clean":"2024-09-21T07:48:31.087918+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:48:31.087918+0000","last_undegraded":"2024-09-21T07:48:31.087918+0000","last_fullsized":"2024-09-21T07:48:31.087918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092204+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:48:31.092204+0000","last_peered":"2024-09-21T07:48:31.092204+0000","last_clean":"2024-09-21T07:48:31.092204+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:48:31.092204+0000","last_undegraded":"2024-09-21T07:48:31.092204+0000","last_fullsized":"2024-09-21T07:48:31.092204+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":94,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:44.169399+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:48:44.169399+0000","last_peered":"2024-09-21T07:48:44.169399+0000","last_clean":"2024-09-21T07:48:44.169399+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:48:44.169399+0000","last_undegraded":"2024-09-21T07:48:44.169399+0000","last_fullsized":"2024-09-21T07:48:44.169399+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48619,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":60,"num_write":30,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086223+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:48:31.086223+0000","last_peered":"2024-09-21T07:48:31.086223+0000","last_clean":"2024-09-21T07:48:31.086223+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:48:31.086223+0000","last_undegraded":"2024-09-21T07:48:31.086223+0000","last_fullsized":"2024-09-21T07:48:31.086223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096500+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:48:31.096500+0000","last_peered":"2024-09-21T07:48:31.096500+0000","last_clean":"2024-09-21T07:48:31.096500+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:48:31.096500+0000","last_undegraded":"2024-09-21T07:48:31.096500+0000","last_fullsized":"2024-09-21T07:48:31.096500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.135172+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:48:33.135172+0000","last_peered":"2024-09-21T07:48:33.135172+0000","last_clean":"2024-09-21T07:48:33.135172+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:48:33.135172+0000","last_undegraded":"2024-09-21T07:48:33.135172+0000","last_fullsized":"2024-09-21T07:48:33.135172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112211+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:48:31.112211+0000","last_peered":"2024-09-21T07:48:31.112211+0000","last_clean":"2024-09-21T07:48:31.112211+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:48:31.112211+0000","last_undegraded":"2024-09-21T07:48:31.112211+0000","last_fullsized":"2024-09-21T07:48:31.112211+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111883+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:48:31.111883+0000","last_peered":"2024-09-21T07:48:31.111883+0000","last_clean":"2024-09-21T07:48:31.111883+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:48:31.111883+0000","last_undegraded":"2024-09-21T07:48:31.111883+0000","last_fullsized":"2024-09-21T07:48:31.111883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147379+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:48:34.147379+0000","last_peered":"2024-09-21T07:48:34.147379+0000","last_clean":"2024-09-21T07:48:34.147379+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:48:34.147379+0000","last_undegraded":"2024-09-21T07:48:34.147379+0000","last_fullsized":"2024-09-21T07:48:34.147379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086057+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:48:31.086057+0000","last_peered":"2024-09-21T07:48:31.086057+0000","last_clean":"2024-09-21T07:48:31.086057+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:48:31.086057+0000","last_undegraded":"2024-09-21T07:48:31.086057+0000","last_fullsized":"2024-09-21T07:48:31.086057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096920+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:48:31.096920+0000","last_peered":"2024-09-21T07:48:31.096920+0000","last_clean":"2024-09-21T07:48:31.096920+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:48:31.096920+0000","last_undegraded":"2024-09-21T07:48:31.096920+0000","last_fullsized":"2024-09-21T07:48:31.096920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":65,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:44.166368+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:48:44.166368+0000","last_peered":"2024-09-21T07:48:44.166368+0000","last_clean":"2024-09-21T07:48:44.166368+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:48:44.166368+0000","last_undegraded":"2024-09-21T07:48:44.166368+0000","last_fullsized":"2024-09-21T07:48:44.166368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092755+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:48:31.092755+0000","last_peered":"2024-09-21T07:48:31.092755+0000","last_clean":"2024-09-21T07:48:31.092755+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:48:31.092755+0000","last_undegraded":"2024-09-21T07:48:31.092755+0000","last_fullsized":"2024-09-21T07:48:31.092755+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113228+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:48:31.113228+0000","last_peered":"2024-09-21T07:48:31.113228+0000","last_clean":"2024-09-21T07:48:31.113228+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:48:31.113228+0000","last_undegraded":"2024-09-21T07:48:31.113228+0000","last_fullsized":"2024-09-21T07:48:31.113228+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086187+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:48:31.086187+0000","last_peered":"2024-09-21T07:48:31.086187+0000","last_clean":"2024-09-21T07:48:31.086187+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:48:31.086187+0000","last_undegraded":"2024-09-21T07:48:31.086187+0000","last_fullsized":"2024-09-21T07:48:31.086187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147669+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:48:34.147669+0000","last_peered":"2024-09-21T07:48:34.147669+0000","last_clean":"2024-09-21T07:48:34.147669+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:48:34.147669+0000","last_undegraded":"2024-09-21T07:48:34.147669+0000","last_fullsized":"2024-09-21T07:48:34.147669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090526+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:48:31.090526+0000","last_peered":"2024-09-21T07:48:31.090526+0000","last_clean":"2024-09-21T07:48:31.090526+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:48:31.090526+0000","last_undegraded":"2024-09-21T07:48:31.090526+0000","last_fullsized":"2024-09-21T07:48:31.090526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.120192+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:48:31.120192+0000","last_peered":"2024-09-21T07:48:31.120192+0000","last_clean":"2024-09-21T07:48:31.120192+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:48:31.120192+0000","last_undegraded":"2024-09-21T07:48:31.120192+0000","last_fullsized":"2024-09-21T07:48:31.120192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:32.128242+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:48:32.128242+0000","last_peered":"2024-09-21T07:48:32.128242+0000","last_clean":"2024-09-21T07:48:32.128242+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:48:32.128242+0000","last_undegraded":"2024-09-21T07:48:32.128242+0000","last_fullsized":"2024-09-21T07:48:32.128242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.133794+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:48:33.133794+0000","last_peered":"2024-09-21T07:48:33.133794+0000","last_clean":"2024-09-21T07:48:33.133794+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:48:33.133794+0000","last_undegraded":"2024-09-21T07:48:33.133794+0000","last_fullsized":"2024-09-21T07:48:33.133794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087384+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:48:31.087384+0000","last_peered":"2024-09-21T07:48:31.087384+0000","last_clean":"2024-09-21T07:48:31.087384+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:48:31.087384+0000","last_undegraded":"2024-09-21T07:48:31.087384+0000","last_fullsized":"2024-09-21T07:48:31.087384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.088949+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:48:31.088949+0000","last_peered":"2024-09-21T07:48:31.088949+0000","last_clean":"2024-09-21T07:48:31.088949+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:48:31.088949+0000","last_undegraded":"2024-09-21T07:48:31.088949+0000","last_fullsized":"2024-09-21T07:48:31.088949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:46.170623+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:48:46.170623+0000","last_peered":"2024-09-21T07:48:46.170623+0000","last_clean":"2024-09-21T07:48:46.170623+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:48:46.170623+0000","last_undegraded":"2024-09-21T07:48:46.170623+0000","last_fullsized":"2024-09-21T07:48:46.170623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092368+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:48:31.092368+0000","last_peered":"2024-09-21T07:48:31.092368+0000","last_clean":"2024-09-21T07:48:31.092368+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:48:31.092368+0000","last_undegraded":"2024-09-21T07:48:31.092368+0000","last_fullsized":"2024-09-21T07:48:31.092368+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089224+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:48:31.089224+0000","last_peered":"2024-09-21T07:48:31.089224+0000","last_clean":"2024-09-21T07:48:31.089224+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:48:31.089224+0000","last_undegraded":"2024-09-21T07:48:31.089224+0000","last_fullsized":"2024-09-21T07:48:31.089224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090241+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:48:31.090241+0000","last_peered":"2024-09-21T07:48:31.090241+0000","last_clean":"2024-09-21T07:48:31.090241+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:48:31.090241+0000","last_undegraded":"2024-09-21T07:48:31.090241+0000","last_fullsized":"2024-09-21T07:48:31.090241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.095506+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:48:31.095506+0000","last_peered":"2024-09-21T07:48:31.095506+0000","last_clean":"2024-09-21T07:48:31.095506+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:48:31.095506+0000","last_undegraded":"2024-09-21T07:48:31.095506+0000","last_fullsized":"2024-09-21T07:48:31.095506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089588+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:48:31.089588+0000","last_peered":"2024-09-21T07:48:31.089588+0000","last_clean":"2024-09-21T07:48:31.089588+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:48:31.089588+0000","last_undegraded":"2024-09-21T07:48:31.089588+0000","last_fullsized":"2024-09-21T07:48:31.089588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112577+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:48:31.112577+0000","last_peered":"2024-09-21T07:48:31.112577+0000","last_clean":"2024-09-21T07:48:31.112577+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:48:31.112577+0000","last_undegraded":"2024-09-21T07:48:31.112577+0000","last_fullsized":"2024-09-21T07:48:31.112577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119510+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:48:31.119510+0000","last_peered":"2024-09-21T07:48:31.119510+0000","last_clean":"2024-09-21T07:48:31.119510+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:48:31.119510+0000","last_undegraded":"2024-09-21T07:48:31.119510+0000","last_fullsized":"2024-09-21T07:48:31.119510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090284+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:48:31.090284+0000","last_peered":"2024-09-21T07:48:31.090284+0000","last_clean":"2024-09-21T07:48:31.090284+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:48:31.090284+0000","last_undegraded":"2024-09-21T07:48:31.090284+0000","last_fullsized":"2024-09-21T07:48:31.090284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089971+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:48:31.089971+0000","last_peered":"2024-09-21T07:48:31.089971+0000","last_clean":"2024-09-21T07:48:31.089971+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:48:31.089971+0000","last_undegraded":"2024-09-21T07:48:31.089971+0000","last_fullsized":"2024-09-21T07:48:31.089971+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.093427+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:48:31.093427+0000","last_peered":"2024-09-21T07:48:31.093427+0000","last_clean":"2024-09-21T07:48:31.093427+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:48:31.093427+0000","last_undegraded":"2024-09-21T07:48:31.093427+0000","last_fullsized":"2024-09-21T07:48:31.093427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086465+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:48:31.086465+0000","last_peered":"2024-09-21T07:48:31.086465+0000","last_clean":"2024-09-21T07:48:31.086465+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:48:31.086465+0000","last_undegraded":"2024-09-21T07:48:31.086465+0000","last_fullsized":"2024-09-21T07:48:31.086465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092930+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:48:31.092930+0000","last_peered":"2024-09-21T07:48:31.092930+0000","last_clean":"2024-09-21T07:48:31.092930+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:48:31.092930+0000","last_undegraded":"2024-09-21T07:48:31.092930+0000","last_fullsized":"2024-09-21T07:48:31.092930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096639+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:48:31.096639+0000","last_peered":"2024-09-21T07:48:31.096639+0000","last_clean":"2024-09-21T07:48:31.096639+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:48:31.096639+0000","last_undegraded":"2024-09-21T07:48:31.096639+0000","last_fullsized":"2024-09-21T07:48:31.096639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119605+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:48:31.119605+0000","last_peered":"2024-09-21T07:48:31.119605+0000","last_clean":"2024-09-21T07:48:31.119605+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:48:31.119605+0000","last_undegraded":"2024-09-21T07:48:31.119605+0000","last_fullsized":"2024-09-21T07:48:31.119605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.100731+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:48:31.100731+0000","last_peered":"2024-09-21T07:48:31.100731+0000","last_clean":"2024-09-21T07:48:31.100731+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:48:31.100731+0000","last_undegraded":"2024-09-21T07:48:31.100731+0000","last_fullsized":"2024-09-21T07:48:31.100731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089999+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:48:31.089999+0000","last_peered":"2024-09-21T07:48:31.089999+0000","last_clean":"2024-09-21T07:48:31.089999+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:48:31.089999+0000","last_undegraded":"2024-09-21T07:48:31.089999+0000","last_fullsized":"2024-09-21T07:48:31.089999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086791+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:48:31.086791+0000","last_peered":"2024-09-21T07:48:31.086791+0000","last_clean":"2024-09-21T07:48:31.086791+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:48:31.086791+0000","last_undegraded":"2024-09-21T07:48:31.086791+0000","last_fullsized":"2024-09-21T07:48:31.086791+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090970+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:48:31.090970+0000","last_peered":"2024-09-21T07:48:31.090970+0000","last_clean":"2024-09-21T07:48:31.090970+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:48:31.090970+0000","last_undegraded":"2024-09-21T07:48:31.090970+0000","last_fullsized":"2024-09-21T07:48:31.090970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.095917+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:48:31.095917+0000","last_peered":"2024-09-21T07:48:31.095917+0000","last_clean":"2024-09-21T07:48:31.095917+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:48:31.095917+0000","last_undegraded":"2024-09-21T07:48:31.095917+0000","last_fullsized":"2024-09-21T07:48:31.095917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111720+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:48:31.111720+0000","last_peered":"2024-09-21T07:48:31.111720+0000","last_clean":"2024-09-21T07:48:31.111720+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:48:31.111720+0000","last_undegraded":"2024-09-21T07:48:31.111720+0000","last_fullsized":"2024-09-21T07:48:31.111720+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112117+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:48:31.112117+0000","last_peered":"2024-09-21T07:48:31.112117+0000","last_clean":"2024-09-21T07:48:31.112117+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:48:31.112117+0000","last_undegraded":"2024-09-21T07:48:31.112117+0000","last_fullsized":"2024-09-21T07:48:31.112117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119497+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:48:31.119497+0000","last_peered":"2024-09-21T07:48:31.119497+0000","last_clean":"2024-09-21T07:48:31.119497+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:48:31.119497+0000","last_undegraded":"2024-09-21T07:48:31.119497+0000","last_fullsized":"2024-09-21T07:48:31.119497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112358+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:48:31.112358+0000","last_peered":"2024-09-21T07:48:31.112358+0000","last_clean":"2024-09-21T07:48:31.112358+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:48:31.112358+0000","last_undegraded":"2024-09-21T07:48:31.112358+0000","last_fullsized":"2024-09-21T07:48:31.112358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091996+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:48:31.091996+0000","last_peered":"2024-09-21T07:48:31.091996+0000","last_clean":"2024-09-21T07:48:31.091996+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:48:31.091996+0000","last_undegraded":"2024-09-21T07:48:31.091996+0000","last_fullsized":"2024-09-21T07:48:31.091996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087052+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:48:31.087052+0000","last_peered":"2024-09-21T07:48:31.087052+0000","last_clean":"2024-09-21T07:48:31.087052+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:48:31.087052+0000","last_undegraded":"2024-09-21T07:48:31.087052+0000","last_fullsized":"2024-09-21T07:48:31.087052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.097012+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:48:31.097012+0000","last_peered":"2024-09-21T07:48:31.097012+0000","last_clean":"2024-09-21T07:48:31.097012+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:48:31.097012+0000","last_undegraded":"2024-09-21T07:48:31.097012+0000","last_fullsized":"2024-09-21T07:48:31.097012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092308+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:48:31.092308+0000","last_peered":"2024-09-21T07:48:31.092308+0000","last_clean":"2024-09-21T07:48:31.092308+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:48:31.092308+0000","last_undegraded":"2024-09-21T07:48:31.092308+0000","last_fullsized":"2024-09-21T07:48:31.092308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091115+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:48:31.091115+0000","last_peered":"2024-09-21T07:48:31.091115+0000","last_clean":"2024-09-21T07:48:31.091115+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:48:31.091115+0000","last_undegraded":"2024-09-21T07:48:31.091115+0000","last_fullsized":"2024-09-21T07:48:31.091115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086818+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:48:31.086818+0000","last_peered":"2024-09-21T07:48:31.086818+0000","last_clean":"2024-09-21T07:48:31.086818+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:48:31.086818+0000","last_undegraded":"2024-09-21T07:48:31.086818+0000","last_fullsized":"2024-09-21T07:48:31.086818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091915+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:48:31.091915+0000","last_peered":"2024-09-21T07:48:31.091915+0000","last_clean":"2024-09-21T07:48:31.091915+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:48:31.091915+0000","last_undegraded":"2024-09-21T07:48:31.091915+0000","last_fullsized":"2024-09-21T07:48:31.091915+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112277+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:48:31.112277+0000","last_peered":"2024-09-21T07:48:31.112277+0000","last_clean":"2024-09-21T07:48:31.112277+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:48:31.112277+0000","last_undegraded":"2024-09-21T07:48:31.112277+0000","last_fullsized":"2024-09-21T07:48:31.112277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112834+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:48:31.112834+0000","last_peered":"2024-09-21T07:48:31.112834+0000","last_clean":"2024-09-21T07:48:31.112834+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:48:31.112834+0000","last_undegraded":"2024-09-21T07:48:31.112834+0000","last_fullsized":"2024-09-21T07:48:31.112834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113080+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:48:31.113080+0000","last_peered":"2024-09-21T07:48:31.113080+0000","last_clean":"2024-09-21T07:48:31.113080+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:48:31.113080+0000","last_undegraded":"2024-09-21T07:48:31.113080+0000","last_fullsized":"2024-09-21T07:48:31.113080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090924+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:48:31.090924+0000","last_peered":"2024-09-21T07:48:31.090924+0000","last_clean":"2024-09-21T07:48:31.090924+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:48:31.090924+0000","last_undegraded":"2024-09-21T07:48:31.090924+0000","last_fullsized":"2024-09-21T07:48:31.090924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55823,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":159,"num_read_kb":140,"num_write":237,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":167469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":507617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36980,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708172,"statfs":{"total":95995035648,"available":95957168128,"internally_reserved":0,"allocated":1675264,"data_stored":1142011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070502,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":510602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266731,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":506302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462961,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1613824,"data_stored":1103381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":502010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1098963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986241,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":506084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":501718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":552593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542225,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":551659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":503857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":50371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":51305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":50355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:48:52.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:48:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:53.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:53 smithi162 ceph-mon[34833]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:48:53.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:53 smithi162 ceph-mon[34833]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-21T07:48:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:53 smithi084 ceph-mon[30411]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:48:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:53 smithi084 ceph-mon[30411]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-21T07:48:53.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:53 smithi191 ceph-mon[34667]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:48:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:53 smithi191 ceph-mon[34667]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-21T07:48:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 -- 172.21.15.84:0/1200237786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d41039b0 msgr2=0x7f20d4103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 --2- 172.21.15.84:0/1200237786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d41039b0 0x7f20d4103dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009900 tx=0x7f20c402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 -- 172.21.15.84:0/1200237786 shutdown_connections 2024-09-21T07:48:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 --2- 172.21.15.84:0/1200237786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d4109c40 0x7f20d4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 --2- 172.21.15.84:0/1200237786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20d41092f0 0x7f20d4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 --2- 172.21.15.84:0/1200237786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d41039b0 0x7f20d4103dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 -- 172.21.15.84:0/1200237786 >> 172.21.15.84:0/1200237786 conn(0x7f20d40ff440 msgr2=0x7f20d4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 -- 172.21.15.84:0/1200237786 shutdown_connections 2024-09-21T07:48:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.650+0000 7f20d3e00640 1 -- 172.21.15.84:0/1200237786 wait complete. 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.651+0000 7f20d3e00640 1 Processor -- start 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3e00640 1 -- start start 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d41039b0 0x7f20d419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20d41092f0 0x7f20d419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4109c40 0x7f20d419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4113900 con 0x7f20d4109c40 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4113780 con 0x7f20d41039b0 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4113a80 con 0x7f20d41092f0 2024-09-21T07:48:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4109c40 0x7f20d419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20cbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20d41092f0 0x7f20d419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4109c40 0x7f20d419fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49254/0 (socket says 172.21.15.84:49254) 2024-09-21T07:48:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d3400640 1 -- 172.21.15.84:0/955909653 learned_addr learned my addr 172.21.15.84:0/955909653 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.652+0000 7f20d2a00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d41039b0 0x7f20d419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20d3400640 1 -- 172.21.15.84:0/955909653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20d41092f0 msgr2=0x7f20d419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20d3400640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20d41092f0 0x7f20d419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20d3400640 1 -- 172.21.15.84:0/955909653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d41039b0 msgr2=0x7f20d419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20d3400640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d41039b0 0x7f20d419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20d3400640 1 -- 172.21.15.84:0/955909653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d41a02c0 con 0x7f20d4109c40 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20d3400640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4109c40 0x7f20d419fb90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00eb10 tx=0x7f20cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20cb400640 1 -- 172.21.15.84:0/955909653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc004b20 con 0x7f20d4109c40 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20cb400640 1 -- 172.21.15.84:0/955909653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20cc004cc0 con 0x7f20d4109c40 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.653+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d41a05b0 con 0x7f20d4109c40 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.654+0000 7f20cb400640 1 -- 172.21.15.84:0/955909653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc010670 con 0x7f20d4109c40 2024-09-21T07:48:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.654+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41a6d10 con 0x7f20d4109c40 2024-09-21T07:48:53.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.655+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d4103dc0 con 0x7f20d4109c40 2024-09-21T07:48:53.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.657+0000 7f20cb400640 1 -- 172.21.15.84:0/955909653 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f20cc005020 con 0x7f20d4109c40 2024-09-21T07:48:53.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.658+0000 7f20cb400640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f20b80b65f0 0x7f20b80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:53.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.659+0000 7f20cb400640 1 -- 172.21.15.84:0/955909653 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f20cc0e7ef0 con 0x7f20d4109c40 2024-09-21T07:48:53.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.659+0000 7f20d2a00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f20b80b65f0 0x7f20b80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:53.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.659+0000 7f20d2a00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f20b80b65f0 0x7f20b80b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20c4031440 tx=0x7f20c4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:53.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.663+0000 7f20cb400640 1 -- 172.21.15.84:0/955909653 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20cc0ae200 con 0x7f20d4109c40 2024-09-21T07:48:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.849+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20d4063800 con 0x7f20b80b65f0 2024-09-21T07:48:53.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.859+0000 7f20cb400640 1 -- 172.21.15.84:0/955909653 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340401 (secure 0 0 0) 0x7f20d4063800 con 0x7f20b80b65f0 2024-09-21T07:48:53.864 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:53.866 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:48:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f20b80b65f0 msgr2=0x7f20b80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f20b80b65f0 0x7f20b80b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20c4031440 tx=0x7f20c4009560 comp rx=0 tx=0).stop 2024-09-21T07:48:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4109c40 msgr2=0x7f20d419fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4109c40 0x7f20d419fb90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00eb10 tx=0x7f20cc00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 shutdown_connections 2024-09-21T07:48:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f20b80b65f0 0x7f20b80b8b00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20d4109c40 0x7f20d419fb90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20d41092f0 0x7f20d419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 --2- 172.21.15.84:0/955909653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20d41039b0 0x7f20d419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.864+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 >> 172.21.15.84:0/955909653 conn(0x7f20d40ff440 msgr2=0x7f20d4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.865+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 shutdown_connections 2024-09-21T07:48:53.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:53.865+0000 7f20d3e00640 1 -- 172.21.15.84:0/955909653 wait complete. 2024-09-21T07:48:54.664 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-21T07:48:51.988032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659200,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":266,"num_read_kb":237,"num_write":365,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387992,"kb_used_data":13784,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553832,"statfs":{"total":1151940427776,"available":1151543123968,"internally_reserved":0,"allocated":14114816,"data_stored":8012347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":58060,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":130,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003988"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":67,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:46.168995+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:48:46.168995+0000","last_peered":"2024-09-21T07:48:46.168995+0000","last_clean":"2024-09-21T07:48:46.168995+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:48:46.168995+0000","last_undegraded":"2024-09-21T07:48:46.168995+0000","last_fullsized":"2024-09-21T07:48:46.168995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.094147+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:48:31.094147+0000","last_peered":"2024-09-21T07:48:31.094147+0000","last_clean":"2024-09-21T07:48:31.094147+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:48:31.094147+0000","last_undegraded":"2024-09-21T07:48:31.094147+0000","last_fullsized":"2024-09-21T07:48:31.094147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089220+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:48:31.089220+0000","last_peered":"2024-09-21T07:48:31.089220+0000","last_clean":"2024-09-21T07:48:31.089220+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:48:31.089220+0000","last_undegraded":"2024-09-21T07:48:31.089220+0000","last_fullsized":"2024-09-21T07:48:31.089220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.094379+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:48:31.094379+0000","last_peered":"2024-09-21T07:48:31.094379+0000","last_clean":"2024-09-21T07:48:31.094379+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:48:31.094379+0000","last_undegraded":"2024-09-21T07:48:31.094379+0000","last_fullsized":"2024-09-21T07:48:31.094379+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111723+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:48:31.111723+0000","last_peered":"2024-09-21T07:48:31.111723+0000","last_clean":"2024-09-21T07:48:31.111723+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:48:31.111723+0000","last_undegraded":"2024-09-21T07:48:31.111723+0000","last_fullsized":"2024-09-21T07:48:31.111723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111879+0000","last_change":"2024-09-21T07:47:49.755746+0000","last_active":"2024-09-21T07:48:31.111879+0000","last_peered":"2024-09-21T07:48:31.111879+0000","last_clean":"2024-09-21T07:48:31.111879+0000","last_became_active":"2024-09-21T07:47:49.755319+0000","last_became_peered":"2024-09-21T07:47:49.755319+0000","last_unstale":"2024-09-21T07:48:31.111879+0000","last_undegraded":"2024-09-21T07:48:31.111879+0000","last_fullsized":"2024-09-21T07:48:31.111879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:03.244616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:35.140924+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:48:35.140924+0000","last_peered":"2024-09-21T07:48:35.140924+0000","last_clean":"2024-09-21T07:48:35.140924+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:48:35.140924+0000","last_undegraded":"2024-09-21T07:48:35.140924+0000","last_fullsized":"2024-09-21T07:48:35.140924+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096433+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:48:31.096433+0000","last_peered":"2024-09-21T07:48:31.096433+0000","last_clean":"2024-09-21T07:48:31.096433+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:48:31.096433+0000","last_undegraded":"2024-09-21T07:48:31.096433+0000","last_fullsized":"2024-09-21T07:48:31.096433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112663+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:48:31.112663+0000","last_peered":"2024-09-21T07:48:31.112663+0000","last_clean":"2024-09-21T07:48:31.112663+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:48:31.112663+0000","last_undegraded":"2024-09-21T07:48:31.112663+0000","last_fullsized":"2024-09-21T07:48:31.112663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147475+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:48:34.147475+0000","last_peered":"2024-09-21T07:48:34.147475+0000","last_clean":"2024-09-21T07:48:34.147475+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:48:34.147475+0000","last_undegraded":"2024-09-21T07:48:34.147475+0000","last_fullsized":"2024-09-21T07:48:34.147475+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.088063+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:48:31.088063+0000","last_peered":"2024-09-21T07:48:31.088063+0000","last_clean":"2024-09-21T07:48:31.088063+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:48:31.088063+0000","last_undegraded":"2024-09-21T07:48:31.088063+0000","last_fullsized":"2024-09-21T07:48:31.088063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112023+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:48:31.112023+0000","last_peered":"2024-09-21T07:48:31.112023+0000","last_clean":"2024-09-21T07:48:31.112023+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:48:31.112023+0000","last_undegraded":"2024-09-21T07:48:31.112023+0000","last_fullsized":"2024-09-21T07:48:31.112023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091342+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:48:31.091342+0000","last_peered":"2024-09-21T07:48:31.091342+0000","last_clean":"2024-09-21T07:48:31.091342+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:48:31.091342+0000","last_undegraded":"2024-09-21T07:48:31.091342+0000","last_fullsized":"2024-09-21T07:48:31.091342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113541+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:48:31.113541+0000","last_peered":"2024-09-21T07:48:31.113541+0000","last_clean":"2024-09-21T07:48:31.113541+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:48:31.113541+0000","last_undegraded":"2024-09-21T07:48:31.113541+0000","last_fullsized":"2024-09-21T07:48:31.113541+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111719+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:48:31.111719+0000","last_peered":"2024-09-21T07:48:31.111719+0000","last_clean":"2024-09-21T07:48:31.111719+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:48:31.111719+0000","last_undegraded":"2024-09-21T07:48:31.111719+0000","last_fullsized":"2024-09-21T07:48:31.111719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092574+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:48:31.092574+0000","last_peered":"2024-09-21T07:48:31.092574+0000","last_clean":"2024-09-21T07:48:31.092574+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:48:31.092574+0000","last_undegraded":"2024-09-21T07:48:31.092574+0000","last_fullsized":"2024-09-21T07:48:31.092574+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.133080+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:48:33.133080+0000","last_peered":"2024-09-21T07:48:33.133080+0000","last_clean":"2024-09-21T07:48:33.133080+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:48:33.133080+0000","last_undegraded":"2024-09-21T07:48:33.133080+0000","last_fullsized":"2024-09-21T07:48:33.133080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111800+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:48:31.111800+0000","last_peered":"2024-09-21T07:48:31.111800+0000","last_clean":"2024-09-21T07:48:31.111800+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:48:31.111800+0000","last_undegraded":"2024-09-21T07:48:31.111800+0000","last_fullsized":"2024-09-21T07:48:31.111800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090374+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:48:31.090374+0000","last_peered":"2024-09-21T07:48:31.090374+0000","last_clean":"2024-09-21T07:48:31.090374+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:48:31.090374+0000","last_undegraded":"2024-09-21T07:48:31.090374+0000","last_fullsized":"2024-09-21T07:48:31.090374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.149409+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:48:34.149409+0000","last_peered":"2024-09-21T07:48:34.149409+0000","last_clean":"2024-09-21T07:48:34.149409+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:48:34.149409+0000","last_undegraded":"2024-09-21T07:48:34.149409+0000","last_fullsized":"2024-09-21T07:48:34.149409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086786+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:48:31.086786+0000","last_peered":"2024-09-21T07:48:31.086786+0000","last_clean":"2024-09-21T07:48:31.086786+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:48:31.086786+0000","last_undegraded":"2024-09-21T07:48:31.086786+0000","last_fullsized":"2024-09-21T07:48:31.086786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092946+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:48:31.092946+0000","last_peered":"2024-09-21T07:48:31.092946+0000","last_clean":"2024-09-21T07:48:31.092946+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:48:31.092946+0000","last_undegraded":"2024-09-21T07:48:31.092946+0000","last_fullsized":"2024-09-21T07:48:31.092946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.114737+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:48:31.114737+0000","last_peered":"2024-09-21T07:48:31.114737+0000","last_clean":"2024-09-21T07:48:31.114737+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:48:31.114737+0000","last_undegraded":"2024-09-21T07:48:31.114737+0000","last_fullsized":"2024-09-21T07:48:31.114737+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.115263+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:48:31.115263+0000","last_peered":"2024-09-21T07:48:31.115263+0000","last_clean":"2024-09-21T07:48:31.115263+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:48:31.115263+0000","last_undegraded":"2024-09-21T07:48:31.115263+0000","last_fullsized":"2024-09-21T07:48:31.115263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113349+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:48:31.113349+0000","last_peered":"2024-09-21T07:48:31.113349+0000","last_clean":"2024-09-21T07:48:31.113349+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:48:31.113349+0000","last_undegraded":"2024-09-21T07:48:31.113349+0000","last_fullsized":"2024-09-21T07:48:31.113349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.146326+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:48:34.146326+0000","last_peered":"2024-09-21T07:48:34.146326+0000","last_clean":"2024-09-21T07:48:34.146326+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:48:34.146326+0000","last_undegraded":"2024-09-21T07:48:34.146326+0000","last_fullsized":"2024-09-21T07:48:34.146326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089368+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:48:31.089368+0000","last_peered":"2024-09-21T07:48:31.089368+0000","last_clean":"2024-09-21T07:48:31.089368+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:48:31.089368+0000","last_undegraded":"2024-09-21T07:48:31.089368+0000","last_fullsized":"2024-09-21T07:48:31.089368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.093515+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:48:31.093515+0000","last_peered":"2024-09-21T07:48:31.093515+0000","last_clean":"2024-09-21T07:48:31.093515+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:48:31.093515+0000","last_undegraded":"2024-09-21T07:48:31.093515+0000","last_fullsized":"2024-09-21T07:48:31.093515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'13","reported_seq":53,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:46.720006+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:48:46.720006+0000","last_peered":"2024-09-21T07:48:46.720006+0000","last_clean":"2024-09-21T07:48:46.720006+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:48:46.720006+0000","last_undegraded":"2024-09-21T07:48:46.720006+0000","last_fullsized":"2024-09-21T07:48:46.720006+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092183+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:48:31.092183+0000","last_peered":"2024-09-21T07:48:31.092183+0000","last_clean":"2024-09-21T07:48:31.092183+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:48:31.092183+0000","last_undegraded":"2024-09-21T07:48:31.092183+0000","last_fullsized":"2024-09-21T07:48:31.092183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119577+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:48:31.119577+0000","last_peered":"2024-09-21T07:48:31.119577+0000","last_clean":"2024-09-21T07:48:31.119577+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:48:31.119577+0000","last_undegraded":"2024-09-21T07:48:31.119577+0000","last_fullsized":"2024-09-21T07:48:31.119577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.148580+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:48:34.148580+0000","last_peered":"2024-09-21T07:48:34.148580+0000","last_clean":"2024-09-21T07:48:34.148580+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:48:34.148580+0000","last_undegraded":"2024-09-21T07:48:34.148580+0000","last_fullsized":"2024-09-21T07:48:34.148580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090655+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:48:31.090655+0000","last_peered":"2024-09-21T07:48:31.090655+0000","last_clean":"2024-09-21T07:48:31.090655+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:48:31.090655+0000","last_undegraded":"2024-09-21T07:48:31.090655+0000","last_fullsized":"2024-09-21T07:48:31.090655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086741+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:48:31.086741+0000","last_peered":"2024-09-21T07:48:31.086741+0000","last_clean":"2024-09-21T07:48:31.086741+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:48:31.086741+0000","last_undegraded":"2024-09-21T07:48:31.086741+0000","last_fullsized":"2024-09-21T07:48:31.086741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086723+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:48:31.086723+0000","last_peered":"2024-09-21T07:48:31.086723+0000","last_clean":"2024-09-21T07:48:31.086723+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:48:31.086723+0000","last_undegraded":"2024-09-21T07:48:31.086723+0000","last_fullsized":"2024-09-21T07:48:31.086723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.098151+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:48:31.098151+0000","last_peered":"2024-09-21T07:48:31.098151+0000","last_clean":"2024-09-21T07:48:31.098151+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:48:31.098151+0000","last_undegraded":"2024-09-21T07:48:31.098151+0000","last_fullsized":"2024-09-21T07:48:31.098151+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087026+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:48:31.087026+0000","last_peered":"2024-09-21T07:48:31.087026+0000","last_clean":"2024-09-21T07:48:31.087026+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:48:31.087026+0000","last_undegraded":"2024-09-21T07:48:31.087026+0000","last_fullsized":"2024-09-21T07:48:31.087026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:48.172483+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:48:48.172483+0000","last_peered":"2024-09-21T07:48:48.172483+0000","last_clean":"2024-09-21T07:48:48.172483+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:48:48.172483+0000","last_undegraded":"2024-09-21T07:48:48.172483+0000","last_fullsized":"2024-09-21T07:48:48.172483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119321+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:48:31.119321+0000","last_peered":"2024-09-21T07:48:31.119321+0000","last_clean":"2024-09-21T07:48:31.119321+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:48:31.119321+0000","last_undegraded":"2024-09-21T07:48:31.119321+0000","last_fullsized":"2024-09-21T07:48:31.119321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086528+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:48:31.086528+0000","last_peered":"2024-09-21T07:48:31.086528+0000","last_clean":"2024-09-21T07:48:31.086528+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:48:31.086528+0000","last_undegraded":"2024-09-21T07:48:31.086528+0000","last_fullsized":"2024-09-21T07:48:31.086528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:48.172773+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:48:48.172773+0000","last_peered":"2024-09-21T07:48:48.172773+0000","last_clean":"2024-09-21T07:48:48.172773+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:48:48.172773+0000","last_undegraded":"2024-09-21T07:48:48.172773+0000","last_fullsized":"2024-09-21T07:48:48.172773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119969+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:48:31.119969+0000","last_peered":"2024-09-21T07:48:31.119969+0000","last_clean":"2024-09-21T07:48:31.119969+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:48:31.119969+0000","last_undegraded":"2024-09-21T07:48:31.119969+0000","last_fullsized":"2024-09-21T07:48:31.119969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.116261+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:48:31.116261+0000","last_peered":"2024-09-21T07:48:31.116261+0000","last_clean":"2024-09-21T07:48:31.116261+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:48:31.116261+0000","last_undegraded":"2024-09-21T07:48:31.116261+0000","last_fullsized":"2024-09-21T07:48:31.116261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:32.126424+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:48:32.126424+0000","last_peered":"2024-09-21T07:48:32.126424+0000","last_clean":"2024-09-21T07:48:32.126424+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:48:32.126424+0000","last_undegraded":"2024-09-21T07:48:32.126424+0000","last_fullsized":"2024-09-21T07:48:32.126424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.088678+0000","last_change":"2024-09-21T07:47:50.065836+0000","last_active":"2024-09-21T07:48:31.088678+0000","last_peered":"2024-09-21T07:48:31.088678+0000","last_clean":"2024-09-21T07:48:31.088678+0000","last_became_active":"2024-09-21T07:47:50.065284+0000","last_became_peered":"2024-09-21T07:47:50.065284+0000","last_unstale":"2024-09-21T07:48:31.088678+0000","last_undegraded":"2024-09-21T07:48:31.088678+0000","last_fullsized":"2024-09-21T07:48:31.088678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:31:51.956063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092698+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:48:31.092698+0000","last_peered":"2024-09-21T07:48:31.092698+0000","last_clean":"2024-09-21T07:48:31.092698+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:48:31.092698+0000","last_undegraded":"2024-09-21T07:48:31.092698+0000","last_fullsized":"2024-09-21T07:48:31.092698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:35.149320+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:48:35.149320+0000","last_peered":"2024-09-21T07:48:35.149320+0000","last_clean":"2024-09-21T07:48:35.149320+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:48:35.149320+0000","last_undegraded":"2024-09-21T07:48:35.149320+0000","last_fullsized":"2024-09-21T07:48:35.149320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091214+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:48:31.091214+0000","last_peered":"2024-09-21T07:48:31.091214+0000","last_clean":"2024-09-21T07:48:31.091214+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:48:31.091214+0000","last_undegraded":"2024-09-21T07:48:31.091214+0000","last_fullsized":"2024-09-21T07:48:31.091214+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091969+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:48:31.091969+0000","last_peered":"2024-09-21T07:48:31.091969+0000","last_clean":"2024-09-21T07:48:31.091969+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:48:31.091969+0000","last_undegraded":"2024-09-21T07:48:31.091969+0000","last_fullsized":"2024-09-21T07:48:31.091969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092053+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:48:31.092053+0000","last_peered":"2024-09-21T07:48:31.092053+0000","last_clean":"2024-09-21T07:48:31.092053+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:48:31.092053+0000","last_undegraded":"2024-09-21T07:48:31.092053+0000","last_fullsized":"2024-09-21T07:48:31.092053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":66,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:50.176559+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:48:50.176559+0000","last_peered":"2024-09-21T07:48:50.176559+0000","last_clean":"2024-09-21T07:48:50.176559+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:48:50.176559+0000","last_undegraded":"2024-09-21T07:48:50.176559+0000","last_fullsized":"2024-09-21T07:48:50.176559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096217+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:48:31.096217+0000","last_peered":"2024-09-21T07:48:31.096217+0000","last_clean":"2024-09-21T07:48:31.096217+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:48:31.096217+0000","last_undegraded":"2024-09-21T07:48:31.096217+0000","last_fullsized":"2024-09-21T07:48:31.096217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091814+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:48:31.091814+0000","last_peered":"2024-09-21T07:48:31.091814+0000","last_clean":"2024-09-21T07:48:31.091814+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:48:31.091814+0000","last_undegraded":"2024-09-21T07:48:31.091814+0000","last_fullsized":"2024-09-21T07:48:31.091814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.149031+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:48:34.149031+0000","last_peered":"2024-09-21T07:48:34.149031+0000","last_clean":"2024-09-21T07:48:34.149031+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:48:34.149031+0000","last_undegraded":"2024-09-21T07:48:34.149031+0000","last_fullsized":"2024-09-21T07:48:34.149031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112453+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:48:31.112453+0000","last_peered":"2024-09-21T07:48:31.112453+0000","last_clean":"2024-09-21T07:48:31.112453+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:48:31.112453+0000","last_undegraded":"2024-09-21T07:48:31.112453+0000","last_fullsized":"2024-09-21T07:48:31.112453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092064+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:48:31.092064+0000","last_peered":"2024-09-21T07:48:31.092064+0000","last_clean":"2024-09-21T07:48:31.092064+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:48:31.092064+0000","last_undegraded":"2024-09-21T07:48:31.092064+0000","last_fullsized":"2024-09-21T07:48:31.092064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147947+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:48:34.147947+0000","last_peered":"2024-09-21T07:48:34.147947+0000","last_clean":"2024-09-21T07:48:34.147947+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:48:34.147947+0000","last_undegraded":"2024-09-21T07:48:34.147947+0000","last_fullsized":"2024-09-21T07:48:34.147947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086291+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:48:31.086291+0000","last_peered":"2024-09-21T07:48:31.086291+0000","last_clean":"2024-09-21T07:48:31.086291+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:48:31.086291+0000","last_undegraded":"2024-09-21T07:48:31.086291+0000","last_fullsized":"2024-09-21T07:48:31.086291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090536+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:48:31.090536+0000","last_peered":"2024-09-21T07:48:31.090536+0000","last_clean":"2024-09-21T07:48:31.090536+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:48:31.090536+0000","last_undegraded":"2024-09-21T07:48:31.090536+0000","last_fullsized":"2024-09-21T07:48:31.090536+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.121471+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:48:33.121471+0000","last_peered":"2024-09-21T07:48:33.121471+0000","last_clean":"2024-09-21T07:48:33.121471+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:48:33.121471+0000","last_undegraded":"2024-09-21T07:48:33.121471+0000","last_fullsized":"2024-09-21T07:48:33.121471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086483+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:48:31.086483+0000","last_peered":"2024-09-21T07:48:31.086483+0000","last_clean":"2024-09-21T07:48:31.086483+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:48:31.086483+0000","last_undegraded":"2024-09-21T07:48:31.086483+0000","last_fullsized":"2024-09-21T07:48:31.086483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.118700+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:48:31.118700+0000","last_peered":"2024-09-21T07:48:31.118700+0000","last_clean":"2024-09-21T07:48:31.118700+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:48:31.118700+0000","last_undegraded":"2024-09-21T07:48:31.118700+0000","last_fullsized":"2024-09-21T07:48:31.118700+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.145954+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:48:34.145954+0000","last_peered":"2024-09-21T07:48:34.145954+0000","last_clean":"2024-09-21T07:48:34.145954+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:48:34.145954+0000","last_undegraded":"2024-09-21T07:48:34.145954+0000","last_fullsized":"2024-09-21T07:48:34.145954+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119920+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:48:31.119920+0000","last_peered":"2024-09-21T07:48:31.119920+0000","last_clean":"2024-09-21T07:48:31.119920+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:48:31.119920+0000","last_undegraded":"2024-09-21T07:48:31.119920+0000","last_fullsized":"2024-09-21T07:48:31.119920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090964+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:48:31.090964+0000","last_peered":"2024-09-21T07:48:31.090964+0000","last_clean":"2024-09-21T07:48:31.090964+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:48:31.090964+0000","last_undegraded":"2024-09-21T07:48:31.090964+0000","last_fullsized":"2024-09-21T07:48:31.090964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:47.171863+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:48:47.171863+0000","last_peered":"2024-09-21T07:48:47.171863+0000","last_clean":"2024-09-21T07:48:47.171863+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:48:47.171863+0000","last_undegraded":"2024-09-21T07:48:47.171863+0000","last_fullsized":"2024-09-21T07:48:47.171863+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.116685+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:48:31.116685+0000","last_peered":"2024-09-21T07:48:31.116685+0000","last_clean":"2024-09-21T07:48:31.116685+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:48:31.116685+0000","last_undegraded":"2024-09-21T07:48:31.116685+0000","last_fullsized":"2024-09-21T07:48:31.116685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091668+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:48:31.091668+0000","last_peered":"2024-09-21T07:48:31.091668+0000","last_clean":"2024-09-21T07:48:31.091668+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:48:31.091668+0000","last_undegraded":"2024-09-21T07:48:31.091668+0000","last_fullsized":"2024-09-21T07:48:31.091668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.149136+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:48:34.149136+0000","last_peered":"2024-09-21T07:48:34.149136+0000","last_clean":"2024-09-21T07:48:34.149136+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:48:34.149136+0000","last_undegraded":"2024-09-21T07:48:34.149136+0000","last_fullsized":"2024-09-21T07:48:34.149136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091646+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:48:31.091646+0000","last_peered":"2024-09-21T07:48:31.091646+0000","last_clean":"2024-09-21T07:48:31.091646+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:48:31.091646+0000","last_undegraded":"2024-09-21T07:48:31.091646+0000","last_fullsized":"2024-09-21T07:48:31.091646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.117466+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:48:31.117466+0000","last_peered":"2024-09-21T07:48:31.117466+0000","last_clean":"2024-09-21T07:48:31.117466+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:48:31.117466+0000","last_undegraded":"2024-09-21T07:48:31.117466+0000","last_fullsized":"2024-09-21T07:48:31.117466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:35.149201+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:48:35.149201+0000","last_peered":"2024-09-21T07:48:35.149201+0000","last_clean":"2024-09-21T07:48:35.149201+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:48:35.149201+0000","last_undegraded":"2024-09-21T07:48:35.149201+0000","last_fullsized":"2024-09-21T07:48:35.149201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087918+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:48:31.087918+0000","last_peered":"2024-09-21T07:48:31.087918+0000","last_clean":"2024-09-21T07:48:31.087918+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:48:31.087918+0000","last_undegraded":"2024-09-21T07:48:31.087918+0000","last_fullsized":"2024-09-21T07:48:31.087918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092204+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:48:31.092204+0000","last_peered":"2024-09-21T07:48:31.092204+0000","last_clean":"2024-09-21T07:48:31.092204+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:48:31.092204+0000","last_undegraded":"2024-09-21T07:48:31.092204+0000","last_fullsized":"2024-09-21T07:48:31.092204+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:49.178339+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:48:49.178339+0000","last_peered":"2024-09-21T07:48:49.178339+0000","last_clean":"2024-09-21T07:48:49.178339+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:48:49.178339+0000","last_undegraded":"2024-09-21T07:48:49.178339+0000","last_fullsized":"2024-09-21T07:48:49.178339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61394,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":78,"num_write":33,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086223+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:48:31.086223+0000","last_peered":"2024-09-21T07:48:31.086223+0000","last_clean":"2024-09-21T07:48:31.086223+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:48:31.086223+0000","last_undegraded":"2024-09-21T07:48:31.086223+0000","last_fullsized":"2024-09-21T07:48:31.086223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096500+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:48:31.096500+0000","last_peered":"2024-09-21T07:48:31.096500+0000","last_clean":"2024-09-21T07:48:31.096500+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:48:31.096500+0000","last_undegraded":"2024-09-21T07:48:31.096500+0000","last_fullsized":"2024-09-21T07:48:31.096500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.135172+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:48:33.135172+0000","last_peered":"2024-09-21T07:48:33.135172+0000","last_clean":"2024-09-21T07:48:33.135172+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:48:33.135172+0000","last_undegraded":"2024-09-21T07:48:33.135172+0000","last_fullsized":"2024-09-21T07:48:33.135172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112211+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:48:31.112211+0000","last_peered":"2024-09-21T07:48:31.112211+0000","last_clean":"2024-09-21T07:48:31.112211+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:48:31.112211+0000","last_undegraded":"2024-09-21T07:48:31.112211+0000","last_fullsized":"2024-09-21T07:48:31.112211+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111883+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:48:31.111883+0000","last_peered":"2024-09-21T07:48:31.111883+0000","last_clean":"2024-09-21T07:48:31.111883+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:48:31.111883+0000","last_undegraded":"2024-09-21T07:48:31.111883+0000","last_fullsized":"2024-09-21T07:48:31.111883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147379+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:48:34.147379+0000","last_peered":"2024-09-21T07:48:34.147379+0000","last_clean":"2024-09-21T07:48:34.147379+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:48:34.147379+0000","last_undegraded":"2024-09-21T07:48:34.147379+0000","last_fullsized":"2024-09-21T07:48:34.147379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086057+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:48:31.086057+0000","last_peered":"2024-09-21T07:48:31.086057+0000","last_clean":"2024-09-21T07:48:31.086057+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:48:31.086057+0000","last_undegraded":"2024-09-21T07:48:31.086057+0000","last_fullsized":"2024-09-21T07:48:31.086057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096920+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:48:31.096920+0000","last_peered":"2024-09-21T07:48:31.096920+0000","last_clean":"2024-09-21T07:48:31.096920+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:48:31.096920+0000","last_undegraded":"2024-09-21T07:48:31.096920+0000","last_fullsized":"2024-09-21T07:48:31.096920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":75,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:49.174160+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:48:49.174160+0000","last_peered":"2024-09-21T07:48:49.174160+0000","last_clean":"2024-09-21T07:48:49.174160+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:48:49.174160+0000","last_undegraded":"2024-09-21T07:48:49.174160+0000","last_fullsized":"2024-09-21T07:48:49.174160+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092755+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:48:31.092755+0000","last_peered":"2024-09-21T07:48:31.092755+0000","last_clean":"2024-09-21T07:48:31.092755+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:48:31.092755+0000","last_undegraded":"2024-09-21T07:48:31.092755+0000","last_fullsized":"2024-09-21T07:48:31.092755+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113228+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:48:31.113228+0000","last_peered":"2024-09-21T07:48:31.113228+0000","last_clean":"2024-09-21T07:48:31.113228+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:48:31.113228+0000","last_undegraded":"2024-09-21T07:48:31.113228+0000","last_fullsized":"2024-09-21T07:48:31.113228+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086187+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:48:31.086187+0000","last_peered":"2024-09-21T07:48:31.086187+0000","last_clean":"2024-09-21T07:48:31.086187+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:48:31.086187+0000","last_undegraded":"2024-09-21T07:48:31.086187+0000","last_fullsized":"2024-09-21T07:48:31.086187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:34.147669+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:48:34.147669+0000","last_peered":"2024-09-21T07:48:34.147669+0000","last_clean":"2024-09-21T07:48:34.147669+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:48:34.147669+0000","last_undegraded":"2024-09-21T07:48:34.147669+0000","last_fullsized":"2024-09-21T07:48:34.147669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090526+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:48:31.090526+0000","last_peered":"2024-09-21T07:48:31.090526+0000","last_clean":"2024-09-21T07:48:31.090526+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:48:31.090526+0000","last_undegraded":"2024-09-21T07:48:31.090526+0000","last_fullsized":"2024-09-21T07:48:31.090526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.120192+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:48:31.120192+0000","last_peered":"2024-09-21T07:48:31.120192+0000","last_clean":"2024-09-21T07:48:31.120192+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:48:31.120192+0000","last_undegraded":"2024-09-21T07:48:31.120192+0000","last_fullsized":"2024-09-21T07:48:31.120192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:32.128242+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:48:32.128242+0000","last_peered":"2024-09-21T07:48:32.128242+0000","last_clean":"2024-09-21T07:48:32.128242+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:48:32.128242+0000","last_undegraded":"2024-09-21T07:48:32.128242+0000","last_fullsized":"2024-09-21T07:48:32.128242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:33.133794+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:48:33.133794+0000","last_peered":"2024-09-21T07:48:33.133794+0000","last_clean":"2024-09-21T07:48:33.133794+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:48:33.133794+0000","last_undegraded":"2024-09-21T07:48:33.133794+0000","last_fullsized":"2024-09-21T07:48:33.133794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087384+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:48:31.087384+0000","last_peered":"2024-09-21T07:48:31.087384+0000","last_clean":"2024-09-21T07:48:31.087384+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:48:31.087384+0000","last_undegraded":"2024-09-21T07:48:31.087384+0000","last_fullsized":"2024-09-21T07:48:31.087384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.088949+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:48:31.088949+0000","last_peered":"2024-09-21T07:48:31.088949+0000","last_clean":"2024-09-21T07:48:31.088949+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:48:31.088949+0000","last_undegraded":"2024-09-21T07:48:31.088949+0000","last_fullsized":"2024-09-21T07:48:31.088949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:46.170623+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:48:46.170623+0000","last_peered":"2024-09-21T07:48:46.170623+0000","last_clean":"2024-09-21T07:48:46.170623+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:48:46.170623+0000","last_undegraded":"2024-09-21T07:48:46.170623+0000","last_fullsized":"2024-09-21T07:48:46.170623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092368+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:48:31.092368+0000","last_peered":"2024-09-21T07:48:31.092368+0000","last_clean":"2024-09-21T07:48:31.092368+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:48:31.092368+0000","last_undegraded":"2024-09-21T07:48:31.092368+0000","last_fullsized":"2024-09-21T07:48:31.092368+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089224+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:48:31.089224+0000","last_peered":"2024-09-21T07:48:31.089224+0000","last_clean":"2024-09-21T07:48:31.089224+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:48:31.089224+0000","last_undegraded":"2024-09-21T07:48:31.089224+0000","last_fullsized":"2024-09-21T07:48:31.089224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090241+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:48:31.090241+0000","last_peered":"2024-09-21T07:48:31.090241+0000","last_clean":"2024-09-21T07:48:31.090241+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:48:31.090241+0000","last_undegraded":"2024-09-21T07:48:31.090241+0000","last_fullsized":"2024-09-21T07:48:31.090241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.095506+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:48:31.095506+0000","last_peered":"2024-09-21T07:48:31.095506+0000","last_clean":"2024-09-21T07:48:31.095506+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:48:31.095506+0000","last_undegraded":"2024-09-21T07:48:31.095506+0000","last_fullsized":"2024-09-21T07:48:31.095506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089588+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:48:31.089588+0000","last_peered":"2024-09-21T07:48:31.089588+0000","last_clean":"2024-09-21T07:48:31.089588+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:48:31.089588+0000","last_undegraded":"2024-09-21T07:48:31.089588+0000","last_fullsized":"2024-09-21T07:48:31.089588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112577+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:48:31.112577+0000","last_peered":"2024-09-21T07:48:31.112577+0000","last_clean":"2024-09-21T07:48:31.112577+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:48:31.112577+0000","last_undegraded":"2024-09-21T07:48:31.112577+0000","last_fullsized":"2024-09-21T07:48:31.112577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119510+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:48:31.119510+0000","last_peered":"2024-09-21T07:48:31.119510+0000","last_clean":"2024-09-21T07:48:31.119510+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:48:31.119510+0000","last_undegraded":"2024-09-21T07:48:31.119510+0000","last_fullsized":"2024-09-21T07:48:31.119510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090284+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:48:31.090284+0000","last_peered":"2024-09-21T07:48:31.090284+0000","last_clean":"2024-09-21T07:48:31.090284+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:48:31.090284+0000","last_undegraded":"2024-09-21T07:48:31.090284+0000","last_fullsized":"2024-09-21T07:48:31.090284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089971+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:48:31.089971+0000","last_peered":"2024-09-21T07:48:31.089971+0000","last_clean":"2024-09-21T07:48:31.089971+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:48:31.089971+0000","last_undegraded":"2024-09-21T07:48:31.089971+0000","last_fullsized":"2024-09-21T07:48:31.089971+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.093427+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:48:31.093427+0000","last_peered":"2024-09-21T07:48:31.093427+0000","last_clean":"2024-09-21T07:48:31.093427+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:48:31.093427+0000","last_undegraded":"2024-09-21T07:48:31.093427+0000","last_fullsized":"2024-09-21T07:48:31.093427+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086465+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:48:31.086465+0000","last_peered":"2024-09-21T07:48:31.086465+0000","last_clean":"2024-09-21T07:48:31.086465+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:48:31.086465+0000","last_undegraded":"2024-09-21T07:48:31.086465+0000","last_fullsized":"2024-09-21T07:48:31.086465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092930+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:48:31.092930+0000","last_peered":"2024-09-21T07:48:31.092930+0000","last_clean":"2024-09-21T07:48:31.092930+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:48:31.092930+0000","last_undegraded":"2024-09-21T07:48:31.092930+0000","last_fullsized":"2024-09-21T07:48:31.092930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.096639+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:48:31.096639+0000","last_peered":"2024-09-21T07:48:31.096639+0000","last_clean":"2024-09-21T07:48:31.096639+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:48:31.096639+0000","last_undegraded":"2024-09-21T07:48:31.096639+0000","last_fullsized":"2024-09-21T07:48:31.096639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119605+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:48:31.119605+0000","last_peered":"2024-09-21T07:48:31.119605+0000","last_clean":"2024-09-21T07:48:31.119605+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:48:31.119605+0000","last_undegraded":"2024-09-21T07:48:31.119605+0000","last_fullsized":"2024-09-21T07:48:31.119605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.100731+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:48:31.100731+0000","last_peered":"2024-09-21T07:48:31.100731+0000","last_clean":"2024-09-21T07:48:31.100731+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:48:31.100731+0000","last_undegraded":"2024-09-21T07:48:31.100731+0000","last_fullsized":"2024-09-21T07:48:31.100731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.089999+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:48:31.089999+0000","last_peered":"2024-09-21T07:48:31.089999+0000","last_clean":"2024-09-21T07:48:31.089999+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:48:31.089999+0000","last_undegraded":"2024-09-21T07:48:31.089999+0000","last_fullsized":"2024-09-21T07:48:31.089999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086791+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:48:31.086791+0000","last_peered":"2024-09-21T07:48:31.086791+0000","last_clean":"2024-09-21T07:48:31.086791+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:48:31.086791+0000","last_undegraded":"2024-09-21T07:48:31.086791+0000","last_fullsized":"2024-09-21T07:48:31.086791+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090970+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:48:31.090970+0000","last_peered":"2024-09-21T07:48:31.090970+0000","last_clean":"2024-09-21T07:48:31.090970+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:48:31.090970+0000","last_undegraded":"2024-09-21T07:48:31.090970+0000","last_fullsized":"2024-09-21T07:48:31.090970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.095917+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:48:31.095917+0000","last_peered":"2024-09-21T07:48:31.095917+0000","last_clean":"2024-09-21T07:48:31.095917+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:48:31.095917+0000","last_undegraded":"2024-09-21T07:48:31.095917+0000","last_fullsized":"2024-09-21T07:48:31.095917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.111720+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:48:31.111720+0000","last_peered":"2024-09-21T07:48:31.111720+0000","last_clean":"2024-09-21T07:48:31.111720+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:48:31.111720+0000","last_undegraded":"2024-09-21T07:48:31.111720+0000","last_fullsized":"2024-09-21T07:48:31.111720+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112117+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:48:31.112117+0000","last_peered":"2024-09-21T07:48:31.112117+0000","last_clean":"2024-09-21T07:48:31.112117+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:48:31.112117+0000","last_undegraded":"2024-09-21T07:48:31.112117+0000","last_fullsized":"2024-09-21T07:48:31.112117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.119497+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:48:31.119497+0000","last_peered":"2024-09-21T07:48:31.119497+0000","last_clean":"2024-09-21T07:48:31.119497+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:48:31.119497+0000","last_undegraded":"2024-09-21T07:48:31.119497+0000","last_fullsized":"2024-09-21T07:48:31.119497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112358+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:48:31.112358+0000","last_peered":"2024-09-21T07:48:31.112358+0000","last_clean":"2024-09-21T07:48:31.112358+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:48:31.112358+0000","last_undegraded":"2024-09-21T07:48:31.112358+0000","last_fullsized":"2024-09-21T07:48:31.112358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091996+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:48:31.091996+0000","last_peered":"2024-09-21T07:48:31.091996+0000","last_clean":"2024-09-21T07:48:31.091996+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:48:31.091996+0000","last_undegraded":"2024-09-21T07:48:31.091996+0000","last_fullsized":"2024-09-21T07:48:31.091996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.087052+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:48:31.087052+0000","last_peered":"2024-09-21T07:48:31.087052+0000","last_clean":"2024-09-21T07:48:31.087052+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:48:31.087052+0000","last_undegraded":"2024-09-21T07:48:31.087052+0000","last_fullsized":"2024-09-21T07:48:31.087052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.097012+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:48:31.097012+0000","last_peered":"2024-09-21T07:48:31.097012+0000","last_clean":"2024-09-21T07:48:31.097012+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:48:31.097012+0000","last_undegraded":"2024-09-21T07:48:31.097012+0000","last_fullsized":"2024-09-21T07:48:31.097012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.092308+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:48:31.092308+0000","last_peered":"2024-09-21T07:48:31.092308+0000","last_clean":"2024-09-21T07:48:31.092308+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:48:31.092308+0000","last_undegraded":"2024-09-21T07:48:31.092308+0000","last_fullsized":"2024-09-21T07:48:31.092308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091115+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:48:31.091115+0000","last_peered":"2024-09-21T07:48:31.091115+0000","last_clean":"2024-09-21T07:48:31.091115+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:48:31.091115+0000","last_undegraded":"2024-09-21T07:48:31.091115+0000","last_fullsized":"2024-09-21T07:48:31.091115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.086818+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:48:31.086818+0000","last_peered":"2024-09-21T07:48:31.086818+0000","last_clean":"2024-09-21T07:48:31.086818+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:48:31.086818+0000","last_undegraded":"2024-09-21T07:48:31.086818+0000","last_fullsized":"2024-09-21T07:48:31.086818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.091915+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:48:31.091915+0000","last_peered":"2024-09-21T07:48:31.091915+0000","last_clean":"2024-09-21T07:48:31.091915+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:48:31.091915+0000","last_undegraded":"2024-09-21T07:48:31.091915+0000","last_fullsized":"2024-09-21T07:48:31.091915+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112277+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:48:31.112277+0000","last_peered":"2024-09-21T07:48:31.112277+0000","last_clean":"2024-09-21T07:48:31.112277+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:48:31.112277+0000","last_undegraded":"2024-09-21T07:48:31.112277+0000","last_fullsized":"2024-09-21T07:48:31.112277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.112834+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:48:31.112834+0000","last_peered":"2024-09-21T07:48:31.112834+0000","last_clean":"2024-09-21T07:48:31.112834+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:48:31.112834+0000","last_undegraded":"2024-09-21T07:48:31.112834+0000","last_fullsized":"2024-09-21T07:48:31.112834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.113080+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:48:31.113080+0000","last_peered":"2024-09-21T07:48:31.113080+0000","last_clean":"2024-09-21T07:48:31.113080+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:48:31.113080+0000","last_undegraded":"2024-09-21T07:48:31.113080+0000","last_fullsized":"2024-09-21T07:48:31.113080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T07:48:31.090924+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:48:31.090924+0000","last_peered":"2024-09-21T07:48:31.090924+0000","last_clean":"2024-09-21T07:48:31.090924+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:48:31.090924+0000","last_undegraded":"2024-09-21T07:48:31.090924+0000","last_fullsized":"2024-09-21T07:48:31.090924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68598,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":185,"num_read_kb":168,"num_write":240,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":193019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743452,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":507617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36992,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708160,"statfs":{"total":95995035648,"available":95957155840,"internally_reserved":0,"allocated":1687552,"data_stored":1154786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070502,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":510602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266732,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":506302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462961,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1613824,"data_stored":1103381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":502010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1098963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986241,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":506084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":501718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":565368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542225,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":551659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705751,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":503857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":50371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:48:54.669 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:48:54.669 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T07:48:54.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:48:55.072 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:55 smithi162 ceph-mon[34833]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:48:55.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:55 smithi162 ceph-mon[34833]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-09-21T07:48:55.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:55 smithi084 ceph-mon[30411]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:48:55.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:55 smithi084 ceph-mon[30411]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-09-21T07:48:55.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:55 smithi191 ceph-mon[34667]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:48:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:55 smithi191 ceph-mon[34667]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-09-21T07:48:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.721+0000 7fcc20c00640 1 -- 172.21.15.84:0/1411803442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 msgr2=0x7fcc1c112880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.721+0000 7fcc20c00640 1 --2- 172.21.15.84:0/1411803442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 0x7fcc1c112880 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009ca0 tx=0x7fcc1402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.722+0000 7fcc20c00640 1 -- 172.21.15.84:0/1411803442 shutdown_connections 2024-09-21T07:48:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.722+0000 7fcc20c00640 1 --2- 172.21.15.84:0/1411803442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 0x7fcc1c112880 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.722+0000 7fcc20c00640 1 --2- 172.21.15.84:0/1411803442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c10b700 0x7fcc1c10bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.722+0000 7fcc20c00640 1 --2- 172.21.15.84:0/1411803442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c105dc0 0x7fcc1c1061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:55.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.722+0000 7fcc20c00640 1 -- 172.21.15.84:0/1411803442 >> 172.21.15.84:0/1411803442 conn(0x7fcc1c1017d0 msgr2=0x7fcc1c103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:55.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.722+0000 7fcc20c00640 1 -- 172.21.15.84:0/1411803442 shutdown_connections 2024-09-21T07:48:55.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.722+0000 7fcc20c00640 1 -- 172.21.15.84:0/1411803442 wait complete. 2024-09-21T07:48:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 Processor -- start 2024-09-21T07:48:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 -- start start 2024-09-21T07:48:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c105dc0 0x7fcc1c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c10b700 0x7fcc1c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 0x7fcc1c1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c115d60 con 0x7fcc1c10c050 2024-09-21T07:48:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c115be0 con 0x7fcc1c105dc0 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.723+0000 7fcc20c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c115ee0 con 0x7fcc1c10b700 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c10b700 0x7fcc1c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc19e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c105dc0 0x7fcc1c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc1a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 0x7fcc1c1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c10b700 0x7fcc1c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:44810/0 (socket says 172.21.15.84:44810) 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc19e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c105dc0 0x7fcc1c19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53718/0 (socket says 172.21.15.84:53718) 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 -- 172.21.15.84:0/2340740858 learned_addr learned my addr 172.21.15.84:0/2340740858 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 -- 172.21.15.84:0/2340740858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c105dc0 msgr2=0x7fcc1c19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c105dc0 0x7fcc1c19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 -- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 msgr2=0x7fcc1c1a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 0x7fcc1c1a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:55.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.724+0000 7fcc11400640 1 -- 172.21.15.84:0/2340740858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c1a25d0 con 0x7fcc1c10b700 2024-09-21T07:48:55.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.725+0000 7fcc11400640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c10b700 0x7fcc1c19cc00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d950 tx=0x7fcc0400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:55.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.725+0000 7fcc13400640 1 -- 172.21.15.84:0/2340740858 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04017070 con 0x7fcc1c10b700 2024-09-21T07:48:55.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.725+0000 7fcc13400640 1 -- 172.21.15.84:0/2340740858 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc04009c30 con 0x7fcc1c10b700 2024-09-21T07:48:55.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.725+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1c1a28c0 con 0x7fcc1c10b700 2024-09-21T07:48:55.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.725+0000 7fcc13400640 1 -- 172.21.15.84:0/2340740858 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040047a0 con 0x7fcc1c10b700 2024-09-21T07:48:55.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.725+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c1a9020 con 0x7fcc1c10b700 2024-09-21T07:48:55.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.726+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1c1061d0 con 0x7fcc1c10b700 2024-09-21T07:48:55.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.729+0000 7fcc13400640 1 -- 172.21.15.84:0/2340740858 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fcc04004020 con 0x7fcc1c10b700 2024-09-21T07:48:55.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.731+0000 7fcc13400640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcc000b65f0 0x7fcc000b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:55.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.731+0000 7fcc13400640 1 -- 172.21.15.84:0/2340740858 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fcc040e7970 con 0x7fcc1c10b700 2024-09-21T07:48:55.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.731+0000 7fcc19e00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcc000b65f0 0x7fcc000b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:55.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.732+0000 7fcc19e00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcc000b65f0 0x7fcc000b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009bd0 tx=0x7fcc0c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:55.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.732+0000 7fcc13400640 1 -- 172.21.15.84:0/2340740858 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc04020020 con 0x7fcc1c10b700 2024-09-21T07:48:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.987+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fcc1c19d790 con 0x7fcc1c10b700 2024-09-21T07:48:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.995+0000 7fcc13400640 1 -- 172.21.15.84:0/2340740858 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fcc1c19d790 con 0x7fcc1c10b700 2024-09-21T07:48:55.997 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-09-21T07:48:55.998 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBneu5mCRsCOxAARzc6TGYt2HRdHJYPT3f73g== 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcc000b65f0 msgr2=0x7fcc000b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcc000b65f0 0x7fcc000b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009bd0 tx=0x7fcc0c005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c10b700 msgr2=0x7fcc1c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c10b700 0x7fcc1c19cc00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d950 tx=0x7fcc0400de10 comp rx=0 tx=0).stop 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 shutdown_connections 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcc000b65f0 0x7fcc000b8b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc1c10c050 0x7fcc1c1a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c10b700 0x7fcc1c19cc00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 --2- 172.21.15.84:0/2340740858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c105dc0 0x7fcc1c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 >> 172.21.15.84:0/2340740858 conn(0x7fcc1c1017d0 msgr2=0x7fcc1c108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 shutdown_connections 2024-09-21T07:48:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:55.998+0000 7fcc20c00640 1 -- 172.21.15.84:0/2340740858 wait complete. 2024-09-21T07:48:56.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:56 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2340740858' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:48:56.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:56 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:48:56.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:56 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:48:56.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:56 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2340740858' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:48:56.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:56 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:48:56.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:56 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:48:56.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:56 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2340740858' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:48:56.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:56 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:48:56.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:56 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:48:56.878 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:48:56.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T07:48:56.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:48:56.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T07:48:57.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:57 smithi162 ceph-mon[34833]: pgmap v327: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-21T07:48:57.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:57 smithi084 ceph-mon[30411]: pgmap v327: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-21T07:48:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:57.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:57 smithi191 ceph-mon[34667]: pgmap v327: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-21T07:48:57.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 -- 172.21.15.84:0/403699536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 msgr2=0x7f0848112520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 --2- 172.21.15.84:0/403699536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f0848112520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0840009ca0 tx=0x7f084002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 -- 172.21.15.84:0/403699536 shutdown_connections 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 --2- 172.21.15.84:0/403699536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f0848112520 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 --2- 172.21.15.84:0/403699536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0848076100 0x7f084810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 --2- 172.21.15.84:0/403699536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08480757b0 0x7f0848075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 -- 172.21.15.84:0/403699536 >> 172.21.15.84:0/403699536 conn(0x7f08480ff5d0 msgr2=0x7f0848101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 -- 172.21.15.84:0/403699536 shutdown_connections 2024-09-21T07:48:57.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.964+0000 7f084f200640 1 -- 172.21.15.84:0/403699536 wait complete. 2024-09-21T07:48:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.965+0000 7f084f200640 1 Processor -- start 2024-09-21T07:48:57.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084f200640 1 -- start start 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084f200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08480757b0 0x7f084819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0848076100 0x7f084819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f08481a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0848115ce0 con 0x7f08481100e0 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0848115b60 con 0x7f0848076100 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084f200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0848115e60 con 0x7f08480757b0 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f08481a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f08481a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54576/0 (socket says 172.21.15.84:54576) 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f084d200640 1 -- 172.21.15.84:0/935515789 learned_addr learned my addr 172.21.15.84:0/935515789 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f083f400640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0848076100 0x7f084819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.966+0000 7f0847e00640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08480757b0 0x7f084819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.967+0000 7f084d200640 1 -- 172.21.15.84:0/935515789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08480757b0 msgr2=0x7f084819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:57.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.967+0000 7f084d200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08480757b0 0x7f084819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.967+0000 7f084d200640 1 -- 172.21.15.84:0/935515789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0848076100 msgr2=0x7f084819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.967+0000 7f084d200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0848076100 0x7f084819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.967+0000 7f084d200640 1 -- 172.21.15.84:0/935515789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08481a2580 con 0x7f08481100e0 2024-09-21T07:48:57.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.967+0000 7f083f400640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0848076100 0x7f084819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:48:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.967+0000 7f084d200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f08481a1e50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f084002f540 tx=0x7f08400316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.968+0000 7f0845600640 1 -- 172.21.15.84:0/935515789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0840003b70 con 0x7f08481100e0 2024-09-21T07:48:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.968+0000 7f0845600640 1 -- 172.21.15.84:0/935515789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0840003d10 con 0x7f08481100e0 2024-09-21T07:48:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.968+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08481a2810 con 0x7f08481100e0 2024-09-21T07:48:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.968+0000 7f0845600640 1 -- 172.21.15.84:0/935515789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084002f990 con 0x7f08481100e0 2024-09-21T07:48:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.968+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08481a8fd0 con 0x7f08481100e0 2024-09-21T07:48:57.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.969+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0848075bc0 con 0x7f08481100e0 2024-09-21T07:48:57.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.973+0000 7f0845600640 1 -- 172.21.15.84:0/935515789 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f0840004b40 con 0x7f08481100e0 2024-09-21T07:48:57.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.974+0000 7f0845600640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f082c0b65f0 0x7f082c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:57.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.975+0000 7f0845600640 1 -- 172.21.15.84:0/935515789 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f0840108cf0 con 0x7f08481100e0 2024-09-21T07:48:57.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.975+0000 7f0847e00640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f082c0b65f0 0x7f082c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:57.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.975+0000 7f0847e00640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f082c0b65f0 0x7f082c0b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0838009bd0 tx=0x7f0838005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:57.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:57.977+0000 7f0845600640 1 -- 172.21.15.84:0/935515789 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08400cefa0 con 0x7f08481100e0 2024-09-21T07:48:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.168+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f08481a9200 con 0x7f08481100e0 2024-09-21T07:48:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.168+0000 7f0845600640 1 -- 172.21.15.84:0/935515789 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v57) ==== 86+0+133 (secure 0 0 0) 0x7f08400d3380 con 0x7f08481100e0 2024-09-21T07:48:58.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:48:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.170+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f082c0b65f0 msgr2=0x7f082c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.170+0000 7f084f200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f082c0b65f0 0x7f082c0b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0838009bd0 tx=0x7f0838005f90 comp rx=0 tx=0).stop 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.170+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 msgr2=0x7f08481a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.170+0000 7f084f200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f08481a1e50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f084002f540 tx=0x7f08400316f0 comp rx=0 tx=0).stop 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 shutdown_connections 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f082c0b65f0 0x7f082c0b8b00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08481100e0 0x7f08481a1e50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0848076100 0x7f084819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 --2- 172.21.15.84:0/935515789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08480757b0 0x7f084819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 >> 172.21.15.84:0/935515789 conn(0x7f08480ff5d0 msgr2=0x7f0848101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 shutdown_connections 2024-09-21T07:48:58.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:58.171+0000 7f084f200640 1 -- 172.21.15.84:0/935515789 wait complete. 2024-09-21T07:48:58.975 INFO:teuthology.orchestra.run.smithi084.stdout:[{"version":57,"timestamp":"2024-09-21T07:47:28.532599+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T07:48:58.976 INFO:tasks.ceph_manager:config epoch is 57 2024-09-21T07:48:58.976 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:48:58.976 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:48:58.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T07:48:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:59 smithi084 ceph-mon[30411]: pgmap v328: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-21T07:48:59.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:48:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/935515789' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:48:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:48:59.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:59 smithi191 ceph-mon[34667]: pgmap v328: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-21T07:48:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:48:59 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/935515789' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:48:59.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:59 smithi162 ceph-mon[34833]: pgmap v328: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-21T07:48:59.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:48:59 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/935515789' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:48:59.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 -- 172.21.15.84:0/3155458887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f294010c010 msgr2=0x7f2940112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:59.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 --2- 172.21.15.84:0/3155458887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f294010c010 0x7f2940112840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2938009ca0 tx=0x7f293802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:48:59.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 -- 172.21.15.84:0/3155458887 shutdown_connections 2024-09-21T07:48:59.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 --2- 172.21.15.84:0/3155458887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f294010c010 0x7f2940112840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:59.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 --2- 172.21.15.84:0/3155458887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f294010b6c0 0x7f294010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:59.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 --2- 172.21.15.84:0/3155458887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2940105d80 0x7f2940106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:59.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 -- 172.21.15.84:0/3155458887 >> 172.21.15.84:0/3155458887 conn(0x7f2940101810 msgr2=0x7f2940103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:48:59.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 -- 172.21.15.84:0/3155458887 shutdown_connections 2024-09-21T07:48:59.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.920+0000 7f2945400640 1 -- 172.21.15.84:0/3155458887 wait complete. 2024-09-21T07:48:59.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.921+0000 7f2945400640 1 Processor -- start 2024-09-21T07:48:59.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.921+0000 7f2945400640 1 -- start start 2024-09-21T07:48:59.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f2945400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2940105d80 0x7f294019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:59.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f2945400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294010b6c0 0x7f294019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:59.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f2945400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f294010c010 0x7f29401a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f2945400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2940115d20 con 0x7f2940105d80 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f2945400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2940115ba0 con 0x7f294010b6c0 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f2945400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2940115ea0 con 0x7f294010c010 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f293e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2940105d80 0x7f294019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f293e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2940105d80 0x7f294019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54598/0 (socket says 172.21.15.84:54598) 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f293e800640 1 -- 172.21.15.84:0/3689376865 learned_addr learned my addr 172.21.15.84:0/3689376865 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f293f200640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f294010c010 0x7f29401a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.922+0000 7f2935e00640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294010b6c0 0x7f294019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f293e800640 1 -- 172.21.15.84:0/3689376865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f294010c010 msgr2=0x7f29401a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f293e800640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f294010c010 0x7f29401a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f293e800640 1 -- 172.21.15.84:0/3689376865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294010b6c0 msgr2=0x7f294019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f293e800640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294010b6c0 0x7f294019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:48:59.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f293e800640 1 -- 172.21.15.84:0/3689376865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29401a25c0 con 0x7f2940105d80 2024-09-21T07:48:59.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f293e800640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2940105d80 0x7f294019c650 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f293000e9f0 tx=0x7f293000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:59.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f2937e00640 1 -- 172.21.15.84:0/3689376865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293000cd80 con 0x7f2940105d80 2024-09-21T07:48:59.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29401a28b0 con 0x7f2940105d80 2024-09-21T07:48:59.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f2937e00640 1 -- 172.21.15.84:0/3689376865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29300108e0 con 0x7f2940105d80 2024-09-21T07:48:59.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f2937e00640 1 -- 172.21.15.84:0/3689376865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930018980 con 0x7f2940105d80 2024-09-21T07:48:59.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.923+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29401a9010 con 0x7f2940105d80 2024-09-21T07:48:59.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.925+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2940106190 con 0x7f2940105d80 2024-09-21T07:48:59.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.929+0000 7f2937e00640 1 -- 172.21.15.84:0/3689376865 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2930010430 con 0x7f2940105d80 2024-09-21T07:48:59.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.930+0000 7f2937e00640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f29240b65f0 0x7f29240b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:48:59.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.930+0000 7f2937e00640 1 -- 172.21.15.84:0/3689376865 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f29300e8160 con 0x7f2940105d80 2024-09-21T07:48:59.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.930+0000 7f2935e00640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f29240b65f0 0x7f29240b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:48:59.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.931+0000 7f2935e00640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f29240b65f0 0x7f29240b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2940104ff0 tx=0x7f2928005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:48:59.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:48:59.932+0000 7f2937e00640 1 -- 172.21.15.84:0/3689376865 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29300b27f0 con 0x7f2940105d80 2024-09-21T07:49:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.169+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f294010de60 con 0x7f2940105d80 2024-09-21T07:49:00.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.175+0000 7f2937e00640 1 -- 172.21.15.84:0/3689376865 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) ==== 74+0+296452 (secure 0 0 0) 0x7f29300b7730 con 0x7f2940105d80 2024-09-21T07:49:00.181 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f29240b65f0 msgr2=0x7f29240b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f29240b65f0 0x7f29240b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2940104ff0 tx=0x7f2928005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2940105d80 msgr2=0x7f294019c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2940105d80 0x7f294019c650 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f293000e9f0 tx=0x7f293000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 shutdown_connections 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f29240b65f0 0x7f29240b8b00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f294010c010 0x7f29401a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294010b6c0 0x7f294019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 --2- 172.21.15.84:0/3689376865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2940105d80 0x7f294019c650 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 >> 172.21.15.84:0/3689376865 conn(0x7f2940101810 msgr2=0x7f294010acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 shutdown_connections 2024-09-21T07:49:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:00.180+0000 7f2945400640 1 -- 172.21.15.84:0/3689376865 wait complete. 2024-09-21T07:49:01.009 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2805742245},{"type":"v1","addr":"172.21.15.84:6801","nonce":2805742245}]},"active_addr":"172.21.15.84:6801/2805742245","active_change":"2024-09-21T07:40:29.868319+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24157,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24164,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.84:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1459844307}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3175774447}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2619465182}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2595460637}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":38361529}]}]} 2024-09-21T07:49:01.016 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T07:49:01.016 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T07:49:01.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:49:01.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:01 smithi084 ceph-mon[30411]: pgmap v329: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T07:49:01.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:01 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3689376865' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:49:01.387 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:01.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:01 smithi191 ceph-mon[34667]: pgmap v329: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T07:49:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:01 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3689376865' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:49:01.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:01 smithi162 ceph-mon[34833]: pgmap v329: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-21T07:49:01.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:01 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3689376865' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:49:01.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 -- 172.21.15.84:0/4042313781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d141094a0 msgr2=0x7f2d141098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:01.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 --2- 172.21.15.84:0/4042313781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d141094a0 0x7f2d141098b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009900 tx=0x7f2cfc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:01.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 -- 172.21.15.84:0/4042313781 shutdown_connections 2024-09-21T07:49:01.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 --2- 172.21.15.84:0/4042313781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14109df0 0x7f2d14110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:01.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 --2- 172.21.15.84:0/4042313781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d141094a0 0x7f2d141098b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:01.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 --2- 172.21.15.84:0/4042313781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d14103b60 0x7f2d14103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:01.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 -- 172.21.15.84:0/4042313781 >> 172.21.15.84:0/4042313781 conn(0x7f2d1407b850 msgr2=0x7f2d1407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:01.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 -- 172.21.15.84:0/4042313781 shutdown_connections 2024-09-21T07:49:01.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.988+0000 7f2d19600640 1 -- 172.21.15.84:0/4042313781 wait complete. 2024-09-21T07:49:01.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 Processor -- start 2024-09-21T07:49:01.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 -- start start 2024-09-21T07:49:01.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14103b60 0x7f2d14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:01.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d141094a0 0x7f2d14075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:01.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d14109df0 0x7f2d14076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:01.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14113ab0 con 0x7f2d14109df0 2024-09-21T07:49:01.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14113930 con 0x7f2d141094a0 2024-09-21T07:49:01.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.990+0000 7f2d19600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14113c30 con 0x7f2d14103b60 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d14109df0 0x7f2d14076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d14109df0 0x7f2d14076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54610/0 (socket says 172.21.15.84:54610) 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 -- 172.21.15.84:0/4044799838 learned_addr learned my addr 172.21.15.84:0/4044799838 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d0a000640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d141094a0 0x7f2d14075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d12a00640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14103b60 0x7f2d14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 -- 172.21.15.84:0/4044799838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14103b60 msgr2=0x7f2d14075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14103b60 0x7f2d14075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 -- 172.21.15.84:0/4044799838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d141094a0 msgr2=0x7f2d14075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d141094a0 0x7f2d14075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.991+0000 7f2d13400640 1 -- 172.21.15.84:0/4044799838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d141a8820 con 0x7f2d14109df0 2024-09-21T07:49:01.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.992+0000 7f2d13400640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d14109df0 0x7f2d14076190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00eb10 tx=0x7f2d0c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:01.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.992+0000 7f2d0be00640 1 -- 172.21.15.84:0/4044799838 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c004b20 con 0x7f2d14109df0 2024-09-21T07:49:01.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.992+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d141a8b10 con 0x7f2d14109df0 2024-09-21T07:49:01.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.992+0000 7f2d0be00640 1 -- 172.21.15.84:0/4044799838 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d0c004cc0 con 0x7f2d14109df0 2024-09-21T07:49:01.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.992+0000 7f2d0be00640 1 -- 172.21.15.84:0/4044799838 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c010690 con 0x7f2d14109df0 2024-09-21T07:49:01.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.992+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d141a9070 con 0x7f2d14109df0 2024-09-21T07:49:01.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.993+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d14103f70 con 0x7f2d14109df0 2024-09-21T07:49:01.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.995+0000 7f2d0be00640 1 -- 172.21.15.84:0/4044799838 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2d0c005020 con 0x7f2d14109df0 2024-09-21T07:49:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.997+0000 7f2d0be00640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cf80b65f0 0x7f2cf80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.997+0000 7f2d0be00640 1 -- 172.21.15.84:0/4044799838 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f2d0c0e7eb0 con 0x7f2d14109df0 2024-09-21T07:49:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.997+0000 7f2d12a00640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cf80b65f0 0x7f2cf80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:01.998+0000 7f2d12a00640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cf80b65f0 0x7f2cf80b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2d14077160 tx=0x7f2d0400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:02.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.001+0000 7f2d0be00640 1 -- 172.21.15.84:0/4044799838 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d0c0ae160 con 0x7f2d14109df0 2024-09-21T07:49:02.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.194+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d1402e640 con 0x7f2d14109df0 2024-09-21T07:49:02.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.196+0000 7f2d0be00640 1 -- 172.21.15.84:0/4044799838 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25051 (secure 0 0 0) 0x7f2d0c0d10e0 con 0x7f2d14109df0 2024-09-21T07:49:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:02.198 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:48:31.082446+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:49:02.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cf80b65f0 msgr2=0x7f2cf80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:02.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cf80b65f0 0x7f2cf80b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2d14077160 tx=0x7f2d0400b410 comp rx=0 tx=0).stop 2024-09-21T07:49:02.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d14109df0 msgr2=0x7f2d14076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:02.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d14109df0 0x7f2d14076190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00eb10 tx=0x7f2d0c00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 shutdown_connections 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2cf80b65f0 0x7f2cf80b8b00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d14109df0 0x7f2d14076190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d141094a0 0x7f2d14075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 --2- 172.21.15.84:0/4044799838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14103b60 0x7f2d14075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.198+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 >> 172.21.15.84:0/4044799838 conn(0x7f2d1407b850 msgr2=0x7f2d14105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.199+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 shutdown_connections 2024-09-21T07:49:02.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:02.199+0000 7f2d19600640 1 -- 172.21.15.84:0/4044799838 wait complete. 2024-09-21T07:49:02.928 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T07:49:02.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:49:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:03 smithi084 ceph-mon[30411]: pgmap v330: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T07:49:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4044799838' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:03 smithi191 ceph-mon[34667]: pgmap v330: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T07:49:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4044799838' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:03.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:03 smithi162 ceph-mon[34833]: pgmap v330: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T07:49:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4044799838' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.845+0000 7fca75a00640 1 -- 172.21.15.84:0/141353698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 msgr2=0x7fca70103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.845+0000 7fca75a00640 1 --2- 172.21.15.84:0/141353698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca70103da0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fca60009900 tx=0x7fca6002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.845+0000 7fca75a00640 1 -- 172.21.15.84:0/141353698 shutdown_connections 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.845+0000 7fca75a00640 1 --2- 172.21.15.84:0/141353698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca70109c20 0x7fca70110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.845+0000 7fca75a00640 1 --2- 172.21.15.84:0/141353698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092d0 0x7fca701096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.845+0000 7fca75a00640 1 --2- 172.21.15.84:0/141353698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca70103da0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.845+0000 7fca75a00640 1 -- 172.21.15.84:0/141353698 >> 172.21.15.84:0/141353698 conn(0x7fca700ff3e0 msgr2=0x7fca70101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:03.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.846+0000 7fca75a00640 1 -- 172.21.15.84:0/141353698 shutdown_connections 2024-09-21T07:49:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.846+0000 7fca75a00640 1 -- 172.21.15.84:0/141353698 wait complete. 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 Processor -- start 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 -- start start 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca7019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092d0 0x7fca7019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca70109c20 0x7fca701a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca70076da0 con 0x7fca70103990 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca70076c20 con 0x7fca70109c20 2024-09-21T07:49:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.847+0000 7fca75a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca70076f20 con 0x7fca701092d0 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca7019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca7019c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54624/0 (socket says 172.21.15.84:54624) 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 -- 172.21.15.84:0/2692801600 learned_addr learned my addr 172.21.15.84:0/2692801600 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca75000640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca70109c20 0x7fca701a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6f400640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092d0 0x7fca7019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 -- 172.21.15.84:0/2692801600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092d0 msgr2=0x7fca7019caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092d0 0x7fca7019caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 -- 172.21.15.84:0/2692801600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca70109c20 msgr2=0x7fca701a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca70109c20 0x7fca701a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 -- 172.21.15.84:0/2692801600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca701a24c0 con 0x7fca70103990 2024-09-21T07:49:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.848+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca7019c550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fca60005940 tx=0x7fca60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.849+0000 7fca6cc00640 1 -- 172.21.15.84:0/2692801600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6003f030 con 0x7fca70103990 2024-09-21T07:49:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.849+0000 7fca6cc00640 1 -- 172.21.15.84:0/2692801600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca60003aa0 con 0x7fca70103990 2024-09-21T07:49:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.849+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca701a2750 con 0x7fca70103990 2024-09-21T07:49:03.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.849+0000 7fca6cc00640 1 -- 172.21.15.84:0/2692801600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60035070 con 0x7fca70103990 2024-09-21T07:49:03.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.849+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca701a8f10 con 0x7fca70103990 2024-09-21T07:49:03.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.850+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca70104c10 con 0x7fca70103990 2024-09-21T07:49:03.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.852+0000 7fca6cc00640 1 -- 172.21.15.84:0/2692801600 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fca60042030 con 0x7fca70103990 2024-09-21T07:49:03.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.854+0000 7fca6cc00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b65f0 0x7fca540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:03.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.854+0000 7fca6cc00640 1 -- 172.21.15.84:0/2692801600 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fca60108270 con 0x7fca70103990 2024-09-21T07:49:03.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.854+0000 7fca6f400640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b65f0 0x7fca540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:03.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.855+0000 7fca6f400640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b65f0 0x7fca540b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca70102aa0 tx=0x7fca5c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:03.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:03.857+0000 7fca6cc00640 1 -- 172.21.15.84:0/2692801600 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca600d2960 con 0x7fca70103990 2024-09-21T07:49:04.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.044+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca70103da0 con 0x7fca70103990 2024-09-21T07:49:04.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.045+0000 7fca6cc00640 1 -- 172.21.15.84:0/2692801600 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+25051 (secure 0 0 0) 0x7fca600d78a0 con 0x7fca70103990 2024-09-21T07:49:04.047 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:04.048 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:48:31.082446+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:49:04.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.047+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b65f0 msgr2=0x7fca540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:04.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.047+0000 7fca75a00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b65f0 0x7fca540b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca70102aa0 tx=0x7fca5c005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.047+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 msgr2=0x7fca7019c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca7019c550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fca60005940 tx=0x7fca60004270 comp rx=0 tx=0).stop 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 shutdown_connections 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b65f0 0x7fca540b8b00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca70109c20 0x7fca701a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092d0 0x7fca7019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 --2- 172.21.15.84:0/2692801600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70103990 0x7fca7019c550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 >> 172.21.15.84:0/2692801600 conn(0x7fca700ff3e0 msgr2=0x7fca70108810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 shutdown_connections 2024-09-21T07:49:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:04.048+0000 7fca75a00640 1 -- 172.21.15.84:0/2692801600 wait complete. 2024-09-21T07:49:04.098 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:04 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2692801600' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:04 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2692801600' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:04.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:04 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2692801600' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:04.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T07:49:04.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T07:49:04.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T07:49:04.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T07:49:04.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T07:49:04.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T07:49:04.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T07:49:04.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T07:49:04.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T07:49:04.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T07:49:04.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T07:49:04.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T07:49:05.312 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:05 smithi084 ceph-mon[30411]: pgmap v331: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T07:49:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:05 smithi191 ceph-mon[34667]: pgmap v331: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T07:49:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:05 smithi162 ceph-mon[34833]: pgmap v331: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T07:49:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.087 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.091 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.095 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.205 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.205 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.739 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:06.740 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:07.180 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:07 smithi084 ceph-mon[30411]: pgmap v332: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:49:07.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.305+0000 7ff4f3000640 1 -- 172.21.15.84:0/3260384923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 msgr2=0x7ff4ec104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.305+0000 7ff4f3000640 1 --2- 172.21.15.84:0/3260384923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 0x7ff4ec104dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009900 tx=0x7ff4dc02a410 comp rx=0 tx=0).stop 2024-09-21T07:49:07.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.305+0000 7ff4f3000640 1 -- 172.21.15.84:0/3260384923 shutdown_connections 2024-09-21T07:49:07.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.305+0000 7ff4f3000640 1 --2- 172.21.15.84:0/3260384923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4ec10de20 0x7ff4ec110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.305+0000 7ff4f3000640 1 --2- 172.21.15.84:0/3260384923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4ec105310 0x7ff4ec10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.305+0000 7ff4f3000640 1 --2- 172.21.15.84:0/3260384923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 0x7ff4ec104dd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.305+0000 7ff4f3000640 1 -- 172.21.15.84:0/3260384923 >> 172.21.15.84:0/3260384923 conn(0x7ff4ec0796e0 msgr2=0x7ff4ec079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:07.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.306+0000 7ff4f3000640 1 -- 172.21.15.84:0/3260384923 shutdown_connections 2024-09-21T07:49:07.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.306+0000 7ff4f3000640 1 -- 172.21.15.84:0/3260384923 wait complete. 2024-09-21T07:49:07.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.307+0000 7ff4f3000640 1 Processor -- start 2024-09-21T07:49:07.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.307+0000 7ff4f3000640 1 -- start start 2024-09-21T07:49:07.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4f3000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 0x7ff4ec19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4f3000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4ec105310 0x7ff4ec19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4f3000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4ec10de20 0x7ff4ec19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4f3000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec113a80 con 0x7ff4ec1049c0 2024-09-21T07:49:07.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4f3000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec113900 con 0x7ff4ec10de20 2024-09-21T07:49:07.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4f3000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec113c00 con 0x7ff4ec105310 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 0x7ff4ec19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4e3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4ec105310 0x7ff4ec19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 0x7ff4ec19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54670/0 (socket says 172.21.15.84:54670) 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4ebe00640 1 -- 172.21.15.84:0/2186323871 learned_addr learned my addr 172.21.15.84:0/2186323871 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.308+0000 7ff4f1000640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4ec10de20 0x7ff4ec19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e3400640 1 -- 172.21.15.84:0/2186323871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4ec10de20 msgr2=0x7ff4ec19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e3400640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4ec10de20 0x7ff4ec19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e3400640 1 -- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 msgr2=0x7ff4ec19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e3400640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 0x7ff4ec19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e3400640 1 -- 172.21.15.84:0/2186323871 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec1a0460 con 0x7ff4ec105310 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4ebe00640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4ec1049c0 0x7ff4ec19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e3400640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4ec105310 0x7ff4ec19aa90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec06b970 tx=0x7ff4d400ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4009e60 con 0x7ff4ec105310 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec1a0750 con 0x7ff4ec105310 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d400ccc0 con 0x7ff4ec105310 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40187a0 con 0x7ff4ec105310 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.309+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec1a6eb0 con 0x7ff4ec105310 2024-09-21T07:49:07.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.310+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4ec063b50 con 0x7ff4ec105310 2024-09-21T07:49:07.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.313+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff4d4010430 con 0x7ff4ec105310 2024-09-21T07:49:07.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.314+0000 7ff4e9600640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff4d00b65f0 0x7ff4d00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.315+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7ff4d40e83c0 con 0x7ff4ec105310 2024-09-21T07:49:07.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.315+0000 7ff4ebe00640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff4d00b65f0 0x7ff4d00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.315+0000 7ff4e9600640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] conn(0x7ff4d00c1900 0x7ff4d00c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.315+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 --> [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4d4015e80 con 0x7ff4d00c1900 2024-09-21T07:49:07.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.315+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7ff4d40e8770 con 0x7ff4ec105310 2024-09-21T07:49:07.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.315+0000 7ff4f1000640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] conn(0x7ff4d00c1900 0x7ff4d00c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.316+0000 7ff4ebe00640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff4d00b65f0 0x7ff4d00b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc031440 tx=0x7ff4dc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:07.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.316+0000 7ff4f1000640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] conn(0x7ff4d00c1900 0x7ff4d00c3df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:07.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.317+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== osd.11 v2:172.21.15.191:6824/577807248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4d4015e80 con 0x7ff4d00c1900 2024-09-21T07:49:07.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.331+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 --> [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4ec063fd0 con 0x7ff4d00c1900 2024-09-21T07:49:07.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4e9600640 1 -- 172.21.15.84:0/2186323871 <== osd.11 v2:172.21.15.191:6824/577807248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff4ec063fd0 con 0x7ff4d00c1900 2024-09-21T07:49:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] conn(0x7ff4d00c1900 msgr2=0x7ff4d00c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4f3000640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] conn(0x7ff4d00c1900 0x7ff4d00c3df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff4d00b65f0 msgr2=0x7ff4d00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4f3000640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff4d00b65f0 0x7ff4d00b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc031440 tx=0x7ff4dc0058d0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4ec105310 msgr2=0x7ff4ec19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4f3000640 1 --2- 172.21.15.84:0/2186323871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4ec105310 0x7ff4ec19aa90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec06b970 tx=0x7ff4d400ed90 comp rx=0 tx=0).stop 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.332+0000 7ff4f1000640 1 -- 172.21.15.84:0/2186323871 reap_dead start 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.333+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 shutdown_connections 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.333+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 >> 172.21.15.84:0/2186323871 conn(0x7ff4ec0796e0 msgr2=0x7ff4ec100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.333+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 shutdown_connections 2024-09-21T07:49:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.333+0000 7ff4f3000640 1 -- 172.21.15.84:0/2186323871 wait complete. 2024-09-21T07:49:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 -- 172.21.15.84:0/4106525043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65141092f0 msgr2=0x7f6514109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 --2- 172.21.15.84:0/4106525043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65141092f0 0x7f6514109700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6500009900 tx=0x7f650002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 -- 172.21.15.84:0/4106525043 shutdown_connections 2024-09-21T07:49:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 --2- 172.21.15.84:0/4106525043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6514109c40 0x7f6514110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 --2- 172.21.15.84:0/4106525043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65141092f0 0x7f6514109700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 --2- 172.21.15.84:0/4106525043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65141039b0 0x7f6514103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 -- 172.21.15.84:0/4106525043 >> 172.21.15.84:0/4106525043 conn(0x7f65140ff440 msgr2=0x7f6514101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 -- 172.21.15.84:0/4106525043 shutdown_connections 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.179+0000 7f651a400640 1 -- 172.21.15.84:0/4106525043 wait complete. 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.180+0000 7f651a400640 1 Processor -- start 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.180+0000 7f651a400640 1 -- start start 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f651a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65141039b0 0x7f651419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f651a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65141092f0 0x7f651419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f651a400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6514109c40 0x7f651419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f651a400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6514113900 con 0x7f65141092f0 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f651a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6514113780 con 0x7f65141039b0 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f651a400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6514113a80 con 0x7f6514109c40 2024-09-21T07:49:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f6513e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65141092f0 0x7f651419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f6513e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65141092f0 0x7f651419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54648/0 (socket says 172.21.15.84:54648) 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f6513e00640 1 -- 172.21.15.84:0/4141960006 learned_addr learned my addr 172.21.15.84:0/4141960006 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f6519a00640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6514109c40 0x7f651419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.181+0000 7f6519000640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65141039b0 0x7f651419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.182+0000 7f6513e00640 1 -- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6514109c40 msgr2=0x7f651419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.182+0000 7f6513e00640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6514109c40 0x7f651419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.182+0000 7f6513e00640 1 -- 172.21.15.84:0/4141960006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65141039b0 msgr2=0x7f651419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.182+0000 7f6513e00640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65141039b0 0x7f651419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.182+0000 7f6513e00640 1 -- 172.21.15.84:0/4141960006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65141a0280 con 0x7f65141092f0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.182+0000 7f6513e00640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65141092f0 0x7f651419a8b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f650002a910 tx=0x7f6500031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.183+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650003f030 con 0x7f65141092f0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.183+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65141a0510 con 0x7f65141092f0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.183+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65000043d0 con 0x7f65141092f0 2024-09-21T07:49:07.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.183+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500035070 con 0x7f65141092f0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.183+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65141a6cd0 con 0x7f65141092f0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.184+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6514063b50 con 0x7f65141092f0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.186+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f6500042030 con 0x7f65141092f0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.188+0000 7f6511600640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64fc0b65f0 0x7f64fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.188+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f6500108050 con 0x7f65141092f0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.188+0000 7f6519000640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64fc0b65f0 0x7f64fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.188+0000 7f6511600640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] conn(0x7f64fc0c1900 0x7f64fc0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.188+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 --> [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6500044e50 con 0x7f64fc0c1900 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.188+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f65001084a0 con 0x7f65141092f0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.188+0000 7f6519a00640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] conn(0x7f64fc0c1900 0x7f64fc0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.189+0000 7f6519000640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64fc0b65f0 0x7f64fc0b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6508009bd0 tx=0x7f6508005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.189+0000 7f6519a00640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] conn(0x7f64fc0c1900 0x7f64fc0c3df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.190+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== osd.2 v2:172.21.15.191:6800/2171931700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6500044e50 con 0x7f64fc0c1900 2024-09-21T07:49:07.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.206+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 --> [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6514063f50 con 0x7f64fc0c1900 2024-09-21T07:49:07.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.206+0000 7f6511600640 1 -- 172.21.15.84:0/4141960006 <== osd.2 v2:172.21.15.191:6800/2171931700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6514063f50 con 0x7f64fc0c1900 2024-09-21T07:49:07.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] conn(0x7f64fc0c1900 msgr2=0x7f64fc0c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] conn(0x7f64fc0c1900 0x7f64fc0c3df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:07.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64fc0b65f0 msgr2=0x7f64fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64fc0b65f0 0x7f64fc0b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6508009bd0 tx=0x7f6508005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65141092f0 msgr2=0x7f651419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 --2- 172.21.15.84:0/4141960006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65141092f0 0x7f651419a8b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f650002a910 tx=0x7f6500031a20 comp rx=0 tx=0).stop 2024-09-21T07:49:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f6519a00640 1 -- 172.21.15.84:0/4141960006 reap_dead start 2024-09-21T07:49:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 shutdown_connections 2024-09-21T07:49:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 >> 172.21.15.84:0/4141960006 conn(0x7f65140ff440 msgr2=0x7f6514101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 shutdown_connections 2024-09-21T07:49:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:07.207+0000 7f651a400640 1 -- 172.21.15.84:0/4141960006 wait complete. 2024-09-21T07:49:07.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:07 smithi191 ceph-mon[34667]: pgmap v332: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:49:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:07 smithi162 ceph-mon[34833]: pgmap v332: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:49:08.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 -- 172.21.15.84:0/2887505785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c01094c0 msgr2=0x7f28c01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 --2- 172.21.15.84:0/2887505785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c01094c0 0x7f28c01098d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009900 tx=0x7f28ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 -- 172.21.15.84:0/2887505785 shutdown_connections 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 --2- 172.21.15.84:0/2887505785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28c0109e10 0x7f28c0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 --2- 172.21.15.84:0/2887505785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c01094c0 0x7f28c01098d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 --2- 172.21.15.84:0/2887505785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28c0103b80 0x7f28c0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 -- 172.21.15.84:0/2887505785 >> 172.21.15.84:0/2887505785 conn(0x7f28c00ff590 msgr2=0x7f28c01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 -- 172.21.15.84:0/2887505785 shutdown_connections 2024-09-21T07:49:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.596+0000 7f28c5400640 1 -- 172.21.15.84:0/2887505785 wait complete. 2024-09-21T07:49:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.597+0000 7f28c5400640 1 Processor -- start 2024-09-21T07:49:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28c5400640 1 -- start start 2024-09-21T07:49:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28c5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c0103b80 0x7f28c019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28c5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28c01094c0 0x7f28c019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28c5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28c0109e10 0x7f28c019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28c5400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f28c0113ad0 con 0x7f28c0103b80 2024-09-21T07:49:08.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28c5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28c0113950 con 0x7f28c01094c0 2024-09-21T07:49:08.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28c5400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f28c0113c50 con 0x7f28c0109e10 2024-09-21T07:49:08.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.598+0000 7f28bf200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28c0109e10 0x7f28c019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bf200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28c0109e10 0x7f28c019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48278/0 (socket says 172.21.15.84:48278) 2024-09-21T07:49:08.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bf200640 1 -- 172.21.15.84:0/1558450557 learned_addr learned my addr 172.21.15.84:0/1558450557 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bde00640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28c01094c0 0x7f28c019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28be800640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c0103b80 0x7f28c019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bf200640 1 -- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28c01094c0 msgr2=0x7f28c019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bf200640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28c01094c0 0x7f28c019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bf200640 1 -- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c0103b80 msgr2=0x7f28c019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bf200640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c0103b80 0x7f28c019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28bf200640 1 -- 172.21.15.84:0/1558450557 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c01a0490 con 0x7f28c0109e10 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.599+0000 7f28be800640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c0103b80 0x7f28c019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.600+0000 7f28bf200640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28c0109e10 0x7f28c019fd60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28b800eb10 tx=0x7f28b800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.600+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8004b20 con 0x7f28c0109e10 2024-09-21T07:49:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.600+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28b8004cc0 con 0x7f28c0109e10 2024-09-21T07:49:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.600+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8010670 con 0x7f28c0109e10 2024-09-21T07:49:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.600+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c01a0780 con 0x7f28c0109e10 2024-09-21T07:49:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.600+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c01a6ee0 con 0x7f28c0109e10 2024-09-21T07:49:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.601+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28c0063b50 con 0x7f28c0109e10 2024-09-21T07:49:08.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.604+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f28b8005000 con 0x7f28c0109e10 2024-09-21T07:49:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.605+0000 7f28b7400640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a40b6670 0x7f28a40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 -- 172.21.15.84:0/3337171159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9d8109c40 msgr2=0x7fc9d8110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 --2- 172.21.15.84:0/3337171159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9d8109c40 0x7fc9d8110470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0009ca0 tx=0x7fc9d002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 -- 172.21.15.84:0/3337171159 shutdown_connections 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 --2- 172.21.15.84:0/3337171159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9d8109c40 0x7fc9d8110470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 --2- 172.21.15.84:0/3337171159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9d81092f0 0x7fc9d8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 --2- 172.21.15.84:0/3337171159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9d81039b0 0x7fc9d8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 -- 172.21.15.84:0/3337171159 >> 172.21.15.84:0/3337171159 conn(0x7fc9d80ff440 msgr2=0x7fc9d8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 -- 172.21.15.84:0/3337171159 shutdown_connections 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.508+0000 7fc9df000640 1 -- 172.21.15.84:0/3337171159 wait complete. 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 Processor -- start 2024-09-21T07:49:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 -- start start 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9d81039b0 0x7fc9d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9d81092f0 0x7fc9d8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9d8109c40 0x7fc9d8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d8113950 con 0x7fc9d81092f0 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81137d0 con 0x7fc9d8109c40 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.509+0000 7fc9df000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d8113ad0 con 0x7fc9d81039b0 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9d81039b0 0x7fc9d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9d81039b0 0x7fc9d8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48256/0 (socket says 172.21.15.84:48256) 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 -- 172.21.15.84:0/3182758954 learned_addr learned my addr 172.21.15.84:0/3182758954 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9dd200640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9d81092f0 0x7fc9d8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9de600640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9d8109c40 0x7fc9d8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 -- 172.21.15.84:0/3182758954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9d8109c40 msgr2=0x7fc9d8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9d8109c40 0x7fc9d8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 -- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9d81092f0 msgr2=0x7fc9d8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9d81092f0 0x7fc9d8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.510+0000 7fc9ddc00640 1 -- 172.21.15.84:0/3182758954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d81a8580 con 0x7fc9d81039b0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.511+0000 7fc9ddc00640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9d81039b0 0x7fc9d8075710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00d950 tx=0x7fc9cc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.511+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc017030 con 0x7fc9d81039b0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.511+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d81a8870 con 0x7fc9d81039b0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.511+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9cc004020 con 0x7fc9d81039b0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.511+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0047a0 con 0x7fc9d81039b0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.511+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d81a8db0 con 0x7fc9d81039b0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.512+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9d8063b10 con 0x7fc9d81039b0 2024-09-21T07:49:08.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.514+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc9cc009a30 con 0x7fc9d81039b0 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.516+0000 7fc9d6000640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc9c00b65f0 0x7fc9c00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.516+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fc9cc0e7a90 con 0x7fc9d81039b0 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.516+0000 7fc9dd200640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc9c00b65f0 0x7fc9c00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.517+0000 7fc9d6000640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] conn(0x7fc9c00c1900 0x7fc9c00c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.517+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 --> [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9cc011e50 con 0x7fc9c00c1900 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.517+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc9cc0e7e40 con 0x7fc9d81039b0 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.517+0000 7fc9de600640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] conn(0x7fc9c00c1900 0x7fc9c00c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.517+0000 7fc9dd200640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc9c00b65f0 0x7fc9c00b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8102b40 tx=0x7fc9c400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.518+0000 7fc9de600640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] conn(0x7fc9c00c1900 0x7fc9c00c3df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.518+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== osd.6 v2:172.21.15.84:6818/3031329443 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9cc011e50 con 0x7fc9c00c1900 2024-09-21T07:49:08.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.606+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f28b80e82c0 con 0x7f28c0109e10 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.533+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 --> [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9d8063f10 con 0x7fc9c00c1900 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.533+0000 7fc9d6000640 1 -- 172.21.15.84:0/3182758954 <== osd.6 v2:172.21.15.84:6818/3031329443 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc9d8063f10 con 0x7fc9c00c1900 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] conn(0x7fc9c00c1900 msgr2=0x7fc9c00c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] conn(0x7fc9c00c1900 0x7fc9c00c3df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc9c00b65f0 msgr2=0x7fc9c00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc9c00b65f0 0x7fc9c00b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8102b40 tx=0x7fc9c400b410 comp rx=0 tx=0).stop 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9d81039b0 msgr2=0x7fc9d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 --2- 172.21.15.84:0/3182758954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9d81039b0 0x7fc9d8075710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00d950 tx=0x7fc9cc00de10 comp rx=0 tx=0).stop 2024-09-21T07:49:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9de600640 1 -- 172.21.15.84:0/3182758954 reap_dead start 2024-09-21T07:49:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 shutdown_connections 2024-09-21T07:49:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 >> 172.21.15.84:0/3182758954 conn(0x7fc9d80ff440 msgr2=0x7fc9d8108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.606+0000 7f28be800640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a40b6670 0x7f28a40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 shutdown_connections 2024-09-21T07:49:08.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.534+0000 7fc9df000640 1 -- 172.21.15.84:0/3182758954 wait complete. 2024-09-21T07:49:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.606+0000 7f28b7400640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] conn(0x7f28a40c1980 0x7f28a40c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.606+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 --> [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28b8015e80 con 0x7f28a40c1980 2024-09-21T07:49:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.606+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f28b80e8670 con 0x7f28c0109e10 2024-09-21T07:49:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.606+0000 7f28bde00640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] conn(0x7f28a40c1980 0x7f28a40c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.606+0000 7f28be800640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a40b6670 0x7f28a40b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009b50 tx=0x7f28b0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.607+0000 7f28bde00640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] conn(0x7f28a40c1980 0x7f28a40c3e70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.608+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== osd.10 v2:172.21.15.162:6824/2712516619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f28b8015e80 con 0x7f28a40c1980 2024-09-21T07:49:08.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.622+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 --> [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28c0063fd0 con 0x7f28a40c1980 2024-09-21T07:49:08.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28b7400640 1 -- 172.21.15.84:0/1558450557 <== osd.10 v2:172.21.15.162:6824/2712516619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f28c0063fd0 con 0x7f28a40c1980 2024-09-21T07:49:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] conn(0x7f28a40c1980 msgr2=0x7f28a40c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] conn(0x7f28a40c1980 0x7f28a40c3e70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a40b6670 msgr2=0x7f28a40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a40b6670 0x7f28a40b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009b50 tx=0x7f28b0005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28c0109e10 msgr2=0x7f28c019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:08.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 --2- 172.21.15.84:0/1558450557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28c0109e10 0x7f28c019fd60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28b800eb10 tx=0x7f28b800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:49:08.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28bf200640 1 -- 172.21.15.84:0/1558450557 reap_dead start 2024-09-21T07:49:08.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 shutdown_connections 2024-09-21T07:49:08.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.623+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 >> 172.21.15.84:0/1558450557 conn(0x7f28c00ff590 msgr2=0x7f28c01029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:08.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.624+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 shutdown_connections 2024-09-21T07:49:08.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:08.624+0000 7f28c5400640 1 -- 172.21.15.84:0/1558450557 wait complete. 2024-09-21T07:49:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.118+0000 7f642ce00640 1 -- 172.21.15.84:0/136536563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810be40 msgr2=0x7f6428112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.118+0000 7f642ce00640 1 --2- 172.21.15.84:0/136536563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810be40 0x7f6428112670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6420009ca0 tx=0x7f642002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.118+0000 7f642ce00640 1 -- 172.21.15.84:0/136536563 shutdown_connections 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.118+0000 7f642ce00640 1 --2- 172.21.15.84:0/136536563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810be40 0x7f6428112670 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.118+0000 7f642ce00640 1 --2- 172.21.15.84:0/136536563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f642810b4f0 0x7f642810b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.118+0000 7f642ce00640 1 --2- 172.21.15.84:0/136536563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6428105bb0 0x7f6428105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.118+0000 7f642ce00640 1 -- 172.21.15.84:0/136536563 >> 172.21.15.84:0/136536563 conn(0x7f6428101680 msgr2=0x7f6428103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.119+0000 7f642ce00640 1 -- 172.21.15.84:0/136536563 shutdown_connections 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.119+0000 7f642ce00640 1 -- 172.21.15.84:0/136536563 wait complete. 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 Processor -- start 2024-09-21T07:49:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 -- start start 2024-09-21T07:49:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6428105bb0 0x7f642819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810b4f0 0x7f642819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f642810be40 0x7f64281a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6428115b00 con 0x7f642810b4f0 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6428115980 con 0x7f6428105bb0 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.120+0000 7f642ce00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6428115c80 con 0x7f642810be40 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810b4f0 0x7f642819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6427e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f642810be40 0x7f64281a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810b4f0 0x7f642819ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55998/0 (socket says 172.21.15.84:55998) 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 -- 172.21.15.84:0/259768721 learned_addr learned my addr 172.21.15.84:0/259768721 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6427400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6428105bb0 0x7f642819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 -- 172.21.15.84:0/259768721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f642810be40 msgr2=0x7f64281a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f642810be40 0x7f64281a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 -- 172.21.15.84:0/259768721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6428105bb0 msgr2=0x7f642819c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6428105bb0 0x7f642819c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6426a00640 1 -- 172.21.15.84:0/259768721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64281a2420 con 0x7f642810b4f0 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.121+0000 7f6427e00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f642810be40 0x7f64281a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.122+0000 7f6426a00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810b4f0 0x7f642819ca50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.122+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414017070 con 0x7f642810b4f0 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.122+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6414009c30 con 0x7f642810b4f0 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.122+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140047a0 con 0x7f642810b4f0 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.122+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64281a2710 con 0x7f642810b4f0 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.122+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64281a8e70 con 0x7f642810b4f0 2024-09-21T07:49:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.123+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6428063b50 con 0x7f642810b4f0 2024-09-21T07:49:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.126+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f6414004020 con 0x7f642810b4f0 2024-09-21T07:49:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.128+0000 7f641fe00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f640c0b6670 0x7f640c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.128+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f64140e7a80 con 0x7f642810b4f0 2024-09-21T07:49:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.128+0000 7f6427400640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f640c0b6670 0x7f640c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.128+0000 7f641fe00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] conn(0x7f640c0c1980 0x7f640c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.129+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 --> [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6414024e80 con 0x7f640c0c1980 2024-09-21T07:49:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.129+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f64140e7e30 con 0x7f642810b4f0 2024-09-21T07:49:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.129+0000 7f6427e00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] conn(0x7f640c0c1980 0x7f640c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.129+0000 7f6427400640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f640c0b6670 0x7f640c0b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6418009bd0 tx=0x7f6418005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.130+0000 7f6427e00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] conn(0x7f640c0c1980 0x7f640c0c3e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.131+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== osd.4 v2:172.21.15.162:6808/1714263086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6414024e80 con 0x7f640c0c1980 2024-09-21T07:49:09.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.145+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 --> [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6428063f50 con 0x7f640c0c1980 2024-09-21T07:49:09.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f641fe00640 1 -- 172.21.15.84:0/259768721 <== osd.4 v2:172.21.15.162:6808/1714263086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6428063f50 con 0x7f640c0c1980 2024-09-21T07:49:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 >> [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] conn(0x7f640c0c1980 msgr2=0x7f640c0c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] conn(0x7f640c0c1980 0x7f640c0c3e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f640c0b6670 msgr2=0x7f640c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f640c0b6670 0x7f640c0b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6418009bd0 tx=0x7f6418005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810b4f0 msgr2=0x7f642819ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 --2- 172.21.15.84:0/259768721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f642810b4f0 0x7f642819ca50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400de10 comp rx=0 tx=0).stop 2024-09-21T07:49:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f6427e00640 1 -- 172.21.15.84:0/259768721 reap_dead start 2024-09-21T07:49:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 shutdown_connections 2024-09-21T07:49:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 >> 172.21.15.84:0/259768721 conn(0x7f6428101680 msgr2=0x7f6428108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.146+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 shutdown_connections 2024-09-21T07:49:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:09.147+0000 7f642ce00640 1 -- 172.21.15.84:0/259768721 wait complete. 2024-09-21T07:49:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:09 smithi084 ceph-mon[30411]: pgmap v333: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:09.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:09 smithi191 ceph-mon[34667]: pgmap v333: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:09.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:09 smithi162 ceph-mon[34833]: pgmap v333: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 -- 172.21.15.84:0/852811748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741039b0 msgr2=0x7eff74103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 --2- 172.21.15.84:0/852811748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741039b0 0x7eff74103dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7eff68009ca0 tx=0x7eff6802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 -- 172.21.15.84:0/852811748 shutdown_connections 2024-09-21T07:49:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 --2- 172.21.15.84:0/852811748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff74109c40 0x7eff74110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 --2- 172.21.15.84:0/852811748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff741092f0 0x7eff74109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 --2- 172.21.15.84:0/852811748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741039b0 0x7eff74103dc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 -- 172.21.15.84:0/852811748 >> 172.21.15.84:0/852811748 conn(0x7eff740ff440 msgr2=0x7eff74101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 -- 172.21.15.84:0/852811748 shutdown_connections 2024-09-21T07:49:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.026+0000 7eff7b000640 1 -- 172.21.15.84:0/852811748 wait complete. 2024-09-21T07:49:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 Processor -- start 2024-09-21T07:49:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 -- start start 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff741039b0 0x7eff7419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741092f0 0x7eff7419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff74109c40 0x7eff741a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7eff74113900 con 0x7eff741092f0 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff74113780 con 0x7eff74109c40 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff7b000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7eff74113a80 con 0x7eff741039b0 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff79200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741092f0 0x7eff7419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.028+0000 7eff79c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff741039b0 0x7eff7419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741092f0 0x7eff7419cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56024/0 (socket says 172.21.15.84:56024) 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff741039b0 0x7eff7419c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48306/0 (socket says 172.21.15.84:48306) 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 -- 172.21.15.84:0/2283196591 learned_addr learned my addr 172.21.15.84:0/2283196591 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff7a600640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff74109c40 0x7eff741a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 -- 172.21.15.84:0/2283196591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff74109c40 msgr2=0x7eff741a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff74109c40 0x7eff741a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 -- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741092f0 msgr2=0x7eff7419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741092f0 0x7eff7419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 -- 172.21.15.84:0/2283196591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff741a24a0 con 0x7eff741039b0 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79200640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff741092f0 0x7eff7419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.029+0000 7eff79c00640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff741039b0 0x7eff7419c530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff68033040 tx=0x7eff680316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.030+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68003b70 con 0x7eff741039b0 2024-09-21T07:49:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.030+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff741a2730 con 0x7eff741039b0 2024-09-21T07:49:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.030+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff68003d10 con 0x7eff741039b0 2024-09-21T07:49:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.030+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6802f9e0 con 0x7eff741039b0 2024-09-21T07:49:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.030+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff741a8ef0 con 0x7eff741039b0 2024-09-21T07:49:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.031+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff7410f9f0 con 0x7eff741039b0 2024-09-21T07:49:10.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.034+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7eff6802fb80 con 0x7eff741039b0 2024-09-21T07:49:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.035+0000 7eff72000640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff5c0b6670 0x7eff5c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.035+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7eff68108d40 con 0x7eff741039b0 2024-09-21T07:49:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.035+0000 7eff79200640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff5c0b6670 0x7eff5c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.036+0000 7eff72000640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] conn(0x7eff5c0c1980 0x7eff5c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.036+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 --> [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff5c0c4540 con 0x7eff5c0c1980 2024-09-21T07:49:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.036+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7eff681090f0 con 0x7eff741039b0 2024-09-21T07:49:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.036+0000 7eff79200640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff5c0b6670 0x7eff5c0b8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff741059f0 tx=0x7eff60005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.036+0000 7eff7a600640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] conn(0x7eff5c0c1980 0x7eff5c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.037+0000 7eff7a600640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] conn(0x7eff5c0c1980 0x7eff5c0c3e70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:10.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.038+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== osd.5 v2:172.21.15.191:6808/2672945398 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff5c0c4540 con 0x7eff5c0c1980 2024-09-21T07:49:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.052+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 --> [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff74104c30 con 0x7eff5c0c1980 2024-09-21T07:49:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.053+0000 7eff72000640 1 -- 172.21.15.84:0/2283196591 <== osd.5 v2:172.21.15.191:6808/2672945398 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7eff74104c30 con 0x7eff5c0c1980 2024-09-21T07:49:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.053+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] conn(0x7eff5c0c1980 msgr2=0x7eff5c0c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.053+0000 7eff7b000640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] conn(0x7eff5c0c1980 0x7eff5c0c3e70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff5c0b6670 msgr2=0x7eff5c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff5c0b6670 0x7eff5c0b8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff741059f0 tx=0x7eff60005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff741039b0 msgr2=0x7eff7419c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 --2- 172.21.15.84:0/2283196591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff741039b0 0x7eff7419c530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff68033040 tx=0x7eff680316f0 comp rx=0 tx=0).stop 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7a600640 1 -- 172.21.15.84:0/2283196591 reap_dead start 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 shutdown_connections 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 >> 172.21.15.84:0/2283196591 conn(0x7eff740ff440 msgr2=0x7eff74108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 shutdown_connections 2024-09-21T07:49:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:10.054+0000 7eff7b000640 1 -- 172.21.15.84:0/2283196591 wait complete. 2024-09-21T07:49:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 -- 172.21.15.84:0/2374890454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336410faf0 msgr2=0x7f336410ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 --2- 172.21.15.84:0/2374890454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336410faf0 0x7f336410ff00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3350009900 tx=0x7f335002a410 comp rx=0 tx=0).stop 2024-09-21T07:49:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 -- 172.21.15.84:0/2374890454 shutdown_connections 2024-09-21T07:49:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 --2- 172.21.15.84:0/2374890454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3364110440 0x7f3364116c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 --2- 172.21.15.84:0/2374890454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336410faf0 0x7f336410ff00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 --2- 172.21.15.84:0/2374890454 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f336410a1b0 0x7f336410a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 -- 172.21.15.84:0/2374890454 >> 172.21.15.84:0/2374890454 conn(0x7f33640780e0 msgr2=0x7f33641081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 -- 172.21.15.84:0/2374890454 shutdown_connections 2024-09-21T07:49:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.180+0000 7f336bc00640 1 -- 172.21.15.84:0/2374890454 wait complete. 2024-09-21T07:49:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 Processor -- start 2024-09-21T07:49:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 -- start start 2024-09-21T07:49:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f336410a1b0 0x7f33641a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f336410faf0 0x7f33641a1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3364110440 0x7f33641a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f336411a0b0 con 0x7f3364110440 2024-09-21T07:49:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3364119f30 con 0x7f336410a1b0 2024-09-21T07:49:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.182+0000 7f336bc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f336411a230 con 0x7f336410faf0 2024-09-21T07:49:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f336410a1b0 0x7f33641a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3364110440 0x7f33641a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f336410a1b0 0x7f33641a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39104/0 (socket says 172.21.15.84:39104) 2024-09-21T07:49:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 -- 172.21.15.84:0/2397720301 learned_addr learned my addr 172.21.15.84:0/2397720301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3363e00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f336410faf0 0x7f33641a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 -- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f336410faf0 msgr2=0x7f33641a1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f336410faf0 0x7f33641a1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 -- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3364110440 msgr2=0x7f33641a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3364110440 0x7f33641a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 -- 172.21.15.84:0/2397720301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33641a6ad0 con 0x7f336410a1b0 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369c00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3364110440 0x7f33641a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.183+0000 7f3369200640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f336410a1b0 0x7f33641a0b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f335400eab0 tx=0x7f335400ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.184+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335400ce40 con 0x7f336410a1b0 2024-09-21T07:49:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.184+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33641a6dc0 con 0x7f336410a1b0 2024-09-21T07:49:11.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.184+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3354011920 con 0x7f336410a1b0 2024-09-21T07:49:11.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.184+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354010a30 con 0x7f336410a1b0 2024-09-21T07:49:11.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.184+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33641ad520 con 0x7f336410a1b0 2024-09-21T07:49:11.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.185+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3364063b10 con 0x7f336410a1b0 2024-09-21T07:49:11.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.187+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f3354010bd0 con 0x7f336410a1b0 2024-09-21T07:49:11.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.189+0000 7f3361600640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33480b65f0 0x7f33480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.189+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f33540e7f40 con 0x7f336410a1b0 2024-09-21T07:49:11.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.189+0000 7f3363e00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33480b65f0 0x7f33480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.189+0000 7f3361600640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] conn(0x7f33480c1900 0x7f33480c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.189+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 --> [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3354017e70 con 0x7f33480c1900 2024-09-21T07:49:11.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.189+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f33540e82f0 con 0x7f336410a1b0 2024-09-21T07:49:11.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.190+0000 7f3369c00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] conn(0x7f33480c1900 0x7f33480c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.190+0000 7f3363e00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33480b65f0 0x7f33480b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3350009230 tx=0x7f3350031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:11.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.190+0000 7f3369c00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] conn(0x7f33480c1900 0x7f33480c3df0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.191+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== osd.8 v2:172.21.15.191:6816/1349047550 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3354017e70 con 0x7f33480c1900 2024-09-21T07:49:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.205+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 --> [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3364063fc0 con 0x7f33480c1900 2024-09-21T07:49:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.206+0000 7f3361600640 1 -- 172.21.15.84:0/2397720301 <== osd.8 v2:172.21.15.191:6816/1349047550 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3364063fc0 con 0x7f33480c1900 2024-09-21T07:49:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.206+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] conn(0x7f33480c1900 msgr2=0x7f33480c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.206+0000 7f336bc00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] conn(0x7f33480c1900 0x7f33480c3df0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33480b65f0 msgr2=0x7f33480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33480b65f0 0x7f33480b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3350009230 tx=0x7f3350031400 comp rx=0 tx=0).stop 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f336410a1b0 msgr2=0x7f33641a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 --2- 172.21.15.84:0/2397720301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f336410a1b0 0x7f33641a0b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f335400eab0 tx=0x7f335400ef70 comp rx=0 tx=0).stop 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f3369c00640 1 -- 172.21.15.84:0/2397720301 reap_dead start 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 shutdown_connections 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 >> 172.21.15.84:0/2397720301 conn(0x7f33640780e0 msgr2=0x7f3364078900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 shutdown_connections 2024-09-21T07:49:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.207+0000 7f336bc00640 1 -- 172.21.15.84:0/2397720301 wait complete. 2024-09-21T07:49:11.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:11 smithi084 ceph-mon[30411]: pgmap v334: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-21T07:49:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 -- 172.21.15.84:0/2809972307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94114570 msgr2=0x7f8b94116990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 --2- 172.21.15.84:0/2809972307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94114570 0x7f8b94116990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009900 tx=0x7f8b8c02a400 comp rx=0 tx=0).stop 2024-09-21T07:49:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 -- 172.21.15.84:0/2809972307 shutdown_connections 2024-09-21T07:49:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 --2- 172.21.15.84:0/2809972307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94114570 0x7f8b94116990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 --2- 172.21.15.84:0/2809972307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b94078290 0x7f8b94114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 --2- 172.21.15.84:0/2809972307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b94077940 0x7f8b94077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 -- 172.21.15.84:0/2809972307 >> 172.21.15.84:0/2809972307 conn(0x7f8b94101680 msgr2=0x7f8b94103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 -- 172.21.15.84:0/2809972307 shutdown_connections 2024-09-21T07:49:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.399+0000 7f8b98a00640 1 -- 172.21.15.84:0/2809972307 wait complete. 2024-09-21T07:49:11.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 Processor -- start 2024-09-21T07:49:11.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 -- start start 2024-09-21T07:49:11.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94077940 0x7f8b941a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b94078290 0x7f8b941a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b94114570 0x7f8b941a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94119ed0 con 0x7f8b94078290 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94119d50 con 0x7f8b94114570 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.400+0000 7f8b98a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9411a050 con 0x7f8b94077940 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b91e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b94078290 0x7f8b941a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b92800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94077940 0x7f8b941a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b91e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b94078290 0x7f8b941a0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56060/0 (socket says 172.21.15.84:56060) 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b91e00640 1 -- 172.21.15.84:0/119778029 learned_addr learned my addr 172.21.15.84:0/119778029 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b93200640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b94114570 0x7f8b941a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b92800640 1 -- 172.21.15.84:0/119778029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b94114570 msgr2=0x7f8b941a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b92800640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b94114570 0x7f8b941a6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b92800640 1 -- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b94078290 msgr2=0x7f8b941a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b92800640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b94078290 0x7f8b941a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b92800640 1 -- 172.21.15.84:0/119778029 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b941a6870 con 0x7f8b94077940 2024-09-21T07:49:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.401+0000 7f8b91e00640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b94078290 0x7f8b941a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.402+0000 7f8b92800640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94077940 0x7f8b941a0900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400ec80 tx=0x7f8b8400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:11.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:11 smithi191 ceph-mon[34667]: pgmap v334: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-21T07:49:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.402+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b84003b70 con 0x7f8b94077940 2024-09-21T07:49:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.402+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b941a6b60 con 0x7f8b94077940 2024-09-21T07:49:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.402+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b941ad2c0 con 0x7f8b94077940 2024-09-21T07:49:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.402+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b84003d10 con 0x7f8b94077940 2024-09-21T07:49:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.402+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b840108b0 con 0x7f8b94077940 2024-09-21T07:49:11.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.403+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b74001060 con 0x7f8b94077940 2024-09-21T07:49:11.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.406+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8b84010a50 con 0x7f8b94077940 2024-09-21T07:49:11.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.407+0000 7f8b8b400640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b780b6670 0x7f8b780b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.408+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f8b840e7f10 con 0x7f8b94077940 2024-09-21T07:49:11.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.408+0000 7f8b91e00640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b780b6670 0x7f8b780b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.408+0000 7f8b8b400640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] conn(0x7f8b780c1970 0x7f8b780c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:11.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.408+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 --> [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b780c4530 con 0x7f8b780c1970 2024-09-21T07:49:11.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.408+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f8b840e82c0 con 0x7f8b94077940 2024-09-21T07:49:11.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.408+0000 7f8b93200640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] conn(0x7f8b780c1970 0x7f8b780c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:11.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.409+0000 7f8b91e00640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b780b6670 0x7f8b780b8b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b9407b220 tx=0x7f8b80005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:11.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.409+0000 7f8b93200640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] conn(0x7f8b780c1970 0x7f8b780c3e60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:11.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.410+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== osd.9 v2:172.21.15.84:6826/3430065825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b780c4530 con 0x7f8b780c1970 2024-09-21T07:49:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.424+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 --> [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b74002e00 con 0x7f8b780c1970 2024-09-21T07:49:11.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.425+0000 7f8b8b400640 1 -- 172.21.15.84:0/119778029 <== osd.9 v2:172.21.15.84:6826/3430065825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8b74002e00 con 0x7f8b780c1970 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.425+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] conn(0x7f8b780c1970 msgr2=0x7f8b780c3e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.425+0000 7f8b98a00640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] conn(0x7f8b780c1970 0x7f8b780c3e60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.425+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b780b6670 msgr2=0x7f8b780b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.425+0000 7f8b98a00640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b780b6670 0x7f8b780b8b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b9407b220 tx=0x7f8b80005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.425+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94077940 msgr2=0x7f8b941a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.425+0000 7f8b98a00640 1 --2- 172.21.15.84:0/119778029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b94077940 0x7f8b941a0900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400ec80 tx=0x7f8b8400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.426+0000 7f8b93200640 1 -- 172.21.15.84:0/119778029 reap_dead start 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.426+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 shutdown_connections 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.426+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 >> 172.21.15.84:0/119778029 conn(0x7f8b94101680 msgr2=0x7f8b94116580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.426+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 shutdown_connections 2024-09-21T07:49:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.426+0000 7f8b98a00640 1 -- 172.21.15.84:0/119778029 wait complete. 2024-09-21T07:49:11.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:11 smithi162 ceph-mon[34833]: pgmap v334: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-21T07:49:12.278 INFO:teuthology.orchestra.run.smithi084.stdout:133143986246 2024-09-21T07:49:12.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T07:49:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 -- 172.21.15.84:0/2735362053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4781092d0 msgr2=0x7fe4781096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 --2- 172.21.15.84:0/2735362053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4781092d0 0x7fe4781096e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe464009900 tx=0x7fe46402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 -- 172.21.15.84:0/2735362053 shutdown_connections 2024-09-21T07:49:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 --2- 172.21.15.84:0/2735362053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe478109c20 0x7fe478110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 --2- 172.21.15.84:0/2735362053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4781092d0 0x7fe4781096e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 --2- 172.21.15.84:0/2735362053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe478103990 0x7fe478103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 -- 172.21.15.84:0/2735362053 >> 172.21.15.84:0/2735362053 conn(0x7fe4780ff3e0 msgr2=0x7fe478101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 -- 172.21.15.84:0/2735362053 shutdown_connections 2024-09-21T07:49:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.743+0000 7fe47dc00640 1 -- 172.21.15.84:0/2735362053 wait complete. 2024-09-21T07:49:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 Processor -- start 2024-09-21T07:49:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 -- start start 2024-09-21T07:49:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe478103990 0x7fe47819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4781092d0 0x7fe47819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe478109c20 0x7fe4781a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe4781138e0 con 0x7fe478103990 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe478113760 con 0x7fe4781092d0 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe47dc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe478113a60 con 0x7fe478109c20 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.745+0000 7fe477e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe478103990 0x7fe47819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4781092d0 0x7fe47819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4781092d0 0x7fe47819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39152/0 (socket says 172.21.15.84:39152) 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477400640 1 -- 172.21.15.84:0/3669590344 learned_addr learned my addr 172.21.15.84:0/3669590344 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe47d200640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe478109c20 0x7fe4781a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477e00640 1 -- 172.21.15.84:0/3669590344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe478109c20 msgr2=0x7fe4781a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477e00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe478109c20 0x7fe4781a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477e00640 1 -- 172.21.15.84:0/3669590344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4781092d0 msgr2=0x7fe47819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477e00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4781092d0 0x7fe47819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477e00640 1 -- 172.21.15.84:0/3669590344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4781a24c0 con 0x7fe478103990 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.746+0000 7fe477e00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe478103990 0x7fe47819c550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e9f0 tx=0x7fe46800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.747+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46800ccc0 con 0x7fe478103990 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.747+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe468005020 con 0x7fe478103990 2024-09-21T07:49:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.747+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4781a27b0 con 0x7fe478103990 2024-09-21T07:49:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.747+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468004a00 con 0x7fe478103990 2024-09-21T07:49:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.747+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4781a8f10 con 0x7fe478103990 2024-09-21T07:49:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.748+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe47810fa50 con 0x7fe478103990 2024-09-21T07:49:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.750+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe468004ba0 con 0x7fe478103990 2024-09-21T07:49:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.752+0000 7fe474c00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe45c0b65f0 0x7fe45c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.752+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fe4680e7b50 con 0x7fe478103990 2024-09-21T07:49:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.752+0000 7fe477400640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe45c0b65f0 0x7fe45c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.752+0000 7fe474c00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] conn(0x7fe45c0c1900 0x7fe45c0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.752+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 --> [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe468012ec0 con 0x7fe45c0c1900 2024-09-21T07:49:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.752+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fe4680e7fa0 con 0x7fe478103990 2024-09-21T07:49:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.753+0000 7fe47d200640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] conn(0x7fe45c0c1900 0x7fe45c0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.753+0000 7fe477400640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe45c0b65f0 0x7fe45c0b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe478105c60 tx=0x7fe464009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.753+0000 7fe47d200640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] conn(0x7fe45c0c1900 0x7fe45c0c3df0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.754+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== osd.1 v2:172.21.15.162:6800/4003571360 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe468012ec0 con 0x7fe45c0c1900 2024-09-21T07:49:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.768+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 --> [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe478104c10 con 0x7fe45c0c1900 2024-09-21T07:49:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.769+0000 7fe474c00640 1 -- 172.21.15.84:0/3669590344 <== osd.1 v2:172.21.15.162:6800/4003571360 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe478104c10 con 0x7fe45c0c1900 2024-09-21T07:49:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 >> [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] conn(0x7fe45c0c1900 msgr2=0x7fe45c0c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] conn(0x7fe45c0c1900 0x7fe45c0c3df0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe45c0b65f0 msgr2=0x7fe45c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe45c0b65f0 0x7fe45c0b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe478105c60 tx=0x7fe464009560 comp rx=0 tx=0).stop 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe478103990 msgr2=0x7fe47819c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 --2- 172.21.15.84:0/3669590344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe478103990 0x7fe47819c550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e9f0 tx=0x7fe46800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47d200640 1 -- 172.21.15.84:0/3669590344 reap_dead start 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 shutdown_connections 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 >> 172.21.15.84:0/3669590344 conn(0x7fe4780ff3e0 msgr2=0x7fe4781069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 shutdown_connections 2024-09-21T07:49:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:12.770+0000 7fe47dc00640 1 -- 172.21.15.84:0/3669590344 wait complete. 2024-09-21T07:49:12.913 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:13.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:13 smithi084 ceph-mon[30411]: pgmap v335: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T07:49:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:13 smithi191 ceph-mon[34667]: pgmap v335: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T07:49:13.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:13 smithi162 ceph-mon[34833]: pgmap v335: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-21T07:49:13.835 INFO:teuthology.orchestra.run.smithi084.stdout:154618822720 2024-09-21T07:49:13.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T07:49:14.575 INFO:teuthology.orchestra.run.smithi084.stdout:60129542231 2024-09-21T07:49:14.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T07:49:15.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:15 smithi084 ceph-mon[30411]: pgmap v336: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:15.354 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:15 smithi162 ceph-mon[34833]: pgmap v336: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:15 smithi191 ceph-mon[34667]: pgmap v336: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:15.764 INFO:teuthology.orchestra.run.smithi084.stdout:253403070507 2024-09-21T07:49:15.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T07:49:16.085 INFO:teuthology.orchestra.run.smithi084.stdout:77309411410 2024-09-21T07:49:16.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T07:49:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.822+0000 7f6489c00640 1 -- 172.21.15.84:0/4135035900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648410ff90 msgr2=0x7f64841123b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.822+0000 7f6489c00640 1 --2- 172.21.15.84:0/4135035900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648410ff90 0x7f64841123b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f647c009ca0 tx=0x7f647c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.823+0000 7f6489c00640 1 -- 172.21.15.84:0/4135035900 shutdown_connections 2024-09-21T07:49:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.823+0000 7f6489c00640 1 --2- 172.21.15.84:0/4135035900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648410ff90 0x7f64841123b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.823+0000 7f6489c00640 1 --2- 172.21.15.84:0/4135035900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6484076080 0x7f648410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.823+0000 7f6489c00640 1 --2- 172.21.15.84:0/4135035900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6484075730 0x7f6484075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.823+0000 7f6489c00640 1 -- 172.21.15.84:0/4135035900 >> 172.21.15.84:0/4135035900 conn(0x7f64840ff400 msgr2=0x7f6484101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.823+0000 7f6489c00640 1 -- 172.21.15.84:0/4135035900 shutdown_connections 2024-09-21T07:49:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.823+0000 7f6489c00640 1 -- 172.21.15.84:0/4135035900 wait complete. 2024-09-21T07:49:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 Processor -- start 2024-09-21T07:49:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 -- start start 2024-09-21T07:49:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6484075730 0x7f648419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6484076080 0x7f648419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f648410ff90 0x7f64841a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6484115b20 con 0x7f6484075730 2024-09-21T07:49:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64841159a0 con 0x7f6484076080 2024-09-21T07:49:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6489c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6484115ca0 con 0x7f648410ff90 2024-09-21T07:49:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.824+0000 7f6483e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6484075730 0x7f648419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6484075730 0x7f648419c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56072/0 (socket says 172.21.15.84:56072) 2024-09-21T07:49:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 -- 172.21.15.84:0/2568112675 learned_addr learned my addr 172.21.15.84:0/2568112675 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6489200640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f648410ff90 0x7f64841a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483400640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6484076080 0x7f648419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 -- 172.21.15.84:0/2568112675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f648410ff90 msgr2=0x7f64841a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f648410ff90 0x7f64841a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 -- 172.21.15.84:0/2568112675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6484076080 msgr2=0x7f648419c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6484076080 0x7f648419c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 -- 172.21.15.84:0/2568112675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64841a2390 con 0x7f6484075730 2024-09-21T07:49:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483400640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6484076080 0x7f648419c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6483e00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6484075730 0x7f648419c420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f647400e9f0 tx=0x7f647400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.825+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647400cd80 con 0x7f6484075730 2024-09-21T07:49:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.826+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64740108e0 con 0x7f6484075730 2024-09-21T07:49:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.826+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64841a2680 con 0x7f6484075730 2024-09-21T07:49:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.826+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474018980 con 0x7f6484075730 2024-09-21T07:49:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.826+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64841a8de0 con 0x7f6484075730 2024-09-21T07:49:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.826+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6484101750 con 0x7f6484075730 2024-09-21T07:49:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.829+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f6474010430 con 0x7f6484075730 2024-09-21T07:49:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.830+0000 7f6480c00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64680b65f0 0x7f64680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.831+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f64740e8460 con 0x7f6484075730 2024-09-21T07:49:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.831+0000 7f6483400640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64680b65f0 0x7f64680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.831+0000 7f6480c00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] conn(0x7f64680c1900 0x7f64680c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.831+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 --> [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f647401ce70 con 0x7f64680c1900 2024-09-21T07:49:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.831+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f64740e8810 con 0x7f6484075730 2024-09-21T07:49:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.831+0000 7f6489200640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] conn(0x7f64680c1900 0x7f64680c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.831+0000 7f6483400640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64680b65f0 0x7f64680b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64700058c0 tx=0x7f6470005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.832+0000 7f6489200640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] conn(0x7f64680c1900 0x7f64680c3df0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.833+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== osd.0 v2:172.21.15.84:6802/2767669406 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f647401ce70 con 0x7f64680c1900 2024-09-21T07:49:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.847+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 --> [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6484076c40 con 0x7f64680c1900 2024-09-21T07:49:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.847+0000 7f6480c00640 1 -- 172.21.15.84:0/2568112675 <== osd.0 v2:172.21.15.84:6802/2767669406 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6484076c40 con 0x7f64680c1900 2024-09-21T07:49:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] conn(0x7f64680c1900 msgr2=0x7f64680c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] conn(0x7f64680c1900 0x7f64680c3df0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64680b65f0 msgr2=0x7f64680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64680b65f0 0x7f64680b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64700058c0 tx=0x7f6470005850 comp rx=0 tx=0).stop 2024-09-21T07:49:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6484075730 msgr2=0x7f648419c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 --2- 172.21.15.84:0/2568112675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6484075730 0x7f648419c420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f647400e9f0 tx=0x7f647400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:49:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489200640 1 -- 172.21.15.84:0/2568112675 reap_dead start 2024-09-21T07:49:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 shutdown_connections 2024-09-21T07:49:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 >> 172.21.15.84:0/2568112675 conn(0x7f64840ff400 msgr2=0x7f6484100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 shutdown_connections 2024-09-21T07:49:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:11.848+0000 7f6489c00640 1 -- 172.21.15.84:0/2568112675 wait complete. 2024-09-21T07:49:17.017 INFO:teuthology.orchestra.run.smithi084.stdout:274877906979 2024-09-21T07:49:17.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T07:49:17.135 INFO:teuthology.orchestra.run.smithi084.stdout:180388626490 2024-09-21T07:49:17.135 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T07:49:17.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:17 smithi084 ceph-mon[30411]: pgmap v337: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:17 smithi191 ceph-mon[34667]: pgmap v337: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:17.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:17 smithi162 ceph-mon[34833]: pgmap v337: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:17.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.613+0000 7f6050c00640 1 -- 172.21.15.84:0/1056568203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c1083b0 msgr2=0x7f604c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.613+0000 7f6050c00640 1 --2- 172.21.15.84:0/1056568203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c1083b0 0x7f604c1087c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6038009900 tx=0x7f603802a410 comp rx=0 tx=0).stop 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.613+0000 7f6050c00640 1 -- 172.21.15.84:0/1056568203 shutdown_connections 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.613+0000 7f6050c00640 1 --2- 172.21.15.84:0/1056568203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604c108d00 0x7f604c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.613+0000 7f6050c00640 1 --2- 172.21.15.84:0/1056568203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c1083b0 0x7f604c1087c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.613+0000 7f6050c00640 1 --2- 172.21.15.84:0/1056568203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f604c102ac0 0x7f604c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.613+0000 7f6050c00640 1 -- 172.21.15.84:0/1056568203 >> 172.21.15.84:0/1056568203 conn(0x7f604c079720 msgr2=0x7f604c079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.614+0000 7f6050c00640 1 -- 172.21.15.84:0/1056568203 shutdown_connections 2024-09-21T07:49:17.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.614+0000 7f6050c00640 1 -- 172.21.15.84:0/1056568203 wait complete. 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 Processor -- start 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 -- start start 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c102ac0 0x7f604c199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604c1083b0 0x7f604c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f604c108d00 0x7f604c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f604c112a10 con 0x7f604c102ac0 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f604c112890 con 0x7f604c108d00 2024-09-21T07:49:17.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6050c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f604c112b90 con 0x7f604c1083b0 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.615+0000 7f6049e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c102ac0 0x7f604c199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c102ac0 0x7f604c199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56124/0 (socket says 172.21.15.84:56124) 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 -- 172.21.15.84:0/246450464 learned_addr learned my addr 172.21.15.84:0/246450464 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049400640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604c1083b0 0x7f604c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f604a800640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f604c108d00 0x7f604c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 -- 172.21.15.84:0/246450464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604c1083b0 msgr2=0x7f604c1995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604c1083b0 0x7f604c1995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 -- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f604c108d00 msgr2=0x7f604c199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:17.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f604c108d00 0x7f604c199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:17.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 -- 172.21.15.84:0/246450464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c19e370 con 0x7f604c102ac0 2024-09-21T07:49:17.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.616+0000 7f6049e00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c102ac0 0x7f604c199090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e9f0 tx=0x7f603c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:17.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.617+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c00cd80 con 0x7f604c102ac0 2024-09-21T07:49:17.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.617+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f603c0108e0 con 0x7f604c102ac0 2024-09-21T07:49:17.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.617+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604c19e660 con 0x7f604c102ac0 2024-09-21T07:49:17.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.617+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c018980 con 0x7f604c102ac0 2024-09-21T07:49:17.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.617+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604c19ebc0 con 0x7f604c102ac0 2024-09-21T07:49:17.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.618+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f602c001030 con 0x7f604c102ac0 2024-09-21T07:49:17.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.621+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f603c010430 con 0x7f604c102ac0 2024-09-21T07:49:17.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.622+0000 7f6042a00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6670 0x7f60300b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:17.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.622+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f603c0e8570 con 0x7f604c102ac0 2024-09-21T07:49:17.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.622+0000 7f6049400640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6670 0x7f60300b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:17.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.622+0000 7f6042a00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] conn(0x7f60300c1980 0x7f60300c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:17.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.622+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 --> [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f603c019ec0 con 0x7f60300c1980 2024-09-21T07:49:17.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.623+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f603c0e8920 con 0x7f604c102ac0 2024-09-21T07:49:17.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.623+0000 7f604a800640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] conn(0x7f60300c1980 0x7f60300c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:17.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.623+0000 7f6049400640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6670 0x7f60300b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f603802aa00 tx=0x7f6038005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:17.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.624+0000 7f604a800640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] conn(0x7f60300c1980 0x7f60300c3e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:17.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.624+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== osd.7 v2:172.21.15.162:6816/328134245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f603c019ec0 con 0x7f60300c1980 2024-09-21T07:49:17.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.639+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 --> [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f602c002dd0 con 0x7f60300c1980 2024-09-21T07:49:17.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.639+0000 7f6042a00640 1 -- 172.21.15.84:0/246450464 <== osd.7 v2:172.21.15.162:6816/328134245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f602c002dd0 con 0x7f60300c1980 2024-09-21T07:49:17.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] conn(0x7f60300c1980 msgr2=0x7f60300c3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:17.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] conn(0x7f60300c1980 0x7f60300c3e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:17.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6670 msgr2=0x7f60300b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:17.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6670 0x7f60300b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f603802aa00 tx=0x7f6038005a20 comp rx=0 tx=0).stop 2024-09-21T07:49:17.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c102ac0 msgr2=0x7f604c199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:17.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 --2- 172.21.15.84:0/246450464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f604c102ac0 0x7f604c199090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e9f0 tx=0x7f603c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:49:17.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f604a800640 1 -- 172.21.15.84:0/246450464 reap_dead start 2024-09-21T07:49:17.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 shutdown_connections 2024-09-21T07:49:17.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 >> 172.21.15.84:0/246450464 conn(0x7f604c079720 msgr2=0x7f604c106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:17.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.640+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 shutdown_connections 2024-09-21T07:49:17.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:17.641+0000 7f6050c00640 1 -- 172.21.15.84:0/246450464 wait complete. 2024-09-21T07:49:18.555 INFO:teuthology.orchestra.run.smithi084.stdout:38654705756 2024-09-21T07:49:18.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T07:49:18.877 INFO:teuthology.orchestra.run.smithi084.stdout:227633266737 2024-09-21T07:49:18.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T07:49:19.177 INFO:teuthology.orchestra.run.smithi084.stdout:296352743456 2024-09-21T07:49:19.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T07:49:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:19 smithi191 ceph-mon[34667]: pgmap v338: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 -- 172.21.15.84:0/319293296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec1083a0 msgr2=0x7f02ec1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 --2- 172.21.15.84:0/319293296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec1083a0 0x7f02ec1087b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009860 tx=0x7f02d802a340 comp rx=0 tx=0).stop 2024-09-21T07:49:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 -- 172.21.15.84:0/319293296 shutdown_connections 2024-09-21T07:49:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 --2- 172.21.15.84:0/319293296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02ec108cf0 0x7f02ec10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 --2- 172.21.15.84:0/319293296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec1083a0 0x7f02ec1087b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 --2- 172.21.15.84:0/319293296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02ec102a60 0x7f02ec102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 -- 172.21.15.84:0/319293296 >> 172.21.15.84:0/319293296 conn(0x7f02ec079730 msgr2=0x7f02ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 -- 172.21.15.84:0/319293296 shutdown_connections 2024-09-21T07:49:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.482+0000 7f02f1400640 1 -- 172.21.15.84:0/319293296 wait complete. 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.484+0000 7f02f1400640 1 Processor -- start 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.484+0000 7f02f1400640 1 -- start start 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.485+0000 7f02f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02ec102a60 0x7f02ec19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.485+0000 7f02f1400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02ec1083a0 0x7f02ec19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.485+0000 7f02f1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec108cf0 0x7f02ec1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.485+0000 7f02f1400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1129b0 con 0x7f02ec102a60 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.485+0000 7f02f1400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec112830 con 0x7f02ec108cf0 2024-09-21T07:49:19.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.485+0000 7f02f1400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec112b30 con 0x7f02ec1083a0 2024-09-21T07:49:19.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.486+0000 7f02eb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec108cf0 0x7f02ec1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:19.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.486+0000 7f02eb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec108cf0 0x7f02ec1a1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:49652/0 (socket says 172.21.15.84:49652) 2024-09-21T07:49:19.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.486+0000 7f02eb200640 1 -- 172.21.15.84:0/2716915101 learned_addr learned my addr 172.21.15.84:0/2716915101 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:19.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.486+0000 7f02e9e00640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02ec1083a0 0x7f02ec19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:19.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.486+0000 7f02ea800640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02ec102a60 0x7f02ec19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:19.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.487+0000 7f02eb200640 1 -- 172.21.15.84:0/2716915101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02ec1083a0 msgr2=0x7f02ec19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:19.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.487+0000 7f02eb200640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02ec1083a0 0x7f02ec19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:19.489 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:19 smithi084 ceph-mon[30411]: pgmap v338: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:19.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.487+0000 7f02eb200640 1 -- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02ec102a60 msgr2=0x7f02ec19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:19.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.487+0000 7f02eb200640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02ec102a60 0x7f02ec19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:19.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.487+0000 7f02eb200640 1 -- 172.21.15.84:0/2716915101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec1a25a0 con 0x7f02ec108cf0 2024-09-21T07:49:19.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.487+0000 7f02ea800640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02ec102a60 0x7f02ec19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:49:19.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.488+0000 7f02eb200640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec108cf0 0x7f02ec1a1f30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f02e400efc0 tx=0x7f02e400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:19.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.488+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4003970 con 0x7f02ec108cf0 2024-09-21T07:49:19.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.488+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02e4004020 con 0x7f02ec108cf0 2024-09-21T07:49:19.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.488+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e400b970 con 0x7f02ec108cf0 2024-09-21T07:49:19.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.488+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ec1a2890 con 0x7f02ec108cf0 2024-09-21T07:49:19.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.488+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ec1a90b0 con 0x7f02ec108cf0 2024-09-21T07:49:19.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.490+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f02ec1018b0 con 0x7f02ec108cf0 2024-09-21T07:49:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.494+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f02e401d020 con 0x7f02ec108cf0 2024-09-21T07:49:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.497+0000 7f02e3400640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02d00b66e0 0x7f02d00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.497+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f02e40e8010 con 0x7f02ec108cf0 2024-09-21T07:49:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.497+0000 7f02e3400640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] conn(0x7f02d00c19f0 0x7f02d00c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.498+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 --> [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02e40098e0 con 0x7f02d00c19f0 2024-09-21T07:49:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.498+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f02e40e8460 con 0x7f02ec108cf0 2024-09-21T07:49:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.498+0000 7f02ea800640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02d00b66e0 0x7f02d00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.499+0000 7f02e9e00640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] conn(0x7f02d00c19f0 0x7f02d00c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.500+0000 7f02ea800640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02d00b66e0 0x7f02d00b8bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00baa0 tx=0x7f02dc005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.500+0000 7f02e9e00640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] conn(0x7f02d00c19f0 0x7f02d00c3ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:19.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.502+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== osd.3 v2:172.21.15.84:6810/3656047347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f02e40098e0 con 0x7f02d00c19f0 2024-09-21T07:49:19.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.524+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 --> [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f02ec103ce0 con 0x7f02d00c19f0 2024-09-21T07:49:19.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.525+0000 7f02e3400640 1 -- 172.21.15.84:0/2716915101 <== osd.3 v2:172.21.15.84:6810/3656047347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f02ec103ce0 con 0x7f02d00c19f0 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] conn(0x7f02d00c19f0 msgr2=0x7f02d00c3ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] conn(0x7f02d00c19f0 0x7f02d00c3ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02d00b66e0 msgr2=0x7f02d00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02d00b66e0 0x7f02d00b8bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00baa0 tx=0x7f02dc005d90 comp rx=0 tx=0).stop 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec108cf0 msgr2=0x7f02ec1a1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 --2- 172.21.15.84:0/2716915101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec108cf0 0x7f02ec1a1f30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f02e400efc0 tx=0x7f02e400c800 comp rx=0 tx=0).stop 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02eb200640 1 -- 172.21.15.84:0/2716915101 reap_dead start 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 shutdown_connections 2024-09-21T07:49:19.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.526+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 >> 172.21.15.84:0/2716915101 conn(0x7f02ec079730 msgr2=0x7f02ec06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:19.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.527+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 shutdown_connections 2024-09-21T07:49:19.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:19.527+0000 7f02f1400640 1 -- 172.21.15.84:0/2716915101 wait complete. 2024-09-21T07:49:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:19 smithi162 ceph-mon[34833]: pgmap v338: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:20.277 INFO:teuthology.orchestra.run.smithi084.stdout:107374182478 2024-09-21T07:49:20.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T07:49:20.702 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:20.703 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:20.703 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:20.713 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:20.713 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:20.717 INFO:teuthology.orchestra.run.smithi084.stdout:201863462967 2024-09-21T07:49:20.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T07:49:21.134 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:21.143 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:21.144 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:21.145 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:21.261 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:21 smithi084 ceph-mon[30411]: pgmap v339: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:21.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:21 smithi191 ceph-mon[34667]: pgmap v339: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:21 smithi162 ceph-mon[34833]: pgmap v339: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 -- 172.21.15.84:0/3793719066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10c010 msgr2=0x7f979c112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3793719066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10c010 0x7f979c112840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9794009ca0 tx=0x7f979402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 -- 172.21.15.84:0/3793719066 shutdown_connections 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3793719066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10c010 0x7f979c112840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3793719066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f979c10b6c0 0x7f979c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3793719066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979c105d80 0x7f979c106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 -- 172.21.15.84:0/3793719066 >> 172.21.15.84:0/3793719066 conn(0x7f979c101810 msgr2=0x7f979c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 -- 172.21.15.84:0/3793719066 shutdown_connections 2024-09-21T07:49:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.973+0000 7f97a1a00640 1 -- 172.21.15.84:0/3793719066 wait complete. 2024-09-21T07:49:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.974+0000 7f97a1a00640 1 Processor -- start 2024-09-21T07:49:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.974+0000 7f97a1a00640 1 -- start start 2024-09-21T07:49:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f97a1a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979c105d80 0x7f979c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f97a1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10b6c0 0x7f979c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f97a1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f979c10c010 0x7f979c1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f97a1a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f979c115d20 con 0x7f979c10b6c0 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f97a1a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f979c115ba0 con 0x7f979c10c010 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f97a1a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f979c115ea0 con 0x7f979c105d80 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f979a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10b6c0 0x7f979c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f979a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10b6c0 0x7f979c19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35062/0 (socket says 172.21.15.84:35062) 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f979a000640 1 -- 172.21.15.84:0/3969174047 learned_addr learned my addr 172.21.15.84:0/3969174047 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f979aa00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979c105d80 0x7f979c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.975+0000 7f979b400640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f979c10c010 0x7f979c1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f979a000640 1 -- 172.21.15.84:0/3969174047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979c105d80 msgr2=0x7f979c19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f979a000640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979c105d80 0x7f979c19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f979a000640 1 -- 172.21.15.84:0/3969174047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f979c10c010 msgr2=0x7f979c1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f979a000640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f979c10c010 0x7f979c1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f979a000640 1 -- 172.21.15.84:0/3969174047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c1a2660 con 0x7f979c10b6c0 2024-09-21T07:49:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f979aa00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979c105d80 0x7f979c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f979a000640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10b6c0 0x7f979c19cc90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f978800e9f0 tx=0x7f978800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f9793400640 1 -- 172.21.15.84:0/3969174047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978800ccc0 con 0x7f979c10b6c0 2024-09-21T07:49:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f9793400640 1 -- 172.21.15.84:0/3969174047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97880108e0 con 0x7f979c10b6c0 2024-09-21T07:49:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c1a2950 con 0x7f979c10b6c0 2024-09-21T07:49:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f9793400640 1 -- 172.21.15.84:0/3969174047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788018860 con 0x7f979c10b6c0 2024-09-21T07:49:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.976+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c1a90b0 con 0x7f979c10b6c0 2024-09-21T07:49:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.977+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c106190 con 0x7f979c10b6c0 2024-09-21T07:49:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.981+0000 7f9793400640 1 -- 172.21.15.84:0/3969174047 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f9788010430 con 0x7f979c10b6c0 2024-09-21T07:49:21.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.982+0000 7f9793400640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f97800b6670 0x7f97800b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:21.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.982+0000 7f9793400640 1 -- 172.21.15.84:0/3969174047 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f97880e8140 con 0x7f979c10b6c0 2024-09-21T07:49:21.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.982+0000 7f979aa00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f97800b6670 0x7f97800b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:21.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.983+0000 7f979aa00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f97800b6670 0x7f97800b8b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f978c005fd0 tx=0x7f978c00b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:21.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:21.983+0000 7f9793400640 1 -- 172.21.15.84:0/3969174047 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97880ae3f0 con 0x7f979c10b6c0 2024-09-21T07:49:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.191+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f979c10de60 con 0x7f979c10b6c0 2024-09-21T07:49:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.191+0000 7f9793400640 1 -- 172.21.15.84:0/3969174047 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97880b27d0 con 0x7f979c10b6c0 2024-09-21T07:49:22.193 INFO:teuthology.orchestra.run.smithi084.stdout:38654705758 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f97800b6670 msgr2=0x7f97800b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f97800b6670 0x7f97800b8b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f978c005fd0 tx=0x7f978c00b5f0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10b6c0 msgr2=0x7f979c19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10b6c0 0x7f979c19cc90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f978800e9f0 tx=0x7f978800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 shutdown_connections 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f97800b6670 0x7f97800b8b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f979c10c010 0x7f979c1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f979c10b6c0 0x7f979c19cc90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 --2- 172.21.15.84:0/3969174047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979c105d80 0x7f979c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 >> 172.21.15.84:0/3969174047 conn(0x7f979c101810 msgr2=0x7f979c10acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 shutdown_connections 2024-09-21T07:49:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.194+0000 7f97a1a00640 1 -- 172.21.15.84:0/3969174047 wait complete. 2024-09-21T07:49:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 -- 172.21.15.84:0/4256766677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 msgr2=0x7f369410f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 --2- 172.21.15.84:0/4256766677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369410f9d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3684009860 tx=0x7f368402a360 comp rx=0 tx=0).stop 2024-09-21T07:49:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 -- 172.21.15.84:0/4256766677 shutdown_connections 2024-09-21T07:49:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 --2- 172.21.15.84:0/4256766677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f369410ff10 0x7f3694112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 --2- 172.21.15.84:0/4256766677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369410f9d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 --2- 172.21.15.84:0/4256766677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36940757b0 0x7f3694075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 -- 172.21.15.84:0/4256766677 >> 172.21.15.84:0/4256766677 conn(0x7f36940ff440 msgr2=0x7f3694101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.719+0000 7f369b200640 1 -- 172.21.15.84:0/4256766677 shutdown_connections 2024-09-21T07:49:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.720+0000 7f369b200640 1 -- 172.21.15.84:0/4256766677 wait complete. 2024-09-21T07:49:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.721+0000 7f369b200640 1 Processor -- start 2024-09-21T07:49:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.721+0000 7f369b200640 1 -- start start 2024-09-21T07:49:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f369b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36940757b0 0x7f369419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f369b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f369b200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f369410ff10 0x7f36941a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f369b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3694115a80 con 0x7f3694076100 2024-09-21T07:49:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f369b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3694115900 con 0x7f36940757b0 2024-09-21T07:49:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f369b200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3694115c00 con 0x7f369410ff10 2024-09-21T07:49:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369419cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35082/0 (socket says 172.21.15.84:35082) 2024-09-21T07:49:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 -- 172.21.15.84:0/3137998997 learned_addr learned my addr 172.21.15.84:0/3137998997 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699e00640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36940757b0 0x7f369419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 -- 172.21.15.84:0/3137998997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f369410ff10 msgr2=0x7f36941a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f369410ff10 0x7f36941a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 -- 172.21.15.84:0/3137998997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36940757b0 msgr2=0x7f369419c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36940757b0 0x7f369419c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699400640 1 -- 172.21.15.84:0/3137998997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36941a2480 con 0x7f3694076100 2024-09-21T07:49:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.722+0000 7f3699e00640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36940757b0 0x7f369419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.723+0000 7f3699400640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369419cab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3684035040 tx=0x7f3684032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.723+0000 7f368ea00640 1 -- 172.21.15.84:0/3137998997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3684040020 con 0x7f3694076100 2024-09-21T07:49:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.723+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36941a2710 con 0x7f3694076100 2024-09-21T07:49:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.723+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36941a8ed0 con 0x7f3694076100 2024-09-21T07:49:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.723+0000 7f368ea00640 1 -- 172.21.15.84:0/3137998997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3684038040 con 0x7f3694076100 2024-09-21T07:49:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.723+0000 7f368ea00640 1 -- 172.21.15.84:0/3137998997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3684037070 con 0x7f3694076100 2024-09-21T07:49:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.724+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3678005290 con 0x7f3694076100 2024-09-21T07:49:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.727+0000 7f368ea00640 1 -- 172.21.15.84:0/3137998997 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f3684043020 con 0x7f3694076100 2024-09-21T07:49:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.728+0000 7f368ea00640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f367c0b65f0 0x7f367c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.728+0000 7f368ea00640 1 -- 172.21.15.84:0/3137998997 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f3684107390 con 0x7f3694076100 2024-09-21T07:49:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.728+0000 7f3699e00640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f367c0b65f0 0x7f367c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.729+0000 7f3699e00640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f367c0b65f0 0x7f367c0b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3688005fd0 tx=0x7f3688009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:22.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.731+0000 7f368ea00640 1 -- 172.21.15.84:0/3137998997 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36840cd6a0 con 0x7f3694076100 2024-09-21T07:49:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.927+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3678005850 con 0x7f3694076100 2024-09-21T07:49:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.928+0000 7f368ea00640 1 -- 172.21.15.84:0/3137998997 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f36840d1a80 con 0x7f3694076100 2024-09-21T07:49:22.930 INFO:teuthology.orchestra.run.smithi084.stdout:154618822722 2024-09-21T07:49:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f367c0b65f0 msgr2=0x7f367c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f367c0b65f0 0x7f367c0b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3688005fd0 tx=0x7f3688009260 comp rx=0 tx=0).stop 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 msgr2=0x7f369419cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369419cab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3684035040 tx=0x7f3684032d50 comp rx=0 tx=0).stop 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 shutdown_connections 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f367c0b65f0 0x7f367c0b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f369410ff10 0x7f36941a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3694076100 0x7f369419cab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 --2- 172.21.15.84:0/3137998997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36940757b0 0x7f369419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.930+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 >> 172.21.15.84:0/3137998997 conn(0x7f36940ff440 msgr2=0x7f3694109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.931+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 shutdown_connections 2024-09-21T07:49:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:22.931+0000 7f369b200640 1 -- 172.21.15.84:0/3137998997 wait complete. 2024-09-21T07:49:23.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 -- 172.21.15.84:0/125785495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c810de20 msgr2=0x7f14c8110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:23.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 --2- 172.21.15.84:0/125785495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c810de20 0x7f14c8110310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009ca0 tx=0x7f14c002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 -- 172.21.15.84:0/125785495 shutdown_connections 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 --2- 172.21.15.84:0/125785495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c810de20 0x7f14c8110310 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 --2- 172.21.15.84:0/125785495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14c8105310 0x7f14c810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 --2- 172.21.15.84:0/125785495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c81049c0 0x7f14c8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 -- 172.21.15.84:0/125785495 >> 172.21.15.84:0/125785495 conn(0x7f14c8079730 msgr2=0x7f14c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 -- 172.21.15.84:0/125785495 shutdown_connections 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.337+0000 7f14cf400640 1 -- 172.21.15.84:0/125785495 wait complete. 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.338+0000 7f14cf400640 1 Processor -- start 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cf400640 1 -- start start 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14c81049c0 0x7f14c819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c8105310 0x7f14c819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c810de20 0x7f14c819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cf400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f14c8113ad0 con 0x7f14c8105310 2024-09-21T07:49:23.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cf400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14c8113950 con 0x7f14c810de20 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cf400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f14c8113c50 con 0x7f14c81049c0 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14c7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c8105310 0x7f14c819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14c81049c0 0x7f14c819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14c81049c0 0x7f14c819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52778/0 (socket says 172.21.15.84:52778) 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cca00640 1 -- 172.21.15.84:0/1977582301 learned_addr learned my addr 172.21.15.84:0/1977582301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14c7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c8105310 0x7f14c819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35112/0 (socket says 172.21.15.84:35112) 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.339+0000 7f14cd400640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c810de20 0x7f14c819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c7e00640 1 -- 172.21.15.84:0/1977582301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14c81049c0 msgr2=0x7f14c819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c7e00640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14c81049c0 0x7f14c819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c7e00640 1 -- 172.21.15.84:0/1977582301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c810de20 msgr2=0x7f14c819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c7e00640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c810de20 0x7f14c819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c7e00640 1 -- 172.21.15.84:0/1977582301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c81a0410 con 0x7f14c8105310 2024-09-21T07:49:23.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c7e00640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c8105310 0x7f14c819aa40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14c806b950 tx=0x7f14b400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c5600640 1 -- 172.21.15.84:0/1977582301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b400cc40 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c5600640 1 -- 172.21.15.84:0/1977582301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14b400cde0 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14c5600640 1 -- 172.21.15.84:0/1977582301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4018780 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.340+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c81a0700 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.341+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c81a6e60 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.342+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c806c1e0 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.344+0000 7f14c5600640 1 -- 172.21.15.84:0/1977582301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f14b4010a90 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.346+0000 7f14c5600640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f14b00b6670 0x7f14b00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.347+0000 7f14c5600640 1 -- 172.21.15.84:0/1977582301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f14b40e7fe0 con 0x7f14c8105310 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.347+0000 7f14cca00640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f14b00b6670 0x7f14b00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.347+0000 7f14cca00640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f14b00b6670 0x7f14b00b8b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14bc005fd0 tx=0x7f14bc00b4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:23.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.349+0000 7f14c5600640 1 -- 172.21.15.84:0/1977582301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14b40b2670 con 0x7f14c8105310 2024-09-21T07:49:23.375 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:23 smithi084 ceph-mon[30411]: pgmap v340: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-21T07:49:23.375 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:23 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3969174047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:49:23.375 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:23 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3137998997' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:49:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:23 smithi191 ceph-mon[34667]: pgmap v340: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-21T07:49:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:23 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3969174047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:49:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:23 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3137998997' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:49:23.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.541+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f14c8104dd0 con 0x7f14c8105310 2024-09-21T07:49:23.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.541+0000 7f14c5600640 1 -- 172.21.15.84:0/1977582301 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14c8104dd0 con 0x7f14c8105310 2024-09-21T07:49:23.543 INFO:teuthology.orchestra.run.smithi084.stdout:77309411413 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f14b00b6670 msgr2=0x7f14b00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f14b00b6670 0x7f14b00b8b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14bc005fd0 tx=0x7f14bc00b4a0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c8105310 msgr2=0x7f14c819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c8105310 0x7f14c819aa40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14c806b950 tx=0x7f14b400ee50 comp rx=0 tx=0).stop 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 shutdown_connections 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f14b00b6670 0x7f14b00b8b80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c810de20 0x7f14c819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c8105310 0x7f14c819aa40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 --2- 172.21.15.84:0/1977582301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14c81049c0 0x7f14c819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 >> 172.21.15.84:0/1977582301 conn(0x7f14c8079730 msgr2=0x7f14c8107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:23.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 shutdown_connections 2024-09-21T07:49:23.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:23.544+0000 7f14cf400640 1 -- 172.21.15.84:0/1977582301 wait complete. 2024-09-21T07:49:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:23 smithi162 ceph-mon[34833]: pgmap v340: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-21T07:49:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:23 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3969174047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:49:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:23 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3137998997' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:49:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 -- 172.21.15.84:0/1630682322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 msgr2=0x7fd340110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 --2- 172.21.15.84:0/1630682322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 0x7fd340110470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd338009ca0 tx=0x7fd33802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 -- 172.21.15.84:0/1630682322 shutdown_connections 2024-09-21T07:49:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 --2- 172.21.15.84:0/1630682322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 0x7fd340110470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 --2- 172.21.15.84:0/1630682322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3401092f0 0x7fd340109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 --2- 172.21.15.84:0/1630682322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401039b0 0x7fd340103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 -- 172.21.15.84:0/1630682322 >> 172.21.15.84:0/1630682322 conn(0x7fd3400ff440 msgr2=0x7fd340101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 -- 172.21.15.84:0/1630682322 shutdown_connections 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.173+0000 7fd344c00640 1 -- 172.21.15.84:0/1630682322 wait complete. 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.175+0000 7fd344c00640 1 Processor -- start 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.175+0000 7fd344c00640 1 -- start start 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd344c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3401039b0 0x7fd340075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd344c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401092f0 0x7fd340075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd344c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 0x7fd340076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd344c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd340113950 con 0x7fd340109c40 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd344c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd3401137d0 con 0x7fd3401039b0 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd344c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd340113ad0 con 0x7fd3401092f0 2024-09-21T07:49:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd33ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401092f0 0x7fd340075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd33fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 0x7fd340076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd33ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401092f0 0x7fd340075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52796/0 (socket says 172.21.15.84:52796) 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd33ea00640 1 -- 172.21.15.84:0/3247225100 learned_addr learned my addr 172.21.15.84:0/3247225100 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.176+0000 7fd33f400640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3401039b0 0x7fd340075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd33f400640 1 -- 172.21.15.84:0/3247225100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401092f0 msgr2=0x7fd340075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd33f400640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401092f0 0x7fd340075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd33f400640 1 -- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 msgr2=0x7fd340076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd33f400640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 0x7fd340076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd33f400640 1 -- 172.21.15.84:0/3247225100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3401a8560 con 0x7fd3401039b0 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd33ea00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401092f0 0x7fd340075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd33f400640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3401039b0 0x7fd340075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd330005fd0 tx=0x7fd33000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd337e00640 1 -- 172.21.15.84:0/3247225100 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330009c30 con 0x7fd3401039b0 2024-09-21T07:49:24.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd337e00640 1 -- 172.21.15.84:0/3247225100 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd330009dd0 con 0x7fd3401039b0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd337e00640 1 -- 172.21.15.84:0/3247225100 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330010460 con 0x7fd3401039b0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.177+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3401a8850 con 0x7fd3401039b0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.178+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3401a8d90 con 0x7fd3401039b0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.179+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd340103dc0 con 0x7fd3401039b0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.181+0000 7fd337e00640 1 -- 172.21.15.84:0/3247225100 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd330003e80 con 0x7fd3401039b0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.183+0000 7fd337e00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3240b65f0 0x7fd3240b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.183+0000 7fd337e00640 1 -- 172.21.15.84:0/3247225100 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fd3300e78b0 con 0x7fd3401039b0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.183+0000 7fd33ea00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3240b65f0 0x7fd3240b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.184+0000 7fd33ea00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3240b65f0 0x7fd3240b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd340102c90 tx=0x7fd32c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:24.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.186+0000 7fd337e00640 1 -- 172.21.15.84:0/3247225100 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd330017020 con 0x7fd3401039b0 2024-09-21T07:49:24.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:24 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1977582301' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 -- 172.21.15.84:0/3186153994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 msgr2=0x7f4f68109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 --2- 172.21.15.84:0/3186153994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f68109700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009900 tx=0x7f4f5402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 -- 172.21.15.84:0/3186153994 shutdown_connections 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 --2- 172.21.15.84:0/3186153994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f68109c40 0x7f4f68110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 --2- 172.21.15.84:0/3186153994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f68109700 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 --2- 172.21.15.84:0/3186153994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f681039b0 0x7f4f68103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 -- 172.21.15.84:0/3186153994 >> 172.21.15.84:0/3186153994 conn(0x7f4f680ff440 msgr2=0x7f4f68101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 -- 172.21.15.84:0/3186153994 shutdown_connections 2024-09-21T07:49:24.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.314+0000 7f4f6d000640 1 -- 172.21.15.84:0/3186153994 wait complete. 2024-09-21T07:49:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.315+0000 7f4f6d000640 1 Processor -- start 2024-09-21T07:49:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.315+0000 7f4f6d000640 1 -- start start 2024-09-21T07:49:24.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f6d000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f681039b0 0x7f4f6819c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f6d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f6819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f6d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f68109c40 0x7f4f681a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f6d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68113900 con 0x7f4f681092f0 2024-09-21T07:49:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f6d000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68113780 con 0x7f4f68109c40 2024-09-21T07:49:24.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f6d000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68113a80 con 0x7f4f681039b0 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f66a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f6819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f66a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f6819cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35160/0 (socket says 172.21.15.84:35160) 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f66a00640 1 -- 172.21.15.84:0/1477793719 learned_addr learned my addr 172.21.15.84:0/1477793719 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f67400640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f681039b0 0x7f4f6819c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.316+0000 7f4f67e00640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f68109c40 0x7f4f681a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f67e00640 1 -- 172.21.15.84:0/1477793719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f681039b0 msgr2=0x7f4f6819c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f67e00640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f681039b0 0x7f4f6819c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f67e00640 1 -- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 msgr2=0x7f4f6819cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f67e00640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f6819cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f67e00640 1 -- 172.21.15.84:0/1477793719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f681a2480 con 0x7f4f68109c40 2024-09-21T07:49:24.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f67400640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f681039b0 0x7f4f6819c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f66a00640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f6819cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.317+0000 7f4f67e00640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f68109c40 0x7f4f681a1d50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009fd0 tx=0x7f4f6000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.318+0000 7f4f5fe00640 1 -- 172.21.15.84:0/1477793719 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000ce20 con 0x7f4f68109c40 2024-09-21T07:49:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.318+0000 7f4f5fe00640 1 -- 172.21.15.84:0/1477793719 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f60005020 con 0x7f4f68109c40 2024-09-21T07:49:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.318+0000 7f4f5fe00640 1 -- 172.21.15.84:0/1477793719 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60010690 con 0x7f4f68109c40 2024-09-21T07:49:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.318+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f681a2770 con 0x7f4f68109c40 2024-09-21T07:49:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.318+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f681a8ed0 con 0x7f4f68109c40 2024-09-21T07:49:24.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.319+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f68103dc0 con 0x7f4f68109c40 2024-09-21T07:49:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.322+0000 7f4f5fe00640 1 -- 172.21.15.84:0/1477793719 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4f600054d0 con 0x7f4f68109c40 2024-09-21T07:49:24.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.325+0000 7f4f5fe00640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4f4c0b6670 0x7f4f4c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:24.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.325+0000 7f4f5fe00640 1 -- 172.21.15.84:0/1477793719 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f4f600e7fc0 con 0x7f4f68109c40 2024-09-21T07:49:24.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.325+0000 7f4f67400640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4f4c0b6670 0x7f4f4c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:24.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.326+0000 7f4f67400640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4f4c0b6670 0x7f4f4c0b8b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009fc0 tx=0x7f4f58005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:24.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.327+0000 7f4f5fe00640 1 -- 172.21.15.84:0/1477793719 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f600ae270 con 0x7f4f68109c40 2024-09-21T07:49:24.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:24 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1977582301' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:49:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.414+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fd34010b4a0 con 0x7fd3401039b0 2024-09-21T07:49:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.415+0000 7fd337e00640 1 -- 172.21.15.84:0/3247225100 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd3300b1f40 con 0x7fd3401039b0 2024-09-21T07:49:24.417 INFO:teuthology.orchestra.run.smithi084.stdout:274877906982 2024-09-21T07:49:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.417+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3240b65f0 msgr2=0x7fd3240b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.417+0000 7fd344c00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3240b65f0 0x7fd3240b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd340102c90 tx=0x7fd32c005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.417+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3401039b0 msgr2=0x7fd340075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.417+0000 7fd344c00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3401039b0 0x7fd340075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd330005fd0 tx=0x7fd33000dde0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 shutdown_connections 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3240b65f0 0x7fd3240b8b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd340109c40 0x7fd340076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3401092f0 0x7fd340075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 --2- 172.21.15.84:0/3247225100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3401039b0 0x7fd340075710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 >> 172.21.15.84:0/3247225100 conn(0x7fd3400ff440 msgr2=0x7fd340108930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 shutdown_connections 2024-09-21T07:49:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.418+0000 7fd344c00640 1 -- 172.21.15.84:0/3247225100 wait complete. 2024-09-21T07:49:24.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.543+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4f6819d640 con 0x7f4f68109c40 2024-09-21T07:49:24.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.544+0000 7f4f5fe00640 1 -- 172.21.15.84:0/1477793719 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4f6819d640 con 0x7f4f68109c40 2024-09-21T07:49:24.546 INFO:teuthology.orchestra.run.smithi084.stdout:180388626493 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4f4c0b6670 msgr2=0x7f4f4c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4f4c0b6670 0x7f4f4c0b8b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009fc0 tx=0x7f4f58005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f68109c40 msgr2=0x7f4f681a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f68109c40 0x7f4f681a1d50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009fd0 tx=0x7f4f6000ef10 comp rx=0 tx=0).stop 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 shutdown_connections 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4f4c0b6670 0x7f4f4c0b8b80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f68109c40 0x7f4f681a1d50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f681092f0 0x7f4f6819cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 --2- 172.21.15.84:0/1477793719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f681039b0 0x7f4f6819c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:24.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 >> 172.21.15.84:0/1477793719 conn(0x7f4f680ff440 msgr2=0x7f4f681089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:24.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 shutdown_connections 2024-09-21T07:49:24.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:24.546+0000 7f4f6d000640 1 -- 172.21.15.84:0/1477793719 wait complete. 2024-09-21T07:49:24.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:24 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1977582301' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:49:24.817 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705756 got 38654705758 for osd.0 2024-09-21T07:49:24.817 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:25.382 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:25 smithi084 ceph-mon[30411]: pgmap v341: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:25.382 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:25 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3247225100' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:49:25.382 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:25 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1477793719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:49:25.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:25 smithi191 ceph-mon[34667]: pgmap v341: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:25.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:25 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3247225100' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:49:25.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:25 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1477793719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:49:25.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:25 smithi162 ceph-mon[34833]: pgmap v341: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:25.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:25 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3247225100' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:49:25.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:25 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1477793719' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:49:25.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 -- 172.21.15.84:0/2366540428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c110440 msgr2=0x7f2f4c116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:25.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2366540428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c110440 0x7f2f4c116c70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009ca0 tx=0x7f2f4402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 -- 172.21.15.84:0/2366540428 shutdown_connections 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2366540428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c110440 0x7f2f4c116c70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2366540428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f4c10faf0 0x7f2f4c10ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2366540428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f4c10a1b0 0x7f2f4c10a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 -- 172.21.15.84:0/2366540428 >> 172.21.15.84:0/2366540428 conn(0x7f2f4c0780e0 msgr2=0x7f2f4c1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 -- 172.21.15.84:0/2366540428 shutdown_connections 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.639+0000 7f2f53a00640 1 -- 172.21.15.84:0/2366540428 wait complete. 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.640+0000 7f2f53a00640 1 Processor -- start 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.640+0000 7f2f53a00640 1 -- start start 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f53a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c10a1b0 0x7f2f4c1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f53a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f4c10faf0 0x7f2f4c1a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:25.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f53a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f4c110440 0x7f2f4c1a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f53a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c11a110 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f53a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c119f90 con 0x7f2f4c110440 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f53a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c11a290 con 0x7f2f4c10faf0 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c10a1b0 0x7f2f4c1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c10a1b0 0x7f2f4c1a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35172/0 (socket says 172.21.15.84:35172) 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 -- 172.21.15.84:0/2737726597 learned_addr learned my addr 172.21.15.84:0/2737726597 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f4be00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f4c10faf0 0x7f2f4c1a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51a00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f4c110440 0x7f2f4c1a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 -- 172.21.15.84:0/2737726597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f4c10faf0 msgr2=0x7f2f4c1a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f4c10faf0 0x7f2f4c1a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 -- 172.21.15.84:0/2737726597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f4c110440 msgr2=0x7f2f4c1a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f4c110440 0x7f2f4c1a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.641+0000 7f2f51000640 1 -- 172.21.15.84:0/2737726597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c1a6a50 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.642+0000 7f2f51000640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c10a1b0 0x7f2f4c1a0ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000d950 tx=0x7f2f4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.642+0000 7f2f49600640 1 -- 172.21.15.84:0/2737726597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40017030 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.642+0000 7f2f49600640 1 -- 172.21.15.84:0/2737726597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f40004020 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.642+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4c1a6d40 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.642+0000 7f2f49600640 1 -- 172.21.15.84:0/2737726597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f400047a0 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.642+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4c1ad4a0 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.643+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f4c10a5c0 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.646+0000 7f2f49600640 1 -- 172.21.15.84:0/2737726597 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2f40009a30 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.649+0000 7f2f49600640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f340b65f0 0x7f2f340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.649+0000 7f2f49600640 1 -- 172.21.15.84:0/2737726597 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f2f400e7ad0 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.649+0000 7f2f4be00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f340b65f0 0x7f2f340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.650+0000 7f2f4be00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f340b65f0 0x7f2f340b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c07a360 tx=0x7f2f38005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.650+0000 7f2f49600640 1 -- 172.21.15.84:0/2737726597 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f400add80 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.870+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2f4c1a1c10 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.870+0000 7f2f49600640 1 -- 172.21.15.84:0/2737726597 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2f400b2160 con 0x7f2f4c10a1b0 2024-09-21T07:49:25.888 INFO:teuthology.orchestra.run.smithi084.stdout:133143986248 2024-09-21T07:49:25.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f340b65f0 msgr2=0x7f2f340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:25.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f340b65f0 0x7f2f340b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c07a360 tx=0x7f2f38005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:25.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c10a1b0 msgr2=0x7f2f4c1a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:25.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c10a1b0 0x7f2f4c1a0ae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000d950 tx=0x7f2f4000de10 comp rx=0 tx=0).stop 2024-09-21T07:49:25.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 shutdown_connections 2024-09-21T07:49:25.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2f340b65f0 0x7f2f340b8b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f4c110440 0x7f2f4c1a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f4c10faf0 0x7f2f4c1a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 --2- 172.21.15.84:0/2737726597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f4c10a1b0 0x7f2f4c1a0ae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:25.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 >> 172.21.15.84:0/2737726597 conn(0x7f2f4c0780e0 msgr2=0x7f2f4c078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:25.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 shutdown_connections 2024-09-21T07:49:25.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:25.873+0000 7f2f53a00640 1 -- 172.21.15.84:0/2737726597 wait complete. 2024-09-21T07:49:26.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:26 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2737726597' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:49:26.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:26 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2737726597' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:49:26.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:26 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2737726597' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:49:26.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822720 got 154618822722 for osd.5 2024-09-21T07:49:26.720 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 -- 172.21.15.84:0/3824874911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe058109c20 msgr2=0x7fe058110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 --2- 172.21.15.84:0/3824874911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe058109c20 0x7fe058110450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe050009ca0 tx=0x7fe05002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 -- 172.21.15.84:0/3824874911 shutdown_connections 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 --2- 172.21.15.84:0/3824874911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe058109c20 0x7fe058110450 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 --2- 172.21.15.84:0/3824874911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0581092d0 0x7fe0581096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 --2- 172.21.15.84:0/3824874911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe058103990 0x7fe058103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 -- 172.21.15.84:0/3824874911 >> 172.21.15.84:0/3824874911 conn(0x7fe0580ff3e0 msgr2=0x7fe058101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 -- 172.21.15.84:0/3824874911 shutdown_connections 2024-09-21T07:49:27.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.194+0000 7fe05cc00640 1 -- 172.21.15.84:0/3824874911 wait complete. 2024-09-21T07:49:27.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.195+0000 7fe05cc00640 1 Processor -- start 2024-09-21T07:49:27.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.195+0000 7fe05cc00640 1 -- start start 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe05cc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe058103990 0x7fe058075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe05cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0581092d0 0x7fe058075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe05cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058109c20 0x7fe058076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe05cc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe058113930 con 0x7fe0581092d0 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe05cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0581137b0 con 0x7fe058109c20 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe05cc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe058113ab0 con 0x7fe058103990 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe04fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0581092d0 0x7fe058075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe057400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe058103990 0x7fe058075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe04fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0581092d0 0x7fe058075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35198/0 (socket says 172.21.15.84:35198) 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe04fe00640 1 -- 172.21.15.84:0/391453855 learned_addr learned my addr 172.21.15.84:0/391453855 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:27.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.196+0000 7fe057e00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058109c20 0x7fe058076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe04fe00640 1 -- 172.21.15.84:0/391453855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe058103990 msgr2=0x7fe058075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe04fe00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe058103990 0x7fe058075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe04fe00640 1 -- 172.21.15.84:0/391453855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058109c20 msgr2=0x7fe058076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe04fe00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058109c20 0x7fe058076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe04fe00640 1 -- 172.21.15.84:0/391453855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0581a8520 con 0x7fe0581092d0 2024-09-21T07:49:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe057400640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe058103990 0x7fe058075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe057e00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058109c20 0x7fe058076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe04fe00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0581092d0 0x7fe058075c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe04000d740 tx=0x7fe04000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe054c00640 1 -- 172.21.15.84:0/391453855 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe040017070 con 0x7fe0581092d0 2024-09-21T07:49:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0581a8810 con 0x7fe0581092d0 2024-09-21T07:49:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe054c00640 1 -- 172.21.15.84:0/391453855 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe04000de50 con 0x7fe0581092d0 2024-09-21T07:49:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe054c00640 1 -- 172.21.15.84:0/391453855 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04000f620 con 0x7fe0581092d0 2024-09-21T07:49:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.197+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0581a8da0 con 0x7fe0581092d0 2024-09-21T07:49:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.198+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe058103da0 con 0x7fe0581092d0 2024-09-21T07:49:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.201+0000 7fe054c00640 1 -- 172.21.15.84:0/391453855 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe04001a070 con 0x7fe0581092d0 2024-09-21T07:49:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.202+0000 7fe054c00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe03c0b6670 0x7fe03c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.202+0000 7fe054c00640 1 -- 172.21.15.84:0/391453855 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7fe0400e71c0 con 0x7fe0581092d0 2024-09-21T07:49:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.203+0000 7fe057400640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe03c0b6670 0x7fe03c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.203+0000 7fe057400640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe03c0b6670 0x7fe03c0b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe058077160 tx=0x7fe04800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:27.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.205+0000 7fe054c00640 1 -- 172.21.15.84:0/391453855 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0400b18d0 con 0x7fe0581092d0 2024-09-21T07:49:27.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:27 smithi084 ceph-mon[30411]: pgmap v342: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:27.402 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986246 got 133143986248 for osd.4 2024-09-21T07:49:27.402 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:27.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:27 smithi191 ceph-mon[34667]: pgmap v342: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:27.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.406+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe058076a10 con 0x7fe0581092d0 2024-09-21T07:49:27.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.407+0000 7fe054c00640 1 -- 172.21.15.84:0/391453855 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe0400b6810 con 0x7fe0581092d0 2024-09-21T07:49:27.409 INFO:teuthology.orchestra.run.smithi084.stdout:227633266739 2024-09-21T07:49:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe03c0b6670 msgr2=0x7fe03c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe03c0b6670 0x7fe03c0b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe058077160 tx=0x7fe04800b410 comp rx=0 tx=0).stop 2024-09-21T07:49:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0581092d0 msgr2=0x7fe058075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0581092d0 0x7fe058075c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe04000d740 tx=0x7fe04000dc00 comp rx=0 tx=0).stop 2024-09-21T07:49:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 shutdown_connections 2024-09-21T07:49:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe03c0b6670 0x7fe03c0b8b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058109c20 0x7fe058076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0581092d0 0x7fe058075c50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 --2- 172.21.15.84:0/391453855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe058103990 0x7fe058075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.409+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 >> 172.21.15.84:0/391453855 conn(0x7fe0580ff3e0 msgr2=0x7fe058106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.410+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 shutdown_connections 2024-09-21T07:49:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.410+0000 7fe05cc00640 1 -- 172.21.15.84:0/391453855 wait complete. 2024-09-21T07:49:27.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 -- 172.21.15.84:0/1226706768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 msgr2=0x7f83c4110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 --2- 172.21.15.84:0/1226706768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 0x7f83c4110470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009ca0 tx=0x7f83bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 -- 172.21.15.84:0/1226706768 shutdown_connections 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 --2- 172.21.15.84:0/1226706768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 0x7f83c4110470 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 --2- 172.21.15.84:0/1226706768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41092f0 0x7f83c4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 --2- 172.21.15.84:0/1226706768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83c41039b0 0x7f83c4103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 -- 172.21.15.84:0/1226706768 >> 172.21.15.84:0/1226706768 conn(0x7f83c40ff440 msgr2=0x7f83c4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 -- 172.21.15.84:0/1226706768 shutdown_connections 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.455+0000 7f83cae00640 1 -- 172.21.15.84:0/1226706768 wait complete. 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.456+0000 7f83cae00640 1 Processor -- start 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.456+0000 7f83cae00640 1 -- start start 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83cae00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41039b0 0x7f83c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83cae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83c41092f0 0x7f83c4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83cae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 0x7f83c4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83cae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4113900 con 0x7f83c4109c40 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83cae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4113780 con 0x7f83c41092f0 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83cae00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4113a80 con 0x7f83c41039b0 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83ca400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 0x7f83c4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83c9a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41039b0 0x7f83c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83ca400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 0x7f83c4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35216/0 (socket says 172.21.15.84:35216) 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83c9a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41039b0 0x7f83c4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52860/0 (socket says 172.21.15.84:52860) 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83ca400640 1 -- 172.21.15.84:0/4070429126 learned_addr learned my addr 172.21.15.84:0/4070429126 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83c9000640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83c41092f0 0x7f83c4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83c9a00640 1 -- 172.21.15.84:0/4070429126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83c41092f0 msgr2=0x7f83c4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83c9a00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83c41092f0 0x7f83c4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83c9a00640 1 -- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 msgr2=0x7f83c4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.457+0000 7f83c9a00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 0x7f83c4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.458+0000 7f83c9a00640 1 -- 172.21.15.84:0/4070429126 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c41a8570 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.458+0000 7f83c9a00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41039b0 0x7f83c4075710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83b800d6d0 tx=0x7f83b800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.458+0000 7f83c2000640 1 -- 172.21.15.84:0/4070429126 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8017070 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.458+0000 7f83c2000640 1 -- 172.21.15.84:0/4070429126 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83b8009820 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.458+0000 7f83c2000640 1 -- 172.21.15.84:0/4070429126 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8004c40 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.458+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c41a8860 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.458+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c41a8d50 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.459+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c4103dc0 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.462+0000 7f83c2000640 1 -- 172.21.15.84:0/4070429126 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f83b8005220 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.463+0000 7f83c2000640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f83ac0b65f0 0x7f83ac0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.464+0000 7f83c2000640 1 -- 172.21.15.84:0/4070429126 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9286+0+0 (secure 0 0 0) 0x7f83b80e77f0 con 0x7f83c41039b0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.464+0000 7f83c9000640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f83ac0b65f0 0x7f83ac0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.464+0000 7f83c9000640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f83ac0b65f0 0x7f83ac0b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f83c4102c90 tx=0x7f83b000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:27.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.465+0000 7f83c2000640 1 -- 172.21.15.84:0/4070429126 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83b80b1e80 con 0x7f83c41039b0 2024-09-21T07:49:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:27 smithi162 ceph-mon[34833]: pgmap v342: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.660+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f83c402e640 con 0x7f83c41039b0 2024-09-21T07:49:27.663 INFO:teuthology.orchestra.run.smithi084.stdout:60129542233 2024-09-21T07:49:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.661+0000 7f83c2000640 1 -- 172.21.15.84:0/4070429126 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83b80b6dc0 con 0x7f83c41039b0 2024-09-21T07:49:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f83ac0b65f0 msgr2=0x7f83ac0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f83ac0b65f0 0x7f83ac0b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f83c4102c90 tx=0x7f83b000b390 comp rx=0 tx=0).stop 2024-09-21T07:49:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41039b0 msgr2=0x7f83c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41039b0 0x7f83c4075710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83b800d6d0 tx=0x7f83b800db90 comp rx=0 tx=0).stop 2024-09-21T07:49:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 shutdown_connections 2024-09-21T07:49:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f83ac0b65f0 0x7f83ac0b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c4109c40 0x7f83c4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83c41092f0 0x7f83c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 --2- 172.21.15.84:0/4070429126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83c41039b0 0x7f83c4075710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 >> 172.21.15.84:0/4070429126 conn(0x7f83c40ff440 msgr2=0x7f83c4108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 shutdown_connections 2024-09-21T07:49:27.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:27.663+0000 7f83cae00640 1 -- 172.21.15.84:0/4070429126 wait complete. 2024-09-21T07:49:27.966 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626490 got 180388626493 for osd.6 2024-09-21T07:49:27.966 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:28.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:28 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/391453855' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:49:28.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:28 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4070429126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:49:28.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:28 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/391453855' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:49:28.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:28 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4070429126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:49:28.481 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411410 got 77309411413 for osd.2 2024-09-21T07:49:28.482 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:28.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:28 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/391453855' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:49:28.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:28 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4070429126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:49:29.117 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:29.138 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266737 got 227633266739 for osd.8 2024-09-21T07:49:29.139 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:29.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:29 smithi084 ceph-mon[30411]: pgmap v343: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:29.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:29 smithi191 ceph-mon[34667]: pgmap v343: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:29 smithi162 ceph-mon[34833]: pgmap v343: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:30.127 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542231 got 60129542233 for osd.1 2024-09-21T07:49:30.127 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:30.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]} : dispatch 2024-09-21T07:49:30.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:30 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]} : dispatch 2024-09-21T07:49:30.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]} : dispatch 2024-09-21T07:49:30.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:30 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]} : dispatch 2024-09-21T07:49:30.504 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:30.537 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906979 got 274877906982 for osd.10 2024-09-21T07:49:30.537 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:30.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]} : dispatch 2024-09-21T07:49:30.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:30 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]} : dispatch 2024-09-21T07:49:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:31 smithi191 ceph-mon[34667]: pgmap v344: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-21T07:49:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:31 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-21T07:49:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:31 smithi191 ceph-mon[34667]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T07:49:31.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:31 smithi084 ceph-mon[30411]: pgmap v344: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:31.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-21T07:49:31.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:31 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-21T07:49:31.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:31 smithi084 ceph-mon[30411]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T07:49:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 -- 172.21.15.84:0/852043474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11541092f0 msgr2=0x7f1154109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 --2- 172.21.15.84:0/852043474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11541092f0 0x7f1154109700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1140009900 tx=0x7f114002a410 comp rx=0 tx=0).stop 2024-09-21T07:49:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 -- 172.21.15.84:0/852043474 shutdown_connections 2024-09-21T07:49:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 --2- 172.21.15.84:0/852043474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1154109c40 0x7f1154110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 --2- 172.21.15.84:0/852043474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11541092f0 0x7f1154109700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 --2- 172.21.15.84:0/852043474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 0x7f1154103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 -- 172.21.15.84:0/852043474 >> 172.21.15.84:0/852043474 conn(0x7f11540ff440 msgr2=0x7f1154101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 -- 172.21.15.84:0/852043474 shutdown_connections 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.487+0000 7f115a600640 1 -- 172.21.15.84:0/852043474 wait complete. 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.488+0000 7f115a600640 1 Processor -- start 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f115a600640 1 -- start start 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f115a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 0x7f115419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f115a600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11541092f0 0x7f115419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f115a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1154109c40 0x7f11541a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f115a600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1154113900 con 0x7f1154109c40 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f115a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1154113780 con 0x7f11541039b0 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f115a600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1154113a80 con 0x7f11541092f0 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f1159c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1154109c40 0x7f11541a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f1153e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11541092f0 0x7f115419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f1159200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 0x7f115419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f1153e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11541092f0 0x7f115419cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34106/0 (socket says 172.21.15.84:34106) 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f1159200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 0x7f115419c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60800/0 (socket says 172.21.15.84:60800) 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f1153e00640 1 -- 172.21.15.84:0/2399750498 learned_addr learned my addr 172.21.15.84:0/2399750498 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.489+0000 7f1159c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1154109c40 0x7f11541a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51448/0 (socket says 172.21.15.84:51448) 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1159200640 1 -- 172.21.15.84:0/2399750498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11541092f0 msgr2=0x7f115419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1159200640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11541092f0 0x7f115419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1159200640 1 -- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1154109c40 msgr2=0x7f11541a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1159200640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1154109c40 0x7f11541a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1159200640 1 -- 172.21.15.84:0/2399750498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11541a24a0 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1159c00640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1154109c40 0x7f11541a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1159200640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 0x7f115419c530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f114800e9f0 tx=0x7f114800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1151600640 1 -- 172.21.15.84:0/2399750498 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114800ccc0 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1151600640 1 -- 172.21.15.84:0/2399750498 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11480108e0 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11541a2790 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.490+0000 7f1151600640 1 -- 172.21.15.84:0/2399750498 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148018880 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.491+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11541a8ef0 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.492+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1154103dc0 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.494+0000 7f1151600640 1 -- 172.21.15.84:0/2399750498 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1148010430 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.496+0000 7f1151600640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f113c0b65f0 0x7f113c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.496+0000 7f1151600640 1 -- 172.21.15.84:0/2399750498 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f11480e7eb0 con 0x7f11541039b0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.496+0000 7f1153e00640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f113c0b65f0 0x7f113c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.497+0000 7f1153e00640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f113c0b65f0 0x7f113c0b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1154105a60 tx=0x7f1140009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:31.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.498+0000 7f1151600640 1 -- 172.21.15.84:0/2399750498 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11480b2530 con 0x7f11541039b0 2024-09-21T07:49:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:31 smithi162 ceph-mon[34833]: pgmap v344: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-21T07:49:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:31 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-21T07:49:31.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:31 smithi162 ceph-mon[34833]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.598+0000 7f6166600640 1 -- 172.21.15.84:0/2985748449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 msgr2=0x7f6160103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.598+0000 7f6166600640 1 --2- 172.21.15.84:0/2985748449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160103dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6154009900 tx=0x7f615402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.599+0000 7f6166600640 1 -- 172.21.15.84:0/2985748449 shutdown_connections 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.599+0000 7f6166600640 1 --2- 172.21.15.84:0/2985748449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6160109c40 0x7f6160110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.599+0000 7f6166600640 1 --2- 172.21.15.84:0/2985748449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61601092f0 0x7f6160109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.599+0000 7f6166600640 1 --2- 172.21.15.84:0/2985748449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160103dc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.599+0000 7f6166600640 1 -- 172.21.15.84:0/2985748449 >> 172.21.15.84:0/2985748449 conn(0x7f61600ff440 msgr2=0x7f6160101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:31.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.599+0000 7f6166600640 1 -- 172.21.15.84:0/2985748449 shutdown_connections 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.599+0000 7f6166600640 1 -- 172.21.15.84:0/2985748449 wait complete. 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 Processor -- start 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 -- start start 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61601092f0 0x7f6160075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6160109c40 0x7f6160076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6160113900 con 0x7f6160109c40 2024-09-21T07:49:31.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6160113780 con 0x7f61601039b0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.600+0000 7f6166600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6160113a80 con 0x7f61601092f0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60822/0 (socket says 172.21.15.84:60822) 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 -- 172.21.15.84:0/2719431138 learned_addr learned my addr 172.21.15.84:0/2719431138 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f615fe00640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61601092f0 0x7f6160075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165c00640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6160109c40 0x7f6160076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 -- 172.21.15.84:0/2719431138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61601092f0 msgr2=0x7f6160075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61601092f0 0x7f6160075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 -- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6160109c40 msgr2=0x7f6160076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6160109c40 0x7f6160076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.601+0000 7f6165200640 1 -- 172.21.15.84:0/2719431138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61601a85b0 con 0x7f61601039b0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.602+0000 7f6165200640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6154005940 tx=0x7f61540040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.602+0000 7f615d600640 1 -- 172.21.15.84:0/2719431138 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615403f030 con 0x7f61601039b0 2024-09-21T07:49:31.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.602+0000 7f615d600640 1 -- 172.21.15.84:0/2719431138 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61540044c0 con 0x7f61601039b0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.602+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61601a8840 con 0x7f61601039b0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.602+0000 7f615d600640 1 -- 172.21.15.84:0/2719431138 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154035070 con 0x7f61601039b0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.602+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61601a8d20 con 0x7f61601039b0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.603+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6160103dc0 con 0x7f61601039b0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.606+0000 7f615d600640 1 -- 172.21.15.84:0/2719431138 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f6154042030 con 0x7f61601039b0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.607+0000 7f615d600640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61480b65f0 0x7f61480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.607+0000 7f615d600640 1 -- 172.21.15.84:0/2719431138 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6154107f50 con 0x7f61601039b0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.608+0000 7f615fe00640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61480b65f0 0x7f61480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.608+0000 7f615fe00640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61480b65f0 0x7f61480b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f614c0095f0 tx=0x7f614c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:31.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.609+0000 7f615d600640 1 -- 172.21.15.84:0/2719431138 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61540d25d0 con 0x7f61601039b0 2024-09-21T07:49:31.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.698+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f11541a91e0 con 0x7f11541039b0 2024-09-21T07:49:31.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.698+0000 7f1151600640 1 -- 172.21.15.84:0/2399750498 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f11480b7470 con 0x7f11541039b0 2024-09-21T07:49:31.701 INFO:teuthology.orchestra.run.smithi084.stdout:253403070511 2024-09-21T07:49:31.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f113c0b65f0 msgr2=0x7f113c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f113c0b65f0 0x7f113c0b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1154105a60 tx=0x7f1140009560 comp rx=0 tx=0).stop 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 msgr2=0x7f115419c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 0x7f115419c530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f114800e9f0 tx=0x7f114800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 shutdown_connections 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f113c0b65f0 0x7f113c0b8b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1154109c40 0x7f11541a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11541092f0 0x7f115419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 --2- 172.21.15.84:0/2399750498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11541039b0 0x7f115419c530 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 >> 172.21.15.84:0/2399750498 conn(0x7f11540ff440 msgr2=0x7f11541089b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 shutdown_connections 2024-09-21T07:49:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.702+0000 7f115a600640 1 -- 172.21.15.84:0/2399750498 wait complete. 2024-09-21T07:49:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.809+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f616002e640 con 0x7f61601039b0 2024-09-21T07:49:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.810+0000 7f615d600640 1 -- 172.21.15.84:0/2719431138 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f61540d7510 con 0x7f61601039b0 2024-09-21T07:49:31.812 INFO:teuthology.orchestra.run.smithi084.stdout:296352743460 2024-09-21T07:49:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61480b65f0 msgr2=0x7f61480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61480b65f0 0x7f61480b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f614c0095f0 tx=0x7f614c005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 msgr2=0x7f6160075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6154005940 tx=0x7f61540040c0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 shutdown_connections 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61480b65f0 0x7f61480b8b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6160109c40 0x7f6160076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61601092f0 0x7f6160075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 --2- 172.21.15.84:0/2719431138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61601039b0 0x7f6160075710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 >> 172.21.15.84:0/2719431138 conn(0x7f61600ff440 msgr2=0x7f6160101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.812+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 shutdown_connections 2024-09-21T07:49:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:31.813+0000 7f6166600640 1 -- 172.21.15.84:0/2719431138 wait complete. 2024-09-21T07:49:32.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 -- 172.21.15.84:0/2677685247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c105d90 msgr2=0x7f048c1061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:32.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 --2- 172.21.15.84:0/2677685247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c105d90 0x7f048c1061a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f047c009ca0 tx=0x7f047c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 -- 172.21.15.84:0/2677685247 shutdown_connections 2024-09-21T07:49:32.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 --2- 172.21.15.84:0/2677685247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f048c10c020 0x7f048c112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 --2- 172.21.15.84:0/2677685247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048c10b6d0 0x7f048c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 --2- 172.21.15.84:0/2677685247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c105d90 0x7f048c1061a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 -- 172.21.15.84:0/2677685247 >> 172.21.15.84:0/2677685247 conn(0x7f048c1017c0 msgr2=0x7f048c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 -- 172.21.15.84:0/2677685247 shutdown_connections 2024-09-21T07:49:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.352+0000 7f0490c00640 1 -- 172.21.15.84:0/2677685247 wait complete. 2024-09-21T07:49:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 Processor -- start 2024-09-21T07:49:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 -- start start 2024-09-21T07:49:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048c105d90 0x7f048c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f048c10b6d0 0x7f048c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c10c020 0x7f048c1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f048c115ce0 con 0x7f048c10c020 2024-09-21T07:49:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f048c115b60 con 0x7f048c105d90 2024-09-21T07:49:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.354+0000 7f0490c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f048c115e60 con 0x7f048c10b6d0 2024-09-21T07:49:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c10c020 0x7f048c1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c10c020 0x7f048c1a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51490/0 (socket says 172.21.15.84:51490) 2024-09-21T07:49:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 -- 172.21.15.84:0/3188290777 learned_addr learned my addr 172.21.15.84:0/3188290777 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 -- 172.21.15.84:0/3188290777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f048c10b6d0 msgr2=0x7f048c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f048c10b6d0 0x7f048c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 -- 172.21.15.84:0/3188290777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048c105d90 msgr2=0x7f048c19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048c105d90 0x7f048c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.355+0000 7f048a800640 1 -- 172.21.15.84:0/3188290777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c1a2640 con 0x7f048c10c020 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.356+0000 7f048a800640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c10c020 0x7f048c1a1f10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f048400e970 tx=0x7f048400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.356+0000 7f0483400640 1 -- 172.21.15.84:0/3188290777 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048400ccc0 con 0x7f048c10c020 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.356+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048c1a2930 con 0x7f048c10c020 2024-09-21T07:49:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.356+0000 7f0483400640 1 -- 172.21.15.84:0/3188290777 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f048400ce60 con 0x7f048c10c020 2024-09-21T07:49:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.356+0000 7f0483400640 1 -- 172.21.15.84:0/3188290777 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484010430 con 0x7f048c10c020 2024-09-21T07:49:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.356+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048c1a9090 con 0x7f048c10c020 2024-09-21T07:49:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.357+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048c1061a0 con 0x7f048c10c020 2024-09-21T07:49:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.360+0000 7f0483400640 1 -- 172.21.15.84:0/3188290777 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f0484004f70 con 0x7f048c10c020 2024-09-21T07:49:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.361+0000 7f0483400640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f04700b65f0 0x7f04700b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.361+0000 7f0483400640 1 -- 172.21.15.84:0/3188290777 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f04840e8050 con 0x7f048c10c020 2024-09-21T07:49:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.361+0000 7f0489e00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f04700b65f0 0x7f04700b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.362+0000 7f0489e00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f04700b65f0 0x7f04700b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f047c0094e0 tx=0x7f047c000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.363+0000 7f0483400640 1 -- 172.21.15.84:0/3188290777 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0484056710 con 0x7f048c10c020 2024-09-21T07:49:32.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:32 smithi084 ceph-mon[30411]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T07:49:32.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:32 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2399750498' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:49:32.418 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:32 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2719431138' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:49:32.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:32 smithi162 ceph-mon[34833]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T07:49:32.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:32 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2399750498' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:49:32.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:32 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2719431138' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:49:32.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.557+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f048c19d800 con 0x7f048c10c020 2024-09-21T07:49:32.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.558+0000 7f0483400640 1 -- 172.21.15.84:0/3188290777 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f04840ae330 con 0x7f048c10c020 2024-09-21T07:49:32.559 INFO:teuthology.orchestra.run.smithi084.stdout:201863462970 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f04700b65f0 msgr2=0x7f04700b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f04700b65f0 0x7f04700b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f047c0094e0 tx=0x7f047c000f40 comp rx=0 tx=0).stop 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c10c020 msgr2=0x7f048c1a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c10c020 0x7f048c1a1f10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f048400e970 tx=0x7f048400ed70 comp rx=0 tx=0).stop 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 shutdown_connections 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f04700b65f0 0x7f04700b8b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f048c10c020 0x7f048c1a1f10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f048c10b6d0 0x7f048c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 --2- 172.21.15.84:0/3188290777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048c105d90 0x7f048c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:32.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 >> 172.21.15.84:0/3188290777 conn(0x7f048c1017c0 msgr2=0x7f048c10ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:32.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 shutdown_connections 2024-09-21T07:49:32.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:32.560+0000 7f0490c00640 1 -- 172.21.15.84:0/3188290777 wait complete. 2024-09-21T07:49:32.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:32 smithi191 ceph-mon[34667]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T07:49:32.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:32 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2399750498' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:49:32.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:32 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2719431138' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:49:32.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743456 got 296352743460 for osd.11 2024-09-21T07:49:32.819 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:33.343 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:33 smithi084 ceph-mon[30411]: pgmap v347: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-21T07:49:33.343 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:33 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3188290777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:49:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 -- 172.21.15.84:0/1969421004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 msgr2=0x7f6288109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 --2- 172.21.15.84:0/1969421004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f6288109700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6274009900 tx=0x7f627402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 -- 172.21.15.84:0/1969421004 shutdown_connections 2024-09-21T07:49:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 --2- 172.21.15.84:0/1969421004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6288109c40 0x7f6288110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 --2- 172.21.15.84:0/1969421004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f6288109700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 --2- 172.21.15.84:0/1969421004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62881039b0 0x7f6288103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 -- 172.21.15.84:0/1969421004 >> 172.21.15.84:0/1969421004 conn(0x7f62880ff440 msgr2=0x7f6288101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 -- 172.21.15.84:0/1969421004 shutdown_connections 2024-09-21T07:49:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.417+0000 7f628ce00640 1 -- 172.21.15.84:0/1969421004 wait complete. 2024-09-21T07:49:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.418+0000 7f628ce00640 1 Processor -- start 2024-09-21T07:49:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f628ce00640 1 -- start start 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f628ce00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62881039b0 0x7f628819c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f628ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f628819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f628ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6288109c40 0x7f62881a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f628ce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6288076000 con 0x7f62881092f0 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f628ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6288075e80 con 0x7f6288109c40 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f628ce00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6288076180 con 0x7f62881039b0 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f6286a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f628819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f6286a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f628819ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51512/0 (socket says 172.21.15.84:51512) 2024-09-21T07:49:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f6287400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62881039b0 0x7f628819c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f6286a00640 1 -- 172.21.15.84:0/1522635927 learned_addr learned my addr 172.21.15.84:0/1522635927 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.419+0000 7f6287e00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6288109c40 0x7f62881a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6287e00640 1 -- 172.21.15.84:0/1522635927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62881039b0 msgr2=0x7f628819c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6287e00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62881039b0 0x7f628819c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6287e00640 1 -- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 msgr2=0x7f628819ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6287e00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f628819ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6287e00640 1 -- 172.21.15.84:0/1522635927 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62881a2460 con 0x7f6288109c40 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6287400640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62881039b0 0x7f628819c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6286a00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f628819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f6287e00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6288109c40 0x7f62881a1d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6280009fd0 tx=0x7f628000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.420+0000 7f627fe00640 1 -- 172.21.15.84:0/1522635927 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628000ce20 con 0x7f6288109c40 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.421+0000 7f627fe00640 1 -- 172.21.15.84:0/1522635927 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6280005020 con 0x7f6288109c40 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.421+0000 7f627fe00640 1 -- 172.21.15.84:0/1522635927 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280010690 con 0x7f6288109c40 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.421+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62881a2750 con 0x7f6288109c40 2024-09-21T07:49:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.421+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881a8eb0 con 0x7f6288109c40 2024-09-21T07:49:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.422+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6288103dc0 con 0x7f6288109c40 2024-09-21T07:49:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.424+0000 7f627fe00640 1 -- 172.21.15.84:0/1522635927 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f62800054d0 con 0x7f6288109c40 2024-09-21T07:49:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.426+0000 7f627fe00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f626c0b6670 0x7f626c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.426+0000 7f627fe00640 1 -- 172.21.15.84:0/1522635927 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f62800e7fd0 con 0x7f6288109c40 2024-09-21T07:49:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.426+0000 7f6287400640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f626c0b6670 0x7f626c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.427+0000 7f6287400640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f626c0b6670 0x7f626c0b8b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6278009fc0 tx=0x7f6278005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.428+0000 7f627fe00640 1 -- 172.21.15.84:0/1522635927 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62800ae270 con 0x7f6288109c40 2024-09-21T07:49:33.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:33 smithi162 ceph-mon[34833]: pgmap v347: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-21T07:49:33.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:33 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3188290777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:49:33.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.621+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f628819d620 con 0x7f6288109c40 2024-09-21T07:49:33.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.621+0000 7f627fe00640 1 -- 172.21.15.84:0/1522635927 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f628819d620 con 0x7f6288109c40 2024-09-21T07:49:33.623 INFO:teuthology.orchestra.run.smithi084.stdout:107374182480 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f626c0b6670 msgr2=0x7f626c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f626c0b6670 0x7f626c0b8b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6278009fc0 tx=0x7f6278005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6288109c40 msgr2=0x7f62881a1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6288109c40 0x7f62881a1d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6280009fd0 tx=0x7f628000ef10 comp rx=0 tx=0).stop 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 shutdown_connections 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f626c0b6670 0x7f626c0b8b80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6288109c40 0x7f62881a1d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62881092f0 0x7f628819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 --2- 172.21.15.84:0/1522635927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62881039b0 0x7f628819c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:33.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 >> 172.21.15.84:0/1522635927 conn(0x7f62880ff440 msgr2=0x7f6288105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:33.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 shutdown_connections 2024-09-21T07:49:33.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:33.624+0000 7f628ce00640 1 -- 172.21.15.84:0/1522635927 wait complete. 2024-09-21T07:49:33.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:33 smithi191 ceph-mon[34667]: pgmap v347: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-21T07:49:33.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:33 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3188290777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:49:33.943 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462967 got 201863462970 for osd.7 2024-09-21T07:49:33.943 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:34.404 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070507 got 253403070511 for osd.9 2024-09-21T07:49:34.405 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:34.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:34 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1522635927' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:49:34.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:34 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1522635927' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:49:34.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:34 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1522635927' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:49:35.052 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182478 got 107374182480 for osd.3 2024-09-21T07:49:35.053 DEBUG:teuthology.parallel:result is None 2024-09-21T07:49:35.053 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:49:35.053 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:49:35.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:35 smithi084 ceph-mon[30411]: pgmap v348: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-21T07:49:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:35.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:35 smithi162 ceph-mon[34833]: pgmap v348: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-21T07:49:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:35 smithi191 ceph-mon[34667]: pgmap v348: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 -- 172.21.15.84:0/1708324099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541092f0 msgr2=0x7fb354109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 --2- 172.21.15.84:0/1708324099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541092f0 0x7fb354109700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb340009900 tx=0x7fb34002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 -- 172.21.15.84:0/1708324099 shutdown_connections 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 --2- 172.21.15.84:0/1708324099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb354109c40 0x7fb354110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 --2- 172.21.15.84:0/1708324099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541092f0 0x7fb354109700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 --2- 172.21.15.84:0/1708324099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 0x7fb354103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 -- 172.21.15.84:0/1708324099 >> 172.21.15.84:0/1708324099 conn(0x7fb3540ff440 msgr2=0x7fb354101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 -- 172.21.15.84:0/1708324099 shutdown_connections 2024-09-21T07:49:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.074+0000 7fb35a000640 1 -- 172.21.15.84:0/1708324099 wait complete. 2024-09-21T07:49:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 Processor -- start 2024-09-21T07:49:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 -- start start 2024-09-21T07:49:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 0x7fb35419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3541092f0 0x7fb35419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354109c40 0x7fb35419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb354113950 con 0x7fb354109c40 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3541137d0 con 0x7fb3541039b0 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.076+0000 7fb35a000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb354113ad0 con 0x7fb3541092f0 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 0x7fb35419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 0x7fb35419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60882/0 (socket says 172.21.15.84:60882) 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 -- 172.21.15.84:0/4185869946 learned_addr learned my addr 172.21.15.84:0/4185869946 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb353e00640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3541092f0 0x7fb35419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb359600640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354109c40 0x7fb35419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 -- 172.21.15.84:0/4185869946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3541092f0 msgr2=0x7fb35419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3541092f0 0x7fb35419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 -- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354109c40 msgr2=0x7fb35419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354109c40 0x7fb35419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.077+0000 7fb358c00640 1 -- 172.21.15.84:0/4185869946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3541a02b0 con 0x7fb3541039b0 2024-09-21T07:49:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.078+0000 7fb358c00640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 0x7fb35419a340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb34800e9f0 tx=0x7fb34800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.078+0000 7fb351600640 1 -- 172.21.15.84:0/4185869946 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34800cd80 con 0x7fb3541039b0 2024-09-21T07:49:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.078+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3541a05a0 con 0x7fb3541039b0 2024-09-21T07:49:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.078+0000 7fb351600640 1 -- 172.21.15.84:0/4185869946 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3480108e0 con 0x7fb3541039b0 2024-09-21T07:49:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.078+0000 7fb351600640 1 -- 172.21.15.84:0/4185869946 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348018980 con 0x7fb3541039b0 2024-09-21T07:49:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.078+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3541a6d00 con 0x7fb3541039b0 2024-09-21T07:49:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.079+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb354103dc0 con 0x7fb3541039b0 2024-09-21T07:49:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.082+0000 7fb351600640 1 -- 172.21.15.84:0/4185869946 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb348010430 con 0x7fb3541039b0 2024-09-21T07:49:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.084+0000 7fb351600640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb33c0b65f0 0x7fb33c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.084+0000 7fb351600640 1 -- 172.21.15.84:0/4185869946 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb3480e8140 con 0x7fb3541039b0 2024-09-21T07:49:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.084+0000 7fb353e00640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb33c0b65f0 0x7fb33c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:36.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.085+0000 7fb353e00640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb33c0b65f0 0x7fb33c0b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb34002a9e0 tx=0x7fb340005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:36.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.086+0000 7fb351600640 1 -- 172.21.15.84:0/4185869946 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3480b27c0 con 0x7fb3541039b0 2024-09-21T07:49:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.272+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb354063800 con 0x7fb33c0b65f0 2024-09-21T07:49:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.278+0000 7fb351600640 1 -- 172.21.15.84:0/4185869946 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340433 (secure 0 0 0) 0x7fb354063800 con 0x7fb33c0b65f0 2024-09-21T07:49:36.286 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:36.288 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:49:36.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.284+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb33c0b65f0 msgr2=0x7fb33c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.284+0000 7fb35a000640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb33c0b65f0 0x7fb33c0b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb34002a9e0 tx=0x7fb340005a20 comp rx=0 tx=0).stop 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.284+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 msgr2=0x7fb35419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.284+0000 7fb35a000640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 0x7fb35419a340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb34800e9f0 tx=0x7fb34800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.284+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 shutdown_connections 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.284+0000 7fb35a000640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb33c0b65f0 0x7fb33c0b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.285+0000 7fb35a000640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354109c40 0x7fb35419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.285+0000 7fb35a000640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3541092f0 0x7fb35419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.285+0000 7fb35a000640 1 --2- 172.21.15.84:0/4185869946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3541039b0 0x7fb35419a340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.285+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 >> 172.21.15.84:0/4185869946 conn(0x7fb3540ff440 msgr2=0x7fb354101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.285+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 shutdown_connections 2024-09-21T07:49:36.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:36.285+0000 7fb35a000640 1 -- 172.21.15.84:0/4185869946 wait complete. 2024-09-21T07:49:36.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:36 smithi162 ceph-mon[34833]: pgmap v349: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:49:36.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:36 smithi084 ceph-mon[30411]: pgmap v349: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:49:36.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:36 smithi191 ceph-mon[34667]: pgmap v349: 129 pgs: 1 activating, 128 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T07:49:37.002 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-21T07:49:36.001921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664603,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":712,"num_read_kb":468,"num_write":374,"num_write_kb":2298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388456,"kb_used_data":14172,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553368,"statfs":{"total":1151940427776,"available":1151542648832,"internally_reserved":0,"allocated":14512128,"data_stored":8252155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002460"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":116,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.240591+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:49:31.240591+0000","last_peered":"2024-09-21T07:49:31.240591+0000","last_clean":"2024-09-21T07:49:31.240591+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:49:31.240591+0000","last_undegraded":"2024-09-21T07:49:31.240591+0000","last_fullsized":"2024-09-21T07:49:31.240591+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278967+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:49:31.278967+0000","last_peered":"2024-09-21T07:49:31.278967+0000","last_clean":"2024-09-21T07:49:31.278967+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:49:31.278967+0000","last_undegraded":"2024-09-21T07:49:31.278967+0000","last_fullsized":"2024-09-21T07:49:31.278967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247545+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247545+0000","last_peered":"2024-09-21T07:49:31.247545+0000","last_clean":"2024-09-21T07:49:31.247545+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247545+0000","last_undegraded":"2024-09-21T07:49:31.247545+0000","last_fullsized":"2024-09-21T07:49:31.247545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279132+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279132+0000","last_peered":"2024-09-21T07:49:31.279132+0000","last_clean":"2024-09-21T07:49:31.279132+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279132+0000","last_undegraded":"2024-09-21T07:49:31.279132+0000","last_fullsized":"2024-09-21T07:49:31.279132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278815+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:49:31.278815+0000","last_peered":"2024-09-21T07:49:31.278815+0000","last_clean":"2024-09-21T07:49:31.278815+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:49:31.278815+0000","last_undegraded":"2024-09-21T07:49:31.278815+0000","last_fullsized":"2024-09-21T07:49:31.278815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279835+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.279835+0000","last_peered":"2024-09-21T07:49:31.279835+0000","last_clean":"2024-09-21T07:49:31.279835+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.279835+0000","last_undegraded":"2024-09-21T07:49:31.279835+0000","last_fullsized":"2024-09-21T07:49:31.279835+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162561+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162561+0000","last_peered":"2024-09-21T07:49:31.162561+0000","last_clean":"2024-09-21T07:49:31.162561+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162561+0000","last_undegraded":"2024-09-21T07:49:31.162561+0000","last_fullsized":"2024-09-21T07:49:31.162561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161466+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:49:31.161466+0000","last_peered":"2024-09-21T07:49:31.161466+0000","last_clean":"2024-09-21T07:49:31.161466+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:49:31.161466+0000","last_undegraded":"2024-09-21T07:49:31.161466+0000","last_fullsized":"2024-09-21T07:49:31.161466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162884+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162884+0000","last_peered":"2024-09-21T07:49:31.162884+0000","last_clean":"2024-09-21T07:49:31.162884+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162884+0000","last_undegraded":"2024-09-21T07:49:31.162884+0000","last_fullsized":"2024-09-21T07:49:31.162884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248407+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:49:31.248407+0000","last_peered":"2024-09-21T07:49:31.248407+0000","last_clean":"2024-09-21T07:49:31.248407+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:49:31.248407+0000","last_undegraded":"2024-09-21T07:49:31.248407+0000","last_fullsized":"2024-09-21T07:49:31.248407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162156+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162156+0000","last_peered":"2024-09-21T07:49:31.162156+0000","last_clean":"2024-09-21T07:49:31.162156+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162156+0000","last_undegraded":"2024-09-21T07:49:31.162156+0000","last_fullsized":"2024-09-21T07:49:31.162156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243738+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:49:31.243738+0000","last_peered":"2024-09-21T07:49:31.243738+0000","last_clean":"2024-09-21T07:49:31.243738+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:49:31.243738+0000","last_undegraded":"2024-09-21T07:49:31.243738+0000","last_fullsized":"2024-09-21T07:49:31.243738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162206+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162206+0000","last_peered":"2024-09-21T07:49:31.162206+0000","last_clean":"2024-09-21T07:49:31.162206+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162206+0000","last_undegraded":"2024-09-21T07:49:31.162206+0000","last_fullsized":"2024-09-21T07:49:31.162206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162959+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.162959+0000","last_peered":"2024-09-21T07:49:31.162959+0000","last_clean":"2024-09-21T07:49:31.162959+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.162959+0000","last_undegraded":"2024-09-21T07:49:31.162959+0000","last_fullsized":"2024-09-21T07:49:31.162959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277969+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:49:31.277969+0000","last_peered":"2024-09-21T07:49:31.277969+0000","last_clean":"2024-09-21T07:49:31.277969+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:49:31.277969+0000","last_undegraded":"2024-09-21T07:49:31.277969+0000","last_fullsized":"2024-09-21T07:49:31.277969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247765+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247765+0000","last_peered":"2024-09-21T07:49:31.247765+0000","last_clean":"2024-09-21T07:49:31.247765+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247765+0000","last_undegraded":"2024-09-21T07:49:31.247765+0000","last_fullsized":"2024-09-21T07:49:31.247765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162981+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.162981+0000","last_peered":"2024-09-21T07:49:31.162981+0000","last_clean":"2024-09-21T07:49:31.162981+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.162981+0000","last_undegraded":"2024-09-21T07:49:31.162981+0000","last_fullsized":"2024-09-21T07:49:31.162981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158317+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:49:31.158317+0000","last_peered":"2024-09-21T07:49:31.158317+0000","last_clean":"2024-09-21T07:49:31.158317+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:49:31.158317+0000","last_undegraded":"2024-09-21T07:49:31.158317+0000","last_fullsized":"2024-09-21T07:49:31.158317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278388+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278388+0000","last_peered":"2024-09-21T07:49:31.278388+0000","last_clean":"2024-09-21T07:49:31.278388+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278388+0000","last_undegraded":"2024-09-21T07:49:31.278388+0000","last_fullsized":"2024-09-21T07:49:31.278388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160509+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160509+0000","last_peered":"2024-09-21T07:49:31.160509+0000","last_clean":"2024-09-21T07:49:31.160509+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160509+0000","last_undegraded":"2024-09-21T07:49:31.160509+0000","last_fullsized":"2024-09-21T07:49:31.160509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162013+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:49:31.162013+0000","last_peered":"2024-09-21T07:49:31.162013+0000","last_clean":"2024-09-21T07:49:31.162013+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:49:31.162013+0000","last_undegraded":"2024-09-21T07:49:31.162013+0000","last_fullsized":"2024-09-21T07:49:31.162013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160963+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.160963+0000","last_peered":"2024-09-21T07:49:31.160963+0000","last_clean":"2024-09-21T07:49:31.160963+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.160963+0000","last_undegraded":"2024-09-21T07:49:31.160963+0000","last_fullsized":"2024-09-21T07:49:31.160963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163092+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163092+0000","last_peered":"2024-09-21T07:49:31.163092+0000","last_clean":"2024-09-21T07:49:31.163092+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163092+0000","last_undegraded":"2024-09-21T07:49:31.163092+0000","last_fullsized":"2024-09-21T07:49:31.163092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279092+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:49:31.279092+0000","last_peered":"2024-09-21T07:49:31.279092+0000","last_clean":"2024-09-21T07:49:31.279092+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:49:31.279092+0000","last_undegraded":"2024-09-21T07:49:31.279092+0000","last_fullsized":"2024-09-21T07:49:31.279092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163338+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163338+0000","last_peered":"2024-09-21T07:49:31.163338+0000","last_clean":"2024-09-21T07:49:31.163338+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163338+0000","last_undegraded":"2024-09-21T07:49:31.163338+0000","last_fullsized":"2024-09-21T07:49:31.163338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247544+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247544+0000","last_peered":"2024-09-21T07:49:31.247544+0000","last_clean":"2024-09-21T07:49:31.247544+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247544+0000","last_undegraded":"2024-09-21T07:49:31.247544+0000","last_fullsized":"2024-09-21T07:49:31.247544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279299+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:49:31.279299+0000","last_peered":"2024-09-21T07:49:31.279299+0000","last_clean":"2024-09-21T07:49:31.279299+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:49:31.279299+0000","last_undegraded":"2024-09-21T07:49:31.279299+0000","last_fullsized":"2024-09-21T07:49:31.279299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'16","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160465+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:49:31.160465+0000","last_peered":"2024-09-21T07:49:31.160465+0000","last_clean":"2024-09-21T07:49:31.160465+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:49:31.160465+0000","last_undegraded":"2024-09-21T07:49:31.160465+0000","last_fullsized":"2024-09-21T07:49:31.160465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278072+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278072+0000","last_peered":"2024-09-21T07:49:31.278072+0000","last_clean":"2024-09-21T07:49:31.278072+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278072+0000","last_undegraded":"2024-09-21T07:49:31.278072+0000","last_fullsized":"2024-09-21T07:49:31.278072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246342+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:49:31.246342+0000","last_peered":"2024-09-21T07:49:31.246342+0000","last_clean":"2024-09-21T07:49:31.246342+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:49:31.246342+0000","last_undegraded":"2024-09-21T07:49:31.246342+0000","last_fullsized":"2024-09-21T07:49:31.246342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162908+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162908+0000","last_peered":"2024-09-21T07:49:31.162908+0000","last_clean":"2024-09-21T07:49:31.162908+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162908+0000","last_undegraded":"2024-09-21T07:49:31.162908+0000","last_fullsized":"2024-09-21T07:49:31.162908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158382+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158382+0000","last_peered":"2024-09-21T07:49:31.158382+0000","last_clean":"2024-09-21T07:49:31.158382+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158382+0000","last_undegraded":"2024-09-21T07:49:31.158382+0000","last_fullsized":"2024-09-21T07:49:31.158382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243152+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:49:31.243152+0000","last_peered":"2024-09-21T07:49:31.243152+0000","last_clean":"2024-09-21T07:49:31.243152+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:49:31.243152+0000","last_undegraded":"2024-09-21T07:49:31.243152+0000","last_fullsized":"2024-09-21T07:49:31.243152+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160425+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160425+0000","last_peered":"2024-09-21T07:49:31.160425+0000","last_clean":"2024-09-21T07:49:31.160425+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160425+0000","last_undegraded":"2024-09-21T07:49:31.160425+0000","last_fullsized":"2024-09-21T07:49:31.160425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162037+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162037+0000","last_peered":"2024-09-21T07:49:31.162037+0000","last_clean":"2024-09-21T07:49:31.162037+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162037+0000","last_undegraded":"2024-09-21T07:49:31.162037+0000","last_fullsized":"2024-09-21T07:49:31.162037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243250+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:49:31.243250+0000","last_peered":"2024-09-21T07:49:31.243250+0000","last_clean":"2024-09-21T07:49:31.243250+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:49:31.243250+0000","last_undegraded":"2024-09-21T07:49:31.243250+0000","last_fullsized":"2024-09-21T07:49:31.243250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:33.247305+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:49:33.247305+0000","last_peered":"2024-09-21T07:49:33.247305+0000","last_clean":"2024-09-21T07:49:33.247305+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:49:33.247305+0000","last_undegraded":"2024-09-21T07:49:33.247305+0000","last_fullsized":"2024-09-21T07:49:33.247305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245947+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.245947+0000","last_peered":"2024-09-21T07:49:31.245947+0000","last_clean":"2024-09-21T07:49:31.245947+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.245947+0000","last_undegraded":"2024-09-21T07:49:31.245947+0000","last_fullsized":"2024-09-21T07:49:31.245947+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247241+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:49:31.247241+0000","last_peered":"2024-09-21T07:49:31.247241+0000","last_clean":"2024-09-21T07:49:31.247241+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:49:31.247241+0000","last_undegraded":"2024-09-21T07:49:31.247241+0000","last_fullsized":"2024-09-21T07:49:31.247241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:33.249686+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:49:33.249686+0000","last_peered":"2024-09-21T07:49:33.249686+0000","last_clean":"2024-09-21T07:49:33.249686+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:49:33.249686+0000","last_undegraded":"2024-09-21T07:49:33.249686+0000","last_fullsized":"2024-09-21T07:49:33.249686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246295+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246295+0000","last_peered":"2024-09-21T07:49:31.246295+0000","last_clean":"2024-09-21T07:49:31.246295+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246295+0000","last_undegraded":"2024-09-21T07:49:31.246295+0000","last_fullsized":"2024-09-21T07:49:31.246295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245724+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:49:31.245724+0000","last_peered":"2024-09-21T07:49:31.245724+0000","last_clean":"2024-09-21T07:49:31.245724+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:49:31.245724+0000","last_undegraded":"2024-09-21T07:49:31.245724+0000","last_fullsized":"2024-09-21T07:49:31.245724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243226+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243226+0000","last_peered":"2024-09-21T07:49:31.243226+0000","last_clean":"2024-09-21T07:49:31.243226+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243226+0000","last_undegraded":"2024-09-21T07:49:31.243226+0000","last_fullsized":"2024-09-21T07:49:31.243226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":5,"reported_epoch":88,"state":"activating","last_fresh":"2024-09-21T07:49:31.163220+0000","last_change":"2024-09-21T07:49:31.162354+0000","last_active":"2024-09-21T07:49:31.161954+0000","last_peered":"2024-09-21T07:48:31.088740+0000","last_clean":"2024-09-21T07:48:31.088740+0000","last_became_active":"2024-09-21T07:47:50.065284+0000","last_became_peered":"2024-09-21T07:47:50.065284+0000","last_unstale":"2024-09-21T07:49:31.163220+0000","last_undegraded":"2024-09-21T07:49:31.163220+0000","last_fullsized":"2024-09-21T07:49:31.163220+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":["8(0)","5(0)","6(2)","9(1)","10(3)"],"object_location_counts":[],"blocked_by":[2,3],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278198+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:49:31.278198+0000","last_peered":"2024-09-21T07:49:31.278198+0000","last_clean":"2024-09-21T07:49:31.278198+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:49:31.278198+0000","last_undegraded":"2024-09-21T07:49:31.278198+0000","last_fullsized":"2024-09-21T07:49:31.278198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162969+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.162969+0000","last_peered":"2024-09-21T07:49:31.162969+0000","last_clean":"2024-09-21T07:49:31.162969+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.162969+0000","last_undegraded":"2024-09-21T07:49:31.162969+0000","last_fullsized":"2024-09-21T07:49:31.162969+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243521+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243521+0000","last_peered":"2024-09-21T07:49:31.243521+0000","last_clean":"2024-09-21T07:49:31.243521+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243521+0000","last_undegraded":"2024-09-21T07:49:31.243521+0000","last_fullsized":"2024-09-21T07:49:31.243521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243899+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:49:31.243899+0000","last_peered":"2024-09-21T07:49:31.243899+0000","last_clean":"2024-09-21T07:49:31.243899+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:49:31.243899+0000","last_undegraded":"2024-09-21T07:49:31.243899+0000","last_fullsized":"2024-09-21T07:49:31.243899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248547+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:49:31.248547+0000","last_peered":"2024-09-21T07:49:31.248547+0000","last_clean":"2024-09-21T07:49:31.248547+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:49:31.248547+0000","last_undegraded":"2024-09-21T07:49:31.248547+0000","last_fullsized":"2024-09-21T07:49:31.248547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161156+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161156+0000","last_peered":"2024-09-21T07:49:31.161156+0000","last_clean":"2024-09-21T07:49:31.161156+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161156+0000","last_undegraded":"2024-09-21T07:49:31.161156+0000","last_fullsized":"2024-09-21T07:49:31.161156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244420+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:49:31.244420+0000","last_peered":"2024-09-21T07:49:31.244420+0000","last_clean":"2024-09-21T07:49:31.244420+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:49:31.244420+0000","last_undegraded":"2024-09-21T07:49:31.244420+0000","last_fullsized":"2024-09-21T07:49:31.244420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248753+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:49:31.248753+0000","last_peered":"2024-09-21T07:49:31.248753+0000","last_clean":"2024-09-21T07:49:31.248753+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:49:31.248753+0000","last_undegraded":"2024-09-21T07:49:31.248753+0000","last_fullsized":"2024-09-21T07:49:31.248753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278701+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278701+0000","last_peered":"2024-09-21T07:49:31.278701+0000","last_clean":"2024-09-21T07:49:31.278701+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278701+0000","last_undegraded":"2024-09-21T07:49:31.278701+0000","last_fullsized":"2024-09-21T07:49:31.278701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244209+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:49:31.244209+0000","last_peered":"2024-09-21T07:49:31.244209+0000","last_clean":"2024-09-21T07:49:31.244209+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:49:31.244209+0000","last_undegraded":"2024-09-21T07:49:31.244209+0000","last_fullsized":"2024-09-21T07:49:31.244209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246268+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246268+0000","last_peered":"2024-09-21T07:49:31.246268+0000","last_clean":"2024-09-21T07:49:31.246268+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246268+0000","last_undegraded":"2024-09-21T07:49:31.246268+0000","last_fullsized":"2024-09-21T07:49:31.246268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246828+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246828+0000","last_peered":"2024-09-21T07:49:31.246828+0000","last_clean":"2024-09-21T07:49:31.246828+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246828+0000","last_undegraded":"2024-09-21T07:49:31.246828+0000","last_fullsized":"2024-09-21T07:49:31.246828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158808+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:49:31.158808+0000","last_peered":"2024-09-21T07:49:31.158808+0000","last_clean":"2024-09-21T07:49:31.158808+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:49:31.158808+0000","last_undegraded":"2024-09-21T07:49:31.158808+0000","last_fullsized":"2024-09-21T07:49:31.158808+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162780+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162780+0000","last_peered":"2024-09-21T07:49:31.162780+0000","last_clean":"2024-09-21T07:49:31.162780+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162780+0000","last_undegraded":"2024-09-21T07:49:31.162780+0000","last_fullsized":"2024-09-21T07:49:31.162780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246860+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246860+0000","last_peered":"2024-09-21T07:49:31.246860+0000","last_clean":"2024-09-21T07:49:31.246860+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246860+0000","last_undegraded":"2024-09-21T07:49:31.246860+0000","last_fullsized":"2024-09-21T07:49:31.246860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246999+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:49:31.246999+0000","last_peered":"2024-09-21T07:49:31.246999+0000","last_clean":"2024-09-21T07:49:31.246999+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:49:31.246999+0000","last_undegraded":"2024-09-21T07:49:31.246999+0000","last_fullsized":"2024-09-21T07:49:31.246999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161987+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.161987+0000","last_peered":"2024-09-21T07:49:31.161987+0000","last_clean":"2024-09-21T07:49:31.161987+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.161987+0000","last_undegraded":"2024-09-21T07:49:31.161987+0000","last_fullsized":"2024-09-21T07:49:31.161987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246136+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246136+0000","last_peered":"2024-09-21T07:49:31.246136+0000","last_clean":"2024-09-21T07:49:31.246136+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246136+0000","last_undegraded":"2024-09-21T07:49:31.246136+0000","last_fullsized":"2024-09-21T07:49:31.246136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243089+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:49:31.243089+0000","last_peered":"2024-09-21T07:49:31.243089+0000","last_clean":"2024-09-21T07:49:31.243089+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:49:31.243089+0000","last_undegraded":"2024-09-21T07:49:31.243089+0000","last_fullsized":"2024-09-21T07:49:31.243089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:32.248550+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:49:32.248550+0000","last_peered":"2024-09-21T07:49:32.248550+0000","last_clean":"2024-09-21T07:49:32.248550+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:49:32.248550+0000","last_undegraded":"2024-09-21T07:49:32.248550+0000","last_fullsized":"2024-09-21T07:49:32.248550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244085+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:49:31.244085+0000","last_peered":"2024-09-21T07:49:31.244085+0000","last_clean":"2024-09-21T07:49:31.244085+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:49:31.244085+0000","last_undegraded":"2024-09-21T07:49:31.244085+0000","last_fullsized":"2024-09-21T07:49:31.244085+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247648+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247648+0000","last_peered":"2024-09-21T07:49:31.247648+0000","last_clean":"2024-09-21T07:49:31.247648+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247648+0000","last_undegraded":"2024-09-21T07:49:31.247648+0000","last_fullsized":"2024-09-21T07:49:31.247648+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158382+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158382+0000","last_peered":"2024-09-21T07:49:31.158382+0000","last_clean":"2024-09-21T07:49:31.158382+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158382+0000","last_undegraded":"2024-09-21T07:49:31.158382+0000","last_fullsized":"2024-09-21T07:49:31.158382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245950+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:49:31.245950+0000","last_peered":"2024-09-21T07:49:31.245950+0000","last_clean":"2024-09-21T07:49:31.245950+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:49:31.245950+0000","last_undegraded":"2024-09-21T07:49:31.245950+0000","last_fullsized":"2024-09-21T07:49:31.245950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158337+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158337+0000","last_peered":"2024-09-21T07:49:31.158337+0000","last_clean":"2024-09-21T07:49:31.158337+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158337+0000","last_undegraded":"2024-09-21T07:49:31.158337+0000","last_fullsized":"2024-09-21T07:49:31.158337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248278+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248278+0000","last_peered":"2024-09-21T07:49:31.248278+0000","last_clean":"2024-09-21T07:49:31.248278+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248278+0000","last_undegraded":"2024-09-21T07:49:31.248278+0000","last_fullsized":"2024-09-21T07:49:31.248278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162418+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:49:31.162418+0000","last_peered":"2024-09-21T07:49:31.162418+0000","last_clean":"2024-09-21T07:49:31.162418+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:49:31.162418+0000","last_undegraded":"2024-09-21T07:49:31.162418+0000","last_fullsized":"2024-09-21T07:49:31.162418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'34","reported_seq":206,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:34.252265+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:49:34.252265+0000","last_peered":"2024-09-21T07:49:34.252265+0000","last_clean":"2024-09-21T07:49:34.252265+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:49:34.252265+0000","last_undegraded":"2024-09-21T07:49:34.252265+0000","last_fullsized":"2024-09-21T07:49:34.252265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66797,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":129,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159862+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159862+0000","last_peered":"2024-09-21T07:49:31.159862+0000","last_clean":"2024-09-21T07:49:31.159862+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159862+0000","last_undegraded":"2024-09-21T07:49:31.159862+0000","last_fullsized":"2024-09-21T07:49:31.159862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161545+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:49:31.161545+0000","last_peered":"2024-09-21T07:49:31.161545+0000","last_clean":"2024-09-21T07:49:31.161545+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:49:31.161545+0000","last_undegraded":"2024-09-21T07:49:31.161545+0000","last_fullsized":"2024-09-21T07:49:31.161545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248619+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248619+0000","last_peered":"2024-09-21T07:49:31.248619+0000","last_clean":"2024-09-21T07:49:31.248619+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248619+0000","last_undegraded":"2024-09-21T07:49:31.248619+0000","last_fullsized":"2024-09-21T07:49:31.248619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162156+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162156+0000","last_peered":"2024-09-21T07:49:31.162156+0000","last_clean":"2024-09-21T07:49:31.162156+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162156+0000","last_undegraded":"2024-09-21T07:49:31.162156+0000","last_fullsized":"2024-09-21T07:49:31.162156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278924+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:49:31.278924+0000","last_peered":"2024-09-21T07:49:31.278924+0000","last_clean":"2024-09-21T07:49:31.278924+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:49:31.278924+0000","last_undegraded":"2024-09-21T07:49:31.278924+0000","last_fullsized":"2024-09-21T07:49:31.278924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244576+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244576+0000","last_peered":"2024-09-21T07:49:31.244576+0000","last_clean":"2024-09-21T07:49:31.244576+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244576+0000","last_undegraded":"2024-09-21T07:49:31.244576+0000","last_fullsized":"2024-09-21T07:49:31.244576+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159716+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159716+0000","last_peered":"2024-09-21T07:49:31.159716+0000","last_clean":"2024-09-21T07:49:31.159716+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159716+0000","last_undegraded":"2024-09-21T07:49:31.159716+0000","last_fullsized":"2024-09-21T07:49:31.159716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162046+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:49:31.162046+0000","last_peered":"2024-09-21T07:49:31.162046+0000","last_clean":"2024-09-21T07:49:31.162046+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:49:31.162046+0000","last_undegraded":"2024-09-21T07:49:31.162046+0000","last_fullsized":"2024-09-21T07:49:31.162046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":169,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:34.252425+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:49:34.252425+0000","last_peered":"2024-09-21T07:49:34.252425+0000","last_clean":"2024-09-21T07:49:34.252425+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:49:34.252425+0000","last_undegraded":"2024-09-21T07:49:34.252425+0000","last_fullsized":"2024-09-21T07:49:34.252425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277833+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277833+0000","last_peered":"2024-09-21T07:49:31.277833+0000","last_clean":"2024-09-21T07:49:31.277833+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277833+0000","last_undegraded":"2024-09-21T07:49:31.277833+0000","last_fullsized":"2024-09-21T07:49:31.277833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278931+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278931+0000","last_peered":"2024-09-21T07:49:31.278931+0000","last_clean":"2024-09-21T07:49:31.278931+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278931+0000","last_undegraded":"2024-09-21T07:49:31.278931+0000","last_fullsized":"2024-09-21T07:49:31.278931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159880+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:49:31.159880+0000","last_peered":"2024-09-21T07:49:31.159880+0000","last_clean":"2024-09-21T07:49:31.159880+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:49:31.159880+0000","last_undegraded":"2024-09-21T07:49:31.159880+0000","last_fullsized":"2024-09-21T07:49:31.159880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247831+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247831+0000","last_peered":"2024-09-21T07:49:31.247831+0000","last_clean":"2024-09-21T07:49:31.247831+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247831+0000","last_undegraded":"2024-09-21T07:49:31.247831+0000","last_fullsized":"2024-09-21T07:49:31.247831+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158803+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158803+0000","last_peered":"2024-09-21T07:49:31.158803+0000","last_clean":"2024-09-21T07:49:31.158803+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158803+0000","last_undegraded":"2024-09-21T07:49:31.158803+0000","last_fullsized":"2024-09-21T07:49:31.158803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159712+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:49:31.159712+0000","last_peered":"2024-09-21T07:49:31.159712+0000","last_clean":"2024-09-21T07:49:31.159712+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:49:31.159712+0000","last_undegraded":"2024-09-21T07:49:31.159712+0000","last_fullsized":"2024-09-21T07:49:31.159712+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245761+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245761+0000","last_peered":"2024-09-21T07:49:31.245761+0000","last_clean":"2024-09-21T07:49:31.245761+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245761+0000","last_undegraded":"2024-09-21T07:49:31.245761+0000","last_fullsized":"2024-09-21T07:49:31.245761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243532+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243532+0000","last_peered":"2024-09-21T07:49:31.243532+0000","last_clean":"2024-09-21T07:49:31.243532+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243532+0000","last_undegraded":"2024-09-21T07:49:31.243532+0000","last_fullsized":"2024-09-21T07:49:31.243532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248159+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:49:31.248159+0000","last_peered":"2024-09-21T07:49:31.248159+0000","last_clean":"2024-09-21T07:49:31.248159+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:49:31.248159+0000","last_undegraded":"2024-09-21T07:49:31.248159+0000","last_fullsized":"2024-09-21T07:49:31.248159+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248064+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248064+0000","last_peered":"2024-09-21T07:49:31.248064+0000","last_clean":"2024-09-21T07:49:31.248064+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248064+0000","last_undegraded":"2024-09-21T07:49:31.248064+0000","last_fullsized":"2024-09-21T07:49:31.248064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":111,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248894+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:49:31.248894+0000","last_peered":"2024-09-21T07:49:31.248894+0000","last_clean":"2024-09-21T07:49:31.248894+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:49:31.248894+0000","last_undegraded":"2024-09-21T07:49:31.248894+0000","last_fullsized":"2024-09-21T07:49:31.248894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162183+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:49:31.162183+0000","last_peered":"2024-09-21T07:49:31.162183+0000","last_clean":"2024-09-21T07:49:31.162183+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:49:31.162183+0000","last_undegraded":"2024-09-21T07:49:31.162183+0000","last_fullsized":"2024-09-21T07:49:31.162183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248410+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248410+0000","last_peered":"2024-09-21T07:49:31.248410+0000","last_clean":"2024-09-21T07:49:31.248410+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248410+0000","last_undegraded":"2024-09-21T07:49:31.248410+0000","last_fullsized":"2024-09-21T07:49:31.248410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158197+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:49:31.158197+0000","last_peered":"2024-09-21T07:49:31.158197+0000","last_clean":"2024-09-21T07:49:31.158197+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:49:31.158197+0000","last_undegraded":"2024-09-21T07:49:31.158197+0000","last_fullsized":"2024-09-21T07:49:31.158197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247967+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:49:31.247967+0000","last_peered":"2024-09-21T07:49:31.247967+0000","last_clean":"2024-09-21T07:49:31.247967+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:49:31.247967+0000","last_undegraded":"2024-09-21T07:49:31.247967+0000","last_fullsized":"2024-09-21T07:49:31.247967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247607+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:49:31.247607+0000","last_peered":"2024-09-21T07:49:31.247607+0000","last_clean":"2024-09-21T07:49:31.247607+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:49:31.247607+0000","last_undegraded":"2024-09-21T07:49:31.247607+0000","last_fullsized":"2024-09-21T07:49:31.247607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278823+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:49:31.278823+0000","last_peered":"2024-09-21T07:49:31.278823+0000","last_clean":"2024-09-21T07:49:31.278823+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:49:31.278823+0000","last_undegraded":"2024-09-21T07:49:31.278823+0000","last_fullsized":"2024-09-21T07:49:31.278823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246257+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:49:31.246257+0000","last_peered":"2024-09-21T07:49:31.246257+0000","last_clean":"2024-09-21T07:49:31.246257+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:49:31.246257+0000","last_undegraded":"2024-09-21T07:49:31.246257+0000","last_fullsized":"2024-09-21T07:49:31.246257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158821+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:49:31.158821+0000","last_peered":"2024-09-21T07:49:31.158821+0000","last_clean":"2024-09-21T07:49:31.158821+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:49:31.158821+0000","last_undegraded":"2024-09-21T07:49:31.158821+0000","last_fullsized":"2024-09-21T07:49:31.158821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248322+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:49:31.248322+0000","last_peered":"2024-09-21T07:49:31.248322+0000","last_clean":"2024-09-21T07:49:31.248322+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:49:31.248322+0000","last_undegraded":"2024-09-21T07:49:31.248322+0000","last_fullsized":"2024-09-21T07:49:31.248322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279213+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:49:31.279213+0000","last_peered":"2024-09-21T07:49:31.279213+0000","last_clean":"2024-09-21T07:49:31.279213+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:49:31.279213+0000","last_undegraded":"2024-09-21T07:49:31.279213+0000","last_fullsized":"2024-09-21T07:49:31.279213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247118+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:49:31.247118+0000","last_peered":"2024-09-21T07:49:31.247118+0000","last_clean":"2024-09-21T07:49:31.247118+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:49:31.247118+0000","last_undegraded":"2024-09-21T07:49:31.247118+0000","last_fullsized":"2024-09-21T07:49:31.247118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278200+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:49:31.278200+0000","last_peered":"2024-09-21T07:49:31.278200+0000","last_clean":"2024-09-21T07:49:31.278200+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:49:31.278200+0000","last_undegraded":"2024-09-21T07:49:31.278200+0000","last_fullsized":"2024-09-21T07:49:31.278200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161332+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:49:31.161332+0000","last_peered":"2024-09-21T07:49:31.161332+0000","last_clean":"2024-09-21T07:49:31.161332+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:49:31.161332+0000","last_undegraded":"2024-09-21T07:49:31.161332+0000","last_fullsized":"2024-09-21T07:49:31.161332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246647+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:49:31.246647+0000","last_peered":"2024-09-21T07:49:31.246647+0000","last_clean":"2024-09-21T07:49:31.246647+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:49:31.246647+0000","last_undegraded":"2024-09-21T07:49:31.246647+0000","last_fullsized":"2024-09-21T07:49:31.246647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158458+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:49:31.158458+0000","last_peered":"2024-09-21T07:49:31.158458+0000","last_clean":"2024-09-21T07:49:31.158458+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:49:31.158458+0000","last_undegraded":"2024-09-21T07:49:31.158458+0000","last_fullsized":"2024-09-21T07:49:31.158458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248639+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:49:31.248639+0000","last_peered":"2024-09-21T07:49:31.248639+0000","last_clean":"2024-09-21T07:49:31.248639+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:49:31.248639+0000","last_undegraded":"2024-09-21T07:49:31.248639+0000","last_fullsized":"2024-09-21T07:49:31.248639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160461+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:49:31.160461+0000","last_peered":"2024-09-21T07:49:31.160461+0000","last_clean":"2024-09-21T07:49:31.160461+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:49:31.160461+0000","last_undegraded":"2024-09-21T07:49:31.160461+0000","last_fullsized":"2024-09-21T07:49:31.160461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159021+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:49:31.159021+0000","last_peered":"2024-09-21T07:49:31.159021+0000","last_clean":"2024-09-21T07:49:31.159021+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:49:31.159021+0000","last_undegraded":"2024-09-21T07:49:31.159021+0000","last_fullsized":"2024-09-21T07:49:31.159021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160800+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:49:31.160800+0000","last_peered":"2024-09-21T07:49:31.160800+0000","last_clean":"2024-09-21T07:49:31.160800+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:49:31.160800+0000","last_undegraded":"2024-09-21T07:49:31.160800+0000","last_fullsized":"2024-09-21T07:49:31.160800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278682+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:49:31.278682+0000","last_peered":"2024-09-21T07:49:31.278682+0000","last_clean":"2024-09-21T07:49:31.278682+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:49:31.278682+0000","last_undegraded":"2024-09-21T07:49:31.278682+0000","last_fullsized":"2024-09-21T07:49:31.278682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278716+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:49:31.278716+0000","last_peered":"2024-09-21T07:49:31.278716+0000","last_clean":"2024-09-21T07:49:31.278716+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:49:31.278716+0000","last_undegraded":"2024-09-21T07:49:31.278716+0000","last_fullsized":"2024-09-21T07:49:31.278716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246587+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:49:31.246587+0000","last_peered":"2024-09-21T07:49:31.246587+0000","last_clean":"2024-09-21T07:49:31.246587+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:49:31.246587+0000","last_undegraded":"2024-09-21T07:49:31.246587+0000","last_fullsized":"2024-09-21T07:49:31.246587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163160+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:49:31.163160+0000","last_peered":"2024-09-21T07:49:31.163160+0000","last_clean":"2024-09-21T07:49:31.163160+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:49:31.163160+0000","last_undegraded":"2024-09-21T07:49:31.163160+0000","last_fullsized":"2024-09-21T07:49:31.163160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243779+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:49:31.243779+0000","last_peered":"2024-09-21T07:49:31.243779+0000","last_clean":"2024-09-21T07:49:31.243779+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:49:31.243779+0000","last_undegraded":"2024-09-21T07:49:31.243779+0000","last_fullsized":"2024-09-21T07:49:31.243779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243987+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:49:31.243987+0000","last_peered":"2024-09-21T07:49:31.243987+0000","last_clean":"2024-09-21T07:49:31.243987+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:49:31.243987+0000","last_undegraded":"2024-09-21T07:49:31.243987+0000","last_fullsized":"2024-09-21T07:49:31.243987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162036+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:49:31.162036+0000","last_peered":"2024-09-21T07:49:31.162036+0000","last_clean":"2024-09-21T07:49:31.162036+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:49:31.162036+0000","last_undegraded":"2024-09-21T07:49:31.162036+0000","last_fullsized":"2024-09-21T07:49:31.162036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278182+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:49:31.278182+0000","last_peered":"2024-09-21T07:49:31.278182+0000","last_clean":"2024-09-21T07:49:31.278182+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:49:31.278182+0000","last_undegraded":"2024-09-21T07:49:31.278182+0000","last_fullsized":"2024-09-21T07:49:31.278182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243511+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:49:31.243511+0000","last_peered":"2024-09-21T07:49:31.243511+0000","last_clean":"2024-09-21T07:49:31.243511+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:49:31.243511+0000","last_undegraded":"2024-09-21T07:49:31.243511+0000","last_fullsized":"2024-09-21T07:49:31.243511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243370+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:49:31.243370+0000","last_peered":"2024-09-21T07:49:31.243370+0000","last_clean":"2024-09-21T07:49:31.243370+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:49:31.243370+0000","last_undegraded":"2024-09-21T07:49:31.243370+0000","last_fullsized":"2024-09-21T07:49:31.243370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162146+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:49:31.162146+0000","last_peered":"2024-09-21T07:49:31.162146+0000","last_clean":"2024-09-21T07:49:31.162146+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:49:31.162146+0000","last_undegraded":"2024-09-21T07:49:31.162146+0000","last_fullsized":"2024-09-21T07:49:31.162146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163148+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:49:31.163148+0000","last_peered":"2024-09-21T07:49:31.163148+0000","last_clean":"2024-09-21T07:49:31.163148+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:49:31.163148+0000","last_undegraded":"2024-09-21T07:49:31.163148+0000","last_fullsized":"2024-09-21T07:49:31.163148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278877+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:49:31.278877+0000","last_peered":"2024-09-21T07:49:31.278877+0000","last_clean":"2024-09-21T07:49:31.278877+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:49:31.278877+0000","last_undegraded":"2024-09-21T07:49:31.278877+0000","last_fullsized":"2024-09-21T07:49:31.278877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279041+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:49:31.279041+0000","last_peered":"2024-09-21T07:49:31.279041+0000","last_clean":"2024-09-21T07:49:31.279041+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:49:31.279041+0000","last_undegraded":"2024-09-21T07:49:31.279041+0000","last_fullsized":"2024-09-21T07:49:31.279041+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158985+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:49:31.158985+0000","last_peered":"2024-09-21T07:49:31.158985+0000","last_clean":"2024-09-21T07:49:31.158985+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:49:31.158985+0000","last_undegraded":"2024-09-21T07:49:31.158985+0000","last_fullsized":"2024-09-21T07:49:31.158985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74001,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":631,"num_read_kb":399,"num_write":249,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":222003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1040384,"data_stored":526779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906985,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37036,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708116,"statfs":{"total":95995035648,"available":95957110784,"internally_reserved":0,"allocated":1728512,"data_stored":1179351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070512,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1056768,"data_stored":529764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":515904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36960,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708192,"statfs":{"total":95995035648,"available":95957188608,"internally_reserved":0,"allocated":1646592,"data_stored":1122543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626496,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":521172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1654784,"data_stored":1118125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":520880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1097728,"data_stored":580373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542235,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1101824,"data_stored":588999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705761,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":523019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:49:37.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:49:37.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:37 smithi084 ceph-mon[30411]: from='client.25142 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:49:37.375 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:37.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:37 smithi162 ceph-mon[34833]: from='client.25142 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:49:37.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:37 smithi191 ceph-mon[34667]: from='client.25142 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:49:38.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 -- 172.21.15.84:0/624537762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c109df0 msgr2=0x7f162c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 --2- 172.21.15.84:0/624537762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c109df0 0x7f162c110620 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1624009ca0 tx=0x7f162402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 -- 172.21.15.84:0/624537762 shutdown_connections 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 --2- 172.21.15.84:0/624537762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c109df0 0x7f162c110620 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 --2- 172.21.15.84:0/624537762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c1094a0 0x7f162c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 --2- 172.21.15.84:0/624537762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c103b60 0x7f162c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 -- 172.21.15.84:0/624537762 >> 172.21.15.84:0/624537762 conn(0x7f162c07b850 msgr2=0x7f162c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 -- 172.21.15.84:0/624537762 shutdown_connections 2024-09-21T07:49:38.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.012+0000 7f1631000640 1 -- 172.21.15.84:0/624537762 wait complete. 2024-09-21T07:49:38.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.013+0000 7f1631000640 1 Processor -- start 2024-09-21T07:49:38.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1631000640 1 -- start start 2024-09-21T07:49:38.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1631000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c103b60 0x7f162c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:38.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1631000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c1094a0 0x7f162c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:38.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1631000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c109df0 0x7f162c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:38.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1631000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f162c113ab0 con 0x7f162c103b60 2024-09-21T07:49:38.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1631000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f162c113930 con 0x7f162c109df0 2024-09-21T07:49:38.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1631000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f162c113c30 con 0x7f162c1094a0 2024-09-21T07:49:38.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1629e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c103b60 0x7f162c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:38.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1629e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c103b60 0x7f162c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40496/0 (socket says 172.21.15.84:40496) 2024-09-21T07:49:38.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1629e00640 1 -- 172.21.15.84:0/120486282 learned_addr learned my addr 172.21.15.84:0/120486282 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:38.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f1629400640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c1094a0 0x7f162c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:38.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.014+0000 7f162a800640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c109df0 0x7f162c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1629e00640 1 -- 172.21.15.84:0/120486282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c1094a0 msgr2=0x7f162c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1629e00640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c1094a0 0x7f162c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1629e00640 1 -- 172.21.15.84:0/120486282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c109df0 msgr2=0x7f162c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1629e00640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c109df0 0x7f162c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1629e00640 1 -- 172.21.15.84:0/120486282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c1a86e0 con 0x7f162c103b60 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1629e00640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c103b60 0x7f162c075710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f161c00e9f0 tx=0x7f161c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1622a00640 1 -- 172.21.15.84:0/120486282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c00cd80 con 0x7f162c103b60 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1622a00640 1 -- 172.21.15.84:0/120486282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f161c0054d0 con 0x7f162c103b60 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.015+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162c1a89d0 con 0x7f162c103b60 2024-09-21T07:49:38.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.016+0000 7f1622a00640 1 -- 172.21.15.84:0/120486282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c010690 con 0x7f162c103b60 2024-09-21T07:49:38.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.016+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f162c1a8ec0 con 0x7f162c103b60 2024-09-21T07:49:38.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.017+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f162c103f70 con 0x7f162c103b60 2024-09-21T07:49:38.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.019+0000 7f1622a00640 1 -- 172.21.15.84:0/120486282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f161c004e30 con 0x7f162c103b60 2024-09-21T07:49:38.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.020+0000 7f1622a00640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65f0 0x7f16100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:38.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.021+0000 7f1622a00640 1 -- 172.21.15.84:0/120486282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f161c0e7f40 con 0x7f162c103b60 2024-09-21T07:49:38.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.021+0000 7f1629400640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65f0 0x7f16100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:38.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.021+0000 7f1629400640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65f0 0x7f16100b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f162c109190 tx=0x7f1618005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:38.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.022+0000 7f1622a00640 1 -- 172.21.15.84:0/120486282 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f161c0ae1e0 con 0x7f162c103b60 2024-09-21T07:49:38.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.212+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f162c063800 con 0x7f16100b65f0 2024-09-21T07:49:38.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.218+0000 7f1622a00640 1 -- 172.21.15.84:0/120486282 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340435 (secure 0 0 0) 0x7f162c063800 con 0x7f16100b65f0 2024-09-21T07:49:38.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:38.225 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:49:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65f0 msgr2=0x7f16100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65f0 0x7f16100b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f162c109190 tx=0x7f1618005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c103b60 msgr2=0x7f162c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c103b60 0x7f162c075710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f161c00e9f0 tx=0x7f161c00edf0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 shutdown_connections 2024-09-21T07:49:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65f0 0x7f16100b8b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c109df0 0x7f162c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c1094a0 0x7f162c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 --2- 172.21.15.84:0/120486282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c103b60 0x7f162c075710 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 >> 172.21.15.84:0/120486282 conn(0x7f162c07b850 msgr2=0x7f162c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 shutdown_connections 2024-09-21T07:49:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:38.223+0000 7f1631000640 1 -- 172.21.15.84:0/120486282 wait complete. 2024-09-21T07:49:38.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:38 smithi162 ceph-mon[34833]: pgmap v350: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:49:38.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:38 smithi084 ceph-mon[30411]: pgmap v350: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:49:38.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:38 smithi191 ceph-mon[34667]: pgmap v350: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:49:38.952 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-21T07:49:38.002541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664603,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":717,"num_read_kb":468,"num_write":374,"num_write_kb":2298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388492,"kb_used_data":14204,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553332,"statfs":{"total":1151940427776,"available":1151542611968,"internally_reserved":0,"allocated":14544896,"data_stored":8271275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002486"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":116,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.240591+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:49:31.240591+0000","last_peered":"2024-09-21T07:49:31.240591+0000","last_clean":"2024-09-21T07:49:31.240591+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:49:31.240591+0000","last_undegraded":"2024-09-21T07:49:31.240591+0000","last_fullsized":"2024-09-21T07:49:31.240591+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278967+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:49:31.278967+0000","last_peered":"2024-09-21T07:49:31.278967+0000","last_clean":"2024-09-21T07:49:31.278967+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:49:31.278967+0000","last_undegraded":"2024-09-21T07:49:31.278967+0000","last_fullsized":"2024-09-21T07:49:31.278967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247545+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247545+0000","last_peered":"2024-09-21T07:49:31.247545+0000","last_clean":"2024-09-21T07:49:31.247545+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247545+0000","last_undegraded":"2024-09-21T07:49:31.247545+0000","last_fullsized":"2024-09-21T07:49:31.247545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279132+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279132+0000","last_peered":"2024-09-21T07:49:31.279132+0000","last_clean":"2024-09-21T07:49:31.279132+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279132+0000","last_undegraded":"2024-09-21T07:49:31.279132+0000","last_fullsized":"2024-09-21T07:49:31.279132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278815+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:49:31.278815+0000","last_peered":"2024-09-21T07:49:31.278815+0000","last_clean":"2024-09-21T07:49:31.278815+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:49:31.278815+0000","last_undegraded":"2024-09-21T07:49:31.278815+0000","last_fullsized":"2024-09-21T07:49:31.278815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279835+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.279835+0000","last_peered":"2024-09-21T07:49:31.279835+0000","last_clean":"2024-09-21T07:49:31.279835+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.279835+0000","last_undegraded":"2024-09-21T07:49:31.279835+0000","last_fullsized":"2024-09-21T07:49:31.279835+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162561+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162561+0000","last_peered":"2024-09-21T07:49:31.162561+0000","last_clean":"2024-09-21T07:49:31.162561+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162561+0000","last_undegraded":"2024-09-21T07:49:31.162561+0000","last_fullsized":"2024-09-21T07:49:31.162561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161466+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:49:31.161466+0000","last_peered":"2024-09-21T07:49:31.161466+0000","last_clean":"2024-09-21T07:49:31.161466+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:49:31.161466+0000","last_undegraded":"2024-09-21T07:49:31.161466+0000","last_fullsized":"2024-09-21T07:49:31.161466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162884+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162884+0000","last_peered":"2024-09-21T07:49:31.162884+0000","last_clean":"2024-09-21T07:49:31.162884+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162884+0000","last_undegraded":"2024-09-21T07:49:31.162884+0000","last_fullsized":"2024-09-21T07:49:31.162884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248407+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:49:31.248407+0000","last_peered":"2024-09-21T07:49:31.248407+0000","last_clean":"2024-09-21T07:49:31.248407+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:49:31.248407+0000","last_undegraded":"2024-09-21T07:49:31.248407+0000","last_fullsized":"2024-09-21T07:49:31.248407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162156+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162156+0000","last_peered":"2024-09-21T07:49:31.162156+0000","last_clean":"2024-09-21T07:49:31.162156+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162156+0000","last_undegraded":"2024-09-21T07:49:31.162156+0000","last_fullsized":"2024-09-21T07:49:31.162156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243738+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:49:31.243738+0000","last_peered":"2024-09-21T07:49:31.243738+0000","last_clean":"2024-09-21T07:49:31.243738+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:49:31.243738+0000","last_undegraded":"2024-09-21T07:49:31.243738+0000","last_fullsized":"2024-09-21T07:49:31.243738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162206+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162206+0000","last_peered":"2024-09-21T07:49:31.162206+0000","last_clean":"2024-09-21T07:49:31.162206+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162206+0000","last_undegraded":"2024-09-21T07:49:31.162206+0000","last_fullsized":"2024-09-21T07:49:31.162206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162959+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.162959+0000","last_peered":"2024-09-21T07:49:31.162959+0000","last_clean":"2024-09-21T07:49:31.162959+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.162959+0000","last_undegraded":"2024-09-21T07:49:31.162959+0000","last_fullsized":"2024-09-21T07:49:31.162959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277969+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:49:31.277969+0000","last_peered":"2024-09-21T07:49:31.277969+0000","last_clean":"2024-09-21T07:49:31.277969+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:49:31.277969+0000","last_undegraded":"2024-09-21T07:49:31.277969+0000","last_fullsized":"2024-09-21T07:49:31.277969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247765+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247765+0000","last_peered":"2024-09-21T07:49:31.247765+0000","last_clean":"2024-09-21T07:49:31.247765+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247765+0000","last_undegraded":"2024-09-21T07:49:31.247765+0000","last_fullsized":"2024-09-21T07:49:31.247765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162981+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.162981+0000","last_peered":"2024-09-21T07:49:31.162981+0000","last_clean":"2024-09-21T07:49:31.162981+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.162981+0000","last_undegraded":"2024-09-21T07:49:31.162981+0000","last_fullsized":"2024-09-21T07:49:31.162981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158317+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:49:31.158317+0000","last_peered":"2024-09-21T07:49:31.158317+0000","last_clean":"2024-09-21T07:49:31.158317+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:49:31.158317+0000","last_undegraded":"2024-09-21T07:49:31.158317+0000","last_fullsized":"2024-09-21T07:49:31.158317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278388+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278388+0000","last_peered":"2024-09-21T07:49:31.278388+0000","last_clean":"2024-09-21T07:49:31.278388+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278388+0000","last_undegraded":"2024-09-21T07:49:31.278388+0000","last_fullsized":"2024-09-21T07:49:31.278388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160509+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160509+0000","last_peered":"2024-09-21T07:49:31.160509+0000","last_clean":"2024-09-21T07:49:31.160509+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160509+0000","last_undegraded":"2024-09-21T07:49:31.160509+0000","last_fullsized":"2024-09-21T07:49:31.160509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162013+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:49:31.162013+0000","last_peered":"2024-09-21T07:49:31.162013+0000","last_clean":"2024-09-21T07:49:31.162013+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:49:31.162013+0000","last_undegraded":"2024-09-21T07:49:31.162013+0000","last_fullsized":"2024-09-21T07:49:31.162013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160963+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.160963+0000","last_peered":"2024-09-21T07:49:31.160963+0000","last_clean":"2024-09-21T07:49:31.160963+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.160963+0000","last_undegraded":"2024-09-21T07:49:31.160963+0000","last_fullsized":"2024-09-21T07:49:31.160963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163092+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163092+0000","last_peered":"2024-09-21T07:49:31.163092+0000","last_clean":"2024-09-21T07:49:31.163092+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163092+0000","last_undegraded":"2024-09-21T07:49:31.163092+0000","last_fullsized":"2024-09-21T07:49:31.163092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279092+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:49:31.279092+0000","last_peered":"2024-09-21T07:49:31.279092+0000","last_clean":"2024-09-21T07:49:31.279092+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:49:31.279092+0000","last_undegraded":"2024-09-21T07:49:31.279092+0000","last_fullsized":"2024-09-21T07:49:31.279092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163338+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163338+0000","last_peered":"2024-09-21T07:49:31.163338+0000","last_clean":"2024-09-21T07:49:31.163338+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163338+0000","last_undegraded":"2024-09-21T07:49:31.163338+0000","last_fullsized":"2024-09-21T07:49:31.163338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247544+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247544+0000","last_peered":"2024-09-21T07:49:31.247544+0000","last_clean":"2024-09-21T07:49:31.247544+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247544+0000","last_undegraded":"2024-09-21T07:49:31.247544+0000","last_fullsized":"2024-09-21T07:49:31.247544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279299+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:49:31.279299+0000","last_peered":"2024-09-21T07:49:31.279299+0000","last_clean":"2024-09-21T07:49:31.279299+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:49:31.279299+0000","last_undegraded":"2024-09-21T07:49:31.279299+0000","last_fullsized":"2024-09-21T07:49:31.279299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'16","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160465+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:49:31.160465+0000","last_peered":"2024-09-21T07:49:31.160465+0000","last_clean":"2024-09-21T07:49:31.160465+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:49:31.160465+0000","last_undegraded":"2024-09-21T07:49:31.160465+0000","last_fullsized":"2024-09-21T07:49:31.160465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278072+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278072+0000","last_peered":"2024-09-21T07:49:31.278072+0000","last_clean":"2024-09-21T07:49:31.278072+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278072+0000","last_undegraded":"2024-09-21T07:49:31.278072+0000","last_fullsized":"2024-09-21T07:49:31.278072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246342+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:49:31.246342+0000","last_peered":"2024-09-21T07:49:31.246342+0000","last_clean":"2024-09-21T07:49:31.246342+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:49:31.246342+0000","last_undegraded":"2024-09-21T07:49:31.246342+0000","last_fullsized":"2024-09-21T07:49:31.246342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162908+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162908+0000","last_peered":"2024-09-21T07:49:31.162908+0000","last_clean":"2024-09-21T07:49:31.162908+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162908+0000","last_undegraded":"2024-09-21T07:49:31.162908+0000","last_fullsized":"2024-09-21T07:49:31.162908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158382+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158382+0000","last_peered":"2024-09-21T07:49:31.158382+0000","last_clean":"2024-09-21T07:49:31.158382+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158382+0000","last_undegraded":"2024-09-21T07:49:31.158382+0000","last_fullsized":"2024-09-21T07:49:31.158382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243152+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:49:31.243152+0000","last_peered":"2024-09-21T07:49:31.243152+0000","last_clean":"2024-09-21T07:49:31.243152+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:49:31.243152+0000","last_undegraded":"2024-09-21T07:49:31.243152+0000","last_fullsized":"2024-09-21T07:49:31.243152+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160425+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160425+0000","last_peered":"2024-09-21T07:49:31.160425+0000","last_clean":"2024-09-21T07:49:31.160425+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160425+0000","last_undegraded":"2024-09-21T07:49:31.160425+0000","last_fullsized":"2024-09-21T07:49:31.160425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162037+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162037+0000","last_peered":"2024-09-21T07:49:31.162037+0000","last_clean":"2024-09-21T07:49:31.162037+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162037+0000","last_undegraded":"2024-09-21T07:49:31.162037+0000","last_fullsized":"2024-09-21T07:49:31.162037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243250+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:49:31.243250+0000","last_peered":"2024-09-21T07:49:31.243250+0000","last_clean":"2024-09-21T07:49:31.243250+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:49:31.243250+0000","last_undegraded":"2024-09-21T07:49:31.243250+0000","last_fullsized":"2024-09-21T07:49:31.243250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:33.247305+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:49:33.247305+0000","last_peered":"2024-09-21T07:49:33.247305+0000","last_clean":"2024-09-21T07:49:33.247305+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:49:33.247305+0000","last_undegraded":"2024-09-21T07:49:33.247305+0000","last_fullsized":"2024-09-21T07:49:33.247305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245947+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.245947+0000","last_peered":"2024-09-21T07:49:31.245947+0000","last_clean":"2024-09-21T07:49:31.245947+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.245947+0000","last_undegraded":"2024-09-21T07:49:31.245947+0000","last_fullsized":"2024-09-21T07:49:31.245947+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247241+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:49:31.247241+0000","last_peered":"2024-09-21T07:49:31.247241+0000","last_clean":"2024-09-21T07:49:31.247241+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:49:31.247241+0000","last_undegraded":"2024-09-21T07:49:31.247241+0000","last_fullsized":"2024-09-21T07:49:31.247241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:33.249686+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:49:33.249686+0000","last_peered":"2024-09-21T07:49:33.249686+0000","last_clean":"2024-09-21T07:49:33.249686+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:49:33.249686+0000","last_undegraded":"2024-09-21T07:49:33.249686+0000","last_fullsized":"2024-09-21T07:49:33.249686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246295+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246295+0000","last_peered":"2024-09-21T07:49:31.246295+0000","last_clean":"2024-09-21T07:49:31.246295+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246295+0000","last_undegraded":"2024-09-21T07:49:31.246295+0000","last_fullsized":"2024-09-21T07:49:31.246295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245724+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:49:31.245724+0000","last_peered":"2024-09-21T07:49:31.245724+0000","last_clean":"2024-09-21T07:49:31.245724+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:49:31.245724+0000","last_undegraded":"2024-09-21T07:49:31.245724+0000","last_fullsized":"2024-09-21T07:49:31.245724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243226+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243226+0000","last_peered":"2024-09-21T07:49:31.243226+0000","last_clean":"2024-09-21T07:49:31.243226+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243226+0000","last_undegraded":"2024-09-21T07:49:31.243226+0000","last_fullsized":"2024-09-21T07:49:31.243226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247818+0000","last_change":"2024-09-21T07:49:31.247663+0000","last_active":"2024-09-21T07:49:31.247818+0000","last_peered":"2024-09-21T07:49:31.247818+0000","last_clean":"2024-09-21T07:49:31.247818+0000","last_became_active":"2024-09-21T07:49:31.247173+0000","last_became_peered":"2024-09-21T07:49:31.247173+0000","last_unstale":"2024-09-21T07:49:31.247818+0000","last_undegraded":"2024-09-21T07:49:31.247818+0000","last_fullsized":"2024-09-21T07:49:31.247818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:29.114632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278198+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:49:31.278198+0000","last_peered":"2024-09-21T07:49:31.278198+0000","last_clean":"2024-09-21T07:49:31.278198+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:49:31.278198+0000","last_undegraded":"2024-09-21T07:49:31.278198+0000","last_fullsized":"2024-09-21T07:49:31.278198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162969+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.162969+0000","last_peered":"2024-09-21T07:49:31.162969+0000","last_clean":"2024-09-21T07:49:31.162969+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.162969+0000","last_undegraded":"2024-09-21T07:49:31.162969+0000","last_fullsized":"2024-09-21T07:49:31.162969+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243521+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243521+0000","last_peered":"2024-09-21T07:49:31.243521+0000","last_clean":"2024-09-21T07:49:31.243521+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243521+0000","last_undegraded":"2024-09-21T07:49:31.243521+0000","last_fullsized":"2024-09-21T07:49:31.243521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243899+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:49:31.243899+0000","last_peered":"2024-09-21T07:49:31.243899+0000","last_clean":"2024-09-21T07:49:31.243899+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:49:31.243899+0000","last_undegraded":"2024-09-21T07:49:31.243899+0000","last_fullsized":"2024-09-21T07:49:31.243899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":115,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:35.254634+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:49:35.254634+0000","last_peered":"2024-09-21T07:49:35.254634+0000","last_clean":"2024-09-21T07:49:35.254634+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:49:35.254634+0000","last_undegraded":"2024-09-21T07:49:35.254634+0000","last_fullsized":"2024-09-21T07:49:35.254634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161156+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161156+0000","last_peered":"2024-09-21T07:49:31.161156+0000","last_clean":"2024-09-21T07:49:31.161156+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161156+0000","last_undegraded":"2024-09-21T07:49:31.161156+0000","last_fullsized":"2024-09-21T07:49:31.161156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244420+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:49:31.244420+0000","last_peered":"2024-09-21T07:49:31.244420+0000","last_clean":"2024-09-21T07:49:31.244420+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:49:31.244420+0000","last_undegraded":"2024-09-21T07:49:31.244420+0000","last_fullsized":"2024-09-21T07:49:31.244420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248753+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:49:31.248753+0000","last_peered":"2024-09-21T07:49:31.248753+0000","last_clean":"2024-09-21T07:49:31.248753+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:49:31.248753+0000","last_undegraded":"2024-09-21T07:49:31.248753+0000","last_fullsized":"2024-09-21T07:49:31.248753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278701+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278701+0000","last_peered":"2024-09-21T07:49:31.278701+0000","last_clean":"2024-09-21T07:49:31.278701+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278701+0000","last_undegraded":"2024-09-21T07:49:31.278701+0000","last_fullsized":"2024-09-21T07:49:31.278701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244209+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:49:31.244209+0000","last_peered":"2024-09-21T07:49:31.244209+0000","last_clean":"2024-09-21T07:49:31.244209+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:49:31.244209+0000","last_undegraded":"2024-09-21T07:49:31.244209+0000","last_fullsized":"2024-09-21T07:49:31.244209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246268+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246268+0000","last_peered":"2024-09-21T07:49:31.246268+0000","last_clean":"2024-09-21T07:49:31.246268+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246268+0000","last_undegraded":"2024-09-21T07:49:31.246268+0000","last_fullsized":"2024-09-21T07:49:31.246268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246828+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246828+0000","last_peered":"2024-09-21T07:49:31.246828+0000","last_clean":"2024-09-21T07:49:31.246828+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246828+0000","last_undegraded":"2024-09-21T07:49:31.246828+0000","last_fullsized":"2024-09-21T07:49:31.246828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158808+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:49:31.158808+0000","last_peered":"2024-09-21T07:49:31.158808+0000","last_clean":"2024-09-21T07:49:31.158808+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:49:31.158808+0000","last_undegraded":"2024-09-21T07:49:31.158808+0000","last_fullsized":"2024-09-21T07:49:31.158808+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162780+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162780+0000","last_peered":"2024-09-21T07:49:31.162780+0000","last_clean":"2024-09-21T07:49:31.162780+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162780+0000","last_undegraded":"2024-09-21T07:49:31.162780+0000","last_fullsized":"2024-09-21T07:49:31.162780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246860+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246860+0000","last_peered":"2024-09-21T07:49:31.246860+0000","last_clean":"2024-09-21T07:49:31.246860+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246860+0000","last_undegraded":"2024-09-21T07:49:31.246860+0000","last_fullsized":"2024-09-21T07:49:31.246860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246999+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:49:31.246999+0000","last_peered":"2024-09-21T07:49:31.246999+0000","last_clean":"2024-09-21T07:49:31.246999+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:49:31.246999+0000","last_undegraded":"2024-09-21T07:49:31.246999+0000","last_fullsized":"2024-09-21T07:49:31.246999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161987+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.161987+0000","last_peered":"2024-09-21T07:49:31.161987+0000","last_clean":"2024-09-21T07:49:31.161987+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.161987+0000","last_undegraded":"2024-09-21T07:49:31.161987+0000","last_fullsized":"2024-09-21T07:49:31.161987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246136+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246136+0000","last_peered":"2024-09-21T07:49:31.246136+0000","last_clean":"2024-09-21T07:49:31.246136+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246136+0000","last_undegraded":"2024-09-21T07:49:31.246136+0000","last_fullsized":"2024-09-21T07:49:31.246136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243089+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:49:31.243089+0000","last_peered":"2024-09-21T07:49:31.243089+0000","last_clean":"2024-09-21T07:49:31.243089+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:49:31.243089+0000","last_undegraded":"2024-09-21T07:49:31.243089+0000","last_fullsized":"2024-09-21T07:49:31.243089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":110,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:32.248550+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:49:32.248550+0000","last_peered":"2024-09-21T07:49:32.248550+0000","last_clean":"2024-09-21T07:49:32.248550+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:49:32.248550+0000","last_undegraded":"2024-09-21T07:49:32.248550+0000","last_fullsized":"2024-09-21T07:49:32.248550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244085+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:49:31.244085+0000","last_peered":"2024-09-21T07:49:31.244085+0000","last_clean":"2024-09-21T07:49:31.244085+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:49:31.244085+0000","last_undegraded":"2024-09-21T07:49:31.244085+0000","last_fullsized":"2024-09-21T07:49:31.244085+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247648+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247648+0000","last_peered":"2024-09-21T07:49:31.247648+0000","last_clean":"2024-09-21T07:49:31.247648+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247648+0000","last_undegraded":"2024-09-21T07:49:31.247648+0000","last_fullsized":"2024-09-21T07:49:31.247648+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158382+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158382+0000","last_peered":"2024-09-21T07:49:31.158382+0000","last_clean":"2024-09-21T07:49:31.158382+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158382+0000","last_undegraded":"2024-09-21T07:49:31.158382+0000","last_fullsized":"2024-09-21T07:49:31.158382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245950+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:49:31.245950+0000","last_peered":"2024-09-21T07:49:31.245950+0000","last_clean":"2024-09-21T07:49:31.245950+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:49:31.245950+0000","last_undegraded":"2024-09-21T07:49:31.245950+0000","last_fullsized":"2024-09-21T07:49:31.245950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158337+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158337+0000","last_peered":"2024-09-21T07:49:31.158337+0000","last_clean":"2024-09-21T07:49:31.158337+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158337+0000","last_undegraded":"2024-09-21T07:49:31.158337+0000","last_fullsized":"2024-09-21T07:49:31.158337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248278+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248278+0000","last_peered":"2024-09-21T07:49:31.248278+0000","last_clean":"2024-09-21T07:49:31.248278+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248278+0000","last_undegraded":"2024-09-21T07:49:31.248278+0000","last_fullsized":"2024-09-21T07:49:31.248278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162418+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:49:31.162418+0000","last_peered":"2024-09-21T07:49:31.162418+0000","last_clean":"2024-09-21T07:49:31.162418+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:49:31.162418+0000","last_undegraded":"2024-09-21T07:49:31.162418+0000","last_fullsized":"2024-09-21T07:49:31.162418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'34","reported_seq":206,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:34.252265+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:49:34.252265+0000","last_peered":"2024-09-21T07:49:34.252265+0000","last_clean":"2024-09-21T07:49:34.252265+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:49:34.252265+0000","last_undegraded":"2024-09-21T07:49:34.252265+0000","last_fullsized":"2024-09-21T07:49:34.252265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66797,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":129,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159862+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159862+0000","last_peered":"2024-09-21T07:49:31.159862+0000","last_clean":"2024-09-21T07:49:31.159862+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159862+0000","last_undegraded":"2024-09-21T07:49:31.159862+0000","last_fullsized":"2024-09-21T07:49:31.159862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161545+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:49:31.161545+0000","last_peered":"2024-09-21T07:49:31.161545+0000","last_clean":"2024-09-21T07:49:31.161545+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:49:31.161545+0000","last_undegraded":"2024-09-21T07:49:31.161545+0000","last_fullsized":"2024-09-21T07:49:31.161545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248619+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248619+0000","last_peered":"2024-09-21T07:49:31.248619+0000","last_clean":"2024-09-21T07:49:31.248619+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248619+0000","last_undegraded":"2024-09-21T07:49:31.248619+0000","last_fullsized":"2024-09-21T07:49:31.248619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162156+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162156+0000","last_peered":"2024-09-21T07:49:31.162156+0000","last_clean":"2024-09-21T07:49:31.162156+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162156+0000","last_undegraded":"2024-09-21T07:49:31.162156+0000","last_fullsized":"2024-09-21T07:49:31.162156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278924+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:49:31.278924+0000","last_peered":"2024-09-21T07:49:31.278924+0000","last_clean":"2024-09-21T07:49:31.278924+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:49:31.278924+0000","last_undegraded":"2024-09-21T07:49:31.278924+0000","last_fullsized":"2024-09-21T07:49:31.278924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244576+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244576+0000","last_peered":"2024-09-21T07:49:31.244576+0000","last_clean":"2024-09-21T07:49:31.244576+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244576+0000","last_undegraded":"2024-09-21T07:49:31.244576+0000","last_fullsized":"2024-09-21T07:49:31.244576+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159716+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159716+0000","last_peered":"2024-09-21T07:49:31.159716+0000","last_clean":"2024-09-21T07:49:31.159716+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159716+0000","last_undegraded":"2024-09-21T07:49:31.159716+0000","last_fullsized":"2024-09-21T07:49:31.159716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162046+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:49:31.162046+0000","last_peered":"2024-09-21T07:49:31.162046+0000","last_clean":"2024-09-21T07:49:31.162046+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:49:31.162046+0000","last_undegraded":"2024-09-21T07:49:31.162046+0000","last_fullsized":"2024-09-21T07:49:31.162046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":169,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:34.252425+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:49:34.252425+0000","last_peered":"2024-09-21T07:49:34.252425+0000","last_clean":"2024-09-21T07:49:34.252425+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:49:34.252425+0000","last_undegraded":"2024-09-21T07:49:34.252425+0000","last_fullsized":"2024-09-21T07:49:34.252425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277833+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277833+0000","last_peered":"2024-09-21T07:49:31.277833+0000","last_clean":"2024-09-21T07:49:31.277833+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277833+0000","last_undegraded":"2024-09-21T07:49:31.277833+0000","last_fullsized":"2024-09-21T07:49:31.277833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278931+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278931+0000","last_peered":"2024-09-21T07:49:31.278931+0000","last_clean":"2024-09-21T07:49:31.278931+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278931+0000","last_undegraded":"2024-09-21T07:49:31.278931+0000","last_fullsized":"2024-09-21T07:49:31.278931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159880+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:49:31.159880+0000","last_peered":"2024-09-21T07:49:31.159880+0000","last_clean":"2024-09-21T07:49:31.159880+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:49:31.159880+0000","last_undegraded":"2024-09-21T07:49:31.159880+0000","last_fullsized":"2024-09-21T07:49:31.159880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247831+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247831+0000","last_peered":"2024-09-21T07:49:31.247831+0000","last_clean":"2024-09-21T07:49:31.247831+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247831+0000","last_undegraded":"2024-09-21T07:49:31.247831+0000","last_fullsized":"2024-09-21T07:49:31.247831+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158803+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158803+0000","last_peered":"2024-09-21T07:49:31.158803+0000","last_clean":"2024-09-21T07:49:31.158803+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158803+0000","last_undegraded":"2024-09-21T07:49:31.158803+0000","last_fullsized":"2024-09-21T07:49:31.158803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159712+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:49:31.159712+0000","last_peered":"2024-09-21T07:49:31.159712+0000","last_clean":"2024-09-21T07:49:31.159712+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:49:31.159712+0000","last_undegraded":"2024-09-21T07:49:31.159712+0000","last_fullsized":"2024-09-21T07:49:31.159712+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245761+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245761+0000","last_peered":"2024-09-21T07:49:31.245761+0000","last_clean":"2024-09-21T07:49:31.245761+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245761+0000","last_undegraded":"2024-09-21T07:49:31.245761+0000","last_fullsized":"2024-09-21T07:49:31.245761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243532+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243532+0000","last_peered":"2024-09-21T07:49:31.243532+0000","last_clean":"2024-09-21T07:49:31.243532+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243532+0000","last_undegraded":"2024-09-21T07:49:31.243532+0000","last_fullsized":"2024-09-21T07:49:31.243532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248159+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:49:31.248159+0000","last_peered":"2024-09-21T07:49:31.248159+0000","last_clean":"2024-09-21T07:49:31.248159+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:49:31.248159+0000","last_undegraded":"2024-09-21T07:49:31.248159+0000","last_fullsized":"2024-09-21T07:49:31.248159+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248064+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248064+0000","last_peered":"2024-09-21T07:49:31.248064+0000","last_clean":"2024-09-21T07:49:31.248064+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248064+0000","last_undegraded":"2024-09-21T07:49:31.248064+0000","last_fullsized":"2024-09-21T07:49:31.248064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":111,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248894+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:49:31.248894+0000","last_peered":"2024-09-21T07:49:31.248894+0000","last_clean":"2024-09-21T07:49:31.248894+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:49:31.248894+0000","last_undegraded":"2024-09-21T07:49:31.248894+0000","last_fullsized":"2024-09-21T07:49:31.248894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162183+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:49:31.162183+0000","last_peered":"2024-09-21T07:49:31.162183+0000","last_clean":"2024-09-21T07:49:31.162183+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:49:31.162183+0000","last_undegraded":"2024-09-21T07:49:31.162183+0000","last_fullsized":"2024-09-21T07:49:31.162183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248410+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248410+0000","last_peered":"2024-09-21T07:49:31.248410+0000","last_clean":"2024-09-21T07:49:31.248410+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248410+0000","last_undegraded":"2024-09-21T07:49:31.248410+0000","last_fullsized":"2024-09-21T07:49:31.248410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158197+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:49:31.158197+0000","last_peered":"2024-09-21T07:49:31.158197+0000","last_clean":"2024-09-21T07:49:31.158197+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:49:31.158197+0000","last_undegraded":"2024-09-21T07:49:31.158197+0000","last_fullsized":"2024-09-21T07:49:31.158197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247967+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:49:31.247967+0000","last_peered":"2024-09-21T07:49:31.247967+0000","last_clean":"2024-09-21T07:49:31.247967+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:49:31.247967+0000","last_undegraded":"2024-09-21T07:49:31.247967+0000","last_fullsized":"2024-09-21T07:49:31.247967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247607+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:49:31.247607+0000","last_peered":"2024-09-21T07:49:31.247607+0000","last_clean":"2024-09-21T07:49:31.247607+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:49:31.247607+0000","last_undegraded":"2024-09-21T07:49:31.247607+0000","last_fullsized":"2024-09-21T07:49:31.247607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278823+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:49:31.278823+0000","last_peered":"2024-09-21T07:49:31.278823+0000","last_clean":"2024-09-21T07:49:31.278823+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:49:31.278823+0000","last_undegraded":"2024-09-21T07:49:31.278823+0000","last_fullsized":"2024-09-21T07:49:31.278823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246257+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:49:31.246257+0000","last_peered":"2024-09-21T07:49:31.246257+0000","last_clean":"2024-09-21T07:49:31.246257+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:49:31.246257+0000","last_undegraded":"2024-09-21T07:49:31.246257+0000","last_fullsized":"2024-09-21T07:49:31.246257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158821+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:49:31.158821+0000","last_peered":"2024-09-21T07:49:31.158821+0000","last_clean":"2024-09-21T07:49:31.158821+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:49:31.158821+0000","last_undegraded":"2024-09-21T07:49:31.158821+0000","last_fullsized":"2024-09-21T07:49:31.158821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248322+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:49:31.248322+0000","last_peered":"2024-09-21T07:49:31.248322+0000","last_clean":"2024-09-21T07:49:31.248322+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:49:31.248322+0000","last_undegraded":"2024-09-21T07:49:31.248322+0000","last_fullsized":"2024-09-21T07:49:31.248322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279213+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:49:31.279213+0000","last_peered":"2024-09-21T07:49:31.279213+0000","last_clean":"2024-09-21T07:49:31.279213+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:49:31.279213+0000","last_undegraded":"2024-09-21T07:49:31.279213+0000","last_fullsized":"2024-09-21T07:49:31.279213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247118+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:49:31.247118+0000","last_peered":"2024-09-21T07:49:31.247118+0000","last_clean":"2024-09-21T07:49:31.247118+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:49:31.247118+0000","last_undegraded":"2024-09-21T07:49:31.247118+0000","last_fullsized":"2024-09-21T07:49:31.247118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278200+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:49:31.278200+0000","last_peered":"2024-09-21T07:49:31.278200+0000","last_clean":"2024-09-21T07:49:31.278200+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:49:31.278200+0000","last_undegraded":"2024-09-21T07:49:31.278200+0000","last_fullsized":"2024-09-21T07:49:31.278200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161332+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:49:31.161332+0000","last_peered":"2024-09-21T07:49:31.161332+0000","last_clean":"2024-09-21T07:49:31.161332+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:49:31.161332+0000","last_undegraded":"2024-09-21T07:49:31.161332+0000","last_fullsized":"2024-09-21T07:49:31.161332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246647+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:49:31.246647+0000","last_peered":"2024-09-21T07:49:31.246647+0000","last_clean":"2024-09-21T07:49:31.246647+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:49:31.246647+0000","last_undegraded":"2024-09-21T07:49:31.246647+0000","last_fullsized":"2024-09-21T07:49:31.246647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158458+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:49:31.158458+0000","last_peered":"2024-09-21T07:49:31.158458+0000","last_clean":"2024-09-21T07:49:31.158458+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:49:31.158458+0000","last_undegraded":"2024-09-21T07:49:31.158458+0000","last_fullsized":"2024-09-21T07:49:31.158458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248639+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:49:31.248639+0000","last_peered":"2024-09-21T07:49:31.248639+0000","last_clean":"2024-09-21T07:49:31.248639+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:49:31.248639+0000","last_undegraded":"2024-09-21T07:49:31.248639+0000","last_fullsized":"2024-09-21T07:49:31.248639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160461+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:49:31.160461+0000","last_peered":"2024-09-21T07:49:31.160461+0000","last_clean":"2024-09-21T07:49:31.160461+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:49:31.160461+0000","last_undegraded":"2024-09-21T07:49:31.160461+0000","last_fullsized":"2024-09-21T07:49:31.160461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159021+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:49:31.159021+0000","last_peered":"2024-09-21T07:49:31.159021+0000","last_clean":"2024-09-21T07:49:31.159021+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:49:31.159021+0000","last_undegraded":"2024-09-21T07:49:31.159021+0000","last_fullsized":"2024-09-21T07:49:31.159021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160800+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:49:31.160800+0000","last_peered":"2024-09-21T07:49:31.160800+0000","last_clean":"2024-09-21T07:49:31.160800+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:49:31.160800+0000","last_undegraded":"2024-09-21T07:49:31.160800+0000","last_fullsized":"2024-09-21T07:49:31.160800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278682+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:49:31.278682+0000","last_peered":"2024-09-21T07:49:31.278682+0000","last_clean":"2024-09-21T07:49:31.278682+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:49:31.278682+0000","last_undegraded":"2024-09-21T07:49:31.278682+0000","last_fullsized":"2024-09-21T07:49:31.278682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278716+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:49:31.278716+0000","last_peered":"2024-09-21T07:49:31.278716+0000","last_clean":"2024-09-21T07:49:31.278716+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:49:31.278716+0000","last_undegraded":"2024-09-21T07:49:31.278716+0000","last_fullsized":"2024-09-21T07:49:31.278716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246587+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:49:31.246587+0000","last_peered":"2024-09-21T07:49:31.246587+0000","last_clean":"2024-09-21T07:49:31.246587+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:49:31.246587+0000","last_undegraded":"2024-09-21T07:49:31.246587+0000","last_fullsized":"2024-09-21T07:49:31.246587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163160+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:49:31.163160+0000","last_peered":"2024-09-21T07:49:31.163160+0000","last_clean":"2024-09-21T07:49:31.163160+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:49:31.163160+0000","last_undegraded":"2024-09-21T07:49:31.163160+0000","last_fullsized":"2024-09-21T07:49:31.163160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243779+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:49:31.243779+0000","last_peered":"2024-09-21T07:49:31.243779+0000","last_clean":"2024-09-21T07:49:31.243779+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:49:31.243779+0000","last_undegraded":"2024-09-21T07:49:31.243779+0000","last_fullsized":"2024-09-21T07:49:31.243779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243987+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:49:31.243987+0000","last_peered":"2024-09-21T07:49:31.243987+0000","last_clean":"2024-09-21T07:49:31.243987+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:49:31.243987+0000","last_undegraded":"2024-09-21T07:49:31.243987+0000","last_fullsized":"2024-09-21T07:49:31.243987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162036+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:49:31.162036+0000","last_peered":"2024-09-21T07:49:31.162036+0000","last_clean":"2024-09-21T07:49:31.162036+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:49:31.162036+0000","last_undegraded":"2024-09-21T07:49:31.162036+0000","last_fullsized":"2024-09-21T07:49:31.162036+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278182+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:49:31.278182+0000","last_peered":"2024-09-21T07:49:31.278182+0000","last_clean":"2024-09-21T07:49:31.278182+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:49:31.278182+0000","last_undegraded":"2024-09-21T07:49:31.278182+0000","last_fullsized":"2024-09-21T07:49:31.278182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243511+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:49:31.243511+0000","last_peered":"2024-09-21T07:49:31.243511+0000","last_clean":"2024-09-21T07:49:31.243511+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:49:31.243511+0000","last_undegraded":"2024-09-21T07:49:31.243511+0000","last_fullsized":"2024-09-21T07:49:31.243511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243370+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:49:31.243370+0000","last_peered":"2024-09-21T07:49:31.243370+0000","last_clean":"2024-09-21T07:49:31.243370+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:49:31.243370+0000","last_undegraded":"2024-09-21T07:49:31.243370+0000","last_fullsized":"2024-09-21T07:49:31.243370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162146+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:49:31.162146+0000","last_peered":"2024-09-21T07:49:31.162146+0000","last_clean":"2024-09-21T07:49:31.162146+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:49:31.162146+0000","last_undegraded":"2024-09-21T07:49:31.162146+0000","last_fullsized":"2024-09-21T07:49:31.162146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163148+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:49:31.163148+0000","last_peered":"2024-09-21T07:49:31.163148+0000","last_clean":"2024-09-21T07:49:31.163148+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:49:31.163148+0000","last_undegraded":"2024-09-21T07:49:31.163148+0000","last_fullsized":"2024-09-21T07:49:31.163148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278877+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:49:31.278877+0000","last_peered":"2024-09-21T07:49:31.278877+0000","last_clean":"2024-09-21T07:49:31.278877+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:49:31.278877+0000","last_undegraded":"2024-09-21T07:49:31.278877+0000","last_fullsized":"2024-09-21T07:49:31.278877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279041+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:49:31.279041+0000","last_peered":"2024-09-21T07:49:31.279041+0000","last_clean":"2024-09-21T07:49:31.279041+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:49:31.279041+0000","last_undegraded":"2024-09-21T07:49:31.279041+0000","last_fullsized":"2024-09-21T07:49:31.279041+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158985+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:49:31.158985+0000","last_peered":"2024-09-21T07:49:31.158985+0000","last_clean":"2024-09-21T07:49:31.158985+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:49:31.158985+0000","last_undegraded":"2024-09-21T07:49:31.158985+0000","last_fullsized":"2024-09-21T07:49:31.158985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74001,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":636,"num_read_kb":399,"num_write":249,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":222003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1040384,"data_stored":526779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906985,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37036,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708116,"statfs":{"total":95995035648,"available":95957110784,"internally_reserved":0,"allocated":1728512,"data_stored":1179351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070512,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1056768,"data_stored":529764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266742,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1044480,"data_stored":525464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36960,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708192,"statfs":{"total":95995035648,"available":95957188608,"internally_reserved":0,"allocated":1646592,"data_stored":1122543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626496,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":521172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1654784,"data_stored":1118125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":520880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1114112,"data_stored":589933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542236,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1101824,"data_stored":588999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705761,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":523019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:49:38.957 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:49:38.957 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:49:38.957 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:49:38.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T07:49:39.327 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:39.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:39 smithi084 ceph-mon[30411]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:49:39.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:39 smithi162 ceph-mon[34833]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:49:39.555 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:39 smithi191 ceph-mon[34667]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.977+0000 7fa864800640 1 -- 172.21.15.84:0/3255485090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c1049d0 msgr2=0x7fa85c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.977+0000 7fa864800640 1 --2- 172.21.15.84:0/3255485090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c1049d0 0x7fa85c104de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa850009900 tx=0x7fa85002a410 comp rx=0 tx=0).stop 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.977+0000 7fa864800640 1 -- 172.21.15.84:0/3255485090 shutdown_connections 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.977+0000 7fa864800640 1 --2- 172.21.15.84:0/3255485090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa85c10de30 0x7fa85c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.978+0000 7fa864800640 1 --2- 172.21.15.84:0/3255485090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa85c105320 0x7fa85c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.978+0000 7fa864800640 1 --2- 172.21.15.84:0/3255485090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c1049d0 0x7fa85c104de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.978+0000 7fa864800640 1 -- 172.21.15.84:0/3255485090 >> 172.21.15.84:0/3255485090 conn(0x7fa85c079740 msgr2=0x7fa85c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.978+0000 7fa864800640 1 -- 172.21.15.84:0/3255485090 shutdown_connections 2024-09-21T07:49:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.978+0000 7fa864800640 1 -- 172.21.15.84:0/3255485090 wait complete. 2024-09-21T07:49:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.979+0000 7fa864800640 1 Processor -- start 2024-09-21T07:49:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.979+0000 7fa864800640 1 -- start start 2024-09-21T07:49:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa864800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa85c1049d0 0x7fa85c102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa864800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa85c105320 0x7fa85c102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa864800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c10de30 0x7fa85c103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa864800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c113b00 con 0x7fa85c1049d0 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa864800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c113980 con 0x7fa85c10de30 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa864800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c113c80 con 0x7fa85c105320 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa85c1049d0 0x7fa85c102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa85c105320 0x7fa85c102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa85c1049d0 0x7fa85c102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40506/0 (socket says 172.21.15.84:40506) 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861e00640 1 -- 172.21.15.84:0/2139960833 learned_addr learned my addr 172.21.15.84:0/2139960833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa862800640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c10de30 0x7fa85c103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861400640 1 -- 172.21.15.84:0/2139960833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c10de30 msgr2=0x7fa85c103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861400640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c10de30 0x7fa85c103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861400640 1 -- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa85c1049d0 msgr2=0x7fa85c102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.980+0000 7fa861400640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa85c1049d0 0x7fa85c102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.981+0000 7fa861400640 1 -- 172.21.15.84:0/2139960833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c1a87d0 con 0x7fa85c105320 2024-09-21T07:49:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.981+0000 7fa861400640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa85c105320 0x7fa85c102c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa85c06b950 tx=0x7fa84c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.981+0000 7fa856a00640 1 -- 172.21.15.84:0/2139960833 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00cd00 con 0x7fa85c105320 2024-09-21T07:49:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.981+0000 7fa856a00640 1 -- 172.21.15.84:0/2139960833 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa84c0035f0 con 0x7fa85c105320 2024-09-21T07:49:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.981+0000 7fa856a00640 1 -- 172.21.15.84:0/2139960833 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c010690 con 0x7fa85c105320 2024-09-21T07:49:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.981+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85c1a8ac0 con 0x7fa85c105320 2024-09-21T07:49:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.981+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85c1a8fb0 con 0x7fa85c105320 2024-09-21T07:49:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.982+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85c06c240 con 0x7fa85c105320 2024-09-21T07:49:39.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.985+0000 7fa856a00640 1 -- 172.21.15.84:0/2139960833 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fa84c0037a0 con 0x7fa85c105320 2024-09-21T07:49:39.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.986+0000 7fa856a00640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8440b6670 0x7fa8440b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:39.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.987+0000 7fa856a00640 1 -- 172.21.15.84:0/2139960833 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa84c0e7c70 con 0x7fa85c105320 2024-09-21T07:49:39.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.987+0000 7fa861e00640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8440b6670 0x7fa8440b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:39.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.988+0000 7fa861e00640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8440b6670 0x7fa8440b8b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa850006010 tx=0x7fa850005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:39.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:39.988+0000 7fa856a00640 1 -- 172.21.15.84:0/2139960833 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa84c0adfa0 con 0x7fa85c105320 2024-09-21T07:49:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.231+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa85c104de0 con 0x7fa85c105320 2024-09-21T07:49:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.232+0000 7fa856a00640 1 -- 172.21.15.84:0/2139960833 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa85c104de0 con 0x7fa85c105320 2024-09-21T07:49:40.234 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:40.234 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8440b6670 msgr2=0x7fa8440b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8440b6670 0x7fa8440b8b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa850006010 tx=0x7fa850005a20 comp rx=0 tx=0).stop 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa85c105320 msgr2=0x7fa85c102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa85c105320 0x7fa85c102c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa85c06b950 tx=0x7fa84c00ee50 comp rx=0 tx=0).stop 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 shutdown_connections 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8440b6670 0x7fa8440b8b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa85c10de30 0x7fa85c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa85c105320 0x7fa85c102c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 --2- 172.21.15.84:0/2139960833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa85c1049d0 0x7fa85c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 >> 172.21.15.84:0/2139960833 conn(0x7fa85c079740 msgr2=0x7fa85c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 shutdown_connections 2024-09-21T07:49:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:40.235+0000 7fa864800640 1 -- 172.21.15.84:0/2139960833 wait complete. 2024-09-21T07:49:40.374 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:49:40.374 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:40.374 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:40 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:40.375 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:40 smithi191 ceph-mon[34667]: pgmap v351: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s 2024-09-21T07:49:40.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:49:40.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:40.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:40 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:40.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:40 smithi162 ceph-mon[34833]: pgmap v351: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s 2024-09-21T07:49:40.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:49:40.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:40.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:40 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:40.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:40 smithi084 ceph-mon[30411]: pgmap v351: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 8 op/s 2024-09-21T07:49:40.975 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:49:40.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:49:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:41 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2139960833' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:49:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:41 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2139960833' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:49:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:41 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2139960833' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:49:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.385+0000 7f3af6a00640 1 -- 172.21.15.84:0/3183681747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 msgr2=0x7f3af01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.385+0000 7f3af6a00640 1 --2- 172.21.15.84:0/3183681747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af01098c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009860 tx=0x7f3adc02a340 comp rx=0 tx=0).stop 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.385+0000 7f3af6a00640 1 -- 172.21.15.84:0/3183681747 shutdown_connections 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.385+0000 7f3af6a00640 1 --2- 172.21.15.84:0/3183681747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3af0109e00 0x7f3af0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.386+0000 7f3af6a00640 1 --2- 172.21.15.84:0/3183681747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af01098c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.386+0000 7f3af6a00640 1 --2- 172.21.15.84:0/3183681747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3af0103b70 0x7f3af0103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.386+0000 7f3af6a00640 1 -- 172.21.15.84:0/3183681747 >> 172.21.15.84:0/3183681747 conn(0x7f3af00ff5e0 msgr2=0x7f3af0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.386+0000 7f3af6a00640 1 -- 172.21.15.84:0/3183681747 shutdown_connections 2024-09-21T07:49:42.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.386+0000 7f3af6a00640 1 -- 172.21.15.84:0/3183681747 wait complete. 2024-09-21T07:49:42.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.387+0000 7f3af6a00640 1 Processor -- start 2024-09-21T07:49:42.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.387+0000 7f3af6a00640 1 -- start start 2024-09-21T07:49:42.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.387+0000 7f3af6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3af0103b70 0x7f3af0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:42.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.387+0000 7f3af6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:42.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3af6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3af0109e00 0x7f3af0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:42.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3af6a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3af0113ac0 con 0x7f3af0109e00 2024-09-21T07:49:42.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3af6a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3af0113940 con 0x7f3af01094b0 2024-09-21T07:49:42.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3af6a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3af0113c40 con 0x7f3af0103b70 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3af4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3af0109e00 0x7f3af0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58826/0 (socket says 172.21.15.84:58826) 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 -- 172.21.15.84:0/1400863794 learned_addr learned my addr 172.21.15.84:0/1400863794 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aefe00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3af0103b70 0x7f3af0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 -- 172.21.15.84:0/1400863794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3af0103b70 msgr2=0x7f3af0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3af0103b70 0x7f3af0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 -- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3af0109e00 msgr2=0x7f3af0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3af0109e00 0x7f3af0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aef400640 1 -- 172.21.15.84:0/1400863794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af01a8790 con 0x7f3af01094b0 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.388+0000 7f3aefe00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3af0103b70 0x7f3af0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.389+0000 7f3aef400640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af0075c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3adc035040 tx=0x7f3adc032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.389+0000 7f3aecc00640 1 -- 172.21.15.84:0/1400863794 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc037040 con 0x7f3af01094b0 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.389+0000 7f3aecc00640 1 -- 172.21.15.84:0/1400863794 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3adc030c10 con 0x7f3af01094b0 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.389+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af01a8a20 con 0x7f3af01094b0 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.389+0000 7f3aecc00640 1 -- 172.21.15.84:0/1400863794 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0035f0 con 0x7f3af01094b0 2024-09-21T07:49:42.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.389+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af01a8ef0 con 0x7f3af01094b0 2024-09-21T07:49:42.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.391+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af0103f80 con 0x7f3af01094b0 2024-09-21T07:49:42.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.393+0000 7f3aecc00640 1 -- 172.21.15.84:0/1400863794 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f3adc043020 con 0x7f3af01094b0 2024-09-21T07:49:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.394+0000 7f3aecc00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ad40b6670 0x7f3ad40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.394+0000 7f3aecc00640 1 -- 172.21.15.84:0/1400863794 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3adc106a80 con 0x7f3af01094b0 2024-09-21T07:49:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.394+0000 7f3aefe00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ad40b6670 0x7f3ad40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:42.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.395+0000 7f3aefe00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ad40b6670 0x7f3ad40b8b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3af0077160 tx=0x7f3ae0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:42.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.398+0000 7f3aecc00640 1 -- 172.21.15.84:0/1400863794 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3adc108e20 con 0x7f3af01094b0 2024-09-21T07:49:42.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:42 smithi162 ceph-mon[34833]: pgmap v352: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:42.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:42 smithi084 ceph-mon[30411]: pgmap v352: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:42.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:42 smithi191 ceph-mon[34667]: pgmap v352: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:42.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.653+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3af002e640 con 0x7f3af01094b0 2024-09-21T07:49:42.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.655+0000 7f3aecc00640 1 -- 172.21.15.84:0/1400863794 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11993 (secure 0 0 0) 0x7f3adc04a060 con 0x7f3af01094b0 2024-09-21T07:49:42.657 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:42.657 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"btime":"2024-09-21T07:48:35:141169+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:48:35.141139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24746,24742,24724,24719,24712]},"id":1}]} 2024-09-21T07:49:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-09-21T07:49:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ad40b6670 msgr2=0x7f3ad40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ad40b6670 0x7f3ad40b8b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3af0077160 tx=0x7f3ae0005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 msgr2=0x7f3af0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af0075c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3adc035040 tx=0x7f3adc032d50 comp rx=0 tx=0).stop 2024-09-21T07:49:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 shutdown_connections 2024-09-21T07:49:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ad40b6670 0x7f3ad40b8b80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3af0109e00 0x7f3af0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af01094b0 0x7f3af0075c50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 --2- 172.21.15.84:0/1400863794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3af0103b70 0x7f3af0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 >> 172.21.15.84:0/1400863794 conn(0x7f3af00ff5e0 msgr2=0x7f3af0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.657+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 shutdown_connections 2024-09-21T07:49:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:42.658+0000 7f3af6a00640 1 -- 172.21.15.84:0/1400863794 wait complete. 2024-09-21T07:49:43.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:43 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1400863794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:43.459 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:49:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:43 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1400863794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:43.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:43 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1400863794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 -- 172.21.15.84:0/3801874252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181092f0 msgr2=0x7f5618109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:44.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 --2- 172.21.15.84:0/3801874252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181092f0 0x7f5618109700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5604009900 tx=0x7f560402a410 comp rx=0 tx=0).stop 2024-09-21T07:49:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 -- 172.21.15.84:0/3801874252 shutdown_connections 2024-09-21T07:49:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 --2- 172.21.15.84:0/3801874252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5618109c40 0x7f5618110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 --2- 172.21.15.84:0/3801874252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181092f0 0x7f5618109700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 --2- 172.21.15.84:0/3801874252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56181039b0 0x7f5618103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 -- 172.21.15.84:0/3801874252 >> 172.21.15.84:0/3801874252 conn(0x7f56180ff440 msgr2=0x7f5618101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 -- 172.21.15.84:0/3801874252 shutdown_connections 2024-09-21T07:49:44.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.511+0000 7f561e600640 1 -- 172.21.15.84:0/3801874252 wait complete. 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.512+0000 7f561e600640 1 Processor -- start 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.512+0000 7f561e600640 1 -- start start 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181039b0 0x7f561819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561e600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56181092f0 0x7f561819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5618109c40 0x7f561819fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561e600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5618113900 con 0x7f56181039b0 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5618113780 con 0x7f5618109c40 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561e600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5618113a80 con 0x7f56181092f0 2024-09-21T07:49:44.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181039b0 0x7f561819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181039b0 0x7f561819a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40542/0 (socket says 172.21.15.84:40542) 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 -- 172.21.15.84:0/4218429644 learned_addr learned my addr 172.21.15.84:0/4218429644 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f5617e00640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56181092f0 0x7f561819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 -- 172.21.15.84:0/4218429644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56181092f0 msgr2=0x7f561819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56181092f0 0x7f561819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 -- 172.21.15.84:0/4218429644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5618109c40 msgr2=0x7f561819fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5618109c40 0x7f561819fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.513+0000 7f561d200640 1 -- 172.21.15.84:0/4218429644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56181a0280 con 0x7f56181039b0 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.514+0000 7f561d200640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181039b0 0x7f561819a310 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f560c00e9f0 tx=0x7f560c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.514+0000 7f5615600640 1 -- 172.21.15.84:0/4218429644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c00cd80 con 0x7f56181039b0 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.514+0000 7f5615600640 1 -- 172.21.15.84:0/4218429644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f560c0054d0 con 0x7f56181039b0 2024-09-21T07:49:44.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.514+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56181a0570 con 0x7f56181039b0 2024-09-21T07:49:44.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.514+0000 7f5615600640 1 -- 172.21.15.84:0/4218429644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c010690 con 0x7f56181039b0 2024-09-21T07:49:44.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.514+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56181a6cd0 con 0x7f56181039b0 2024-09-21T07:49:44.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.516+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5618103dc0 con 0x7f56181039b0 2024-09-21T07:49:44.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.518+0000 7f5615600640 1 -- 172.21.15.84:0/4218429644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f560c004e90 con 0x7f56181039b0 2024-09-21T07:49:44.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.520+0000 7f5615600640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f56000b65f0 0x7f56000b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:44.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.521+0000 7f5615600640 1 -- 172.21.15.84:0/4218429644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f560c0e7e10 con 0x7f56181039b0 2024-09-21T07:49:44.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.521+0000 7f5617e00640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f56000b65f0 0x7f56000b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:44.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.521+0000 7f5617e00640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f56000b65f0 0x7f56000b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5604009230 tx=0x7f5604031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:44.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.525+0000 7f5615600640 1 -- 172.21.15.84:0/4218429644 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f560c0eb030 con 0x7f56181039b0 2024-09-21T07:49:44.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:44.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:44.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:44 smithi084 ceph-mon[30411]: pgmap v353: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:44.623 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:49:44.623 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:49:44.623 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:44 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:44.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.761+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f561819b440 con 0x7f56181039b0 2024-09-21T07:49:44.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.761+0000 7f5615600640 1 -- 172.21.15.84:0/4218429644 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11993 (secure 0 0 0) 0x7f560c0ae0b0 con 0x7f56181039b0 2024-09-21T07:49:44.764 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:44.764 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"btime":"2024-09-21T07:48:35:141169+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:48:35.141139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24746,24742,24724,24719,24712]},"id":1}]} 2024-09-21T07:49:44.764 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f56000b65f0 msgr2=0x7f56000b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f56000b65f0 0x7f56000b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5604009230 tx=0x7f5604031400 comp rx=0 tx=0).stop 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181039b0 msgr2=0x7f561819a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181039b0 0x7f561819a310 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f560c00e9f0 tx=0x7f560c00edf0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 shutdown_connections 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f56000b65f0 0x7f56000b8b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5618109c40 0x7f561819fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56181092f0 0x7f561819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 --2- 172.21.15.84:0/4218429644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56181039b0 0x7f561819a310 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 >> 172.21.15.84:0/4218429644 conn(0x7f56180ff440 msgr2=0x7f5618101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 shutdown_connections 2024-09-21T07:49:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:44.764+0000 7f561e600640 1 -- 172.21.15.84:0/4218429644 wait complete. 2024-09-21T07:49:44.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:44.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:44.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:44 smithi191 ceph-mon[34667]: pgmap v353: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:44.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:49:44.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:49:44.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:44 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:44 smithi162 ceph-mon[34833]: pgmap v353: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:49:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:49:45.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:44 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:49:45.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:49:45.883 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:45.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:45 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4218429644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:46.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:45 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4218429644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:45 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4218429644' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 -- 172.21.15.84:0/3901814330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 msgr2=0x7f4e0c116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 --2- 172.21.15.84:0/3901814330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c116b60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009ca0 tx=0x7f4e0402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 -- 172.21.15.84:0/3901814330 shutdown_connections 2024-09-21T07:49:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 --2- 172.21.15.84:0/3901814330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c116b60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 --2- 172.21.15.84:0/3901814330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c078290 0x7f4e0c114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 --2- 172.21.15.84:0/3901814330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e0c077940 0x7f4e0c077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 -- 172.21.15.84:0/3901814330 >> 172.21.15.84:0/3901814330 conn(0x7f4e0c101810 msgr2=0x7f4e0c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 -- 172.21.15.84:0/3901814330 shutdown_connections 2024-09-21T07:49:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.524+0000 7f4e11600640 1 -- 172.21.15.84:0/3901814330 wait complete. 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.525+0000 7f4e11600640 1 Processor -- start 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.525+0000 7f4e11600640 1 -- start start 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e11600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c077940 0x7f4e0c1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e11600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e0c078290 0x7f4e0c1a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e11600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c1a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e11600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c11a0c0 con 0x7f4e0c114740 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e11600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c119f40 con 0x7f4e0c077940 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e11600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c11a240 con 0x7f4e0c078290 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c1a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c1a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40562/0 (socket says 172.21.15.84:40562) 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 -- 172.21.15.84:0/1499011748 learned_addr learned my addr 172.21.15.84:0/1499011748 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0aa00640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c077940 0x7f4e0c1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e02000640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e0c078290 0x7f4e0c1a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 -- 172.21.15.84:0/1499011748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e0c078290 msgr2=0x7f4e0c1a1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e0c078290 0x7f4e0c1a1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 -- 172.21.15.84:0/1499011748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c077940 msgr2=0x7f4e0c1a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c077940 0x7f4e0c1a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0b400640 1 -- 172.21.15.84:0/1499011748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c1a69e0 con 0x7f4e0c114740 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e02000640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e0c078290 0x7f4e0c1a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.526+0000 7f4e0aa00640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c077940 0x7f4e0c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.527+0000 7f4e0b400640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c1a62b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e040098d0 tx=0x7f4e040317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.527+0000 7f4e03e00640 1 -- 172.21.15.84:0/1499011748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04003b70 con 0x7f4e0c114740 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.527+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c1a6c70 con 0x7f4e0c114740 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.527+0000 7f4e03e00640 1 -- 172.21.15.84:0/1499011748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e04003d10 con 0x7f4e0c114740 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.527+0000 7f4e03e00640 1 -- 172.21.15.84:0/1499011748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0402fa20 con 0x7f4e0c114740 2024-09-21T07:49:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.527+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c1ad430 con 0x7f4e0c114740 2024-09-21T07:49:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.528+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c077d50 con 0x7f4e0c114740 2024-09-21T07:49:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.531+0000 7f4e03e00640 1 -- 172.21.15.84:0/1499011748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4e0402fc20 con 0x7f4e0c114740 2024-09-21T07:49:46.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.532+0000 7f4e03e00640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4df00b6670 0x7f4df00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:46.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.532+0000 7f4e03e00640 1 -- 172.21.15.84:0/1499011748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4e04108ea0 con 0x7f4e0c114740 2024-09-21T07:49:46.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.533+0000 7f4e0aa00640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4df00b6670 0x7f4df00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.533+0000 7f4e0aa00640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4df00b6670 0x7f4df00b8b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0058c0 tx=0x7f4dfc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:46.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.534+0000 7f4e03e00640 1 -- 172.21.15.84:0/1499011748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e040393b0 con 0x7f4e0c114740 2024-09-21T07:49:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.721+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e0c1a1ba0 con 0x7f4e0c114740 2024-09-21T07:49:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.722+0000 7f4e03e00640 1 -- 172.21.15.84:0/1499011748 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+25144 (secure 0 0 0) 0x7f4e0c1a1ba0 con 0x7f4e0c114740 2024-09-21T07:49:46.725 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:46.725 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:49:31.146906+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4df00b6670 msgr2=0x7f4df00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4df00b6670 0x7f4df00b8b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0058c0 tx=0x7f4dfc005850 comp rx=0 tx=0).stop 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 msgr2=0x7f4e0c1a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c1a62b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e040098d0 tx=0x7f4e040317b0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 shutdown_connections 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4df00b6670 0x7f4df00b8b80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e0c114740 0x7f4e0c1a62b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e0c078290 0x7f4e0c1a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 --2- 172.21.15.84:0/1499011748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c077940 0x7f4e0c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 >> 172.21.15.84:0/1499011748 conn(0x7f4e0c101810 msgr2=0x7f4e0c116760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 shutdown_connections 2024-09-21T07:49:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:46.725+0000 7f4e11600640 1 -- 172.21.15.84:0/1499011748 wait complete. 2024-09-21T07:49:46.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:46 smithi191 ceph-mon[34667]: pgmap v354: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:47.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:46 smithi162 ceph-mon[34833]: pgmap v354: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:47.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:46 smithi084 ceph-mon[30411]: pgmap v354: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:47.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:49:47.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:47 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1499011748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:47.869 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:47.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:47 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1499011748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:47 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1499011748' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:49:48.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 -- 172.21.15.84:0/1544436990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 msgr2=0x7f5ab0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1544436990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab0103f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009900 tx=0x7f5aa002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 -- 172.21.15.84:0/1544436990 shutdown_connections 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1544436990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab0109e10 0x7f5ab0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1544436990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab01094c0 0x7f5ab01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1544436990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab0103f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 -- 172.21.15.84:0/1544436990 >> 172.21.15.84:0/1544436990 conn(0x7f5ab00ff590 msgr2=0x7f5ab01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 -- 172.21.15.84:0/1544436990 shutdown_connections 2024-09-21T07:49:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.507+0000 7f5ab6200640 1 -- 172.21.15.84:0/1544436990 wait complete. 2024-09-21T07:49:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.508+0000 7f5ab6200640 1 Processor -- start 2024-09-21T07:49:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5ab6200640 1 -- start start 2024-09-21T07:49:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5ab6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5ab6200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab01094c0 0x7f5ab019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5ab6200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0109e10 0x7f5ab01a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5ab6200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0113ad0 con 0x7f5ab01094c0 2024-09-21T07:49:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5ab6200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0113950 con 0x7f5ab0103b80 2024-09-21T07:49:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5ab6200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0113c50 con 0x7f5ab0109e10 2024-09-21T07:49:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5aaf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5aaea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab01094c0 0x7f5ab019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5aaf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab019c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42232/0 (socket says 172.21.15.84:42232) 2024-09-21T07:49:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.509+0000 7f5aaf400640 1 -- 172.21.15.84:0/1943999655 learned_addr learned my addr 172.21.15.84:0/1943999655 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aafe00640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0109e10 0x7f5ab01a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aaf400640 1 -- 172.21.15.84:0/1943999655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0109e10 msgr2=0x7f5ab01a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aaf400640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0109e10 0x7f5ab01a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aaf400640 1 -- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab01094c0 msgr2=0x7f5ab019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aaf400640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab01094c0 0x7f5ab019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aaf400640 1 -- 172.21.15.84:0/1943999655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab01a26f0 con 0x7f5ab0103b80 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aafe00640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0109e10 0x7f5ab01a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.510+0000 7f5aaf400640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab019c780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005940 tx=0x7f5aa00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.511+0000 7f5aa7e00640 1 -- 172.21.15.84:0/1943999655 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa003f030 con 0x7f5ab0103b80 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.511+0000 7f5aa7e00640 1 -- 172.21.15.84:0/1943999655 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa00044c0 con 0x7f5ab0103b80 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.511+0000 7f5aa7e00640 1 -- 172.21.15.84:0/1943999655 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0035070 con 0x7f5ab0103b80 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.511+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab01a2980 con 0x7f5ab0103b80 2024-09-21T07:49:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.511+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab01a9140 con 0x7f5ab0103b80 2024-09-21T07:49:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.512+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab0104e00 con 0x7f5ab0103b80 2024-09-21T07:49:48.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.515+0000 7f5aa7e00640 1 -- 172.21.15.84:0/1943999655 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f5aa0042030 con 0x7f5ab0103b80 2024-09-21T07:49:48.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.516+0000 7f5aa7e00640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a940b65f0 0x7f5a940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:48.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.517+0000 7f5aa7e00640 1 -- 172.21.15.84:0/1943999655 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5aa0107fa0 con 0x7f5ab0103b80 2024-09-21T07:49:48.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.517+0000 7f5aaea00640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a940b65f0 0x7f5a940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:48.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.518+0000 7f5aaea00640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a940b65f0 0x7f5a940b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0108ce0 tx=0x7f5a9c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:48.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.518+0000 7f5aa7e00640 1 -- 172.21.15.84:0/1943999655 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5aa00ce240 con 0x7f5ab0103b80 2024-09-21T07:49:48.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:48 smithi084 ceph-mon[30411]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:48.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.759+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ab0103f90 con 0x7f5ab0103b80 2024-09-21T07:49:48.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.760+0000 7f5aa7e00640 1 -- 172.21.15.84:0/1943999655 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11993 (secure 0 0 0) 0x7f5ab0103f90 con 0x7f5ab0103b80 2024-09-21T07:49:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:49:48.763 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"btime":"2024-09-21T07:48:35:141169+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:48:35.141139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24746,24742,24724,24719,24712]},"id":1}]} 2024-09-21T07:49:48.764 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a940b65f0 msgr2=0x7f5a940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a940b65f0 0x7f5a940b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0108ce0 tx=0x7f5a9c005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 msgr2=0x7f5ab019c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab019c780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005940 tx=0x7f5aa00040c0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 shutdown_connections 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a940b65f0 0x7f5a940b8b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0109e10 0x7f5ab01a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ab01094c0 0x7f5ab019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 --2- 172.21.15.84:0/1943999655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab0103b80 0x7f5ab019c780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:48.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 >> 172.21.15.84:0/1943999655 conn(0x7f5ab00ff590 msgr2=0x7f5ab0102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:48.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 shutdown_connections 2024-09-21T07:49:48.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:48.763+0000 7f5ab6200640 1 -- 172.21.15.84:0/1943999655 wait complete. 2024-09-21T07:49:48.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:48 smithi191 ceph-mon[34667]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:49.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:48 smithi162 ceph-mon[34833]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:49.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:47:41.706708+0000', 'modified': '2024-09-21T07:48:35.141139+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24746, 'mds_1': 24742, 'mds_2': 24724, 'mds_3': 24719, 'mds_4': 24712}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14757': {'gid': 14757, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6841/1397513983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6840', 'nonce': 1397513983}, {'type': 'v1', 'addr': '172.21.15.84:6841', 'nonce': 1397513983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24662': {'gid': 24662, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6833/1671465182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1671465182}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1671465182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2170041322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2170041322}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2170041322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2049364491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2049364491}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2049364491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24697': {'gid': 24697, 'name': 'd', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6837/1436382958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1436382958}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1436382958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24712': {'gid': 24712, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.191:6835/1369621448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 1369621448}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 1369621448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24719': {'gid': 24719, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.162:6837/1733531268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 1733531268}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 1733531268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24724': {'gid': 24724, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.191:6837/2311233520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 2311233520}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2311233520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24742': {'gid': 24742, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.191:6839/2322343723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2322343723}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2322343723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24746': {'gid': 24746, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.162:6839/3948328826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 3948328826}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 3948328826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24746, 'qdb_cluster': [24746, 24742, 24724, 24719, 24712]} 2024-09-21T07:49:49.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:49:49.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T07:49:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1943999655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:49.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1943999655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:50.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1943999655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:49:50.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 -- 172.21.15.84:0/3882040634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 msgr2=0x7f2d34106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 --2- 172.21.15.84:0/3882040634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d34106190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009900 tx=0x7f2d2802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 -- 172.21.15.84:0/3882040634 shutdown_connections 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 --2- 172.21.15.84:0/3882040634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3410c010 0x7f2d34112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 --2- 172.21.15.84:0/3882040634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d3410b6c0 0x7f2d3410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 --2- 172.21.15.84:0/3882040634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d34106190 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 -- 172.21.15.84:0/3882040634 >> 172.21.15.84:0/3882040634 conn(0x7f2d34101810 msgr2=0x7f2d34103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 -- 172.21.15.84:0/3882040634 shutdown_connections 2024-09-21T07:49:50.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.513+0000 7f2d3c600640 1 -- 172.21.15.84:0/3882040634 wait complete. 2024-09-21T07:49:50.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.514+0000 7f2d3c600640 1 Processor -- start 2024-09-21T07:49:50.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.514+0000 7f2d3c600640 1 -- start start 2024-09-21T07:49:50.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d3419c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3c600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d3410b6c0 0x7f2d3419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3c600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3410c010 0x7f2d341a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34115d20 con 0x7f2d34105d80 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3c600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34115ba0 con 0x7f2d3410c010 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3c600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34115ea0 con 0x7f2d3410b6c0 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d3419c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d3419c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56626/0 (socket says 172.21.15.84:56626) 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 -- 172.21.15.84:0/2062694975 learned_addr learned my addr 172.21.15.84:0/2062694975 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39200640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d3410b6c0 0x7f2d3419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3a600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3410c010 0x7f2d341a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 -- 172.21.15.84:0/2062694975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d3410b6c0 msgr2=0x7f2d3419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d3410b6c0 0x7f2d3419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 -- 172.21.15.84:0/2062694975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3410c010 msgr2=0x7f2d341a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3410c010 0x7f2d341a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d39c00640 1 -- 172.21.15.84:0/2062694975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d341a26e0 con 0x7f2d34105d80 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.515+0000 7f2d3a600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3410c010 0x7f2d341a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:50.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.516+0000 7f2d39c00640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d3419c770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d28005ab0 tx=0x7f2d28003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:50.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.516+0000 7f2d32000640 1 -- 172.21.15.84:0/2062694975 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2803f070 con 0x7f2d34105d80 2024-09-21T07:49:50.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.516+0000 7f2d32000640 1 -- 172.21.15.84:0/2062694975 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d28031d60 con 0x7f2d34105d80 2024-09-21T07:49:50.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.516+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d341a2970 con 0x7f2d34105d80 2024-09-21T07:49:50.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.516+0000 7f2d32000640 1 -- 172.21.15.84:0/2062694975 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28035030 con 0x7f2d34105d80 2024-09-21T07:49:50.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.516+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d341a9130 con 0x7f2d34105d80 2024-09-21T07:49:50.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.520+0000 7f2d432b2740 1 Processor -- start 2024-09-21T07:49:50.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.520+0000 7f2d432b2740 1 -- start start 2024-09-21T07:49:50.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d432b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d318d50 con 0x55ac1cffaf60 2024-09-21T07:49:50.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d432b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d308180 con 0x55ac1cfd20a0 2024-09-21T07:49:50.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d432b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d30bf90 con 0x55ac1cfda280 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56640/0 (socket says 172.21.15.84:56640) 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d3a600640 1 -- 172.21.15.84:0/2341985878 learned_addr learned my addr 172.21.15.84:0/2341985878 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d39200640 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.521+0000 7f2d32000640 1 -- 172.21.15.84:0/2062694975 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2d28042070 con 0x7f2d34105d80 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.522+0000 7f2d3a600640 1 -- 172.21.15.84:0/2341985878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 msgr2=0x55ac1d3a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.522+0000 7f2d3a600640 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.522+0000 7f2d3a600640 1 -- 172.21.15.84:0/2341985878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfd20a0 msgr2=0x55ac1d3a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.522+0000 7f2d3a600640 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.522+0000 7f2d3a600640 1 -- 172.21.15.84:0/2341985878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1d2d2a70 con 0x55ac1cffaf60 2024-09-21T07:49:50.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.522+0000 7f2d3a600640 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a1490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009fd0 tx=0x7f2d2c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30516e0ba313965 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:50.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.523+0000 7f2d26a00640 1 -- 172.21.15.84:0/2341985878 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c015070 con 0x55ac1cffaf60 2024-09-21T07:49:50.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.523+0000 7f2d26a00640 1 -- 172.21.15.84:0/2341985878 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d2c011bb0 con 0x55ac1cffaf60 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.523+0000 7f2d26a00640 1 -- 172.21.15.84:0/2341985878 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c010c20 con 0x55ac1cffaf60 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.523+0000 7f2d32000640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2d1c0b6670 0x7f2d1c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.523+0000 7f2d432b2740 1 -- 172.21.15.84:0/2341985878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 msgr2=0x55ac1d3a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.523+0000 7f2d432b2740 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a1490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009fd0 tx=0x7f2d2c00f7f0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 -- 172.21.15.84:0/2341985878 shutdown_connections 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 --2- 172.21.15.84:0/2341985878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a1490 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 -- 172.21.15.84:0/2341985878 >> 172.21.15.84:0/2341985878 conn(0x55ac1cfef350 msgr2=0x55ac1d39f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d32000640 1 -- 172.21.15.84:0/2062694975 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2d28108290 con 0x7f2d34105d80 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 -- 172.21.15.84:0/2341985878 shutdown_connections 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d39c00640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2d1c0b6670 0x7f2d1c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 -- 172.21.15.84:0/2341985878 wait complete. 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d432b2740 1 -- start start 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.524+0000 7f2d39c00640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2d1c0b6670 0x7f2d1c0b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d28031f50 tx=0x7f2d28031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 1 Processor -- start 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfda280 0x55ac1d3ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d1695f0 con 0x55ac1cfda280 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d2a3460 con 0x55ac1cffaf60 2024-09-21T07:49:50.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d3afc70 con 0x55ac1cfd20a0 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.525+0000 7f2d432b2740 10 client.0 _ll_register_callbacks cb 0x55ac1d2b3210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d39200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfda280 0x55ac1d3ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36674/0 (socket says 172.21.15.84:36674) 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d3a600640 1 -- 172.21.15.84:0/1464738197 learned_addr learned my addr 172.21.15.84:0/1464738197 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d3a600640 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d39200640 1 -- 172.21.15.84:0/1464738197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 msgr2=0x55ac1d3ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d39200640 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d39200640 1 -- 172.21.15.84:0/1464738197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 msgr2=0x55ac1d3b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d39200640 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d39200640 1 -- 172.21.15.84:0/1464738197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1d066540 con 0x55ac1cfda280 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d39200640 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfda280 0x55ac1d3ad590 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406c810 tx=0x7f2d2000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0f183721c27776 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.526+0000 7f2d1b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.527+0000 7f2d1b400640 1 -- 172.21.15.84:0/1464738197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20003d90 con 0x55ac1cfda280 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.527+0000 7f2d1b400640 1 -- 172.21.15.84:0/1464738197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2d20005020 con 0x55ac1cfda280 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.527+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ac1d2a5a70 con 0x55ac1cfda280 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.527+0000 7f2d1b400640 1 -- 172.21.15.84:0/1464738197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d20024050 con 0x55ac1cfda280 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.527+0000 7f2d432b2740 10 client.15207 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.527+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ac1d2c06f0 con 0x55ac1cfda280 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.527+0000 7f2d1b400640 1 -- 172.21.15.84:0/1464738197 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ac1d2a5a70 con 0x55ac1cfda280 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d1b400640 1 -- 172.21.15.84:0/1464738197 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2d2001b470 con 0x55ac1cfda280 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d432b2740 10 client.15207 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d432b2740 10 client.15207 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d432b2740 20 client.15207 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d432b2740 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cfb98e0 0x55ac1d3bf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d432b2740 4 client.15207 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:49:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac1d31aca0 con 0x55ac1cfb98e0 2024-09-21T07:49:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.528+0000 7f2d3a600640 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cfb98e0 0x55ac1d3bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.529+0000 7f2d3a600640 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cfb98e0 0x55ac1d3bf610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3411f3103c926cfb server_cookie=dc25e29705ea36f4 in_seq=0 out_seq=0 2024-09-21T07:49:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.529+0000 7f2d1b400640 10 client.15207 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d1b400640 1 -- 172.21.15.84:0/1464738197 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac1d31aca0 con 0x55ac1cfb98e0 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d1b400640 10 client.15207 handle_command_reply: tid=0 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 client.15207 shutdown 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfda280 msgr2=0x55ac1d3ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfda280 0x55ac1d3ad590 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406c810 tx=0x7f2d2000bf30 comp rx=0 tx=0).stop 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 shutdown_connections 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cfb98e0 0x55ac1d3bf610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfda280 0x55ac1d3ad590 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 --2- 172.21.15.84:0/1464738197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d1b400640 0 client.15207 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:49:50.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 >> 172.21.15.84:0/1464738197 conn(0x55ac1cfef350 msgr2=0x55ac1d3a4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:50.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 shutdown_connections 2024-09-21T07:49:50.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 1 -- 172.21.15.84:0/1464738197 wait complete. 2024-09-21T07:49:50.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.530+0000 7f2d432b2740 20 client.15207 trim_cache size 0 max 16384 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 Processor -- start 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 -- start start 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d3bd950 con 0x55ac1cfd20a0 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d3be020 con 0x55ac1cffaf60 2024-09-21T07:49:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.549+0000 7f2d432b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d3be6f0 con 0x55ac1cfda280 2024-09-21T07:49:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3be1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56648/0 (socket says 172.21.15.84:56648) 2024-09-21T07:49:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 -- 172.21.15.84:0/4169290582 learned_addr learned my addr 172.21.15.84:0/4169290582 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d39200640 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 -- 172.21.15.84:0/4169290582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 msgr2=0x55ac1d3a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 -- 172.21.15.84:0/4169290582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 msgr2=0x55ac1d3a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 -- 172.21.15.84:0/4169290582 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1d3a3780 con 0x55ac1cfd20a0 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.550+0000 7f2d3a600640 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3be1a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00fcf0 tx=0x7f2d2c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed283ac223cbd3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.551+0000 7f2d26000640 1 -- 172.21.15.84:0/4169290582 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c015040 con 0x55ac1cfd20a0 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.551+0000 7f2d26000640 1 -- 172.21.15.84:0/4169290582 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d2c010d80 con 0x55ac1cfd20a0 2024-09-21T07:49:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.551+0000 7f2d26000640 1 -- 172.21.15.84:0/4169290582 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0054b0 con 0x55ac1cfd20a0 2024-09-21T07:49:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.551+0000 7f2d432b2740 1 -- 172.21.15.84:0/4169290582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfd20a0 msgr2=0x55ac1d3be1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.551+0000 7f2d432b2740 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3be1a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00fcf0 tx=0x7f2d2c00f7f0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 -- 172.21.15.84:0/4169290582 shutdown_connections 2024-09-21T07:49:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cffaf60 0x55ac1d3a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfda280 0x55ac1d3a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 --2- 172.21.15.84:0/4169290582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3be1a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 -- 172.21.15.84:0/4169290582 >> 172.21.15.84:0/4169290582 conn(0x55ac1cfef350 msgr2=0x55ac1d39ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 -- 172.21.15.84:0/4169290582 shutdown_connections 2024-09-21T07:49:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 -- 172.21.15.84:0/4169290582 wait complete. 2024-09-21T07:49:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 -- start start 2024-09-21T07:49:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.552+0000 7f2d432b2740 1 Processor -- start 2024-09-21T07:49:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfda280 0x55ac1d3c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d432b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d432b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d3bf490 con 0x55ac1cffaf60 2024-09-21T07:49:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d432b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d3bedc0 con 0x55ac1cfda280 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d432b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ac1d3bfb60 con 0x55ac1cfd20a0 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d432b2740 10 client.0 _ll_register_callbacks cb 0x7f2d20004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d3a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56650/0 (socket says 172.21.15.84:56650) 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d3a600640 1 -- 172.21.15.84:0/3252162805 learned_addr learned my addr 172.21.15.84:0/3252162805 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.553+0000 7f2d39200640 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfda280 0x55ac1d3c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d3a600640 1 -- 172.21.15.84:0/3252162805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 msgr2=0x55ac1d3c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d3a600640 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d3a600640 1 -- 172.21.15.84:0/3252162805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfda280 msgr2=0x55ac1d3c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d3a600640 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfda280 0x55ac1d3c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d3a600640 1 -- 172.21.15.84:0/3252162805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1d3c7c90 con 0x55ac1cffaf60 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d3a600640 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3c7650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c006010 tx=0x7f2d2c005150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92102b747f3fac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d1b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:49:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d1b400640 1 -- 172.21.15.84:0/3252162805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c015030 con 0x55ac1cffaf60 2024-09-21T07:49:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d1b400640 1 -- 172.21.15.84:0/3252162805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2d2c005430 con 0x55ac1cffaf60 2024-09-21T07:49:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d2c010d80 con 0x55ac1cffaf60 2024-09-21T07:49:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.554+0000 7f2d1b400640 1 -- 172.21.15.84:0/3252162805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d2c034040 con 0x55ac1cffaf60 2024-09-21T07:49:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 10 client.15213 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ac1d42b3a0 con 0x55ac1cffaf60 2024-09-21T07:49:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d1b400640 1 -- 172.21.15.84:0/3252162805 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d2c010d80 con 0x55ac1cffaf60 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d1b400640 1 -- 172.21.15.84:0/3252162805 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2d2c03a070 con 0x55ac1cffaf60 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 10 client.15213 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 10 client.15213 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 20 client.15213 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cf8ec90 0x55ac1d42e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 4 client.15213 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "status"}) -- 0x55ac1d316750 con 0x55ac1cf8ec90 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.555+0000 7f2d39200640 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cf8ec90 0x55ac1d42e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.556+0000 7f2d39200640 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cf8ec90 0x55ac1d42e500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a513ffc2f3d1e6 server_cookie=b43a379ee34d3705 in_seq=0 out_seq=0 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.556+0000 7f2d1b400640 10 client.15213 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.556+0000 7f2d1b400640 1 -- 172.21.15.84:0/3252162805 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ac1d316750 con 0x55ac1cf8ec90 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.556+0000 7f2d1b400640 10 client.15213 handle_command_reply: tid=0 2024-09-21T07:49:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.556+0000 7f2d432b2740 1 client.15213 shutdown 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.556+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 msgr2=0x55ac1d3c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.556+0000 7f2d432b2740 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3c7650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c006010 tx=0x7f2d2c005150 comp rx=0 tx=0).stop 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 shutdown_connections 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55ac1cf8ec90 0x55ac1d42e500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac1cffaf60 0x55ac1d3c7650 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ac1cfda280 0x55ac1d3c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 --2- 172.21.15.84:0/3252162805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ac1cfd20a0 0x55ac1d3c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 >> 172.21.15.84:0/3252162805 conn(0x55ac1cfef350 msgr2=0x55ac1d3ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d1b400640 0 client.15213 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 shutdown_connections 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 1 -- 172.21.15.84:0/3252162805 wait complete. 2024-09-21T07:49:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d432b2740 20 client.15213 trim_cache size 0 max 16384 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 4, 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24712, 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 76.420692388999996, 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:49:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 159.37906160099999 2024-09-21T07:49:50.563 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:49:50.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2d1c0b6670 msgr2=0x7f2d1c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d3c600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2d1c0b6670 0x7f2d1c0b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d28031f50 tx=0x7f2d28031400 comp rx=0 tx=0).stop 2024-09-21T07:49:50.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 msgr2=0x7f2d3419c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.557+0000 7f2d3c600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d3419c770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d28005ab0 tx=0x7f2d28003cd0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 shutdown_connections 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2d1c0b6670 0x7f2d1c0b8b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d3410c010 0x7f2d341a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d3410b6c0 0x7f2d3419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 --2- 172.21.15.84:0/2062694975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d34105d80 0x7f2d3419c770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 >> 172.21.15.84:0/2062694975 conn(0x7f2d34101810 msgr2=0x7f2d34103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 shutdown_connections 2024-09-21T07:49:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:50.558+0000 7f2d3c600640 1 -- 172.21.15.84:0/2062694975 wait complete. 2024-09-21T07:49:50.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:50 smithi084 ceph-mon[30411]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:51.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:50 smithi162 ceph-mon[34833]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:51.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:50 smithi191 ceph-mon[34667]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:49:51.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T07:49:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:52.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 -- 172.21.15.84:0/776295760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244078290 msgr2=0x7fc244114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 --2- 172.21.15.84:0/776295760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244078290 0x7fc244114200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc230009900 tx=0x7fc23002a410 comp rx=0 tx=0).stop 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 -- 172.21.15.84:0/776295760 shutdown_connections 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 --2- 172.21.15.84:0/776295760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc244114740 0x7fc244116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 --2- 172.21.15.84:0/776295760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244078290 0x7fc244114200 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 --2- 172.21.15.84:0/776295760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc244077940 0x7fc244077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 -- 172.21.15.84:0/776295760 >> 172.21.15.84:0/776295760 conn(0x7fc244101810 msgr2=0x7fc244103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 -- 172.21.15.84:0/776295760 shutdown_connections 2024-09-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.255+0000 7fc24b000640 1 -- 172.21.15.84:0/776295760 wait complete. 2024-09-21T07:49:52.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 Processor -- start 2024-09-21T07:49:52.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 -- start start 2024-09-21T07:49:52.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc244077940 0x7fc2441a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc244078290 0x7fc2441a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244114740 0x7fc2441a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc24411a0e0 con 0x7fc244114740 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc244119f60 con 0x7fc244078290 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.257+0000 7fc24b000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc24411a260 con 0x7fc244077940 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc249000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244114740 0x7fc2441a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc244078290 0x7fc2441a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc249000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244114740 0x7fc2441a6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56674/0 (socket says 172.21.15.84:56674) 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc244078290 0x7fc2441a10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42282/0 (socket says 172.21.15.84:42282) 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc249000640 1 -- 172.21.15.84:0/3016024527 learned_addr learned my addr 172.21.15.84:0/3016024527 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc244077940 0x7fc2441a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243e00640 1 -- 172.21.15.84:0/3016024527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc244078290 msgr2=0x7fc2441a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243e00640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc244078290 0x7fc2441a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243e00640 1 -- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244114740 msgr2=0x7fc2441a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243e00640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244114740 0x7fc2441a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243e00640 1 -- 172.21.15.84:0/3016024527 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2441a6ac0 con 0x7fc244077940 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.258+0000 7fc243e00640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc244077940 0x7fc2441a0b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc234005fd0 tx=0x7fc23400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.259+0000 7fc240c00640 1 -- 172.21.15.84:0/3016024527 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234009c30 con 0x7fc244077940 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.259+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2441a6db0 con 0x7fc244077940 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.259+0000 7fc240c00640 1 -- 172.21.15.84:0/3016024527 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc234009dd0 con 0x7fc244077940 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.259+0000 7fc240c00640 1 -- 172.21.15.84:0/3016024527 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234003e20 con 0x7fc244077940 2024-09-21T07:49:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.259+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2441ad510 con 0x7fc244077940 2024-09-21T07:49:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 Processor -- start 2024-09-21T07:49:52.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 -- start start 2024-09-21T07:49:52.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a8bf60 0x558380e32490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a630a0 0x558380e329d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a6b280 0x558380e32f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558380da9d50 con 0x558380a6b280 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558380d99180 con 0x558380a630a0 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.262+0000 7fc251be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558380d9cf90 con 0x558380a8bf60 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc240c00640 1 -- 172.21.15.84:0/3016024527 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc234003fe0 con 0x7fc244077940 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a8bf60 0x558380e32490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a8bf60 0x558380e32490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36718/0 (socket says 172.21.15.84:36718) 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 -- 172.21.15.84:0/3793740162 learned_addr learned my addr 172.21.15.84:0/3793740162 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc243400640 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a6b280 0x558380e32f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc243e00640 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a630a0 0x558380e329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 -- 172.21.15.84:0/3793740162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a630a0 msgr2=0x558380e329d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a630a0 0x558380e329d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 -- 172.21.15.84:0/3793740162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a6b280 msgr2=0x558380e32f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a6b280 0x558380e32f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.263+0000 7fc249000640 1 -- 172.21.15.84:0/3793740162 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558380d63a70 con 0x558380a8bf60 2024-09-21T07:49:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.264+0000 7fc249000640 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a8bf60 0x558380e32490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc23c011470 tx=0x7fc23c011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a9264d51811ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.264+0000 7fc239600640 1 -- 172.21.15.84:0/3793740162 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c004b20 con 0x558380a8bf60 2024-09-21T07:49:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.264+0000 7fc239600640 1 -- 172.21.15.84:0/3793740162 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc23c004cc0 con 0x558380a8bf60 2024-09-21T07:49:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.264+0000 7fc239600640 1 -- 172.21.15.84:0/3793740162 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c005310 con 0x558380a8bf60 2024-09-21T07:49:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc240c00640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2280b6670 0x7fc2280b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 -- 172.21.15.84:0/3793740162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a8bf60 msgr2=0x558380e32490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a8bf60 0x558380e32490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc23c011470 tx=0x7fc23c011930 comp rx=0 tx=0).stop 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc240c00640 1 -- 172.21.15.84:0/3016024527 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc2340e73a0 con 0x7fc244077940 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc243e00640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2280b6670 0x7fc2280b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 -- 172.21.15.84:0/3793740162 shutdown_connections 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a6b280 0x558380e32f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a630a0 0x558380e329d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 --2- 172.21.15.84:0/3793740162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a8bf60 0x558380e32490 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 -- 172.21.15.84:0/3793740162 >> 172.21.15.84:0/3793740162 conn(0x558380a80350 msgr2=0x558380e30380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 -- 172.21.15.84:0/3793740162 shutdown_connections 2024-09-21T07:49:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.265+0000 7fc251be2740 1 -- 172.21.15.84:0/3793740162 wait complete. 2024-09-21T07:49:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.266+0000 7fc243e00640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2280b6670 0x7fc2280b8b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc2340e4930 tx=0x7fc2340cef90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.266+0000 7fc251be2740 1 -- start start 2024-09-21T07:49:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.266+0000 7fc251be2740 1 Processor -- start 2024-09-21T07:49:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.266+0000 7fc251be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e3df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.266+0000 7fc251be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e3e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc251be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc251be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558380bfa5f0 con 0x558380a630a0 2024-09-21T07:49:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc251be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558380d34460 con 0x558380a8bf60 2024-09-21T07:49:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc251be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558380e40c70 con 0x558380a6b280 2024-09-21T07:49:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc251be2740 10 client.0 _ll_register_callbacks cb 0x558380d44210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc249000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e3df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc249000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e3df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56684/0 (socket says 172.21.15.84:56684) 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc249000640 1 -- 172.21.15.84:0/735647156 learned_addr learned my addr 172.21.15.84:0/735647156 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc243400640 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e3e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc249000640 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc243400640 1 -- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 msgr2=0x558380e49f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc243400640 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc243400640 1 -- 172.21.15.84:0/735647156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 msgr2=0x558380e3df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc243400640 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e3df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.267+0000 7fc243400640 1 -- 172.21.15.84:0/735647156 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558380af7540 con 0x558380a6b280 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc243400640 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e3e4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc230009230 tx=0x7fc2300043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b7fcb0e57db88bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc22e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc22e000640 1 -- 172.21.15.84:0/735647156 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230035040 con 0x558380a6b280 2024-09-21T07:49:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558380d36a70 con 0x558380a6b280 2024-09-21T07:49:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc22e000640 1 -- 172.21.15.84:0/735647156 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc230005450 con 0x558380a6b280 2024-09-21T07:49:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc22e000640 1 -- 172.21.15.84:0/735647156 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc230005650 con 0x558380a6b280 2024-09-21T07:49:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc251be2740 10 client.25222 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.268+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558380d516f0 con 0x558380a6b280 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc22e000640 1 -- 172.21.15.84:0/735647156 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558380d36a70 con 0x558380a6b280 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc22e000640 1 -- 172.21.15.84:0/735647156 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc2300039d0 con 0x558380a6b280 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc251be2740 10 client.25222 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc251be2740 10 client.25222 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc251be2740 20 client.25222 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc251be2740 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a4a8e0 0x558380e50410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc251be2740 4 client.25222 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.269+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558380dabca0 con 0x558380a4a8e0 2024-09-21T07:49:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.270+0000 7fc249000640 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a4a8e0 0x558380e50410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.270+0000 7fc249000640 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a4a8e0 0x558380e50410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=73dae24fff161a35 server_cookie=3a163bdd2b106569 in_seq=0 out_seq=0 2024-09-21T07:49:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.270+0000 7fc22e000640 10 client.25222 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:49:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.271+0000 7fc22e000640 1 -- 172.21.15.84:0/735647156 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558380dabca0 con 0x558380a4a8e0 2024-09-21T07:49:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.271+0000 7fc22e000640 10 client.25222 handle_command_reply: tid=0 2024-09-21T07:49:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.271+0000 7fc251be2740 1 client.25222 shutdown 2024-09-21T07:49:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 msgr2=0x558380e3e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e3e4c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc230009230 tx=0x7fc2300043d0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 shutdown_connections 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a4a8e0 0x558380e50410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e3e4c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 --2- 172.21.15.84:0/735647156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e3df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 >> 172.21.15.84:0/735647156 conn(0x558380a80350 msgr2=0x558380e35620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc22e000640 0 client.25222 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 shutdown_connections 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 1 -- 172.21.15.84:0/735647156 wait complete. 2024-09-21T07:49:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.272+0000 7fc251be2740 20 client.25222 trim_cache size 0 max 16384 2024-09-21T07:49:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 Processor -- start 2024-09-21T07:49:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 -- start start 2024-09-21T07:49:52.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e50410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e2b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558380e4e750 con 0x558380a630a0 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558380e4ee20 con 0x558380a8bf60 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc251be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558380e4f4f0 con 0x558380a6b280 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc249000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e50410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc243400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e2b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc243400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e2b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36736/0 (socket says 172.21.15.84:36736) 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.292+0000 7fc243400640 1 -- 172.21.15.84:0/3239201381 learned_addr learned my addr 172.21.15.84:0/3239201381 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc249000640 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc243400640 1 -- 172.21.15.84:0/3239201381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 msgr2=0x558380e49ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc243400640 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc243400640 1 -- 172.21.15.84:0/3239201381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 msgr2=0x558380e50410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc243400640 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e50410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc243400640 1 -- 172.21.15.84:0/3239201381 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558380e4e580 con 0x558380a6b280 2024-09-21T07:49:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc249000640 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e50410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc243400640 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e2b010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc230006010 tx=0x7fc230009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b3c4240d5531970 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.293+0000 7fc238c00640 1 -- 172.21.15.84:0/3239201381 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230058070 con 0x558380a6b280 2024-09-21T07:49:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc238c00640 1 -- 172.21.15.84:0/3239201381 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc230041070 con 0x558380a6b280 2024-09-21T07:49:52.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc238c00640 1 -- 172.21.15.84:0/3239201381 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230035030 con 0x558380a6b280 2024-09-21T07:49:52.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc251be2740 1 -- 172.21.15.84:0/3239201381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 msgr2=0x558380e2b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc251be2740 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e2b010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc230006010 tx=0x7fc230009260 comp rx=0 tx=0).stop 2024-09-21T07:49:52.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc251be2740 1 -- 172.21.15.84:0/3239201381 shutdown_connections 2024-09-21T07:49:52.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc251be2740 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a8bf60 0x558380e49ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc251be2740 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a6b280 0x558380e2b010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc251be2740 1 --2- 172.21.15.84:0/3239201381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a630a0 0x558380e50410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.294+0000 7fc251be2740 1 -- 172.21.15.84:0/3239201381 >> 172.21.15.84:0/3239201381 conn(0x558380a80350 msgr2=0x558380e3c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.295+0000 7fc251be2740 1 -- 172.21.15.84:0/3239201381 shutdown_connections 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.295+0000 7fc251be2740 1 -- 172.21.15.84:0/3239201381 wait complete. 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.295+0000 7fc251be2740 1 -- start start 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.295+0000 7fc251be2740 1 Processor -- start 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc251be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a630a0 0x558380e56680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc251be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a6b280 0x558380e56c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc251be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a8bf60 0x558380e51d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc251be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558380e50290 con 0x558380a8bf60 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc251be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558380e4fbc0 con 0x558380a6b280 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc251be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558380e50960 con 0x558380a630a0 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc251be2740 10 client.0 _ll_register_callbacks cb 0x7fc230005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc249000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a8bf60 0x558380e51d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc249000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a8bf60 0x558380e51d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56700/0 (socket says 172.21.15.84:56700) 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc249000640 1 -- 172.21.15.84:0/1837954645 learned_addr learned my addr 172.21.15.84:0/1837954645 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc243400640 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a6b280 0x558380e56c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.296+0000 7fc249000640 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a630a0 0x558380e56680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc243400640 1 -- 172.21.15.84:0/1837954645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a630a0 msgr2=0x558380e56680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc243400640 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a630a0 0x558380e56680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc243400640 1 -- 172.21.15.84:0/1837954645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a8bf60 msgr2=0x558380e51d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc243400640 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a8bf60 0x558380e51d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc243400640 1 -- 172.21.15.84:0/1837954645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558380e52400 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc243400640 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a6b280 0x558380e56c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x558380e51490 tx=0x7fc2300058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668376c467c893b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc22e000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc22e000640 1 -- 172.21.15.84:0/1837954645 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230035070 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc230041070 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.297+0000 7fc22e000640 1 -- 172.21.15.84:0/1837954645 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc230031be0 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc22e000640 1 -- 172.21.15.84:0/1837954645 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc230058040 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 10 client.25208 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558380e57e00 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc22e000640 1 -- 172.21.15.84:0/1837954645 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc230041070 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc22e000640 1 -- 172.21.15.84:0/1837954645 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc23005b070 con 0x558380a6b280 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 10 client.25208 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:52.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 10 client.25208 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 20 client.25208 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a1fc90 0x558380ebe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 4 client.25208 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.298+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "status"}) -- 0x558380da7750 con 0x558380a1fc90 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.299+0000 7fc249000640 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a1fc90 0x558380ebe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.299+0000 7fc249000640 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a1fc90 0x558380ebe7a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e5dbcab6ea47fbd0 server_cookie=d29f540e6a15203a in_seq=0 out_seq=0 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.299+0000 7fc22e000640 10 client.25208 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.299+0000 7fc22e000640 1 -- 172.21.15.84:0/1837954645 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558380da7750 con 0x558380a1fc90 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.299+0000 7fc22e000640 10 client.25208 handle_command_reply: tid=0 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.299+0000 7fc251be2740 1 client.25208 shutdown 2024-09-21T07:49:52.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a6b280 msgr2=0x558380e56c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a6b280 0x558380e56c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x558380e51490 tx=0x7fc2300058d0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 shutdown_connections 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558380a1fc90 0x558380ebe7a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558380a8bf60 0x558380e51d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558380a6b280 0x558380e56c60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 --2- 172.21.15.84:0/1837954645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558380a630a0 0x558380e56680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc22e000640 0 client.25208 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 >> 172.21.15.84:0/1837954645 conn(0x558380a80350 msgr2=0x558380e2fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 shutdown_connections 2024-09-21T07:49:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 1 -- 172.21.15.84:0/1837954645 wait complete. 2024-09-21T07:49:52.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.300+0000 7fc251be2740 20 client.25208 trim_cache size 0 max 16384 2024-09-21T07:49:52.308 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:49:52.308 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:49:52.308 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 3, 2024-09-21T07:49:52.308 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24719, 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 79.177449577000004, 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 155.80021826699999 2024-09-21T07:49:52.309 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:49:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2280b6670 msgr2=0x7fc2280b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2280b6670 0x7fc2280b8b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc2340e4930 tx=0x7fc2340cef90 comp rx=0 tx=0).stop 2024-09-21T07:49:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc244077940 msgr2=0x7fc2441a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc244077940 0x7fc2441a0b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc234005fd0 tx=0x7fc23400dde0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 shutdown_connections 2024-09-21T07:49:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2280b6670 0x7fc2280b8b80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc244114740 0x7fc2441a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc244078290 0x7fc2441a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 --2- 172.21.15.84:0/3016024527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc244077940 0x7fc2441a0b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 >> 172.21.15.84:0/3016024527 conn(0x7fc244101810 msgr2=0x7fc244116790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 shutdown_connections 2024-09-21T07:49:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:52.301+0000 7fc24b000640 1 -- 172.21.15.84:0/3016024527 wait complete. 2024-09-21T07:49:53.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:49:53.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:53 smithi084 ceph-mon[30411]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:49:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:53 smithi191 ceph-mon[34667]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:49:53.453 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:53.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:53 smithi162 ceph-mon[34833]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:49:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 -- 172.21.15.84:0/520363304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 msgr2=0x7f6a74106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 --2- 172.21.15.84:0/520363304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a74106190 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009900 tx=0x7f6a6402a410 comp rx=0 tx=0).stop 2024-09-21T07:49:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 -- 172.21.15.84:0/520363304 shutdown_connections 2024-09-21T07:49:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 --2- 172.21.15.84:0/520363304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a7410c010 0x7f6a74112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 --2- 172.21.15.84:0/520363304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7410b6c0 0x7f6a7410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 --2- 172.21.15.84:0/520363304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a74106190 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 -- 172.21.15.84:0/520363304 >> 172.21.15.84:0/520363304 conn(0x7f6a741017f0 msgr2=0x7f6a74103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 -- 172.21.15.84:0/520363304 shutdown_connections 2024-09-21T07:49:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.079+0000 7f6a79600640 1 -- 172.21.15.84:0/520363304 wait complete. 2024-09-21T07:49:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.080+0000 7f6a79600640 1 Processor -- start 2024-09-21T07:49:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.080+0000 7f6a79600640 1 -- start start 2024-09-21T07:49:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a79600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a7419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a79600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7410b6c0 0x7f6a7419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a79600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a7410c010 0x7f6a741a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a79600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74115d20 con 0x7f6a74105d80 2024-09-21T07:49:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a79600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74115ba0 con 0x7f6a7410c010 2024-09-21T07:49:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a79600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74115ea0 con 0x7f6a7410b6c0 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a7419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a7419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56720/0 (socket says 172.21.15.84:56720) 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 -- 172.21.15.84:0/3706868951 learned_addr learned my addr 172.21.15.84:0/3706868951 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a6a000640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7410b6c0 0x7f6a7419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a73400640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a7410c010 0x7f6a741a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 -- 172.21.15.84:0/3706868951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7410b6c0 msgr2=0x7f6a7419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7410b6c0 0x7f6a7419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 -- 172.21.15.84:0/3706868951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a7410c010 msgr2=0x7f6a741a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a7410c010 0x7f6a741a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.081+0000 7f6a72a00640 1 -- 172.21.15.84:0/3706868951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a741a2620 con 0x7f6a74105d80 2024-09-21T07:49:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.082+0000 7f6a72a00640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a7419c6b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a64005ab0 tx=0x7f6a64003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.082+0000 7f6a6be00640 1 -- 172.21.15.84:0/3706868951 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6403f070 con 0x7f6a74105d80 2024-09-21T07:49:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.082+0000 7f6a6be00640 1 -- 172.21.15.84:0/3706868951 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a64031d60 con 0x7f6a74105d80 2024-09-21T07:49:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.082+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a741a28b0 con 0x7f6a74105d80 2024-09-21T07:49:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.082+0000 7f6a6be00640 1 -- 172.21.15.84:0/3706868951 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64035030 con 0x7f6a74105d80 2024-09-21T07:49:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.082+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a741a9070 con 0x7f6a74105d80 2024-09-21T07:49:54.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.085+0000 7f6a80262740 1 Processor -- start 2024-09-21T07:49:54.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a80262740 1 -- start start 2024-09-21T07:49:54.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a6be00640 1 -- 172.21.15.84:0/3706868951 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f6a64042070 con 0x7f6a74105d80 2024-09-21T07:49:54.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a80262740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f15490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a80262740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a80262740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a80262740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560459e8cd50 con 0x560459b460a0 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a80262740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560459e7c180 con 0x560459b6ef60 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a80262740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560459e7ff90 con 0x560459b4e280 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a73400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f15490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a73400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f15490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42364/0 (socket says 172.21.15.84:42364) 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a73400640 1 -- 172.21.15.84:0/2977828222 learned_addr learned my addr 172.21.15.84:0/2977828222 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.086+0000 7f6a72a00640 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a6a000640 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a73400640 1 -- 172.21.15.84:0/2977828222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 msgr2=0x560459f15f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a73400640 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f15f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a73400640 1 -- 172.21.15.84:0/2977828222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 msgr2=0x560459f159d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a73400640 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f159d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a73400640 1 -- 172.21.15.84:0/2977828222 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560459e46a70 con 0x560459b6ef60 2024-09-21T07:49:54.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a72a00640 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:54.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.087+0000 7f6a73400640 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f15490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009fd0 tx=0x7f6a6c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2099073d3af0f35e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:54.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.088+0000 7f6a63400640 1 -- 172.21.15.84:0/2977828222 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c004d20 con 0x560459b6ef60 2024-09-21T07:49:54.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.088+0000 7f6a63400640 1 -- 172.21.15.84:0/2977828222 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a6c004050 con 0x560459b6ef60 2024-09-21T07:49:54.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.088+0000 7f6a63400640 1 -- 172.21.15.84:0/2977828222 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c005280 con 0x560459b6ef60 2024-09-21T07:49:54.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.088+0000 7f6a6be00640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6a580b6670 0x7f6a580b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a72a00640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6a580b6670 0x7f6a580b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a6be00640 1 -- 172.21.15.84:0/3706868951 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6a641080b0 con 0x7f6a74105d80 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 -- 172.21.15.84:0/2977828222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 msgr2=0x560459f15490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f15490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009fd0 tx=0x7f6a6c0118d0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 -- 172.21.15.84:0/2977828222 shutdown_connections 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f15f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 --2- 172.21.15.84:0/2977828222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f15490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 -- 172.21.15.84:0/2977828222 >> 172.21.15.84:0/2977828222 conn(0x560459b63350 msgr2=0x560459f13380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 -- 172.21.15.84:0/2977828222 shutdown_connections 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a80262740 1 -- 172.21.15.84:0/2977828222 wait complete. 2024-09-21T07:49:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.089+0000 7f6a72a00640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6a580b6670 0x7f6a580b8b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a640ca2d0 tx=0x7f6a64009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.090+0000 7f6a80262740 1 -- start start 2024-09-21T07:49:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.090+0000 7f6a80262740 1 Processor -- start 2024-09-21T07:49:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a80262740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 0x560459f29f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a80262740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b4e280 0x560459f2a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a80262740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b6ef60 0x560459f2f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a80262740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560459cdd5f0 con 0x560459b6ef60 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a80262740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560459e17460 con 0x560459b4e280 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a80262740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560459f23c70 con 0x560459b460a0 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a80262740 10 client.0 _ll_register_callbacks cb 0x560459e27210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a73400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b6ef60 0x560459f2f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a73400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b6ef60 0x560459f2f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56738/0 (socket says 172.21.15.84:56738) 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a73400640 1 -- 172.21.15.84:0/3467246122 learned_addr learned my addr 172.21.15.84:0/3467246122 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a6a000640 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b4e280 0x560459f2a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.091+0000 7f6a73400640 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 0x560459f29f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a6a000640 1 -- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 msgr2=0x560459f29f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a6a000640 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 0x560459f29f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a6a000640 1 -- 172.21.15.84:0/3467246122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b6ef60 msgr2=0x560459f2f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a6a000640 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b6ef60 0x560459f2f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a6a000640 1 -- 172.21.15.84:0/3467246122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560459bda540 con 0x560459b4e280 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a6a000640 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b4e280 0x560459f2a500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a7406c7d0 tx=0x7f6a5c00bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9f47dfd9d28d57b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a57e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a57e00640 1 -- 172.21.15.84:0/3467246122 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c003d90 con 0x560459b4e280 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a57e00640 1 -- 172.21.15.84:0/3467246122 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6a5c005020 con 0x560459b4e280 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.092+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560459e19a70 con 0x560459b4e280 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.093+0000 7f6a57e00640 1 -- 172.21.15.84:0/3467246122 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a5c024050 con 0x560459b4e280 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.093+0000 7f6a80262740 10 client.25220 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.093+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560459e346f0 con 0x560459b4e280 2024-09-21T07:49:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.093+0000 7f6a57e00640 1 -- 172.21.15.84:0/3467246122 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560459e19a70 con 0x560459b4e280 2024-09-21T07:49:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a57e00640 1 -- 172.21.15.84:0/3467246122 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6a5c01b470 con 0x560459b4e280 2024-09-21T07:49:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a80262740 10 client.25220 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a80262740 10 client.25220 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:49:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a80262740 20 client.25220 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a80262740 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b2d8e0 0x560459f3bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a80262740 4 client.25220 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:49:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560459e8eca0 con 0x560459b2d8e0 2024-09-21T07:49:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.094+0000 7f6a73400640 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b2d8e0 0x560459f3bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.095+0000 7f6a73400640 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b2d8e0 0x560459f3bd50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa60069f6328448f server_cookie=d4673186342f8ebe in_seq=0 out_seq=0 2024-09-21T07:49:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.095+0000 7f6a57e00640 10 client.25220 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a57e00640 1 -- 172.21.15.84:0/3467246122 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560459e8eca0 con 0x560459b2d8e0 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a57e00640 10 client.25220 handle_command_reply: tid=0 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 client.25220 shutdown 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b4e280 msgr2=0x560459f2a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b4e280 0x560459f2a500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a7406c7d0 tx=0x7f6a5c00bf30 comp rx=0 tx=0).stop 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 shutdown_connections 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b2d8e0 0x560459f3bd50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b6ef60 0x560459f2f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b4e280 0x560459f2a500 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a57e00640 0 client.25220 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 --2- 172.21.15.84:0/3467246122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 0x560459f29f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.096+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 >> 172.21.15.84:0/3467246122 conn(0x560459b63350 msgr2=0x560459f18620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.097+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 shutdown_connections 2024-09-21T07:49:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.097+0000 7f6a80262740 1 -- 172.21.15.84:0/3467246122 wait complete. 2024-09-21T07:49:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.097+0000 7f6a80262740 20 client.25220 trim_cache size 0 max 16384 2024-09-21T07:49:54.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.115+0000 7f6a80262740 1 Processor -- start 2024-09-21T07:49:54.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.115+0000 7f6a80262740 1 -- start start 2024-09-21T07:49:54.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a80262740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 0x560459f0e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a80262740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b4e280 0x560459f285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a80262740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f28ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a80262740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560459f3a090 con 0x560459b4e280 2024-09-21T07:49:54.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a80262740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560459f3a760 con 0x560459b6ef60 2024-09-21T07:49:54.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a80262740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560459f3ae30 con 0x560459b460a0 2024-09-21T07:49:54.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a6a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b4e280 0x560459f285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a6a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b4e280 0x560459f285a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56740/0 (socket says 172.21.15.84:56740) 2024-09-21T07:49:54.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a6a000640 1 -- 172.21.15.84:0/2310747421 learned_addr learned my addr 172.21.15.84:0/2310747421 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:54.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a73400640 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f28ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a6a000640 1 -- 172.21.15.84:0/2310747421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 msgr2=0x560459f0e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.116+0000 7f6a6a000640 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 0x560459f0e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.117+0000 7f6a6a000640 1 -- 172.21.15.84:0/2310747421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 msgr2=0x560459f28ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.117+0000 7f6a6a000640 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f28ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.117+0000 7f6a6a000640 1 -- 172.21.15.84:0/2310747421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560459f195a0 con 0x560459b4e280 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.117+0000 7f6a6a000640 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b4e280 0x560459f285a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c004280 tx=0x7f6a5c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a8670f236c29e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.117+0000 7f6a62a00640 1 -- 172.21.15.84:0/2310747421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c02c020 con 0x560459b4e280 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.117+0000 7f6a62a00640 1 -- 172.21.15.84:0/2310747421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a5c003d90 con 0x560459b4e280 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.117+0000 7f6a62a00640 1 -- 172.21.15.84:0/2310747421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c01bb00 con 0x560459b4e280 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 -- 172.21.15.84:0/2310747421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b4e280 msgr2=0x560459f285a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b4e280 0x560459f285a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c004280 tx=0x7f6a5c005850 comp rx=0 tx=0).stop 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 -- 172.21.15.84:0/2310747421 shutdown_connections 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f28ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b4e280 0x560459f285a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 --2- 172.21.15.84:0/2310747421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b460a0 0x560459f0e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 -- 172.21.15.84:0/2310747421 >> 172.21.15.84:0/2310747421 conn(0x560459b63350 msgr2=0x560459f39770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:54.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 -- 172.21.15.84:0/2310747421 shutdown_connections 2024-09-21T07:49:54.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.118+0000 7f6a80262740 1 -- 172.21.15.84:0/2310747421 wait complete. 2024-09-21T07:49:54.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 -- start start 2024-09-21T07:49:54.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 Processor -- start 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f13170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f30040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f30580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560459f3bbd0 con 0x560459b460a0 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560459f3b500 con 0x560459b6ef60 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560459f3c2a0 con 0x560459b4e280 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.119+0000 7f6a80262740 10 client.0 _ll_register_callbacks cb 0x7f6a5c004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a73400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f13170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a73400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f13170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56750/0 (socket says 172.21.15.84:56750) 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a73400640 1 -- 172.21.15.84:0/96285541 learned_addr learned my addr 172.21.15.84:0/96285541 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a6a000640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f30040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a73400640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a6a000640 1 -- 172.21.15.84:0/96285541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 msgr2=0x560459f30580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a6a000640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f30580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a6a000640 1 -- 172.21.15.84:0/96285541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 msgr2=0x560459f13170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a6a000640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f13170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a6a000640 1 -- 172.21.15.84:0/96285541 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560459f13810 con 0x560459b4e280 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a73400640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f13170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a6a000640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f30040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00b3d0 tx=0x7f6a5c00b5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e70d044e731e099 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.120+0000 7f6a57e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a57e00640 1 -- 172.21.15.84:0/96285541 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c02c070 con 0x560459b4e280 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a5c003d90 con 0x560459b4e280 2024-09-21T07:49:54.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a57e00640 1 -- 172.21.15.84:0/96285541 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6a5c011440 con 0x560459b4e280 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a57e00640 1 -- 172.21.15.84:0/96285541 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a5c042050 con 0x560459b4e280 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a80262740 10 client.25243 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560459f35ad0 con 0x560459b4e280 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a57e00640 1 -- 172.21.15.84:0/96285541 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a5c003d90 con 0x560459b4e280 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a57e00640 1 -- 172.21.15.84:0/96285541 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6a5c028530 con 0x560459b4e280 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.121+0000 7f6a80262740 10 client.25243 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a80262740 10 client.25243 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a80262740 20 client.25243 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a80262740 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b02c90 0x560459faa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a80262740 4 client.25243 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "status"}) -- 0x560459e8a750 con 0x560459b02c90 2024-09-21T07:49:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a73400640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b02c90 0x560459faa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:54.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a73400640 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b02c90 0x560459faa060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8bd8db37e4df612e server_cookie=7bf968c176b513d8 in_seq=0 out_seq=0 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.122+0000 7f6a57e00640 10 client.25243 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a57e00640 1 -- 172.21.15.84:0/96285541 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560459e8a750 con 0x560459b02c90 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a57e00640 10 client.25243 handle_command_reply: tid=0 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 client.25243 shutdown 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 msgr2=0x560459f30040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f30040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00b3d0 tx=0x7f6a5c00b5b0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 shutdown_connections 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x560459b02c90 0x560459faa060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560459b6ef60 0x560459f30580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560459b4e280 0x560459f30040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 --2- 172.21.15.84:0/96285541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560459b460a0 0x560459f13170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a57e00640 0 client.25243 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:49:54.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 >> 172.21.15.84:0/96285541 conn(0x560459b63350 msgr2=0x560459f0e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 shutdown_connections 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 1 -- 172.21.15.84:0/96285541 wait complete. 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.123+0000 7f6a80262740 20 client.25243 trim_cache size 0 max 16384 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24724, 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:49:54.129 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:49:54.130 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 82.007088211999999, 2024-09-21T07:49:54.130 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:49:54.130 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:49:54.130 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:49:54.130 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 160.25825655599999 2024-09-21T07:49:54.130 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6a580b6670 msgr2=0x7f6a580b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6a580b6670 0x7f6a580b8b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a640ca2d0 tx=0x7f6a64009260 comp rx=0 tx=0).stop 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 msgr2=0x7f6a7419c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a7419c6b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a64005ab0 tx=0x7f6a64003c80 comp rx=0 tx=0).stop 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 shutdown_connections 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6a580b6670 0x7f6a580b8b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a7410c010 0x7f6a741a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7410b6c0 0x7f6a7419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 --2- 172.21.15.84:0/3706868951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a74105d80 0x7f6a7419c6b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 >> 172.21.15.84:0/3706868951 conn(0x7f6a741017f0 msgr2=0x7f6a74103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 shutdown_connections 2024-09-21T07:49:54.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:54.124+0000 7f6a79600640 1 -- 172.21.15.84:0/3706868951 wait complete. 2024-09-21T07:49:54.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:49:55.237 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:55.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:55 smithi084 ceph-mon[30411]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:55 smithi191 ceph-mon[34667]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:55.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:55 smithi162 ceph-mon[34833]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 -- 172.21.15.84:0/815750728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c105d90 msgr2=0x7fd40c1061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 --2- 172.21.15.84:0/815750728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c105d90 0x7fd40c1061a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009ca0 tx=0x7fd3fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 -- 172.21.15.84:0/815750728 shutdown_connections 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 --2- 172.21.15.84:0/815750728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd40c10c020 0x7fd40c112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 --2- 172.21.15.84:0/815750728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd40c10b6d0 0x7fd40c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 --2- 172.21.15.84:0/815750728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c105d90 0x7fd40c1061a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 -- 172.21.15.84:0/815750728 >> 172.21.15.84:0/815750728 conn(0x7fd40c1017c0 msgr2=0x7fd40c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 -- 172.21.15.84:0/815750728 shutdown_connections 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.847+0000 7fd411e00640 1 -- 172.21.15.84:0/815750728 wait complete. 2024-09-21T07:49:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.848+0000 7fd411e00640 1 Processor -- start 2024-09-21T07:49:55.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.848+0000 7fd411e00640 1 -- start start 2024-09-21T07:49:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.848+0000 7fd411e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd40c105d90 0x7fd40c19c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd411e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c10b6d0 0x7fd40c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd411e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd40c10c020 0x7fd40c1a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd411e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c115ce0 con 0x7fd40c10b6d0 2024-09-21T07:49:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd411e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c115b60 con 0x7fd40c10c020 2024-09-21T07:49:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd411e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c115e60 con 0x7fd40c105d90 2024-09-21T07:49:55.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c10b6d0 0x7fd40c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c10b6d0 0x7fd40c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56774/0 (socket says 172.21.15.84:56774) 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 -- 172.21.15.84:0/177808220 learned_addr learned my addr 172.21.15.84:0/177808220 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40aa00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd40c105d90 0x7fd40c19c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40b400640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd40c10c020 0x7fd40c1a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 -- 172.21.15.84:0/177808220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd40c105d90 msgr2=0x7fd40c19c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd40c105d90 0x7fd40c19c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 -- 172.21.15.84:0/177808220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd40c10c020 msgr2=0x7fd40c1a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd40c10c020 0x7fd40c1a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.849+0000 7fd40a000640 1 -- 172.21.15.84:0/177808220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c1a2720 con 0x7fd40c10b6d0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.850+0000 7fd40a000640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c10b6d0 0x7fd40c19cd50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400e9c0 tx=0x7fd3f400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.850+0000 7fd410a00640 1 -- 172.21.15.84:0/177808220 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400ccc0 con 0x7fd40c10b6d0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.850+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c1a2a10 con 0x7fd40c10b6d0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.850+0000 7fd410a00640 1 -- 172.21.15.84:0/177808220 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3f40054d0 con 0x7fd40c10b6d0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.850+0000 7fd410a00640 1 -- 172.21.15.84:0/177808220 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4010430 con 0x7fd40c10b6d0 2024-09-21T07:49:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.850+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c1a9170 con 0x7fd40c10b6d0 2024-09-21T07:49:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.853+0000 7fd418ab2740 1 Processor -- start 2024-09-21T07:49:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd418ab2740 1 -- start start 2024-09-21T07:49:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd410a00640 1 -- 172.21.15.84:0/177808220 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd3f4004f40 con 0x7fd40c10b6d0 2024-09-21T07:49:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7f98490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7f989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7f98f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd418ab2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5579d7f0fd50 con 0x5579d7bc90a0 2024-09-21T07:49:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd418ab2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5579d7eff180 con 0x5579d7bd1280 2024-09-21T07:49:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd418ab2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5579d7f02f90 con 0x5579d7bf1f60 2024-09-21T07:49:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd40aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7f989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd40aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7f989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56786/0 (socket says 172.21.15.84:56786) 2024-09-21T07:49:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd40aa00640 1 -- 172.21.15.84:0/2218672689 learned_addr learned my addr 172.21.15.84:0/2218672689 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd40b400640 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7f98490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.854+0000 7fd40a000640 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7f98f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd40aa00640 1 -- 172.21.15.84:0/2218672689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 msgr2=0x5579d7f98490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd40aa00640 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7f98490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd40aa00640 1 -- 172.21.15.84:0/2218672689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 msgr2=0x5579d7f98f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd40aa00640 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7f98f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd40aa00640 1 -- 172.21.15.84:0/2218672689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579d7ec9a70 con 0x5579d7bc90a0 2024-09-21T07:49:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd40b400640 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7f98490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd40aa00640 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7f989d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc035000 tx=0x7fd3fc0093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1daf9b8571910fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd410a00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3f00b6670 0x7fd3f00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.855+0000 7fd3fbe00640 1 -- 172.21.15.84:0/2218672689 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc031cf0 con 0x5579d7bc90a0 2024-09-21T07:49:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.856+0000 7fd3fbe00640 1 -- 172.21.15.84:0/2218672689 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3fc036030 con 0x5579d7bc90a0 2024-09-21T07:49:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.856+0000 7fd3fbe00640 1 -- 172.21.15.84:0/2218672689 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc004260 con 0x5579d7bc90a0 2024-09-21T07:49:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.856+0000 7fd410a00640 1 -- 172.21.15.84:0/177808220 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd3f40e7d00 con 0x7fd40c10b6d0 2024-09-21T07:49:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.856+0000 7fd40b400640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3f00b6670 0x7fd3f00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.856+0000 7fd418ab2740 1 -- 172.21.15.84:0/2218672689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 msgr2=0x5579d7f989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.856+0000 7fd40b400640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3f00b6670 0x7fd3f00b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd404009f00 tx=0x7fd404005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.856+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7f989d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc035000 tx=0x7fd3fc0093f0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 -- 172.21.15.84:0/2218672689 shutdown_connections 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7f98f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7f989d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2218672689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7f98490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 -- 172.21.15.84:0/2218672689 >> 172.21.15.84:0/2218672689 conn(0x5579d7be6350 msgr2=0x5579d7f96380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 -- 172.21.15.84:0/2218672689 shutdown_connections 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 -- 172.21.15.84:0/2218672689 wait complete. 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 -- start start 2024-09-21T07:49:55.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.857+0000 7fd418ab2740 1 Processor -- start 2024-09-21T07:49:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bc90a0 0x5579d7fa3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7fa4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fafdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd418ab2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5579d7d605f0 con 0x5579d7bd1280 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd418ab2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5579d7e9a460 con 0x5579d7bc90a0 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd418ab2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5579d7fa6a90 con 0x5579d7bf1f60 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd418ab2740 10 client.0 _ll_register_callbacks cb 0x5579d7eaa210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd40a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7fa4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd40a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7fa4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56788/0 (socket says 172.21.15.84:56788) 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd40a000640 1 -- 172.21.15.84:0/1038380979 learned_addr learned my addr 172.21.15.84:0/1038380979 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd40b400640 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fafdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.858+0000 7fd40aa00640 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bc90a0 0x5579d7fa3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd40a000640 1 -- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 msgr2=0x5579d7fafdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd40a000640 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fafdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd40a000640 1 -- 172.21.15.84:0/1038380979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bc90a0 msgr2=0x5579d7fa3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd40a000640 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bc90a0 0x5579d7fa3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd40a000640 1 -- 172.21.15.84:0/1038380979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579d7c5d540 con 0x5579d7bd1280 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd40a000640 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7fa4510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40aab50 tx=0x7fd3f40a9ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8105c90341bcf54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd3f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd3f8c00640 1 -- 172.21.15.84:0/1038380979 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40e9070 con 0x5579d7bd1280 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd3f8c00640 1 -- 172.21.15.84:0/1038380979 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd3f40a9230 con 0x5579d7bd1280 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.859+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579d7e9ca70 con 0x5579d7bd1280 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd3f8c00640 1 -- 172.21.15.84:0/1038380979 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3f40ad050 con 0x5579d7bd1280 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 10 client.15261 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5579d7eb76f0 con 0x5579d7bd1280 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd3f8c00640 1 -- 172.21.15.84:0/1038380979 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5579d7e9ca70 con 0x5579d7bd1280 2024-09-21T07:49:55.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd3f8c00640 1 -- 172.21.15.84:0/1038380979 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd3f40a9430 con 0x5579d7bd1280 2024-09-21T07:49:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 10 client.15261 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:49:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 20 client.15261 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7bb08e0 0x5579d7fb6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 4 client.15261 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:49:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.860+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579d7f11ca0 con 0x5579d7bb08e0 2024-09-21T07:49:55.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.861+0000 7fd40aa00640 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7bb08e0 0x5579d7fb6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.862+0000 7fd40aa00640 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7bb08e0 0x5579d7fb6250 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81c51051da52bcb6 server_cookie=d414fce78b7efb73 in_seq=0 out_seq=0 2024-09-21T07:49:55.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.862+0000 7fd3f8c00640 10 client.15261 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:49:55.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.862+0000 7fd3f8c00640 1 -- 172.21.15.84:0/1038380979 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5579d7f11ca0 con 0x5579d7bb08e0 2024-09-21T07:49:55.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.862+0000 7fd3f8c00640 10 client.15261 handle_command_reply: tid=0 2024-09-21T07:49:55.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 client.15261 shutdown 2024-09-21T07:49:55.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 msgr2=0x5579d7fa4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7fa4510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40aab50 tx=0x7fd3f40a9ff0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 shutdown_connections 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7bb08e0 0x5579d7fb6250 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fafdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7fa4510 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd3f8c00640 0 client.15261 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 --2- 172.21.15.84:0/1038380979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bc90a0 0x5579d7fa3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 >> 172.21.15.84:0/1038380979 conn(0x5579d7be6350 msgr2=0x5579d7f9b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 shutdown_connections 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 1 -- 172.21.15.84:0/1038380979 wait complete. 2024-09-21T07:49:55.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.863+0000 7fd418ab2740 20 client.15261 trim_cache size 0 max 16384 2024-09-21T07:49:55.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.882+0000 7fd418ab2740 1 Processor -- start 2024-09-21T07:49:55.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.882+0000 7fd418ab2740 1 -- start start 2024-09-21T07:49:55.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.882+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bc90a0 0x5579d7fa2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.882+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7f9e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bf1f60 0x5579d7fafd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd418ab2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5579d7fb4590 con 0x5579d7bd1280 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd418ab2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5579d7fb4c60 con 0x5579d7bf1f60 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd418ab2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5579d7fb5330 con 0x5579d7bc90a0 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7f9e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7f9e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56800/0 (socket says 172.21.15.84:56800) 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 -- 172.21.15.84:0/854786830 learned_addr learned my addr 172.21.15.84:0/854786830 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40aa00640 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bc90a0 0x5579d7fa2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40b400640 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bf1f60 0x5579d7fafd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 -- 172.21.15.84:0/854786830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bc90a0 msgr2=0x5579d7fa2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bc90a0 0x5579d7fa2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 -- 172.21.15.84:0/854786830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bf1f60 msgr2=0x5579d7fafd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bf1f60 0x5579d7fafd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40a000640 1 -- 172.21.15.84:0/854786830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579d7f9a780 con 0x5579d7bd1280 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.883+0000 7fd40aa00640 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bc90a0 0x5579d7fa2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.884+0000 7fd40a000640 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7f9e5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40e57e0 tx=0x7fd3f4005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eeb8160f3486a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:55.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.884+0000 7fd3fb400640 1 -- 172.21.15.84:0/854786830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40ad6b0 con 0x5579d7bd1280 2024-09-21T07:49:55.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.884+0000 7fd3fb400640 1 -- 172.21.15.84:0/854786830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3f40ea020 con 0x5579d7bd1280 2024-09-21T07:49:55.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.884+0000 7fd3fb400640 1 -- 172.21.15.84:0/854786830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40ac7f0 con 0x5579d7bd1280 2024-09-21T07:49:55.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 -- 172.21.15.84:0/854786830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 msgr2=0x5579d7f9e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7f9e5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40e57e0 tx=0x7fd3f4005e30 comp rx=0 tx=0).stop 2024-09-21T07:49:55.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 -- 172.21.15.84:0/854786830 shutdown_connections 2024-09-21T07:49:55.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bf1f60 0x5579d7fafd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bd1280 0x5579d7f9e5b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 --2- 172.21.15.84:0/854786830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bc90a0 0x5579d7fa2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 -- 172.21.15.84:0/854786830 >> 172.21.15.84:0/854786830 conn(0x5579d7be6350 msgr2=0x5579d7f91010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 -- 172.21.15.84:0/854786830 shutdown_connections 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 -- 172.21.15.84:0/854786830 wait complete. 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.885+0000 7fd418ab2740 1 -- start start 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 1 Processor -- start 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7fb8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7fb94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fbe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5579d7fb60d0 con 0x5579d7bc90a0 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5579d7fb5a00 con 0x5579d7bd1280 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5579d7fb67a0 con 0x5579d7bf1f60 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd418ab2740 10 client.0 _ll_register_callbacks cb 0x7fd3f400ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd40aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7fb8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd40b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fbe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd40b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fbe440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36844/0 (socket says 172.21.15.84:36844) 2024-09-21T07:49:55.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd40aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7fb8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56814/0 (socket says 172.21.15.84:56814) 2024-09-21T07:49:55.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd40b400640 1 -- 172.21.15.84:0/2769766857 learned_addr learned my addr 172.21.15.84:0/2769766857 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:55.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.886+0000 7fd40a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7fb94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40b400640 1 -- 172.21.15.84:0/2769766857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 msgr2=0x5579d7fb94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40b400640 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7fb94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40b400640 1 -- 172.21.15.84:0/2769766857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 msgr2=0x5579d7fb8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40b400640 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7fb8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40b400640 1 -- 172.21.15.84:0/2769766857 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579d7fbeab0 con 0x5579d7bf1f60 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40aa00640 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7fb8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40a000640 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7fb94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd40b400640 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fbe440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4040045a0 tx=0x7fd4040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=575246d8580d767 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.887+0000 7fd3f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd3f8c00640 1 -- 172.21.15.84:0/2769766857 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40402f060 con 0x5579d7bf1f60 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3f40ea020 con 0x5579d7bf1f60 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd3f8c00640 1 -- 172.21.15.84:0/2769766857 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd40401f7c0 con 0x5579d7bf1f60 2024-09-21T07:49:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd3f8c00640 1 -- 172.21.15.84:0/2769766857 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd404036050 con 0x5579d7bf1f60 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd418ab2740 10 client.25261 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5579d80221e0 con 0x5579d7bf1f60 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd3f8c00640 1 -- 172.21.15.84:0/2769766857 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3f40ea020 con 0x5579d7bf1f60 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.888+0000 7fd3f8c00640 1 -- 172.21.15.84:0/2769766857 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd40401eb00 con 0x5579d7bf1f60 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd418ab2740 10 client.25261 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd418ab2740 10 client.25261 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd418ab2740 20 client.25261 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:55.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7b85c90 0x5579d8025ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd418ab2740 4 client.25261 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "status"}) -- 0x5579d7f0d750 con 0x5579d7b85c90 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd40aa00640 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7b85c90 0x5579d8025ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd40aa00640 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7b85c90 0x5579d8025ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6cc683488691c447 server_cookie=5fb7860a94a5c8f6 in_seq=0 out_seq=0 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.889+0000 7fd3f8c00640 10 client.25261 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd3f8c00640 1 -- 172.21.15.84:0/2769766857 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5579d7f0d750 con 0x5579d7b85c90 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd3f8c00640 10 client.25261 handle_command_reply: tid=0 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 client.25261 shutdown 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 msgr2=0x5579d7fbe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fbe440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4040045a0 tx=0x7fd4040046c0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 shutdown_connections 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5579d7b85c90 0x5579d8025ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5579d7bf1f60 0x5579d7fbe440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579d7bd1280 0x5579d7fb94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd3f8c00640 0 client.25261 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 --2- 172.21.15.84:0/2769766857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579d7bc90a0 0x5579d7fb8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 >> 172.21.15.84:0/2769766857 conn(0x5579d7be6350 msgr2=0x5579d7f95b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 shutdown_connections 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 1 -- 172.21.15.84:0/2769766857 wait complete. 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.890+0000 7fd418ab2740 20 client.25261 trim_cache size 0 max 16384 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24742, 2024-09-21T07:49:55.896 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 84.787524031000004, 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 156.77941418500001 2024-09-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3f00b6670 msgr2=0x7fd3f00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3f00b6670 0x7fd3f00b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd404009f00 tx=0x7fd404005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c10b6d0 msgr2=0x7fd40c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c10b6d0 0x7fd40c19cd50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400e9c0 tx=0x7fd3f400edc0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 shutdown_connections 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd3f00b6670 0x7fd3f00b8b80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd40c10c020 0x7fd40c1a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd40c10b6d0 0x7fd40c19cd50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 --2- 172.21.15.84:0/177808220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd40c105d90 0x7fd40c19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 >> 172.21.15.84:0/177808220 conn(0x7fd40c1017c0 msgr2=0x7fd40c10ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 shutdown_connections 2024-09-21T07:49:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:55.891+0000 7fd411e00640 1 -- 172.21.15.84:0/177808220 wait complete. 2024-09-21T07:49:56.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:49:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:57.331 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:57 smithi084 ceph-mon[30411]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:57.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:57 smithi191 ceph-mon[34667]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:57.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:57 smithi162 ceph-mon[34833]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.597+0000 7f7293200640 1 -- 172.21.15.84:0/68727099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 msgr2=0x7f728c112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.597+0000 7f7293200640 1 --2- 172.21.15.84:0/68727099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c112840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7284009ca0 tx=0x7f728402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.598+0000 7f7293200640 1 -- 172.21.15.84:0/68727099 shutdown_connections 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.598+0000 7f7293200640 1 --2- 172.21.15.84:0/68727099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c112840 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.598+0000 7f7293200640 1 --2- 172.21.15.84:0/68727099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f728c10b6c0 0x7f728c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.598+0000 7f7293200640 1 --2- 172.21.15.84:0/68727099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f728c105d80 0x7f728c106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.598+0000 7f7293200640 1 -- 172.21.15.84:0/68727099 >> 172.21.15.84:0/68727099 conn(0x7f728c101810 msgr2=0x7f728c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.598+0000 7f7293200640 1 -- 172.21.15.84:0/68727099 shutdown_connections 2024-09-21T07:49:57.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.598+0000 7f7293200640 1 -- 172.21.15.84:0/68727099 wait complete. 2024-09-21T07:49:57.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.599+0000 7f7293200640 1 Processor -- start 2024-09-21T07:49:57.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.599+0000 7f7293200640 1 -- start start 2024-09-21T07:49:57.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7293200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f728c105d80 0x7f728c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7293200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f728c10b6c0 0x7f728c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7293200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7293200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f728c115cd0 con 0x7f728c10c010 2024-09-21T07:49:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7293200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f728c115b50 con 0x7f728c105d80 2024-09-21T07:49:57.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7293200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f728c115e50 con 0x7f728c10b6c0 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c1a1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56832/0 (socket says 172.21.15.84:56832) 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 -- 172.21.15.84:0/2683910071 learned_addr learned my addr 172.21.15.84:0/2683910071 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f728be00640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f728c105d80 0x7f728c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7283400640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f728c10b6c0 0x7f728c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 -- 172.21.15.84:0/2683910071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f728c10b6c0 msgr2=0x7f728c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f728c10b6c0 0x7f728c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 -- 172.21.15.84:0/2683910071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f728c105d80 msgr2=0x7f728c19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f728c105d80 0x7f728c19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.600+0000 7f7291200640 1 -- 172.21.15.84:0/2683910071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728c1a25d0 con 0x7f728c10c010 2024-09-21T07:49:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.601+0000 7f7291200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c1a1ea0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7284005cc0 tx=0x7f7284031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.601+0000 7f7289600640 1 -- 172.21.15.84:0/2683910071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7284003b70 con 0x7f728c10c010 2024-09-21T07:49:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.601+0000 7f7289600640 1 -- 172.21.15.84:0/2683910071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72840318f0 con 0x7f728c10c010 2024-09-21T07:49:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.601+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728c1a2860 con 0x7f728c10c010 2024-09-21T07:49:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.601+0000 7f7289600640 1 -- 172.21.15.84:0/2683910071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728402f950 con 0x7f728c10c010 2024-09-21T07:49:57.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.601+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f728c1a9020 con 0x7f728c10c010 2024-09-21T07:49:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.604+0000 7f7299ed6740 1 Processor -- start 2024-09-21T07:49:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7289600640 1 -- 172.21.15.84:0/2683910071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f728402fb10 con 0x7f728c10c010 2024-09-21T07:49:57.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7299ed6740 1 -- start start 2024-09-21T07:49:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d554f60 0x55f87d8fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d52c0a0 0x55f87d8fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d8fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7299ed6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f87d872d50 con 0x55f87d52c0a0 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7299ed6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f87d862180 con 0x55f87d534280 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.605+0000 7f7299ed6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f87d865f90 con 0x55f87d554f60 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f7283400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d554f60 0x55f87d8fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f728be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d52c0a0 0x55f87d8fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f7283400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d554f60 0x55f87d8fb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36878/0 (socket says 172.21.15.84:36878) 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f7283400640 1 -- 172.21.15.84:0/3223633711 learned_addr learned my addr 172.21.15.84:0/3223633711 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:57.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f7283400640 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d8fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f728be00640 1 -- 172.21.15.84:0/3223633711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d554f60 msgr2=0x55f87d8fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f728be00640 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d554f60 0x55f87d8fb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f728be00640 1 -- 172.21.15.84:0/3223633711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 msgr2=0x55f87d8fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f728be00640 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d8fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f728be00640 1 -- 172.21.15.84:0/3223633711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87d82ca70 con 0x55f87d52c0a0 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f7283400640 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d554f60 0x55f87d8fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.606+0000 7f728be00640 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d52c0a0 0x55f87d8fb9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f727c009b70 tx=0x7f727c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0ee90b279381e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.607+0000 7f7289600640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72700b65f0 0x7f72700b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.607+0000 7f7281600640 1 -- 172.21.15.84:0/3223633711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c009e60 con 0x55f87d52c0a0 2024-09-21T07:49:57.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.607+0000 7f7281600640 1 -- 172.21.15.84:0/3223633711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f727c012900 con 0x55f87d52c0a0 2024-09-21T07:49:57.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.607+0000 7f7281600640 1 -- 172.21.15.84:0/3223633711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c00fa00 con 0x55f87d52c0a0 2024-09-21T07:49:57.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.607+0000 7f7289600640 1 -- 172.21.15.84:0/2683910071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7284108e10 con 0x7f728c10c010 2024-09-21T07:49:57.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.607+0000 7f7283400640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72700b65f0 0x7f72700b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 -- 172.21.15.84:0/3223633711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d52c0a0 msgr2=0x55f87d8fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7283400640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72700b65f0 0x7f72700b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72740116e0 tx=0x7f7274004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d52c0a0 0x55f87d8fb9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f727c009b70 tx=0x7f727c0117b0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 -- 172.21.15.84:0/3223633711 shutdown_connections 2024-09-21T07:49:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d8fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d52c0a0 0x55f87d8fb9d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3223633711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d554f60 0x55f87d8fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 -- 172.21.15.84:0/3223633711 >> 172.21.15.84:0/3223633711 conn(0x55f87d549350 msgr2=0x55f87d8f9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 -- 172.21.15.84:0/3223633711 shutdown_connections 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.608+0000 7f7299ed6740 1 -- 172.21.15.84:0/3223633711 wait complete. 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 -- start start 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 Processor -- start 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d906f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d534280 0x55f87d9074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d554f60 0x55f87d912fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f87d6c35f0 con 0x55f87d534280 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f87d7fd460 con 0x55f87d554f60 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f87d909c70 con 0x55f87d52c0a0 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.609+0000 7f7299ed6740 10 client.0 _ll_register_callbacks cb 0x55f87d80d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d534280 0x55f87d9074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d534280 0x55f87d9074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56854/0 (socket says 172.21.15.84:56854) 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 -- 172.21.15.84:0/1180446801 learned_addr learned my addr 172.21.15.84:0/1180446801 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7291200640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d554f60 0x55f87d912fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f728be00640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d906f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 -- 172.21.15.84:0/1180446801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 msgr2=0x55f87d906f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d906f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 -- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d554f60 msgr2=0x55f87d912fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d554f60 0x55f87d912fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 -- 172.21.15.84:0/1180446801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f87d5c0540 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7291200640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d554f60 0x55f87d912fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f7283400640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d534280 0x55f87d9074d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f72740038a0 tx=0x7f72740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98827d09dbb6aadf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.610+0000 7f727a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.611+0000 7f727a000640 1 -- 172.21.15.84:0/1180446801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727400f7a0 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.611+0000 7f727a000640 1 -- 172.21.15.84:0/1180446801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f727400f940 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.611+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f87d7ffa70 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.611+0000 7f727a000640 1 -- 172.21.15.84:0/1180446801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f727400fb40 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.611+0000 7f7299ed6740 10 client.15279 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.611+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f87d81a6f0 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.611+0000 7f727a000640 1 -- 172.21.15.84:0/1180446801 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f87d7ffa70 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f727a000640 1 -- 172.21.15.84:0/1180446801 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7274012450 con 0x55f87d534280 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f7299ed6740 10 client.15279 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f7299ed6740 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:49:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f7299ed6740 20 client.15279 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:57.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d5138e0 0x55f87d9194d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f7299ed6740 4 client.15279 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:49:57.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f87d874ca0 con 0x55f87d5138e0 2024-09-21T07:49:57.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.612+0000 7f728be00640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d5138e0 0x55f87d9194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.613+0000 7f728be00640 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d5138e0 0x55f87d9194d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75065a929430e621 server_cookie=b3ab7827ae0fb767 in_seq=0 out_seq=0 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.613+0000 7f727a000640 10 client.15279 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f727a000640 1 -- 172.21.15.84:0/1180446801 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f87d874ca0 con 0x55f87d5138e0 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f727a000640 10 client.15279 handle_command_reply: tid=0 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 client.15279 shutdown 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d534280 msgr2=0x55f87d9074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d534280 0x55f87d9074d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f72740038a0 tx=0x7f72740046c0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 shutdown_connections 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d554f60 0x55f87d912fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d534280 0x55f87d9074d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d5138e0 0x55f87d9194d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1180446801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d906f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 >> 172.21.15.84:0/1180446801 conn(0x55f87d549350 msgr2=0x55f87d8fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:57.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.614+0000 7f727a000640 0 client.15279 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:49:57.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.615+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 shutdown_connections 2024-09-21T07:49:57.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.615+0000 7f7299ed6740 1 -- 172.21.15.84:0/1180446801 wait complete. 2024-09-21T07:49:57.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.615+0000 7f7299ed6740 20 client.15279 trim_cache size 0 max 16384 2024-09-21T07:49:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.633+0000 7f7299ed6740 1 Processor -- start 2024-09-21T07:49:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.633+0000 7f7299ed6740 1 -- start start 2024-09-21T07:49:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d8f4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d901f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d902480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7299ed6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f87d917810 con 0x55f87d554f60 2024-09-21T07:49:57.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7299ed6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f87d917ee0 con 0x55f87d534280 2024-09-21T07:49:57.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7299ed6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f87d9185b0 con 0x55f87d52c0a0 2024-09-21T07:49:57.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7291200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d902480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f728be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d8f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f728be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d8f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36894/0 (socket says 172.21.15.84:36894) 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f728be00640 1 -- 172.21.15.84:0/1820310338 learned_addr learned my addr 172.21.15.84:0/1820310338 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f7283400640 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d901f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.634+0000 7f728be00640 1 -- 172.21.15.84:0/1820310338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 msgr2=0x55f87d901f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f728be00640 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d901f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f728be00640 1 -- 172.21.15.84:0/1820310338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 msgr2=0x55f87d902480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f728be00640 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d902480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f728be00640 1 -- 172.21.15.84:0/1820310338 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87d908050 con 0x55f87d52c0a0 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f7283400640 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d901f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:49:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f728be00640 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d8f4010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f727c000c00 tx=0x7f727c00f620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a37c831df923378 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:57.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f7280c00640 1 -- 172.21.15.84:0/1820310338 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0053b0 con 0x55f87d52c0a0 2024-09-21T07:49:57.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f7280c00640 1 -- 172.21.15.84:0/1820310338 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f727c009d80 con 0x55f87d52c0a0 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.635+0000 7f7280c00640 1 -- 172.21.15.84:0/1820310338 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0035f0 con 0x55f87d52c0a0 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 -- 172.21.15.84:0/1820310338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 msgr2=0x55f87d8f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d8f4010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f727c000c00 tx=0x7f727c00f620 comp rx=0 tx=0).stop 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 -- 172.21.15.84:0/1820310338 shutdown_connections 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d902480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d901f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 --2- 172.21.15.84:0/1820310338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d8f4010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 -- 172.21.15.84:0/1820310338 >> 172.21.15.84:0/1820310338 conn(0x55f87d549350 msgr2=0x55f87d913140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 -- 172.21.15.84:0/1820310338 shutdown_connections 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.636+0000 7f7299ed6740 1 -- 172.21.15.84:0/1820310338 wait complete. 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 -- start start 2024-09-21T07:49:57.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 Processor -- start 2024-09-21T07:49:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d91bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d91c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d920d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f87d919350 con 0x55f87d554f60 2024-09-21T07:49:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f87d918c80 con 0x55f87d534280 2024-09-21T07:49:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f87d919a20 con 0x55f87d52c0a0 2024-09-21T07:49:57.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.637+0000 7f7299ed6740 10 client.0 _ll_register_callbacks cb 0x7f7274004430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f728be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d91bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f728be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d91bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36900/0 (socket says 172.21.15.84:36900) 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f728be00640 1 -- 172.21.15.84:0/3329309788 learned_addr learned my addr 172.21.15.84:0/3329309788 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7291200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d920d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7283400640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d91c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7291200640 1 -- 172.21.15.84:0/3329309788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 msgr2=0x55f87d91bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7291200640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d91bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7291200640 1 -- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 msgr2=0x55f87d91c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7291200640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d91c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7291200640 1 -- 172.21.15.84:0/3329309788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f87d921240 con 0x55f87d554f60 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7283400640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d91c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f728be00640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d91bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f7291200640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d920d00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7284106330 tx=0x7f7284005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7666038e70acce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:57.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.638+0000 7f727a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f727a000640 1 -- 172.21.15.84:0/3329309788 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72840ca120 con 0x55f87d554f60 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f727a000640 1 -- 172.21.15.84:0/3329309788 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f72840cdc10 con 0x55f87d554f60 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f87d870750 con 0x55f87d554f60 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f727a000640 1 -- 172.21.15.84:0/3329309788 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f72840ce4c0 con 0x55f87d554f60 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f7299ed6740 10 client.15285 fetch_fsmap learned FSMap version 28 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f87d9224c0 con 0x55f87d554f60 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f727a000640 1 -- 172.21.15.84:0/3329309788 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f87d870750 con 0x55f87d554f60 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.639+0000 7f727a000640 1 -- 172.21.15.84:0/3329309788 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f72840cfce0 con 0x55f87d554f60 2024-09-21T07:49:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.640+0000 7f7299ed6740 10 client.15285 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:49:57.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.640+0000 7f7299ed6740 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:49:57.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.640+0000 7f7299ed6740 20 client.15285 populate_metadata read hostname 'smithi084' 2024-09-21T07:49:57.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.640+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d4e8c90 0x55f87d987f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.640+0000 7f7299ed6740 4 client.15285 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.640+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "status"}) -- 0x55f87d86db80 con 0x55f87d4e8c90 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.640+0000 7f728be00640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d4e8c90 0x55f87d987f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f728be00640 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d4e8c90 0x55f87d987f20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0127bc23ae1424 server_cookie=3ff102c450161f30 in_seq=0 out_seq=0 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f727a000640 10 client.15285 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f727a000640 1 -- 172.21.15.84:0/3329309788 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f87d86db80 con 0x55f87d4e8c90 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f727a000640 10 client.15285 handle_command_reply: tid=0 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 client.15285 shutdown 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 msgr2=0x55f87d920d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d920d00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7284106330 tx=0x7f7284005b50 comp rx=0 tx=0).stop 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 shutdown_connections 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f87d554f60 0x55f87d920d00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f87d534280 0x55f87d91c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f87d4e8c90 0x55f87d987f20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 --2- 172.21.15.84:0/3329309788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f87d52c0a0 0x55f87d91bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 >> 172.21.15.84:0/3329309788 conn(0x55f87d549350 msgr2=0x55f87d913140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f727a000640 0 client.15285 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 shutdown_connections 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.641+0000 7f7299ed6740 1 -- 172.21.15.84:0/3329309788 wait complete. 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7299ed6740 20 client.15285 trim_cache size 0 max 16384 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T07:49:57.646 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24746, 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 134.93695776000001, 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 149.22995705700001 2024-09-21T07:49:57.647 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72700b65f0 msgr2=0x7f72700b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72700b65f0 0x7f72700b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72740116e0 tx=0x7f7274004730 comp rx=0 tx=0).stop 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 msgr2=0x7f728c1a1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c1a1ea0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7284005cc0 tx=0x7f7284031700 comp rx=0 tx=0).stop 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 shutdown_connections 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72700b65f0 0x7f72700b8b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f728c10c010 0x7f728c1a1ea0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f728c10b6c0 0x7f728c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 --2- 172.21.15.84:0/2683910071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f728c105d80 0x7f728c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.642+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 >> 172.21.15.84:0/2683910071 conn(0x7f728c101810 msgr2=0x7f728c10ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.643+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 shutdown_connections 2024-09-21T07:49:57.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:57.643+0000 7f7293200640 1 -- 172.21.15.84:0/2683910071 wait complete. 2024-09-21T07:49:58.385 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T07:49:58.385 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:49:58.395 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T07:49:58.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T07:49:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:49:59.163 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:49:59 smithi084 ceph-mon[30411]: pgmap v360: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 -- 172.21.15.84:0/3676616927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 msgr2=0x7fa63c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 --2- 172.21.15.84:0/3676616927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c110640 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa634009ca0 tx=0x7fa63402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 -- 172.21.15.84:0/3676616927 shutdown_connections 2024-09-21T07:49:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 --2- 172.21.15.84:0/3676616927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c110640 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 --2- 172.21.15.84:0/3676616927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa63c1094c0 0x7fa63c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 --2- 172.21.15.84:0/3676616927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63c103b80 0x7fa63c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 -- 172.21.15.84:0/3676616927 >> 172.21.15.84:0/3676616927 conn(0x7fa63c0ff610 msgr2=0x7fa63c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 -- 172.21.15.84:0/3676616927 shutdown_connections 2024-09-21T07:49:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.343+0000 7fa643a00640 1 -- 172.21.15.84:0/3676616927 wait complete. 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.344+0000 7fa643a00640 1 Processor -- start 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.344+0000 7fa643a00640 1 -- start start 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa643a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa63c103b80 0x7fa63c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa643a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63c1094c0 0x7fa63c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa643a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa643a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c113ad0 con 0x7fa63c109e10 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa643a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c113950 con 0x7fa63c1094c0 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa643a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c113c50 con 0x7fa63c103b80 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa641a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:59.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa641a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43348/0 (socket says 172.21.15.84:43348) 2024-09-21T07:49:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa641a00640 1 -- 172.21.15.84:0/3058683946 learned_addr learned my addr 172.21.15.84:0/3058683946 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:49:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa641000640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa63c103b80 0x7fa63c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.345+0000 7fa63be00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63c1094c0 0x7fa63c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa641a00640 1 -- 172.21.15.84:0/3058683946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa63c103b80 msgr2=0x7fa63c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa641a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa63c103b80 0x7fa63c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa641a00640 1 -- 172.21.15.84:0/3058683946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63c1094c0 msgr2=0x7fa63c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa641a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63c1094c0 0x7fa63c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa641a00640 1 -- 172.21.15.84:0/3058683946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c1a0450 con 0x7fa63c109e10 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa641a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c19fd20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa6340098d0 tx=0x7fa6340317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa639600640 1 -- 172.21.15.84:0/3058683946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634003b70 con 0x7fa63c109e10 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63c1a06e0 con 0x7fa63c109e10 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa639600640 1 -- 172.21.15.84:0/3058683946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa634003d10 con 0x7fa63c109e10 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.346+0000 7fa639600640 1 -- 172.21.15.84:0/3058683946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63402fa20 con 0x7fa63c109e10 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.347+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63c1a6ea0 con 0x7fa63c109e10 2024-09-21T07:49:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.348+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63c104e00 con 0x7fa63c109e10 2024-09-21T07:49:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.350+0000 7fa639600640 1 -- 172.21.15.84:0/3058683946 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fa63402fbe0 con 0x7fa63c109e10 2024-09-21T07:49:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.351+0000 7fa639600640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6200b65f0 0x7fa6200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:49:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.352+0000 7fa639600640 1 -- 172.21.15.84:0/3058683946 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa634108db0 con 0x7fa63c109e10 2024-09-21T07:49:59.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.352+0000 7fa641000640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6200b65f0 0x7fa6200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:49:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.352+0000 7fa641000640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6200b65f0 0x7fa6200b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009bd0 tx=0x7fa62c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:49:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.354+0000 7fa639600640 1 -- 172.21.15.84:0/3058683946 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6340cf050 con 0x7fa63c109e10 2024-09-21T07:49:59.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:49:59 smithi191 ceph-mon[34667]: pgmap v360: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:59.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:49:59 smithi162 ceph-mon[34833]: pgmap v360: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:49:59.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.557+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa63c10bc60 con 0x7fa6200b65f0 2024-09-21T07:49:59.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.558+0000 7fa639600640 1 -- 172.21.15.84:0/3058683946 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa63c10bc60 con 0x7fa6200b65f0 2024-09-21T07:49:59.560 INFO:teuthology.orchestra.run.smithi084.stdout:Backend: cephadm 2024-09-21T07:49:59.560 INFO:teuthology.orchestra.run.smithi084.stdout:Available: Yes 2024-09-21T07:49:59.560 INFO:teuthology.orchestra.run.smithi084.stdout:Paused: No 2024-09-21T07:49:59.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.560+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6200b65f0 msgr2=0x7fa6200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.560+0000 7fa643a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6200b65f0 0x7fa6200b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009bd0 tx=0x7fa62c005f90 comp rx=0 tx=0).stop 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.560+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 msgr2=0x7fa63c19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.560+0000 7fa643a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c19fd20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa6340098d0 tx=0x7fa6340317b0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 shutdown_connections 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6200b65f0 0x7fa6200b8b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c109e10 0x7fa63c19fd20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63c1094c0 0x7fa63c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 --2- 172.21.15.84:0/3058683946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa63c103b80 0x7fa63c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 >> 172.21.15.84:0/3058683946 conn(0x7fa63c0ff610 msgr2=0x7fa63c106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 shutdown_connections 2024-09-21T07:49:59.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:49:59.561+0000 7fa643a00640 1 -- 172.21.15.84:0/3058683946 wait complete. 2024-09-21T07:50:00.283 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:00 smithi084 ceph-mon[30411]: overall HEALTH_OK 2024-09-21T07:50:00.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T07:50:00.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:00 smithi191 ceph-mon[34667]: overall HEALTH_OK 2024-09-21T07:50:00.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:00 smithi162 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T07:50:00.691 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:01.080 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:01 smithi084 ceph-mon[30411]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:01.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 -- 172.21.15.84:0/350132373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 msgr2=0x7f3180112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 --2- 172.21.15.84:0/350132373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 0x7f3180112560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ca0 tx=0x7f317802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 -- 172.21.15.84:0/350132373 shutdown_connections 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 --2- 172.21.15.84:0/350132373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 0x7f3180112560 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 --2- 172.21.15.84:0/350132373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31800760a0 0x7f318010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 --2- 172.21.15.84:0/350132373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3180075750 0x7f3180075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 -- 172.21.15.84:0/350132373 >> 172.21.15.84:0/350132373 conn(0x7f31800ff5d0 msgr2=0x7f3180101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 -- 172.21.15.84:0/350132373 shutdown_connections 2024-09-21T07:50:01.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.303+0000 7f3185800640 1 -- 172.21.15.84:0/350132373 wait complete. 2024-09-21T07:50:01.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.304+0000 7f3185800640 1 Processor -- start 2024-09-21T07:50:01.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.304+0000 7f3185800640 1 -- start start 2024-09-21T07:50:01.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f3185800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3180075750 0x7f318019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f3185800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31800760a0 0x7f318019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f3185800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 0x7f31801a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f3185800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3180115d00 con 0x7f3180110140 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f3185800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3180115b80 con 0x7f3180075750 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f3185800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3180115e80 con 0x7f31800760a0 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f317f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 0x7f31801a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f317ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3180075750 0x7f318019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f317f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 0x7f31801a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43366/0 (socket says 172.21.15.84:43366) 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f317f400640 1 -- 172.21.15.84:0/1575286518 learned_addr learned my addr 172.21.15.84:0/1575286518 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.305+0000 7f3176000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31800760a0 0x7f318019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3176000640 1 -- 172.21.15.84:0/1575286518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3180075750 msgr2=0x7f318019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3176000640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3180075750 0x7f318019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3176000640 1 -- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 msgr2=0x7f31801a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:01.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3176000640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 0x7f31801a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3176000640 1 -- 172.21.15.84:0/1575286518 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31801a25c0 con 0x7f31800760a0 2024-09-21T07:50:01.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f317ea00640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3180075750 0x7f318019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:01.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3176000640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31800760a0 0x7f318019cbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31800777d0 tx=0x7f316800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:01.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3177e00640 1 -- 172.21.15.84:0/1575286518 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316800cc40 con 0x7f31800760a0 2024-09-21T07:50:01.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3177e00640 1 -- 172.21.15.84:0/1575286518 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316800cde0 con 0x7f31800760a0 2024-09-21T07:50:01.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31801a28b0 con 0x7f31800760a0 2024-09-21T07:50:01.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.306+0000 7f3177e00640 1 -- 172.21.15.84:0/1575286518 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168018760 con 0x7f31800760a0 2024-09-21T07:50:01.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.307+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31801a9010 con 0x7f31800760a0 2024-09-21T07:50:01.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.308+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3180075b60 con 0x7f31800760a0 2024-09-21T07:50:01.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.310+0000 7f3177e00640 1 -- 172.21.15.84:0/1575286518 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f3168010a90 con 0x7f31800760a0 2024-09-21T07:50:01.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.311+0000 7f3177e00640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31640b65f0 0x7f31640b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:01.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.312+0000 7f3177e00640 1 -- 172.21.15.84:0/1575286518 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f31680e80e0 con 0x7f31800760a0 2024-09-21T07:50:01.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.312+0000 7f317ea00640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31640b65f0 0x7f31640b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:01.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.312+0000 7f317ea00640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31640b65f0 0x7f31640b8b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3170009fc0 tx=0x7f3170005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:01.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.313+0000 7f3177e00640 1 -- 172.21.15.84:0/1575286518 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31680b2760 con 0x7f31800760a0 2024-09-21T07:50:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:01 smithi191 ceph-mon[34667]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:01.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:01 smithi191 ceph-mon[34667]: pgmap v361: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:01.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.509+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f318010a2f0 con 0x7f31640b65f0 2024-09-21T07:50:01.511 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:01 smithi084 ceph-mon[30411]: pgmap v361: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:01.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.521+0000 7f3177e00640 1 -- 172.21.15.84:0/1575286518 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f318010a2f0 con 0x7f31640b65f0 2024-09-21T07:50:01.523 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T07:50:01.523 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (2m) 17s ago 2m 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 3ac567c58e63 2024-09-21T07:50:01.523 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi162 running (2m) 20s ago 2m 96.7M - 19.3.0-5120-g18432218 ddce307e1f32 491d461f3f52 2024-09-21T07:50:01.523 INFO:teuthology.orchestra.run.smithi084.stdout:mds.c smithi191 running (2m) 20s ago 2m 87.0M - 19.3.0-5120-g18432218 ddce307e1f32 a161ce33b4df 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.d smithi084 running (2m) 17s ago 2m 85.5M - 19.3.0-5120-g18432218 ddce307e1f32 691526cb28b5 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.e smithi162 running (2m) 20s ago 2m 85.3M - 19.3.0-5120-g18432218 ddce307e1f32 35cb94b08188 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.f smithi191 running (2m) 20s ago 2m 86.8M - 19.3.0-5120-g18432218 ddce307e1f32 ee23b80f2963 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.g smithi084 running (2m) 17s ago 2m 80.8M - 19.3.0-5120-g18432218 ddce307e1f32 321154123d54 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.h smithi162 running (2m) 20s ago 2m 86.2M - 19.3.0-5120-g18432218 ddce307e1f32 f2f6c6e8ea94 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.i smithi191 running (2m) 20s ago 2m 86.7M - 19.3.0-5120-g18432218 ddce307e1f32 cd175deb20a8 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.j smithi084 running (2m) 17s ago 2m 80.9M - 19.3.0-5120-g18432218 ddce307e1f32 45ec1b410ce8 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.k smithi162 running (3m) 20s ago 3m 85.5M - 19.3.0-5120-g18432218 ddce307e1f32 c6a3b88a787d 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mds.l smithi191 running (3m) 20s ago 3m 90.3M - 19.3.0-5120-g18432218 ddce307e1f32 3ff5971ba17a 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi084 *:9283,8765 running (11m) 17s ago 11m 587M - 19.3.0-5120-g18432218 ddce307e1f32 55ff0ac7caf2 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi162 *:8443,8765 running (9m) 20s ago 9m 524M - 19.3.0-5120-g18432218 ddce307e1f32 8bd70be84ff5 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.z smithi191 *:8443,8765 running (9m) 20s ago 9m 525M - 19.3.0-5120-g18432218 ddce307e1f32 3da8821866de 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (11m) 17s ago 11m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 4570a1287a90 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi162 running (9m) 20s ago 9m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 0788e5b682ab 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi191 running (9m) 20s ago 9m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 cedc443a8dfd 2024-09-21T07:50:01.524 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (8m) 17s ago 8m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 78269d2a9fe0 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi162 running (7m) 20s ago 7m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 74550811a889 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi191 running (7m) 20s ago 7m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 fda7a9a0018a 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (7m) 17s ago 7m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0632356be670 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi162 running (6m) 20s ago 6m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f6bdc0eecf36 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi191 running (6m) 20s ago 6m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 bfb9ea43309d 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi084 running (5m) 17s ago 5m 108M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b068cbd80411 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi162 running (5m) 20s ago 5m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6fdfbafae77c 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.8 smithi191 running (4m) 20s ago 4m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f3d62387517c 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.9 smithi084 running (4m) 17s ago 4m 117M 4272M 19.3.0-5120-g18432218 ddce307e1f32 87ec6e727544 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.10 smithi162 running (3m) 20s ago 3m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a4d9f3477924 2024-09-21T07:50:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:osd.11 smithi191 running (3m) 20s ago 3m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d26ef2fd853f 2024-09-21T07:50:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31640b65f0 msgr2=0x7f31640b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31640b65f0 0x7f31640b8b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3170009fc0 tx=0x7f3170005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31800760a0 msgr2=0x7f318019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31800760a0 0x7f318019cbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31800777d0 tx=0x7f316800ee50 comp rx=0 tx=0).stop 2024-09-21T07:50:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 shutdown_connections 2024-09-21T07:50:01.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31640b65f0 0x7f31640b8b00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3180110140 0x7f31801a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31800760a0 0x7f318019cbf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 --2- 172.21.15.84:0/1575286518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3180075750 0x7f318019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 >> 172.21.15.84:0/1575286518 conn(0x7f31800ff5d0 msgr2=0x7f3180109be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 shutdown_connections 2024-09-21T07:50:01.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:01.525+0000 7f3185800640 1 -- 172.21.15.84:0/1575286518 wait complete. 2024-09-21T07:50:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:01 smithi162 ceph-mon[34833]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:01 smithi162 ceph-mon[34833]: pgmap v361: 129 pgs: 129 active+clean; 649 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:02.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T07:50:02.616 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 -- 172.21.15.84:0/1431812119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 msgr2=0x7fa0bc110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1431812119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 0x7fa0bc110470 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009ca0 tx=0x7fa0b402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 -- 172.21.15.84:0/1431812119 shutdown_connections 2024-09-21T07:50:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1431812119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 0x7fa0bc110470 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1431812119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0bc1092f0 0x7fa0bc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1431812119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 0x7fa0bc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 -- 172.21.15.84:0/1431812119 >> 172.21.15.84:0/1431812119 conn(0x7fa0bc0ff440 msgr2=0x7fa0bc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 -- 172.21.15.84:0/1431812119 shutdown_connections 2024-09-21T07:50:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.239+0000 7fa0bb200640 1 -- 172.21.15.84:0/1431812119 wait complete. 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.240+0000 7fa0bb200640 1 Processor -- start 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.240+0000 7fa0bb200640 1 -- start start 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0bb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 0x7fa0bc19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0bb200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0bc1092f0 0x7fa0bc19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0bb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 0x7fa0bc1a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0bb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc113950 con 0x7fa0bc109c40 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0bb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc1137d0 con 0x7fa0bc1039b0 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0bb200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc113ad0 con 0x7fa0bc1092f0 2024-09-21T07:50:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0b9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 0x7fa0bc19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0ba800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 0x7fa0bc1a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0b9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 0x7fa0bc19c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35710/0 (socket says 172.21.15.84:35710) 2024-09-21T07:50:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0b9e00640 1 -- 172.21.15.84:0/1549885436 learned_addr learned my addr 172.21.15.84:0/1549885436 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.241+0000 7fa0b9400640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0bc1092f0 0x7fa0bc19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b9e00640 1 -- 172.21.15.84:0/1549885436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0bc1092f0 msgr2=0x7fa0bc19caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b9e00640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0bc1092f0 0x7fa0bc19caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b9e00640 1 -- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 msgr2=0x7fa0bc1a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b9e00640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 0x7fa0bc1a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b9e00640 1 -- 172.21.15.84:0/1549885436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc1a2470 con 0x7fa0bc1039b0 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b9e00640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 0x7fa0bc19c500 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b2a00640 1 -- 172.21.15.84:0/1549885436 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00cd80 con 0x7fa0bc1039b0 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0bc1a2760 con 0x7fa0bc1039b0 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b2a00640 1 -- 172.21.15.84:0/1549885436 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0ac0108e0 con 0x7fa0bc1039b0 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.242+0000 7fa0b2a00640 1 -- 172.21.15.84:0/1549885436 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac018980 con 0x7fa0bc1039b0 2024-09-21T07:50:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.243+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0bc1a8ec0 con 0x7fa0bc1039b0 2024-09-21T07:50:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.244+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0bc103dc0 con 0x7fa0bc1039b0 2024-09-21T07:50:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.246+0000 7fa0b2a00640 1 -- 172.21.15.84:0/1549885436 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fa0ac010430 con 0x7fa0bc1039b0 2024-09-21T07:50:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.247+0000 7fa0b2a00640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0a00b6560 0x7fa0a00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.247+0000 7fa0b2a00640 1 -- 172.21.15.84:0/1549885436 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa0ac0e7b30 con 0x7fa0bc1039b0 2024-09-21T07:50:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.248+0000 7fa0b9400640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0a00b6560 0x7fa0a00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.248+0000 7fa0b9400640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0a00b6560 0x7fa0a00b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc105a60 tx=0x7fa0a8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:03.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.251+0000 7fa0b2a00640 1 -- 172.21.15.84:0/1549885436 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0ac0b2310 con 0x7fa0bc1039b0 2024-09-21T07:50:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:03 smithi084 ceph-mon[30411]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:03 smithi084 ceph-mon[30411]: pgmap v362: 129 pgs: 129 active+clean; 649 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:50:03.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:03 smithi191 ceph-mon[34667]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:03 smithi191 ceph-mon[34667]: pgmap v362: 129 pgs: 129 active+clean; 649 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:50:03.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.459+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa0bc10f740 con 0x7fa0a00b6560 2024-09-21T07:50:03.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.465+0000 7fa0b2a00640 1 -- 172.21.15.84:0/1549885436 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa0bc10f740 con 0x7fa0a00b6560 2024-09-21T07:50:03.466 INFO:teuthology.orchestra.run.smithi084.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T07:50:03.466 INFO:teuthology.orchestra.run.smithi084.stdout:mds.all 12/12 22s ago 3m smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-21T07:50:03.466 INFO:teuthology.orchestra.run.smithi084.stdout:mgr 3/3 22s ago 9m smithi084=x;smithi162=y;smithi191=z;count:3 2024-09-21T07:50:03.466 INFO:teuthology.orchestra.run.smithi084.stdout:mon 3/3 22s ago 10m smithi084:172.21.15.84=a;smithi162:172.21.15.162=b;smithi191:172.21.15.191=c;count:3 2024-09-21T07:50:03.466 INFO:teuthology.orchestra.run.smithi084.stdout:osd 12 22s ago - 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0a00b6560 msgr2=0x7fa0a00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0a00b6560 0x7fa0a00b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc105a60 tx=0x7fa0a8005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 msgr2=0x7fa0bc19c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 0x7fa0bc19c500 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e9f0 tx=0x7fa0ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 shutdown_connections 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0a00b6560 0x7fa0a00b8a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0bc109c40 0x7fa0bc1a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0bc1092f0 0x7fa0bc19caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 --2- 172.21.15.84:0/1549885436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0bc1039b0 0x7fa0bc19c500 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 >> 172.21.15.84:0/1549885436 conn(0x7fa0bc0ff440 msgr2=0x7fa0bc1078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 shutdown_connections 2024-09-21T07:50:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:03.467+0000 7fa0bb200640 1 -- 172.21.15.84:0/1549885436 wait complete. 2024-09-21T07:50:03.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:03 smithi162 ceph-mon[34833]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:03 smithi162 ceph-mon[34833]: pgmap v362: 129 pgs: 129 active+clean; 649 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:50:04.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T07:50:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:04 smithi191 ceph-mon[34667]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T07:50:04.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:04 smithi162 ceph-mon[34833]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T07:50:04.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:04 smithi084 ceph-mon[30411]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-09-21T07:50:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:05.222 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:05 smithi084 ceph-mon[30411]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:05.223 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:05 smithi084 ceph-mon[30411]: pgmap v363: 129 pgs: 129 active+clean; 649 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:50:05.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 -- 172.21.15.84:0/4034191282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7708105d80 msgr2=0x7f7708106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 --2- 172.21.15.84:0/4034191282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7708105d80 0x7f7708106190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009900 tx=0x7f76f802a410 comp rx=0 tx=0).stop 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 -- 172.21.15.84:0/4034191282 shutdown_connections 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 --2- 172.21.15.84:0/4034191282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770810c010 0x7f7708112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 --2- 172.21.15.84:0/4034191282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f770810b6c0 0x7f770810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 --2- 172.21.15.84:0/4034191282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7708105d80 0x7f7708106190 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 -- 172.21.15.84:0/4034191282 >> 172.21.15.84:0/4034191282 conn(0x7f7708101810 msgr2=0x7f7708103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 -- 172.21.15.84:0/4034191282 shutdown_connections 2024-09-21T07:50:05.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.290+0000 7f770dc00640 1 -- 172.21.15.84:0/4034191282 wait complete. 2024-09-21T07:50:05.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.291+0000 7f770dc00640 1 Processor -- start 2024-09-21T07:50:05.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.291+0000 7f770dc00640 1 -- start start 2024-09-21T07:50:05.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f770dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7708105d80 0x7f770819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:05.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f770dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770810b6c0 0x7f770819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:05.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f770dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f770810c010 0x7f77081a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:05.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f770dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7708115cd0 con 0x7f770810c010 2024-09-21T07:50:05.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f770dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7708115b50 con 0x7f7708105d80 2024-09-21T07:50:05.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f770dc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7708115e50 con 0x7f770810b6c0 2024-09-21T07:50:05.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f7707400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f770810c010 0x7f77081a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:05.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f7707400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f770810c010 0x7f77081a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43394/0 (socket says 172.21.15.84:43394) 2024-09-21T07:50:05.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f7707400640 1 -- 172.21.15.84:0/2405923871 learned_addr learned my addr 172.21.15.84:0/2405923871 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:05.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f7706000640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770810b6c0 0x7f770819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:05.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.292+0000 7f7706a00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7708105d80 0x7f770819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f7707400640 1 -- 172.21.15.84:0/2405923871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770810b6c0 msgr2=0x7f770819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f7707400640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770810b6c0 0x7f770819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f7707400640 1 -- 172.21.15.84:0/2405923871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7708105d80 msgr2=0x7f770819c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f7707400640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7708105d80 0x7f770819c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f7707400640 1 -- 172.21.15.84:0/2405923871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77081a26b0 con 0x7f770810c010 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f7706000640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770810b6c0 0x7f770819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f7707400640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f770810c010 0x7f77081a1f80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f770000eb10 tx=0x7f770000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f76ff400640 1 -- 172.21.15.84:0/2405923871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700004b20 con 0x7f770810c010 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f76ff400640 1 -- 172.21.15.84:0/2405923871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7700004cc0 con 0x7f770810c010 2024-09-21T07:50:05.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77081a29a0 con 0x7f770810c010 2024-09-21T07:50:05.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.293+0000 7f76ff400640 1 -- 172.21.15.84:0/2405923871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700010670 con 0x7f770810c010 2024-09-21T07:50:05.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.294+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77081a9100 con 0x7f770810c010 2024-09-21T07:50:05.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.295+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7708106190 con 0x7f770810c010 2024-09-21T07:50:05.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.297+0000 7f76ff400640 1 -- 172.21.15.84:0/2405923871 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f7700005000 con 0x7f770810c010 2024-09-21T07:50:05.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.299+0000 7f76ff400640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76ec0b6560 0x7f76ec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:05.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.300+0000 7f76ff400640 1 -- 172.21.15.84:0/2405923871 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f77000e7ed0 con 0x7f770810c010 2024-09-21T07:50:05.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.300+0000 7f7706a00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76ec0b6560 0x7f76ec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:05.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.301+0000 7f7706a00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76ec0b6560 0x7f76ec0b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76f8031440 tx=0x7f76f8009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:05.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.302+0000 7f76ff400640 1 -- 172.21.15.84:0/2405923871 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7700056710 con 0x7f770810c010 2024-09-21T07:50:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:05 smithi191 ceph-mon[34667]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:05 smithi191 ceph-mon[34667]: pgmap v363: 129 pgs: 129 active+clean; 649 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:50:05.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.495+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f7708063800 con 0x7f76ec0b6560 2024-09-21T07:50:05.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.497+0000 7f76ff400640 1 -- 172.21.15.84:0/2405923871 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f7708063800 con 0x7f76ec0b6560 2024-09-21T07:50:05.498 INFO:teuthology.orchestra.run.smithi084.stdout:HOST ADDR LABELS STATUS 2024-09-21T07:50:05.498 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 172.21.15.84 2024-09-21T07:50:05.499 INFO:teuthology.orchestra.run.smithi084.stdout:smithi162 172.21.15.162 2024-09-21T07:50:05.499 INFO:teuthology.orchestra.run.smithi084.stdout:smithi191 172.21.15.191 2024-09-21T07:50:05.499 INFO:teuthology.orchestra.run.smithi084.stdout:3 hosts in cluster 2024-09-21T07:50:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76ec0b6560 msgr2=0x7f76ec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76ec0b6560 0x7f76ec0b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76f8031440 tx=0x7f76f8009560 comp rx=0 tx=0).stop 2024-09-21T07:50:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f770810c010 msgr2=0x7f77081a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f770810c010 0x7f77081a1f80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f770000eb10 tx=0x7f770000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 shutdown_connections 2024-09-21T07:50:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76ec0b6560 0x7f76ec0b8a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f770810c010 0x7f77081a1f80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770810b6c0 0x7f770819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 --2- 172.21.15.84:0/2405923871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7708105d80 0x7f770819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 >> 172.21.15.84:0/2405923871 conn(0x7f7708101810 msgr2=0x7f7708103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 shutdown_connections 2024-09-21T07:50:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:05.500+0000 7f770dc00640 1 -- 172.21.15.84:0/2405923871 wait complete. 2024-09-21T07:50:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:05 smithi162 ceph-mon[34833]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:05 smithi162 ceph-mon[34833]: pgmap v363: 129 pgs: 129 active+clean; 649 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:50:06.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T07:50:06.602 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:07.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 -- 172.21.15.84:0/3246365794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5010c010 msgr2=0x7f4d50112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:07.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 --2- 172.21.15.84:0/3246365794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5010c010 0x7f4d50112840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009ca0 tx=0x7f4d4802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 -- 172.21.15.84:0/3246365794 shutdown_connections 2024-09-21T07:50:07.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 --2- 172.21.15.84:0/3246365794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5010c010 0x7f4d50112840 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 --2- 172.21.15.84:0/3246365794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d5010b6c0 0x7f4d5010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 --2- 172.21.15.84:0/3246365794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d50105d80 0x7f4d50106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 -- 172.21.15.84:0/3246365794 >> 172.21.15.84:0/3246365794 conn(0x7f4d50101810 msgr2=0x7f4d50103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:07.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 -- 172.21.15.84:0/3246365794 shutdown_connections 2024-09-21T07:50:07.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.256+0000 7f4d55800640 1 -- 172.21.15.84:0/3246365794 wait complete. 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.257+0000 7f4d55800640 1 Processor -- start 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.257+0000 7f4d55800640 1 -- start start 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d55800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d50105d80 0x7f4d5019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d55800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d5010b6c0 0x7f4d5019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d55800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d5010c010 0x7f4d501a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d55800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50115d20 con 0x7f4d50105d80 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d55800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50115ba0 con 0x7f4d5010c010 2024-09-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d55800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50115ea0 con 0x7f4d5010b6c0 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d50105d80 0x7f4d5019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d50105d80 0x7f4d5019c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43404/0 (socket says 172.21.15.84:43404) 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 -- 172.21.15.84:0/2587015432 learned_addr learned my addr 172.21.15.84:0/2587015432 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d46000640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d5010b6c0 0x7f4d5019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4f400640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d5010c010 0x7f4d501a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 -- 172.21.15.84:0/2587015432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d5010b6c0 msgr2=0x7f4d5019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d5010b6c0 0x7f4d5019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 -- 172.21.15.84:0/2587015432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d5010c010 msgr2=0x7f4d501a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d5010c010 0x7f4d501a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4ea00640 1 -- 172.21.15.84:0/2587015432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d501a2700 con 0x7f4d50105d80 2024-09-21T07:50:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.258+0000 7f4d4f400640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d5010c010 0x7f4d501a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.259+0000 7f4d4ea00640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d50105d80 0x7f4d5019c790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e9f0 tx=0x7f4d4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.259+0000 7f4d47e00640 1 -- 172.21.15.84:0/2587015432 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000cd80 con 0x7f4d50105d80 2024-09-21T07:50:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.259+0000 7f4d47e00640 1 -- 172.21.15.84:0/2587015432 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d400054d0 con 0x7f4d50105d80 2024-09-21T07:50:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.259+0000 7f4d47e00640 1 -- 172.21.15.84:0/2587015432 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40010690 con 0x7f4d50105d80 2024-09-21T07:50:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.259+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d501a29f0 con 0x7f4d50105d80 2024-09-21T07:50:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.259+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d501a9150 con 0x7f4d50105d80 2024-09-21T07:50:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.260+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d50106190 con 0x7f4d50105d80 2024-09-21T07:50:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.262+0000 7f4d47e00640 1 -- 172.21.15.84:0/2587015432 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f4d40004e30 con 0x7f4d50105d80 2024-09-21T07:50:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.264+0000 7f4d47e00640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d340b6560 0x7f4d340b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.264+0000 7f4d47e00640 1 -- 172.21.15.84:0/2587015432 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4d400e7e60 con 0x7f4d50105d80 2024-09-21T07:50:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.264+0000 7f4d46000640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d340b6560 0x7f4d340b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.265+0000 7f4d46000640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d340b6560 0x7f4d340b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d501050c0 tx=0x7f4d3800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.266+0000 7f4d47e00640 1 -- 172.21.15.84:0/2587015432 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d40056710 con 0x7f4d50105d80 2024-09-21T07:50:07.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:07 smithi191 ceph-mon[34667]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:07.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:07 smithi191 ceph-mon[34667]: pgmap v364: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T07:50:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.462+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4d5010de60 con 0x7f4d340b6560 2024-09-21T07:50:07.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:07 smithi084 ceph-mon[30411]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:07.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:07 smithi084 ceph-mon[30411]: pgmap v364: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T07:50:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.463+0000 7f4d47e00640 1 -- 172.21.15.84:0/2587015432 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4d5010de60 con 0x7f4d340b6560 2024-09-21T07:50:07.465 INFO:teuthology.orchestra.run.smithi084.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T07:50:07.465 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WF400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-21T07:50:07.465 INFO:teuthology.orchestra.run.smithi084.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:50:07.466 INFO:teuthology.orchestra.run.smithi084.stdout:smithi191 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303008M400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:50:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d340b6560 msgr2=0x7f4d340b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d340b6560 0x7f4d340b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d501050c0 tx=0x7f4d3800b410 comp rx=0 tx=0).stop 2024-09-21T07:50:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d50105d80 msgr2=0x7f4d5019c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d50105d80 0x7f4d5019c790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e9f0 tx=0x7f4d4000edf0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 shutdown_connections 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d340b6560 0x7f4d340b8a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d5010c010 0x7f4d501a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d5010b6c0 0x7f4d5019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 --2- 172.21.15.84:0/2587015432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d50105d80 0x7f4d5019c790 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.466+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 >> 172.21.15.84:0/2587015432 conn(0x7f4d50101810 msgr2=0x7f4d50108c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.467+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 shutdown_connections 2024-09-21T07:50:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:07.467+0000 7f4d55800640 1 -- 172.21.15.84:0/2587015432 wait complete. 2024-09-21T07:50:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:07 smithi162 ceph-mon[34833]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:07.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:07 smithi162 ceph-mon[34833]: pgmap v364: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T07:50:08.151 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:50:08.168 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T07:50:08.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T07:50:08.537 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 -- 172.21.15.84:0/1425408065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 msgr2=0x7fe7e4110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1425408065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e4110470 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009ca0 tx=0x7fe7dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 -- 172.21.15.84:0/1425408065 shutdown_connections 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1425408065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e4110470 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1425408065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7e41092f0 0x7fe7e4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1425408065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e41039b0 0x7fe7e4103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 -- 172.21.15.84:0/1425408065 >> 172.21.15.84:0/1425408065 conn(0x7fe7e40ff440 msgr2=0x7fe7e4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 -- 172.21.15.84:0/1425408065 shutdown_connections 2024-09-21T07:50:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.078+0000 7fe7e9400640 1 -- 172.21.15.84:0/1425408065 wait complete. 2024-09-21T07:50:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.079+0000 7fe7e9400640 1 Processor -- start 2024-09-21T07:50:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.079+0000 7fe7e9400640 1 -- start start 2024-09-21T07:50:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e41039b0 0x7fe7e419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7e41092f0 0x7fe7e419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e41a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e9400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e4113900 con 0x7fe7e4109c40 2024-09-21T07:50:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e4113780 con 0x7fe7e41039b0 2024-09-21T07:50:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e9400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e4113a80 con 0x7fe7e41092f0 2024-09-21T07:50:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e41a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e41a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47776/0 (socket says 172.21.15.84:47776) 2024-09-21T07:50:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e8a00640 1 -- 172.21.15.84:0/1390288135 learned_addr learned my addr 172.21.15.84:0/1390288135 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e3e00640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e41039b0 0x7fe7e419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.080+0000 7fe7e3400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7e41092f0 0x7fe7e419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e3e00640 1 -- 172.21.15.84:0/1390288135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7e41092f0 msgr2=0x7fe7e419ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e3e00640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7e41092f0 0x7fe7e419ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e3e00640 1 -- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 msgr2=0x7fe7e41a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e3e00640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e41a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e3e00640 1 -- 172.21.15.84:0/1390288135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e41a2440 con 0x7fe7e41039b0 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e8a00640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e41a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e3400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7e41092f0 0x7fe7e419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e3e00640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e41039b0 0x7fe7e419c4d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400e9f0 tx=0x7fe7d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.081+0000 7fe7e0c00640 1 -- 172.21.15.84:0/1390288135 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400ccc0 con 0x7fe7e41039b0 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.082+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e41a2730 con 0x7fe7e41039b0 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.082+0000 7fe7e0c00640 1 -- 172.21.15.84:0/1390288135 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7d40108e0 con 0x7fe7e41039b0 2024-09-21T07:50:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.082+0000 7fe7e0c00640 1 -- 172.21.15.84:0/1390288135 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4018880 con 0x7fe7e41039b0 2024-09-21T07:50:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.082+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e41a8e90 con 0x7fe7e41039b0 2024-09-21T07:50:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.083+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e4103dc0 con 0x7fe7e41039b0 2024-09-21T07:50:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.085+0000 7fe7e0c00640 1 -- 172.21.15.84:0/1390288135 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fe7d4010430 con 0x7fe7e41039b0 2024-09-21T07:50:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.087+0000 7fe7e0c00640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7c80b6560 0x7fe7c80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.087+0000 7fe7e0c00640 1 -- 172.21.15.84:0/1390288135 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe7d40e7fc0 con 0x7fe7e41039b0 2024-09-21T07:50:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.087+0000 7fe7e3400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7c80b6560 0x7fe7c80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.088+0000 7fe7e3400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7c80b6560 0x7fe7c80b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe7e41059f0 tx=0x7fe7d0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.089+0000 7fe7e0c00640 1 -- 172.21.15.84:0/1390288135 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7d40b27a0 con 0x7fe7e41039b0 2024-09-21T07:50:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:09 smithi084 ceph-mon[30411]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:09.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:09 smithi084 ceph-mon[30411]: pgmap v365: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T07:50:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.316+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe7e41a9200 con 0x7fe7e41039b0 2024-09-21T07:50:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.317+0000 7fe7e0c00640 1 -- 172.21.15.84:0/1390288135 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3142 (secure 0 0 0) 0x7fe7d40b76e0 con 0x7fe7e41039b0 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:e28 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:btime 2024-09-21T07:48:35:141169+0000 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 28 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T07:50:09.320 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-09-21T07:47:41.706708+0000 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-09-21T07:48:35.141139+0000 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 300 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 5 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1,2,3,4 2024-09-21T07:50:09.321 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24746,1=24742,2=24724,3=24719,4=24712} 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3,4] 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 0 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 24746 members: 24746,24742,24724,24719,24712 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b{0:24746} state up:active seq 5 addr [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d{0:24697} state up:standby-replay seq 1 addr [v2:172.21.15.84:6836/1436382958,v1:172.21.15.84:6837/1436382958] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.i{1:24742} state up:active seq 19 addr [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.322 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.e{1:24695} state up:standby-replay seq 1 addr [v2:172.21.15.162:6834/2049364491,v1:172.21.15.162:6835/2049364491] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c{2:24724} state up:active seq 21 addr [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.l{2:24667} state up:standby-replay seq 1 addr [v2:172.21.15.191:6832/2170041322,v1:172.21.15.191:6833/2170041322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.h{3:24719} state up:active seq 21 addr [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.k{3:24662} state up:standby-replay seq 1 addr [v2:172.21.15.162:6832/1671465182,v1:172.21.15.162:6833/1671465182] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.f{4:24712} state up:active seq 22 addr [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a{4:14757} state up:standby-replay seq 1 addr [v2:172.21.15.84:6840/1397513983,v1:172.21.15.84:6841/1397513983] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.j{-1:14685} state up:standby seq 1 addr [v2:172.21.15.84:6834/1263089342,v1:172.21.15.84:6835/1263089342] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.323 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.g{-1:14751} state up:standby seq 1 addr [v2:172.21.15.84:6838/2332299014,v1:172.21.15.84:6839/2332299014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:50:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-09-21T07:50:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.319+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7c80b6560 msgr2=0x7fe7c80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7c80b6560 0x7fe7c80b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe7e41059f0 tx=0x7fe7d0005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e41039b0 msgr2=0x7fe7e419c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e41039b0 0x7fe7e419c4d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400e9f0 tx=0x7fe7d400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 shutdown_connections 2024-09-21T07:50:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe7c80b6560 0x7fe7c80b8a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e4109c40 0x7fe7e41a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7e41092f0 0x7fe7e419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 --2- 172.21.15.84:0/1390288135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e41039b0 0x7fe7e419c4d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 >> 172.21.15.84:0/1390288135 conn(0x7fe7e40ff440 msgr2=0x7fe7e4108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 shutdown_connections 2024-09-21T07:50:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:09.320+0000 7fe7e9400640 1 -- 172.21.15.84:0/1390288135 wait complete. 2024-09-21T07:50:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:09 smithi191 ceph-mon[34667]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:09.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:09 smithi191 ceph-mon[34667]: pgmap v365: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T07:50:09.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:09 smithi162 ceph-mon[34833]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:09.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:09 smithi162 ceph-mon[34833]: pgmap v365: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T07:50:10.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T07:50:10.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:10 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1390288135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:50:10.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:10 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1390288135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:50:10.411 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:10.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:10 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1390288135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:50:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 -- 172.21.15.84:0/3932595442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8684105d80 msgr2=0x7f8684106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 --2- 172.21.15.84:0/3932595442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8684105d80 0x7f8684106190 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8674009900 tx=0x7f867402a410 comp rx=0 tx=0).stop 2024-09-21T07:50:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 -- 172.21.15.84:0/3932595442 shutdown_connections 2024-09-21T07:50:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 --2- 172.21.15.84:0/3932595442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f868410c010 0x7f8684112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 --2- 172.21.15.84:0/3932595442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f868410b6c0 0x7f868410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 --2- 172.21.15.84:0/3932595442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8684105d80 0x7f8684106190 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 -- 172.21.15.84:0/3932595442 >> 172.21.15.84:0/3932595442 conn(0x7f8684101810 msgr2=0x7f8684103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:11.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 -- 172.21.15.84:0/3932595442 shutdown_connections 2024-09-21T07:50:11.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.021+0000 7f8689e00640 1 -- 172.21.15.84:0/3932595442 wait complete. 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.022+0000 7f8689e00640 1 Processor -- start 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.022+0000 7f8689e00640 1 -- start start 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.022+0000 7f8689e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8684105d80 0x7f868419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.022+0000 7f8689e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f868410b6c0 0x7f868419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.022+0000 7f8689e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f868410c010 0x7f86841a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8689e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8684115cd0 con 0x7f868410c010 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8689e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8684115b50 con 0x7f868410b6c0 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8689e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8684115e50 con 0x7f8684105d80 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8683400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f868410c010 0x7f86841a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8682000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f868410b6c0 0x7f868419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8682000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f868410b6c0 0x7f868419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52620/0 (socket says 172.21.15.84:52620) 2024-09-21T07:50:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8682000640 1 -- 172.21.15.84:0/3754473880 learned_addr learned my addr 172.21.15.84:0/3754473880 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8683400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f868410c010 0x7f86841a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47786/0 (socket says 172.21.15.84:47786) 2024-09-21T07:50:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8682a00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8684105d80 0x7f868419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8683400640 1 -- 172.21.15.84:0/3754473880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8684105d80 msgr2=0x7f868419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8683400640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8684105d80 0x7f868419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8683400640 1 -- 172.21.15.84:0/3754473880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f868410b6c0 msgr2=0x7f868419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8683400640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f868410b6c0 0x7f868419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.023+0000 7f8683400640 1 -- 172.21.15.84:0/3754473880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86841a2650 con 0x7f868410c010 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.024+0000 7f8683400640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f868410c010 0x7f86841a1f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f867c009fd0 tx=0x7f867c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.024+0000 7f8688a00640 1 -- 172.21.15.84:0/3754473880 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c00ce20 con 0x7f868410c010 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.024+0000 7f8688a00640 1 -- 172.21.15.84:0/3754473880 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f867c005020 con 0x7f868410c010 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.024+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86841a2940 con 0x7f868410c010 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.024+0000 7f8688a00640 1 -- 172.21.15.84:0/3754473880 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c010690 con 0x7f868410c010 2024-09-21T07:50:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.024+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86841a90a0 con 0x7f868410c010 2024-09-21T07:50:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.025+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8684106190 con 0x7f868410c010 2024-09-21T07:50:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.028+0000 7f8688a00640 1 -- 172.21.15.84:0/3754473880 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f867c0054d0 con 0x7f868410c010 2024-09-21T07:50:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.030+0000 7f8688a00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86680b6560 0x7f86680b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.030+0000 7f8688a00640 1 -- 172.21.15.84:0/3754473880 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f867c0e7f50 con 0x7f868410c010 2024-09-21T07:50:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.030+0000 7f8682a00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86680b6560 0x7f86680b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:11.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.031+0000 7f8682a00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86680b6560 0x7f86680b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8674031440 tx=0x7f8674005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:11.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.032+0000 7f8688a00640 1 -- 172.21.15.84:0/3754473880 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f867c0ae350 con 0x7f868410c010 2024-09-21T07:50:11.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.225+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f868419d810 con 0x7f868410c010 2024-09-21T07:50:11.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.226+0000 7f8688a00640 1 -- 172.21.15.84:0/3754473880 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+6022 (secure 0 0 0) 0x7f868419d810 con 0x7f868410c010 2024-09-21T07:50:11.228 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 88 2024-09-21T07:50:11.228 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T07:50:11.228 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-09-21T07:38:31.274442+0000 2024-09-21T07:50:11.228 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-09-21T07:49:31.146906+0000 2024-09-21T07:50:11.228 INFO:teuthology.orchestra.run.smithi084.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:crush_version 27 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:full_ratio 0.95 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:backfillfull_ratio 0.9 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:nearfull_ratio 0.85 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:require_min_compat_client luminous 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:min_compat_client luminous 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:require_osd_release squid 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:stretch_mode_enabled false 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:max_osd 12 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 up in weight 1 up_from 9 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6802/2767669406,v1:172.21.15.84:6803/2767669406] [v2:172.21.15.84:6804/2767669406,v1:172.21.15.84:6805/2767669406] exists,up fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6 2024-09-21T07:50:11.229 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 up in weight 1 up_from 14 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/4003571360,v1:172.21.15.162:6801/4003571360] [v2:172.21.15.162:6802/4003571360,v1:172.21.15.162:6803/4003571360] exists,up f441b5fe-ade0-49aa-946a-a46da421c736 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/2171931700,v1:172.21.15.191:6801/2171931700] [v2:172.21.15.191:6802/2171931700,v1:172.21.15.191:6803/2171931700] exists,up 247eb882-3ff7-474e-9367-aaadc4e26a59 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6810/3656047347,v1:172.21.15.84:6811/3656047347] [v2:172.21.15.84:6812/3656047347,v1:172.21.15.84:6813/3656047347] exists,up b309008a-7e80-4b28-bfa7-9ae80c749072 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 up in weight 1 up_from 31 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/1714263086,v1:172.21.15.162:6809/1714263086] [v2:172.21.15.162:6810/1714263086,v1:172.21.15.162:6811/1714263086] exists,up ad64fba4-4313-4086-9c0e-67226e9c6b23 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 up in weight 1 up_from 36 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6808/2672945398,v1:172.21.15.191:6809/2672945398] [v2:172.21.15.191:6810/2672945398,v1:172.21.15.191:6811/2672945398] exists,up d23cf2e7-5411-45c7-9a4d-c7ca9eccd062 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 up in weight 1 up_from 42 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6818/3031329443,v1:172.21.15.84:6819/3031329443] [v2:172.21.15.84:6820/3031329443,v1:172.21.15.84:6821/3031329443] exists,up 56fec50e-104d-4e8d-aa85-455f1d25bbcc 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/328134245,v1:172.21.15.162:6817/328134245] [v2:172.21.15.162:6818/328134245,v1:172.21.15.162:6819/328134245] exists,up 64539985-2656-47f9-b200-bf9d6cc097a2 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.8 up in weight 1 up_from 53 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6816/1349047550,v1:172.21.15.191:6817/1349047550] [v2:172.21.15.191:6818/1349047550,v1:172.21.15.191:6819/1349047550] exists,up 3edf476b-1d78-4981-b8fe-c4a12b2f294b 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.9 up in weight 1 up_from 59 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6826/3430065825,v1:172.21.15.84:6827/3430065825] [v2:172.21.15.84:6828/3430065825,v1:172.21.15.84:6829/3430065825] exists,up 57b9d175-b40d-444d-9ff4-fee6682fb3b2 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.10 up in weight 1 up_from 64 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/2712516619,v1:172.21.15.162:6825/2712516619] [v2:172.21.15.162:6826/2712516619,v1:172.21.15.162:6827/2712516619] exists,up e440b17d-d229-459b-82ab-3f60f7842cfa 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:osd.11 up in weight 1 up_from 69 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6824/577807248,v1:172.21.15.191:6825/577807248] [v2:172.21.15.191:6826/577807248,v1:172.21.15.191:6827/577807248] exists,up 52ebe031-ba58-4e7f-9172-3a61ac5cedaa 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.13 [2,11] 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T07:50:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.1c [8,11] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.11 [4,6] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.18 [3,9] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.21 [4,8,5,9] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.2c [4,9] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.2 [9,1] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.6 [5,8] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.17 [9,8] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.18 [9,8] 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/2305492953 expires 2024-09-22T07:40:29.868163+0000 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3844740807 expires 2024-09-22T07:40:29.868163+0000 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/2263664999 expires 2024-09-22T07:40:29.868163+0000 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/1624480162 expires 2024-09-22T07:38:56.444167+0000 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/1624480162 expires 2024-09-22T07:38:56.444167+0000 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/4171591464 expires 2024-09-22T07:39:25.647588+0000 2024-09-21T07:50:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/963010449 expires 2024-09-22T07:40:29.868163+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/2499433199 expires 2024-09-22T07:38:56.444167+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/2887533754 expires 2024-09-22T07:39:25.647588+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3074211591 expires 2024-09-22T07:38:56.444167+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/1079969130 expires 2024-09-22T07:38:56.444167+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/4129963413 expires 2024-09-22T07:39:25.647588+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/963010449 expires 2024-09-22T07:40:29.868163+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/4129963413 expires 2024-09-22T07:39:25.647588+0000 2024-09-21T07:50:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/253258973 expires 2024-09-22T07:39:25.647588+0000 2024-09-21T07:50:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.228+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86680b6560 msgr2=0x7f86680b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.228+0000 7f8689e00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86680b6560 0x7f86680b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8674031440 tx=0x7f8674005d50 comp rx=0 tx=0).stop 2024-09-21T07:50:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.228+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f868410c010 msgr2=0x7f86841a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.228+0000 7f8689e00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f868410c010 0x7f86841a1f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f867c009fd0 tx=0x7f867c00ef10 comp rx=0 tx=0).stop 2024-09-21T07:50:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 shutdown_connections 2024-09-21T07:50:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86680b6560 0x7f86680b8a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f868410c010 0x7f86841a1f20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f868410b6c0 0x7f868419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 --2- 172.21.15.84:0/3754473880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8684105d80 0x7f868419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 >> 172.21.15.84:0/3754473880 conn(0x7f8684101810 msgr2=0x7f8684103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 shutdown_connections 2024-09-21T07:50:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:11.229+0000 7f8689e00640 1 -- 172.21.15.84:0/3754473880 wait complete. 2024-09-21T07:50:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:11 smithi191 ceph-mon[34667]: pgmap v366: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:50:11.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:11 smithi162 ceph-mon[34833]: pgmap v366: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:50:11.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:11 smithi084 ceph-mon[30411]: pgmap v366: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:50:11.989 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T07:50:12.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:50:12.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:12 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3754473880' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:50:12.371 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:12.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:12 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3754473880' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:50:12.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:12 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3754473880' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.968+0000 7f9d93e00640 1 -- 172.21.15.84:0/4122006946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d941092f0 msgr2=0x7f9d94109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.968+0000 7f9d93e00640 1 --2- 172.21.15.84:0/4122006946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d941092f0 0x7f9d94109700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009900 tx=0x7f9d7c02a410 comp rx=0 tx=0).stop 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.969+0000 7f9d93e00640 1 -- 172.21.15.84:0/4122006946 shutdown_connections 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.969+0000 7f9d93e00640 1 --2- 172.21.15.84:0/4122006946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d94109c40 0x7f9d94110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.969+0000 7f9d93e00640 1 --2- 172.21.15.84:0/4122006946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d941092f0 0x7f9d94109700 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.969+0000 7f9d93e00640 1 --2- 172.21.15.84:0/4122006946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d941039b0 0x7f9d94103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.969+0000 7f9d93e00640 1 -- 172.21.15.84:0/4122006946 >> 172.21.15.84:0/4122006946 conn(0x7f9d940ff440 msgr2=0x7f9d94101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.969+0000 7f9d93e00640 1 -- 172.21.15.84:0/4122006946 shutdown_connections 2024-09-21T07:50:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.969+0000 7f9d93e00640 1 -- 172.21.15.84:0/4122006946 wait complete. 2024-09-21T07:50:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.970+0000 7f9d93e00640 1 Processor -- start 2024-09-21T07:50:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.970+0000 7f9d93e00640 1 -- start start 2024-09-21T07:50:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.970+0000 7f9d93e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d941039b0 0x7f9d9419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d93e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d941092f0 0x7f9d9419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d93e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d94109c40 0x7f9d9419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d93e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94113950 con 0x7f9d94109c40 2024-09-21T07:50:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d93e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d941137d0 con 0x7f9d941039b0 2024-09-21T07:50:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d93e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94113ad0 con 0x7f9d941092f0 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d93400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d94109c40 0x7f9d9419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d941039b0 0x7f9d9419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d941039b0 0x7f9d9419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52638/0 (socket says 172.21.15.84:52638) 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d93400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d94109c40 0x7f9d9419fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47796/0 (socket says 172.21.15.84:47796) 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 -- 172.21.15.84:0/3125084921 learned_addr learned my addr 172.21.15.84:0/3125084921 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d8a000640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d941092f0 0x7f9d9419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 -- 172.21.15.84:0/3125084921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d941092f0 msgr2=0x7f9d9419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d941092f0 0x7f9d9419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 -- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d94109c40 msgr2=0x7f9d9419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d94109c40 0x7f9d9419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.971+0000 7f9d92a00640 1 -- 172.21.15.84:0/3125084921 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d941a0270 con 0x7f9d941039b0 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.972+0000 7f9d92a00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d941039b0 0x7f9d9419a300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400eb90 tx=0x7f9d8400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.972+0000 7f9d98a00640 1 -- 172.21.15.84:0/3125084921 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84004d20 con 0x7f9d941039b0 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.972+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d941a0560 con 0x7f9d941039b0 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.972+0000 7f9d98a00640 1 -- 172.21.15.84:0/3125084921 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d8400ee90 con 0x7f9d941039b0 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.972+0000 7f9d98a00640 1 -- 172.21.15.84:0/3125084921 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84010670 con 0x7f9d941039b0 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.972+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d941a6cc0 con 0x7f9d941039b0 2024-09-21T07:50:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.973+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d94103dc0 con 0x7f9d941039b0 2024-09-21T07:50:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.976+0000 7f9d98a00640 1 -- 172.21.15.84:0/3125084921 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f9d84010850 con 0x7f9d941039b0 2024-09-21T07:50:12.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.977+0000 7f9d98a00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9d780b6560 0x7f9d780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:12.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.977+0000 7f9d98a00640 1 -- 172.21.15.84:0/3125084921 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f9d840e7ff0 con 0x7f9d941039b0 2024-09-21T07:50:12.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.977+0000 7f9d8a000640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9d780b6560 0x7f9d780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:12.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.978+0000 7f9d8a000640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9d780b6560 0x7f9d780b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02aa00 tx=0x7f9d7c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:12.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:12.979+0000 7f9d98a00640 1 -- 172.21.15.84:0/3125084921 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d84056710 con 0x7f9d941039b0 2024-09-21T07:50:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.208+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d9419b430 con 0x7f9d941039b0 2024-09-21T07:50:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.209+0000 7f9d98a00640 1 -- 172.21.15.84:0/3125084921 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11993 (secure 0 0 0) 0x7f9d840ae3f0 con 0x7f9d941039b0 2024-09-21T07:50:13.211 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:13.212 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"btime":"2024-09-21T07:48:35:141169+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:48:35.141139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24746,24742,24724,24719,24712]},"id":1}]} 2024-09-21T07:50:13.212 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9d780b6560 msgr2=0x7f9d780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9d780b6560 0x7f9d780b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02aa00 tx=0x7f9d7c005a20 comp rx=0 tx=0).stop 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d941039b0 msgr2=0x7f9d9419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d941039b0 0x7f9d9419a300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400eb90 tx=0x7f9d8400c6a0 comp rx=0 tx=0).stop 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 shutdown_connections 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9d780b6560 0x7f9d780b8a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d94109c40 0x7f9d9419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d941092f0 0x7f9d9419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:13.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 --2- 172.21.15.84:0/3125084921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d941039b0 0x7f9d9419a300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:13.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 >> 172.21.15.84:0/3125084921 conn(0x7f9d940ff440 msgr2=0x7f9d94101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:13.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 shutdown_connections 2024-09-21T07:50:13.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:13.212+0000 7f9d93e00640 1 -- 172.21.15.84:0/3125084921 wait complete. 2024-09-21T07:50:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:13 smithi191 ceph-mon[34667]: pgmap v367: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:50:13.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:13 smithi084 ceph-mon[30411]: pgmap v367: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:50:13.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:13 smithi162 ceph-mon[34833]: pgmap v367: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T07:50:13.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:50:14.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:14 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3125084921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:14.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:14 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3125084921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:14.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:14 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3125084921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:14.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.908+0000 7fe0cd400640 1 -- 172.21.15.84:0/624978652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 msgr2=0x7fe0c8106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.908+0000 7fe0cd400640 1 --2- 172.21.15.84:0/624978652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c8106190 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009900 tx=0x7fe0b802a410 comp rx=0 tx=0).stop 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.909+0000 7fe0cd400640 1 -- 172.21.15.84:0/624978652 shutdown_connections 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.909+0000 7fe0cd400640 1 --2- 172.21.15.84:0/624978652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0c810c010 0x7fe0c8112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.909+0000 7fe0cd400640 1 --2- 172.21.15.84:0/624978652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c810b6c0 0x7fe0c810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.909+0000 7fe0cd400640 1 --2- 172.21.15.84:0/624978652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c8106190 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.909+0000 7fe0cd400640 1 -- 172.21.15.84:0/624978652 >> 172.21.15.84:0/624978652 conn(0x7fe0c8101810 msgr2=0x7fe0c8103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.909+0000 7fe0cd400640 1 -- 172.21.15.84:0/624978652 shutdown_connections 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.909+0000 7fe0cd400640 1 -- 172.21.15.84:0/624978652 wait complete. 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 Processor -- start 2024-09-21T07:50:14.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 -- start start 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c810b6c0 0x7fe0c819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0c810c010 0x7fe0c81a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8115d20 con 0x7fe0c8105d80 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8115ba0 con 0x7fe0c810c010 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.910+0000 7fe0cd400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8115ea0 con 0x7fe0c810b6c0 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47806/0 (socket says 172.21.15.84:47806) 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 -- 172.21.15.84:0/902459161 learned_addr learned my addr 172.21.15.84:0/902459161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:14.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0bde00640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c810b6c0 0x7fe0c819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c7200640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0c810c010 0x7fe0c81a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 -- 172.21.15.84:0/902459161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c810b6c0 msgr2=0x7fe0c819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c810b6c0 0x7fe0c819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 -- 172.21.15.84:0/902459161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0c810c010 msgr2=0x7fe0c81a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0c810c010 0x7fe0c81a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.911+0000 7fe0c6800640 1 -- 172.21.15.84:0/902459161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c81a2660 con 0x7fe0c8105d80 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.912+0000 7fe0c6800640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c819c6f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8005ab0 tx=0x7fe0b8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.912+0000 7fe0bfe00640 1 -- 172.21.15.84:0/902459161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b803f070 con 0x7fe0c8105d80 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.912+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c81a28f0 con 0x7fe0c8105d80 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.912+0000 7fe0bfe00640 1 -- 172.21.15.84:0/902459161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b8031d60 con 0x7fe0c8105d80 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.912+0000 7fe0bfe00640 1 -- 172.21.15.84:0/902459161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8035030 con 0x7fe0c8105d80 2024-09-21T07:50:14.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.912+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c81a90b0 con 0x7fe0c8105d80 2024-09-21T07:50:14.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.913+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c8106190 con 0x7fe0c8105d80 2024-09-21T07:50:14.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.915+0000 7fe0bfe00640 1 -- 172.21.15.84:0/902459161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fe0b8042070 con 0x7fe0c8105d80 2024-09-21T07:50:14.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.917+0000 7fe0bfe00640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe0ac0b6560 0x7fe0ac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:14.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.917+0000 7fe0bfe00640 1 -- 172.21.15.84:0/902459161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe0b81085d0 con 0x7fe0c8105d80 2024-09-21T07:50:14.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.917+0000 7fe0bde00640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe0ac0b6560 0x7fe0ac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:14.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.918+0000 7fe0bde00640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe0ac0b6560 0x7fe0ac0b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe0c810b190 tx=0x7fe0b0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:14.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:14.919+0000 7fe0bfe00640 1 -- 172.21.15.84:0/902459161 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0b80d2db0 con 0x7fe0c8105d80 2024-09-21T07:50:15.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.150+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0c810de10 con 0x7fe0c8105d80 2024-09-21T07:50:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.150+0000 7fe0bfe00640 1 -- 172.21.15.84:0/902459161 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11993 (secure 0 0 0) 0x7fe0b80d7cf0 con 0x7fe0c8105d80 2024-09-21T07:50:15.152 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:15.153 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"btime":"2024-09-21T07:48:35:141169+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:48:35.141139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24746,24742,24724,24719,24712]},"id":1}]} 2024-09-21T07:50:15.153 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-09-21T07:50:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe0ac0b6560 msgr2=0x7fe0ac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe0ac0b6560 0x7fe0ac0b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe0c810b190 tx=0x7fe0b0005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 msgr2=0x7fe0c819c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c819c6f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8005ab0 tx=0x7fe0b8003c80 comp rx=0 tx=0).stop 2024-09-21T07:50:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 shutdown_connections 2024-09-21T07:50:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe0ac0b6560 0x7fe0ac0b8a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0c810c010 0x7fe0c81a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c810b6c0 0x7fe0c819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 --2- 172.21.15.84:0/902459161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8105d80 0x7fe0c819c6f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 >> 172.21.15.84:0/902459161 conn(0x7fe0c8101810 msgr2=0x7fe0c8103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 shutdown_connections 2024-09-21T07:50:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:15.153+0000 7fe0cd400640 1 -- 172.21.15.84:0/902459161 wait complete. 2024-09-21T07:50:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:15 smithi191 ceph-mon[34667]: pgmap v368: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T07:50:15.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:15 smithi162 ceph-mon[34833]: pgmap v368: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T07:50:15.554 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:15 smithi084 ceph-mon[30411]: pgmap v368: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T07:50:15.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:50:16.270 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:16.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:16 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/902459161' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:16.408 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:16 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/902459161' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:16.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:16 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/902459161' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 -- 172.21.15.84:0/1337045863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 msgr2=0x7f6638109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 --2- 172.21.15.84:0/1337045863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f6638109700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6624009900 tx=0x7f662402a410 comp rx=0 tx=0).stop 2024-09-21T07:50:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 -- 172.21.15.84:0/1337045863 shutdown_connections 2024-09-21T07:50:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 --2- 172.21.15.84:0/1337045863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6638109c40 0x7f6638110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 --2- 172.21.15.84:0/1337045863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f6638109700 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 --2- 172.21.15.84:0/1337045863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66381039b0 0x7f6638103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 -- 172.21.15.84:0/1337045863 >> 172.21.15.84:0/1337045863 conn(0x7f66380ff440 msgr2=0x7f6638101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 -- 172.21.15.84:0/1337045863 shutdown_connections 2024-09-21T07:50:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.854+0000 7f663de00640 1 -- 172.21.15.84:0/1337045863 wait complete. 2024-09-21T07:50:16.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.855+0000 7f663de00640 1 Processor -- start 2024-09-21T07:50:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.855+0000 7f663de00640 1 -- start start 2024-09-21T07:50:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381039b0 0x7f663819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f663819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6638109c40 0x7f663819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663de00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6638113950 con 0x7f66381092f0 2024-09-21T07:50:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663de00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66381137d0 con 0x7f66381039b0 2024-09-21T07:50:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663de00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6638113ad0 con 0x7f6638109c40 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f6637e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f663819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f6637e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f663819a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47836/0 (socket says 172.21.15.84:47836) 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f6637e00640 1 -- 172.21.15.84:0/3892129434 learned_addr learned my addr 172.21.15.84:0/3892129434 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663ca00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381039b0 0x7f663819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.856+0000 7f663d400640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6638109c40 0x7f663819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6637e00640 1 -- 172.21.15.84:0/3892129434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6638109c40 msgr2=0x7f663819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6637e00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6638109c40 0x7f663819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6637e00640 1 -- 172.21.15.84:0/3892129434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381039b0 msgr2=0x7f663819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6637e00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381039b0 0x7f663819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6637e00640 1 -- 172.21.15.84:0/3892129434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66381a0290 con 0x7f66381092f0 2024-09-21T07:50:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6637e00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f663819a8c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6624005ab0 tx=0x7f6624003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6635600640 1 -- 172.21.15.84:0/3892129434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662403f070 con 0x7f66381092f0 2024-09-21T07:50:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6635600640 1 -- 172.21.15.84:0/3892129434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6624031b50 con 0x7f66381092f0 2024-09-21T07:50:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66381a0520 con 0x7f66381092f0 2024-09-21T07:50:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.857+0000 7f6635600640 1 -- 172.21.15.84:0/3892129434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624035030 con 0x7f66381092f0 2024-09-21T07:50:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.858+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66381a6ce0 con 0x7f66381092f0 2024-09-21T07:50:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.859+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6638103dc0 con 0x7f66381092f0 2024-09-21T07:50:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.863+0000 7f6635600640 1 -- 172.21.15.84:0/3892129434 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f6624042070 con 0x7f66381092f0 2024-09-21T07:50:16.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.864+0000 7f6635600640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f661c0b6560 0x7f661c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:16.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.864+0000 7f6635600640 1 -- 172.21.15.84:0/3892129434 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f66241080d0 con 0x7f66381092f0 2024-09-21T07:50:16.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.864+0000 7f663ca00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f661c0b6560 0x7f661c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:16.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.865+0000 7f663ca00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f661c0b6560 0x7f661c0b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6628005fd0 tx=0x7f6628009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:16.866+0000 7f6635600640 1 -- 172.21.15.84:0/3892129434 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66240d28f0 con 0x7f66381092f0 2024-09-21T07:50:17.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.057+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f663810ba40 con 0x7f66381092f0 2024-09-21T07:50:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.058+0000 7f6635600640 1 -- 172.21.15.84:0/3892129434 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+25144 (secure 0 0 0) 0x7f66240efe20 con 0x7f66381092f0 2024-09-21T07:50:17.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:17.061 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:49:31.146906+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f661c0b6560 msgr2=0x7f661c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f661c0b6560 0x7f661c0b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6628005fd0 tx=0x7f6628009500 comp rx=0 tx=0).stop 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 msgr2=0x7f663819a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f663819a8c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6624005ab0 tx=0x7f6624003b90 comp rx=0 tx=0).stop 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 shutdown_connections 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f661c0b6560 0x7f661c0b8a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6638109c40 0x7f663819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66381092f0 0x7f663819a8c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 --2- 172.21.15.84:0/3892129434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381039b0 0x7f663819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 >> 172.21.15.84:0/3892129434 conn(0x7f66380ff440 msgr2=0x7f6638101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 shutdown_connections 2024-09-21T07:50:17.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:17.061+0000 7f663de00640 1 -- 172.21.15.84:0/3892129434 wait complete. 2024-09-21T07:50:17.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:17 smithi191 ceph-mon[34667]: pgmap v369: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T07:50:17.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:17 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3892129434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:17.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:17 smithi084 ceph-mon[30411]: pgmap v369: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T07:50:17.417 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:17 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3892129434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:17.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:17 smithi162 ceph-mon[34833]: pgmap v369: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T07:50:17.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:17 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3892129434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:17.760 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:47:41.706708+0000', 'modified': '2024-09-21T07:48:35.141139+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24746, 'mds_1': 24742, 'mds_2': 24724, 'mds_3': 24719, 'mds_4': 24712}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14757': {'gid': 14757, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6841/1397513983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6840', 'nonce': 1397513983}, {'type': 'v1', 'addr': '172.21.15.84:6841', 'nonce': 1397513983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24662': {'gid': 24662, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6833/1671465182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1671465182}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1671465182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2170041322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2170041322}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2170041322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2049364491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2049364491}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2049364491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24697': {'gid': 24697, 'name': 'd', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6837/1436382958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1436382958}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1436382958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24712': {'gid': 24712, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.191:6835/1369621448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 1369621448}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 1369621448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24719': {'gid': 24719, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.162:6837/1733531268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 1733531268}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 1733531268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24724': {'gid': 24724, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.191:6837/2311233520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 2311233520}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2311233520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24742': {'gid': 24742, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.191:6839/2322343723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2322343723}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2322343723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24746': {'gid': 24746, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.162:6839/3948328826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 3948328826}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 3948328826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24746, 'qdb_cluster': [24746, 24742, 24724, 24719, 24712]} 2024-09-21T07:50:17.760 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:50:17.760 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T07:50:18.126 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 -- 172.21.15.84:0/3243607692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 msgr2=0x7f0f84112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 --2- 172.21.15.84:0/3243607692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f84112670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009ca0 tx=0x7f0f7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 -- 172.21.15.84:0/3243607692 shutdown_connections 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 --2- 172.21.15.84:0/3243607692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f84112670 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 --2- 172.21.15.84:0/3243607692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f8410b4f0 0x7f0f8410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 --2- 172.21.15.84:0/3243607692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f84105bb0 0x7f0f84105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 -- 172.21.15.84:0/3243607692 >> 172.21.15.84:0/3243607692 conn(0x7f0f84101680 msgr2=0x7f0f84103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:18.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 -- 172.21.15.84:0/3243607692 shutdown_connections 2024-09-21T07:50:18.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.871+0000 7f0f83200640 1 -- 172.21.15.84:0/3243607692 wait complete. 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 Processor -- start 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 -- start start 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f84105bb0 0x7f0f8419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f8410b4f0 0x7f0f8419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f841a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84115b50 con 0x7f0f8410be40 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f841159d0 con 0x7f0f8410b4f0 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.872+0000 7f0f83200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84115cd0 con 0x7f0f84105bb0 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f82800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f841a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f82800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f841a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32908/0 (socket says 172.21.15.84:32908) 2024-09-21T07:50:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f82800640 1 -- 172.21.15.84:0/2454800431 learned_addr learned my addr 172.21.15.84:0/2454800431 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:18.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f7be00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f8410b4f0 0x7f0f8419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f81e00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f84105bb0 0x7f0f8419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f7be00640 1 -- 172.21.15.84:0/2454800431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f84105bb0 msgr2=0x7f0f8419c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f7be00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f84105bb0 0x7f0f8419c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f7be00640 1 -- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 msgr2=0x7f0f841a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f7be00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f841a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f7be00640 1 -- 172.21.15.84:0/2454800431 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f841a2510 con 0x7f0f8410b4f0 2024-09-21T07:50:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.873+0000 7f0f82800640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f841a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.874+0000 7f0f7be00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f8410b4f0 0x7f0f8419cb40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f8406c8c0 tx=0x7f0f6c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.874+0000 7f0f7aa00640 1 -- 172.21.15.84:0/2454800431 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00cc40 con 0x7f0f8410b4f0 2024-09-21T07:50:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.874+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f841a2800 con 0x7f0f8410b4f0 2024-09-21T07:50:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.874+0000 7f0f7aa00640 1 -- 172.21.15.84:0/2454800431 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f6c00cde0 con 0x7f0f8410b4f0 2024-09-21T07:50:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.874+0000 7f0f7aa00640 1 -- 172.21.15.84:0/2454800431 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c004a00 con 0x7f0f8410b4f0 2024-09-21T07:50:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.874+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f841a8f60 con 0x7f0f8410b4f0 2024-09-21T07:50:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.878+0000 7f0f8fc99740 1 Processor -- start 2024-09-21T07:50:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.878+0000 7f0f8fc99740 1 -- start start 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3178670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba3178bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba31790f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dba30efd50 con 0x55dba2dd1f60 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dba30df180 con 0x55dba2db1280 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dba30e2f90 con 0x55dba2da90a0 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f82800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3178670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f81e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba3178bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f82800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3178670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32910/0 (socket says 172.21.15.84:32910) 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f82800640 1 -- 172.21.15.84:0/1266325842 learned_addr learned my addr 172.21.15.84:0/1266325842 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f7aa00640 1 -- 172.21.15.84:0/2454800431 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f0f6c004ba0 con 0x7f0f8410b4f0 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.879+0000 7f0f81e00640 1 -- 172.21.15.84:0/1266325842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 msgr2=0x55dba31790f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f81e00640 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba31790f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f81e00640 1 -- 172.21.15.84:0/1266325842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 msgr2=0x55dba3178670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f81e00640 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3178670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f81e00640 1 -- 172.21.15.84:0/1266325842 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba30a9a70 con 0x55dba2da90a0 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f82800640 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3178670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f81e00640 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba3178bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005fd0 tx=0x7f0f740107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed1199128879c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f73400640 1 -- 172.21.15.84:0/1266325842 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7401c480 con 0x55dba2da90a0 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f73400640 1 -- 172.21.15.84:0/1266325842 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f7401cad0 con 0x55dba2da90a0 2024-09-21T07:50:18.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.880+0000 7f0f73400640 1 -- 172.21.15.84:0/1266325842 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74011af0 con 0x55dba2da90a0 2024-09-21T07:50:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 -- 172.21.15.84:0/1266325842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 msgr2=0x55dba3178bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba3178bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005fd0 tx=0x7f0f740107a0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 -- 172.21.15.84:0/1266325842 shutdown_connections 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba31790f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba3178bb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/1266325842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3178670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 -- 172.21.15.84:0/1266325842 >> 172.21.15.84:0/1266325842 conn(0x55dba2dc6350 msgr2=0x55dba3176560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 -- 172.21.15.84:0/1266325842 shutdown_connections 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f8fc99740 1 -- 172.21.15.84:0/1266325842 wait complete. 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.881+0000 7f0f7aa00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0f680b6510 0x7f0f680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.882+0000 7f0f7aa00640 1 -- 172.21.15.84:0/2454800431 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0f6c0e76a0 con 0x7f0f8410b4f0 2024-09-21T07:50:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.882+0000 7f0f81e00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0f680b6510 0x7f0f680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.882+0000 7f0f8fc99740 1 -- start start 2024-09-21T07:50:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.882+0000 7f0f8fc99740 1 Processor -- start 2024-09-21T07:50:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.882+0000 7f0f81e00640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0f680b6510 0x7f0f680b8a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f74011750 tx=0x7f0f74000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba31842a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3184840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2dd1f60 0x55dba3190140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dba2f405f0 con 0x55dba2da90a0 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dba307a460 con 0x55dba2db1280 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dba3186e50 con 0x55dba2dd1f60 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f8fc99740 10 client.0 _ll_register_callbacks cb 0x55dba308a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f81e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba31842a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f7be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3184840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f81e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba31842a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32912/0 (socket says 172.21.15.84:32912) 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f81e00640 1 -- 172.21.15.84:0/102776082 learned_addr learned my addr 172.21.15.84:0/102776082 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.883+0000 7f0f82800640 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2dd1f60 0x55dba3190140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f7be00640 1 -- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2dd1f60 msgr2=0x55dba3190140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f7be00640 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2dd1f60 0x55dba3190140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f7be00640 1 -- 172.21.15.84:0/102776082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 msgr2=0x55dba31842a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f7be00640 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba31842a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f7be00640 1 -- 172.21.15.84:0/102776082 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba2e3d540 con 0x55dba2db1280 2024-09-21T07:50:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f81e00640 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba31842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f7be00640 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3184840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0e4d20 tx=0x7f0f6c005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ab58cb39f7c2bad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f67e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:50:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f67e00640 1 -- 172.21.15.84:0/102776082 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c01c040 con 0x55dba2db1280 2024-09-21T07:50:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f67e00640 1 -- 172.21.15.84:0/102776082 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0f6c0ac840 con 0x55dba2db1280 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.884+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dba307ca70 con 0x55dba2db1280 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f67e00640 1 -- 172.21.15.84:0/102776082 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f6c0acef0 con 0x55dba2db1280 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 10 client.25331 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dba30976f0 con 0x55dba2db1280 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f67e00640 1 -- 172.21.15.84:0/102776082 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dba307ca70 con 0x55dba2db1280 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f67e00640 1 -- 172.21.15.84:0/102776082 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0f6c096c10 con 0x55dba2db1280 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 10 client.25331 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 10 client.25331 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 20 client.25331 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d908e0 0x55dba3196710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 4 client.25331 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.885+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dba30f1ca0 con 0x55dba2d908e0 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.886+0000 7f0f81e00640 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d908e0 0x55dba3196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.886+0000 7f0f81e00640 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d908e0 0x55dba3196710 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5052d6351b90634f server_cookie=906df57d046a4cd3 in_seq=0 out_seq=0 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.886+0000 7f0f67e00640 10 client.25331 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:50:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.887+0000 7f0f67e00640 1 -- 172.21.15.84:0/102776082 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dba30f1ca0 con 0x55dba2d908e0 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.887+0000 7f0f67e00640 10 client.25331 handle_command_reply: tid=0 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.887+0000 7f0f8fc99740 1 client.25331 shutdown 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 msgr2=0x55dba3184840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3184840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0e4d20 tx=0x7f0f6c005250 comp rx=0 tx=0).stop 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 shutdown_connections 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d908e0 0x55dba3196710 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2dd1f60 0x55dba3190140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3184840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/102776082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba31842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f67e00640 0 client.25331 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 >> 172.21.15.84:0/102776082 conn(0x55dba2dc6350 msgr2=0x55dba317b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 shutdown_connections 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 1 -- 172.21.15.84:0/102776082 wait complete. 2024-09-21T07:50:18.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.888+0000 7f0f8fc99740 20 client.25331 trim_cache size 0 max 16384 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 Processor -- start 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 -- start start 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba31902c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3190800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3184280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dba3194a50 con 0x55dba2dd1f60 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dba3195120 con 0x55dba2db1280 2024-09-21T07:50:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dba31957f0 con 0x55dba2da90a0 2024-09-21T07:50:18.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.907+0000 7f0f82800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3184280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f82800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3184280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32922/0 (socket says 172.21.15.84:32922) 2024-09-21T07:50:18.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f82800640 1 -- 172.21.15.84:0/42780511 learned_addr learned my addr 172.21.15.84:0/42780511 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:18.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f81e00640 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba31902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f7be00640 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3190800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f81e00640 1 -- 172.21.15.84:0/42780511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 msgr2=0x55dba3190800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f81e00640 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3190800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f81e00640 1 -- 172.21.15.84:0/42780511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 msgr2=0x55dba3184280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f81e00640 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3184280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f81e00640 1 -- 172.21.15.84:0/42780511 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba31867e0 con 0x55dba2da90a0 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f81e00640 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba31902c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55dba3197890 tx=0x7f0f7400b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26029cffd318caa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f72a00640 1 -- 172.21.15.84:0/42780511 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400be00 con 0x55dba2da90a0 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.908+0000 7f0f72a00640 1 -- 172.21.15.84:0/42780511 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f74034900 con 0x55dba2da90a0 2024-09-21T07:50:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f72a00640 1 -- 172.21.15.84:0/42780511 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7401c480 con 0x55dba2da90a0 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 -- 172.21.15.84:0/42780511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 msgr2=0x55dba31902c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba31902c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55dba3197890 tx=0x7f0f7400b410 comp rx=0 tx=0).stop 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 -- 172.21.15.84:0/42780511 shutdown_connections 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2dd1f60 0x55dba3184280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2db1280 0x55dba3190800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/42780511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2da90a0 0x55dba31902c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 -- 172.21.15.84:0/42780511 >> 172.21.15.84:0/42780511 conn(0x55dba2dc6350 msgr2=0x55dba31712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:18.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.909+0000 7f0f8fc99740 1 -- 172.21.15.84:0/42780511 shutdown_connections 2024-09-21T07:50:18.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.910+0000 7f0f8fc99740 1 -- 172.21.15.84:0/42780511 wait complete. 2024-09-21T07:50:18.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.910+0000 7f0f8fc99740 1 -- start start 2024-09-21T07:50:18.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.910+0000 7f0f8fc99740 1 Processor -- start 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba319f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2db1280 0x55dba3198590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f8fc99740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2dd1f60 0x55dba3198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dba3196590 con 0x55dba2da90a0 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dba3195ec0 con 0x55dba2dd1f60 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f8fc99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dba3196c60 con 0x55dba2db1280 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f8fc99740 10 client.0 _ll_register_callbacks cb 0x7f0f6c0a9aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba319f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba319f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32924/0 (socket says 172.21.15.84:32924) 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 -- 172.21.15.84:0/2093697732 learned_addr learned my addr 172.21.15.84:0/2093697732 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f7be00640 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2db1280 0x55dba3198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f82800640 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2dd1f60 0x55dba3198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 -- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2db1280 msgr2=0x55dba3198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2db1280 0x55dba3198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 -- 172.21.15.84:0/2093697732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2dd1f60 msgr2=0x55dba3198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2dd1f60 0x55dba3198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.911+0000 7f0f81e00640 1 -- 172.21.15.84:0/2093697732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba3199170 con 0x55dba2da90a0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f81e00640 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba319f090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005fd0 tx=0x7f0f74011600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f012b0cbf5e3475c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f67e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f67e00640 1 -- 172.21.15.84:0/2093697732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74042070 con 0x55dba2da90a0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f67e00640 1 -- 172.21.15.84:0/2093697732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0f74034450 con 0x55dba2da90a0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f74034900 con 0x55dba2da90a0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f67e00640 1 -- 172.21.15.84:0/2093697732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f7404e050 con 0x55dba2da90a0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f8fc99740 10 client.15363 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.912+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dba319eb00 con 0x55dba2da90a0 2024-09-21T07:50:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f67e00640 1 -- 172.21.15.84:0/2093697732 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f74034900 con 0x55dba2da90a0 2024-09-21T07:50:18.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f67e00640 1 -- 172.21.15.84:0/2093697732 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0f7403c8b0 con 0x55dba2da90a0 2024-09-21T07:50:18.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f8fc99740 10 client.15363 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:18.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f8fc99740 10 client.15363 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:50:18.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f8fc99740 20 client.15363 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:18.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d65c90 0x55dba3204bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:18.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f8fc99740 4 client.15363 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:50:18.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "status"}) -- 0x55dba30ed750 con 0x55dba2d65c90 2024-09-21T07:50:18.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.913+0000 7f0f7be00640 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d65c90 0x55dba3204bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:18.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f7be00640 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d65c90 0x55dba3204bc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=84b98e4fd178252a server_cookie=1ee08a54d3b1dce5 in_seq=0 out_seq=0 2024-09-21T07:50:18.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f67e00640 10 client.15363 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:50:18.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f67e00640 1 -- 172.21.15.84:0/2093697732 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55dba30ed750 con 0x55dba2d65c90 2024-09-21T07:50:18.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f67e00640 10 client.15363 handle_command_reply: tid=0 2024-09-21T07:50:18.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 client.15363 shutdown 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 msgr2=0x55dba319f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba319f090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005fd0 tx=0x7f0f74011600 comp rx=0 tx=0).stop 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 shutdown_connections 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55dba2d65c90 0x55dba3204bc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dba2dd1f60 0x55dba3198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dba2db1280 0x55dba3198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 --2- 172.21.15.84:0/2093697732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dba2da90a0 0x55dba319f090 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f67e00640 0 client.15363 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.914+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 >> 172.21.15.84:0/2093697732 conn(0x55dba2dc6350 msgr2=0x55dba31712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.915+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 shutdown_connections 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.915+0000 7f0f8fc99740 1 -- 172.21.15.84:0/2093697732 wait complete. 2024-09-21T07:50:18.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.915+0000 7f0f8fc99740 20 client.15363 trim_cache size 0 max 16384 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 4, 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24712, 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 104.778572793, 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 187.73694211500001 2024-09-21T07:50:18.920 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:50:18.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.915+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0f680b6510 msgr2=0x7f0f680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.915+0000 7f0f83200640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0f680b6510 0x7f0f680b8a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f74011750 tx=0x7f0f74000bc0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.915+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f8410b4f0 msgr2=0x7f0f8419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:18.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.915+0000 7f0f83200640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f8410b4f0 0x7f0f8419cb40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f8406c8c0 tx=0x7f0f6c00ee50 comp rx=0 tx=0).stop 2024-09-21T07:50:18.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 shutdown_connections 2024-09-21T07:50:18.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0f680b6510 0x7f0f680b8a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8410be40 0x7f0f841a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f8410b4f0 0x7f0f8419cb40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 --2- 172.21.15.84:0/2454800431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f84105bb0 0x7f0f8419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:18.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 >> 172.21.15.84:0/2454800431 conn(0x7f0f84101680 msgr2=0x7f0f8410aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:18.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 shutdown_connections 2024-09-21T07:50:18.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:18.916+0000 7f0f83200640 1 -- 172.21.15.84:0/2454800431 wait complete. 2024-09-21T07:50:19.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:19 smithi191 ceph-mon[34667]: pgmap v370: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:19 smithi162 ceph-mon[34833]: pgmap v370: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:19 smithi084 ceph-mon[30411]: pgmap v370: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:19.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T07:50:20.172 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.782+0000 7f80d8a00640 1 -- 172.21.15.84:0/1923040997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4075dd0 msgr2=0x7f80d40761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.782+0000 7f80d8a00640 1 --2- 172.21.15.84:0/1923040997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4075dd0 0x7f80d40761e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009860 tx=0x7f80c002a340 comp rx=0 tx=0).stop 2024-09-21T07:50:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.783+0000 7f80d8a00640 1 -- 172.21.15.84:0/1923040997 shutdown_connections 2024-09-21T07:50:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.783+0000 7f80d8a00640 1 --2- 172.21.15.84:0/1923040997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d4114280 0x7f80d4116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.783+0000 7f80d8a00640 1 --2- 172.21.15.84:0/1923040997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4075dd0 0x7f80d40761e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.783+0000 7f80d8a00640 1 --2- 172.21.15.84:0/1923040997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80d4077380 0x7f80d40757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.783+0000 7f80d8a00640 1 -- 172.21.15.84:0/1923040997 >> 172.21.15.84:0/1923040997 conn(0x7f80d40ff440 msgr2=0x7f80d4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:20.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.783+0000 7f80d8a00640 1 -- 172.21.15.84:0/1923040997 shutdown_connections 2024-09-21T07:50:20.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.783+0000 7f80d8a00640 1 -- 172.21.15.84:0/1923040997 wait complete. 2024-09-21T07:50:20.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 Processor -- start 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 -- start start 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80d4075dd0 0x7f80d41a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4077380 0x7f80d41a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d4114280 0x7f80d41a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4119e80 con 0x7f80d4077380 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4119d00 con 0x7f80d4114280 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.784+0000 7f80d8a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80d411a000 con 0x7f80d4075dd0 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4077380 0x7f80d41a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80d4075dd0 0x7f80d41a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d4114280 0x7f80d41a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4077380 0x7f80d41a0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32930/0 (socket says 172.21.15.84:32930) 2024-09-21T07:50:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 -- 172.21.15.84:0/722626370 learned_addr learned my addr 172.21.15.84:0/722626370 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 -- 172.21.15.84:0/722626370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80d4075dd0 msgr2=0x7f80d41a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80d4075dd0 0x7f80d41a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 -- 172.21.15.84:0/722626370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d4114280 msgr2=0x7f80d41a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d4114280 0x7f80d41a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d1e00640 1 -- 172.21.15.84:0/722626370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d41a6820 con 0x7f80d4077380 2024-09-21T07:50:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.785+0000 7f80d3200640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d4114280 0x7f80d41a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.786+0000 7f80d1e00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4077380 0x7f80d41a0e50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f80c0035040 tx=0x7f80c0032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.786+0000 7f80cb400640 1 -- 172.21.15.84:0/722626370 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0037040 con 0x7f80d4077380 2024-09-21T07:50:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.786+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d41a6ab0 con 0x7f80d4077380 2024-09-21T07:50:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.786+0000 7f80cb400640 1 -- 172.21.15.84:0/722626370 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80c0041070 con 0x7f80d4077380 2024-09-21T07:50:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.786+0000 7f80cb400640 1 -- 172.21.15.84:0/722626370 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0003850 con 0x7f80d4077380 2024-09-21T07:50:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.786+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d41ad270 con 0x7f80d4077380 2024-09-21T07:50:20.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.790+0000 7f80cb400640 1 -- 172.21.15.84:0/722626370 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f80c0004050 con 0x7f80d4077380 2024-09-21T07:50:20.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 Processor -- start 2024-09-21T07:50:20.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 -- start start 2024-09-21T07:50:20.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a77670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326a80a0 0x559532a77bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5595329eed50 con 0x5595326d0f60 2024-09-21T07:50:20.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5595329de180 con 0x5595326b0280 2024-09-21T07:50:20.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.791+0000 7f80e0037740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5595329e1f90 con 0x5595326a80a0 2024-09-21T07:50:20.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.792+0000 7f80d2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326a80a0 0x559532a77bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.792+0000 7f80d2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326a80a0 0x559532a77bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53732/0 (socket says 172.21.15.84:53732) 2024-09-21T07:50:20.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.792+0000 7f80d3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a77670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.792+0000 7f80d2800640 1 -- 172.21.15.84:0/673443284 learned_addr learned my addr 172.21.15.84:0/673443284 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:20.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.792+0000 7f80cb400640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80b80b65e0 0x7f80b80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.792+0000 7f80d1e00640 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.792+0000 7f80d2800640 1 -- 172.21.15.84:0/673443284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 msgr2=0x559532a780f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d2800640 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a780f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d2800640 1 -- 172.21.15.84:0/673443284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 msgr2=0x559532a77670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d2800640 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a77670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d2800640 1 -- 172.21.15.84:0/673443284 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595329a8a70 con 0x5595326a80a0 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80cb400640 1 -- 172.21.15.84:0/722626370 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f80c0107100 con 0x7f80d4077380 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d3200640 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a77670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d1e00640 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d3200640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80b80b65e0 0x7f80b80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.793+0000 7f80d2800640 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326a80a0 0x559532a77bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009cc0 tx=0x7f80c4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd2da81b0c4703e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.794+0000 7f80bf400640 1 -- 172.21.15.84:0/673443284 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4005220 con 0x5595326a80a0 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.794+0000 7f80d3200640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80b80b65e0 0x7f80b80b8af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009fd0 tx=0x7f80cc004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:20.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.794+0000 7f80bf400640 1 -- 172.21.15.84:0/673443284 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80c4004c50 con 0x5595326a80a0 2024-09-21T07:50:20.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.794+0000 7f80bf400640 1 -- 172.21.15.84:0/673443284 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c40197f0 con 0x5595326a80a0 2024-09-21T07:50:20.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 -- 172.21.15.84:0/673443284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326a80a0 msgr2=0x559532a77bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326a80a0 0x559532a77bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009cc0 tx=0x7f80c4011810 comp rx=0 tx=0).stop 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 -- 172.21.15.84:0/673443284 shutdown_connections 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326a80a0 0x559532a77bb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 --2- 172.21.15.84:0/673443284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a77670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 -- 172.21.15.84:0/673443284 >> 172.21.15.84:0/673443284 conn(0x5595326c5350 msgr2=0x559532a75560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 -- 172.21.15.84:0/673443284 shutdown_connections 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 -- 172.21.15.84:0/673443284 wait complete. 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.795+0000 7f80e0037740 1 -- start start 2024-09-21T07:50:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 1 Processor -- start 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326a80a0 0x559532a83250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a83790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a8f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55953283f5f0 con 0x5595326d0f60 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559532979460 con 0x5595326a80a0 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559532a85e50 con 0x5595326b0280 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80e0037740 10 client.0 _ll_register_callbacks cb 0x559532989210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.796+0000 7f80d1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a83790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a8f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a83790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53744/0 (socket says 172.21.15.84:53744) 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 -- 172.21.15.84:0/2834861605 learned_addr learned my addr 172.21.15.84:0/2834861605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d2800640 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326a80a0 0x559532a83250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 -- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326a80a0 msgr2=0x559532a83250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326a80a0 0x559532a83250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 -- 172.21.15.84:0/2834861605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 msgr2=0x559532a8f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a8f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 -- 172.21.15.84:0/2834861605 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55953273c540 con 0x5595326b0280 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d2800640 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326a80a0 0x559532a83250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80d1e00640 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a83790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80c002a930 tx=0x7f80c00ccc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83657cfdea4e2c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80b3e00640 1 -- 172.21.15.84:0/2834861605 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c00c9490 con 0x5595326b0280 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.797+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55953297ba70 con 0x5595326b0280 2024-09-21T07:50:20.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80b3e00640 1 -- 172.21.15.84:0/2834861605 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f80c00d65d0 con 0x5595326b0280 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80b3e00640 1 -- 172.21.15.84:0/2834861605 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80c00cf070 con 0x5595326b0280 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 10 client.25369 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595329966f0 con 0x5595326b0280 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80b3e00640 1 -- 172.21.15.84:0/2834861605 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55953297ba70 con 0x5595326b0280 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80b3e00640 1 -- 172.21.15.84:0/2834861605 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80c01090b0 con 0x5595326b0280 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 10 client.25369 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 10 client.25369 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 20 client.25369 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55953268f8e0 0x559532a95770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 4 client.25369 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.798+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595329f0ca0 con 0x55953268f8e0 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.799+0000 7f80d2800640 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55953268f8e0 0x559532a95770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.799+0000 7f80d2800640 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55953268f8e0 0x559532a95770 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=87c83c52b6c304d server_cookie=7c57f8c3f5bbfc72 in_seq=0 out_seq=0 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.799+0000 7f80b3e00640 10 client.25369 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80b3e00640 1 -- 172.21.15.84:0/2834861605 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595329f0ca0 con 0x55953268f8e0 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80b3e00640 10 client.25369 handle_command_reply: tid=0 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 client.25369 shutdown 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 msgr2=0x559532a83790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a83790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80c002a930 tx=0x7f80c00ccc10 comp rx=0 tx=0).stop 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 shutdown_connections 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55953268f8e0 0x559532a95770 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326d0f60 0x559532a8f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a83790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 --2- 172.21.15.84:0/2834861605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326a80a0 0x559532a83250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80b3e00640 0 client.25369 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:50:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.800+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 >> 172.21.15.84:0/2834861605 conn(0x5595326c5350 msgr2=0x559532a7a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.801+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 shutdown_connections 2024-09-21T07:50:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.801+0000 7f80e0037740 1 -- 172.21.15.84:0/2834861605 wait complete. 2024-09-21T07:50:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.801+0000 7f80e0037740 20 client.25369 trim_cache size 0 max 16384 2024-09-21T07:50:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 Processor -- start 2024-09-21T07:50:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 -- start start 2024-09-21T07:50:20.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a92fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a8f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326d0f60 0x559532a8f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559532a93ab0 con 0x5595326a80a0 2024-09-21T07:50:20.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559532a94180 con 0x5595326b0280 2024-09-21T07:50:20.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.820+0000 7f80e0037740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559532a94850 con 0x5595326d0f60 2024-09-21T07:50:20.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a92fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a92fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32970/0 (socket says 172.21.15.84:32970) 2024-09-21T07:50:20.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 -- 172.21.15.84:0/2755085722 learned_addr learned my addr 172.21.15.84:0/2755085722 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:20.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d1e00640 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a8f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d3200640 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326d0f60 0x559532a8f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 -- 172.21.15.84:0/2755085722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326d0f60 msgr2=0x559532a8f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326d0f60 0x559532a8f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 -- 172.21.15.84:0/2755085722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 msgr2=0x559532a8f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a8f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 -- 172.21.15.84:0/2755085722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559532a84310 con 0x5595326a80a0 2024-09-21T07:50:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.821+0000 7f80d2800640 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a92fe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009be0 tx=0x7f80c4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9b0764659bf0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.822+0000 7f80bea00640 1 -- 172.21.15.84:0/2755085722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4005300 con 0x5595326a80a0 2024-09-21T07:50:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.822+0000 7f80bea00640 1 -- 172.21.15.84:0/2755085722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80c4004b10 con 0x5595326a80a0 2024-09-21T07:50:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.822+0000 7f80bea00640 1 -- 172.21.15.84:0/2755085722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c40198e0 con 0x5595326a80a0 2024-09-21T07:50:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 -- 172.21.15.84:0/2755085722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 msgr2=0x559532a92fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a92fe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009be0 tx=0x7f80c4009260 comp rx=0 tx=0).stop 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 -- 172.21.15.84:0/2755085722 shutdown_connections 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326d0f60 0x559532a8f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326b0280 0x559532a8f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 --2- 172.21.15.84:0/2755085722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a92fe0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 -- 172.21.15.84:0/2755085722 >> 172.21.15.84:0/2755085722 conn(0x5595326c5350 msgr2=0x559532a818d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 -- 172.21.15.84:0/2755085722 shutdown_connections 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.823+0000 7f80e0037740 1 -- 172.21.15.84:0/2755085722 wait complete. 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.824+0000 7f80e0037740 1 -- start start 2024-09-21T07:50:20.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.824+0000 7f80e0037740 1 Processor -- start 2024-09-21T07:50:20.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80e0037740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a9e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80e0037740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a97720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80e0037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326d0f60 0x559532a97c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80e0037740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559532a955f0 con 0x5595326a80a0 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80e0037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559532a94f20 con 0x5595326d0f60 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80e0037740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559532a95cc0 con 0x5595326b0280 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80e0037740 10 client.0 _ll_register_callbacks cb 0x7f80c0009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80d2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a9e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80d2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a9e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32978/0 (socket says 172.21.15.84:32978) 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80d2800640 1 -- 172.21.15.84:0/178696490 learned_addr learned my addr 172.21.15.84:0/178696490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.825+0000 7f80d1e00640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a97720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d3200640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326d0f60 0x559532a97c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d1e00640 1 -- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326d0f60 msgr2=0x559532a97c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d1e00640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326d0f60 0x559532a97c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d1e00640 1 -- 172.21.15.84:0/178696490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 msgr2=0x559532a9e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d1e00640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a9e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d1e00640 1 -- 172.21.15.84:0/178696490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559532a983d0 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d2800640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a9e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80d1e00640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a97720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f80c00ccdd0 tx=0x7f80c0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f4dc83d9a1c1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80b3e00640 1 -- 172.21.15.84:0/178696490 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c00c9490 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.826+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80c4004b10 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80b3e00640 1 -- 172.21.15.84:0/178696490 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f80c00cc2a0 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80b3e00640 1 -- 172.21.15.84:0/178696490 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80c00cc790 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 10 client.25375 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559532a983d0 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80b3e00640 1 -- 172.21.15.84:0/178696490 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80c4004b10 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80b3e00640 1 -- 172.21.15.84:0/178696490 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80c00c8790 con 0x5595326b0280 2024-09-21T07:50:20.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 10 client.25375 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 10 client.25375 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 20 client.25375 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x559532664c90 0x559532b04030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 4 client.25375 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.827+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "status"}) -- 0x5595329ec750 con 0x559532664c90 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.828+0000 7f80d2800640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x559532664c90 0x559532b04030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.828+0000 7f80d2800640 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x559532664c90 0x559532b04030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=70436498eff71aa0 server_cookie=e591267fa2ac1cf8 in_seq=0 out_seq=0 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.828+0000 7f80b3e00640 10 client.25375 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80b3e00640 1 -- 172.21.15.84:0/178696490 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5595329ec750 con 0x559532664c90 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80b3e00640 10 client.25375 handle_command_reply: tid=0 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 client.25375 shutdown 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 msgr2=0x559532a97720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a97720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f80c00ccdd0 tx=0x7f80c0000bc0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 shutdown_connections 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x559532664c90 0x559532b04030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5595326d0f60 0x559532a97c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5595326b0280 0x559532a97720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 --2- 172.21.15.84:0/178696490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595326a80a0 0x559532a9e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80b3e00640 0 client.25375 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 >> 172.21.15.84:0/178696490 conn(0x5595326c5350 msgr2=0x559532a83230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 shutdown_connections 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 1 -- 172.21.15.84:0/178696490 wait complete. 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.829+0000 7f80e0037740 20 client.25375 trim_cache size 0 max 16384 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:50:20.835 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 3, 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24719, 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 107.706796841, 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 184.32956571899999 2024-09-21T07:50:20.836 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80b80b65e0 msgr2=0x7f80b80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80b80b65e0 0x7f80b80b8af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009fd0 tx=0x7f80cc004a40 comp rx=0 tx=0).stop 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4077380 msgr2=0x7f80d41a0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4077380 0x7f80d41a0e50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f80c0035040 tx=0x7f80c0032d50 comp rx=0 tx=0).stop 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 shutdown_connections 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80b80b65e0 0x7f80b80b8af0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d4114280 0x7f80d41a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80d4077380 0x7f80d41a0e50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 --2- 172.21.15.84:0/722626370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80d4075dd0 0x7f80d41a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 >> 172.21.15.84:0/722626370 conn(0x7f80d40ff440 msgr2=0x7f80d4110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:20.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 shutdown_connections 2024-09-21T07:50:20.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:20.830+0000 7f80d8a00640 1 -- 172.21.15.84:0/722626370 wait complete. 2024-09-21T07:50:21.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:21 smithi191 ceph-mon[34667]: pgmap v371: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:21.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:21 smithi162 ceph-mon[34833]: pgmap v371: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:21.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:21 smithi084 ceph-mon[30411]: pgmap v371: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:21.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:50:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 -- 172.21.15.84:0/1211890701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30076100 msgr2=0x7f0b3010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 --2- 172.21.15.84:0/1211890701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30076100 0x7f0b3010f9d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009900 tx=0x7f0b1802a410 comp rx=0 tx=0).stop 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 -- 172.21.15.84:0/1211890701 shutdown_connections 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 --2- 172.21.15.84:0/1211890701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b3010ff10 0x7f0b30112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 --2- 172.21.15.84:0/1211890701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30076100 0x7f0b3010f9d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 --2- 172.21.15.84:0/1211890701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 0x7f0b30075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 -- 172.21.15.84:0/1211890701 >> 172.21.15.84:0/1211890701 conn(0x7f0b300ff440 msgr2=0x7f0b30101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.750+0000 7f0b2f200640 1 -- 172.21.15.84:0/1211890701 shutdown_connections 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.751+0000 7f0b2f200640 1 -- 172.21.15.84:0/1211890701 wait complete. 2024-09-21T07:50:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.752+0000 7f0b2f200640 1 Processor -- start 2024-09-21T07:50:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.752+0000 7f0b2f200640 1 -- start start 2024-09-21T07:50:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.752+0000 7f0b2f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 0x7f0b3019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2f200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b30076100 0x7f0b3019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3010ff10 0x7f0b301a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30115ac0 con 0x7f0b3010ff10 2024-09-21T07:50:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30115940 con 0x7f0b300757b0 2024-09-21T07:50:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2f200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30115c40 con 0x7f0b30076100 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 0x7f0b3019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3010ff10 0x7f0b301a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b30076100 0x7f0b3019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3010ff10 0x7f0b301a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33004/0 (socket says 172.21.15.84:33004) 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 0x7f0b3019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42326/0 (socket says 172.21.15.84:42326) 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 -- 172.21.15.84:0/130218567 learned_addr learned my addr 172.21.15.84:0/130218567 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 -- 172.21.15.84:0/130218567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b30076100 msgr2=0x7f0b3019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b30076100 0x7f0b3019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 -- 172.21.15.84:0/130218567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 msgr2=0x7f0b3019c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 0x7f0b3019c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.753+0000 7f0b2e800640 1 -- 172.21.15.84:0/130218567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b301a2480 con 0x7f0b3010ff10 2024-09-21T07:50:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.754+0000 7f0b2de00640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 0x7f0b3019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:22.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.754+0000 7f0b2e800640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3010ff10 0x7f0b301a1d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800eaa0 tx=0x7f0b2800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:22.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.754+0000 7f0b26a00640 1 -- 172.21.15.84:0/130218567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800cdb0 con 0x7f0b3010ff10 2024-09-21T07:50:22.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.754+0000 7f0b26a00640 1 -- 172.21.15.84:0/130218567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b28005020 con 0x7f0b3010ff10 2024-09-21T07:50:22.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.754+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b301a2770 con 0x7f0b3010ff10 2024-09-21T07:50:22.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.754+0000 7f0b26a00640 1 -- 172.21.15.84:0/130218567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b280116d0 con 0x7f0b3010ff10 2024-09-21T07:50:22.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.754+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b301a8ed0 con 0x7f0b3010ff10 2024-09-21T07:50:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.758+0000 7f0b3ba56740 1 Processor -- start 2024-09-21T07:50:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b26a00640 1 -- 172.21.15.84:0/130218567 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f0b280051d0 con 0x7f0b3010ff10 2024-09-21T07:50:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b3ba56740 1 -- start start 2024-09-21T07:50:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8a0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55753e817d50 con 0x55753e4f9f60 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55753e807180 con 0x55753e4d9280 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.759+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55753e80af90 con 0x55753e4d10a0 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33006/0 (socket says 172.21.15.84:33006) 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 -- 172.21.15.84:0/4203457445 learned_addr learned my addr 172.21.15.84:0/4203457445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b2de00640 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 -- 172.21.15.84:0/4203457445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 msgr2=0x55753e8a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 -- 172.21.15.84:0/4203457445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 msgr2=0x55753e8a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b27e00640 1 -- 172.21.15.84:0/4203457445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753e7d1a70 con 0x55753e4f9f60 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.760+0000 7f0b2de00640 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.761+0000 7f0b27e00640 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8a0670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0b180096c0 tx=0x7f0b18005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc1c5312dedc01f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.761+0000 7f0b26a00640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0b140b6560 0x7f0b140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.761+0000 7f0b1f400640 1 -- 172.21.15.84:0/4203457445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18044020 con 0x55753e4f9f60 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.761+0000 7f0b1f400640 1 -- 172.21.15.84:0/4203457445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b18031720 con 0x55753e4f9f60 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.761+0000 7f0b1f400640 1 -- 172.21.15.84:0/4203457445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18035040 con 0x55753e4f9f60 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.761+0000 7f0b26a00640 1 -- 172.21.15.84:0/130218567 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0b280e78c0 con 0x7f0b3010ff10 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.761+0000 7f0b2de00640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0b140b6560 0x7f0b140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 -- 172.21.15.84:0/4203457445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 msgr2=0x55753e8a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8a0670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0b180096c0 tx=0x7f0b18005db0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b2de00640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0b140b6560 0x7f0b140b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009fd0 tx=0x7f0b20005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 -- 172.21.15.84:0/4203457445 shutdown_connections 2024-09-21T07:50:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/4203457445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8a0670 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 -- 172.21.15.84:0/4203457445 >> 172.21.15.84:0/4203457445 conn(0x55753e4ee350 msgr2=0x55753e89e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 -- 172.21.15.84:0/4203457445 shutdown_connections 2024-09-21T07:50:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.762+0000 7f0b3ba56740 1 -- 172.21.15.84:0/4203457445 wait complete. 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.763+0000 7f0b3ba56740 1 -- start start 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.763+0000 7f0b3ba56740 1 Processor -- start 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d10a0 0x55753e8ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4f9f60 0x55753e8b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55753e6685f0 con 0x55753e4d10a0 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55753e7a2460 con 0x55753e4d9280 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55753e8aedf0 con 0x55753e4f9f60 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b3ba56740 10 client.0 _ll_register_callbacks cb 0x55753e7b2210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d10a0 0x55753e8ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d10a0 0x55753e8ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33012/0 (socket says 172.21.15.84:33012) 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 -- 172.21.15.84:0/2185050842 learned_addr learned my addr 172.21.15.84:0/2185050842 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b27e00640 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2e800640 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4f9f60 0x55753e8b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 -- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4f9f60 msgr2=0x55753e8b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4f9f60 0x55753e8b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 -- 172.21.15.84:0/2185050842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 msgr2=0x55753e8ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.764+0000 7f0b2de00640 1 -- 172.21.15.84:0/2185050842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753e565540 con 0x55753e4d10a0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b2de00640 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d10a0 0x55753e8ac2d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0b20012ed0 tx=0x7f0b20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9196a27c2ab2ccb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b13e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b13e00640 1 -- 172.21.15.84:0/2185050842 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000fe20 con 0x55753e4d10a0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55753e7a4a70 con 0x55753e4d10a0 2024-09-21T07:50:22.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b13e00640 1 -- 172.21.15.84:0/2185050842 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0b20004240 con 0x55753e4d10a0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b13e00640 1 -- 172.21.15.84:0/2185050842 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b20032050 con 0x55753e4d10a0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b3ba56740 10 client.15393 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.765+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55753e7bf6f0 con 0x55753e4d10a0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b13e00640 1 -- 172.21.15.84:0/2185050842 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55753e7a4a70 con 0x55753e4d10a0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b13e00640 1 -- 172.21.15.84:0/2185050842 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0b20027020 con 0x55753e4d10a0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b3ba56740 10 client.15393 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b3ba56740 10 client.15393 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b3ba56740 20 client.15393 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e4b88e0 0x55753e8be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b3ba56740 4 client.15393 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55753e819ca0 con 0x55753e4b88e0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.766+0000 7f0b27e00640 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e4b88e0 0x55753e8be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.767+0000 7f0b27e00640 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e4b88e0 0x55753e8be7f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ea9edd891d58f4e server_cookie=aa9672afcc2fb166 in_seq=0 out_seq=0 2024-09-21T07:50:22.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.767+0000 7f0b13e00640 10 client.15393 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:50:22.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b13e00640 1 -- 172.21.15.84:0/2185050842 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55753e819ca0 con 0x55753e4b88e0 2024-09-21T07:50:22.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b13e00640 10 client.15393 handle_command_reply: tid=0 2024-09-21T07:50:22.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 client.15393 shutdown 2024-09-21T07:50:22.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d10a0 msgr2=0x55753e8ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d10a0 0x55753e8ac2d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0b20012ed0 tx=0x7f0b20004730 comp rx=0 tx=0).stop 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 shutdown_connections 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e4b88e0 0x55753e8be7f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4f9f60 0x55753e8b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/2185050842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d10a0 0x55753e8ac2d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b13e00640 0 client.15393 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 >> 172.21.15.84:0/2185050842 conn(0x55753e4ee350 msgr2=0x55753e8a3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 shutdown_connections 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 1 -- 172.21.15.84:0/2185050842 wait complete. 2024-09-21T07:50:22.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.768+0000 7f0b3ba56740 20 client.15393 trim_cache size 0 max 16384 2024-09-21T07:50:22.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.787+0000 7f0b3ba56740 1 Processor -- start 2024-09-21T07:50:22.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.787+0000 7f0b3ba56740 1 -- start start 2024-09-21T07:50:22.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.787+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.787+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.787+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8aa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55753e8bcb30 con 0x55753e4f9f60 2024-09-21T07:50:22.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55753e8bd200 con 0x55753e4d9280 2024-09-21T07:50:22.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55753e8bd8d0 con 0x55753e4d10a0 2024-09-21T07:50:22.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33022/0 (socket says 172.21.15.84:33022) 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2e800640 1 -- 172.21.15.84:0/365673726 learned_addr learned my addr 172.21.15.84:0/365673726 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8be7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53808/0 (socket says 172.21.15.84:53808) 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b27e00640 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2de00640 1 -- 172.21.15.84:0/365673726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 msgr2=0x55753e8bc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2de00640 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8bc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2de00640 1 -- 172.21.15.84:0/365673726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 msgr2=0x55753e8aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2de00640 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.788+0000 7f0b2de00640 1 -- 172.21.15.84:0/365673726 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55753e8988c0 con 0x55753e4d10a0 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.789+0000 7f0b2de00640 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8be7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b20003ae0 tx=0x7f0b200123f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ed460a977054e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.789+0000 7f0b1ea00640 1 -- 172.21.15.84:0/365673726 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b200035f0 con 0x55753e4d10a0 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.789+0000 7f0b1ea00640 1 -- 172.21.15.84:0/365673726 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b20003790 con 0x55753e4d10a0 2024-09-21T07:50:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.789+0000 7f0b1ea00640 1 -- 172.21.15.84:0/365673726 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20029720 con 0x55753e4d10a0 2024-09-21T07:50:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 -- 172.21.15.84:0/365673726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 msgr2=0x55753e8be7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8be7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b20003ae0 tx=0x7f0b200123f0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 -- 172.21.15.84:0/365673726 shutdown_connections 2024-09-21T07:50:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4f9f60 0x55753e8aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4d9280 0x55753e8bc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/365673726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8be7f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 -- 172.21.15.84:0/365673726 >> 172.21.15.84:0/365673726 conn(0x55753e4ee350 msgr2=0x55753e8a7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 -- 172.21.15.84:0/365673726 shutdown_connections 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 -- 172.21.15.84:0/365673726 wait complete. 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.790+0000 7f0b3ba56740 1 -- start start 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 1 Processor -- start 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d9280 0x55753e8c0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4f9f60 0x55753e8c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55753e8be670 con 0x55753e4d9280 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55753e8bdfa0 con 0x55753e4f9f60 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55753e8bed40 con 0x55753e4d10a0 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b3ba56740 10 client.0 _ll_register_callbacks cb 0x7f0b200124c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:22.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d9280 0x55753e8c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b2de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53816/0 (socket says 172.21.15.84:53816) 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b2de00640 1 -- 172.21.15.84:0/88643089 learned_addr learned my addr 172.21.15.84:0/88643089 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.791+0000 7f0b2e800640 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4f9f60 0x55753e8c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b2de00640 1 -- 172.21.15.84:0/88643089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4f9f60 msgr2=0x55753e8c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b2de00640 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4f9f60 0x55753e8c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b2de00640 1 -- 172.21.15.84:0/88643089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d9280 msgr2=0x55753e8c0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b2de00640 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d9280 0x55753e8c0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b2de00640 1 -- 172.21.15.84:0/88643089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55753e8c14b0 con 0x55753e4d10a0 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b27e00640 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d9280 0x55753e8c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b2de00640 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8c72d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b20003a60 tx=0x7f0b200092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34d10d533e404e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:22.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b13e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:50:22.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b13e00640 1 -- 172.21.15.84:0/88643089 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20044060 con 0x55753e4d10a0 2024-09-21T07:50:22.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b13e00640 1 -- 172.21.15.84:0/88643089 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0b20005240 con 0x55753e4d10a0 2024-09-21T07:50:22.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.792+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b20003790 con 0x55753e4d10a0 2024-09-21T07:50:22.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b13e00640 1 -- 172.21.15.84:0/88643089 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b2004b050 con 0x55753e4d10a0 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 10 client.25393 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55753e929cc0 con 0x55753e4d10a0 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b13e00640 1 -- 172.21.15.84:0/88643089 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b20003790 con 0x55753e4d10a0 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b13e00640 1 -- 172.21.15.84:0/88643089 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0b20027040 con 0x55753e4d10a0 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 10 client.25393 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 10 client.25393 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 20 client.25393 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e48dc90 0x55753e92d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 4 client.25393 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.793+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "status"}) -- 0x55753e815750 con 0x55753e48dc90 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.794+0000 7f0b27e00640 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e48dc90 0x55753e92d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.794+0000 7f0b27e00640 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e48dc90 0x55753e92d2b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dce2c65fe513ead0 server_cookie=bdcdf39cc1349244 in_seq=0 out_seq=0 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.794+0000 7f0b13e00640 10 client.25393 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:50:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.794+0000 7f0b13e00640 1 -- 172.21.15.84:0/88643089 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55753e815750 con 0x55753e48dc90 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.794+0000 7f0b13e00640 10 client.25393 handle_command_reply: tid=0 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.794+0000 7f0b3ba56740 1 client.25393 shutdown 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 msgr2=0x55753e8c72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8c72d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b20003a60 tx=0x7f0b200092a0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 shutdown_connections 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55753e48dc90 0x55753e92d2b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55753e4f9f60 0x55753e8c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55753e4d9280 0x55753e8c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b13e00640 0 client.25393 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 --2- 172.21.15.84:0/88643089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55753e4d10a0 0x55753e8c72d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 >> 172.21.15.84:0/88643089 conn(0x55753e4ee350 msgr2=0x55753e8a16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 shutdown_connections 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 1 -- 172.21.15.84:0/88643089 wait complete. 2024-09-21T07:50:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.795+0000 7f0b3ba56740 20 client.25393 trim_cache size 0 max 16384 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24724, 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 110.678721201, 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:50:22.802 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:50:22.803 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:50:22.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 188.92989169200001 2024-09-21T07:50:22.803 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:50:22.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0b140b6560 msgr2=0x7f0b140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0b140b6560 0x7f0b140b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009fd0 tx=0x7f0b20005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:22.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3010ff10 msgr2=0x7f0b301a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3010ff10 0x7f0b301a1d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800eaa0 tx=0x7f0b2800ef60 comp rx=0 tx=0).stop 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 shutdown_connections 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0b140b6560 0x7f0b140b8a70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3010ff10 0x7f0b301a1d50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b30076100 0x7f0b3019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 --2- 172.21.15.84:0/130218567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b300757b0 0x7f0b3019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 >> 172.21.15.84:0/130218567 conn(0x7f0b300ff440 msgr2=0x7f0b30109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 shutdown_connections 2024-09-21T07:50:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:22.796+0000 7f0b2f200640 1 -- 172.21.15.84:0/130218567 wait complete. 2024-09-21T07:50:23.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:23 smithi084 ceph-mon[30411]: pgmap v372: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:50:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:23 smithi162 ceph-mon[34833]: pgmap v372: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:50:23.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:23 smithi191 ceph-mon[34667]: pgmap v372: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:50:23.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:50:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 -- 172.21.15.84:0/3317588942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5410b6c0 msgr2=0x7f5d5410bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 --2- 172.21.15.84:0/3317588942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5410b6c0 0x7f5d5410bad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009860 tx=0x7f5d3c02a340 comp rx=0 tx=0).stop 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 -- 172.21.15.84:0/3317588942 shutdown_connections 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 --2- 172.21.15.84:0/3317588942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d5410c010 0x7f5d54112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 --2- 172.21.15.84:0/3317588942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5410b6c0 0x7f5d5410bad0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 --2- 172.21.15.84:0/3317588942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d54105d80 0x7f5d54106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 -- 172.21.15.84:0/3317588942 >> 172.21.15.84:0/3317588942 conn(0x7f5d54101810 msgr2=0x7f5d54103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:24.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 -- 172.21.15.84:0/3317588942 shutdown_connections 2024-09-21T07:50:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.733+0000 7f5d5b000640 1 -- 172.21.15.84:0/3317588942 wait complete. 2024-09-21T07:50:24.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.734+0000 7f5d5b000640 1 Processor -- start 2024-09-21T07:50:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d5b000640 1 -- start start 2024-09-21T07:50:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d5b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d54105d80 0x7f5d5419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d5b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d5410b6c0 0x7f5d5419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d5b000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d5410c010 0x7f5d541a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d5b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54115cd0 con 0x7f5d54105d80 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d5b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54115b50 con 0x7f5d5410b6c0 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d5b000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54115e50 con 0x7f5d5410c010 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d54105d80 0x7f5d5419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d54105d80 0x7f5d5419c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33046/0 (socket says 172.21.15.84:33046) 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d53e00640 1 -- 172.21.15.84:0/828384999 learned_addr learned my addr 172.21.15.84:0/828384999 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d4be00640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d5410b6c0 0x7f5d5419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.735+0000 7f5d59000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d5410c010 0x7f5d541a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d53e00640 1 -- 172.21.15.84:0/828384999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d5410c010 msgr2=0x7f5d541a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d53e00640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d5410c010 0x7f5d541a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d53e00640 1 -- 172.21.15.84:0/828384999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d5410b6c0 msgr2=0x7f5d5419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d53e00640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d5410b6c0 0x7f5d5419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d53e00640 1 -- 172.21.15.84:0/828384999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d541a2690 con 0x7f5d54105d80 2024-09-21T07:50:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d59000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d5410c010 0x7f5d541a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d53e00640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d54105d80 0x7f5d5419c720 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400e9f0 tx=0x7f5d4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d51600640 1 -- 172.21.15.84:0/828384999 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400cd80 con 0x7f5d54105d80 2024-09-21T07:50:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d51600640 1 -- 172.21.15.84:0/828384999 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d440108e0 con 0x7f5d54105d80 2024-09-21T07:50:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d51600640 1 -- 172.21.15.84:0/828384999 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44018980 con 0x7f5d54105d80 2024-09-21T07:50:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d541a2980 con 0x7f5d54105d80 2024-09-21T07:50:24.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.736+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d541a90e0 con 0x7f5d54105d80 2024-09-21T07:50:24.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 Processor -- start 2024-09-21T07:50:24.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 -- start start 2024-09-21T07:50:24.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d51600640 1 -- 172.21.15.84:0/828384999 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f5d44010430 con 0x7f5d54105d80 2024-09-21T07:50:24.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb771490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3a20a0 0x55a3bb7719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3aa280 0x55a3bb771f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb6e8d50 con 0x55a3bb3caf60 2024-09-21T07:50:24.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb6d8180 con 0x55a3bb3a20a0 2024-09-21T07:50:24.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.740+0000 7f5d61be5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb6dbf90 con 0x55a3bb3aa280 2024-09-21T07:50:24.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d59000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb771490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3aa280 0x55a3bb771f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d59000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb771490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33056/0 (socket says 172.21.15.84:33056) 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3a20a0 0x55a3bb7719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d59000640 1 -- 172.21.15.84:0/2906995931 learned_addr learned my addr 172.21.15.84:0/2906995931 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d4be00640 1 -- 172.21.15.84:0/2906995931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3a20a0 msgr2=0x55a3bb7719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d4be00640 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3a20a0 0x55a3bb7719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d4be00640 1 -- 172.21.15.84:0/2906995931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 msgr2=0x55a3bb771490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d4be00640 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb771490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d4be00640 1 -- 172.21.15.84:0/2906995931 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3bb6a2a70 con 0x55a3bb3aa280 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d59000640 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb771490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.741+0000 7f5d4be00640 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3aa280 0x55a3bb771f10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c02a860 tx=0x7f5d3c0095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1d263002f7cf54d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.742+0000 7f5d49600640 1 -- 172.21.15.84:0/2906995931 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c041070 con 0x55a3bb3aa280 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.742+0000 7f5d49600640 1 -- 172.21.15.84:0/2906995931 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d3c0044d0 con 0x55a3bb3aa280 2024-09-21T07:50:24.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.742+0000 7f5d49600640 1 -- 172.21.15.84:0/2906995931 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c037040 con 0x55a3bb3aa280 2024-09-21T07:50:24.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.742+0000 7f5d51600640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d380b6560 0x7f5d380b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.742+0000 7f5d51600640 1 -- 172.21.15.84:0/828384999 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5d440e7ba0 con 0x7f5d54105d80 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d59000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d380b6560 0x7f5d380b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 -- 172.21.15.84:0/2906995931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3aa280 msgr2=0x55a3bb771f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3aa280 0x55a3bb771f10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c02a860 tx=0x7f5d3c0095a0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 -- 172.21.15.84:0/2906995931 shutdown_connections 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3aa280 0x55a3bb771f10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3a20a0 0x55a3bb7719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 --2- 172.21.15.84:0/2906995931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb771490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 -- 172.21.15.84:0/2906995931 >> 172.21.15.84:0/2906995931 conn(0x55a3bb3bf350 msgr2=0x55a3bb76f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 -- 172.21.15.84:0/2906995931 shutdown_connections 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d61be5740 1 -- 172.21.15.84:0/2906995931 wait complete. 2024-09-21T07:50:24.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.743+0000 7f5d59000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d380b6560 0x7f5d380b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c005fd0 tx=0x7f5d4c011040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 -- start start 2024-09-21T07:50:24.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 Processor -- start 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb77d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb77d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb788f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb5395f0 con 0x55a3bb3a20a0 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb673460 con 0x55a3bb3aa280 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb77fc10 con 0x55a3bb3caf60 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.744+0000 7f5d61be5740 10 client.0 _ll_register_callbacks cb 0x55a3bb683210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb77d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb77d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb77d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42380/0 (socket says 172.21.15.84:42380) 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 -- 172.21.15.84:0/3712625023 learned_addr learned my addr 172.21.15.84:0/3712625023 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d59000640 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb788f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 -- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 msgr2=0x55a3bb788f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb788f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 -- 172.21.15.84:0/3712625023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 msgr2=0x55a3bb77d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb77d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 -- 172.21.15.84:0/3712625023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3bb436540 con 0x55a3bb3aa280 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d4be00640 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb77d5f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c000c00 tx=0x7f5d3c0304e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d3e04b630571fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.745+0000 7f5d42000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.746+0000 7f5d42000640 1 -- 172.21.15.84:0/3712625023 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c037030 con 0x55a3bb3aa280 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.746+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3bb675a70 con 0x55a3bb3aa280 2024-09-21T07:50:24.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.746+0000 7f5d42000640 1 -- 172.21.15.84:0/3712625023 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5d3c03d680 con 0x55a3bb3aa280 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.746+0000 7f5d42000640 1 -- 172.21.15.84:0/3712625023 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d3c054050 con 0x55a3bb3aa280 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.746+0000 7f5d61be5740 10 client.25385 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.746+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3bb6906f0 con 0x55a3bb3aa280 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.746+0000 7f5d42000640 1 -- 172.21.15.84:0/3712625023 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a3bb675a70 con 0x55a3bb3aa280 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d42000640 1 -- 172.21.15.84:0/3712625023 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5d3c032810 con 0x55a3bb3aa280 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d61be5740 10 client.25385 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d61be5740 10 client.25385 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d61be5740 20 client.25385 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb3898e0 0x55a3bb78f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d61be5740 4 client.25385 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3bb6eaca0 con 0x55a3bb3898e0 2024-09-21T07:50:24.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.747+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb3898e0 0x55a3bb78f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.748+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb3898e0 0x55a3bb78f070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36ef9927fca27936 server_cookie=a11be2d45724bfba in_seq=0 out_seq=0 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.748+0000 7f5d42000640 10 client.25385 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d42000640 1 -- 172.21.15.84:0/3712625023 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3bb6eaca0 con 0x55a3bb3898e0 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d42000640 10 client.25385 handle_command_reply: tid=0 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 client.25385 shutdown 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 msgr2=0x55a3bb77d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb77d5f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c000c00 tx=0x7f5d3c0304e0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 shutdown_connections 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb3898e0 0x55a3bb78f070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb788f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb77d5f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d42000640 0 client.25385 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3712625023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb77d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 >> 172.21.15.84:0/3712625023 conn(0x55a3bb3bf350 msgr2=0x55a3bb774670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:24.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.749+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 shutdown_connections 2024-09-21T07:50:24.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.750+0000 7f5d61be5740 1 -- 172.21.15.84:0/3712625023 wait complete. 2024-09-21T07:50:24.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.750+0000 7f5d61be5740 20 client.25385 trim_cache size 0 max 16384 2024-09-21T07:50:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.768+0000 7f5d61be5740 1 Processor -- start 2024-09-21T07:50:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.768+0000 7f5d61be5740 1 -- start start 2024-09-21T07:50:24.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3a20a0 0x55a3bb78e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb788e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb777300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d61be5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb78d3b0 con 0x55a3bb3caf60 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d61be5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb78da80 con 0x55a3bb3aa280 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d61be5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb78e150 con 0x55a3bb3a20a0 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d59000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb777300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d59000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb777300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33070/0 (socket says 172.21.15.84:33070) 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d59000640 1 -- 172.21.15.84:0/3063260182 learned_addr learned my addr 172.21.15.84:0/3063260182 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3a20a0 0x55a3bb78e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d4be00640 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb788e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d53e00640 1 -- 172.21.15.84:0/3063260182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 msgr2=0x55a3bb788e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb788e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d53e00640 1 -- 172.21.15.84:0/3063260182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 msgr2=0x55a3bb777300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb777300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d53e00640 1 -- 172.21.15.84:0/3063260182 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3bb77df50 con 0x55a3bb3a20a0 2024-09-21T07:50:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.769+0000 7f5d59000640 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb777300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.770+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3a20a0 0x55a3bb78e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55a3bb770110 tx=0x7f5d440eb620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e512da875d49fd21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.770+0000 7f5d48c00640 1 -- 172.21.15.84:0/3063260182 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d440ad6b0 con 0x55a3bb3a20a0 2024-09-21T07:50:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.770+0000 7f5d48c00640 1 -- 172.21.15.84:0/3063260182 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d44010720 con 0x55a3bb3a20a0 2024-09-21T07:50:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.770+0000 7f5d48c00640 1 -- 172.21.15.84:0/3063260182 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d440ad050 con 0x55a3bb3a20a0 2024-09-21T07:50:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 -- 172.21.15.84:0/3063260182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3a20a0 msgr2=0x55a3bb78e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3a20a0 0x55a3bb78e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55a3bb770110 tx=0x7f5d440eb620 comp rx=0 tx=0).stop 2024-09-21T07:50:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 -- 172.21.15.84:0/3063260182 shutdown_connections 2024-09-21T07:50:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3caf60 0x55a3bb777300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb788e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3063260182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3a20a0 0x55a3bb78e9a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 -- 172.21.15.84:0/3063260182 >> 172.21.15.84:0/3063260182 conn(0x55a3bb3bf350 msgr2=0x55a3bb777ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 -- 172.21.15.84:0/3063260182 shutdown_connections 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 -- 172.21.15.84:0/3063260182 wait complete. 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.771+0000 7f5d61be5740 1 -- start start 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 1 Processor -- start 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb790110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb790650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb790b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb78eef0 con 0x55a3bb3a20a0 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb78e820 con 0x55a3bb3aa280 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a3bb78f5c0 con 0x55a3bb3caf60 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d61be5740 10 client.0 _ll_register_callbacks cb 0x7f5d44005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb790110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb790110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33072/0 (socket says 172.21.15.84:33072) 2024-09-21T07:50:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d53e00640 1 -- 172.21.15.84:0/3265270712 learned_addr learned my addr 172.21.15.84:0/3265270712 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d4be00640 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb790650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.772+0000 7f5d59000640 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb790b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d53e00640 1 -- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 msgr2=0x55a3bb790b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb790b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d53e00640 1 -- 172.21.15.84:0/3265270712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 msgr2=0x55a3bb790650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb790650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d53e00640 1 -- 172.21.15.84:0/3265270712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3bb797370 con 0x55a3bb3a20a0 2024-09-21T07:50:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d53e00640 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb790110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d440aab50 tx=0x7f5d440a9130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f449c6f7de283867 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d42000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d42000640 1 -- 172.21.15.84:0/3265270712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d440ad230 con 0x55a3bb3a20a0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d42000640 1 -- 172.21.15.84:0/3265270712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5d440a9b50 con 0x55a3bb3a20a0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.773+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3bb6e6750 con 0x55a3bb3a20a0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d42000640 1 -- 172.21.15.84:0/3265270712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d440ad6b0 con 0x55a3bb3a20a0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3bb7fa880 con 0x55a3bb3a20a0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d42000640 1 -- 172.21.15.84:0/3265270712 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a3bb6e6750 con 0x55a3bb3a20a0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d42000640 1 -- 172.21.15.84:0/3265270712 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5d440a9230 con 0x55a3bb3a20a0 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 10 client.15417 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 20 client.15417 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb35ec90 0x55a3bb7fdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 4 client.15417 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:50:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.774+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "status"}) -- 0x55a3bb6e3b80 con 0x55a3bb35ec90 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.775+0000 7f5d4be00640 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb35ec90 0x55a3bb7fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.775+0000 7f5d4be00640 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb35ec90 0x55a3bb7fdc40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f071146b5e2c56a server_cookie=ef3082a076e1ab61 in_seq=0 out_seq=0 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.775+0000 7f5d42000640 10 client.15417 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d42000640 1 -- 172.21.15.84:0/3265270712 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a3bb6e3b80 con 0x55a3bb35ec90 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d42000640 10 client.15417 handle_command_reply: tid=0 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 client.15417 shutdown 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 msgr2=0x55a3bb790110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb790110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d440aab50 tx=0x7f5d440a9130 comp rx=0 tx=0).stop 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 shutdown_connections 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a3bb35ec90 0x55a3bb7fdc40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3bb3caf60 0x55a3bb790b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3bb3aa280 0x55a3bb790650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 --2- 172.21.15.84:0/3265270712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3bb3a20a0 0x55a3bb790110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 >> 172.21.15.84:0/3265270712 conn(0x55a3bb3bf350 msgr2=0x55a3bb77d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:24.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d42000640 0 client.15417 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 shutdown_connections 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 1 -- 172.21.15.84:0/3265270712 wait complete. 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.776+0000 7f5d61be5740 20 client.15417 trim_cache size 0 max 16384 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24742, 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:50:24.781 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 113.673315171, 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 185.66520600499999 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d380b6560 msgr2=0x7f5d380b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d380b6560 0x7f5d380b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c005fd0 tx=0x7f5d4c011040 comp rx=0 tx=0).stop 2024-09-21T07:50:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d54105d80 msgr2=0x7f5d5419c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d54105d80 0x7f5d5419c720 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400e9f0 tx=0x7f5d4400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 shutdown_connections 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d380b6560 0x7f5d380b8a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d5410c010 0x7f5d541a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d5410b6c0 0x7f5d5419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 --2- 172.21.15.84:0/828384999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d54105d80 0x7f5d5419c720 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 >> 172.21.15.84:0/828384999 conn(0x7f5d54101810 msgr2=0x7f5d54103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 shutdown_connections 2024-09-21T07:50:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:24.777+0000 7f5d5b000640 1 -- 172.21.15.84:0/828384999 wait complete. 2024-09-21T07:50:25.544 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:25 smithi084 ceph-mon[30411]: pgmap v373: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:50:25.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:25 smithi162 ceph-mon[34833]: pgmap v373: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:50:25.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:50:25.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:25 smithi191 ceph-mon[34667]: pgmap v373: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:50:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 -- 172.21.15.84:0/1596638061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81092f0 msgr2=0x7fc8e8109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 --2- 172.21.15.84:0/1596638061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81092f0 0x7fc8e8109700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009900 tx=0x7fc8d402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 -- 172.21.15.84:0/1596638061 shutdown_connections 2024-09-21T07:50:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 --2- 172.21.15.84:0/1596638061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e8109c40 0x7fc8e8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 --2- 172.21.15.84:0/1596638061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81092f0 0x7fc8e8109700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 --2- 172.21.15.84:0/1596638061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8e81039b0 0x7fc8e8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 -- 172.21.15.84:0/1596638061 >> 172.21.15.84:0/1596638061 conn(0x7fc8e80ff440 msgr2=0x7fc8e8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 -- 172.21.15.84:0/1596638061 shutdown_connections 2024-09-21T07:50:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.577+0000 7fc8ede00640 1 -- 172.21.15.84:0/1596638061 wait complete. 2024-09-21T07:50:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.578+0000 7fc8ede00640 1 Processor -- start 2024-09-21T07:50:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ede00640 1 -- start start 2024-09-21T07:50:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ede00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81039b0 0x7fc8e819c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ede00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e81092f0 0x7fc8e819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ede00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8e8109c40 0x7fc8e81a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ede00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8113950 con 0x7fc8e81039b0 2024-09-21T07:50:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ede00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e81137d0 con 0x7fc8e81092f0 2024-09-21T07:50:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ede00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8113ad0 con 0x7fc8e8109c40 2024-09-21T07:50:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8eca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81039b0 0x7fc8e819c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8eca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81039b0 0x7fc8e819c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33090/0 (socket says 172.21.15.84:33090) 2024-09-21T07:50:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8eca00640 1 -- 172.21.15.84:0/2146511855 learned_addr learned my addr 172.21.15.84:0/2146511855 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e81092f0 0x7fc8e819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.579+0000 7fc8ed400640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8e8109c40 0x7fc8e81a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.580+0000 7fc8e7e00640 1 -- 172.21.15.84:0/2146511855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8e8109c40 msgr2=0x7fc8e81a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.580+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8e8109c40 0x7fc8e81a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.580+0000 7fc8e7e00640 1 -- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81039b0 msgr2=0x7fc8e819c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.580+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81039b0 0x7fc8e819c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.580+0000 7fc8e7e00640 1 -- 172.21.15.84:0/2146511855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e81a24b0 con 0x7fc8e81092f0 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.580+0000 7fc8eca00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81039b0 0x7fc8e819c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.580+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e81092f0 0x7fc8e819cae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009230 tx=0x7fc8d4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.581+0000 7fc8e5600640 1 -- 172.21.15.84:0/2146511855 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d403f070 con 0x7fc8e81092f0 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.581+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e81a2740 con 0x7fc8e81092f0 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.581+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e81a8f00 con 0x7fc8e81092f0 2024-09-21T07:50:26.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.581+0000 7fc8e5600640 1 -- 172.21.15.84:0/2146511855 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8d4031b50 con 0x7fc8e81092f0 2024-09-21T07:50:26.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.581+0000 7fc8e5600640 1 -- 172.21.15.84:0/2146511855 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4049060 con 0x7fc8e81092f0 2024-09-21T07:50:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.584+0000 7fc8f6042740 1 Processor -- start 2024-09-21T07:50:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8f6042740 1 -- start start 2024-09-21T07:50:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b91bf60 0x55f26bcc2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bcc2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8fb280 0x55f26bcc30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8f6042740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f26bc39d50 con 0x55f26b8f30a0 2024-09-21T07:50:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8f6042740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f26bc29180 con 0x55f26b8fb280 2024-09-21T07:50:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8f6042740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f26bc2cf90 con 0x55f26b91bf60 2024-09-21T07:50:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8ed400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b91bf60 0x55f26bcc2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8eca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bcc2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8ed400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b91bf60 0x55f26bcc2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53894/0 (socket says 172.21.15.84:53894) 2024-09-21T07:50:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.585+0000 7fc8ed400640 1 -- 172.21.15.84:0/114317779 learned_addr learned my addr 172.21.15.84:0/114317779 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8ed400640 1 -- 172.21.15.84:0/114317779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8fb280 msgr2=0x55f26bcc30f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8ed400640 1 --2- 172.21.15.84:0/114317779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8fb280 0x55f26bcc30f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8ed400640 1 -- 172.21.15.84:0/114317779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 msgr2=0x55f26bcc2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8ed400640 1 --2- 172.21.15.84:0/114317779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bcc2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8ed400640 1 -- 172.21.15.84:0/114317779 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f26bbf3a70 con 0x55f26b91bf60 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8e5600640 1 -- 172.21.15.84:0/2146511855 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fc8d4042070 con 0x7fc8e81092f0 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8ed400640 1 --2- 172.21.15.84:0/114317779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b91bf60 0x55f26bcc2670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011440 tx=0x7fc8e0011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac090199566ec087 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.586+0000 7fc8d9c00640 1 -- 172.21.15.84:0/114317779 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0003c30 con 0x55f26b91bf60 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8d9c00640 1 -- 172.21.15.84:0/114317779 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8e0003dd0 con 0x55f26b91bf60 2024-09-21T07:50:26.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8d9c00640 1 -- 172.21.15.84:0/114317779 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e000fa10 con 0x55f26b91bf60 2024-09-21T07:50:26.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8f6042740 1 -- 172.21.15.84:0/114317779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b91bf60 msgr2=0x55f26bcc2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8f6042740 1 --2- 172.21.15.84:0/114317779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b91bf60 0x55f26bcc2670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011440 tx=0x7fc8e0011900 comp rx=0 tx=0).stop 2024-09-21T07:50:26.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8f6042740 1 -- 172.21.15.84:0/114317779 shutdown_connections 2024-09-21T07:50:26.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8f6042740 1 --2- 172.21.15.84:0/114317779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8fb280 0x55f26bcc30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8f6042740 1 --2- 172.21.15.84:0/114317779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bcc2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.587+0000 7fc8f6042740 1 --2- 172.21.15.84:0/114317779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b91bf60 0x55f26bcc2670 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.588+0000 7fc8f6042740 1 -- 172.21.15.84:0/114317779 >> 172.21.15.84:0/114317779 conn(0x55f26b910350 msgr2=0x55f26bcc0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.588+0000 7fc8f6042740 1 -- 172.21.15.84:0/114317779 shutdown_connections 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.588+0000 7fc8f6042740 1 -- 172.21.15.84:0/114317779 wait complete. 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.588+0000 7fc8e5600640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8d00b6470 0x7fc8d00b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.588+0000 7fc8e5600640 1 -- 172.21.15.84:0/2146511855 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc8d41076b0 con 0x7fc8e81092f0 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.588+0000 7fc8eca00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8d00b6470 0x7fc8d00b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.588+0000 7fc8f6042740 1 -- start start 2024-09-21T07:50:26.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 1 Processor -- start 2024-09-21T07:50:26.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8eca00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8d00b6470 0x7fc8d00b8980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009fd0 tx=0x7fc8dc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:26.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bcce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcda140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f26ba8a5f0 con 0x55f26b91bf60 2024-09-21T07:50:26.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f26bbc4460 con 0x55f26b8f30a0 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f26bcd0e50 con 0x55f26b8fb280 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.589+0000 7fc8f6042740 10 client.0 _ll_register_callbacks cb 0x55f26bbd4210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8eca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bcce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53898/0 (socket says 172.21.15.84:53898) 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 -- 172.21.15.84:0/3078348459 learned_addr learned my addr 172.21.15.84:0/3078348459 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8ed400640 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcda140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 -- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 msgr2=0x55f26bcce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bcce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 -- 172.21.15.84:0/3078348459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 msgr2=0x55f26bcda140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcda140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 -- 172.21.15.84:0/3078348459 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f26b987540 con 0x55f26b8fb280 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8eca00640 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bcce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcce780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40cd0b0 tx=0x7fc8d40cd180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd48f01d29f7a271 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:26.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.590+0000 7fc8ce000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.591+0000 7fc8ce000640 1 -- 172.21.15.84:0/3078348459 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4031d00 con 0x55f26b8fb280 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.591+0000 7fc8ce000640 1 -- 172.21.15.84:0/3078348459 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc8d41072c0 con 0x55f26b8fb280 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.591+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f26bbc6a70 con 0x55f26b8fb280 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.591+0000 7fc8ce000640 1 -- 172.21.15.84:0/3078348459 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8d40ccec0 con 0x55f26b8fb280 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.591+0000 7fc8f6042740 10 client.25423 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.591+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f26bbe16f0 con 0x55f26b8fb280 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.591+0000 7fc8ce000640 1 -- 172.21.15.84:0/3078348459 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f26bbc6a70 con 0x55f26b8fb280 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8ce000640 1 -- 172.21.15.84:0/3078348459 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc8d40cc610 con 0x55f26b8fb280 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8f6042740 10 client.25423 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8f6042740 10 client.25423 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8f6042740 20 client.25423 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:26.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8f6042740 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8da8e0 0x55f26bce06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8f6042740 4 client.25423 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f26bc3bca0 con 0x55f26b8da8e0 2024-09-21T07:50:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.592+0000 7fc8eca00640 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8da8e0 0x55f26bce06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.593+0000 7fc8ce000640 10 client.25423 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:26.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.593+0000 7fc8eca00640 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8da8e0 0x55f26bce06e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8ab70e97c58da33 server_cookie=24a35a852e8ae253 in_seq=0 out_seq=0 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.594+0000 7fc8ce000640 1 -- 172.21.15.84:0/3078348459 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f26bc3bca0 con 0x55f26b8da8e0 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.594+0000 7fc8ce000640 10 client.25423 handle_command_reply: tid=0 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.594+0000 7fc8f6042740 1 client.25423 shutdown 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.594+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 msgr2=0x55f26bcce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcce780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40cd0b0 tx=0x7fc8d40cd180 comp rx=0 tx=0).stop 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 shutdown_connections 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcda140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8da8e0 0x55f26bce06e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcce780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 --2- 172.21.15.84:0/3078348459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bcce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8ce000640 0 client.25423 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:26.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 >> 172.21.15.84:0/3078348459 conn(0x55f26b910350 msgr2=0x55f26bcc5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:26.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 shutdown_connections 2024-09-21T07:50:26.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 1 -- 172.21.15.84:0/3078348459 wait complete. 2024-09-21T07:50:26.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.595+0000 7fc8f6042740 20 client.25423 trim_cache size 0 max 16384 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 Processor -- start 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 -- start start 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bce06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcc91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcc96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f26bcdea20 con 0x55f26b91bf60 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f26bcdf0f0 con 0x55f26b8f30a0 2024-09-21T07:50:26.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8f6042740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f26bcdf7c0 con 0x55f26b8fb280 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8ed400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcc96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8ed400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcc96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33124/0 (socket says 172.21.15.84:33124) 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8ed400640 1 -- 172.21.15.84:0/1937119980 learned_addr learned my addr 172.21.15.84:0/1937119980 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8e7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcc91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.614+0000 7fc8eca00640 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bce06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8eca00640 1 -- 172.21.15.84:0/1937119980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 msgr2=0x55f26bcc91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8eca00640 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcc91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8eca00640 1 -- 172.21.15.84:0/1937119980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 msgr2=0x55f26bcc96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:26.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8eca00640 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcc96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8eca00640 1 -- 172.21.15.84:0/1937119980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f26bccc540 con 0x55f26b8f30a0 2024-09-21T07:50:26.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8eca00640 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bce06e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f26bcda700 tx=0x7fc8dc01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a231c0a0582a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:26.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8d9200640 1 -- 172.21.15.84:0/1937119980 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc01d9e0 con 0x55f26b8f30a0 2024-09-21T07:50:26.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8d9200640 1 -- 172.21.15.84:0/1937119980 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8dc01db80 con 0x55f26b8f30a0 2024-09-21T07:50:26.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.615+0000 7fc8d9200640 1 -- 172.21.15.84:0/1937119980 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0316a0 con 0x55f26b8f30a0 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 -- 172.21.15.84:0/1937119980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 msgr2=0x55f26bce06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bce06e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f26bcda700 tx=0x7fc8dc01b000 comp rx=0 tx=0).stop 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 -- 172.21.15.84:0/1937119980 shutdown_connections 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b91bf60 0x55f26bcc96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bcc91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 --2- 172.21.15.84:0/1937119980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b8f30a0 0x55f26bce06e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 -- 172.21.15.84:0/1937119980 >> 172.21.15.84:0/1937119980 conn(0x55f26b910350 msgr2=0x55f26bcce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 -- 172.21.15.84:0/1937119980 shutdown_connections 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.616+0000 7fc8f6042740 1 -- 172.21.15.84:0/1937119980 wait complete. 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 -- start start 2024-09-21T07:50:26.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 Processor -- start 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bce30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bce3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b91bf60 0x55f26bce7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f26bce0560 con 0x55f26b8f30a0 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f26bcdfe90 con 0x55f26b91bf60 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f26bce0c30 con 0x55f26b8fb280 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.617+0000 7fc8f6042740 10 client.0 _ll_register_callbacks cb 0x7fc8d40c9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bce30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bce30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33126/0 (socket says 172.21.15.84:33126) 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 -- 172.21.15.84:0/610436165 learned_addr learned my addr 172.21.15.84:0/610436165 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bce3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8ed400640 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b91bf60 0x55f26bce7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 -- 172.21.15.84:0/610436165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 msgr2=0x55f26bce3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bce3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 -- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b91bf60 msgr2=0x55f26bce7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b91bf60 0x55f26bce7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.618+0000 7fc8eca00640 1 -- 172.21.15.84:0/610436165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f26bce8450 con 0x55f26b8f30a0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8eca00640 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bce30c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0097e0 tx=0x7fc8dc01da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5677fd4be54e7b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8ce000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8ce000640 1 -- 172.21.15.84:0/610436165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc01de30 con 0x55f26b8f30a0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8ce000640 1 -- 172.21.15.84:0/610436165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc8dc005030 con 0x55f26b8f30a0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8dc01db80 con 0x55f26b8f30a0 2024-09-21T07:50:26.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8ce000640 1 -- 172.21.15.84:0/610436165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8dc042050 con 0x55f26b8f30a0 2024-09-21T07:50:26.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8f6042740 10 client.15435 fetch_fsmap learned FSMap version 28 2024-09-21T07:50:26.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.619+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f26bce9640 con 0x55f26b8f30a0 2024-09-21T07:50:26.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8ce000640 1 -- 172.21.15.84:0/610436165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8dc01db80 con 0x55f26b8f30a0 2024-09-21T07:50:26.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8ce000640 1 -- 172.21.15.84:0/610436165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc8dc02f020 con 0x55f26b8f30a0 2024-09-21T07:50:26.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8f6042740 10 client.15435 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T07:50:26.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8f6042740 10 client.15435 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:50:26.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8f6042740 20 client.15435 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8f6042740 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8afc90 0x55f26bd4ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8f6042740 4 client.15435 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "status"}) -- 0x55f26bc37750 con 0x55f26b8afc90 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.620+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8afc90 0x55f26bd4ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8e7e00640 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8afc90 0x55f26bd4ee30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fb56231fbae5aa1 server_cookie=60c2da7cae2288fc in_seq=0 out_seq=0 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8ce000640 10 client.15435 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8ce000640 1 -- 172.21.15.84:0/610436165 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f26bc37750 con 0x55f26b8afc90 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8ce000640 10 client.15435 handle_command_reply: tid=0 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 client.15435 shutdown 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 msgr2=0x55f26bce30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bce30c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0097e0 tx=0x7fc8dc01da00 comp rx=0 tx=0).stop 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 shutdown_connections 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f26b91bf60 0x55f26bce7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f26b8afc90 0x55f26bd4ee30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f26b8fb280 0x55f26bce3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 --2- 172.21.15.84:0/610436165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f26b8f30a0 0x55f26bce30c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 >> 172.21.15.84:0/610436165 conn(0x55f26b910350 msgr2=0x55f26bcc91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.621+0000 7fc8ce000640 0 client.15435 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.622+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 shutdown_connections 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.622+0000 7fc8f6042740 1 -- 172.21.15.84:0/610436165 wait complete. 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.622+0000 7fc8f6042740 20 client.15435 trim_cache size 0 max 16384 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24746, 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:50:26.626 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 163.91718312200001, 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 28, 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 178.21018412199999 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:50:26.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.622+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8d00b6470 msgr2=0x7fc8d00b8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8d00b6470 0x7fc8d00b8980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009fd0 tx=0x7fc8dc005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e81092f0 msgr2=0x7fc8e819cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e81092f0 0x7fc8e819cae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009230 tx=0x7fc8d4003b90 comp rx=0 tx=0).stop 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 shutdown_connections 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8d00b6470 0x7fc8d00b8980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8e8109c40 0x7fc8e81a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e81092f0 0x7fc8e819cae0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 --2- 172.21.15.84:0/2146511855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e81039b0 0x7fc8e819c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 >> 172.21.15.84:0/2146511855 conn(0x7fc8e80ff440 msgr2=0x7fc8e8108970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 shutdown_connections 2024-09-21T07:50:26.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:26.623+0000 7fc8ede00640 1 -- 172.21.15.84:0/2146511855 wait complete. 2024-09-21T07:50:27.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:27 smithi084 ceph-mon[30411]: pgmap v374: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:50:27.460 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T07:50:27.483 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T07:50:27.483 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T07:50:27.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:27.484 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T07:50:27.519 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T07:50:27.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:27.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T07:50:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:27 smithi162 ceph-mon[34833]: pgmap v374: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:50:27.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:27.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-09-21T07:50:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:27 smithi191 ceph-mon[34667]: pgmap v374: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T07:50:27.943 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T07:50:27.943 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:50:27.943 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:50:27.943 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T07:50:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:28.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 -- 172.21.15.84:0/96183995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c102640 msgr2=0x7fb76c102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:28.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 --2- 172.21.15.84:0/96183995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c102640 0x7fb76c102a50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009900 tx=0x7fb75c02a480 comp rx=0 tx=0).stop 2024-09-21T07:50:28.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 -- 172.21.15.84:0/96183995 shutdown_connections 2024-09-21T07:50:28.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 --2- 172.21.15.84:0/96183995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c1101f0 0x7fb76c112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:28.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 --2- 172.21.15.84:0/96183995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76c102f90 0x7fb76c10fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:28.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 --2- 172.21.15.84:0/96183995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c102640 0x7fb76c102a50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:28.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 -- 172.21.15.84:0/96183995 >> 172.21.15.84:0/96183995 conn(0x7fb76c0796e0 msgr2=0x7fb76c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:28.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 -- 172.21.15.84:0/96183995 shutdown_connections 2024-09-21T07:50:28.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.905+0000 7fb771a00640 1 -- 172.21.15.84:0/96183995 wait complete. 2024-09-21T07:50:28.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.906+0000 7fb771a00640 1 Processor -- start 2024-09-21T07:50:28.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.906+0000 7fb771a00640 1 -- start start 2024-09-21T07:50:28.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb771a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c102640 0x7fb76c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb771a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76c102f90 0x7fb76c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb771a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c1101f0 0x7fb76c1a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb771a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c115c90 con 0x7fb76c1101f0 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb771a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c115b10 con 0x7fb76c102640 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb771a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c115e10 con 0x7fb76c102f90 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb76b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c1101f0 0x7fb76c1a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb76b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c1101f0 0x7fb76c1a1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57890/0 (socket says 172.21.15.84:57890) 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb76b400640 1 -- 172.21.15.84:0/2047638451 learned_addr learned my addr 172.21.15.84:0/2047638451 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb76aa00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c102640 0x7fb76c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.907+0000 7fb762000640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76c102f90 0x7fb76c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb76b400640 1 -- 172.21.15.84:0/2047638451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76c102f90 msgr2=0x7fb76c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb76b400640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76c102f90 0x7fb76c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb76b400640 1 -- 172.21.15.84:0/2047638451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c102640 msgr2=0x7fb76c19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb76b400640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c102640 0x7fb76c19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:28.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb76b400640 1 -- 172.21.15.84:0/2047638451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c1a2610 con 0x7fb76c1101f0 2024-09-21T07:50:28.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb76b400640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c1101f0 0x7fb76c1a1ee0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb76400eb10 tx=0x7fb76400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:28.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb763e00640 1 -- 172.21.15.84:0/2047638451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764004b20 con 0x7fb76c1101f0 2024-09-21T07:50:28.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb763e00640 1 -- 172.21.15.84:0/2047638451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb764004cc0 con 0x7fb76c1101f0 2024-09-21T07:50:28.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb763e00640 1 -- 172.21.15.84:0/2047638451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764010670 con 0x7fb76c1101f0 2024-09-21T07:50:28.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.908+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c1a2900 con 0x7fb76c1101f0 2024-09-21T07:50:28.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.909+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c1a9060 con 0x7fb76c1101f0 2024-09-21T07:50:28.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.910+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c06c1a0 con 0x7fb76c1101f0 2024-09-21T07:50:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.912+0000 7fb763e00640 1 -- 172.21.15.84:0/2047638451 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fb764005020 con 0x7fb76c1101f0 2024-09-21T07:50:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.913+0000 7fb763e00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7500b6560 0x7fb7500b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.914+0000 7fb763e00640 1 -- 172.21.15.84:0/2047638451 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb7640e7dd0 con 0x7fb76c1101f0 2024-09-21T07:50:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.914+0000 7fb76aa00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7500b6560 0x7fb7500b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:28.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.914+0000 7fb76aa00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7500b6560 0x7fb7500b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb75c031440 tx=0x7fb75c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:28.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:28.917+0000 7fb763e00640 1 -- 172.21.15.84:0/2047638451 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7640ae1d0 con 0x7fb76c1101f0 2024-09-21T07:50:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.143+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb76c02e640 con 0x7fb76c1101f0 2024-09-21T07:50:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.143+0000 7fb763e00640 1 -- 172.21.15.84:0/2047638451 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7fb7640b25b0 con 0x7fb76c1101f0 2024-09-21T07:50:29.145 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7500b6560 msgr2=0x7fb7500b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7500b6560 0x7fb7500b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb75c031440 tx=0x7fb75c009560 comp rx=0 tx=0).stop 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c1101f0 msgr2=0x7fb76c1a1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c1101f0 0x7fb76c1a1ee0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb76400eb10 tx=0x7fb76400c2d0 comp rx=0 tx=0).stop 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 shutdown_connections 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb7500b6560 0x7fb7500b8a70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb76c1101f0 0x7fb76c1a1ee0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76c102f90 0x7fb76c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 --2- 172.21.15.84:0/2047638451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c102640 0x7fb76c19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 >> 172.21.15.84:0/2047638451 conn(0x7fb76c0796e0 msgr2=0x7fb76c111700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 shutdown_connections 2024-09-21T07:50:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:29.146+0000 7fb771a00640 1 -- 172.21.15.84:0/2047638451 wait complete. 2024-09-21T07:50:29.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:29 smithi084 ceph-mon[30411]: pgmap v375: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:29.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:29 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2047638451' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:50:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:29 smithi162 ceph-mon[34833]: pgmap v375: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:29 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2047638451' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:50:29.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:29 smithi191 ceph-mon[34667]: pgmap v375: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:29.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:29 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2047638451' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:50:29.932 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:50:29.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:50:29.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-09-21T07:50:29.933 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:50:29.933 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:50:29.933 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:50:29.933 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:50:29.933 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:50:29.933 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:50:29.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:29.933 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:50:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42013sec preferred_lft 42013sec 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T07:50:29.970 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:50:29.970 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:50:29.970 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:50:29.971 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:50:29.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:50:29.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-09-21T07:50:29.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-09-21T07:50:29.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:50:29.971 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:50:30.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:50:30.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:30.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:30.198 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:50:30.253 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-09-21T07:50:30.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:30.257 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-09-21T07:50:30.294 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-09-21T07:50:30.294 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:50:30.294 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:50:30.294 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:50:30.294 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:50:30.294 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:50:30.294 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:50:30.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:50:30.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:50:30.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:50:30.295 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:50:30.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:50:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:30.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:30.491 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T07:50:30.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:30.527 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-09-21T07:50:30.603 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:50:30.603 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:50:30.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:50:30.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:50:30.603 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:50:30.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:50:30.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:30.782 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:50:30.782 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:50:30.782 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:50:30.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:50:30.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:50:30.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:50:30.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:50:30.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:50:30.783 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:50:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:50:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:31.001 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:50:31.002 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T07:50:31.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-09-21T07:50:31.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:50:31.002 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T07:50:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:50:31.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:31.168 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:50:31.168 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:50:31.203 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:50:31.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:50:31.204 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:50:31.278 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T07:50:31.278 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T07:50:31.278 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/e73e0f04-a2c3-42ea-8489-c117528eaa5d 2024-09-21T07:50:31.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:31.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/e73e0f04-a2c3-42ea-8489-c117528eaa5d /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-21T07:50:31.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:31 smithi084 ceph-mon[30411]: pgmap v376: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:31.466 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-21T07:50:31.466 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-21T07:50:31.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:31 smithi162 ceph-mon[34833]: pgmap v376: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:31.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:31 smithi191 ceph-mon[34667]: pgmap v376: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T07:50:32.126 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-21T07:50:32.126 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-21T07:50:32.126 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.162:6789,172.21.15.191:6789" 2024-09-21T07:50:32.126 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@56620f92-77ec-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/e73e0f04-a2c3-42ea-8489-c117528eaa5d 2024-09-21T07:50:32.127 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.84:6789/172.21.15.162:6789/172.21.15.191:6789" will pass to kernel 2024-09-21T07:50:32.129 INFO:teuthology.orchestra.run.smithi084.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:50:32.129 INFO:teuthology.orchestra.run.smithi084.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:50:32.129 INFO:teuthology.orchestra.run.smithi084.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:50:32.129 INFO:teuthology.orchestra.run.smithi084.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:50:32.129 INFO:teuthology.orchestra.run.smithi084.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:50:32.132 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:50:32.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:50:32.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:50:32.191 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:50:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:50:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:32.281 INFO:teuthology.orchestra.run.smithi084.stdout:client15444 2024-09-21T07:50:32.282 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:50:32.282 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:50:32.317 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:50:32.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:50:32.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:32.447 INFO:teuthology.orchestra.run.smithi084.stdout:client15444 2024-09-21T07:50:32.447 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:50:32.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:50:32.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:32.537 INFO:teuthology.orchestra.run.smithi084.stdout:client15444 2024-09-21T07:50:32.537 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/56620f92-77ec-11ef-baf5-efdc52797490.client15444/status') 2024-09-21T07:50:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:50:32.636 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.15444 (3)192.168.0.1:0/772092058 2024-09-21T07:50:32.636 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2024-09-21T07:50:32.636 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2024-09-21T07:50:32.636 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2024-09-21T07:50:32.636 INFO:teuthology.orchestra.run.smithi084.stderr:69 bytes copied, 6.9443e-05 s, 994 kB/s 2024-09-21T07:50:32.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:50:32.647 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T07:50:32.662 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:50:32.662 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T07:50:32.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 -- 172.21.15.84:0/3794896199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca80104930 msgr2=0x7fca80104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 --2- 172.21.15.84:0/3794896199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca80104930 0x7fca80104d40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fca70009900 tx=0x7fca7002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 -- 172.21.15.84:0/3794896199 shutdown_connections 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 --2- 172.21.15.84:0/3794896199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca8010dd90 0x7fca80110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 --2- 172.21.15.84:0/3794896199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca80105280 0x7fca8010d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 --2- 172.21.15.84:0/3794896199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca80104930 0x7fca80104d40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 -- 172.21.15.84:0/3794896199 >> 172.21.15.84:0/3794896199 conn(0x7fca800fe3c0 msgr2=0x7fca80100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 -- 172.21.15.84:0/3794896199 shutdown_connections 2024-09-21T07:50:32.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.876+0000 7fca85800640 1 -- 172.21.15.84:0/3794896199 wait complete. 2024-09-21T07:50:32.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.877+0000 7fca85800640 1 Processor -- start 2024-09-21T07:50:32.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.877+0000 7fca85800640 1 -- start start 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.877+0000 7fca85800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca80104930 0x7fca8019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.877+0000 7fca85800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca80105280 0x7fca8019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.877+0000 7fca85800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8010dd90 0x7fca801a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca85800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca801139f0 con 0x7fca8010dd90 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca85800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca80113870 con 0x7fca80104930 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca85800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca80113b70 con 0x7fca80105280 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8010dd90 0x7fca801a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8010dd90 0x7fca801a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57912/0 (socket says 172.21.15.84:57912) 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 -- 172.21.15.84:0/4027145953 learned_addr learned my addr 172.21.15.84:0/4027145953 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7ea00640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca80104930 0x7fca8019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7e000640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca80105280 0x7fca8019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:32.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 -- 172.21.15.84:0/4027145953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca80105280 msgr2=0x7fca8019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:32.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca80105280 0x7fca8019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:32.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 -- 172.21.15.84:0/4027145953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca80104930 msgr2=0x7fca8019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:32.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca80104930 0x7fca8019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:32.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.878+0000 7fca7f400640 1 -- 172.21.15.84:0/4027145953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca801a2560 con 0x7fca8010dd90 2024-09-21T07:50:32.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.879+0000 7fca7f400640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8010dd90 0x7fca801a1e60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fca7800eb10 tx=0x7fca7800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:32.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.879+0000 7fca77400640 1 -- 172.21.15.84:0/4027145953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78004b20 con 0x7fca8010dd90 2024-09-21T07:50:32.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.879+0000 7fca77400640 1 -- 172.21.15.84:0/4027145953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca78004cc0 con 0x7fca8010dd90 2024-09-21T07:50:32.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.879+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca801a2850 con 0x7fca8010dd90 2024-09-21T07:50:32.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.879+0000 7fca77400640 1 -- 172.21.15.84:0/4027145953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78010670 con 0x7fca8010dd90 2024-09-21T07:50:32.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.879+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca801a8fe0 con 0x7fca8010dd90 2024-09-21T07:50:32.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.880+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca80104d40 con 0x7fca8010dd90 2024-09-21T07:50:32.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.882+0000 7fca77400640 1 -- 172.21.15.84:0/4027145953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fca78005020 con 0x7fca8010dd90 2024-09-21T07:50:32.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.884+0000 7fca77400640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca640b65e0 0x7fca640b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:32.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.884+0000 7fca77400640 1 -- 172.21.15.84:0/4027145953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fca780e7e00 con 0x7fca8010dd90 2024-09-21T07:50:32.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.884+0000 7fca7ea00640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca640b65e0 0x7fca640b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:32.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.885+0000 7fca7ea00640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca640b65e0 0x7fca640b8af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca70031440 tx=0x7fca70009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:32.888+0000 7fca77400640 1 -- 172.21.15.84:0/4027145953 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca780ae200 con 0x7fca8010dd90 2024-09-21T07:50:33.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.117+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fca801a9280 con 0x7fca8010dd90 2024-09-21T07:50:33.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.460+0000 7fca77400640 1 -- 172.21.15.84:0/4027145953 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7fca780b25e0 con 0x7fca8010dd90 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca640b65e0 msgr2=0x7fca640b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca640b65e0 0x7fca640b8af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca70031440 tx=0x7fca70009560 comp rx=0 tx=0).stop 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8010dd90 msgr2=0x7fca801a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8010dd90 0x7fca801a1e60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fca7800eb10 tx=0x7fca7800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 shutdown_connections 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca640b65e0 0x7fca640b8af0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8010dd90 0x7fca801a1e60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca80105280 0x7fca8019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 --2- 172.21.15.84:0/4027145953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca80104930 0x7fca8019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 >> 172.21.15.84:0/4027145953 conn(0x7fca800fe3c0 msgr2=0x7fca8010bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 shutdown_connections 2024-09-21T07:50:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.463+0000 7fca85800640 1 -- 172.21.15.84:0/4027145953 wait complete. 2024-09-21T07:50:33.487 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:33 smithi084 ceph-mon[30411]: pgmap v377: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:50:33.487 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:33 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4027145953' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T07:50:33.489 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T07:50:33.502 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T07:50:33.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:50:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:33 smithi162 ceph-mon[34833]: pgmap v377: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:50:33.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:33 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4027145953' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T07:50:33.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:33 smithi191 ceph-mon[34667]: pgmap v377: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:50:33.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:33 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4027145953' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T07:50:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 -- 172.21.15.84:0/2187490403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa8075dd0 msgr2=0x7feaa80761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 --2- 172.21.15.84:0/2187490403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa8075dd0 0x7feaa80761e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fea94009900 tx=0x7fea9402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 -- 172.21.15.84:0/2187490403 shutdown_connections 2024-09-21T07:50:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 --2- 172.21.15.84:0/2187490403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feaa81141b0 0x7feaa8116680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 --2- 172.21.15.84:0/2187490403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa8075dd0 0x7feaa80761e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 --2- 172.21.15.84:0/2187490403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa8077390 0x7feaa80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 -- 172.21.15.84:0/2187490403 >> 172.21.15.84:0/2187490403 conn(0x7feaa80ff350 msgr2=0x7feaa81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 -- 172.21.15.84:0/2187490403 shutdown_connections 2024-09-21T07:50:33.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.771+0000 7feaa7200640 1 -- 172.21.15.84:0/2187490403 wait complete. 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.772+0000 7feaa7200640 1 Processor -- start 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.772+0000 7feaa7200640 1 -- start start 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa7200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feaa8075dd0 0x7feaa81a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa8077390 0x7feaa81a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa81141b0 0x7feaa81a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feaa8119df0 con 0x7feaa81141b0 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feaa8119c70 con 0x7feaa8077390 2024-09-21T07:50:33.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa7200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feaa8119f70 con 0x7feaa8075dd0 2024-09-21T07:50:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa81141b0 0x7feaa81a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feaa8075dd0 0x7feaa81a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa81141b0 0x7feaa81a6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57930/0 (socket says 172.21.15.84:57930) 2024-09-21T07:50:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa6800640 1 -- 172.21.15.84:0/432298890 learned_addr learned my addr 172.21.15.84:0/432298890 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:33.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.773+0000 7feaa5400640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa8077390 0x7feaa81a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa5e00640 1 -- 172.21.15.84:0/432298890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa8077390 msgr2=0x7feaa81a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa5e00640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa8077390 0x7feaa81a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa5e00640 1 -- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa81141b0 msgr2=0x7feaa81a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa5e00640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa81141b0 0x7feaa81a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa5e00640 1 -- 172.21.15.84:0/432298890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa81a6720 con 0x7feaa8075dd0 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa5e00640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feaa8075dd0 0x7feaa81a07f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e9f0 tx=0x7fea9800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7fea9ea00640 1 -- 172.21.15.84:0/432298890 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9800ccc0 con 0x7feaa8075dd0 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa81a6a10 con 0x7feaa8075dd0 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7fea9ea00640 1 -- 172.21.15.84:0/432298890 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea980108e0 con 0x7feaa8075dd0 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7fea9ea00640 1 -- 172.21.15.84:0/432298890 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98018880 con 0x7feaa8075dd0 2024-09-21T07:50:33.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.774+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa81ad1a0 con 0x7feaa8075dd0 2024-09-21T07:50:33.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.776+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa80761e0 con 0x7feaa8075dd0 2024-09-21T07:50:33.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.778+0000 7fea9ea00640 1 -- 172.21.15.84:0/432298890 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fea98010430 con 0x7feaa8075dd0 2024-09-21T07:50:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.779+0000 7fea9ea00640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fea8c0b6560 0x7fea8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.780+0000 7fea9ea00640 1 -- 172.21.15.84:0/432298890 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fea980e7cf0 con 0x7feaa8075dd0 2024-09-21T07:50:33.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.780+0000 7feaa5400640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fea8c0b6560 0x7fea8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:33.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.780+0000 7feaa5400640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fea8c0b6560 0x7fea8c0b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea94031440 tx=0x7fea94009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:33.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.782+0000 7fea9ea00640 1 -- 172.21.15.84:0/432298890 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea980b24d0 con 0x7feaa8075dd0 2024-09-21T07:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.996+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feaa802e640 con 0x7feaa8075dd0 2024-09-21T07:50:34.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:33.998+0000 7fea9ea00640 1 -- 172.21.15.84:0/432298890 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+25144 (secure 0 0 0) 0x7fea980b7410 con 0x7feaa8075dd0 2024-09-21T07:50:34.000 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:34.001 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:49:31.146906+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fea8c0b6560 msgr2=0x7fea8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fea8c0b6560 0x7fea8c0b8a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea94031440 tx=0x7fea94009560 comp rx=0 tx=0).stop 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feaa8075dd0 msgr2=0x7feaa81a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feaa8075dd0 0x7feaa81a07f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e9f0 tx=0x7fea9800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 shutdown_connections 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fea8c0b6560 0x7fea8c0b8a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa81141b0 0x7feaa81a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa8077390 0x7feaa81a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 --2- 172.21.15.84:0/432298890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feaa8075dd0 0x7feaa81a07f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 >> 172.21.15.84:0/432298890 conn(0x7feaa80ff350 msgr2=0x7feaa81100b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:34.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 shutdown_connections 2024-09-21T07:50:34.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.001+0000 7feaa7200640 1 -- 172.21.15.84:0/432298890 wait complete. 2024-09-21T07:50:34.030 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:42:36.190783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:47:35.807539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:47:38.820711+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T07:47:47.739225+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T07:50:34.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:50:34.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.257+0000 7fe192a00640 1 -- 172.21.15.84:0/3797724960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 msgr2=0x7fe18c1097d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.257+0000 7fe192a00640 1 --2- 172.21.15.84:0/3797724960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c1097d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe178009900 tx=0x7fe17802a410 comp rx=0 tx=0).stop 2024-09-21T07:50:34.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.257+0000 7fe192a00640 1 -- 172.21.15.84:0/3797724960 shutdown_connections 2024-09-21T07:50:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.257+0000 7fe192a00640 1 --2- 172.21.15.84:0/3797724960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe18c109d10 0x7fe18c110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.257+0000 7fe192a00640 1 --2- 172.21.15.84:0/3797724960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c1097d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.257+0000 7fe192a00640 1 --2- 172.21.15.84:0/3797724960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c103a90 0x7fe18c103ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.257+0000 7fe192a00640 1 -- 172.21.15.84:0/3797724960 >> 172.21.15.84:0/3797724960 conn(0x7fe18c0ff4d0 msgr2=0x7fe18c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.258+0000 7fe192a00640 1 -- 172.21.15.84:0/3797724960 shutdown_connections 2024-09-21T07:50:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.258+0000 7fe192a00640 1 -- 172.21.15.84:0/3797724960 wait complete. 2024-09-21T07:50:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 Processor -- start 2024-09-21T07:50:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 -- start start 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe18c103a90 0x7fe18c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c109d10 0x7fe18c1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c1139d0 con 0x7fe18c1093c0 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c113850 con 0x7fe18c109d10 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe192a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c113b50 con 0x7fe18c103a90 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe18b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe18b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57950/0 (socket says 172.21.15.84:57950) 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe18b400640 1 -- 172.21.15.84:0/924373958 learned_addr learned my addr 172.21.15.84:0/924373958 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.259+0000 7fe18be00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe18c103a90 0x7fe18c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe190a00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c109d10 0x7fe18c1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe18b400640 1 -- 172.21.15.84:0/924373958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe18c103a90 msgr2=0x7fe18c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe18b400640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe18c103a90 0x7fe18c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe18b400640 1 -- 172.21.15.84:0/924373958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c109d10 msgr2=0x7fe18c1a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe18b400640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c109d10 0x7fe18c1a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe18b400640 1 -- 172.21.15.84:0/924373958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c1a2500 con 0x7fe18c1093c0 2024-09-21T07:50:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe18b400640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c19cb70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe17802a930 tx=0x7fe178031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.260+0000 7fe188c00640 1 -- 172.21.15.84:0/924373958 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17803f030 con 0x7fe18c1093c0 2024-09-21T07:50:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.261+0000 7fe188c00640 1 -- 172.21.15.84:0/924373958 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe178004490 con 0x7fe18c1093c0 2024-09-21T07:50:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.261+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c1a2790 con 0x7fe18c1093c0 2024-09-21T07:50:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.261+0000 7fe188c00640 1 -- 172.21.15.84:0/924373958 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178035070 con 0x7fe18c1093c0 2024-09-21T07:50:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.261+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c1a8f80 con 0x7fe18c1093c0 2024-09-21T07:50:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.262+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c103ea0 con 0x7fe18c1093c0 2024-09-21T07:50:34.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.267+0000 7fe188c00640 1 -- 172.21.15.84:0/924373958 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fe178042030 con 0x7fe18c1093c0 2024-09-21T07:50:34.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.269+0000 7fe188c00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1700b6560 0x7fe1700b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.269+0000 7fe188c00640 1 -- 172.21.15.84:0/924373958 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe178107f10 con 0x7fe18c1093c0 2024-09-21T07:50:34.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.269+0000 7fe18be00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1700b6560 0x7fe1700b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.269+0000 7fe188c00640 1 -- 172.21.15.84:0/924373958 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1781083b0 con 0x7fe18c1093c0 2024-09-21T07:50:34.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.270+0000 7fe18be00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1700b6560 0x7fe1700b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009bd0 tx=0x7fe17c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.464+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe18c1a91b0 con 0x7fe18c1093c0 2024-09-21T07:50:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.465+0000 7fe188c00640 1 -- 172.21.15.84:0/924373958 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fe1780d2730 con 0x7fe18c1093c0 2024-09-21T07:50:34.467 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T07:50:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.467+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1700b6560 msgr2=0x7fe1700b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.467+0000 7fe192a00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1700b6560 0x7fe1700b8a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009bd0 tx=0x7fe17c005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.467+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 msgr2=0x7fe18c19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.467+0000 7fe192a00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c19cb70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe17802a930 tx=0x7fe178031a20 comp rx=0 tx=0).stop 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.467+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 shutdown_connections 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.467+0000 7fe192a00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1700b6560 0x7fe1700b8a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.467+0000 7fe192a00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c109d10 0x7fe18c1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.468+0000 7fe192a00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c1093c0 0x7fe18c19cb70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.468+0000 7fe192a00640 1 --2- 172.21.15.84:0/924373958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe18c103a90 0x7fe18c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.468+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 >> 172.21.15.84:0/924373958 conn(0x7fe18c0ff4d0 msgr2=0x7fe18c106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.468+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 shutdown_connections 2024-09-21T07:50:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.468+0000 7fe192a00640 1 -- 172.21.15.84:0/924373958 wait complete. 2024-09-21T07:50:34.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:50:34.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 -- 172.21.15.84:0/1967245827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 msgr2=0x7f869c103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 --2- 172.21.15.84:0/1967245827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 0x7f869c103d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8690009900 tx=0x7f869002a400 comp rx=0 tx=0).stop 2024-09-21T07:50:34.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 -- 172.21.15.84:0/1967245827 shutdown_connections 2024-09-21T07:50:34.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 --2- 172.21.15.84:0/1967245827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 0x7f869c1103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 --2- 172.21.15.84:0/1967245827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f869c109220 0x7f869c109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 --2- 172.21.15.84:0/1967245827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 0x7f869c103d00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 -- 172.21.15.84:0/1967245827 >> 172.21.15.84:0/1967245827 conn(0x7f869c0ff350 msgr2=0x7f869c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:34.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 -- 172.21.15.84:0/1967245827 shutdown_connections 2024-09-21T07:50:34.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.720+0000 7f86a2400640 1 -- 172.21.15.84:0/1967245827 wait complete. 2024-09-21T07:50:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.721+0000 7f86a2400640 1 Processor -- start 2024-09-21T07:50:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.721+0000 7f86a2400640 1 -- start start 2024-09-21T07:50:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 0x7f869c077130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a2400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f869c109220 0x7f869c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a2400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 0x7f869c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a2400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f869c113830 con 0x7f869c109b70 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f869c1136b0 con 0x7f869c1038f0 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a2400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f869c1139b0 con 0x7f869c109220 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 0x7f869c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 0x7f869c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57962/0 (socket says 172.21.15.84:57962) 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a1a00640 1 -- 172.21.15.84:0/888065383 learned_addr learned my addr 172.21.15.84:0/888065383 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f86a1000640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 0x7f869c077130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.722+0000 7f869be00640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f869c109220 0x7f869c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f86a1a00640 1 -- 172.21.15.84:0/888065383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f869c109220 msgr2=0x7f869c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f86a1a00640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f869c109220 0x7f869c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f86a1a00640 1 -- 172.21.15.84:0/888065383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 msgr2=0x7f869c077130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f86a1a00640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 0x7f869c077130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f86a1a00640 1 -- 172.21.15.84:0/888065383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c076470 con 0x7f869c109b70 2024-09-21T07:50:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f86a1a00640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 0x7f869c075c50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8694009fd0 tx=0x7f869400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f8699600640 1 -- 172.21.15.84:0/888065383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694017070 con 0x7f869c109b70 2024-09-21T07:50:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869c1acc40 con 0x7f869c109b70 2024-09-21T07:50:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f8699600640 1 -- 172.21.15.84:0/888065383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8694003e20 con 0x7f869c109b70 2024-09-21T07:50:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.723+0000 7f8699600640 1 -- 172.21.15.84:0/888065383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694010460 con 0x7f869c109b70 2024-09-21T07:50:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.724+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f869c1ad190 con 0x7f869c109b70 2024-09-21T07:50:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.725+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f869c103d00 con 0x7f869c109b70 2024-09-21T07:50:34.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.727+0000 7f8699600640 1 -- 172.21.15.84:0/888065383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f8694003970 con 0x7f869c109b70 2024-09-21T07:50:34.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.729+0000 7f8699600640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86840b6560 0x7f86840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:34.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.730+0000 7f8699600640 1 -- 172.21.15.84:0/888065383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f86940e74c0 con 0x7f869c109b70 2024-09-21T07:50:34.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.730+0000 7f86a1000640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86840b6560 0x7f86840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:34.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.730+0000 7f86a1000640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86840b6560 0x7f86840b8a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8690000c00 tx=0x7f8690031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:34.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.734+0000 7f8699600640 1 -- 172.21.15.84:0/888065383 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86940b1ca0 con 0x7f869c109b70 2024-09-21T07:50:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:34 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/4027145953' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T07:50:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:34 smithi162 ceph-mon[34833]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:50:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:34 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/432298890' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:34.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:34 smithi162 ceph-mon[34833]: pgmap v378: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:50:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:34 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/4027145953' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T07:50:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:34 smithi084 ceph-mon[30411]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:50:34.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:34 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/432298890' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:34.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:34 smithi084 ceph-mon[30411]: pgmap v378: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:50:34.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:34 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/4027145953' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T07:50:34.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:34 smithi191 ceph-mon[34667]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:50:34.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:34 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/432298890' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:34.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:34 smithi191 ceph-mon[34667]: pgmap v378: 129 pgs: 129 active+clean; 650 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:50:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.950+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f869c02e640 con 0x7f869c109b70 2024-09-21T07:50:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.951+0000 7f8699600640 1 -- 172.21.15.84:0/888065383 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f86940b6be0 con 0x7f869c109b70 2024-09-21T07:50:34.952 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T07:50:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86840b6560 msgr2=0x7f86840b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86840b6560 0x7f86840b8a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8690000c00 tx=0x7f8690031400 comp rx=0 tx=0).stop 2024-09-21T07:50:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 msgr2=0x7f869c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 0x7f869c075c50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8694009fd0 tx=0x7f869400b260 comp rx=0 tx=0).stop 2024-09-21T07:50:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 shutdown_connections 2024-09-21T07:50:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86840b6560 0x7f86840b8a70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f869c109b70 0x7f869c075c50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f869c109220 0x7f869c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 --2- 172.21.15.84:0/888065383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869c1038f0 0x7f869c077130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 >> 172.21.15.84:0/888065383 conn(0x7f869c0ff350 msgr2=0x7f869c101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 shutdown_connections 2024-09-21T07:50:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:34.953+0000 7f86a2400640 1 -- 172.21.15.84:0/888065383 wait complete. 2024-09-21T07:50:34.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:50:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 -- 172.21.15.84:0/958374536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 msgr2=0x7f6cd0112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/958374536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 0x7f6cd0112770 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009ca0 tx=0x7f6cc802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 -- 172.21.15.84:0/958374536 shutdown_connections 2024-09-21T07:50:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/958374536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 0x7f6cd0112770 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/958374536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd010b5f0 0x7f6cd010ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/958374536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cd0105cc0 0x7f6cd01060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 -- 172.21.15.84:0/958374536 >> 172.21.15.84:0/958374536 conn(0x7f6cd01016c0 msgr2=0x7f6cd0103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:35.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 -- 172.21.15.84:0/958374536 shutdown_connections 2024-09-21T07:50:35.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.198+0000 7f6cd5a00640 1 -- 172.21.15.84:0/958374536 wait complete. 2024-09-21T07:50:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 Processor -- start 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 -- start start 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cd0105cc0 0x7f6cd019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd010b5f0 0x7f6cd019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 0x7f6cd01a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0115c00 con 0x7f6cd010bf40 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0115a80 con 0x7f6cd010b5f0 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.199+0000 7f6cd5a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0115d80 con 0x7f6cd0105cc0 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6ccea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cd0105cc0 0x7f6cd019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6ccea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cd0105cc0 0x7f6cd019c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57508/0 (socket says 172.21.15.84:57508) 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6ccea00640 1 -- 172.21.15.84:0/2748282708 learned_addr learned my addr 172.21.15.84:0/2748282708 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6cce000640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd010b5f0 0x7f6cd019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6ccf400640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 0x7f6cd01a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6cce000640 1 -- 172.21.15.84:0/2748282708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cd0105cc0 msgr2=0x7f6cd019c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6cce000640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cd0105cc0 0x7f6cd019c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6cce000640 1 -- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 msgr2=0x7f6cd01a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6cce000640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 0x7f6cd01a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6cce000640 1 -- 172.21.15.84:0/2748282708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01a2490 con 0x7f6cd010b5f0 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.200+0000 7f6ccf400640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 0x7f6cd01a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.201+0000 7f6cce000640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd010b5f0 0x7f6cd019cb00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cd006c9f0 tx=0x7f6cbc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.201+0000 7f6cc7400640 1 -- 172.21.15.84:0/2748282708 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00cc40 con 0x7f6cd010b5f0 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.201+0000 7f6cc7400640 1 -- 172.21.15.84:0/2748282708 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cbc00cde0 con 0x7f6cd010b5f0 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.201+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd01a2780 con 0x7f6cd010b5f0 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.201+0000 7f6cc7400640 1 -- 172.21.15.84:0/2748282708 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc018780 con 0x7f6cd010b5f0 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.201+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01a8f10 con 0x7f6cd010b5f0 2024-09-21T07:50:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.202+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd01060d0 con 0x7f6cd010b5f0 2024-09-21T07:50:35.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.206+0000 7f6cc7400640 1 -- 172.21.15.84:0/2748282708 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f6cbc010a90 con 0x7f6cd010b5f0 2024-09-21T07:50:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.207+0000 7f6cc7400640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6cb40b6560 0x7f6cb40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.207+0000 7f6cc7400640 1 -- 172.21.15.84:0/2748282708 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6cbc0e7f60 con 0x7f6cd010b5f0 2024-09-21T07:50:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.208+0000 7f6ccea00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6cb40b6560 0x7f6cb40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.208+0000 7f6cc7400640 1 -- 172.21.15.84:0/2748282708 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cbc0b2740 con 0x7f6cd010b5f0 2024-09-21T07:50:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.208+0000 7f6ccea00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6cb40b6560 0x7f6cb40b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009c90 tx=0x7f6cc0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:35.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.399+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6cd010dd90 con 0x7f6cd010b5f0 2024-09-21T07:50:35.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.399+0000 7f6cc7400640 1 -- 172.21.15.84:0/2748282708 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f6cbc0b7680 con 0x7f6cd010b5f0 2024-09-21T07:50:35.401 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6cb40b6560 msgr2=0x7f6cb40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6cb40b6560 0x7f6cb40b8a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009c90 tx=0x7f6cc0005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd010b5f0 msgr2=0x7f6cd019cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd010b5f0 0x7f6cd019cb00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cd006c9f0 tx=0x7f6cbc00ee50 comp rx=0 tx=0).stop 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 shutdown_connections 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6cb40b6560 0x7f6cb40b8a70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd010bf40 0x7f6cd01a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd010b5f0 0x7f6cd019cb00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 --2- 172.21.15.84:0/2748282708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cd0105cc0 0x7f6cd019c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 >> 172.21.15.84:0/2748282708 conn(0x7f6cd01016c0 msgr2=0x7f6cd010aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 shutdown_connections 2024-09-21T07:50:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.402+0000 7f6cd5a00640 1 -- 172.21.15.84:0/2748282708 wait complete. 2024-09-21T07:50:35.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T07:50:35.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 -- 172.21.15.84:0/3057680167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c10bf40 msgr2=0x7f162c112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 --2- 172.21.15.84:0/3057680167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c10bf40 0x7f162c112770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1624009ca0 tx=0x7f162402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 -- 172.21.15.84:0/3057680167 shutdown_connections 2024-09-21T07:50:35.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 --2- 172.21.15.84:0/3057680167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c10bf40 0x7f162c112770 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 --2- 172.21.15.84:0/3057680167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c10b5f0 0x7f162c10ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 --2- 172.21.15.84:0/3057680167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c105cc0 0x7f162c1060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 -- 172.21.15.84:0/3057680167 >> 172.21.15.84:0/3057680167 conn(0x7f162c1016c0 msgr2=0x7f162c103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:35.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 -- 172.21.15.84:0/3057680167 shutdown_connections 2024-09-21T07:50:35.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.649+0000 7f1632a00640 1 -- 172.21.15.84:0/3057680167 wait complete. 2024-09-21T07:50:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.650+0000 7f1632a00640 1 Processor -- start 2024-09-21T07:50:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.650+0000 7f1632a00640 1 -- start start 2024-09-21T07:50:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1632a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c105cc0 0x7f162c19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1632a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c10b5f0 0x7f162c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1632a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c10bf40 0x7f162c1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1632a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f162c115c00 con 0x7f162c105cc0 2024-09-21T07:50:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1632a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f162c115a80 con 0x7f162c10b5f0 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1632a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f162c115d80 con 0x7f162c10bf40 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c105cc0 0x7f162c19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c105cc0 0x7f162c19c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58002/0 (socket says 172.21.15.84:58002) 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 -- 172.21.15.84:0/3625240472 learned_addr learned my addr 172.21.15.84:0/3625240472 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1630a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c10bf40 0x7f162c1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1623400640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c10b5f0 0x7f162c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 -- 172.21.15.84:0/3625240472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c10bf40 msgr2=0x7f162c1a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c10bf40 0x7f162c1a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 -- 172.21.15.84:0/3625240472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c10b5f0 msgr2=0x7f162c19cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c10b5f0 0x7f162c19cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f162be00640 1 -- 172.21.15.84:0/3625240472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c1a2490 con 0x7f162c105cc0 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.651+0000 7f1630a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c10bf40 0x7f162c1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.652+0000 7f162be00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c105cc0 0x7f162c19c560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f161c00ea60 tx=0x7f161c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.652+0000 7f1629600640 1 -- 172.21.15.84:0/3625240472 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c00cde0 con 0x7f162c105cc0 2024-09-21T07:50:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.652+0000 7f1629600640 1 -- 172.21.15.84:0/3625240472 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f161c0035f0 con 0x7f162c105cc0 2024-09-21T07:50:35.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.652+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162c1a2780 con 0x7f162c105cc0 2024-09-21T07:50:35.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.652+0000 7f1629600640 1 -- 172.21.15.84:0/3625240472 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c010690 con 0x7f162c105cc0 2024-09-21T07:50:35.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.652+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f162c1a8f10 con 0x7f162c105cc0 2024-09-21T07:50:35.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.653+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f162c1060d0 con 0x7f162c105cc0 2024-09-21T07:50:35.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.655+0000 7f1629600640 1 -- 172.21.15.84:0/3625240472 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f161c0037a0 con 0x7f162c105cc0 2024-09-21T07:50:35.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.657+0000 7f1629600640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65e0 0x7f16100b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:35.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.657+0000 7f1629600640 1 -- 172.21.15.84:0/3625240472 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f161c0e7fb0 con 0x7f162c105cc0 2024-09-21T07:50:35.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.657+0000 7f1623400640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65e0 0x7f16100b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:35.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.658+0000 7f1623400640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65e0 0x7f16100b8af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f162c104f10 tx=0x7f1614005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:35.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.659+0000 7f1629600640 1 -- 172.21.15.84:0/3625240472 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f161c0ae3b0 con 0x7f162c105cc0 2024-09-21T07:50:35.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/924373958' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/888065383' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2748282708' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/924373958' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/888065383' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2748282708' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.845+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f162c02e640 con 0x7f162c105cc0 2024-09-21T07:50:35.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.845+0000 7f1629600640 1 -- 172.21.15.84:0/3625240472 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) ==== 103+0+11 (secure 0 0 0) 0x7f161c0b2790 con 0x7f162c105cc0 2024-09-21T07:50:35.847 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65e0 msgr2=0x7f16100b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65e0 0x7f16100b8af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f162c104f10 tx=0x7f1614005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c105cc0 msgr2=0x7f162c19c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c105cc0 0x7f162c19c560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f161c00ea60 tx=0x7f161c00ef20 comp rx=0 tx=0).stop 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 shutdown_connections 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f16100b65e0 0x7f16100b8af0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c10bf40 0x7f162c1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f162c10b5f0 0x7f162c19cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 --2- 172.21.15.84:0/3625240472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c105cc0 0x7f162c19c560 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:35.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 >> 172.21.15.84:0/3625240472 conn(0x7f162c1016c0 msgr2=0x7f162c10aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:35.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 shutdown_connections 2024-09-21T07:50:35.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:35.848+0000 7f1632a00640 1 -- 172.21.15.84:0/3625240472 wait complete. 2024-09-21T07:50:35.871 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T07:50:35.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:50:35.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/924373958' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/888065383' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:50:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2748282708' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:50:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:36.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:36 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3625240472' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:50:36.645 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:36 smithi084 ceph-mon[30411]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T07:50:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:36 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3625240472' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:50:36.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:36 smithi162 ceph-mon[34833]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T07:50:36.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:36 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3625240472' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T07:50:36.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:36 smithi191 ceph-mon[34667]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T07:50:36.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 -- 172.21.15.84:0/62944856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c110440 msgr2=0x7fe39c116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:36.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 --2- 172.21.15.84:0/62944856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c110440 0x7fe39c116c70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe394009ca0 tx=0x7fe39402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:36.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 -- 172.21.15.84:0/62944856 shutdown_connections 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 --2- 172.21.15.84:0/62944856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c110440 0x7fe39c116c70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 --2- 172.21.15.84:0/62944856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe39c10faf0 0x7fe39c10ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 --2- 172.21.15.84:0/62944856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c10a1b0 0x7fe39c10a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 -- 172.21.15.84:0/62944856 >> 172.21.15.84:0/62944856 conn(0x7fe39c0780e0 msgr2=0x7fe39c1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 -- 172.21.15.84:0/62944856 shutdown_connections 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.909+0000 7fe3a1200640 1 -- 172.21.15.84:0/62944856 wait complete. 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.910+0000 7fe3a1200640 1 Processor -- start 2024-09-21T07:50:36.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe3a1200640 1 -- start start 2024-09-21T07:50:36.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe3a1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c10a1b0 0x7fe39c1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:36.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe3a1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c10faf0 0x7fe39c1a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:36.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe3a1200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe39c110440 0x7fe39c1a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:36.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe3a1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c11a110 con 0x7fe39c10a1b0 2024-09-21T07:50:36.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe3a1200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c119f90 con 0x7fe39c10faf0 2024-09-21T07:50:36.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe3a1200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c11a290 con 0x7fe39c110440 2024-09-21T07:50:36.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.911+0000 7fe399e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c10a1b0 0x7fe39c1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:36.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c10a1b0 0x7fe39c1a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58032/0 (socket says 172.21.15.84:58032) 2024-09-21T07:50:36.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe39a800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe39c110440 0x7fe39c1a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:36.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 -- 172.21.15.84:0/808722198 learned_addr learned my addr 172.21.15.84:0/808722198 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:36.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe391400640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c10faf0 0x7fe39c1a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 -- 172.21.15.84:0/808722198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe39c110440 msgr2=0x7fe39c1a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe39c110440 0x7fe39c1a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 -- 172.21.15.84:0/808722198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c10faf0 msgr2=0x7fe39c1a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c10faf0 0x7fe39c1a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 -- 172.21.15.84:0/808722198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39c1a69f0 con 0x7fe39c10a1b0 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.912+0000 7fe399e00640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c10a1b0 0x7fe39c1a0a80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d950 tx=0x7fe38c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.913+0000 7fe393400640 1 -- 172.21.15.84:0/808722198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c017070 con 0x7fe39c10a1b0 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.913+0000 7fe393400640 1 -- 172.21.15.84:0/808722198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe38c009c30 con 0x7fe39c10a1b0 2024-09-21T07:50:36.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.913+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39c1a6ce0 con 0x7fe39c10a1b0 2024-09-21T07:50:36.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.913+0000 7fe393400640 1 -- 172.21.15.84:0/808722198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00f620 con 0x7fe39c10a1b0 2024-09-21T07:50:36.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.913+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39c1ad440 con 0x7fe39c10a1b0 2024-09-21T07:50:36.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.914+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39c10a5c0 con 0x7fe39c10a1b0 2024-09-21T07:50:36.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.916+0000 7fe393400640 1 -- 172.21.15.84:0/808722198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fe38c005030 con 0x7fe39c10a1b0 2024-09-21T07:50:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.919+0000 7fe393400640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3800b65e0 0x7fe3800b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.919+0000 7fe393400640 1 -- 172.21.15.84:0/808722198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe38c0e72c0 con 0x7fe39c10a1b0 2024-09-21T07:50:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.919+0000 7fe391400640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3800b65e0 0x7fe3800b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.920+0000 7fe391400640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3800b65e0 0x7fe3800b8af0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06b040 tx=0x7fe384005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:36.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:36.921+0000 7fe393400640 1 -- 172.21.15.84:0/808722198 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe38c009de0 con 0x7fe39c10a1b0 2024-09-21T07:50:37.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.148+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe39c1a1bb0 con 0x7fe39c10a1b0 2024-09-21T07:50:37.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.148+0000 7fe393400640 1 -- 172.21.15.84:0/808722198 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fe38c0b1b20 con 0x7fe39c10a1b0 2024-09-21T07:50:37.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:37.151 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:50:37.151 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:50:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3800b65e0 msgr2=0x7fe3800b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3800b65e0 0x7fe3800b8af0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06b040 tx=0x7fe384005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c10a1b0 msgr2=0x7fe39c1a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c10a1b0 0x7fe39c1a0a80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d950 tx=0x7fe38c00de10 comp rx=0 tx=0).stop 2024-09-21T07:50:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 shutdown_connections 2024-09-21T07:50:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3800b65e0 0x7fe3800b8af0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe39c110440 0x7fe39c1a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:37.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c10faf0 0x7fe39c1a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:37.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 --2- 172.21.15.84:0/808722198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39c10a1b0 0x7fe39c1a0a80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:37.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 >> 172.21.15.84:0/808722198 conn(0x7fe39c0780e0 msgr2=0x7fe39c078760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:37.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 shutdown_connections 2024-09-21T07:50:37.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:37.151+0000 7fe3a1200640 1 -- 172.21.15.84:0/808722198 wait complete. 2024-09-21T07:50:37.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:37 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/808722198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:37 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/808722198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:37.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:37 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/808722198' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:38.024 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T07:50:38.024 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T07:50:38.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 -- 172.21.15.84:0/3259004487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c105cd0 msgr2=0x7fe13c1060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 --2- 172.21.15.84:0/3259004487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c105cd0 0x7fe13c1060e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009900 tx=0x7fe12c02a410 comp rx=0 tx=0).stop 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 -- 172.21.15.84:0/3259004487 shutdown_connections 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 --2- 172.21.15.84:0/3259004487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe13c10bf50 0x7fe13c112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 --2- 172.21.15.84:0/3259004487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe13c10b600 0x7fe13c10ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 --2- 172.21.15.84:0/3259004487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c105cd0 0x7fe13c1060e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 -- 172.21.15.84:0/3259004487 >> 172.21.15.84:0/3259004487 conn(0x7fe13c1016f0 msgr2=0x7fe13c103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 -- 172.21.15.84:0/3259004487 shutdown_connections 2024-09-21T07:50:38.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.243+0000 7fe141000640 1 -- 172.21.15.84:0/3259004487 wait complete. 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 Processor -- start 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 -- start start 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe13c105cd0 0x7fe13c19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c10b600 0x7fe13c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe13c10bf50 0x7fe13c1a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c115c10 con 0x7fe13c10b600 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c115a90 con 0x7fe13c105cd0 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.244+0000 7fe141000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c115d90 con 0x7fe13c10bf50 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c10b600 0x7fe13c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe13a800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe13c10bf50 0x7fe13c1a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c10b600 0x7fe13c19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50792/0 (socket says 172.21.15.84:50792) 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe139e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe13c105cd0 0x7fe13c19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 -- 172.21.15.84:0/4130649008 learned_addr learned my addr 172.21.15.84:0/4130649008 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 -- 172.21.15.84:0/4130649008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe13c10bf50 msgr2=0x7fe13c1a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe13c10bf50 0x7fe13c1a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 -- 172.21.15.84:0/4130649008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe13c105cd0 msgr2=0x7fe13c19c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe13c105cd0 0x7fe13c19c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 -- 172.21.15.84:0/4130649008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c1a25c0 con 0x7fe13c10b600 2024-09-21T07:50:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe131400640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c10b600 0x7fe13c19cc30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe12400d950 tx=0x7fe12400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.245+0000 7fe133400640 1 -- 172.21.15.84:0/4130649008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124017070 con 0x7fe13c10b600 2024-09-21T07:50:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.246+0000 7fe133400640 1 -- 172.21.15.84:0/4130649008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe124009c30 con 0x7fe13c10b600 2024-09-21T07:50:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.246+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c1a28b0 con 0x7fe13c10b600 2024-09-21T07:50:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.246+0000 7fe133400640 1 -- 172.21.15.84:0/4130649008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1240047a0 con 0x7fe13c10b600 2024-09-21T07:50:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.246+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c1a9040 con 0x7fe13c10b600 2024-09-21T07:50:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.247+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c106f40 con 0x7fe13c10b600 2024-09-21T07:50:38.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.249+0000 7fe133400640 1 -- 172.21.15.84:0/4130649008 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fe124004020 con 0x7fe13c10b600 2024-09-21T07:50:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.252+0000 7fe133400640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1200b6560 0x7fe1200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.252+0000 7fe133400640 1 -- 172.21.15.84:0/4130649008 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe1240e7810 con 0x7fe13c10b600 2024-09-21T07:50:38.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.252+0000 7fe139e00640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1200b6560 0x7fe1200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.253+0000 7fe139e00640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1200b6560 0x7fe1200b8a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe12c031440 tx=0x7fe12c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.254+0000 7fe133400640 1 -- 172.21.15.84:0/4130649008 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe124020020 con 0x7fe13c10b600 2024-09-21T07:50:38.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.443+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe13c063800 con 0x7fe1200b6560 2024-09-21T07:50:38.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.449+0000 7fe133400640 1 -- 172.21.15.84:0/4130649008 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340535 (secure 0 0 0) 0x7fe13c063800 con 0x7fe1200b6560 2024-09-21T07:50:38.455 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:38.457 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:50:38.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1200b6560 msgr2=0x7fe1200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1200b6560 0x7fe1200b8a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe12c031440 tx=0x7fe12c009560 comp rx=0 tx=0).stop 2024-09-21T07:50:38.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c10b600 msgr2=0x7fe13c19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c10b600 0x7fe13c19cc30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe12400d950 tx=0x7fe12400de10 comp rx=0 tx=0).stop 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 shutdown_connections 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1200b6560 0x7fe1200b8a70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe13c10bf50 0x7fe13c1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe13c10b600 0x7fe13c19cc30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 --2- 172.21.15.84:0/4130649008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe13c105cd0 0x7fe13c19c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 >> 172.21.15.84:0/4130649008 conn(0x7fe13c1016f0 msgr2=0x7fe13c103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.454+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 shutdown_connections 2024-09-21T07:50:38.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.455+0000 7fe141000640 1 -- 172.21.15.84:0/4130649008 wait complete. 2024-09-21T07:50:38.480 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-21T07:50:38.020919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671199,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1323,"num_read_kb":779,"num_write":390,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396744,"kb_used_data":14216,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545080,"statfs":{"total":1151940427776,"available":1151534161920,"internally_reserved":0,"allocated":14557184,"data_stored":8291063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":391492921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6065,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":58,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003550"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:32.108578+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:50:32.108578+0000","last_peered":"2024-09-21T07:50:32.108578+0000","last_clean":"2024-09-21T07:50:32.108578+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:50:32.108578+0000","last_undegraded":"2024-09-21T07:50:32.108578+0000","last_fullsized":"2024-09-21T07:50:32.108578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210401+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:50:00.210401+0000","last_peered":"2024-09-21T07:50:00.210401+0000","last_clean":"2024-09-21T07:50:00.210401+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:50:00.210401+0000","last_undegraded":"2024-09-21T07:50:00.210401+0000","last_fullsized":"2024-09-21T07:50:00.210401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247890+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247890+0000","last_peered":"2024-09-21T07:49:31.247890+0000","last_clean":"2024-09-21T07:49:31.247890+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247890+0000","last_undegraded":"2024-09-21T07:49:31.247890+0000","last_fullsized":"2024-09-21T07:49:31.247890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279185+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279185+0000","last_peered":"2024-09-21T07:49:31.279185+0000","last_clean":"2024-09-21T07:49:31.279185+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279185+0000","last_undegraded":"2024-09-21T07:49:31.279185+0000","last_fullsized":"2024-09-21T07:49:31.279185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230523+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:50:00.230523+0000","last_peered":"2024-09-21T07:50:00.230523+0000","last_clean":"2024-09-21T07:50:00.230523+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:50:00.230523+0000","last_undegraded":"2024-09-21T07:50:00.230523+0000","last_fullsized":"2024-09-21T07:50:00.230523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.280231+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.280231+0000","last_peered":"2024-09-21T07:49:31.280231+0000","last_clean":"2024-09-21T07:49:31.280231+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.280231+0000","last_undegraded":"2024-09-21T07:49:31.280231+0000","last_fullsized":"2024-09-21T07:49:31.280231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162622+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162622+0000","last_peered":"2024-09-21T07:49:31.162622+0000","last_clean":"2024-09-21T07:49:31.162622+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162622+0000","last_undegraded":"2024-09-21T07:49:31.162622+0000","last_fullsized":"2024-09-21T07:49:31.162622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230976+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:50:00.230976+0000","last_peered":"2024-09-21T07:50:00.230976+0000","last_clean":"2024-09-21T07:50:00.230976+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:50:00.230976+0000","last_undegraded":"2024-09-21T07:50:00.230976+0000","last_fullsized":"2024-09-21T07:50:00.230976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162964+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162964+0000","last_peered":"2024-09-21T07:49:31.162964+0000","last_clean":"2024-09-21T07:49:31.162964+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162964+0000","last_undegraded":"2024-09-21T07:49:31.162964+0000","last_fullsized":"2024-09-21T07:49:31.162964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235866+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:50:00.235866+0000","last_peered":"2024-09-21T07:50:00.235866+0000","last_clean":"2024-09-21T07:50:00.235866+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:50:00.235866+0000","last_undegraded":"2024-09-21T07:50:00.235866+0000","last_fullsized":"2024-09-21T07:50:00.235866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162229+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162229+0000","last_peered":"2024-09-21T07:49:31.162229+0000","last_clean":"2024-09-21T07:49:31.162229+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162229+0000","last_undegraded":"2024-09-21T07:49:31.162229+0000","last_fullsized":"2024-09-21T07:49:31.162229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236270+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:50:00.236270+0000","last_peered":"2024-09-21T07:50:00.236270+0000","last_clean":"2024-09-21T07:50:00.236270+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:50:00.236270+0000","last_undegraded":"2024-09-21T07:50:00.236270+0000","last_fullsized":"2024-09-21T07:50:00.236270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162277+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162277+0000","last_peered":"2024-09-21T07:49:31.162277+0000","last_clean":"2024-09-21T07:49:31.162277+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162277+0000","last_undegraded":"2024-09-21T07:49:31.162277+0000","last_fullsized":"2024-09-21T07:49:31.162277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163029+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.163029+0000","last_peered":"2024-09-21T07:49:31.163029+0000","last_clean":"2024-09-21T07:49:31.163029+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.163029+0000","last_undegraded":"2024-09-21T07:49:31.163029+0000","last_fullsized":"2024-09-21T07:49:31.163029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225576+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:50:00.225576+0000","last_peered":"2024-09-21T07:50:00.225576+0000","last_clean":"2024-09-21T07:50:00.225576+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:50:00.225576+0000","last_undegraded":"2024-09-21T07:50:00.225576+0000","last_fullsized":"2024-09-21T07:50:00.225576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247829+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247829+0000","last_peered":"2024-09-21T07:49:31.247829+0000","last_clean":"2024-09-21T07:49:31.247829+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247829+0000","last_undegraded":"2024-09-21T07:49:31.247829+0000","last_fullsized":"2024-09-21T07:49:31.247829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163050+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.163050+0000","last_peered":"2024-09-21T07:49:31.163050+0000","last_clean":"2024-09-21T07:49:31.163050+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.163050+0000","last_undegraded":"2024-09-21T07:49:31.163050+0000","last_fullsized":"2024-09-21T07:49:31.163050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228962+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:50:00.228962+0000","last_peered":"2024-09-21T07:50:00.228962+0000","last_clean":"2024-09-21T07:50:00.228962+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:50:00.228962+0000","last_undegraded":"2024-09-21T07:50:00.228962+0000","last_fullsized":"2024-09-21T07:50:00.228962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278440+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278440+0000","last_peered":"2024-09-21T07:49:31.278440+0000","last_clean":"2024-09-21T07:49:31.278440+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278440+0000","last_undegraded":"2024-09-21T07:49:31.278440+0000","last_fullsized":"2024-09-21T07:49:31.278440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160566+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160566+0000","last_peered":"2024-09-21T07:49:31.160566+0000","last_clean":"2024-09-21T07:49:31.160566+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160566+0000","last_undegraded":"2024-09-21T07:49:31.160566+0000","last_fullsized":"2024-09-21T07:49:31.160566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.182905+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:50:00.182905+0000","last_peered":"2024-09-21T07:50:00.182905+0000","last_clean":"2024-09-21T07:50:00.182905+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:50:00.182905+0000","last_undegraded":"2024-09-21T07:50:00.182905+0000","last_fullsized":"2024-09-21T07:50:00.182905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161028+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.161028+0000","last_peered":"2024-09-21T07:49:31.161028+0000","last_clean":"2024-09-21T07:49:31.161028+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.161028+0000","last_undegraded":"2024-09-21T07:49:31.161028+0000","last_fullsized":"2024-09-21T07:49:31.161028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163163+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163163+0000","last_peered":"2024-09-21T07:49:31.163163+0000","last_clean":"2024-09-21T07:49:31.163163+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163163+0000","last_undegraded":"2024-09-21T07:49:31.163163+0000","last_fullsized":"2024-09-21T07:49:31.163163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228483+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:50:00.228483+0000","last_peered":"2024-09-21T07:50:00.228483+0000","last_clean":"2024-09-21T07:50:00.228483+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:50:00.228483+0000","last_undegraded":"2024-09-21T07:50:00.228483+0000","last_fullsized":"2024-09-21T07:50:00.228483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163371+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163371+0000","last_peered":"2024-09-21T07:49:31.163371+0000","last_clean":"2024-09-21T07:49:31.163371+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163371+0000","last_undegraded":"2024-09-21T07:49:31.163371+0000","last_fullsized":"2024-09-21T07:49:31.163371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247637+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247637+0000","last_peered":"2024-09-21T07:49:31.247637+0000","last_clean":"2024-09-21T07:49:31.247637+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247637+0000","last_undegraded":"2024-09-21T07:49:31.247637+0000","last_fullsized":"2024-09-21T07:49:31.247637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233969+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:50:00.233969+0000","last_peered":"2024-09-21T07:50:00.233969+0000","last_clean":"2024-09-21T07:50:00.233969+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:50:00.233969+0000","last_undegraded":"2024-09-21T07:50:00.233969+0000","last_fullsized":"2024-09-21T07:50:00.233969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'18","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.730803+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:50:00.730803+0000","last_peered":"2024-09-21T07:50:00.730803+0000","last_clean":"2024-09-21T07:50:00.730803+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:50:00.730803+0000","last_undegraded":"2024-09-21T07:50:00.730803+0000","last_fullsized":"2024-09-21T07:50:00.730803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278131+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278131+0000","last_peered":"2024-09-21T07:49:31.278131+0000","last_clean":"2024-09-21T07:49:31.278131+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278131+0000","last_undegraded":"2024-09-21T07:49:31.278131+0000","last_fullsized":"2024-09-21T07:49:31.278131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214205+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:50:00.214205+0000","last_peered":"2024-09-21T07:50:00.214205+0000","last_clean":"2024-09-21T07:50:00.214205+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:50:00.214205+0000","last_undegraded":"2024-09-21T07:50:00.214205+0000","last_fullsized":"2024-09-21T07:50:00.214205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162970+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162970+0000","last_peered":"2024-09-21T07:49:31.162970+0000","last_clean":"2024-09-21T07:49:31.162970+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162970+0000","last_undegraded":"2024-09-21T07:49:31.162970+0000","last_fullsized":"2024-09-21T07:49:31.162970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158456+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158456+0000","last_peered":"2024-09-21T07:49:31.158456+0000","last_clean":"2024-09-21T07:49:31.158456+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158456+0000","last_undegraded":"2024-09-21T07:49:31.158456+0000","last_fullsized":"2024-09-21T07:49:31.158456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212815+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:50:00.212815+0000","last_peered":"2024-09-21T07:50:00.212815+0000","last_clean":"2024-09-21T07:50:00.212815+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:50:00.212815+0000","last_undegraded":"2024-09-21T07:50:00.212815+0000","last_fullsized":"2024-09-21T07:50:00.212815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160485+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160485+0000","last_peered":"2024-09-21T07:49:31.160485+0000","last_clean":"2024-09-21T07:49:31.160485+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160485+0000","last_undegraded":"2024-09-21T07:49:31.160485+0000","last_fullsized":"2024-09-21T07:49:31.160485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162107+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162107+0000","last_peered":"2024-09-21T07:49:31.162107+0000","last_clean":"2024-09-21T07:49:31.162107+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162107+0000","last_undegraded":"2024-09-21T07:49:31.162107+0000","last_fullsized":"2024-09-21T07:49:31.162107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226173+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:50:00.226173+0000","last_peered":"2024-09-21T07:50:00.226173+0000","last_clean":"2024-09-21T07:50:00.226173+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:50:00.226173+0000","last_undegraded":"2024-09-21T07:50:00.226173+0000","last_fullsized":"2024-09-21T07:50:00.226173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:33.346545+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:50:33.346545+0000","last_peered":"2024-09-21T07:50:33.346545+0000","last_clean":"2024-09-21T07:50:33.346545+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:50:33.346545+0000","last_undegraded":"2024-09-21T07:50:33.346545+0000","last_fullsized":"2024-09-21T07:50:33.346545+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":899,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246008+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.246008+0000","last_peered":"2024-09-21T07:49:31.246008+0000","last_clean":"2024-09-21T07:49:31.246008+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.246008+0000","last_undegraded":"2024-09-21T07:49:31.246008+0000","last_fullsized":"2024-09-21T07:49:31.246008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234222+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:50:00.234222+0000","last_peered":"2024-09-21T07:50:00.234222+0000","last_clean":"2024-09-21T07:50:00.234222+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:50:00.234222+0000","last_undegraded":"2024-09-21T07:50:00.234222+0000","last_fullsized":"2024-09-21T07:50:00.234222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:33.345735+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:50:33.345735+0000","last_peered":"2024-09-21T07:50:33.345735+0000","last_clean":"2024-09-21T07:50:33.345735+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:50:33.345735+0000","last_undegraded":"2024-09-21T07:50:33.345735+0000","last_fullsized":"2024-09-21T07:50:33.345735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246470+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246470+0000","last_peered":"2024-09-21T07:49:31.246470+0000","last_clean":"2024-09-21T07:49:31.246470+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246470+0000","last_undegraded":"2024-09-21T07:49:31.246470+0000","last_fullsized":"2024-09-21T07:49:31.246470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215266+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:50:00.215266+0000","last_peered":"2024-09-21T07:50:00.215266+0000","last_clean":"2024-09-21T07:50:00.215266+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:50:00.215266+0000","last_undegraded":"2024-09-21T07:50:00.215266+0000","last_fullsized":"2024-09-21T07:50:00.215266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243292+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243292+0000","last_peered":"2024-09-21T07:49:31.243292+0000","last_clean":"2024-09-21T07:49:31.243292+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243292+0000","last_undegraded":"2024-09-21T07:49:31.243292+0000","last_fullsized":"2024-09-21T07:49:31.243292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247818+0000","last_change":"2024-09-21T07:49:31.247663+0000","last_active":"2024-09-21T07:49:31.247818+0000","last_peered":"2024-09-21T07:49:31.247818+0000","last_clean":"2024-09-21T07:49:31.247818+0000","last_became_active":"2024-09-21T07:49:31.247173+0000","last_became_peered":"2024-09-21T07:49:31.247173+0000","last_unstale":"2024-09-21T07:49:31.247818+0000","last_undegraded":"2024-09-21T07:49:31.247818+0000","last_fullsized":"2024-09-21T07:49:31.247818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:29.114632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229905+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:50:00.229905+0000","last_peered":"2024-09-21T07:50:00.229905+0000","last_clean":"2024-09-21T07:50:00.229905+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:50:00.229905+0000","last_undegraded":"2024-09-21T07:50:00.229905+0000","last_fullsized":"2024-09-21T07:50:00.229905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163025+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.163025+0000","last_peered":"2024-09-21T07:49:31.163025+0000","last_clean":"2024-09-21T07:49:31.163025+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.163025+0000","last_undegraded":"2024-09-21T07:49:31.163025+0000","last_fullsized":"2024-09-21T07:49:31.163025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243589+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243589+0000","last_peered":"2024-09-21T07:49:31.243589+0000","last_clean":"2024-09-21T07:49:31.243589+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243589+0000","last_undegraded":"2024-09-21T07:49:31.243589+0000","last_fullsized":"2024-09-21T07:49:31.243589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236108+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:50:00.236108+0000","last_peered":"2024-09-21T07:50:00.236108+0000","last_clean":"2024-09-21T07:50:00.236108+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:50:00.236108+0000","last_undegraded":"2024-09-21T07:50:00.236108+0000","last_fullsized":"2024-09-21T07:50:00.236108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'7","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:35.349470+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:50:35.349470+0000","last_peered":"2024-09-21T07:50:35.349470+0000","last_clean":"2024-09-21T07:50:35.349470+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:50:35.349470+0000","last_undegraded":"2024-09-21T07:50:35.349470+0000","last_fullsized":"2024-09-21T07:50:35.349470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161230+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161230+0000","last_peered":"2024-09-21T07:49:31.161230+0000","last_clean":"2024-09-21T07:49:31.161230+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161230+0000","last_undegraded":"2024-09-21T07:49:31.161230+0000","last_fullsized":"2024-09-21T07:49:31.161230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233772+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:50:00.233772+0000","last_peered":"2024-09-21T07:50:00.233772+0000","last_clean":"2024-09-21T07:50:00.233772+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:50:00.233772+0000","last_undegraded":"2024-09-21T07:50:00.233772+0000","last_fullsized":"2024-09-21T07:50:00.233772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248809+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:49:31.248809+0000","last_peered":"2024-09-21T07:49:31.248809+0000","last_clean":"2024-09-21T07:49:31.248809+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:49:31.248809+0000","last_undegraded":"2024-09-21T07:49:31.248809+0000","last_fullsized":"2024-09-21T07:49:31.248809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278758+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278758+0000","last_peered":"2024-09-21T07:49:31.278758+0000","last_clean":"2024-09-21T07:49:31.278758+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278758+0000","last_undegraded":"2024-09-21T07:49:31.278758+0000","last_fullsized":"2024-09-21T07:49:31.278758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231353+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:50:00.231353+0000","last_peered":"2024-09-21T07:50:00.231353+0000","last_clean":"2024-09-21T07:50:00.231353+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:50:00.231353+0000","last_undegraded":"2024-09-21T07:50:00.231353+0000","last_fullsized":"2024-09-21T07:50:00.231353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246326+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246326+0000","last_peered":"2024-09-21T07:49:31.246326+0000","last_clean":"2024-09-21T07:49:31.246326+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246326+0000","last_undegraded":"2024-09-21T07:49:31.246326+0000","last_fullsized":"2024-09-21T07:49:31.246326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246901+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246901+0000","last_peered":"2024-09-21T07:49:31.246901+0000","last_clean":"2024-09-21T07:49:31.246901+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246901+0000","last_undegraded":"2024-09-21T07:49:31.246901+0000","last_fullsized":"2024-09-21T07:49:31.246901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228801+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:50:00.228801+0000","last_peered":"2024-09-21T07:50:00.228801+0000","last_clean":"2024-09-21T07:50:00.228801+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:50:00.228801+0000","last_undegraded":"2024-09-21T07:50:00.228801+0000","last_fullsized":"2024-09-21T07:50:00.228801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162830+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162830+0000","last_peered":"2024-09-21T07:49:31.162830+0000","last_clean":"2024-09-21T07:49:31.162830+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162830+0000","last_undegraded":"2024-09-21T07:49:31.162830+0000","last_fullsized":"2024-09-21T07:49:31.162830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246921+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246921+0000","last_peered":"2024-09-21T07:49:31.246921+0000","last_clean":"2024-09-21T07:49:31.246921+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246921+0000","last_undegraded":"2024-09-21T07:49:31.246921+0000","last_fullsized":"2024-09-21T07:49:31.246921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235805+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:50:00.235805+0000","last_peered":"2024-09-21T07:50:00.235805+0000","last_clean":"2024-09-21T07:50:00.235805+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:50:00.235805+0000","last_undegraded":"2024-09-21T07:50:00.235805+0000","last_fullsized":"2024-09-21T07:50:00.235805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162058+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.162058+0000","last_peered":"2024-09-21T07:49:31.162058+0000","last_clean":"2024-09-21T07:49:31.162058+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.162058+0000","last_undegraded":"2024-09-21T07:49:31.162058+0000","last_fullsized":"2024-09-21T07:49:31.162058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246203+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246203+0000","last_peered":"2024-09-21T07:49:31.246203+0000","last_clean":"2024-09-21T07:49:31.246203+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246203+0000","last_undegraded":"2024-09-21T07:49:31.246203+0000","last_fullsized":"2024-09-21T07:49:31.246203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225861+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:50:00.225861+0000","last_peered":"2024-09-21T07:50:00.225861+0000","last_clean":"2024-09-21T07:50:00.225861+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:50:00.225861+0000","last_undegraded":"2024-09-21T07:50:00.225861+0000","last_fullsized":"2024-09-21T07:50:00.225861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:32.344719+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:50:32.344719+0000","last_peered":"2024-09-21T07:50:32.344719+0000","last_clean":"2024-09-21T07:50:32.344719+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:50:32.344719+0000","last_undegraded":"2024-09-21T07:50:32.344719+0000","last_fullsized":"2024-09-21T07:50:32.344719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226537+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:50:00.226537+0000","last_peered":"2024-09-21T07:50:00.226537+0000","last_clean":"2024-09-21T07:50:00.226537+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:50:00.226537+0000","last_undegraded":"2024-09-21T07:50:00.226537+0000","last_fullsized":"2024-09-21T07:50:00.226537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247713+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247713+0000","last_peered":"2024-09-21T07:49:31.247713+0000","last_clean":"2024-09-21T07:49:31.247713+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247713+0000","last_undegraded":"2024-09-21T07:49:31.247713+0000","last_fullsized":"2024-09-21T07:49:31.247713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158454+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158454+0000","last_peered":"2024-09-21T07:49:31.158454+0000","last_clean":"2024-09-21T07:49:31.158454+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158454+0000","last_undegraded":"2024-09-21T07:49:31.158454+0000","last_fullsized":"2024-09-21T07:49:31.158454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.213866+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:50:00.213866+0000","last_peered":"2024-09-21T07:50:00.213866+0000","last_clean":"2024-09-21T07:50:00.213866+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:50:00.213866+0000","last_undegraded":"2024-09-21T07:50:00.213866+0000","last_fullsized":"2024-09-21T07:50:00.213866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158337+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158337+0000","last_peered":"2024-09-21T07:49:31.158337+0000","last_clean":"2024-09-21T07:49:31.158337+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158337+0000","last_undegraded":"2024-09-21T07:49:31.158337+0000","last_fullsized":"2024-09-21T07:49:31.158337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248339+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248339+0000","last_peered":"2024-09-21T07:49:31.248339+0000","last_clean":"2024-09-21T07:49:31.248339+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248339+0000","last_undegraded":"2024-09-21T07:49:31.248339+0000","last_fullsized":"2024-09-21T07:49:31.248339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.224994+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:50:00.224994+0000","last_peered":"2024-09-21T07:50:00.224994+0000","last_clean":"2024-09-21T07:50:00.224994+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:50:00.224994+0000","last_undegraded":"2024-09-21T07:50:00.224994+0000","last_fullsized":"2024-09-21T07:50:00.224994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'40","reported_seq":336,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:34.348021+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:50:34.348021+0000","last_peered":"2024-09-21T07:50:34.348021+0000","last_clean":"2024-09-21T07:50:34.348021+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:50:34.348021+0000","last_undegraded":"2024-09-21T07:50:34.348021+0000","last_fullsized":"2024-09-21T07:50:34.348021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":197,"num_write":42,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159921+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159921+0000","last_peered":"2024-09-21T07:49:31.159921+0000","last_clean":"2024-09-21T07:49:31.159921+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159921+0000","last_undegraded":"2024-09-21T07:49:31.159921+0000","last_fullsized":"2024-09-21T07:49:31.159921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236544+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:50:00.236544+0000","last_peered":"2024-09-21T07:50:00.236544+0000","last_clean":"2024-09-21T07:50:00.236544+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:50:00.236544+0000","last_undegraded":"2024-09-21T07:50:00.236544+0000","last_fullsized":"2024-09-21T07:50:00.236544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248679+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248679+0000","last_peered":"2024-09-21T07:49:31.248679+0000","last_clean":"2024-09-21T07:49:31.248679+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248679+0000","last_undegraded":"2024-09-21T07:49:31.248679+0000","last_fullsized":"2024-09-21T07:49:31.248679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162313+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162313+0000","last_peered":"2024-09-21T07:49:31.162313+0000","last_clean":"2024-09-21T07:49:31.162313+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162313+0000","last_undegraded":"2024-09-21T07:49:31.162313+0000","last_fullsized":"2024-09-21T07:49:31.162313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227866+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:50:00.227866+0000","last_peered":"2024-09-21T07:50:00.227866+0000","last_clean":"2024-09-21T07:50:00.227866+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:50:00.227866+0000","last_undegraded":"2024-09-21T07:50:00.227866+0000","last_fullsized":"2024-09-21T07:50:00.227866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244633+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244633+0000","last_peered":"2024-09-21T07:49:31.244633+0000","last_clean":"2024-09-21T07:49:31.244633+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244633+0000","last_undegraded":"2024-09-21T07:49:31.244633+0000","last_fullsized":"2024-09-21T07:49:31.244633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159785+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159785+0000","last_peered":"2024-09-21T07:49:31.159785+0000","last_clean":"2024-09-21T07:49:31.159785+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159785+0000","last_undegraded":"2024-09-21T07:49:31.159785+0000","last_fullsized":"2024-09-21T07:49:31.159785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231446+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:50:00.231446+0000","last_peered":"2024-09-21T07:50:00.231446+0000","last_clean":"2024-09-21T07:50:00.231446+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:50:00.231446+0000","last_undegraded":"2024-09-21T07:50:00.231446+0000","last_fullsized":"2024-09-21T07:50:00.231446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":292,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:34.347341+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:50:34.347341+0000","last_peered":"2024-09-21T07:50:34.347341+0000","last_clean":"2024-09-21T07:50:34.347341+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:50:34.347341+0000","last_undegraded":"2024-09-21T07:50:34.347341+0000","last_fullsized":"2024-09-21T07:50:34.347341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277894+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277894+0000","last_peered":"2024-09-21T07:49:31.277894+0000","last_clean":"2024-09-21T07:49:31.277894+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277894+0000","last_undegraded":"2024-09-21T07:49:31.277894+0000","last_fullsized":"2024-09-21T07:49:31.277894+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278984+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278984+0000","last_peered":"2024-09-21T07:49:31.278984+0000","last_clean":"2024-09-21T07:49:31.278984+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278984+0000","last_undegraded":"2024-09-21T07:49:31.278984+0000","last_fullsized":"2024-09-21T07:49:31.278984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225224+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:50:00.225224+0000","last_peered":"2024-09-21T07:50:00.225224+0000","last_clean":"2024-09-21T07:50:00.225224+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:50:00.225224+0000","last_undegraded":"2024-09-21T07:50:00.225224+0000","last_fullsized":"2024-09-21T07:50:00.225224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247909+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247909+0000","last_peered":"2024-09-21T07:49:31.247909+0000","last_clean":"2024-09-21T07:49:31.247909+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247909+0000","last_undegraded":"2024-09-21T07:49:31.247909+0000","last_fullsized":"2024-09-21T07:49:31.247909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158882+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158882+0000","last_peered":"2024-09-21T07:49:31.158882+0000","last_clean":"2024-09-21T07:49:31.158882+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158882+0000","last_undegraded":"2024-09-21T07:49:31.158882+0000","last_fullsized":"2024-09-21T07:49:31.158882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226888+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:50:00.226888+0000","last_peered":"2024-09-21T07:50:00.226888+0000","last_clean":"2024-09-21T07:50:00.226888+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:50:00.226888+0000","last_undegraded":"2024-09-21T07:50:00.226888+0000","last_fullsized":"2024-09-21T07:50:00.226888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245823+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245823+0000","last_peered":"2024-09-21T07:49:31.245823+0000","last_clean":"2024-09-21T07:49:31.245823+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245823+0000","last_undegraded":"2024-09-21T07:49:31.245823+0000","last_fullsized":"2024-09-21T07:49:31.245823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243596+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243596+0000","last_peered":"2024-09-21T07:49:31.243596+0000","last_clean":"2024-09-21T07:49:31.243596+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243596+0000","last_undegraded":"2024-09-21T07:49:31.243596+0000","last_fullsized":"2024-09-21T07:49:31.243596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234552+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:50:00.234552+0000","last_peered":"2024-09-21T07:50:00.234552+0000","last_clean":"2024-09-21T07:50:00.234552+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:50:00.234552+0000","last_undegraded":"2024-09-21T07:50:00.234552+0000","last_fullsized":"2024-09-21T07:50:00.234552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248127+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248127+0000","last_peered":"2024-09-21T07:49:31.248127+0000","last_clean":"2024-09-21T07:49:31.248127+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248127+0000","last_undegraded":"2024-09-21T07:49:31.248127+0000","last_fullsized":"2024-09-21T07:49:31.248127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:31.343208+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:50:31.343208+0000","last_peered":"2024-09-21T07:50:31.343208+0000","last_clean":"2024-09-21T07:50:31.343208+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:50:31.343208+0000","last_undegraded":"2024-09-21T07:50:31.343208+0000","last_fullsized":"2024-09-21T07:50:31.343208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212530+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:50:00.212530+0000","last_peered":"2024-09-21T07:50:00.212530+0000","last_clean":"2024-09-21T07:50:00.212530+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:50:00.212530+0000","last_undegraded":"2024-09-21T07:50:00.212530+0000","last_fullsized":"2024-09-21T07:50:00.212530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248474+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248474+0000","last_peered":"2024-09-21T07:49:31.248474+0000","last_clean":"2024-09-21T07:49:31.248474+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248474+0000","last_undegraded":"2024-09-21T07:49:31.248474+0000","last_fullsized":"2024-09-21T07:49:31.248474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229653+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:50:00.229653+0000","last_peered":"2024-09-21T07:50:00.229653+0000","last_clean":"2024-09-21T07:50:00.229653+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:50:00.229653+0000","last_undegraded":"2024-09-21T07:50:00.229653+0000","last_fullsized":"2024-09-21T07:50:00.229653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214497+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:50:00.214497+0000","last_peered":"2024-09-21T07:50:00.214497+0000","last_clean":"2024-09-21T07:50:00.214497+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:50:00.214497+0000","last_undegraded":"2024-09-21T07:50:00.214497+0000","last_fullsized":"2024-09-21T07:50:00.214497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227306+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:50:00.227306+0000","last_peered":"2024-09-21T07:50:00.227306+0000","last_clean":"2024-09-21T07:50:00.227306+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:50:00.227306+0000","last_undegraded":"2024-09-21T07:50:00.227306+0000","last_fullsized":"2024-09-21T07:50:00.227306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227334+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:50:00.227334+0000","last_peered":"2024-09-21T07:50:00.227334+0000","last_clean":"2024-09-21T07:50:00.227334+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:50:00.227334+0000","last_undegraded":"2024-09-21T07:50:00.227334+0000","last_fullsized":"2024-09-21T07:50:00.227334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227942+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:50:00.227942+0000","last_peered":"2024-09-21T07:50:00.227942+0000","last_clean":"2024-09-21T07:50:00.227942+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:50:00.227942+0000","last_undegraded":"2024-09-21T07:50:00.227942+0000","last_fullsized":"2024-09-21T07:50:00.227942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228389+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:50:00.228389+0000","last_peered":"2024-09-21T07:50:00.228389+0000","last_clean":"2024-09-21T07:50:00.228389+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:50:00.228389+0000","last_undegraded":"2024-09-21T07:50:00.228389+0000","last_fullsized":"2024-09-21T07:50:00.228389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223482+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:50:00.223482+0000","last_peered":"2024-09-21T07:50:00.223482+0000","last_clean":"2024-09-21T07:50:00.223482+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:50:00.223482+0000","last_undegraded":"2024-09-21T07:50:00.223482+0000","last_fullsized":"2024-09-21T07:50:00.223482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.202426+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:50:00.202426+0000","last_peered":"2024-09-21T07:50:00.202426+0000","last_clean":"2024-09-21T07:50:00.202426+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:50:00.202426+0000","last_undegraded":"2024-09-21T07:50:00.202426+0000","last_fullsized":"2024-09-21T07:50:00.202426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228634+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:50:00.228634+0000","last_peered":"2024-09-21T07:50:00.228634+0000","last_clean":"2024-09-21T07:50:00.228634+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:50:00.228634+0000","last_undegraded":"2024-09-21T07:50:00.228634+0000","last_fullsized":"2024-09-21T07:50:00.228634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.219031+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:50:00.219031+0000","last_peered":"2024-09-21T07:50:00.219031+0000","last_clean":"2024-09-21T07:50:00.219031+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:50:00.219031+0000","last_undegraded":"2024-09-21T07:50:00.219031+0000","last_fullsized":"2024-09-21T07:50:00.219031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235687+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:50:00.235687+0000","last_peered":"2024-09-21T07:50:00.235687+0000","last_clean":"2024-09-21T07:50:00.235687+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:50:00.235687+0000","last_undegraded":"2024-09-21T07:50:00.235687+0000","last_fullsized":"2024-09-21T07:50:00.235687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228617+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:50:00.228617+0000","last_peered":"2024-09-21T07:50:00.228617+0000","last_clean":"2024-09-21T07:50:00.228617+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:50:00.228617+0000","last_undegraded":"2024-09-21T07:50:00.228617+0000","last_fullsized":"2024-09-21T07:50:00.228617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227531+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:50:00.227531+0000","last_peered":"2024-09-21T07:50:00.227531+0000","last_clean":"2024-09-21T07:50:00.227531+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:50:00.227531+0000","last_undegraded":"2024-09-21T07:50:00.227531+0000","last_fullsized":"2024-09-21T07:50:00.227531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210770+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:50:00.210770+0000","last_peered":"2024-09-21T07:50:00.210770+0000","last_clean":"2024-09-21T07:50:00.210770+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:50:00.210770+0000","last_undegraded":"2024-09-21T07:50:00.210770+0000","last_fullsized":"2024-09-21T07:50:00.210770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229015+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:50:00.229015+0000","last_peered":"2024-09-21T07:50:00.229015+0000","last_clean":"2024-09-21T07:50:00.229015+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:50:00.229015+0000","last_undegraded":"2024-09-21T07:50:00.229015+0000","last_fullsized":"2024-09-21T07:50:00.229015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231891+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:50:00.231891+0000","last_peered":"2024-09-21T07:50:00.231891+0000","last_clean":"2024-09-21T07:50:00.231891+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:50:00.231891+0000","last_undegraded":"2024-09-21T07:50:00.231891+0000","last_fullsized":"2024-09-21T07:50:00.231891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235579+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:50:00.235579+0000","last_peered":"2024-09-21T07:50:00.235579+0000","last_clean":"2024-09-21T07:50:00.235579+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:50:00.235579+0000","last_undegraded":"2024-09-21T07:50:00.235579+0000","last_fullsized":"2024-09-21T07:50:00.235579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227718+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:50:00.227718+0000","last_peered":"2024-09-21T07:50:00.227718+0000","last_clean":"2024-09-21T07:50:00.227718+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:50:00.227718+0000","last_undegraded":"2024-09-21T07:50:00.227718+0000","last_fullsized":"2024-09-21T07:50:00.227718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228484+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:50:00.228484+0000","last_peered":"2024-09-21T07:50:00.228484+0000","last_clean":"2024-09-21T07:50:00.228484+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:50:00.228484+0000","last_undegraded":"2024-09-21T07:50:00.228484+0000","last_fullsized":"2024-09-21T07:50:00.228484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223270+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:50:00.223270+0000","last_peered":"2024-09-21T07:50:00.223270+0000","last_clean":"2024-09-21T07:50:00.223270+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:50:00.223270+0000","last_undegraded":"2024-09-21T07:50:00.223270+0000","last_fullsized":"2024-09-21T07:50:00.223270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229604+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:50:00.229604+0000","last_peered":"2024-09-21T07:50:00.229604+0000","last_clean":"2024-09-21T07:50:00.229604+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:50:00.229604+0000","last_undegraded":"2024-09-21T07:50:00.229604+0000","last_fullsized":"2024-09-21T07:50:00.229604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235991+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:50:00.235991+0000","last_peered":"2024-09-21T07:50:00.235991+0000","last_clean":"2024-09-21T07:50:00.235991+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:50:00.235991+0000","last_undegraded":"2024-09-21T07:50:00.235991+0000","last_fullsized":"2024-09-21T07:50:00.235991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210061+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:50:00.210061+0000","last_peered":"2024-09-21T07:50:00.210061+0000","last_clean":"2024-09-21T07:50:00.210061+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:50:00.210061+0000","last_undegraded":"2024-09-21T07:50:00.210061+0000","last_fullsized":"2024-09-21T07:50:00.210061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234725+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:50:00.234725+0000","last_peered":"2024-09-21T07:50:00.234725+0000","last_clean":"2024-09-21T07:50:00.234725+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:50:00.234725+0000","last_undegraded":"2024-09-21T07:50:00.234725+0000","last_fullsized":"2024-09-21T07:50:00.234725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210704+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:50:00.210704+0000","last_peered":"2024-09-21T07:50:00.210704+0000","last_clean":"2024-09-21T07:50:00.210704+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:50:00.210704+0000","last_undegraded":"2024-09-21T07:50:00.210704+0000","last_fullsized":"2024-09-21T07:50:00.210704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233170+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:50:00.233170+0000","last_peered":"2024-09-21T07:50:00.233170+0000","last_clean":"2024-09-21T07:50:00.233170+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:50:00.233170+0000","last_undegraded":"2024-09-21T07:50:00.233170+0000","last_fullsized":"2024-09-21T07:50:00.233170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215521+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:50:00.215521+0000","last_peered":"2024-09-21T07:50:00.215521+0000","last_clean":"2024-09-21T07:50:00.215521+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:50:00.215521+0000","last_undegraded":"2024-09-21T07:50:00.215521+0000","last_fullsized":"2024-09-21T07:50:00.215521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.208038+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:50:00.208038+0000","last_peered":"2024-09-21T07:50:00.208038+0000","last_clean":"2024-09-21T07:50:00.208038+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:50:00.208038+0000","last_undegraded":"2024-09-21T07:50:00.208038+0000","last_fullsized":"2024-09-21T07:50:00.208038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229406+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:50:00.229406+0000","last_peered":"2024-09-21T07:50:00.229406+0000","last_clean":"2024-09-21T07:50:00.229406+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:50:00.229406+0000","last_undegraded":"2024-09-21T07:50:00.229406+0000","last_fullsized":"2024-09-21T07:50:00.229406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230493+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:50:00.230493+0000","last_peered":"2024-09-21T07:50:00.230493+0000","last_clean":"2024-09-21T07:50:00.230493+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:50:00.230493+0000","last_undegraded":"2024-09-21T07:50:00.230493+0000","last_fullsized":"2024-09-21T07:50:00.230493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.220776+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:50:00.220776+0000","last_peered":"2024-09-21T07:50:00.220776+0000","last_clean":"2024-09-21T07:50:00.220776+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:50:00.220776+0000","last_undegraded":"2024-09-21T07:50:00.220776+0000","last_fullsized":"2024-09-21T07:50:00.220776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230134+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:50:00.230134+0000","last_peered":"2024-09-21T07:50:00.230134+0000","last_clean":"2024-09-21T07:50:00.230134+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:50:00.230134+0000","last_undegraded":"2024-09-21T07:50:00.230134+0000","last_fullsized":"2024-09-21T07:50:00.230134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80597,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1242,"num_read_kb":710,"num_write":265,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":241791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":526920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906997,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37036,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708116,"statfs":{"total":95995035648,"available":95957110784,"internally_reserved":0,"allocated":1732608,"data_stored":1185354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070524,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":529764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266754,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":525464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462983,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1646592,"data_stored":1122995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626508,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822737,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1118266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986263,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":520880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":596218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542248,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":595313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":523160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":74863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":74536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:50:38.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.734+0000 7f1e70400640 1 -- 172.21.15.84:0/1004428023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e68105cd0 msgr2=0x7f1e681060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.734+0000 7f1e70400640 1 --2- 172.21.15.84:0/1004428023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e68105cd0 0x7f1e681060e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009900 tx=0x7f1e5c02a410 comp rx=0 tx=0).stop 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.734+0000 7f1e70400640 1 -- 172.21.15.84:0/1004428023 shutdown_connections 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.734+0000 7f1e70400640 1 --2- 172.21.15.84:0/1004428023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6810bf50 0x7f1e68112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.734+0000 7f1e70400640 1 --2- 172.21.15.84:0/1004428023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e6810b600 0x7f1e6810ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.734+0000 7f1e70400640 1 --2- 172.21.15.84:0/1004428023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e68105cd0 0x7f1e681060e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.734+0000 7f1e70400640 1 -- 172.21.15.84:0/1004428023 >> 172.21.15.84:0/1004428023 conn(0x7f1e681016f0 msgr2=0x7f1e68103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.735+0000 7f1e70400640 1 -- 172.21.15.84:0/1004428023 shutdown_connections 2024-09-21T07:50:38.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.735+0000 7f1e70400640 1 -- 172.21.15.84:0/1004428023 wait complete. 2024-09-21T07:50:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 Processor -- start 2024-09-21T07:50:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 -- start start 2024-09-21T07:50:38.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e68105cd0 0x7f1e6819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e6810b600 0x7f1e6819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6810bf50 0x7f1e681a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68115c10 con 0x7f1e6810b600 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68115a90 con 0x7f1e6810bf50 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e70400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68115d90 con 0x7f1e68105cd0 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e6d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e6810b600 0x7f1e6819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e6da00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e68105cd0 0x7f1e6819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e6da00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e68105cd0 0x7f1e6819c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52062/0 (socket says 172.21.15.84:52062) 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.736+0000 7f1e6da00640 1 -- 172.21.15.84:0/777734267 learned_addr learned my addr 172.21.15.84:0/777734267 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e6e400640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6810bf50 0x7f1e681a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e6d000640 1 -- 172.21.15.84:0/777734267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e68105cd0 msgr2=0x7f1e6819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e6d000640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e68105cd0 0x7f1e6819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e6d000640 1 -- 172.21.15.84:0/777734267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6810bf50 msgr2=0x7f1e681a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e6d000640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6810bf50 0x7f1e681a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e6d000640 1 -- 172.21.15.84:0/777734267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e681a25c0 con 0x7f1e6810b600 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e6d000640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e6810b600 0x7f1e6819cc30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e6806c5e0 tx=0x7f1e5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e66000640 1 -- 172.21.15.84:0/777734267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54017070 con 0x7f1e6810b600 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.737+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e681a28b0 con 0x7f1e6810b600 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.738+0000 7f1e66000640 1 -- 172.21.15.84:0/777734267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e540099a0 con 0x7f1e6810b600 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.738+0000 7f1e66000640 1 -- 172.21.15.84:0/777734267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54005630 con 0x7f1e6810b600 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.738+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681a9040 con 0x7f1e6810b600 2024-09-21T07:50:38.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.739+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e68106f40 con 0x7f1e6810b600 2024-09-21T07:50:38.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.742+0000 7f1e66000640 1 -- 172.21.15.84:0/777734267 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f1e54009b50 con 0x7f1e6810b600 2024-09-21T07:50:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.743+0000 7f1e66000640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1e500b6560 0x7f1e500b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.743+0000 7f1e66000640 1 -- 172.21.15.84:0/777734267 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f1e540e7800 con 0x7f1e6810b600 2024-09-21T07:50:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.743+0000 7f1e6da00640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1e500b6560 0x7f1e500b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.744+0000 7f1e6da00640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1e500b6560 0x7f1e500b8a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c031440 tx=0x7f1e5c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:38.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.744+0000 7f1e66000640 1 -- 172.21.15.84:0/777734267 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e54020020 con 0x7f1e6810b600 2024-09-21T07:50:38.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:38 smithi162 ceph-mon[34833]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T07:50:38.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:38 smithi084 ceph-mon[30411]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T07:50:38.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:38 smithi191 ceph-mon[34667]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T07:50:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.930+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e68063800 con 0x7f1e500b6560 2024-09-21T07:50:38.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.936+0000 7f1e66000640 1 -- 172.21.15.84:0/777734267 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340535 (secure 0 0 0) 0x7f1e68063800 con 0x7f1e500b6560 2024-09-21T07:50:38.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:38.943 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:50:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1e500b6560 msgr2=0x7f1e500b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1e500b6560 0x7f1e500b8a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c031440 tx=0x7f1e5c0058d0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e6810b600 msgr2=0x7f1e6819cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e6810b600 0x7f1e6819cc30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e6806c5e0 tx=0x7f1e5400dbb0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 shutdown_connections 2024-09-21T07:50:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1e500b6560 0x7f1e500b8a70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e6810bf50 0x7f1e681a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e6810b600 0x7f1e6819cc30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 --2- 172.21.15.84:0/777734267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e68105cd0 0x7f1e6819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:38.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 >> 172.21.15.84:0/777734267 conn(0x7f1e681016f0 msgr2=0x7f1e68103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:38.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 shutdown_connections 2024-09-21T07:50:38.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:38.940+0000 7f1e70400640 1 -- 172.21.15.84:0/777734267 wait complete. 2024-09-21T07:50:38.968 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-21T07:50:38.020919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671199,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1323,"num_read_kb":779,"num_write":390,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396744,"kb_used_data":14216,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545080,"statfs":{"total":1151940427776,"available":1151534161920,"internally_reserved":0,"allocated":14557184,"data_stored":8291063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":391492921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6065,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":58,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003550"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:32.108578+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:50:32.108578+0000","last_peered":"2024-09-21T07:50:32.108578+0000","last_clean":"2024-09-21T07:50:32.108578+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:50:32.108578+0000","last_undegraded":"2024-09-21T07:50:32.108578+0000","last_fullsized":"2024-09-21T07:50:32.108578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210401+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:50:00.210401+0000","last_peered":"2024-09-21T07:50:00.210401+0000","last_clean":"2024-09-21T07:50:00.210401+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:50:00.210401+0000","last_undegraded":"2024-09-21T07:50:00.210401+0000","last_fullsized":"2024-09-21T07:50:00.210401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247890+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247890+0000","last_peered":"2024-09-21T07:49:31.247890+0000","last_clean":"2024-09-21T07:49:31.247890+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247890+0000","last_undegraded":"2024-09-21T07:49:31.247890+0000","last_fullsized":"2024-09-21T07:49:31.247890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279185+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279185+0000","last_peered":"2024-09-21T07:49:31.279185+0000","last_clean":"2024-09-21T07:49:31.279185+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279185+0000","last_undegraded":"2024-09-21T07:49:31.279185+0000","last_fullsized":"2024-09-21T07:49:31.279185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230523+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:50:00.230523+0000","last_peered":"2024-09-21T07:50:00.230523+0000","last_clean":"2024-09-21T07:50:00.230523+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:50:00.230523+0000","last_undegraded":"2024-09-21T07:50:00.230523+0000","last_fullsized":"2024-09-21T07:50:00.230523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.280231+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.280231+0000","last_peered":"2024-09-21T07:49:31.280231+0000","last_clean":"2024-09-21T07:49:31.280231+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.280231+0000","last_undegraded":"2024-09-21T07:49:31.280231+0000","last_fullsized":"2024-09-21T07:49:31.280231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162622+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162622+0000","last_peered":"2024-09-21T07:49:31.162622+0000","last_clean":"2024-09-21T07:49:31.162622+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162622+0000","last_undegraded":"2024-09-21T07:49:31.162622+0000","last_fullsized":"2024-09-21T07:49:31.162622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230976+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:50:00.230976+0000","last_peered":"2024-09-21T07:50:00.230976+0000","last_clean":"2024-09-21T07:50:00.230976+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:50:00.230976+0000","last_undegraded":"2024-09-21T07:50:00.230976+0000","last_fullsized":"2024-09-21T07:50:00.230976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162964+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162964+0000","last_peered":"2024-09-21T07:49:31.162964+0000","last_clean":"2024-09-21T07:49:31.162964+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162964+0000","last_undegraded":"2024-09-21T07:49:31.162964+0000","last_fullsized":"2024-09-21T07:49:31.162964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235866+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:50:00.235866+0000","last_peered":"2024-09-21T07:50:00.235866+0000","last_clean":"2024-09-21T07:50:00.235866+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:50:00.235866+0000","last_undegraded":"2024-09-21T07:50:00.235866+0000","last_fullsized":"2024-09-21T07:50:00.235866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162229+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162229+0000","last_peered":"2024-09-21T07:49:31.162229+0000","last_clean":"2024-09-21T07:49:31.162229+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162229+0000","last_undegraded":"2024-09-21T07:49:31.162229+0000","last_fullsized":"2024-09-21T07:49:31.162229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236270+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:50:00.236270+0000","last_peered":"2024-09-21T07:50:00.236270+0000","last_clean":"2024-09-21T07:50:00.236270+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:50:00.236270+0000","last_undegraded":"2024-09-21T07:50:00.236270+0000","last_fullsized":"2024-09-21T07:50:00.236270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162277+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162277+0000","last_peered":"2024-09-21T07:49:31.162277+0000","last_clean":"2024-09-21T07:49:31.162277+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162277+0000","last_undegraded":"2024-09-21T07:49:31.162277+0000","last_fullsized":"2024-09-21T07:49:31.162277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163029+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.163029+0000","last_peered":"2024-09-21T07:49:31.163029+0000","last_clean":"2024-09-21T07:49:31.163029+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.163029+0000","last_undegraded":"2024-09-21T07:49:31.163029+0000","last_fullsized":"2024-09-21T07:49:31.163029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225576+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:50:00.225576+0000","last_peered":"2024-09-21T07:50:00.225576+0000","last_clean":"2024-09-21T07:50:00.225576+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:50:00.225576+0000","last_undegraded":"2024-09-21T07:50:00.225576+0000","last_fullsized":"2024-09-21T07:50:00.225576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247829+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247829+0000","last_peered":"2024-09-21T07:49:31.247829+0000","last_clean":"2024-09-21T07:49:31.247829+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247829+0000","last_undegraded":"2024-09-21T07:49:31.247829+0000","last_fullsized":"2024-09-21T07:49:31.247829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163050+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.163050+0000","last_peered":"2024-09-21T07:49:31.163050+0000","last_clean":"2024-09-21T07:49:31.163050+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.163050+0000","last_undegraded":"2024-09-21T07:49:31.163050+0000","last_fullsized":"2024-09-21T07:49:31.163050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228962+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:50:00.228962+0000","last_peered":"2024-09-21T07:50:00.228962+0000","last_clean":"2024-09-21T07:50:00.228962+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:50:00.228962+0000","last_undegraded":"2024-09-21T07:50:00.228962+0000","last_fullsized":"2024-09-21T07:50:00.228962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278440+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278440+0000","last_peered":"2024-09-21T07:49:31.278440+0000","last_clean":"2024-09-21T07:49:31.278440+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278440+0000","last_undegraded":"2024-09-21T07:49:31.278440+0000","last_fullsized":"2024-09-21T07:49:31.278440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160566+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160566+0000","last_peered":"2024-09-21T07:49:31.160566+0000","last_clean":"2024-09-21T07:49:31.160566+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160566+0000","last_undegraded":"2024-09-21T07:49:31.160566+0000","last_fullsized":"2024-09-21T07:49:31.160566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.182905+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:50:00.182905+0000","last_peered":"2024-09-21T07:50:00.182905+0000","last_clean":"2024-09-21T07:50:00.182905+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:50:00.182905+0000","last_undegraded":"2024-09-21T07:50:00.182905+0000","last_fullsized":"2024-09-21T07:50:00.182905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161028+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.161028+0000","last_peered":"2024-09-21T07:49:31.161028+0000","last_clean":"2024-09-21T07:49:31.161028+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.161028+0000","last_undegraded":"2024-09-21T07:49:31.161028+0000","last_fullsized":"2024-09-21T07:49:31.161028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163163+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163163+0000","last_peered":"2024-09-21T07:49:31.163163+0000","last_clean":"2024-09-21T07:49:31.163163+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163163+0000","last_undegraded":"2024-09-21T07:49:31.163163+0000","last_fullsized":"2024-09-21T07:49:31.163163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228483+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:50:00.228483+0000","last_peered":"2024-09-21T07:50:00.228483+0000","last_clean":"2024-09-21T07:50:00.228483+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:50:00.228483+0000","last_undegraded":"2024-09-21T07:50:00.228483+0000","last_fullsized":"2024-09-21T07:50:00.228483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163371+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163371+0000","last_peered":"2024-09-21T07:49:31.163371+0000","last_clean":"2024-09-21T07:49:31.163371+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163371+0000","last_undegraded":"2024-09-21T07:49:31.163371+0000","last_fullsized":"2024-09-21T07:49:31.163371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247637+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247637+0000","last_peered":"2024-09-21T07:49:31.247637+0000","last_clean":"2024-09-21T07:49:31.247637+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247637+0000","last_undegraded":"2024-09-21T07:49:31.247637+0000","last_fullsized":"2024-09-21T07:49:31.247637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233969+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:50:00.233969+0000","last_peered":"2024-09-21T07:50:00.233969+0000","last_clean":"2024-09-21T07:50:00.233969+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:50:00.233969+0000","last_undegraded":"2024-09-21T07:50:00.233969+0000","last_fullsized":"2024-09-21T07:50:00.233969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'18","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.730803+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:50:00.730803+0000","last_peered":"2024-09-21T07:50:00.730803+0000","last_clean":"2024-09-21T07:50:00.730803+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:50:00.730803+0000","last_undegraded":"2024-09-21T07:50:00.730803+0000","last_fullsized":"2024-09-21T07:50:00.730803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278131+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278131+0000","last_peered":"2024-09-21T07:49:31.278131+0000","last_clean":"2024-09-21T07:49:31.278131+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278131+0000","last_undegraded":"2024-09-21T07:49:31.278131+0000","last_fullsized":"2024-09-21T07:49:31.278131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214205+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:50:00.214205+0000","last_peered":"2024-09-21T07:50:00.214205+0000","last_clean":"2024-09-21T07:50:00.214205+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:50:00.214205+0000","last_undegraded":"2024-09-21T07:50:00.214205+0000","last_fullsized":"2024-09-21T07:50:00.214205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162970+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162970+0000","last_peered":"2024-09-21T07:49:31.162970+0000","last_clean":"2024-09-21T07:49:31.162970+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162970+0000","last_undegraded":"2024-09-21T07:49:31.162970+0000","last_fullsized":"2024-09-21T07:49:31.162970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158456+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158456+0000","last_peered":"2024-09-21T07:49:31.158456+0000","last_clean":"2024-09-21T07:49:31.158456+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158456+0000","last_undegraded":"2024-09-21T07:49:31.158456+0000","last_fullsized":"2024-09-21T07:49:31.158456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212815+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:50:00.212815+0000","last_peered":"2024-09-21T07:50:00.212815+0000","last_clean":"2024-09-21T07:50:00.212815+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:50:00.212815+0000","last_undegraded":"2024-09-21T07:50:00.212815+0000","last_fullsized":"2024-09-21T07:50:00.212815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160485+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160485+0000","last_peered":"2024-09-21T07:49:31.160485+0000","last_clean":"2024-09-21T07:49:31.160485+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160485+0000","last_undegraded":"2024-09-21T07:49:31.160485+0000","last_fullsized":"2024-09-21T07:49:31.160485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162107+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162107+0000","last_peered":"2024-09-21T07:49:31.162107+0000","last_clean":"2024-09-21T07:49:31.162107+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162107+0000","last_undegraded":"2024-09-21T07:49:31.162107+0000","last_fullsized":"2024-09-21T07:49:31.162107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226173+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:50:00.226173+0000","last_peered":"2024-09-21T07:50:00.226173+0000","last_clean":"2024-09-21T07:50:00.226173+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:50:00.226173+0000","last_undegraded":"2024-09-21T07:50:00.226173+0000","last_fullsized":"2024-09-21T07:50:00.226173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:33.346545+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:50:33.346545+0000","last_peered":"2024-09-21T07:50:33.346545+0000","last_clean":"2024-09-21T07:50:33.346545+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:50:33.346545+0000","last_undegraded":"2024-09-21T07:50:33.346545+0000","last_fullsized":"2024-09-21T07:50:33.346545+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":899,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246008+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.246008+0000","last_peered":"2024-09-21T07:49:31.246008+0000","last_clean":"2024-09-21T07:49:31.246008+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.246008+0000","last_undegraded":"2024-09-21T07:49:31.246008+0000","last_fullsized":"2024-09-21T07:49:31.246008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234222+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:50:00.234222+0000","last_peered":"2024-09-21T07:50:00.234222+0000","last_clean":"2024-09-21T07:50:00.234222+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:50:00.234222+0000","last_undegraded":"2024-09-21T07:50:00.234222+0000","last_fullsized":"2024-09-21T07:50:00.234222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:33.345735+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:50:33.345735+0000","last_peered":"2024-09-21T07:50:33.345735+0000","last_clean":"2024-09-21T07:50:33.345735+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:50:33.345735+0000","last_undegraded":"2024-09-21T07:50:33.345735+0000","last_fullsized":"2024-09-21T07:50:33.345735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246470+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246470+0000","last_peered":"2024-09-21T07:49:31.246470+0000","last_clean":"2024-09-21T07:49:31.246470+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246470+0000","last_undegraded":"2024-09-21T07:49:31.246470+0000","last_fullsized":"2024-09-21T07:49:31.246470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215266+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:50:00.215266+0000","last_peered":"2024-09-21T07:50:00.215266+0000","last_clean":"2024-09-21T07:50:00.215266+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:50:00.215266+0000","last_undegraded":"2024-09-21T07:50:00.215266+0000","last_fullsized":"2024-09-21T07:50:00.215266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243292+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243292+0000","last_peered":"2024-09-21T07:49:31.243292+0000","last_clean":"2024-09-21T07:49:31.243292+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243292+0000","last_undegraded":"2024-09-21T07:49:31.243292+0000","last_fullsized":"2024-09-21T07:49:31.243292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247818+0000","last_change":"2024-09-21T07:49:31.247663+0000","last_active":"2024-09-21T07:49:31.247818+0000","last_peered":"2024-09-21T07:49:31.247818+0000","last_clean":"2024-09-21T07:49:31.247818+0000","last_became_active":"2024-09-21T07:49:31.247173+0000","last_became_peered":"2024-09-21T07:49:31.247173+0000","last_unstale":"2024-09-21T07:49:31.247818+0000","last_undegraded":"2024-09-21T07:49:31.247818+0000","last_fullsized":"2024-09-21T07:49:31.247818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:29.114632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229905+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:50:00.229905+0000","last_peered":"2024-09-21T07:50:00.229905+0000","last_clean":"2024-09-21T07:50:00.229905+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:50:00.229905+0000","last_undegraded":"2024-09-21T07:50:00.229905+0000","last_fullsized":"2024-09-21T07:50:00.229905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163025+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.163025+0000","last_peered":"2024-09-21T07:49:31.163025+0000","last_clean":"2024-09-21T07:49:31.163025+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.163025+0000","last_undegraded":"2024-09-21T07:49:31.163025+0000","last_fullsized":"2024-09-21T07:49:31.163025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243589+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243589+0000","last_peered":"2024-09-21T07:49:31.243589+0000","last_clean":"2024-09-21T07:49:31.243589+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243589+0000","last_undegraded":"2024-09-21T07:49:31.243589+0000","last_fullsized":"2024-09-21T07:49:31.243589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236108+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:50:00.236108+0000","last_peered":"2024-09-21T07:50:00.236108+0000","last_clean":"2024-09-21T07:50:00.236108+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:50:00.236108+0000","last_undegraded":"2024-09-21T07:50:00.236108+0000","last_fullsized":"2024-09-21T07:50:00.236108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'7","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:35.349470+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:50:35.349470+0000","last_peered":"2024-09-21T07:50:35.349470+0000","last_clean":"2024-09-21T07:50:35.349470+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:50:35.349470+0000","last_undegraded":"2024-09-21T07:50:35.349470+0000","last_fullsized":"2024-09-21T07:50:35.349470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161230+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161230+0000","last_peered":"2024-09-21T07:49:31.161230+0000","last_clean":"2024-09-21T07:49:31.161230+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161230+0000","last_undegraded":"2024-09-21T07:49:31.161230+0000","last_fullsized":"2024-09-21T07:49:31.161230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233772+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:50:00.233772+0000","last_peered":"2024-09-21T07:50:00.233772+0000","last_clean":"2024-09-21T07:50:00.233772+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:50:00.233772+0000","last_undegraded":"2024-09-21T07:50:00.233772+0000","last_fullsized":"2024-09-21T07:50:00.233772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248809+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:49:31.248809+0000","last_peered":"2024-09-21T07:49:31.248809+0000","last_clean":"2024-09-21T07:49:31.248809+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:49:31.248809+0000","last_undegraded":"2024-09-21T07:49:31.248809+0000","last_fullsized":"2024-09-21T07:49:31.248809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278758+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278758+0000","last_peered":"2024-09-21T07:49:31.278758+0000","last_clean":"2024-09-21T07:49:31.278758+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278758+0000","last_undegraded":"2024-09-21T07:49:31.278758+0000","last_fullsized":"2024-09-21T07:49:31.278758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231353+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:50:00.231353+0000","last_peered":"2024-09-21T07:50:00.231353+0000","last_clean":"2024-09-21T07:50:00.231353+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:50:00.231353+0000","last_undegraded":"2024-09-21T07:50:00.231353+0000","last_fullsized":"2024-09-21T07:50:00.231353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246326+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246326+0000","last_peered":"2024-09-21T07:49:31.246326+0000","last_clean":"2024-09-21T07:49:31.246326+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246326+0000","last_undegraded":"2024-09-21T07:49:31.246326+0000","last_fullsized":"2024-09-21T07:49:31.246326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246901+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246901+0000","last_peered":"2024-09-21T07:49:31.246901+0000","last_clean":"2024-09-21T07:49:31.246901+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246901+0000","last_undegraded":"2024-09-21T07:49:31.246901+0000","last_fullsized":"2024-09-21T07:49:31.246901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228801+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:50:00.228801+0000","last_peered":"2024-09-21T07:50:00.228801+0000","last_clean":"2024-09-21T07:50:00.228801+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:50:00.228801+0000","last_undegraded":"2024-09-21T07:50:00.228801+0000","last_fullsized":"2024-09-21T07:50:00.228801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162830+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162830+0000","last_peered":"2024-09-21T07:49:31.162830+0000","last_clean":"2024-09-21T07:49:31.162830+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162830+0000","last_undegraded":"2024-09-21T07:49:31.162830+0000","last_fullsized":"2024-09-21T07:49:31.162830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246921+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246921+0000","last_peered":"2024-09-21T07:49:31.246921+0000","last_clean":"2024-09-21T07:49:31.246921+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246921+0000","last_undegraded":"2024-09-21T07:49:31.246921+0000","last_fullsized":"2024-09-21T07:49:31.246921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235805+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:50:00.235805+0000","last_peered":"2024-09-21T07:50:00.235805+0000","last_clean":"2024-09-21T07:50:00.235805+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:50:00.235805+0000","last_undegraded":"2024-09-21T07:50:00.235805+0000","last_fullsized":"2024-09-21T07:50:00.235805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162058+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.162058+0000","last_peered":"2024-09-21T07:49:31.162058+0000","last_clean":"2024-09-21T07:49:31.162058+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.162058+0000","last_undegraded":"2024-09-21T07:49:31.162058+0000","last_fullsized":"2024-09-21T07:49:31.162058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246203+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246203+0000","last_peered":"2024-09-21T07:49:31.246203+0000","last_clean":"2024-09-21T07:49:31.246203+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246203+0000","last_undegraded":"2024-09-21T07:49:31.246203+0000","last_fullsized":"2024-09-21T07:49:31.246203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225861+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:50:00.225861+0000","last_peered":"2024-09-21T07:50:00.225861+0000","last_clean":"2024-09-21T07:50:00.225861+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:50:00.225861+0000","last_undegraded":"2024-09-21T07:50:00.225861+0000","last_fullsized":"2024-09-21T07:50:00.225861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:32.344719+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:50:32.344719+0000","last_peered":"2024-09-21T07:50:32.344719+0000","last_clean":"2024-09-21T07:50:32.344719+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:50:32.344719+0000","last_undegraded":"2024-09-21T07:50:32.344719+0000","last_fullsized":"2024-09-21T07:50:32.344719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226537+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:50:00.226537+0000","last_peered":"2024-09-21T07:50:00.226537+0000","last_clean":"2024-09-21T07:50:00.226537+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:50:00.226537+0000","last_undegraded":"2024-09-21T07:50:00.226537+0000","last_fullsized":"2024-09-21T07:50:00.226537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247713+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247713+0000","last_peered":"2024-09-21T07:49:31.247713+0000","last_clean":"2024-09-21T07:49:31.247713+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247713+0000","last_undegraded":"2024-09-21T07:49:31.247713+0000","last_fullsized":"2024-09-21T07:49:31.247713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158454+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158454+0000","last_peered":"2024-09-21T07:49:31.158454+0000","last_clean":"2024-09-21T07:49:31.158454+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158454+0000","last_undegraded":"2024-09-21T07:49:31.158454+0000","last_fullsized":"2024-09-21T07:49:31.158454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.213866+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:50:00.213866+0000","last_peered":"2024-09-21T07:50:00.213866+0000","last_clean":"2024-09-21T07:50:00.213866+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:50:00.213866+0000","last_undegraded":"2024-09-21T07:50:00.213866+0000","last_fullsized":"2024-09-21T07:50:00.213866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158337+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158337+0000","last_peered":"2024-09-21T07:49:31.158337+0000","last_clean":"2024-09-21T07:49:31.158337+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158337+0000","last_undegraded":"2024-09-21T07:49:31.158337+0000","last_fullsized":"2024-09-21T07:49:31.158337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248339+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248339+0000","last_peered":"2024-09-21T07:49:31.248339+0000","last_clean":"2024-09-21T07:49:31.248339+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248339+0000","last_undegraded":"2024-09-21T07:49:31.248339+0000","last_fullsized":"2024-09-21T07:49:31.248339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.224994+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:50:00.224994+0000","last_peered":"2024-09-21T07:50:00.224994+0000","last_clean":"2024-09-21T07:50:00.224994+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:50:00.224994+0000","last_undegraded":"2024-09-21T07:50:00.224994+0000","last_fullsized":"2024-09-21T07:50:00.224994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'40","reported_seq":336,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:34.348021+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:50:34.348021+0000","last_peered":"2024-09-21T07:50:34.348021+0000","last_clean":"2024-09-21T07:50:34.348021+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:50:34.348021+0000","last_undegraded":"2024-09-21T07:50:34.348021+0000","last_fullsized":"2024-09-21T07:50:34.348021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":197,"num_write":42,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159921+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159921+0000","last_peered":"2024-09-21T07:49:31.159921+0000","last_clean":"2024-09-21T07:49:31.159921+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159921+0000","last_undegraded":"2024-09-21T07:49:31.159921+0000","last_fullsized":"2024-09-21T07:49:31.159921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236544+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:50:00.236544+0000","last_peered":"2024-09-21T07:50:00.236544+0000","last_clean":"2024-09-21T07:50:00.236544+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:50:00.236544+0000","last_undegraded":"2024-09-21T07:50:00.236544+0000","last_fullsized":"2024-09-21T07:50:00.236544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248679+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248679+0000","last_peered":"2024-09-21T07:49:31.248679+0000","last_clean":"2024-09-21T07:49:31.248679+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248679+0000","last_undegraded":"2024-09-21T07:49:31.248679+0000","last_fullsized":"2024-09-21T07:49:31.248679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162313+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162313+0000","last_peered":"2024-09-21T07:49:31.162313+0000","last_clean":"2024-09-21T07:49:31.162313+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162313+0000","last_undegraded":"2024-09-21T07:49:31.162313+0000","last_fullsized":"2024-09-21T07:49:31.162313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227866+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:50:00.227866+0000","last_peered":"2024-09-21T07:50:00.227866+0000","last_clean":"2024-09-21T07:50:00.227866+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:50:00.227866+0000","last_undegraded":"2024-09-21T07:50:00.227866+0000","last_fullsized":"2024-09-21T07:50:00.227866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244633+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244633+0000","last_peered":"2024-09-21T07:49:31.244633+0000","last_clean":"2024-09-21T07:49:31.244633+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244633+0000","last_undegraded":"2024-09-21T07:49:31.244633+0000","last_fullsized":"2024-09-21T07:49:31.244633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159785+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159785+0000","last_peered":"2024-09-21T07:49:31.159785+0000","last_clean":"2024-09-21T07:49:31.159785+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159785+0000","last_undegraded":"2024-09-21T07:49:31.159785+0000","last_fullsized":"2024-09-21T07:49:31.159785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231446+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:50:00.231446+0000","last_peered":"2024-09-21T07:50:00.231446+0000","last_clean":"2024-09-21T07:50:00.231446+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:50:00.231446+0000","last_undegraded":"2024-09-21T07:50:00.231446+0000","last_fullsized":"2024-09-21T07:50:00.231446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":292,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:34.347341+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:50:34.347341+0000","last_peered":"2024-09-21T07:50:34.347341+0000","last_clean":"2024-09-21T07:50:34.347341+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:50:34.347341+0000","last_undegraded":"2024-09-21T07:50:34.347341+0000","last_fullsized":"2024-09-21T07:50:34.347341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277894+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277894+0000","last_peered":"2024-09-21T07:49:31.277894+0000","last_clean":"2024-09-21T07:49:31.277894+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277894+0000","last_undegraded":"2024-09-21T07:49:31.277894+0000","last_fullsized":"2024-09-21T07:49:31.277894+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278984+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278984+0000","last_peered":"2024-09-21T07:49:31.278984+0000","last_clean":"2024-09-21T07:49:31.278984+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278984+0000","last_undegraded":"2024-09-21T07:49:31.278984+0000","last_fullsized":"2024-09-21T07:49:31.278984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225224+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:50:00.225224+0000","last_peered":"2024-09-21T07:50:00.225224+0000","last_clean":"2024-09-21T07:50:00.225224+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:50:00.225224+0000","last_undegraded":"2024-09-21T07:50:00.225224+0000","last_fullsized":"2024-09-21T07:50:00.225224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247909+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247909+0000","last_peered":"2024-09-21T07:49:31.247909+0000","last_clean":"2024-09-21T07:49:31.247909+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247909+0000","last_undegraded":"2024-09-21T07:49:31.247909+0000","last_fullsized":"2024-09-21T07:49:31.247909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158882+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158882+0000","last_peered":"2024-09-21T07:49:31.158882+0000","last_clean":"2024-09-21T07:49:31.158882+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158882+0000","last_undegraded":"2024-09-21T07:49:31.158882+0000","last_fullsized":"2024-09-21T07:49:31.158882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226888+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:50:00.226888+0000","last_peered":"2024-09-21T07:50:00.226888+0000","last_clean":"2024-09-21T07:50:00.226888+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:50:00.226888+0000","last_undegraded":"2024-09-21T07:50:00.226888+0000","last_fullsized":"2024-09-21T07:50:00.226888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245823+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245823+0000","last_peered":"2024-09-21T07:49:31.245823+0000","last_clean":"2024-09-21T07:49:31.245823+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245823+0000","last_undegraded":"2024-09-21T07:49:31.245823+0000","last_fullsized":"2024-09-21T07:49:31.245823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243596+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243596+0000","last_peered":"2024-09-21T07:49:31.243596+0000","last_clean":"2024-09-21T07:49:31.243596+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243596+0000","last_undegraded":"2024-09-21T07:49:31.243596+0000","last_fullsized":"2024-09-21T07:49:31.243596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234552+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:50:00.234552+0000","last_peered":"2024-09-21T07:50:00.234552+0000","last_clean":"2024-09-21T07:50:00.234552+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:50:00.234552+0000","last_undegraded":"2024-09-21T07:50:00.234552+0000","last_fullsized":"2024-09-21T07:50:00.234552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248127+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248127+0000","last_peered":"2024-09-21T07:49:31.248127+0000","last_clean":"2024-09-21T07:49:31.248127+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248127+0000","last_undegraded":"2024-09-21T07:49:31.248127+0000","last_fullsized":"2024-09-21T07:49:31.248127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:31.343208+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:50:31.343208+0000","last_peered":"2024-09-21T07:50:31.343208+0000","last_clean":"2024-09-21T07:50:31.343208+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:50:31.343208+0000","last_undegraded":"2024-09-21T07:50:31.343208+0000","last_fullsized":"2024-09-21T07:50:31.343208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212530+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:50:00.212530+0000","last_peered":"2024-09-21T07:50:00.212530+0000","last_clean":"2024-09-21T07:50:00.212530+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:50:00.212530+0000","last_undegraded":"2024-09-21T07:50:00.212530+0000","last_fullsized":"2024-09-21T07:50:00.212530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248474+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248474+0000","last_peered":"2024-09-21T07:49:31.248474+0000","last_clean":"2024-09-21T07:49:31.248474+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248474+0000","last_undegraded":"2024-09-21T07:49:31.248474+0000","last_fullsized":"2024-09-21T07:49:31.248474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229653+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:50:00.229653+0000","last_peered":"2024-09-21T07:50:00.229653+0000","last_clean":"2024-09-21T07:50:00.229653+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:50:00.229653+0000","last_undegraded":"2024-09-21T07:50:00.229653+0000","last_fullsized":"2024-09-21T07:50:00.229653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214497+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:50:00.214497+0000","last_peered":"2024-09-21T07:50:00.214497+0000","last_clean":"2024-09-21T07:50:00.214497+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:50:00.214497+0000","last_undegraded":"2024-09-21T07:50:00.214497+0000","last_fullsized":"2024-09-21T07:50:00.214497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227306+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:50:00.227306+0000","last_peered":"2024-09-21T07:50:00.227306+0000","last_clean":"2024-09-21T07:50:00.227306+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:50:00.227306+0000","last_undegraded":"2024-09-21T07:50:00.227306+0000","last_fullsized":"2024-09-21T07:50:00.227306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227334+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:50:00.227334+0000","last_peered":"2024-09-21T07:50:00.227334+0000","last_clean":"2024-09-21T07:50:00.227334+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:50:00.227334+0000","last_undegraded":"2024-09-21T07:50:00.227334+0000","last_fullsized":"2024-09-21T07:50:00.227334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227942+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:50:00.227942+0000","last_peered":"2024-09-21T07:50:00.227942+0000","last_clean":"2024-09-21T07:50:00.227942+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:50:00.227942+0000","last_undegraded":"2024-09-21T07:50:00.227942+0000","last_fullsized":"2024-09-21T07:50:00.227942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228389+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:50:00.228389+0000","last_peered":"2024-09-21T07:50:00.228389+0000","last_clean":"2024-09-21T07:50:00.228389+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:50:00.228389+0000","last_undegraded":"2024-09-21T07:50:00.228389+0000","last_fullsized":"2024-09-21T07:50:00.228389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223482+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:50:00.223482+0000","last_peered":"2024-09-21T07:50:00.223482+0000","last_clean":"2024-09-21T07:50:00.223482+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:50:00.223482+0000","last_undegraded":"2024-09-21T07:50:00.223482+0000","last_fullsized":"2024-09-21T07:50:00.223482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.202426+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:50:00.202426+0000","last_peered":"2024-09-21T07:50:00.202426+0000","last_clean":"2024-09-21T07:50:00.202426+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:50:00.202426+0000","last_undegraded":"2024-09-21T07:50:00.202426+0000","last_fullsized":"2024-09-21T07:50:00.202426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228634+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:50:00.228634+0000","last_peered":"2024-09-21T07:50:00.228634+0000","last_clean":"2024-09-21T07:50:00.228634+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:50:00.228634+0000","last_undegraded":"2024-09-21T07:50:00.228634+0000","last_fullsized":"2024-09-21T07:50:00.228634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.219031+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:50:00.219031+0000","last_peered":"2024-09-21T07:50:00.219031+0000","last_clean":"2024-09-21T07:50:00.219031+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:50:00.219031+0000","last_undegraded":"2024-09-21T07:50:00.219031+0000","last_fullsized":"2024-09-21T07:50:00.219031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235687+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:50:00.235687+0000","last_peered":"2024-09-21T07:50:00.235687+0000","last_clean":"2024-09-21T07:50:00.235687+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:50:00.235687+0000","last_undegraded":"2024-09-21T07:50:00.235687+0000","last_fullsized":"2024-09-21T07:50:00.235687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228617+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:50:00.228617+0000","last_peered":"2024-09-21T07:50:00.228617+0000","last_clean":"2024-09-21T07:50:00.228617+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:50:00.228617+0000","last_undegraded":"2024-09-21T07:50:00.228617+0000","last_fullsized":"2024-09-21T07:50:00.228617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227531+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:50:00.227531+0000","last_peered":"2024-09-21T07:50:00.227531+0000","last_clean":"2024-09-21T07:50:00.227531+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:50:00.227531+0000","last_undegraded":"2024-09-21T07:50:00.227531+0000","last_fullsized":"2024-09-21T07:50:00.227531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210770+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:50:00.210770+0000","last_peered":"2024-09-21T07:50:00.210770+0000","last_clean":"2024-09-21T07:50:00.210770+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:50:00.210770+0000","last_undegraded":"2024-09-21T07:50:00.210770+0000","last_fullsized":"2024-09-21T07:50:00.210770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229015+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:50:00.229015+0000","last_peered":"2024-09-21T07:50:00.229015+0000","last_clean":"2024-09-21T07:50:00.229015+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:50:00.229015+0000","last_undegraded":"2024-09-21T07:50:00.229015+0000","last_fullsized":"2024-09-21T07:50:00.229015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231891+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:50:00.231891+0000","last_peered":"2024-09-21T07:50:00.231891+0000","last_clean":"2024-09-21T07:50:00.231891+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:50:00.231891+0000","last_undegraded":"2024-09-21T07:50:00.231891+0000","last_fullsized":"2024-09-21T07:50:00.231891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235579+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:50:00.235579+0000","last_peered":"2024-09-21T07:50:00.235579+0000","last_clean":"2024-09-21T07:50:00.235579+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:50:00.235579+0000","last_undegraded":"2024-09-21T07:50:00.235579+0000","last_fullsized":"2024-09-21T07:50:00.235579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227718+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:50:00.227718+0000","last_peered":"2024-09-21T07:50:00.227718+0000","last_clean":"2024-09-21T07:50:00.227718+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:50:00.227718+0000","last_undegraded":"2024-09-21T07:50:00.227718+0000","last_fullsized":"2024-09-21T07:50:00.227718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228484+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:50:00.228484+0000","last_peered":"2024-09-21T07:50:00.228484+0000","last_clean":"2024-09-21T07:50:00.228484+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:50:00.228484+0000","last_undegraded":"2024-09-21T07:50:00.228484+0000","last_fullsized":"2024-09-21T07:50:00.228484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223270+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:50:00.223270+0000","last_peered":"2024-09-21T07:50:00.223270+0000","last_clean":"2024-09-21T07:50:00.223270+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:50:00.223270+0000","last_undegraded":"2024-09-21T07:50:00.223270+0000","last_fullsized":"2024-09-21T07:50:00.223270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229604+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:50:00.229604+0000","last_peered":"2024-09-21T07:50:00.229604+0000","last_clean":"2024-09-21T07:50:00.229604+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:50:00.229604+0000","last_undegraded":"2024-09-21T07:50:00.229604+0000","last_fullsized":"2024-09-21T07:50:00.229604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235991+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:50:00.235991+0000","last_peered":"2024-09-21T07:50:00.235991+0000","last_clean":"2024-09-21T07:50:00.235991+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:50:00.235991+0000","last_undegraded":"2024-09-21T07:50:00.235991+0000","last_fullsized":"2024-09-21T07:50:00.235991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210061+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:50:00.210061+0000","last_peered":"2024-09-21T07:50:00.210061+0000","last_clean":"2024-09-21T07:50:00.210061+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:50:00.210061+0000","last_undegraded":"2024-09-21T07:50:00.210061+0000","last_fullsized":"2024-09-21T07:50:00.210061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234725+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:50:00.234725+0000","last_peered":"2024-09-21T07:50:00.234725+0000","last_clean":"2024-09-21T07:50:00.234725+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:50:00.234725+0000","last_undegraded":"2024-09-21T07:50:00.234725+0000","last_fullsized":"2024-09-21T07:50:00.234725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210704+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:50:00.210704+0000","last_peered":"2024-09-21T07:50:00.210704+0000","last_clean":"2024-09-21T07:50:00.210704+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:50:00.210704+0000","last_undegraded":"2024-09-21T07:50:00.210704+0000","last_fullsized":"2024-09-21T07:50:00.210704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233170+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:50:00.233170+0000","last_peered":"2024-09-21T07:50:00.233170+0000","last_clean":"2024-09-21T07:50:00.233170+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:50:00.233170+0000","last_undegraded":"2024-09-21T07:50:00.233170+0000","last_fullsized":"2024-09-21T07:50:00.233170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215521+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:50:00.215521+0000","last_peered":"2024-09-21T07:50:00.215521+0000","last_clean":"2024-09-21T07:50:00.215521+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:50:00.215521+0000","last_undegraded":"2024-09-21T07:50:00.215521+0000","last_fullsized":"2024-09-21T07:50:00.215521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.208038+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:50:00.208038+0000","last_peered":"2024-09-21T07:50:00.208038+0000","last_clean":"2024-09-21T07:50:00.208038+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:50:00.208038+0000","last_undegraded":"2024-09-21T07:50:00.208038+0000","last_fullsized":"2024-09-21T07:50:00.208038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229406+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:50:00.229406+0000","last_peered":"2024-09-21T07:50:00.229406+0000","last_clean":"2024-09-21T07:50:00.229406+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:50:00.229406+0000","last_undegraded":"2024-09-21T07:50:00.229406+0000","last_fullsized":"2024-09-21T07:50:00.229406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230493+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:50:00.230493+0000","last_peered":"2024-09-21T07:50:00.230493+0000","last_clean":"2024-09-21T07:50:00.230493+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:50:00.230493+0000","last_undegraded":"2024-09-21T07:50:00.230493+0000","last_fullsized":"2024-09-21T07:50:00.230493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.220776+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:50:00.220776+0000","last_peered":"2024-09-21T07:50:00.220776+0000","last_clean":"2024-09-21T07:50:00.220776+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:50:00.220776+0000","last_undegraded":"2024-09-21T07:50:00.220776+0000","last_fullsized":"2024-09-21T07:50:00.220776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230134+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:50:00.230134+0000","last_peered":"2024-09-21T07:50:00.230134+0000","last_clean":"2024-09-21T07:50:00.230134+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:50:00.230134+0000","last_undegraded":"2024-09-21T07:50:00.230134+0000","last_fullsized":"2024-09-21T07:50:00.230134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80597,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1242,"num_read_kb":710,"num_write":265,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":241791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":526920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906997,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37036,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708116,"statfs":{"total":95995035648,"available":95957110784,"internally_reserved":0,"allocated":1732608,"data_stored":1185354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070524,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":529764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266754,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":525464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462983,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1646592,"data_stored":1122995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626508,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822737,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1118266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986263,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":520880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":596218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542248,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":595313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":523160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":74863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":74536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:50:38.973 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T07:50:38.973 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.225+0000 7f819bc00640 1 -- 172.21.15.84:0/930054672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819410bf50 msgr2=0x7f8194112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.225+0000 7f819bc00640 1 --2- 172.21.15.84:0/930054672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819410bf50 0x7f8194112780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f818c009ca0 tx=0x7f818c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.226+0000 7f819bc00640 1 -- 172.21.15.84:0/930054672 shutdown_connections 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.226+0000 7f819bc00640 1 --2- 172.21.15.84:0/930054672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819410bf50 0x7f8194112780 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.226+0000 7f819bc00640 1 --2- 172.21.15.84:0/930054672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f819410b600 0x7f819410ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.226+0000 7f819bc00640 1 --2- 172.21.15.84:0/930054672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8194105cd0 0x7f81941060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.226+0000 7f819bc00640 1 -- 172.21.15.84:0/930054672 >> 172.21.15.84:0/930054672 conn(0x7f8194101710 msgr2=0x7f8194103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.226+0000 7f819bc00640 1 -- 172.21.15.84:0/930054672 shutdown_connections 2024-09-21T07:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.226+0000 7f819bc00640 1 -- 172.21.15.84:0/930054672 wait complete. 2024-09-21T07:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 Processor -- start 2024-09-21T07:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 -- start start 2024-09-21T07:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8194105cd0 0x7f819419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819410b600 0x7f819419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f819410bf50 0x7f81941a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8194115c10 con 0x7f8194105cd0 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8194115a90 con 0x7f819410b600 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.227+0000 7f819bc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8194115d90 con 0x7f819410bf50 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8199200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8194105cd0 0x7f819419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819410b600 0x7f819419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8199200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8194105cd0 0x7f819419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50834/0 (socket says 172.21.15.84:50834) 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819410b600 0x7f819419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60590/0 (socket says 172.21.15.84:60590) 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8199200640 1 -- 172.21.15.84:0/3354206283 learned_addr learned my addr 172.21.15.84:0/3354206283 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8199c00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f819410bf50 0x7f81941a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 -- 172.21.15.84:0/3354206283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f819410bf50 msgr2=0x7f81941a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f819410bf50 0x7f81941a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 -- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8194105cd0 msgr2=0x7f819419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8194105cd0 0x7f819419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 -- 172.21.15.84:0/3354206283 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81941a2580 con 0x7f819410b600 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8199200640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8194105cd0 0x7f819419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8193e00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819410b600 0x7f819419cbf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f819406ca00 tx=0x7f818000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.228+0000 7f8191600640 1 -- 172.21.15.84:0/3354206283 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818000cc40 con 0x7f819410b600 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.229+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81941a2870 con 0x7f819410b600 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.229+0000 7f8191600640 1 -- 172.21.15.84:0/3354206283 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f818000cde0 con 0x7f819410b600 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.229+0000 7f8191600640 1 -- 172.21.15.84:0/3354206283 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180018760 con 0x7f819410b600 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.229+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81941a9000 con 0x7f819410b600 2024-09-21T07:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.230+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81941060e0 con 0x7f819410b600 2024-09-21T07:50:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.232+0000 7f8191600640 1 -- 172.21.15.84:0/3354206283 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f8180010a90 con 0x7f819410b600 2024-09-21T07:50:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.234+0000 7f8191600640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f817c0b65e0 0x7f817c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.234+0000 7f8191600640 1 -- 172.21.15.84:0/3354206283 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f81800e7e70 con 0x7f819410b600 2024-09-21T07:50:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.234+0000 7f8199200640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f817c0b65e0 0x7f817c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.235+0000 7f8199200640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f817c0b65e0 0x7f817c0b8af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8188011550 tx=0x7f8188005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.236+0000 7f8191600640 1 -- 172.21.15.84:0/3354206283 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81800b2650 con 0x7f819410b600 2024-09-21T07:50:39.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.420+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8194063800 con 0x7f817c0b65e0 2024-09-21T07:50:39.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.426+0000 7f8191600640 1 -- 172.21.15.84:0/3354206283 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340535 (secure 0 0 0) 0x7f8194063800 con 0x7f817c0b65e0 2024-09-21T07:50:39.432 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:39.434 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f817c0b65e0 msgr2=0x7f817c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f817c0b65e0 0x7f817c0b8af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8188011550 tx=0x7f8188005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819410b600 msgr2=0x7f819419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819410b600 0x7f819419cbf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f819406ca00 tx=0x7f818000ee50 comp rx=0 tx=0).stop 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 shutdown_connections 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f817c0b65e0 0x7f817c0b8af0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f819410bf50 0x7f81941a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f819410b600 0x7f819419cbf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 --2- 172.21.15.84:0/3354206283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8194105cd0 0x7f819419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 >> 172.21.15.84:0/3354206283 conn(0x7f8194101710 msgr2=0x7f819410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 shutdown_connections 2024-09-21T07:50:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:39.431+0000 7f819bc00640 1 -- 172.21.15.84:0/3354206283 wait complete. 2024-09-21T07:50:39.455 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-21T07:50:38.020919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671199,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1323,"num_read_kb":779,"num_write":390,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396744,"kb_used_data":14216,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545080,"statfs":{"total":1151940427776,"available":1151534161920,"internally_reserved":0,"allocated":14557184,"data_stored":8291063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":391492921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6065,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":58,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003550"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:32.108578+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:50:32.108578+0000","last_peered":"2024-09-21T07:50:32.108578+0000","last_clean":"2024-09-21T07:50:32.108578+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:50:32.108578+0000","last_undegraded":"2024-09-21T07:50:32.108578+0000","last_fullsized":"2024-09-21T07:50:32.108578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210401+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:50:00.210401+0000","last_peered":"2024-09-21T07:50:00.210401+0000","last_clean":"2024-09-21T07:50:00.210401+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:50:00.210401+0000","last_undegraded":"2024-09-21T07:50:00.210401+0000","last_fullsized":"2024-09-21T07:50:00.210401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247890+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247890+0000","last_peered":"2024-09-21T07:49:31.247890+0000","last_clean":"2024-09-21T07:49:31.247890+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247890+0000","last_undegraded":"2024-09-21T07:49:31.247890+0000","last_fullsized":"2024-09-21T07:49:31.247890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279185+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279185+0000","last_peered":"2024-09-21T07:49:31.279185+0000","last_clean":"2024-09-21T07:49:31.279185+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279185+0000","last_undegraded":"2024-09-21T07:49:31.279185+0000","last_fullsized":"2024-09-21T07:49:31.279185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230523+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:50:00.230523+0000","last_peered":"2024-09-21T07:50:00.230523+0000","last_clean":"2024-09-21T07:50:00.230523+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:50:00.230523+0000","last_undegraded":"2024-09-21T07:50:00.230523+0000","last_fullsized":"2024-09-21T07:50:00.230523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.280231+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.280231+0000","last_peered":"2024-09-21T07:49:31.280231+0000","last_clean":"2024-09-21T07:49:31.280231+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.280231+0000","last_undegraded":"2024-09-21T07:49:31.280231+0000","last_fullsized":"2024-09-21T07:49:31.280231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162622+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162622+0000","last_peered":"2024-09-21T07:49:31.162622+0000","last_clean":"2024-09-21T07:49:31.162622+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162622+0000","last_undegraded":"2024-09-21T07:49:31.162622+0000","last_fullsized":"2024-09-21T07:49:31.162622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230976+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:50:00.230976+0000","last_peered":"2024-09-21T07:50:00.230976+0000","last_clean":"2024-09-21T07:50:00.230976+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:50:00.230976+0000","last_undegraded":"2024-09-21T07:50:00.230976+0000","last_fullsized":"2024-09-21T07:50:00.230976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162964+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162964+0000","last_peered":"2024-09-21T07:49:31.162964+0000","last_clean":"2024-09-21T07:49:31.162964+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162964+0000","last_undegraded":"2024-09-21T07:49:31.162964+0000","last_fullsized":"2024-09-21T07:49:31.162964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235866+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:50:00.235866+0000","last_peered":"2024-09-21T07:50:00.235866+0000","last_clean":"2024-09-21T07:50:00.235866+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:50:00.235866+0000","last_undegraded":"2024-09-21T07:50:00.235866+0000","last_fullsized":"2024-09-21T07:50:00.235866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162229+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162229+0000","last_peered":"2024-09-21T07:49:31.162229+0000","last_clean":"2024-09-21T07:49:31.162229+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162229+0000","last_undegraded":"2024-09-21T07:49:31.162229+0000","last_fullsized":"2024-09-21T07:49:31.162229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236270+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:50:00.236270+0000","last_peered":"2024-09-21T07:50:00.236270+0000","last_clean":"2024-09-21T07:50:00.236270+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:50:00.236270+0000","last_undegraded":"2024-09-21T07:50:00.236270+0000","last_fullsized":"2024-09-21T07:50:00.236270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162277+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162277+0000","last_peered":"2024-09-21T07:49:31.162277+0000","last_clean":"2024-09-21T07:49:31.162277+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162277+0000","last_undegraded":"2024-09-21T07:49:31.162277+0000","last_fullsized":"2024-09-21T07:49:31.162277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163029+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.163029+0000","last_peered":"2024-09-21T07:49:31.163029+0000","last_clean":"2024-09-21T07:49:31.163029+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.163029+0000","last_undegraded":"2024-09-21T07:49:31.163029+0000","last_fullsized":"2024-09-21T07:49:31.163029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225576+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:50:00.225576+0000","last_peered":"2024-09-21T07:50:00.225576+0000","last_clean":"2024-09-21T07:50:00.225576+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:50:00.225576+0000","last_undegraded":"2024-09-21T07:50:00.225576+0000","last_fullsized":"2024-09-21T07:50:00.225576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247829+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247829+0000","last_peered":"2024-09-21T07:49:31.247829+0000","last_clean":"2024-09-21T07:49:31.247829+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247829+0000","last_undegraded":"2024-09-21T07:49:31.247829+0000","last_fullsized":"2024-09-21T07:49:31.247829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163050+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.163050+0000","last_peered":"2024-09-21T07:49:31.163050+0000","last_clean":"2024-09-21T07:49:31.163050+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.163050+0000","last_undegraded":"2024-09-21T07:49:31.163050+0000","last_fullsized":"2024-09-21T07:49:31.163050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228962+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:50:00.228962+0000","last_peered":"2024-09-21T07:50:00.228962+0000","last_clean":"2024-09-21T07:50:00.228962+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:50:00.228962+0000","last_undegraded":"2024-09-21T07:50:00.228962+0000","last_fullsized":"2024-09-21T07:50:00.228962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278440+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278440+0000","last_peered":"2024-09-21T07:49:31.278440+0000","last_clean":"2024-09-21T07:49:31.278440+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278440+0000","last_undegraded":"2024-09-21T07:49:31.278440+0000","last_fullsized":"2024-09-21T07:49:31.278440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160566+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160566+0000","last_peered":"2024-09-21T07:49:31.160566+0000","last_clean":"2024-09-21T07:49:31.160566+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160566+0000","last_undegraded":"2024-09-21T07:49:31.160566+0000","last_fullsized":"2024-09-21T07:49:31.160566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.182905+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:50:00.182905+0000","last_peered":"2024-09-21T07:50:00.182905+0000","last_clean":"2024-09-21T07:50:00.182905+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:50:00.182905+0000","last_undegraded":"2024-09-21T07:50:00.182905+0000","last_fullsized":"2024-09-21T07:50:00.182905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161028+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.161028+0000","last_peered":"2024-09-21T07:49:31.161028+0000","last_clean":"2024-09-21T07:49:31.161028+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.161028+0000","last_undegraded":"2024-09-21T07:49:31.161028+0000","last_fullsized":"2024-09-21T07:49:31.161028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163163+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163163+0000","last_peered":"2024-09-21T07:49:31.163163+0000","last_clean":"2024-09-21T07:49:31.163163+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163163+0000","last_undegraded":"2024-09-21T07:49:31.163163+0000","last_fullsized":"2024-09-21T07:49:31.163163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228483+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:50:00.228483+0000","last_peered":"2024-09-21T07:50:00.228483+0000","last_clean":"2024-09-21T07:50:00.228483+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:50:00.228483+0000","last_undegraded":"2024-09-21T07:50:00.228483+0000","last_fullsized":"2024-09-21T07:50:00.228483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163371+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163371+0000","last_peered":"2024-09-21T07:49:31.163371+0000","last_clean":"2024-09-21T07:49:31.163371+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163371+0000","last_undegraded":"2024-09-21T07:49:31.163371+0000","last_fullsized":"2024-09-21T07:49:31.163371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247637+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247637+0000","last_peered":"2024-09-21T07:49:31.247637+0000","last_clean":"2024-09-21T07:49:31.247637+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247637+0000","last_undegraded":"2024-09-21T07:49:31.247637+0000","last_fullsized":"2024-09-21T07:49:31.247637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233969+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:50:00.233969+0000","last_peered":"2024-09-21T07:50:00.233969+0000","last_clean":"2024-09-21T07:50:00.233969+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:50:00.233969+0000","last_undegraded":"2024-09-21T07:50:00.233969+0000","last_fullsized":"2024-09-21T07:50:00.233969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'18","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.730803+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:50:00.730803+0000","last_peered":"2024-09-21T07:50:00.730803+0000","last_clean":"2024-09-21T07:50:00.730803+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:50:00.730803+0000","last_undegraded":"2024-09-21T07:50:00.730803+0000","last_fullsized":"2024-09-21T07:50:00.730803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278131+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278131+0000","last_peered":"2024-09-21T07:49:31.278131+0000","last_clean":"2024-09-21T07:49:31.278131+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278131+0000","last_undegraded":"2024-09-21T07:49:31.278131+0000","last_fullsized":"2024-09-21T07:49:31.278131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214205+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:50:00.214205+0000","last_peered":"2024-09-21T07:50:00.214205+0000","last_clean":"2024-09-21T07:50:00.214205+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:50:00.214205+0000","last_undegraded":"2024-09-21T07:50:00.214205+0000","last_fullsized":"2024-09-21T07:50:00.214205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162970+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162970+0000","last_peered":"2024-09-21T07:49:31.162970+0000","last_clean":"2024-09-21T07:49:31.162970+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162970+0000","last_undegraded":"2024-09-21T07:49:31.162970+0000","last_fullsized":"2024-09-21T07:49:31.162970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158456+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158456+0000","last_peered":"2024-09-21T07:49:31.158456+0000","last_clean":"2024-09-21T07:49:31.158456+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158456+0000","last_undegraded":"2024-09-21T07:49:31.158456+0000","last_fullsized":"2024-09-21T07:49:31.158456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212815+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:50:00.212815+0000","last_peered":"2024-09-21T07:50:00.212815+0000","last_clean":"2024-09-21T07:50:00.212815+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:50:00.212815+0000","last_undegraded":"2024-09-21T07:50:00.212815+0000","last_fullsized":"2024-09-21T07:50:00.212815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160485+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160485+0000","last_peered":"2024-09-21T07:49:31.160485+0000","last_clean":"2024-09-21T07:49:31.160485+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160485+0000","last_undegraded":"2024-09-21T07:49:31.160485+0000","last_fullsized":"2024-09-21T07:49:31.160485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162107+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162107+0000","last_peered":"2024-09-21T07:49:31.162107+0000","last_clean":"2024-09-21T07:49:31.162107+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162107+0000","last_undegraded":"2024-09-21T07:49:31.162107+0000","last_fullsized":"2024-09-21T07:49:31.162107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226173+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:50:00.226173+0000","last_peered":"2024-09-21T07:50:00.226173+0000","last_clean":"2024-09-21T07:50:00.226173+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:50:00.226173+0000","last_undegraded":"2024-09-21T07:50:00.226173+0000","last_fullsized":"2024-09-21T07:50:00.226173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:33.346545+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:50:33.346545+0000","last_peered":"2024-09-21T07:50:33.346545+0000","last_clean":"2024-09-21T07:50:33.346545+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:50:33.346545+0000","last_undegraded":"2024-09-21T07:50:33.346545+0000","last_fullsized":"2024-09-21T07:50:33.346545+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":899,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246008+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.246008+0000","last_peered":"2024-09-21T07:49:31.246008+0000","last_clean":"2024-09-21T07:49:31.246008+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.246008+0000","last_undegraded":"2024-09-21T07:49:31.246008+0000","last_fullsized":"2024-09-21T07:49:31.246008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234222+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:50:00.234222+0000","last_peered":"2024-09-21T07:50:00.234222+0000","last_clean":"2024-09-21T07:50:00.234222+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:50:00.234222+0000","last_undegraded":"2024-09-21T07:50:00.234222+0000","last_fullsized":"2024-09-21T07:50:00.234222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:33.345735+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:50:33.345735+0000","last_peered":"2024-09-21T07:50:33.345735+0000","last_clean":"2024-09-21T07:50:33.345735+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:50:33.345735+0000","last_undegraded":"2024-09-21T07:50:33.345735+0000","last_fullsized":"2024-09-21T07:50:33.345735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246470+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246470+0000","last_peered":"2024-09-21T07:49:31.246470+0000","last_clean":"2024-09-21T07:49:31.246470+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246470+0000","last_undegraded":"2024-09-21T07:49:31.246470+0000","last_fullsized":"2024-09-21T07:49:31.246470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215266+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:50:00.215266+0000","last_peered":"2024-09-21T07:50:00.215266+0000","last_clean":"2024-09-21T07:50:00.215266+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:50:00.215266+0000","last_undegraded":"2024-09-21T07:50:00.215266+0000","last_fullsized":"2024-09-21T07:50:00.215266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243292+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243292+0000","last_peered":"2024-09-21T07:49:31.243292+0000","last_clean":"2024-09-21T07:49:31.243292+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243292+0000","last_undegraded":"2024-09-21T07:49:31.243292+0000","last_fullsized":"2024-09-21T07:49:31.243292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247818+0000","last_change":"2024-09-21T07:49:31.247663+0000","last_active":"2024-09-21T07:49:31.247818+0000","last_peered":"2024-09-21T07:49:31.247818+0000","last_clean":"2024-09-21T07:49:31.247818+0000","last_became_active":"2024-09-21T07:49:31.247173+0000","last_became_peered":"2024-09-21T07:49:31.247173+0000","last_unstale":"2024-09-21T07:49:31.247818+0000","last_undegraded":"2024-09-21T07:49:31.247818+0000","last_fullsized":"2024-09-21T07:49:31.247818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:29.114632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229905+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:50:00.229905+0000","last_peered":"2024-09-21T07:50:00.229905+0000","last_clean":"2024-09-21T07:50:00.229905+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:50:00.229905+0000","last_undegraded":"2024-09-21T07:50:00.229905+0000","last_fullsized":"2024-09-21T07:50:00.229905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163025+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.163025+0000","last_peered":"2024-09-21T07:49:31.163025+0000","last_clean":"2024-09-21T07:49:31.163025+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.163025+0000","last_undegraded":"2024-09-21T07:49:31.163025+0000","last_fullsized":"2024-09-21T07:49:31.163025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243589+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243589+0000","last_peered":"2024-09-21T07:49:31.243589+0000","last_clean":"2024-09-21T07:49:31.243589+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243589+0000","last_undegraded":"2024-09-21T07:49:31.243589+0000","last_fullsized":"2024-09-21T07:49:31.243589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236108+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:50:00.236108+0000","last_peered":"2024-09-21T07:50:00.236108+0000","last_clean":"2024-09-21T07:50:00.236108+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:50:00.236108+0000","last_undegraded":"2024-09-21T07:50:00.236108+0000","last_fullsized":"2024-09-21T07:50:00.236108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'7","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:35.349470+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:50:35.349470+0000","last_peered":"2024-09-21T07:50:35.349470+0000","last_clean":"2024-09-21T07:50:35.349470+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:50:35.349470+0000","last_undegraded":"2024-09-21T07:50:35.349470+0000","last_fullsized":"2024-09-21T07:50:35.349470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161230+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161230+0000","last_peered":"2024-09-21T07:49:31.161230+0000","last_clean":"2024-09-21T07:49:31.161230+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161230+0000","last_undegraded":"2024-09-21T07:49:31.161230+0000","last_fullsized":"2024-09-21T07:49:31.161230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233772+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:50:00.233772+0000","last_peered":"2024-09-21T07:50:00.233772+0000","last_clean":"2024-09-21T07:50:00.233772+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:50:00.233772+0000","last_undegraded":"2024-09-21T07:50:00.233772+0000","last_fullsized":"2024-09-21T07:50:00.233772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248809+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:49:31.248809+0000","last_peered":"2024-09-21T07:49:31.248809+0000","last_clean":"2024-09-21T07:49:31.248809+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:49:31.248809+0000","last_undegraded":"2024-09-21T07:49:31.248809+0000","last_fullsized":"2024-09-21T07:49:31.248809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278758+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278758+0000","last_peered":"2024-09-21T07:49:31.278758+0000","last_clean":"2024-09-21T07:49:31.278758+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278758+0000","last_undegraded":"2024-09-21T07:49:31.278758+0000","last_fullsized":"2024-09-21T07:49:31.278758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231353+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:50:00.231353+0000","last_peered":"2024-09-21T07:50:00.231353+0000","last_clean":"2024-09-21T07:50:00.231353+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:50:00.231353+0000","last_undegraded":"2024-09-21T07:50:00.231353+0000","last_fullsized":"2024-09-21T07:50:00.231353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246326+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246326+0000","last_peered":"2024-09-21T07:49:31.246326+0000","last_clean":"2024-09-21T07:49:31.246326+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246326+0000","last_undegraded":"2024-09-21T07:49:31.246326+0000","last_fullsized":"2024-09-21T07:49:31.246326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246901+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246901+0000","last_peered":"2024-09-21T07:49:31.246901+0000","last_clean":"2024-09-21T07:49:31.246901+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246901+0000","last_undegraded":"2024-09-21T07:49:31.246901+0000","last_fullsized":"2024-09-21T07:49:31.246901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228801+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:50:00.228801+0000","last_peered":"2024-09-21T07:50:00.228801+0000","last_clean":"2024-09-21T07:50:00.228801+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:50:00.228801+0000","last_undegraded":"2024-09-21T07:50:00.228801+0000","last_fullsized":"2024-09-21T07:50:00.228801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162830+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162830+0000","last_peered":"2024-09-21T07:49:31.162830+0000","last_clean":"2024-09-21T07:49:31.162830+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162830+0000","last_undegraded":"2024-09-21T07:49:31.162830+0000","last_fullsized":"2024-09-21T07:49:31.162830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246921+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246921+0000","last_peered":"2024-09-21T07:49:31.246921+0000","last_clean":"2024-09-21T07:49:31.246921+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246921+0000","last_undegraded":"2024-09-21T07:49:31.246921+0000","last_fullsized":"2024-09-21T07:49:31.246921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235805+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:50:00.235805+0000","last_peered":"2024-09-21T07:50:00.235805+0000","last_clean":"2024-09-21T07:50:00.235805+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:50:00.235805+0000","last_undegraded":"2024-09-21T07:50:00.235805+0000","last_fullsized":"2024-09-21T07:50:00.235805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162058+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.162058+0000","last_peered":"2024-09-21T07:49:31.162058+0000","last_clean":"2024-09-21T07:49:31.162058+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.162058+0000","last_undegraded":"2024-09-21T07:49:31.162058+0000","last_fullsized":"2024-09-21T07:49:31.162058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246203+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246203+0000","last_peered":"2024-09-21T07:49:31.246203+0000","last_clean":"2024-09-21T07:49:31.246203+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246203+0000","last_undegraded":"2024-09-21T07:49:31.246203+0000","last_fullsized":"2024-09-21T07:49:31.246203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225861+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:50:00.225861+0000","last_peered":"2024-09-21T07:50:00.225861+0000","last_clean":"2024-09-21T07:50:00.225861+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:50:00.225861+0000","last_undegraded":"2024-09-21T07:50:00.225861+0000","last_fullsized":"2024-09-21T07:50:00.225861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:32.344719+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:50:32.344719+0000","last_peered":"2024-09-21T07:50:32.344719+0000","last_clean":"2024-09-21T07:50:32.344719+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:50:32.344719+0000","last_undegraded":"2024-09-21T07:50:32.344719+0000","last_fullsized":"2024-09-21T07:50:32.344719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226537+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:50:00.226537+0000","last_peered":"2024-09-21T07:50:00.226537+0000","last_clean":"2024-09-21T07:50:00.226537+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:50:00.226537+0000","last_undegraded":"2024-09-21T07:50:00.226537+0000","last_fullsized":"2024-09-21T07:50:00.226537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247713+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247713+0000","last_peered":"2024-09-21T07:49:31.247713+0000","last_clean":"2024-09-21T07:49:31.247713+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247713+0000","last_undegraded":"2024-09-21T07:49:31.247713+0000","last_fullsized":"2024-09-21T07:49:31.247713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158454+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158454+0000","last_peered":"2024-09-21T07:49:31.158454+0000","last_clean":"2024-09-21T07:49:31.158454+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158454+0000","last_undegraded":"2024-09-21T07:49:31.158454+0000","last_fullsized":"2024-09-21T07:49:31.158454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.213866+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:50:00.213866+0000","last_peered":"2024-09-21T07:50:00.213866+0000","last_clean":"2024-09-21T07:50:00.213866+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:50:00.213866+0000","last_undegraded":"2024-09-21T07:50:00.213866+0000","last_fullsized":"2024-09-21T07:50:00.213866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158337+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158337+0000","last_peered":"2024-09-21T07:49:31.158337+0000","last_clean":"2024-09-21T07:49:31.158337+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158337+0000","last_undegraded":"2024-09-21T07:49:31.158337+0000","last_fullsized":"2024-09-21T07:49:31.158337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248339+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248339+0000","last_peered":"2024-09-21T07:49:31.248339+0000","last_clean":"2024-09-21T07:49:31.248339+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248339+0000","last_undegraded":"2024-09-21T07:49:31.248339+0000","last_fullsized":"2024-09-21T07:49:31.248339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.224994+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:50:00.224994+0000","last_peered":"2024-09-21T07:50:00.224994+0000","last_clean":"2024-09-21T07:50:00.224994+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:50:00.224994+0000","last_undegraded":"2024-09-21T07:50:00.224994+0000","last_fullsized":"2024-09-21T07:50:00.224994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'40","reported_seq":336,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:34.348021+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:50:34.348021+0000","last_peered":"2024-09-21T07:50:34.348021+0000","last_clean":"2024-09-21T07:50:34.348021+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:50:34.348021+0000","last_undegraded":"2024-09-21T07:50:34.348021+0000","last_fullsized":"2024-09-21T07:50:34.348021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":197,"num_write":42,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159921+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159921+0000","last_peered":"2024-09-21T07:49:31.159921+0000","last_clean":"2024-09-21T07:49:31.159921+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159921+0000","last_undegraded":"2024-09-21T07:49:31.159921+0000","last_fullsized":"2024-09-21T07:49:31.159921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236544+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:50:00.236544+0000","last_peered":"2024-09-21T07:50:00.236544+0000","last_clean":"2024-09-21T07:50:00.236544+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:50:00.236544+0000","last_undegraded":"2024-09-21T07:50:00.236544+0000","last_fullsized":"2024-09-21T07:50:00.236544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248679+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248679+0000","last_peered":"2024-09-21T07:49:31.248679+0000","last_clean":"2024-09-21T07:49:31.248679+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248679+0000","last_undegraded":"2024-09-21T07:49:31.248679+0000","last_fullsized":"2024-09-21T07:49:31.248679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162313+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162313+0000","last_peered":"2024-09-21T07:49:31.162313+0000","last_clean":"2024-09-21T07:49:31.162313+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162313+0000","last_undegraded":"2024-09-21T07:49:31.162313+0000","last_fullsized":"2024-09-21T07:49:31.162313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227866+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:50:00.227866+0000","last_peered":"2024-09-21T07:50:00.227866+0000","last_clean":"2024-09-21T07:50:00.227866+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:50:00.227866+0000","last_undegraded":"2024-09-21T07:50:00.227866+0000","last_fullsized":"2024-09-21T07:50:00.227866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244633+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244633+0000","last_peered":"2024-09-21T07:49:31.244633+0000","last_clean":"2024-09-21T07:49:31.244633+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244633+0000","last_undegraded":"2024-09-21T07:49:31.244633+0000","last_fullsized":"2024-09-21T07:49:31.244633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159785+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159785+0000","last_peered":"2024-09-21T07:49:31.159785+0000","last_clean":"2024-09-21T07:49:31.159785+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159785+0000","last_undegraded":"2024-09-21T07:49:31.159785+0000","last_fullsized":"2024-09-21T07:49:31.159785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231446+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:50:00.231446+0000","last_peered":"2024-09-21T07:50:00.231446+0000","last_clean":"2024-09-21T07:50:00.231446+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:50:00.231446+0000","last_undegraded":"2024-09-21T07:50:00.231446+0000","last_fullsized":"2024-09-21T07:50:00.231446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":292,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:34.347341+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:50:34.347341+0000","last_peered":"2024-09-21T07:50:34.347341+0000","last_clean":"2024-09-21T07:50:34.347341+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:50:34.347341+0000","last_undegraded":"2024-09-21T07:50:34.347341+0000","last_fullsized":"2024-09-21T07:50:34.347341+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277894+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277894+0000","last_peered":"2024-09-21T07:49:31.277894+0000","last_clean":"2024-09-21T07:49:31.277894+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277894+0000","last_undegraded":"2024-09-21T07:49:31.277894+0000","last_fullsized":"2024-09-21T07:49:31.277894+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278984+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278984+0000","last_peered":"2024-09-21T07:49:31.278984+0000","last_clean":"2024-09-21T07:49:31.278984+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278984+0000","last_undegraded":"2024-09-21T07:49:31.278984+0000","last_fullsized":"2024-09-21T07:49:31.278984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225224+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:50:00.225224+0000","last_peered":"2024-09-21T07:50:00.225224+0000","last_clean":"2024-09-21T07:50:00.225224+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:50:00.225224+0000","last_undegraded":"2024-09-21T07:50:00.225224+0000","last_fullsized":"2024-09-21T07:50:00.225224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247909+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247909+0000","last_peered":"2024-09-21T07:49:31.247909+0000","last_clean":"2024-09-21T07:49:31.247909+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247909+0000","last_undegraded":"2024-09-21T07:49:31.247909+0000","last_fullsized":"2024-09-21T07:49:31.247909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158882+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158882+0000","last_peered":"2024-09-21T07:49:31.158882+0000","last_clean":"2024-09-21T07:49:31.158882+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158882+0000","last_undegraded":"2024-09-21T07:49:31.158882+0000","last_fullsized":"2024-09-21T07:49:31.158882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226888+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:50:00.226888+0000","last_peered":"2024-09-21T07:50:00.226888+0000","last_clean":"2024-09-21T07:50:00.226888+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:50:00.226888+0000","last_undegraded":"2024-09-21T07:50:00.226888+0000","last_fullsized":"2024-09-21T07:50:00.226888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245823+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245823+0000","last_peered":"2024-09-21T07:49:31.245823+0000","last_clean":"2024-09-21T07:49:31.245823+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245823+0000","last_undegraded":"2024-09-21T07:49:31.245823+0000","last_fullsized":"2024-09-21T07:49:31.245823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243596+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243596+0000","last_peered":"2024-09-21T07:49:31.243596+0000","last_clean":"2024-09-21T07:49:31.243596+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243596+0000","last_undegraded":"2024-09-21T07:49:31.243596+0000","last_fullsized":"2024-09-21T07:49:31.243596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234552+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:50:00.234552+0000","last_peered":"2024-09-21T07:50:00.234552+0000","last_clean":"2024-09-21T07:50:00.234552+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:50:00.234552+0000","last_undegraded":"2024-09-21T07:50:00.234552+0000","last_fullsized":"2024-09-21T07:50:00.234552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248127+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248127+0000","last_peered":"2024-09-21T07:49:31.248127+0000","last_clean":"2024-09-21T07:49:31.248127+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248127+0000","last_undegraded":"2024-09-21T07:49:31.248127+0000","last_fullsized":"2024-09-21T07:49:31.248127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:31.343208+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:50:31.343208+0000","last_peered":"2024-09-21T07:50:31.343208+0000","last_clean":"2024-09-21T07:50:31.343208+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:50:31.343208+0000","last_undegraded":"2024-09-21T07:50:31.343208+0000","last_fullsized":"2024-09-21T07:50:31.343208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212530+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:50:00.212530+0000","last_peered":"2024-09-21T07:50:00.212530+0000","last_clean":"2024-09-21T07:50:00.212530+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:50:00.212530+0000","last_undegraded":"2024-09-21T07:50:00.212530+0000","last_fullsized":"2024-09-21T07:50:00.212530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248474+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248474+0000","last_peered":"2024-09-21T07:49:31.248474+0000","last_clean":"2024-09-21T07:49:31.248474+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248474+0000","last_undegraded":"2024-09-21T07:49:31.248474+0000","last_fullsized":"2024-09-21T07:49:31.248474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229653+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:50:00.229653+0000","last_peered":"2024-09-21T07:50:00.229653+0000","last_clean":"2024-09-21T07:50:00.229653+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:50:00.229653+0000","last_undegraded":"2024-09-21T07:50:00.229653+0000","last_fullsized":"2024-09-21T07:50:00.229653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214497+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:50:00.214497+0000","last_peered":"2024-09-21T07:50:00.214497+0000","last_clean":"2024-09-21T07:50:00.214497+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:50:00.214497+0000","last_undegraded":"2024-09-21T07:50:00.214497+0000","last_fullsized":"2024-09-21T07:50:00.214497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227306+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:50:00.227306+0000","last_peered":"2024-09-21T07:50:00.227306+0000","last_clean":"2024-09-21T07:50:00.227306+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:50:00.227306+0000","last_undegraded":"2024-09-21T07:50:00.227306+0000","last_fullsized":"2024-09-21T07:50:00.227306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227334+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:50:00.227334+0000","last_peered":"2024-09-21T07:50:00.227334+0000","last_clean":"2024-09-21T07:50:00.227334+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:50:00.227334+0000","last_undegraded":"2024-09-21T07:50:00.227334+0000","last_fullsized":"2024-09-21T07:50:00.227334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227942+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:50:00.227942+0000","last_peered":"2024-09-21T07:50:00.227942+0000","last_clean":"2024-09-21T07:50:00.227942+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:50:00.227942+0000","last_undegraded":"2024-09-21T07:50:00.227942+0000","last_fullsized":"2024-09-21T07:50:00.227942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228389+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:50:00.228389+0000","last_peered":"2024-09-21T07:50:00.228389+0000","last_clean":"2024-09-21T07:50:00.228389+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:50:00.228389+0000","last_undegraded":"2024-09-21T07:50:00.228389+0000","last_fullsized":"2024-09-21T07:50:00.228389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223482+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:50:00.223482+0000","last_peered":"2024-09-21T07:50:00.223482+0000","last_clean":"2024-09-21T07:50:00.223482+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:50:00.223482+0000","last_undegraded":"2024-09-21T07:50:00.223482+0000","last_fullsized":"2024-09-21T07:50:00.223482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.202426+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:50:00.202426+0000","last_peered":"2024-09-21T07:50:00.202426+0000","last_clean":"2024-09-21T07:50:00.202426+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:50:00.202426+0000","last_undegraded":"2024-09-21T07:50:00.202426+0000","last_fullsized":"2024-09-21T07:50:00.202426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228634+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:50:00.228634+0000","last_peered":"2024-09-21T07:50:00.228634+0000","last_clean":"2024-09-21T07:50:00.228634+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:50:00.228634+0000","last_undegraded":"2024-09-21T07:50:00.228634+0000","last_fullsized":"2024-09-21T07:50:00.228634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.219031+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:50:00.219031+0000","last_peered":"2024-09-21T07:50:00.219031+0000","last_clean":"2024-09-21T07:50:00.219031+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:50:00.219031+0000","last_undegraded":"2024-09-21T07:50:00.219031+0000","last_fullsized":"2024-09-21T07:50:00.219031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235687+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:50:00.235687+0000","last_peered":"2024-09-21T07:50:00.235687+0000","last_clean":"2024-09-21T07:50:00.235687+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:50:00.235687+0000","last_undegraded":"2024-09-21T07:50:00.235687+0000","last_fullsized":"2024-09-21T07:50:00.235687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228617+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:50:00.228617+0000","last_peered":"2024-09-21T07:50:00.228617+0000","last_clean":"2024-09-21T07:50:00.228617+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:50:00.228617+0000","last_undegraded":"2024-09-21T07:50:00.228617+0000","last_fullsized":"2024-09-21T07:50:00.228617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227531+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:50:00.227531+0000","last_peered":"2024-09-21T07:50:00.227531+0000","last_clean":"2024-09-21T07:50:00.227531+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:50:00.227531+0000","last_undegraded":"2024-09-21T07:50:00.227531+0000","last_fullsized":"2024-09-21T07:50:00.227531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210770+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:50:00.210770+0000","last_peered":"2024-09-21T07:50:00.210770+0000","last_clean":"2024-09-21T07:50:00.210770+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:50:00.210770+0000","last_undegraded":"2024-09-21T07:50:00.210770+0000","last_fullsized":"2024-09-21T07:50:00.210770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229015+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:50:00.229015+0000","last_peered":"2024-09-21T07:50:00.229015+0000","last_clean":"2024-09-21T07:50:00.229015+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:50:00.229015+0000","last_undegraded":"2024-09-21T07:50:00.229015+0000","last_fullsized":"2024-09-21T07:50:00.229015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231891+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:50:00.231891+0000","last_peered":"2024-09-21T07:50:00.231891+0000","last_clean":"2024-09-21T07:50:00.231891+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:50:00.231891+0000","last_undegraded":"2024-09-21T07:50:00.231891+0000","last_fullsized":"2024-09-21T07:50:00.231891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235579+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:50:00.235579+0000","last_peered":"2024-09-21T07:50:00.235579+0000","last_clean":"2024-09-21T07:50:00.235579+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:50:00.235579+0000","last_undegraded":"2024-09-21T07:50:00.235579+0000","last_fullsized":"2024-09-21T07:50:00.235579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227718+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:50:00.227718+0000","last_peered":"2024-09-21T07:50:00.227718+0000","last_clean":"2024-09-21T07:50:00.227718+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:50:00.227718+0000","last_undegraded":"2024-09-21T07:50:00.227718+0000","last_fullsized":"2024-09-21T07:50:00.227718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228484+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:50:00.228484+0000","last_peered":"2024-09-21T07:50:00.228484+0000","last_clean":"2024-09-21T07:50:00.228484+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:50:00.228484+0000","last_undegraded":"2024-09-21T07:50:00.228484+0000","last_fullsized":"2024-09-21T07:50:00.228484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223270+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:50:00.223270+0000","last_peered":"2024-09-21T07:50:00.223270+0000","last_clean":"2024-09-21T07:50:00.223270+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:50:00.223270+0000","last_undegraded":"2024-09-21T07:50:00.223270+0000","last_fullsized":"2024-09-21T07:50:00.223270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229604+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:50:00.229604+0000","last_peered":"2024-09-21T07:50:00.229604+0000","last_clean":"2024-09-21T07:50:00.229604+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:50:00.229604+0000","last_undegraded":"2024-09-21T07:50:00.229604+0000","last_fullsized":"2024-09-21T07:50:00.229604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235991+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:50:00.235991+0000","last_peered":"2024-09-21T07:50:00.235991+0000","last_clean":"2024-09-21T07:50:00.235991+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:50:00.235991+0000","last_undegraded":"2024-09-21T07:50:00.235991+0000","last_fullsized":"2024-09-21T07:50:00.235991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210061+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:50:00.210061+0000","last_peered":"2024-09-21T07:50:00.210061+0000","last_clean":"2024-09-21T07:50:00.210061+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:50:00.210061+0000","last_undegraded":"2024-09-21T07:50:00.210061+0000","last_fullsized":"2024-09-21T07:50:00.210061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234725+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:50:00.234725+0000","last_peered":"2024-09-21T07:50:00.234725+0000","last_clean":"2024-09-21T07:50:00.234725+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:50:00.234725+0000","last_undegraded":"2024-09-21T07:50:00.234725+0000","last_fullsized":"2024-09-21T07:50:00.234725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210704+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:50:00.210704+0000","last_peered":"2024-09-21T07:50:00.210704+0000","last_clean":"2024-09-21T07:50:00.210704+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:50:00.210704+0000","last_undegraded":"2024-09-21T07:50:00.210704+0000","last_fullsized":"2024-09-21T07:50:00.210704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233170+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:50:00.233170+0000","last_peered":"2024-09-21T07:50:00.233170+0000","last_clean":"2024-09-21T07:50:00.233170+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:50:00.233170+0000","last_undegraded":"2024-09-21T07:50:00.233170+0000","last_fullsized":"2024-09-21T07:50:00.233170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215521+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:50:00.215521+0000","last_peered":"2024-09-21T07:50:00.215521+0000","last_clean":"2024-09-21T07:50:00.215521+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:50:00.215521+0000","last_undegraded":"2024-09-21T07:50:00.215521+0000","last_fullsized":"2024-09-21T07:50:00.215521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.208038+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:50:00.208038+0000","last_peered":"2024-09-21T07:50:00.208038+0000","last_clean":"2024-09-21T07:50:00.208038+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:50:00.208038+0000","last_undegraded":"2024-09-21T07:50:00.208038+0000","last_fullsized":"2024-09-21T07:50:00.208038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229406+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:50:00.229406+0000","last_peered":"2024-09-21T07:50:00.229406+0000","last_clean":"2024-09-21T07:50:00.229406+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:50:00.229406+0000","last_undegraded":"2024-09-21T07:50:00.229406+0000","last_fullsized":"2024-09-21T07:50:00.229406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230493+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:50:00.230493+0000","last_peered":"2024-09-21T07:50:00.230493+0000","last_clean":"2024-09-21T07:50:00.230493+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:50:00.230493+0000","last_undegraded":"2024-09-21T07:50:00.230493+0000","last_fullsized":"2024-09-21T07:50:00.230493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.220776+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:50:00.220776+0000","last_peered":"2024-09-21T07:50:00.220776+0000","last_clean":"2024-09-21T07:50:00.220776+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:50:00.220776+0000","last_undegraded":"2024-09-21T07:50:00.220776+0000","last_fullsized":"2024-09-21T07:50:00.220776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230134+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:50:00.230134+0000","last_peered":"2024-09-21T07:50:00.230134+0000","last_clean":"2024-09-21T07:50:00.230134+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:50:00.230134+0000","last_undegraded":"2024-09-21T07:50:00.230134+0000","last_fullsized":"2024-09-21T07:50:00.230134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80597,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1242,"num_read_kb":710,"num_write":265,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":241791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":526920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906997,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37036,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708116,"statfs":{"total":95995035648,"available":95957110784,"internally_reserved":0,"allocated":1732608,"data_stored":1185354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070524,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":529764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266754,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":525464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462983,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1646592,"data_stored":1122995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626508,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822737,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1118266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986263,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":520880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":596218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542248,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":595313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":523160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":74863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":74536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:50:39.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:50:39.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:39 smithi162 ceph-mon[34833]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:39.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:39 smithi162 ceph-mon[34833]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:39.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:39 smithi191 ceph-mon[34667]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:39.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:39 smithi191 ceph-mon[34667]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:39.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:39 smithi084 ceph-mon[30411]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:39.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:39 smithi084 ceph-mon[30411]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:40.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:40 smithi084 ceph-mon[30411]: from='client.25472 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:40.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:40 smithi084 ceph-mon[30411]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 -- 172.21.15.84:0/213831359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 msgr2=0x7fecbc103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 --2- 172.21.15.84:0/213831359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc103f90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fecac009900 tx=0x7fecac02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 -- 172.21.15.84:0/213831359 shutdown_connections 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 --2- 172.21.15.84:0/213831359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecbc109e10 0x7fecbc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 --2- 172.21.15.84:0/213831359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecbc1094c0 0x7fecbc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 --2- 172.21.15.84:0/213831359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc103f90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 -- 172.21.15.84:0/213831359 >> 172.21.15.84:0/213831359 conn(0x7fecbc0ff5d0 msgr2=0x7fecbc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 -- 172.21.15.84:0/213831359 shutdown_connections 2024-09-21T07:50:40.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.642+0000 7fecc3400640 1 -- 172.21.15.84:0/213831359 wait complete. 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.643+0000 7fecc3400640 1 Processor -- start 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.643+0000 7fecc3400640 1 -- start start 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.643+0000 7fecc3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.643+0000 7fecc3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecbc1094c0 0x7fecbc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.643+0000 7fecc3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecbc109e10 0x7fecbc1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.643+0000 7fecc3400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc113b20 con 0x7fecbc103b80 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.643+0000 7fecc3400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc1139a0 con 0x7fecbc1094c0 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc3400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc113ca0 con 0x7fecbc109e10 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc19c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50842/0 (socket says 172.21.15.84:50842) 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 -- 172.21.15.84:0/765671545 learned_addr learned my addr 172.21.15.84:0/765671545 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecb3e00640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecbc1094c0 0x7fecbc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc1400640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecbc109e10 0x7fecbc1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 -- 172.21.15.84:0/765671545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecbc109e10 msgr2=0x7fecbc1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecbc109e10 0x7fecbc1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 -- 172.21.15.84:0/765671545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecbc1094c0 msgr2=0x7fecbc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecbc1094c0 0x7fecbc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.644+0000 7fecc0a00640 1 -- 172.21.15.84:0/765671545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc1a2660 con 0x7fecbc103b80 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.645+0000 7fecc0a00640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc19c6f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fecac005ab0 tx=0x7fecac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.645+0000 7fecba000640 1 -- 172.21.15.84:0/765671545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac03f070 con 0x7fecbc103b80 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.645+0000 7fecba000640 1 -- 172.21.15.84:0/765671545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecac031b60 con 0x7fecbc103b80 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.645+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecbc1a28f0 con 0x7fecbc103b80 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.645+0000 7fecba000640 1 -- 172.21.15.84:0/765671545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac035030 con 0x7fecbc103b80 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.645+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecbc1a90b0 con 0x7fecbc103b80 2024-09-21T07:50:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.646+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecbc103f90 con 0x7fecbc103b80 2024-09-21T07:50:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.649+0000 7fecba000640 1 -- 172.21.15.84:0/765671545 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fecac042070 con 0x7fecbc103b80 2024-09-21T07:50:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.651+0000 7fecba000640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feca00b6560 0x7feca00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.652+0000 7fecba000640 1 -- 172.21.15.84:0/765671545 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fecac1086b0 con 0x7fecbc103b80 2024-09-21T07:50:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.652+0000 7fecb3e00640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feca00b6560 0x7feca00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.652+0000 7fecb3e00640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feca00b6560 0x7feca00b8a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fecbc107df0 tx=0x7feca4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.654+0000 7fecba000640 1 -- 172.21.15.84:0/765671545 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fecac0d2e90 con 0x7fecbc103b80 2024-09-21T07:50:40.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:40 smithi162 ceph-mon[34833]: from='client.25472 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:40.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:40 smithi162 ceph-mon[34833]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T07:50:40.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.879+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecbc1a9310 con 0x7fecbc103b80 2024-09-21T07:50:40.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.880+0000 7fecba000640 1 -- 172.21.15.84:0/765671545 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fecac0d7dd0 con 0x7fecbc103b80 2024-09-21T07:50:40.882 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:40.882 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:50:40.882 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feca00b6560 msgr2=0x7feca00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feca00b6560 0x7feca00b8a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fecbc107df0 tx=0x7feca4005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 msgr2=0x7fecbc19c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc19c6f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fecac005ab0 tx=0x7fecac003c10 comp rx=0 tx=0).stop 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 shutdown_connections 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feca00b6560 0x7feca00b8a70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecbc109e10 0x7fecbc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecbc1094c0 0x7fecbc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 --2- 172.21.15.84:0/765671545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecbc103b80 0x7fecbc19c6f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 >> 172.21.15.84:0/765671545 conn(0x7fecbc0ff5d0 msgr2=0x7fecbc108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 shutdown_connections 2024-09-21T07:50:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:40.883+0000 7fecc3400640 1 -- 172.21.15.84:0/765671545 wait complete. 2024-09-21T07:50:40.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:40 smithi191 ceph-mon[34667]: from='client.25472 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:40.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:40 smithi191 ceph-mon[34667]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T07:50:41.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:50:41.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:41 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/765671545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:41.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:41 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/765671545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:41.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:41 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/765671545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:42.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 -- 172.21.15.84:0/1860237000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 msgr2=0x7fa6f8114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:42.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 --2- 172.21.15.84:0/1860237000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 0x7fa6f8114200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009900 tx=0x7fa6e402a410 comp rx=0 tx=0).stop 2024-09-21T07:50:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 -- 172.21.15.84:0/1860237000 shutdown_connections 2024-09-21T07:50:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 --2- 172.21.15.84:0/1860237000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8114740 0x7fa6f8116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 --2- 172.21.15.84:0/1860237000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 0x7fa6f8114200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 --2- 172.21.15.84:0/1860237000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8077940 0x7fa6f8077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 -- 172.21.15.84:0/1860237000 >> 172.21.15.84:0/1860237000 conn(0x7fa6f8101810 msgr2=0x7fa6f8103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 -- 172.21.15.84:0/1860237000 shutdown_connections 2024-09-21T07:50:42.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.654+0000 7fa700000640 1 -- 172.21.15.84:0/1860237000 wait complete. 2024-09-21T07:50:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.655+0000 7fa700000640 1 Processor -- start 2024-09-21T07:50:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.655+0000 7fa700000640 1 -- start start 2024-09-21T07:50:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa700000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8077940 0x7fa6f81a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa700000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 0x7fa6f81a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa700000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8114740 0x7fa6f81a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa700000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f811a080 con 0x7fa6f8078290 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa700000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8119f00 con 0x7fa6f8077940 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa700000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f811a200 con 0x7fa6f8114740 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa6fcc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 0x7fa6f81a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa6fd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8077940 0x7fa6f81a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa6fd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8077940 0x7fa6f81a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60618/0 (socket says 172.21.15.84:60618) 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa6fd600640 1 -- 172.21.15.84:0/355725334 learned_addr learned my addr 172.21.15.84:0/355725334 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.656+0000 7fa6fe000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8114740 0x7fa6f81a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6fd600640 1 -- 172.21.15.84:0/355725334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8114740 msgr2=0x7fa6f81a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6fd600640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8114740 0x7fa6f81a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6fd600640 1 -- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 msgr2=0x7fa6f81a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6fd600640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 0x7fa6f81a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6fd600640 1 -- 172.21.15.84:0/355725334 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f81a6aa0 con 0x7fa6f8077940 2024-09-21T07:50:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6fd600640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8077940 0x7fa6f81a0b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e9f0 tx=0x7fa6ec00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6f6000640 1 -- 172.21.15.84:0/355725334 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00cd80 con 0x7fa6f8077940 2024-09-21T07:50:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6f6000640 1 -- 172.21.15.84:0/355725334 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6ec0054d0 con 0x7fa6f8077940 2024-09-21T07:50:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f81a6d90 con 0x7fa6f8077940 2024-09-21T07:50:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa6f6000640 1 -- 172.21.15.84:0/355725334 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec010690 con 0x7fa6f8077940 2024-09-21T07:50:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.657+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f81ad4f0 con 0x7fa6f8077940 2024-09-21T07:50:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.658+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f8077d50 con 0x7fa6f8077940 2024-09-21T07:50:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.661+0000 7fa6f6000640 1 -- 172.21.15.84:0/355725334 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fa6ec004e30 con 0x7fa6f8077940 2024-09-21T07:50:42.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.662+0000 7fa6f6000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6e00b6560 0x7fa6e00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:42.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.662+0000 7fa6f6000640 1 -- 172.21.15.84:0/355725334 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa6ec0e7db0 con 0x7fa6f8077940 2024-09-21T07:50:42.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.662+0000 7fa6fcc00640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6e00b6560 0x7fa6e00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:42.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.663+0000 7fa6fcc00640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6e00b6560 0x7fa6e00b8a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009230 tx=0x7fa6e4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:42.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.664+0000 7fa6f6000640 1 -- 172.21.15.84:0/355725334 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6ec0ae1b0 con 0x7fa6f8077940 2024-09-21T07:50:42.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:42 smithi162 ceph-mon[34833]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T07:50:42.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:42 smithi084 ceph-mon[30411]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T07:50:42.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.855+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6f81a1c60 con 0x7fa6f8077940 2024-09-21T07:50:42.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.857+0000 7fa6f6000640 1 -- 172.21.15.84:0/355725334 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+25144 (secure 0 0 0) 0x7fa6f81a1c60 con 0x7fa6f8077940 2024-09-21T07:50:42.860 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:42.860 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:49:31.146906+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:50:42.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6e00b6560 msgr2=0x7fa6e00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:42.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6e00b6560 0x7fa6e00b8a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009230 tx=0x7fa6e4031400 comp rx=0 tx=0).stop 2024-09-21T07:50:42.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8077940 msgr2=0x7fa6f81a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8077940 0x7fa6f81a0b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e9f0 tx=0x7fa6ec00edf0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 shutdown_connections 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa6e00b6560 0x7fa6e00b8a70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8114740 0x7fa6f81a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6f8078290 0x7fa6f81a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 --2- 172.21.15.84:0/355725334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f8077940 0x7fa6f81a0b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 >> 172.21.15.84:0/355725334 conn(0x7fa6f8101810 msgr2=0x7fa6f81167f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.860+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 shutdown_connections 2024-09-21T07:50:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:42.861+0000 7fa700000640 1 -- 172.21.15.84:0/355725334 wait complete. 2024-09-21T07:50:42.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:42 smithi191 ceph-mon[34667]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T07:50:43.695 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T07:50:43.696 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T07:50:43.705 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:50:43.705 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T07:50:43.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T07:50:43.705 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T07:50:43.706 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:50:43.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:50:43.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:43 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/355725334' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:43.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:43 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/355725334' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:43.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:43 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/355725334' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 -- 172.21.15.84:0/1032696963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8103910 msgr2=0x7f73f8103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 --2- 172.21.15.84:0/1032696963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8103910 0x7f73f8103d20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009900 tx=0x7f73e802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 -- 172.21.15.84:0/1032696963 shutdown_connections 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 --2- 172.21.15.84:0/1032696963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109b90 0x7f73f81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 --2- 172.21.15.84:0/1032696963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73f8109240 0x7f73f8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 --2- 172.21.15.84:0/1032696963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8103910 0x7f73f8103d20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 -- 172.21.15.84:0/1032696963 >> 172.21.15.84:0/1032696963 conn(0x7f73f80ff330 msgr2=0x7f73f8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 -- 172.21.15.84:0/1032696963 shutdown_connections 2024-09-21T07:50:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.924+0000 7f73fd200640 1 -- 172.21.15.84:0/1032696963 wait complete. 2024-09-21T07:50:43.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.925+0000 7f73fd200640 1 Processor -- start 2024-09-21T07:50:43.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.925+0000 7f73fd200640 1 -- start start 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.925+0000 7f73fd200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73f8103910 0x7f73f819c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73fd200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109240 0x7f73f819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73fd200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8109b90 0x7f73f81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73fd200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73f8113850 con 0x7f73f8109240 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73fd200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81136d0 con 0x7f73f8109b90 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73fd200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81139d0 con 0x7f73f8103910 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109240 0x7f73f819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109240 0x7f73f819ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50866/0 (socket says 172.21.15.84:50866) 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 -- 172.21.15.84:0/1459044848 learned_addr learned my addr 172.21.15.84:0/1459044848 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f7400640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73f8103910 0x7f73f819c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f7e00640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8109b90 0x7f73f81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 -- 172.21.15.84:0/1459044848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73f8103910 msgr2=0x7f73f819c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73f8103910 0x7f73f819c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 -- 172.21.15.84:0/1459044848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8109b90 msgr2=0x7f73f81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8109b90 0x7f73f81a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.926+0000 7f73f6a00640 1 -- 172.21.15.84:0/1459044848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f81a23c0 con 0x7f73f8109240 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.927+0000 7f73f6a00640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109240 0x7f73f819ca30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e9f0 tx=0x7f73e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.927+0000 7f73efe00640 1 -- 172.21.15.84:0/1459044848 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e400ccc0 con 0x7f73f8109240 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.927+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f81a26b0 con 0x7f73f8109240 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.927+0000 7f73efe00640 1 -- 172.21.15.84:0/1459044848 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e40108e0 con 0x7f73f8109240 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.927+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f81a8e40 con 0x7f73f8109240 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.927+0000 7f73efe00640 1 -- 172.21.15.84:0/1459044848 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4018820 con 0x7f73f8109240 2024-09-21T07:50:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.928+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f8103d20 con 0x7f73f8109240 2024-09-21T07:50:43.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.931+0000 7f73efe00640 1 -- 172.21.15.84:0/1459044848 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f73e4010430 con 0x7f73f8109240 2024-09-21T07:50:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.933+0000 7f73efe00640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73dc0b6560 0x7f73dc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.934+0000 7f73efe00640 1 -- 172.21.15.84:0/1459044848 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f73e40e7d30 con 0x7f73f8109240 2024-09-21T07:50:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.934+0000 7f73f7400640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73dc0b6560 0x7f73dc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.934+0000 7f73efe00640 1 -- 172.21.15.84:0/1459044848 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73e40ae130 con 0x7f73f8109240 2024-09-21T07:50:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:43.935+0000 7f73f7400640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73dc0b6560 0x7f73dc0b8a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f73e8031440 tx=0x7f73e8009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:44.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.179+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f73f810f670 con 0x7f73dc0b6560 2024-09-21T07:50:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.360+0000 7f73efe00640 1 -- 172.21.15.84:0/1459044848 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f73f810f670 con 0x7f73dc0b6560 2024-09-21T07:50:44.363 INFO:teuthology.orchestra.run.smithi084.stdout:Schedule set for path / 2024-09-21T07:50:44.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73dc0b6560 msgr2=0x7f73dc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73dc0b6560 0x7f73dc0b8a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f73e8031440 tx=0x7f73e8009560 comp rx=0 tx=0).stop 2024-09-21T07:50:44.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109240 msgr2=0x7f73f819ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109240 0x7f73f819ca30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e9f0 tx=0x7f73e400edf0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 shutdown_connections 2024-09-21T07:50:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73dc0b6560 0x7f73dc0b8a70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f8109b90 0x7f73f81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f8109240 0x7f73f819ca30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 --2- 172.21.15.84:0/1459044848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73f8103910 0x7f73f819c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 >> 172.21.15.84:0/1459044848 conn(0x7f73f80ff330 msgr2=0x7f73f8108920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 shutdown_connections 2024-09-21T07:50:44.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.363+0000 7f73fd200640 1 -- 172.21.15.84:0/1459044848 wait complete. 2024-09-21T07:50:44.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T07:50:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 -- 172.21.15.84:0/1009796624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 msgr2=0x7fc27c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 --2- 172.21.15.84:0/1009796624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 0x7fc27c1103c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc274009ca0 tx=0x7fc27402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 -- 172.21.15.84:0/1009796624 shutdown_connections 2024-09-21T07:50:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 --2- 172.21.15.84:0/1009796624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 0x7fc27c1103c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 --2- 172.21.15.84:0/1009796624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 0x7fc27c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 --2- 172.21.15.84:0/1009796624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc27c103910 0x7fc27c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 -- 172.21.15.84:0/1009796624 >> 172.21.15.84:0/1009796624 conn(0x7fc27c0ff330 msgr2=0x7fc27c101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 -- 172.21.15.84:0/1009796624 shutdown_connections 2024-09-21T07:50:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.658+0000 7fc281e00640 1 -- 172.21.15.84:0/1009796624 wait complete. 2024-09-21T07:50:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.659+0000 7fc281e00640 1 Processor -- start 2024-09-21T07:50:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281e00640 1 -- start start 2024-09-21T07:50:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc27c103910 0x7fc27c19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 0x7fc27c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 0x7fc27c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c113850 con 0x7fc27c109b90 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c1136d0 con 0x7fc27c109240 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c1139d0 con 0x7fc27c103910 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc27be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 0x7fc27c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc27be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 0x7fc27c19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60684/0 (socket says 172.21.15.84:60684) 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc281400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 0x7fc27c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc27be00640 1 -- 172.21.15.84:0/1874589164 learned_addr learned my addr 172.21.15.84:0/1874589164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.660+0000 7fc280a00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc27c103910 0x7fc27c19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc27be00640 1 -- 172.21.15.84:0/1874589164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc27c103910 msgr2=0x7fc27c19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc27be00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc27c103910 0x7fc27c19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc27be00640 1 -- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 msgr2=0x7fc27c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc27be00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 0x7fc27c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc27be00640 1 -- 172.21.15.84:0/1874589164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c1a0140 con 0x7fc27c109240 2024-09-21T07:50:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc280a00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc27c103910 0x7fc27c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc27be00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 0x7fc27c19a7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc26800e9f0 tx=0x7fc26800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc279600640 1 -- 172.21.15.84:0/1874589164 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26800ccc0 con 0x7fc27c109240 2024-09-21T07:50:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.661+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27c1a0430 con 0x7fc27c109240 2024-09-21T07:50:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.662+0000 7fc279600640 1 -- 172.21.15.84:0/1874589164 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2680108e0 con 0x7fc27c109240 2024-09-21T07:50:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.662+0000 7fc279600640 1 -- 172.21.15.84:0/1874589164 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268018860 con 0x7fc27c109240 2024-09-21T07:50:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.662+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27c1a6bc0 con 0x7fc27c109240 2024-09-21T07:50:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.663+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27c103d20 con 0x7fc27c109240 2024-09-21T07:50:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.665+0000 7fc279600640 1 -- 172.21.15.84:0/1874589164 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fc268010430 con 0x7fc27c109240 2024-09-21T07:50:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.667+0000 7fc279600640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2640b6560 0x7fc2640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.667+0000 7fc279600640 1 -- 172.21.15.84:0/1874589164 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc2680e7f80 con 0x7fc27c109240 2024-09-21T07:50:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.667+0000 7fc280a00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2640b6560 0x7fc2640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.668+0000 7fc280a00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2640b6560 0x7fc2640b8a70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc270009fc0 tx=0x7fc270005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.668+0000 7fc279600640 1 -- 172.21.15.84:0/1874589164 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2680b2760 con 0x7fc27c109240 2024-09-21T07:50:44.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 -- 172.21.15.84:0/2827107791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 msgr2=0x7fa21c112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 --2- 172.21.15.84:0/2827107791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c112350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa214009ca0 tx=0x7fa21402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 -- 172.21.15.84:0/2827107791 shutdown_connections 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 --2- 172.21.15.84:0/2827107791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c112350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 --2- 172.21.15.84:0/2827107791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa21c076100 0x7fa21c10f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 --2- 172.21.15.84:0/2827107791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c0757b0 0x7fa21c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 -- 172.21.15.84:0/2827107791 >> 172.21.15.84:0/2827107791 conn(0x7fa21c0ff440 msgr2=0x7fa21c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 -- 172.21.15.84:0/2827107791 shutdown_connections 2024-09-21T07:50:44.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.784+0000 7fa221c00640 1 -- 172.21.15.84:0/2827107791 wait complete. 2024-09-21T07:50:44.787 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:44 smithi084 ceph-mon[30411]: pgmap v383: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T07:50:44.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.786+0000 7fa221c00640 1 Processor -- start 2024-09-21T07:50:44.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.786+0000 7fa221c00640 1 -- start start 2024-09-21T07:50:44.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa21c0757b0 0x7fa21c19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c076100 0x7fa21c19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c115a80 con 0x7fa21c0757b0 2024-09-21T07:50:44.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c115900 con 0x7fa21c076100 2024-09-21T07:50:44.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c115c00 con 0x7fa21c10ff10 2024-09-21T07:50:44.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa213e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c076100 0x7fa21c19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa21be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa21c0757b0 0x7fa21c19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c1a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52164/0 (socket says 172.21.15.84:52164) 2024-09-21T07:50:44.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa221200640 1 -- 172.21.15.84:0/2317539811 learned_addr learned my addr 172.21.15.84:0/2317539811 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:44.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.787+0000 7fa213e00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c076100 0x7fa21c19ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60704/0 (socket says 172.21.15.84:60704) 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.788+0000 7fa213e00640 1 -- 172.21.15.84:0/2317539811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 msgr2=0x7fa21c1a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.788+0000 7fa213e00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c1a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.788+0000 7fa213e00640 1 -- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa21c0757b0 msgr2=0x7fa21c19c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.788+0000 7fa213e00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa21c0757b0 0x7fa21c19c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.788+0000 7fa213e00640 1 -- 172.21.15.84:0/2317539811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c1a2420 con 0x7fa21c076100 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.788+0000 7fa221200640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c1a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.788+0000 7fa213e00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c076100 0x7fa21c19ca50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa20400e9c0 tx=0x7fa20400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.789+0000 7fa219600640 1 -- 172.21.15.84:0/2317539811 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20400ccc0 con 0x7fa21c076100 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.789+0000 7fa219600640 1 -- 172.21.15.84:0/2317539811 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2040035f0 con 0x7fa21c076100 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.789+0000 7fa219600640 1 -- 172.21.15.84:0/2317539811 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20400ce60 con 0x7fa21c076100 2024-09-21T07:50:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.789+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21c1a2710 con 0x7fa21c076100 2024-09-21T07:50:44.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.789+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21c1a8e70 con 0x7fa21c076100 2024-09-21T07:50:44.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.792+0000 7fa229fd0740 1 Processor -- start 2024-09-21T07:50:44.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.792+0000 7fa229fd0740 1 -- start start 2024-09-21T07:50:44.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984930350 0x55e984cd7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984907490 0x55e984cd8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e98490f670 0x55e984cd8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa229fd0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e984c4de90 con 0x55e984907490 2024-09-21T07:50:44.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa229fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e984c3d2c0 con 0x55e984930350 2024-09-21T07:50:44.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa229fd0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e984c410d0 con 0x55e98490f670 2024-09-21T07:50:44.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa221200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984930350 0x55e984cd7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa221200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984930350 0x55e984cd7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60706/0 (socket says 172.21.15.84:60706) 2024-09-21T07:50:44.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa221200640 1 -- 172.21.15.84:0/1582338235 learned_addr learned my addr 172.21.15.84:0/1582338235 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:44.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa21be00640 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984907490 0x55e984cd8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa219600640 1 -- 172.21.15.84:0/2317539811 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fa204004000 con 0x7fa21c076100 2024-09-21T07:50:44.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa213e00640 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e98490f670 0x55e984cd8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.793+0000 7fa221200640 1 -- 172.21.15.84:0/1582338235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e98490f670 msgr2=0x55e984cd8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa221200640 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e98490f670 0x55e984cd8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa221200640 1 -- 172.21.15.84:0/1582338235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984907490 msgr2=0x55e984cd8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa221200640 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984907490 0x55e984cd8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa221200640 1 -- 172.21.15.84:0/1582338235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98499b930 con 0x55e984930350 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa213e00640 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e98490f670 0x55e984cd8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa221200640 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984930350 0x55e984cd7f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa2140094b0 tx=0x7fa21402f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4536e64319dcaa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa211600640 1 -- 172.21.15.84:0/1582338235 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214031450 con 0x55e984930350 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa211600640 1 -- 172.21.15.84:0/1582338235 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa214036040 con 0x55e984930350 2024-09-21T07:50:44.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.794+0000 7fa211600640 1 -- 172.21.15.84:0/1582338235 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214004500 con 0x55e984930350 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.795+0000 7fa219600640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa2000b65e0 0x7fa2000b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 -- 172.21.15.84:0/1582338235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984930350 msgr2=0x55e984cd7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984930350 0x55e984cd7f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa2140094b0 tx=0x7fa21402f310 comp rx=0 tx=0).stop 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa219600640 1 -- 172.21.15.84:0/2317539811 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa2040e7c50 con 0x7fa21c076100 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 -- 172.21.15.84:0/1582338235 shutdown_connections 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e98490f670 0x55e984cd8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984907490 0x55e984cd8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 --2- 172.21.15.84:0/1582338235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984930350 0x55e984cd7f00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 -- 172.21.15.84:0/1582338235 >> 172.21.15.84:0/1582338235 conn(0x55e984924740 msgr2=0x55e984cd5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa21be00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa2000b65e0 0x7fa2000b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.796+0000 7fa229fd0740 1 -- 172.21.15.84:0/1582338235 shutdown_connections 2024-09-21T07:50:44.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.797+0000 7fa229fd0740 1 -- 172.21.15.84:0/1582338235 wait complete. 2024-09-21T07:50:44.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.797+0000 7fa21be00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa2000b65e0 0x7fa2000b8af0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e984cd6b80 tx=0x7fa20c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.797+0000 7fa229fd0740 1 -- start start 2024-09-21T07:50:44.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.797+0000 7fa229fd0740 1 Processor -- start 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cf7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa229fd0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e984a9e890 con 0x55e984930350 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa229fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e984bd8160 con 0x55e98490f670 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa229fd0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e984ceec30 con 0x55e984907490 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa229fd0740 10 client.0 _ll_register_callbacks cb 0x55e984bf4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa21be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa21be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cec340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52178/0 (socket says 172.21.15.84:52178) 2024-09-21T07:50:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa21be00640 1 -- 172.21.15.84:0/822974039 learned_addr learned my addr 172.21.15.84:0/822974039 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.798+0000 7fa221200640 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cf7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa21be00640 1 -- 172.21.15.84:0/822974039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 msgr2=0x55e984cec8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:50:44.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa21be00640 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cec8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa21be00640 1 -- 172.21.15.84:0/822974039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 msgr2=0x55e984cf7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa21be00640 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cf7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa21be00640 1 -- 172.21.15.84:0/822974039 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e984cf85a0 con 0x55e984907490 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa21be00640 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cec340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009dc0 tx=0x7fa20c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6256148ff9694ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa20a000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa20a000640 1 -- 172.21.15.84:0/822974039 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c01f640 con 0x55e984907490 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa214036040 con 0x55e984907490 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.799+0000 7fa20a000640 1 -- 172.21.15.84:0/822974039 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa20c01f7e0 con 0x55e984907490 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa20a000640 1 -- 172.21.15.84:0/822974039 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa20c01f9e0 con 0x55e984907490 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa229fd0740 10 client.25534 fetch_fsmap learned FSMap version 29 2024-09-21T07:50:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e984cfaea0 con 0x55e984907490 2024-09-21T07:50:44.803 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:44 smithi162 ceph-mon[34833]: pgmap v383: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T07:50:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa20a000640 1 -- 172.21.15.84:0/822974039 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa214036040 con 0x55e984907490 2024-09-21T07:50:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa20a000640 1 -- 172.21.15.84:0/822974039 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa20c027020 con 0x55e984907490 2024-09-21T07:50:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa229fd0740 10 client.25534 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:50:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa229fd0740 10 client.25534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:50:44.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.800+0000 7fa229fd0740 20 client.25534 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:44.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.801+0000 7fa229fd0740 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848eecd0 0x55e984cfe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.801+0000 7fa229fd0740 4 client.25534 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:44.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.801+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e984c4fde0 con 0x55e9848eecd0 2024-09-21T07:50:44.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.801+0000 7fa213e00640 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848eecd0 0x55e984cfe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.801+0000 7fa20a000640 10 client.25534 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:44.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.801+0000 7fa213e00640 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848eecd0 0x55e984cfe440 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86eb60ec72a55fcd server_cookie=a466061fbaa2996d in_seq=0 out_seq=0 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.802+0000 7fa20a000640 1 -- 172.21.15.84:0/822974039 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e984c4fde0 con 0x55e9848eecd0 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.802+0000 7fa20a000640 10 client.25534 handle_command_reply: tid=0 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.802+0000 7fa229fd0740 1 client.25534 shutdown 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 msgr2=0x55e984cec340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cec340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009dc0 tx=0x7fa20c004730 comp rx=0 tx=0).stop 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 shutdown_connections 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cf7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cec8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848eecd0 0x55e984cfe440 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 --2- 172.21.15.84:0/822974039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cec340 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa20a000640 0 client.25534 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 >> 172.21.15.84:0/822974039 conn(0x55e984924740 msgr2=0x55e984cdb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.803+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 shutdown_connections 2024-09-21T07:50:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.804+0000 7fa229fd0740 1 -- 172.21.15.84:0/822974039 wait complete. 2024-09-21T07:50:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.804+0000 7fa229fd0740 20 client.25534 trim_cache size 0 max 16384 2024-09-21T07:50:44.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 Processor -- start 2024-09-21T07:50:44.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 -- start start 2024-09-21T07:50:44.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cdcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cdd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cdb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1ae980 con 0x55e984930350 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1b04c0 con 0x55e98490f670 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.822+0000 7fa229fd0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1af050 con 0x55e984907490 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cdcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa213e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cdd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cdcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52192/0 (socket says 172.21.15.84:52192) 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 -- 172.21.15.84:0/2450574174 learned_addr learned my addr 172.21.15.84:0/2450574174 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa213e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cdd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60722/0 (socket says 172.21.15.84:60722) 2024-09-21T07:50:44.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa221200640 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cdb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 -- 172.21.15.84:0/2450574174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 msgr2=0x55e984cdd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cdd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 -- 172.21.15.84:0/2450574174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 msgr2=0x55e984cdb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cdb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa21be00640 1 -- 172.21.15.84:0/2450574174 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e984ce79d0 con 0x55e984907490 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa221200640 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cdb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.823+0000 7fa213e00640 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cdd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.824+0000 7fa21be00640 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cdcff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0058c0 tx=0x7fa20c02af70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78efdb5832957561 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.824+0000 7fa210c00640 1 -- 172.21.15.84:0/2450574174 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c01f640 con 0x55e984907490 2024-09-21T07:50:44.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.824+0000 7fa210c00640 1 -- 172.21.15.84:0/2450574174 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20c01f7e0 con 0x55e984907490 2024-09-21T07:50:44.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.824+0000 7fa210c00640 1 -- 172.21.15.84:0/2450574174 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0366e0 con 0x55e984907490 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 -- 172.21.15.84:0/2450574174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 msgr2=0x55e984cdcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cdcff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0058c0 tx=0x7fa20c02af70 comp rx=0 tx=0).stop 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 -- 172.21.15.84:0/2450574174 shutdown_connections 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e984930350 0x55e984cdb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e98490f670 0x55e984cdd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 --2- 172.21.15.84:0/2450574174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984907490 0x55e984cdcff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 -- 172.21.15.84:0/2450574174 >> 172.21.15.84:0/2450574174 conn(0x55e984924740 msgr2=0x55e984cea9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 -- 172.21.15.84:0/2450574174 shutdown_connections 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.825+0000 7fa229fd0740 1 -- 172.21.15.84:0/2450574174 wait complete. 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 -- start start 2024-09-21T07:50:44.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 Processor -- start 2024-09-21T07:50:44.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984907490 0x55e984cf01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e98490f670 0x55e984cf0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984930350 0x55e984d67e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1afdf0 con 0x55e98490f670 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1af720 con 0x55e984907490 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c1ac980 con 0x55e984930350 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.826+0000 7fa229fd0740 10 client.0 _ll_register_callbacks cb 0x7fa20c009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984907490 0x55e984cf01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984907490 0x55e984cf01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60726/0 (socket says 172.21.15.84:60726) 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 -- 172.21.15.84:0/3714336912 learned_addr learned my addr 172.21.15.84:0/3714336912 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa213e00640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e98490f670 0x55e984cf0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa221200640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984930350 0x55e984d67e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 -- 172.21.15.84:0/3714336912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984930350 msgr2=0x55e984d67e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984930350 0x55e984d67e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 -- 172.21.15.84:0/3714336912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e98490f670 msgr2=0x55e984cf0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e98490f670 0x55e984cf0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 -- 172.21.15.84:0/3714336912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e984cf0fa0 con 0x55e984907490 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa221200640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984930350 0x55e984d67e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa213e00640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e98490f670 0x55e984cf0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa21be00640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984907490 0x55e984cf01e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa20c01fe40 tx=0x7fa20c029b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ecbcf0651dadeae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.827+0000 7fa20a000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.828+0000 7fa20a000640 1 -- 172.21.15.84:0/3714336912 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c044070 con 0x55e984907490 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.828+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa20c01f7e0 con 0x55e984907490 2024-09-21T07:50:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.828+0000 7fa20a000640 1 -- 172.21.15.84:0/3714336912 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa20c005040 con 0x55e984907490 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.828+0000 7fa20a000640 1 -- 172.21.15.84:0/3714336912 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa20c01f640 con 0x55e984907490 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.828+0000 7fa229fd0740 10 client.25517 fetch_fsmap learned FSMap version 29 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.828+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e984d69400 con 0x55e984907490 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.828+0000 7fa20a000640 1 -- 172.21.15.84:0/3714336912 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20c01f7e0 con 0x55e984907490 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa20a000640 1 -- 172.21.15.84:0/3714336912 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa20c027040 con 0x55e984907490 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa229fd0740 10 client.25517 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa229fd0740 10 client.25517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:50:44.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa229fd0740 20 client.25517 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:44.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa229fd0740 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848c4080 0x55e984d6ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:44.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa229fd0740 4 client.25517 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:50:44.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e984c4b890 con 0x55e9848c4080 2024-09-21T07:50:44.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.829+0000 7fa213e00640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848c4080 0x55e984d6ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:44.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.830+0000 7fa20a000640 10 client.25517 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:44.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.830+0000 7fa213e00640 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848c4080 0x55e984d6ba60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9ad25374645443 server_cookie=5633fa8d043df2c7 in_seq=0 out_seq=0 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.831+0000 7fa20a000640 1 -- 172.21.15.84:0/3714336912 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e984c4b890 con 0x55e9848c4080 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.831+0000 7fa20a000640 10 client.25517 handle_command_reply: tid=0 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.831+0000 7fa229fd0740 1 client.25517 shutdown 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.831+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984907490 msgr2=0x55e984cf01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.831+0000 7fa229fd0740 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984907490 0x55e984cf01e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa20c01fe40 tx=0x7fa20c029b20 comp rx=0 tx=0).stop 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 shutdown_connections 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e9848c4080 0x55e984d6ba60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e984930350 0x55e984d67e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e98490f670 0x55e984cf0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa20a000640 0 client.25517 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 --2- 172.21.15.84:0/3714336912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e984907490 0x55e984cf01e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 >> 172.21.15.84:0/3714336912 conn(0x55e984924740 msgr2=0x55e984cdb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 shutdown_connections 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 1 -- 172.21.15.84:0/3714336912 wait complete. 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.832+0000 7fa229fd0740 20 client.25517 trim_cache size 0 max 16384 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "098875a9-63e0-4fc5-a56f-f2c4e8928c0d", 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:50:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:50:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa2000b65e0 msgr2=0x7fa2000b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa2000b65e0 0x7fa2000b8af0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e984cd6b80 tx=0x7fa20c005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c076100 msgr2=0x7fa21c19ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c076100 0x7fa21c19ca50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa20400e9c0 tx=0x7fa20400ee80 comp rx=0 tx=0).stop 2024-09-21T07:50:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 shutdown_connections 2024-09-21T07:50:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa2000b65e0 0x7fa2000b8af0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa21c10ff10 0x7fa21c1a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa21c076100 0x7fa21c19ca50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 --2- 172.21.15.84:0/2317539811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa21c0757b0 0x7fa21c19c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:44.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 >> 172.21.15.84:0/2317539811 conn(0x7fa21c0ff440 msgr2=0x7fa21c109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:44.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.833+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 shutdown_connections 2024-09-21T07:50:44.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.834+0000 7fa221c00640 1 -- 172.21.15.84:0/2317539811 wait complete. 2024-09-21T07:50:44.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:44 smithi191 ceph-mon[34667]: pgmap v383: 129 pgs: 129 active+clean; 655 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-21T07:50:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.919+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fc27c063800 con 0x7fc2640b6560 2024-09-21T07:50:45.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:44.999+0000 7fc279600640 1 -- 172.21.15.84:0/1874589164 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fc27c063800 con 0x7fc2640b6560 2024-09-21T07:50:45.001 INFO:teuthology.orchestra.run.smithi084.stdout:Retention added to path / 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2640b6560 msgr2=0x7fc2640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2640b6560 0x7fc2640b8a70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc270009fc0 tx=0x7fc270005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 msgr2=0x7fc27c19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 0x7fc27c19a7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc26800e9f0 tx=0x7fc26800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 shutdown_connections 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc2640b6560 0x7fc2640b8a70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc27c109b90 0x7fc27c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c109240 0x7fc27c19a7b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 --2- 172.21.15.84:0/1874589164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc27c103910 0x7fc27c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 >> 172.21.15.84:0/1874589164 conn(0x7fc27c0ff330 msgr2=0x7fc27c101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:45.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 shutdown_connections 2024-09-21T07:50:45.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.002+0000 7fc281e00640 1 -- 172.21.15.84:0/1874589164 wait complete. 2024-09-21T07:50:45.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T07:50:45.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 -- 172.21.15.84:0/1875155207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102e90 msgr2=0x7f374410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 --2- 172.21.15.84:0/1875155207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102e90 0x7f374410fbb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3730009900 tx=0x7f373002a480 comp rx=0 tx=0).stop 2024-09-21T07:50:45.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 -- 172.21.15.84:0/1875155207 shutdown_connections 2024-09-21T07:50:45.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 --2- 172.21.15.84:0/1875155207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37441100f0 0x7f3744112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 --2- 172.21.15.84:0/1875155207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102e90 0x7f374410fbb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 --2- 172.21.15.84:0/1875155207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3744102540 0x7f3744102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 -- 172.21.15.84:0/1875155207 >> 172.21.15.84:0/1875155207 conn(0x7f37440fe3c0 msgr2=0x7f3744100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:45.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 -- 172.21.15.84:0/1875155207 shutdown_connections 2024-09-21T07:50:45.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.269+0000 7f374ba00640 1 -- 172.21.15.84:0/1875155207 wait complete. 2024-09-21T07:50:45.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.270+0000 7f374ba00640 1 Processor -- start 2024-09-21T07:50:45.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f374ba00640 1 -- start start 2024-09-21T07:50:45.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f374ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102540 0x7f374419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f374ba00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3744102e90 0x7f374419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f374ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37441100f0 0x7f37441a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f374ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3744115c30 con 0x7f3744102540 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f374ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3744115ab0 con 0x7f37441100f0 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f374ba00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3744115db0 con 0x7f3744102e90 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f3749000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102540 0x7f374419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f3749000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102540 0x7f374419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50970/0 (socket says 172.21.15.84:50970) 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f3749000640 1 -- 172.21.15.84:0/3766971104 learned_addr learned my addr 172.21.15.84:0/3766971104 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f3743e00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3744102e90 0x7f374419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.271+0000 7f3749a00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37441100f0 0x7f37441a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3749000640 1 -- 172.21.15.84:0/3766971104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3744102e90 msgr2=0x7f374419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3749000640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3744102e90 0x7f374419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3749000640 1 -- 172.21.15.84:0/3766971104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37441100f0 msgr2=0x7f37441a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3749000640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37441100f0 0x7f37441a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3749000640 1 -- 172.21.15.84:0/3766971104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37441a2600 con 0x7f3744102540 2024-09-21T07:50:45.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3743e00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3744102e90 0x7f374419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:45.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3749000640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102540 0x7f374419c6d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f373800ea60 tx=0x7f373800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:45.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f3741600640 1 -- 172.21.15.84:0/3766971104 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373800cde0 con 0x7f3744102540 2024-09-21T07:50:45.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.272+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37441a28f0 con 0x7f3744102540 2024-09-21T07:50:45.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.273+0000 7f3741600640 1 -- 172.21.15.84:0/3766971104 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37380035f0 con 0x7f3744102540 2024-09-21T07:50:45.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.273+0000 7f3741600640 1 -- 172.21.15.84:0/3766971104 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738010690 con 0x7f3744102540 2024-09-21T07:50:45.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.273+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37441a9080 con 0x7f3744102540 2024-09-21T07:50:45.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.275+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3744102950 con 0x7f3744102540 2024-09-21T07:50:45.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.276+0000 7f3741600640 1 -- 172.21.15.84:0/3766971104 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f37380037a0 con 0x7f3744102540 2024-09-21T07:50:45.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.278+0000 7f3741600640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f372c0b65e0 0x7f372c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.278+0000 7f3741600640 1 -- 172.21.15.84:0/3766971104 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f37380e7a50 con 0x7f3744102540 2024-09-21T07:50:45.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.278+0000 7f3743e00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f372c0b65e0 0x7f372c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.279+0000 7f3743e00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f372c0b65e0 0x7f372c0b8af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3730005ab0 tx=0x7f3730005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:45.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.282+0000 7f3741600640 1 -- 172.21.15.84:0/3766971104 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37380ade50 con 0x7f3744102540 2024-09-21T07:50:45.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.514+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f374410b2b0 con 0x7f372c0b65e0 2024-09-21T07:50:45.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.521+0000 7f3741600640 1 -- 172.21.15.84:0/3766971104 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f374410b2b0 con 0x7f372c0b65e0 2024-09-21T07:50:45.523 INFO:teuthology.orchestra.run.smithi084.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T07:50:44", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f372c0b65e0 msgr2=0x7f372c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f372c0b65e0 0x7f372c0b8af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3730005ab0 tx=0x7f3730005a20 comp rx=0 tx=0).stop 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102540 msgr2=0x7f374419c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102540 0x7f374419c6d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f373800ea60 tx=0x7f373800ef20 comp rx=0 tx=0).stop 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 shutdown_connections 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f372c0b65e0 0x7f372c0b8af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37441100f0 0x7f37441a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3744102e90 0x7f374419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 --2- 172.21.15.84:0/3766971104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3744102540 0x7f374419c6d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 >> 172.21.15.84:0/3766971104 conn(0x7f37440fe3c0 msgr2=0x7f3744112170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 shutdown_connections 2024-09-21T07:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.524+0000 7f374ba00640 1 -- 172.21.15.84:0/3766971104 wait complete. 2024-09-21T07:50:45.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T07:50:45.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:50:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 -- 172.21.15.84:0/882130271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4103930 msgr2=0x7f67b4103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 --2- 172.21.15.84:0/882130271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4103930 0x7f67b4103d40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009900 tx=0x7f67a402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 -- 172.21.15.84:0/882130271 shutdown_connections 2024-09-21T07:50:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 --2- 172.21.15.84:0/882130271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4109bb0 0x7f67b41103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 --2- 172.21.15.84:0/882130271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b4109260 0x7f67b4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 --2- 172.21.15.84:0/882130271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4103930 0x7f67b4103d40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 -- 172.21.15.84:0/882130271 >> 172.21.15.84:0/882130271 conn(0x7f67b40ff390 msgr2=0x7f67b41017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 -- 172.21.15.84:0/882130271 shutdown_connections 2024-09-21T07:50:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.772+0000 7f67b3e00640 1 -- 172.21.15.84:0/882130271 wait complete. 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.773+0000 7f67b3e00640 1 Processor -- start 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.773+0000 7f67b3e00640 1 -- start start 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4103930 0x7f67b419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4109260 0x7f67b419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b4109bb0 0x7f67b41a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f67b41138c0 con 0x7f67b4109260 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67b4113740 con 0x7f67b4109bb0 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b3e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67b4113a40 con 0x7f67b4103930 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4103930 0x7f67b419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4109260 0x7f67b419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4103930 0x7f67b419c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52232/0 (socket says 172.21.15.84:52232) 2024-09-21T07:50:45.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b2a00640 1 -- 172.21.15.84:0/650402241 learned_addr learned my addr 172.21.15.84:0/650402241 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:45.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.774+0000 7f67b3400640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b4109bb0 0x7f67b41a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b2a00640 1 -- 172.21.15.84:0/650402241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b4109bb0 msgr2=0x7f67b41a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b2a00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b4109bb0 0x7f67b41a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b2a00640 1 -- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4109260 msgr2=0x7f67b419cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b2a00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4109260 0x7f67b419cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b2a00640 1 -- 172.21.15.84:0/650402241 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b41a2450 con 0x7f67b4103930 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b2000640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4109260 0x7f67b419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b2a00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4103930 0x7f67b419c520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f67a4005ab0 tx=0x7f67a4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67ab400640 1 -- 172.21.15.84:0/650402241 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a403f070 con 0x7f67b4103930 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67ab400640 1 -- 172.21.15.84:0/650402241 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67a4031b60 con 0x7f67b4103930 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b41a26e0 con 0x7f67b4103930 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67ab400640 1 -- 172.21.15.84:0/650402241 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4035030 con 0x7f67b4103930 2024-09-21T07:50:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.775+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b41a8ed0 con 0x7f67b4103930 2024-09-21T07:50:45.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.776+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b4104ba0 con 0x7f67b4103930 2024-09-21T07:50:45.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.779+0000 7f67ab400640 1 -- 172.21.15.84:0/650402241 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f67a4042070 con 0x7f67b4103930 2024-09-21T07:50:45.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.780+0000 7f67ab400640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f67980b6560 0x7f67980b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:45.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.780+0000 7f67ab400640 1 -- 172.21.15.84:0/650402241 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f67a4108330 con 0x7f67b4103930 2024-09-21T07:50:45.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.781+0000 7f67b2000640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f67980b6560 0x7f67980b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:45.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.781+0000 7f67b2000640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f67980b6560 0x7f67980b8a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f67b406ab70 tx=0x7f67a0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:45.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:45.782+0000 7f67ab400640 1 -- 172.21.15.84:0/650402241 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67a40ce730 con 0x7f67b4103930 2024-09-21T07:50:45.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:45.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:45.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:50:45.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='client.25502 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:50:45.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:45 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='client.25502 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:50:45.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:45 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='client.25502 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:50:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:45 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:50:46.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.002+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f67b410f690 con 0x7f67980b6560 2024-09-21T07:50:46.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.011+0000 7f67ab400640 1 -- 172.21.15.84:0/650402241 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f67b410f690 con 0x7f67980b6560 2024-09-21T07:50:46.013 INFO:teuthology.orchestra.run.smithi084.stdout:/ 1m 6m3h 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f67980b6560 msgr2=0x7f67980b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f67980b6560 0x7f67980b8a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f67b406ab70 tx=0x7f67a0005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4103930 msgr2=0x7f67b419c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4103930 0x7f67b419c520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f67a4005ab0 tx=0x7f67a4003c10 comp rx=0 tx=0).stop 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 shutdown_connections 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f67980b6560 0x7f67980b8a70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67b4109bb0 0x7f67b41a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b4109260 0x7f67b419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 --2- 172.21.15.84:0/650402241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b4103930 0x7f67b419c520 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 >> 172.21.15.84:0/650402241 conn(0x7f67b40ff390 msgr2=0x7f67b4108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:46.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 shutdown_connections 2024-09-21T07:50:46.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.013+0000 7f67b3e00640 1 -- 172.21.15.84:0/650402241 wait complete. 2024-09-21T07:50:46.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T07:50:46.087 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:46.105 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T07:50:46.115 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T07:50:46.174 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T07:50:46.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T07:50:46.178 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T07:50:46.238 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:50:46.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:50:46.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:46 smithi084 ceph-mon[30411]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:46.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:46 smithi084 ceph-mon[30411]: from='client.25549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:46.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:46 smithi084 ceph-mon[30411]: pgmap v384: 129 pgs: 129 active+clean; 655 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.696+0000 7fd430000640 1 -- 172.21.15.84:0/382115449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 msgr2=0x7fd428103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.696+0000 7fd430000640 1 --2- 172.21.15.84:0/382115449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd428103f80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009900 tx=0x7fd41c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.697+0000 7fd430000640 1 -- 172.21.15.84:0/382115449 shutdown_connections 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.697+0000 7fd430000640 1 --2- 172.21.15.84:0/382115449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd428109e00 0x7fd428110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.697+0000 7fd430000640 1 --2- 172.21.15.84:0/382115449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4281094b0 0x7fd4281098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.697+0000 7fd430000640 1 --2- 172.21.15.84:0/382115449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd428103f80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.697+0000 7fd430000640 1 -- 172.21.15.84:0/382115449 >> 172.21.15.84:0/382115449 conn(0x7fd4280ff5e0 msgr2=0x7fd428101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.697+0000 7fd430000640 1 -- 172.21.15.84:0/382115449 shutdown_connections 2024-09-21T07:50:46.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.697+0000 7fd430000640 1 -- 172.21.15.84:0/382115449 wait complete. 2024-09-21T07:50:46.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.698+0000 7fd430000640 1 Processor -- start 2024-09-21T07:50:46.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.698+0000 7fd430000640 1 -- start start 2024-09-21T07:50:46.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.698+0000 7fd430000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd42819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.698+0000 7fd430000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4281094b0 0x7fd42819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.698+0000 7fd430000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd428109e00 0x7fd42819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd430000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd428113ac0 con 0x7fd428103b70 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd430000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd428113940 con 0x7fd428109e00 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd430000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd428113c40 con 0x7fd4281094b0 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd42d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd42819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd42d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd42819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51026/0 (socket says 172.21.15.84:51026) 2024-09-21T07:50:46.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd42d600640 1 -- 172.21.15.84:0/2961101385 learned_addr learned my addr 172.21.15.84:0/2961101385 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd42cc00640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4281094b0 0x7fd42819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.699+0000 7fd42e000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd428109e00 0x7fd42819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.700+0000 7fd42d600640 1 -- 172.21.15.84:0/2961101385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4281094b0 msgr2=0x7fd42819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.700+0000 7fd42d600640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4281094b0 0x7fd42819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.700+0000 7fd42d600640 1 -- 172.21.15.84:0/2961101385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd428109e00 msgr2=0x7fd42819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.700+0000 7fd42d600640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd428109e00 0x7fd42819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.700+0000 7fd42d600640 1 -- 172.21.15.84:0/2961101385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4281a0460 con 0x7fd428103b70 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.700+0000 7fd42d600640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd42819a4f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd41c005940 tx=0x7fd41c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.701+0000 7fd426000640 1 -- 172.21.15.84:0/2961101385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c03f030 con 0x7fd428103b70 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.701+0000 7fd426000640 1 -- 172.21.15.84:0/2961101385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c003cb0 con 0x7fd428103b70 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.701+0000 7fd426000640 1 -- 172.21.15.84:0/2961101385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c035070 con 0x7fd428103b70 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.701+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4281a06f0 con 0x7fd428103b70 2024-09-21T07:50:46.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.701+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4280755f0 con 0x7fd428103b70 2024-09-21T07:50:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.705+0000 7fd436dc2740 1 Processor -- start 2024-09-21T07:50:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.705+0000 7fd436dc2740 1 -- start start 2024-09-21T07:50:46.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.705+0000 7fd426000640 1 -- 172.21.15.84:0/2961101385 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fd41c042030 con 0x7fd428103b70 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f18d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b491b0 0x557a57f192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f197e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd436dc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a57e8ff70 con 0x557a57b51390 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd436dc2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a57e7f3a0 con 0x557a57b72070 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd436dc2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557a57e831b0 con 0x557a57b491b0 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd42e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f18d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd42d600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b491b0 0x557a57f192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd42e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f18d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60790/0 (socket says 172.21.15.84:60790) 2024-09-21T07:50:46.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd42e000640 1 -- 172.21.15.84:0/316548942 learned_addr learned my addr 172.21.15.84:0/316548942 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:46.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.706+0000 7fd42cc00640 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd42e000640 1 -- 172.21.15.84:0/316548942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b491b0 msgr2=0x557a57f192a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd42e000640 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b491b0 0x557a57f192a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd42e000640 1 -- 172.21.15.84:0/316548942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 msgr2=0x557a57f197e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd42e000640 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f197e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd42e000640 1 -- 172.21.15.84:0/316548942 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a57e49c90 con 0x557a57b72070 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd42e000640 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f18d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd420009f90 tx=0x7fd420010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd2edc55aa5195f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd426000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4100b6670 0x7fd4100b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd41a600640 1 -- 172.21.15.84:0/316548942 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420011700 con 0x557a57b72070 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd41a600640 1 -- 172.21.15.84:0/316548942 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd420011d50 con 0x557a57b72070 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd426000640 1 -- 172.21.15.84:0/2961101385 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd41c108100 con 0x7fd428103b70 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd42d600640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4100b6670 0x7fd4100b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.707+0000 7fd41a600640 1 -- 172.21.15.84:0/316548942 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420019d40 con 0x557a57b72070 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.708+0000 7fd436dc2740 1 -- 172.21.15.84:0/316548942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 msgr2=0x557a57f18d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.708+0000 7fd436dc2740 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f18d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd420009f90 tx=0x7fd420010860 comp rx=0 tx=0).stop 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.708+0000 7fd42d600640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4100b6670 0x7fd4100b8b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x557a57f179e0 tx=0x7fd41c10bc30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.708+0000 7fd436dc2740 1 -- 172.21.15.84:0/316548942 shutdown_connections 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.708+0000 7fd436dc2740 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f197e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.709+0000 7fd436dc2740 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b491b0 0x557a57f192a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.709+0000 7fd436dc2740 1 --2- 172.21.15.84:0/316548942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f18d60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.709+0000 7fd436dc2740 1 -- 172.21.15.84:0/316548942 >> 172.21.15.84:0/316548942 conn(0x557a57b66460 msgr2=0x557a57f16c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.709+0000 7fd436dc2740 1 -- 172.21.15.84:0/316548942 shutdown_connections 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.709+0000 7fd436dc2740 1 -- 172.21.15.84:0/316548942 wait complete. 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.709+0000 7fd436dc2740 1 -- start start 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.709+0000 7fd436dc2740 1 Processor -- start 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.710+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f24430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.710+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b51390 0x557a57f24970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.710+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f30880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.710+0000 7fd436dc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a57ce0700 con 0x557a57b491b0 2024-09-21T07:50:46.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.710+0000 7fd436dc2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a57e1a540 con 0x557a57b72070 2024-09-21T07:50:46.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.710+0000 7fd436dc2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557a57f27590 con 0x557a57b51390 2024-09-21T07:50:46.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.710+0000 7fd436dc2740 10 client.0 _ll_register_callbacks cb 0x557a57e2a430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:46.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f24430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f30880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f30880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60794/0 (socket says 172.21.15.84:60794) 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 -- 172.21.15.84:0/3307511052 learned_addr learned my addr 172.21.15.84:0/3307511052 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42cc00640 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b51390 0x557a57f24970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 -- 172.21.15.84:0/3307511052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b51390 msgr2=0x557a57f24970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b51390 0x557a57f24970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 -- 172.21.15.84:0/3307511052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 msgr2=0x557a57f24430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f24430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.711+0000 7fd42e000640 1 -- 172.21.15.84:0/3307511052 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a57bdd650 con 0x557a57b72070 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd42e000640 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f30880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x557a57f26c80 tx=0x7fd420005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d5c35b40c4ab0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd40ea00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd40ea00640 1 -- 172.21.15.84:0/3307511052 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42001f040 con 0x557a57b72070 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a57e1cb50 con 0x557a57b72070 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd40ea00640 1 -- 172.21.15.84:0/3307511052 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd420004c40 con 0x557a57b72070 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd40ea00640 1 -- 172.21.15.84:0/3307511052 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd420003970 con 0x557a57b72070 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd436dc2740 10 client.25541 fetch_fsmap learned FSMap version 29 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.712+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a57e37910 con 0x557a57b72070 2024-09-21T07:50:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.713+0000 7fd40ea00640 1 -- 172.21.15.84:0/3307511052 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557a57e1cb50 con 0x557a57b72070 2024-09-21T07:50:46.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd40ea00640 1 -- 172.21.15.84:0/3307511052 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd4200044a0 con 0x557a57b72070 2024-09-21T07:50:46.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd436dc2740 10 client.25541 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:50:46.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd436dc2740 10 client.25541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:50:46.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd436dc2740 20 client.25541 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b309f0 0x557a57f36500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd436dc2740 4 client.25541 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a57e91ec0 con 0x557a57b309f0 2024-09-21T07:50:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.714+0000 7fd42cc00640 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b309f0 0x557a57f36500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.715+0000 7fd42cc00640 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b309f0 0x557a57f36500 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966f06644c5fac67 server_cookie=bbc325d522c7fe01 in_seq=0 out_seq=0 2024-09-21T07:50:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.715+0000 7fd40ea00640 10 client.25541 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd40ea00640 1 -- 172.21.15.84:0/3307511052 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a57e91ec0 con 0x557a57b309f0 2024-09-21T07:50:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd40ea00640 10 client.25541 handle_command_reply: tid=0 2024-09-21T07:50:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 client.25541 shutdown 2024-09-21T07:50:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 msgr2=0x557a57f30880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f30880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x557a57f26c80 tx=0x7fd420005fd0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 shutdown_connections 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b72070 0x557a57f30880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b309f0 0x557a57f36500 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b51390 0x557a57f24970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3307511052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f24430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd40ea00640 0 client.25541 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 >> 172.21.15.84:0/3307511052 conn(0x557a57b66460 msgr2=0x557a57f19d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 shutdown_connections 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.716+0000 7fd436dc2740 1 -- 172.21.15.84:0/3307511052 wait complete. 2024-09-21T07:50:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.717+0000 7fd436dc2740 20 client.25541 trim_cache size 0 max 16384 2024-09-21T07:50:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:46.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.735+0000 7fd436dc2740 1 Processor -- start 2024-09-21T07:50:46.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.735+0000 7fd436dc2740 1 -- start start 2024-09-21T07:50:46.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b491b0 0x557a57f26310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f30780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd436dc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281aebd0 con 0x557a57b51390 2024-09-21T07:50:46.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd436dc2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281b0710 con 0x557a57b491b0 2024-09-21T07:50:46.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd436dc2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281af2a0 con 0x557a57b72070 2024-09-21T07:50:46.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd42e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b491b0 0x557a57f26310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd42e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b491b0 0x557a57f26310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60810/0 (socket says 172.21.15.84:60810) 2024-09-21T07:50:46.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd42e000640 1 -- 172.21.15.84:0/1666476237 learned_addr learned my addr 172.21.15.84:0/1666476237 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:46.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd42e000640 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.736+0000 7fd42cc00640 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f30780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd42e000640 1 -- 172.21.15.84:0/1666476237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 msgr2=0x557a57f233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd42e000640 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd42e000640 1 -- 172.21.15.84:0/1666476237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 msgr2=0x557a57f30780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd42e000640 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f30780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd42e000640 1 -- 172.21.15.84:0/1666476237 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a57f17810 con 0x557a57b491b0 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd42e000640 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b491b0 0x557a57f26310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd420009a80 tx=0x7fd4200021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26605d6b67a9ae3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd419c00640 1 -- 172.21.15.84:0/1666476237 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420019510 con 0x557a57b491b0 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd419c00640 1 -- 172.21.15.84:0/1666476237 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4200196b0 con 0x557a57b491b0 2024-09-21T07:50:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.737+0000 7fd419c00640 1 -- 172.21.15.84:0/1666476237 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420011d50 con 0x557a57b491b0 2024-09-21T07:50:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.738+0000 7fd436dc2740 1 -- 172.21.15.84:0/1666476237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b491b0 msgr2=0x557a57f26310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.738+0000 7fd436dc2740 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b491b0 0x557a57f26310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd420009a80 tx=0x7fd4200021f0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.738+0000 7fd436dc2740 1 -- 172.21.15.84:0/1666476237 shutdown_connections 2024-09-21T07:50:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.738+0000 7fd436dc2740 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.738+0000 7fd436dc2740 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b51390 0x557a57f30780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.738+0000 7fd436dc2740 1 --2- 172.21.15.84:0/1666476237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b491b0 0x557a57f26310 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.738+0000 7fd436dc2740 1 -- 172.21.15.84:0/1666476237 >> 172.21.15.84:0/1666476237 conn(0x557a57b66460 msgr2=0x557a57f22cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.739+0000 7fd436dc2740 1 -- 172.21.15.84:0/1666476237 shutdown_connections 2024-09-21T07:50:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.739+0000 7fd436dc2740 1 -- 172.21.15.84:0/1666476237 wait complete. 2024-09-21T07:50:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.739+0000 7fd436dc2740 1 -- start start 2024-09-21T07:50:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.739+0000 7fd436dc2740 1 Processor -- start 2024-09-21T07:50:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f28710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b51390 0x557a57f28c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd436dc2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f29190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd436dc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281b0040 con 0x557a57b491b0 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd436dc2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281af970 con 0x557a57b51390 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd436dc2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281acb90 con 0x557a57b72070 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd436dc2740 10 client.0 _ll_register_callbacks cb 0x7fd420019aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd42e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f28710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd42e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f28710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51068/0 (socket says 172.21.15.84:51068) 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd42e000640 1 -- 172.21.15.84:0/3590259828 learned_addr learned my addr 172.21.15.84:0/3590259828 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd42cc00640 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b51390 0x557a57f28c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.740+0000 7fd42e000640 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f29190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd42e000640 1 -- 172.21.15.84:0/3590259828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 msgr2=0x557a57f29190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd42e000640 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f29190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd42e000640 1 -- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b51390 msgr2=0x557a57f28c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd42e000640 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b51390 0x557a57f28c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd42e000640 1 -- 172.21.15.84:0/3590259828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a57f9fd60 con 0x557a57b491b0 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd42e000640 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f28710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd420019a70 tx=0x7fd420010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c9844962f551d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd40ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd40ea00640 1 -- 172.21.15.84:0/3590259828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420011ad0 con 0x557a57b491b0 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd40ea00640 1 -- 172.21.15.84:0/3590259828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd420011c70 con 0x557a57b491b0 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.741+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4200196b0 con 0x557a57b491b0 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd40ea00640 1 -- 172.21.15.84:0/3590259828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd420004940 con 0x557a57b491b0 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 10 client.15582 fetch_fsmap learned FSMap version 29 2024-09-21T07:50:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a57fa0f50 con 0x557a57b491b0 2024-09-21T07:50:46.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd40ea00640 1 -- 172.21.15.84:0/3590259828 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4200196b0 con 0x557a57b491b0 2024-09-21T07:50:46.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd40ea00640 1 -- 172.21.15.84:0/3590259828 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd42003a7b0 con 0x557a57b491b0 2024-09-21T07:50:46.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 10 client.15582 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:50:46.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 20 client.15582 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b05da0 0x557a57fa35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 4 client.15582 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.742+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a57e8d970 con 0x557a57b05da0 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.743+0000 7fd42cc00640 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b05da0 0x557a57fa35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.743+0000 7fd42cc00640 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b05da0 0x557a57fa35a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=467fbefc3fa977c1 server_cookie=7233824ade91c811 in_seq=0 out_seq=0 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.743+0000 7fd40ea00640 10 client.15582 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd40ea00640 1 -- 172.21.15.84:0/3590259828 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x557a57e8d970 con 0x557a57b05da0 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd40ea00640 10 client.15582 handle_command_reply: tid=0 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 client.15582 shutdown 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 msgr2=0x557a57f28710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f28710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd420019a70 tx=0x7fd420010860 comp rx=0 tx=0).stop 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 shutdown_connections 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a57b05da0 0x557a57fa35a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a57b72070 0x557a57f29190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a57b51390 0x557a57f28c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 --2- 172.21.15.84:0/3590259828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a57b491b0 0x557a57f28710 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 >> 172.21.15.84:0/3590259828 conn(0x557a57b66460 msgr2=0x557a57f23670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd40ea00640 0 client.15582 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 shutdown_connections 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.744+0000 7fd436dc2740 1 -- 172.21.15.84:0/3590259828 wait complete. 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd436dc2740 20 client.15582 trim_cache size 0 max 16384 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:50:46.749 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "098875a9-63e0-4fc5-a56f-f2c4e8928c0d", 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:50:46.750 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:50:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:50:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:50:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:50:46.751 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:50:46.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4100b6670 msgr2=0x7fd4100b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4100b6670 0x7fd4100b8b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x557a57f179e0 tx=0x7fd41c10bc30 comp rx=0 tx=0).stop 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 msgr2=0x7fd42819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd42819a4f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd41c005940 tx=0x7fd41c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 shutdown_connections 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4100b6670 0x7fd4100b8b80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd428109e00 0x7fd42819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4281094b0 0x7fd42819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 --2- 172.21.15.84:0/2961101385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd428103b70 0x7fd42819a4f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.745+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 >> 172.21.15.84:0/2961101385 conn(0x7fd4280ff5e0 msgr2=0x7fd428101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.746+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 shutdown_connections 2024-09-21T07:50:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:46.746+0000 7fd430000640 1 -- 172.21.15.84:0/2961101385 wait complete. 2024-09-21T07:50:46.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:46 smithi162 ceph-mon[34833]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:46.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:46 smithi162 ceph-mon[34833]: from='client.25549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:46.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:46 smithi162 ceph-mon[34833]: pgmap v384: 129 pgs: 129 active+clean; 655 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:50:46.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:46 smithi191 ceph-mon[34667]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:46.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:46 smithi191 ceph-mon[34667]: from='client.25549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:50:46.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:46 smithi191 ceph-mon[34667]: pgmap v384: 129 pgs: 129 active+clean; 655 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:50:47.637 INFO:tasks.cephfs.filesystem:scrub status for tag:098875a9-63e0-4fc5-a56f-f2c4e8928c0d - {'path': '/', 'tag': '098875a9-63e0-4fc5-a56f-f2c4e8928c0d', 'options': 'recursive,force'} 2024-09-21T07:50:47.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:47 smithi162 ceph-mon[34833]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-21T07:50:47.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:47 smithi084 ceph-mon[30411]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-21T07:50:47.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:47 smithi191 ceph-mon[34667]: mgrmap e24: x(active, since 10m), standbys: z, y 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 -- 172.21.15.84:0/1440484836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c410b6d0 msgr2=0x7f22c410bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 --2- 172.21.15.84:0/1440484836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c410b6d0 0x7f22c410bae0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009900 tx=0x7f22b002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 -- 172.21.15.84:0/1440484836 shutdown_connections 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 --2- 172.21.15.84:0/1440484836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22c410c020 0x7f22c4112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 --2- 172.21.15.84:0/1440484836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c410b6d0 0x7f22c410bae0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 --2- 172.21.15.84:0/1440484836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c4105d90 0x7f22c41061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 -- 172.21.15.84:0/1440484836 >> 172.21.15.84:0/1440484836 conn(0x7f22c4101860 msgr2=0x7f22c4103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 -- 172.21.15.84:0/1440484836 shutdown_connections 2024-09-21T07:50:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.182+0000 7f22cc200640 1 -- 172.21.15.84:0/1440484836 wait complete. 2024-09-21T07:50:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.183+0000 7f22cc200640 1 Processor -- start 2024-09-21T07:50:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22cc200640 1 -- start start 2024-09-21T07:50:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22cc200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c4105d90 0x7f22c419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22cc200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22c410b6d0 0x7f22c419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22cc200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c410c020 0x7f22c41a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22cc200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4115ce0 con 0x7f22c4105d90 2024-09-21T07:50:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22cc200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4115b60 con 0x7f22c410b6d0 2024-09-21T07:50:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22cc200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4115e60 con 0x7f22c410c020 2024-09-21T07:50:48.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.184+0000 7f22c9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c4105d90 0x7f22c419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22c9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c4105d90 0x7f22c419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37940/0 (socket says 172.21.15.84:37940) 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22c9800640 1 -- 172.21.15.84:0/887422333 learned_addr learned my addr 172.21.15.84:0/887422333 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22ca200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c410c020 0x7f22c41a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22c8e00640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22c410b6d0 0x7f22c419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22ca200640 1 -- 172.21.15.84:0/887422333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22c410b6d0 msgr2=0x7f22c419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22ca200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22c410b6d0 0x7f22c419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22ca200640 1 -- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c4105d90 msgr2=0x7f22c419c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22ca200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c4105d90 0x7f22c419c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22ca200640 1 -- 172.21.15.84:0/887422333 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c41a2640 con 0x7f22c410c020 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.185+0000 7f22ca200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c410c020 0x7f22c41a1f10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009fd0 tx=0x7f22bc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.186+0000 7f22c2000640 1 -- 172.21.15.84:0/887422333 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00ce20 con 0x7f22c410c020 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.186+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c41a2930 con 0x7f22c410c020 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.186+0000 7f22c2000640 1 -- 172.21.15.84:0/887422333 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22bc010430 con 0x7f22c410c020 2024-09-21T07:50:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.186+0000 7f22c2000640 1 -- 172.21.15.84:0/887422333 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00f620 con 0x7f22c410c020 2024-09-21T07:50:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.186+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c41a9090 con 0x7f22c410c020 2024-09-21T07:50:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.187+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c41061a0 con 0x7f22c410c020 2024-09-21T07:50:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.190+0000 7f22c2000640 1 -- 172.21.15.84:0/887422333 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f22bc0108e0 con 0x7f22c410c020 2024-09-21T07:50:48.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.191+0000 7f22c2000640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:48.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.191+0000 7f22c2000640 1 -- 172.21.15.84:0/887422333 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f22bc0e80b0 con 0x7f22c410c020 2024-09-21T07:50:48.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.191+0000 7f22c9800640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:48.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.192+0000 7f22c9800640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22b80095f0 tx=0x7f22b8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:48.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.193+0000 7f22c2000640 1 -- 172.21.15.84:0/887422333 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22bc0ae390 con 0x7f22c410c020 2024-09-21T07:50:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.376+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22c4063800 con 0x7f22ac0b65f0 2024-09-21T07:50:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.383+0000 7f22c2000640 1 -- 172.21.15.84:0/887422333 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340538 (secure 0 0 0) 0x7f22c4063800 con 0x7f22ac0b65f0 2024-09-21T07:50:48.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:48.392 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.388+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22ac0b65f0 msgr2=0x7f22ac0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.388+0000 7f22cc200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22b80095f0 tx=0x7f22b8005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.388+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c410c020 msgr2=0x7f22c41a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.388+0000 7f22cc200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c410c020 0x7f22c41a1f10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009fd0 tx=0x7f22bc00ef10 comp rx=0 tx=0).stop 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 shutdown_connections 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22b80095f0 tx=0x7f22b8005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c410c020 0x7f22c41a1f10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22c410b6d0 0x7f22c419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 --2- 172.21.15.84:0/887422333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c4105d90 0x7f22c419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 >> 172.21.15.84:0/887422333 conn(0x7f22c4101860 msgr2=0x7f22c4103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 shutdown_connections 2024-09-21T07:50:48.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:48.389+0000 7f22cc200640 1 -- 172.21.15.84:0/887422333 wait complete. 2024-09-21T07:50:48.751 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:48 smithi084 ceph-mon[30411]: pgmap v385: 129 pgs: 129 active+clean; 655 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:48.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:48 smithi162 ceph-mon[34833]: pgmap v385: 129 pgs: 129 active+clean; 655 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:48.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:48 smithi191 ceph-mon[34667]: pgmap v385: 129 pgs: 129 active+clean; 655 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T07:50:49.284 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-09-21T07:50:48.023849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671199,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1424,"num_read_kb":830,"num_write":390,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397516,"kb_used_data":14988,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544308,"statfs":{"total":1151940427776,"available":1151533371392,"internally_reserved":0,"allocated":15347712,"data_stored":9078055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":391492921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":51,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003543"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":188,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:41.358694+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:50:41.358694+0000","last_peered":"2024-09-21T07:50:41.358694+0000","last_clean":"2024-09-21T07:50:41.358694+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:50:41.358694+0000","last_undegraded":"2024-09-21T07:50:41.358694+0000","last_fullsized":"2024-09-21T07:50:41.358694+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210401+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:50:00.210401+0000","last_peered":"2024-09-21T07:50:00.210401+0000","last_clean":"2024-09-21T07:50:00.210401+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:50:00.210401+0000","last_undegraded":"2024-09-21T07:50:00.210401+0000","last_fullsized":"2024-09-21T07:50:00.210401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247890+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247890+0000","last_peered":"2024-09-21T07:49:31.247890+0000","last_clean":"2024-09-21T07:49:31.247890+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247890+0000","last_undegraded":"2024-09-21T07:49:31.247890+0000","last_fullsized":"2024-09-21T07:49:31.247890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279185+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279185+0000","last_peered":"2024-09-21T07:49:31.279185+0000","last_clean":"2024-09-21T07:49:31.279185+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279185+0000","last_undegraded":"2024-09-21T07:49:31.279185+0000","last_fullsized":"2024-09-21T07:49:31.279185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230523+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:50:00.230523+0000","last_peered":"2024-09-21T07:50:00.230523+0000","last_clean":"2024-09-21T07:50:00.230523+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:50:00.230523+0000","last_undegraded":"2024-09-21T07:50:00.230523+0000","last_fullsized":"2024-09-21T07:50:00.230523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.280231+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.280231+0000","last_peered":"2024-09-21T07:49:31.280231+0000","last_clean":"2024-09-21T07:49:31.280231+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.280231+0000","last_undegraded":"2024-09-21T07:49:31.280231+0000","last_fullsized":"2024-09-21T07:49:31.280231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162622+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162622+0000","last_peered":"2024-09-21T07:49:31.162622+0000","last_clean":"2024-09-21T07:49:31.162622+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162622+0000","last_undegraded":"2024-09-21T07:49:31.162622+0000","last_fullsized":"2024-09-21T07:49:31.162622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230976+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:50:00.230976+0000","last_peered":"2024-09-21T07:50:00.230976+0000","last_clean":"2024-09-21T07:50:00.230976+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:50:00.230976+0000","last_undegraded":"2024-09-21T07:50:00.230976+0000","last_fullsized":"2024-09-21T07:50:00.230976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162964+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162964+0000","last_peered":"2024-09-21T07:49:31.162964+0000","last_clean":"2024-09-21T07:49:31.162964+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162964+0000","last_undegraded":"2024-09-21T07:49:31.162964+0000","last_fullsized":"2024-09-21T07:49:31.162964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235866+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:50:00.235866+0000","last_peered":"2024-09-21T07:50:00.235866+0000","last_clean":"2024-09-21T07:50:00.235866+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:50:00.235866+0000","last_undegraded":"2024-09-21T07:50:00.235866+0000","last_fullsized":"2024-09-21T07:50:00.235866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162229+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162229+0000","last_peered":"2024-09-21T07:49:31.162229+0000","last_clean":"2024-09-21T07:49:31.162229+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162229+0000","last_undegraded":"2024-09-21T07:49:31.162229+0000","last_fullsized":"2024-09-21T07:49:31.162229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236270+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:50:00.236270+0000","last_peered":"2024-09-21T07:50:00.236270+0000","last_clean":"2024-09-21T07:50:00.236270+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:50:00.236270+0000","last_undegraded":"2024-09-21T07:50:00.236270+0000","last_fullsized":"2024-09-21T07:50:00.236270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162277+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162277+0000","last_peered":"2024-09-21T07:49:31.162277+0000","last_clean":"2024-09-21T07:49:31.162277+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162277+0000","last_undegraded":"2024-09-21T07:49:31.162277+0000","last_fullsized":"2024-09-21T07:49:31.162277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163029+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.163029+0000","last_peered":"2024-09-21T07:49:31.163029+0000","last_clean":"2024-09-21T07:49:31.163029+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.163029+0000","last_undegraded":"2024-09-21T07:49:31.163029+0000","last_fullsized":"2024-09-21T07:49:31.163029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225576+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:50:00.225576+0000","last_peered":"2024-09-21T07:50:00.225576+0000","last_clean":"2024-09-21T07:50:00.225576+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:50:00.225576+0000","last_undegraded":"2024-09-21T07:50:00.225576+0000","last_fullsized":"2024-09-21T07:50:00.225576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247829+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247829+0000","last_peered":"2024-09-21T07:49:31.247829+0000","last_clean":"2024-09-21T07:49:31.247829+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247829+0000","last_undegraded":"2024-09-21T07:49:31.247829+0000","last_fullsized":"2024-09-21T07:49:31.247829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163050+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.163050+0000","last_peered":"2024-09-21T07:49:31.163050+0000","last_clean":"2024-09-21T07:49:31.163050+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.163050+0000","last_undegraded":"2024-09-21T07:49:31.163050+0000","last_fullsized":"2024-09-21T07:49:31.163050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228962+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:50:00.228962+0000","last_peered":"2024-09-21T07:50:00.228962+0000","last_clean":"2024-09-21T07:50:00.228962+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:50:00.228962+0000","last_undegraded":"2024-09-21T07:50:00.228962+0000","last_fullsized":"2024-09-21T07:50:00.228962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278440+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278440+0000","last_peered":"2024-09-21T07:49:31.278440+0000","last_clean":"2024-09-21T07:49:31.278440+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278440+0000","last_undegraded":"2024-09-21T07:49:31.278440+0000","last_fullsized":"2024-09-21T07:49:31.278440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160566+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160566+0000","last_peered":"2024-09-21T07:49:31.160566+0000","last_clean":"2024-09-21T07:49:31.160566+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160566+0000","last_undegraded":"2024-09-21T07:49:31.160566+0000","last_fullsized":"2024-09-21T07:49:31.160566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.182905+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:50:00.182905+0000","last_peered":"2024-09-21T07:50:00.182905+0000","last_clean":"2024-09-21T07:50:00.182905+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:50:00.182905+0000","last_undegraded":"2024-09-21T07:50:00.182905+0000","last_fullsized":"2024-09-21T07:50:00.182905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161028+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.161028+0000","last_peered":"2024-09-21T07:49:31.161028+0000","last_clean":"2024-09-21T07:49:31.161028+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.161028+0000","last_undegraded":"2024-09-21T07:49:31.161028+0000","last_fullsized":"2024-09-21T07:49:31.161028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163163+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163163+0000","last_peered":"2024-09-21T07:49:31.163163+0000","last_clean":"2024-09-21T07:49:31.163163+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163163+0000","last_undegraded":"2024-09-21T07:49:31.163163+0000","last_fullsized":"2024-09-21T07:49:31.163163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228483+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:50:00.228483+0000","last_peered":"2024-09-21T07:50:00.228483+0000","last_clean":"2024-09-21T07:50:00.228483+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:50:00.228483+0000","last_undegraded":"2024-09-21T07:50:00.228483+0000","last_fullsized":"2024-09-21T07:50:00.228483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163371+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163371+0000","last_peered":"2024-09-21T07:49:31.163371+0000","last_clean":"2024-09-21T07:49:31.163371+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163371+0000","last_undegraded":"2024-09-21T07:49:31.163371+0000","last_fullsized":"2024-09-21T07:49:31.163371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247637+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247637+0000","last_peered":"2024-09-21T07:49:31.247637+0000","last_clean":"2024-09-21T07:49:31.247637+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247637+0000","last_undegraded":"2024-09-21T07:49:31.247637+0000","last_fullsized":"2024-09-21T07:49:31.247637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233969+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:50:00.233969+0000","last_peered":"2024-09-21T07:50:00.233969+0000","last_clean":"2024-09-21T07:50:00.233969+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:50:00.233969+0000","last_undegraded":"2024-09-21T07:50:00.233969+0000","last_fullsized":"2024-09-21T07:50:00.233969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'18","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.730803+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:50:00.730803+0000","last_peered":"2024-09-21T07:50:00.730803+0000","last_clean":"2024-09-21T07:50:00.730803+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:50:00.730803+0000","last_undegraded":"2024-09-21T07:50:00.730803+0000","last_fullsized":"2024-09-21T07:50:00.730803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278131+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278131+0000","last_peered":"2024-09-21T07:49:31.278131+0000","last_clean":"2024-09-21T07:49:31.278131+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278131+0000","last_undegraded":"2024-09-21T07:49:31.278131+0000","last_fullsized":"2024-09-21T07:49:31.278131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214205+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:50:00.214205+0000","last_peered":"2024-09-21T07:50:00.214205+0000","last_clean":"2024-09-21T07:50:00.214205+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:50:00.214205+0000","last_undegraded":"2024-09-21T07:50:00.214205+0000","last_fullsized":"2024-09-21T07:50:00.214205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162970+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162970+0000","last_peered":"2024-09-21T07:49:31.162970+0000","last_clean":"2024-09-21T07:49:31.162970+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162970+0000","last_undegraded":"2024-09-21T07:49:31.162970+0000","last_fullsized":"2024-09-21T07:49:31.162970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158456+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158456+0000","last_peered":"2024-09-21T07:49:31.158456+0000","last_clean":"2024-09-21T07:49:31.158456+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158456+0000","last_undegraded":"2024-09-21T07:49:31.158456+0000","last_fullsized":"2024-09-21T07:49:31.158456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212815+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:50:00.212815+0000","last_peered":"2024-09-21T07:50:00.212815+0000","last_clean":"2024-09-21T07:50:00.212815+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:50:00.212815+0000","last_undegraded":"2024-09-21T07:50:00.212815+0000","last_fullsized":"2024-09-21T07:50:00.212815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160485+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160485+0000","last_peered":"2024-09-21T07:49:31.160485+0000","last_clean":"2024-09-21T07:49:31.160485+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160485+0000","last_undegraded":"2024-09-21T07:49:31.160485+0000","last_fullsized":"2024-09-21T07:49:31.160485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162107+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162107+0000","last_peered":"2024-09-21T07:49:31.162107+0000","last_clean":"2024-09-21T07:49:31.162107+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162107+0000","last_undegraded":"2024-09-21T07:49:31.162107+0000","last_fullsized":"2024-09-21T07:49:31.162107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226173+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:50:00.226173+0000","last_peered":"2024-09-21T07:50:00.226173+0000","last_clean":"2024-09-21T07:50:00.226173+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:50:00.226173+0000","last_undegraded":"2024-09-21T07:50:00.226173+0000","last_fullsized":"2024-09-21T07:50:00.226173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":183,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:43.362335+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:50:43.362335+0000","last_peered":"2024-09-21T07:50:43.362335+0000","last_clean":"2024-09-21T07:50:43.362335+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:50:43.362335+0000","last_undegraded":"2024-09-21T07:50:43.362335+0000","last_fullsized":"2024-09-21T07:50:43.362335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":899,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246008+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.246008+0000","last_peered":"2024-09-21T07:49:31.246008+0000","last_clean":"2024-09-21T07:49:31.246008+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.246008+0000","last_undegraded":"2024-09-21T07:49:31.246008+0000","last_fullsized":"2024-09-21T07:49:31.246008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234222+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:50:00.234222+0000","last_peered":"2024-09-21T07:50:00.234222+0000","last_clean":"2024-09-21T07:50:00.234222+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:50:00.234222+0000","last_undegraded":"2024-09-21T07:50:00.234222+0000","last_fullsized":"2024-09-21T07:50:00.234222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:43.362075+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:50:43.362075+0000","last_peered":"2024-09-21T07:50:43.362075+0000","last_clean":"2024-09-21T07:50:43.362075+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:50:43.362075+0000","last_undegraded":"2024-09-21T07:50:43.362075+0000","last_fullsized":"2024-09-21T07:50:43.362075+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":131,"num_read_kb":131,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246470+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246470+0000","last_peered":"2024-09-21T07:49:31.246470+0000","last_clean":"2024-09-21T07:49:31.246470+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246470+0000","last_undegraded":"2024-09-21T07:49:31.246470+0000","last_fullsized":"2024-09-21T07:49:31.246470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215266+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:50:00.215266+0000","last_peered":"2024-09-21T07:50:00.215266+0000","last_clean":"2024-09-21T07:50:00.215266+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:50:00.215266+0000","last_undegraded":"2024-09-21T07:50:00.215266+0000","last_fullsized":"2024-09-21T07:50:00.215266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243292+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243292+0000","last_peered":"2024-09-21T07:49:31.243292+0000","last_clean":"2024-09-21T07:49:31.243292+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243292+0000","last_undegraded":"2024-09-21T07:49:31.243292+0000","last_fullsized":"2024-09-21T07:49:31.243292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247818+0000","last_change":"2024-09-21T07:49:31.247663+0000","last_active":"2024-09-21T07:49:31.247818+0000","last_peered":"2024-09-21T07:49:31.247818+0000","last_clean":"2024-09-21T07:49:31.247818+0000","last_became_active":"2024-09-21T07:49:31.247173+0000","last_became_peered":"2024-09-21T07:49:31.247173+0000","last_unstale":"2024-09-21T07:49:31.247818+0000","last_undegraded":"2024-09-21T07:49:31.247818+0000","last_fullsized":"2024-09-21T07:49:31.247818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:29.114632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229905+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:50:00.229905+0000","last_peered":"2024-09-21T07:50:00.229905+0000","last_clean":"2024-09-21T07:50:00.229905+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:50:00.229905+0000","last_undegraded":"2024-09-21T07:50:00.229905+0000","last_fullsized":"2024-09-21T07:50:00.229905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163025+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.163025+0000","last_peered":"2024-09-21T07:49:31.163025+0000","last_clean":"2024-09-21T07:49:31.163025+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.163025+0000","last_undegraded":"2024-09-21T07:49:31.163025+0000","last_fullsized":"2024-09-21T07:49:31.163025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243589+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243589+0000","last_peered":"2024-09-21T07:49:31.243589+0000","last_clean":"2024-09-21T07:49:31.243589+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243589+0000","last_undegraded":"2024-09-21T07:49:31.243589+0000","last_fullsized":"2024-09-21T07:49:31.243589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236108+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:50:00.236108+0000","last_peered":"2024-09-21T07:50:00.236108+0000","last_clean":"2024-09-21T07:50:00.236108+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:50:00.236108+0000","last_undegraded":"2024-09-21T07:50:00.236108+0000","last_fullsized":"2024-09-21T07:50:00.236108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'7","reported_seq":188,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:45.365098+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:50:45.365098+0000","last_peered":"2024-09-21T07:50:45.365098+0000","last_clean":"2024-09-21T07:50:45.365098+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:50:45.365098+0000","last_undegraded":"2024-09-21T07:50:45.365098+0000","last_fullsized":"2024-09-21T07:50:45.365098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161230+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161230+0000","last_peered":"2024-09-21T07:49:31.161230+0000","last_clean":"2024-09-21T07:49:31.161230+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161230+0000","last_undegraded":"2024-09-21T07:49:31.161230+0000","last_fullsized":"2024-09-21T07:49:31.161230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233772+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:50:00.233772+0000","last_peered":"2024-09-21T07:50:00.233772+0000","last_clean":"2024-09-21T07:50:00.233772+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:50:00.233772+0000","last_undegraded":"2024-09-21T07:50:00.233772+0000","last_fullsized":"2024-09-21T07:50:00.233772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248809+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:49:31.248809+0000","last_peered":"2024-09-21T07:49:31.248809+0000","last_clean":"2024-09-21T07:49:31.248809+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:49:31.248809+0000","last_undegraded":"2024-09-21T07:49:31.248809+0000","last_fullsized":"2024-09-21T07:49:31.248809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278758+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278758+0000","last_peered":"2024-09-21T07:49:31.278758+0000","last_clean":"2024-09-21T07:49:31.278758+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278758+0000","last_undegraded":"2024-09-21T07:49:31.278758+0000","last_fullsized":"2024-09-21T07:49:31.278758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231353+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:50:00.231353+0000","last_peered":"2024-09-21T07:50:00.231353+0000","last_clean":"2024-09-21T07:50:00.231353+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:50:00.231353+0000","last_undegraded":"2024-09-21T07:50:00.231353+0000","last_fullsized":"2024-09-21T07:50:00.231353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246326+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246326+0000","last_peered":"2024-09-21T07:49:31.246326+0000","last_clean":"2024-09-21T07:49:31.246326+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246326+0000","last_undegraded":"2024-09-21T07:49:31.246326+0000","last_fullsized":"2024-09-21T07:49:31.246326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246901+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246901+0000","last_peered":"2024-09-21T07:49:31.246901+0000","last_clean":"2024-09-21T07:49:31.246901+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246901+0000","last_undegraded":"2024-09-21T07:49:31.246901+0000","last_fullsized":"2024-09-21T07:49:31.246901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228801+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:50:00.228801+0000","last_peered":"2024-09-21T07:50:00.228801+0000","last_clean":"2024-09-21T07:50:00.228801+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:50:00.228801+0000","last_undegraded":"2024-09-21T07:50:00.228801+0000","last_fullsized":"2024-09-21T07:50:00.228801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162830+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162830+0000","last_peered":"2024-09-21T07:49:31.162830+0000","last_clean":"2024-09-21T07:49:31.162830+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162830+0000","last_undegraded":"2024-09-21T07:49:31.162830+0000","last_fullsized":"2024-09-21T07:49:31.162830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246921+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246921+0000","last_peered":"2024-09-21T07:49:31.246921+0000","last_clean":"2024-09-21T07:49:31.246921+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246921+0000","last_undegraded":"2024-09-21T07:49:31.246921+0000","last_fullsized":"2024-09-21T07:49:31.246921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235805+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:50:00.235805+0000","last_peered":"2024-09-21T07:50:00.235805+0000","last_clean":"2024-09-21T07:50:00.235805+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:50:00.235805+0000","last_undegraded":"2024-09-21T07:50:00.235805+0000","last_fullsized":"2024-09-21T07:50:00.235805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162058+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.162058+0000","last_peered":"2024-09-21T07:49:31.162058+0000","last_clean":"2024-09-21T07:49:31.162058+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.162058+0000","last_undegraded":"2024-09-21T07:49:31.162058+0000","last_fullsized":"2024-09-21T07:49:31.162058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246203+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246203+0000","last_peered":"2024-09-21T07:49:31.246203+0000","last_clean":"2024-09-21T07:49:31.246203+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246203+0000","last_undegraded":"2024-09-21T07:49:31.246203+0000","last_fullsized":"2024-09-21T07:49:31.246203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225861+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:50:00.225861+0000","last_peered":"2024-09-21T07:50:00.225861+0000","last_clean":"2024-09-21T07:50:00.225861+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:50:00.225861+0000","last_undegraded":"2024-09-21T07:50:00.225861+0000","last_fullsized":"2024-09-21T07:50:00.225861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:42.361286+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:50:42.361286+0000","last_peered":"2024-09-21T07:50:42.361286+0000","last_clean":"2024-09-21T07:50:42.361286+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:50:42.361286+0000","last_undegraded":"2024-09-21T07:50:42.361286+0000","last_fullsized":"2024-09-21T07:50:42.361286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226537+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:50:00.226537+0000","last_peered":"2024-09-21T07:50:00.226537+0000","last_clean":"2024-09-21T07:50:00.226537+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:50:00.226537+0000","last_undegraded":"2024-09-21T07:50:00.226537+0000","last_fullsized":"2024-09-21T07:50:00.226537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247713+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247713+0000","last_peered":"2024-09-21T07:49:31.247713+0000","last_clean":"2024-09-21T07:49:31.247713+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247713+0000","last_undegraded":"2024-09-21T07:49:31.247713+0000","last_fullsized":"2024-09-21T07:49:31.247713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158454+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158454+0000","last_peered":"2024-09-21T07:49:31.158454+0000","last_clean":"2024-09-21T07:49:31.158454+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158454+0000","last_undegraded":"2024-09-21T07:49:31.158454+0000","last_fullsized":"2024-09-21T07:49:31.158454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.213866+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:50:00.213866+0000","last_peered":"2024-09-21T07:50:00.213866+0000","last_clean":"2024-09-21T07:50:00.213866+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:50:00.213866+0000","last_undegraded":"2024-09-21T07:50:00.213866+0000","last_fullsized":"2024-09-21T07:50:00.213866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158337+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158337+0000","last_peered":"2024-09-21T07:49:31.158337+0000","last_clean":"2024-09-21T07:49:31.158337+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158337+0000","last_undegraded":"2024-09-21T07:49:31.158337+0000","last_fullsized":"2024-09-21T07:49:31.158337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248339+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248339+0000","last_peered":"2024-09-21T07:49:31.248339+0000","last_clean":"2024-09-21T07:49:31.248339+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248339+0000","last_undegraded":"2024-09-21T07:49:31.248339+0000","last_fullsized":"2024-09-21T07:49:31.248339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.224994+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:50:00.224994+0000","last_peered":"2024-09-21T07:50:00.224994+0000","last_clean":"2024-09-21T07:50:00.224994+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:50:00.224994+0000","last_undegraded":"2024-09-21T07:50:00.224994+0000","last_fullsized":"2024-09-21T07:50:00.224994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'40","reported_seq":357,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:44.363916+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:50:44.363916+0000","last_peered":"2024-09-21T07:50:44.363916+0000","last_clean":"2024-09-21T07:50:44.363916+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:50:44.363916+0000","last_undegraded":"2024-09-21T07:50:44.363916+0000","last_fullsized":"2024-09-21T07:50:44.363916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":208,"num_write":42,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159921+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159921+0000","last_peered":"2024-09-21T07:49:31.159921+0000","last_clean":"2024-09-21T07:49:31.159921+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159921+0000","last_undegraded":"2024-09-21T07:49:31.159921+0000","last_fullsized":"2024-09-21T07:49:31.159921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236544+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:50:00.236544+0000","last_peered":"2024-09-21T07:50:00.236544+0000","last_clean":"2024-09-21T07:50:00.236544+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:50:00.236544+0000","last_undegraded":"2024-09-21T07:50:00.236544+0000","last_fullsized":"2024-09-21T07:50:00.236544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248679+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248679+0000","last_peered":"2024-09-21T07:49:31.248679+0000","last_clean":"2024-09-21T07:49:31.248679+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248679+0000","last_undegraded":"2024-09-21T07:49:31.248679+0000","last_fullsized":"2024-09-21T07:49:31.248679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162313+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162313+0000","last_peered":"2024-09-21T07:49:31.162313+0000","last_clean":"2024-09-21T07:49:31.162313+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162313+0000","last_undegraded":"2024-09-21T07:49:31.162313+0000","last_fullsized":"2024-09-21T07:49:31.162313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227866+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:50:00.227866+0000","last_peered":"2024-09-21T07:50:00.227866+0000","last_clean":"2024-09-21T07:50:00.227866+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:50:00.227866+0000","last_undegraded":"2024-09-21T07:50:00.227866+0000","last_fullsized":"2024-09-21T07:50:00.227866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244633+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244633+0000","last_peered":"2024-09-21T07:49:31.244633+0000","last_clean":"2024-09-21T07:49:31.244633+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244633+0000","last_undegraded":"2024-09-21T07:49:31.244633+0000","last_fullsized":"2024-09-21T07:49:31.244633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159785+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159785+0000","last_peered":"2024-09-21T07:49:31.159785+0000","last_clean":"2024-09-21T07:49:31.159785+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159785+0000","last_undegraded":"2024-09-21T07:49:31.159785+0000","last_fullsized":"2024-09-21T07:49:31.159785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231446+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:50:00.231446+0000","last_peered":"2024-09-21T07:50:00.231446+0000","last_clean":"2024-09-21T07:50:00.231446+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:50:00.231446+0000","last_undegraded":"2024-09-21T07:50:00.231446+0000","last_fullsized":"2024-09-21T07:50:00.231446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":312,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:44.363321+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:50:44.363321+0000","last_peered":"2024-09-21T07:50:44.363321+0000","last_clean":"2024-09-21T07:50:44.363321+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:50:44.363321+0000","last_undegraded":"2024-09-21T07:50:44.363321+0000","last_fullsized":"2024-09-21T07:50:44.363321+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":260,"num_read_kb":260,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277894+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277894+0000","last_peered":"2024-09-21T07:49:31.277894+0000","last_clean":"2024-09-21T07:49:31.277894+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277894+0000","last_undegraded":"2024-09-21T07:49:31.277894+0000","last_fullsized":"2024-09-21T07:49:31.277894+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278984+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278984+0000","last_peered":"2024-09-21T07:49:31.278984+0000","last_clean":"2024-09-21T07:49:31.278984+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278984+0000","last_undegraded":"2024-09-21T07:49:31.278984+0000","last_fullsized":"2024-09-21T07:49:31.278984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225224+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:50:00.225224+0000","last_peered":"2024-09-21T07:50:00.225224+0000","last_clean":"2024-09-21T07:50:00.225224+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:50:00.225224+0000","last_undegraded":"2024-09-21T07:50:00.225224+0000","last_fullsized":"2024-09-21T07:50:00.225224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247909+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247909+0000","last_peered":"2024-09-21T07:49:31.247909+0000","last_clean":"2024-09-21T07:49:31.247909+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247909+0000","last_undegraded":"2024-09-21T07:49:31.247909+0000","last_fullsized":"2024-09-21T07:49:31.247909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158882+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158882+0000","last_peered":"2024-09-21T07:49:31.158882+0000","last_clean":"2024-09-21T07:49:31.158882+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158882+0000","last_undegraded":"2024-09-21T07:49:31.158882+0000","last_fullsized":"2024-09-21T07:49:31.158882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226888+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:50:00.226888+0000","last_peered":"2024-09-21T07:50:00.226888+0000","last_clean":"2024-09-21T07:50:00.226888+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:50:00.226888+0000","last_undegraded":"2024-09-21T07:50:00.226888+0000","last_fullsized":"2024-09-21T07:50:00.226888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245823+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245823+0000","last_peered":"2024-09-21T07:49:31.245823+0000","last_clean":"2024-09-21T07:49:31.245823+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245823+0000","last_undegraded":"2024-09-21T07:49:31.245823+0000","last_fullsized":"2024-09-21T07:49:31.245823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243596+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243596+0000","last_peered":"2024-09-21T07:49:31.243596+0000","last_clean":"2024-09-21T07:49:31.243596+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243596+0000","last_undegraded":"2024-09-21T07:49:31.243596+0000","last_fullsized":"2024-09-21T07:49:31.243596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234552+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:50:00.234552+0000","last_peered":"2024-09-21T07:50:00.234552+0000","last_clean":"2024-09-21T07:50:00.234552+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:50:00.234552+0000","last_undegraded":"2024-09-21T07:50:00.234552+0000","last_fullsized":"2024-09-21T07:50:00.234552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248127+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248127+0000","last_peered":"2024-09-21T07:49:31.248127+0000","last_clean":"2024-09-21T07:49:31.248127+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248127+0000","last_undegraded":"2024-09-21T07:49:31.248127+0000","last_fullsized":"2024-09-21T07:49:31.248127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":184,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:41.359662+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:50:41.359662+0000","last_peered":"2024-09-21T07:50:41.359662+0000","last_clean":"2024-09-21T07:50:41.359662+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:50:41.359662+0000","last_undegraded":"2024-09-21T07:50:41.359662+0000","last_fullsized":"2024-09-21T07:50:41.359662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212530+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:50:00.212530+0000","last_peered":"2024-09-21T07:50:00.212530+0000","last_clean":"2024-09-21T07:50:00.212530+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:50:00.212530+0000","last_undegraded":"2024-09-21T07:50:00.212530+0000","last_fullsized":"2024-09-21T07:50:00.212530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248474+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248474+0000","last_peered":"2024-09-21T07:49:31.248474+0000","last_clean":"2024-09-21T07:49:31.248474+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248474+0000","last_undegraded":"2024-09-21T07:49:31.248474+0000","last_fullsized":"2024-09-21T07:49:31.248474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229653+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:50:00.229653+0000","last_peered":"2024-09-21T07:50:00.229653+0000","last_clean":"2024-09-21T07:50:00.229653+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:50:00.229653+0000","last_undegraded":"2024-09-21T07:50:00.229653+0000","last_fullsized":"2024-09-21T07:50:00.229653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214497+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:50:00.214497+0000","last_peered":"2024-09-21T07:50:00.214497+0000","last_clean":"2024-09-21T07:50:00.214497+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:50:00.214497+0000","last_undegraded":"2024-09-21T07:50:00.214497+0000","last_fullsized":"2024-09-21T07:50:00.214497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227306+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:50:00.227306+0000","last_peered":"2024-09-21T07:50:00.227306+0000","last_clean":"2024-09-21T07:50:00.227306+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:50:00.227306+0000","last_undegraded":"2024-09-21T07:50:00.227306+0000","last_fullsized":"2024-09-21T07:50:00.227306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227334+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:50:00.227334+0000","last_peered":"2024-09-21T07:50:00.227334+0000","last_clean":"2024-09-21T07:50:00.227334+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:50:00.227334+0000","last_undegraded":"2024-09-21T07:50:00.227334+0000","last_fullsized":"2024-09-21T07:50:00.227334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227942+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:50:00.227942+0000","last_peered":"2024-09-21T07:50:00.227942+0000","last_clean":"2024-09-21T07:50:00.227942+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:50:00.227942+0000","last_undegraded":"2024-09-21T07:50:00.227942+0000","last_fullsized":"2024-09-21T07:50:00.227942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228389+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:50:00.228389+0000","last_peered":"2024-09-21T07:50:00.228389+0000","last_clean":"2024-09-21T07:50:00.228389+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:50:00.228389+0000","last_undegraded":"2024-09-21T07:50:00.228389+0000","last_fullsized":"2024-09-21T07:50:00.228389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223482+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:50:00.223482+0000","last_peered":"2024-09-21T07:50:00.223482+0000","last_clean":"2024-09-21T07:50:00.223482+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:50:00.223482+0000","last_undegraded":"2024-09-21T07:50:00.223482+0000","last_fullsized":"2024-09-21T07:50:00.223482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.202426+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:50:00.202426+0000","last_peered":"2024-09-21T07:50:00.202426+0000","last_clean":"2024-09-21T07:50:00.202426+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:50:00.202426+0000","last_undegraded":"2024-09-21T07:50:00.202426+0000","last_fullsized":"2024-09-21T07:50:00.202426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228634+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:50:00.228634+0000","last_peered":"2024-09-21T07:50:00.228634+0000","last_clean":"2024-09-21T07:50:00.228634+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:50:00.228634+0000","last_undegraded":"2024-09-21T07:50:00.228634+0000","last_fullsized":"2024-09-21T07:50:00.228634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.219031+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:50:00.219031+0000","last_peered":"2024-09-21T07:50:00.219031+0000","last_clean":"2024-09-21T07:50:00.219031+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:50:00.219031+0000","last_undegraded":"2024-09-21T07:50:00.219031+0000","last_fullsized":"2024-09-21T07:50:00.219031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235687+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:50:00.235687+0000","last_peered":"2024-09-21T07:50:00.235687+0000","last_clean":"2024-09-21T07:50:00.235687+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:50:00.235687+0000","last_undegraded":"2024-09-21T07:50:00.235687+0000","last_fullsized":"2024-09-21T07:50:00.235687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228617+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:50:00.228617+0000","last_peered":"2024-09-21T07:50:00.228617+0000","last_clean":"2024-09-21T07:50:00.228617+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:50:00.228617+0000","last_undegraded":"2024-09-21T07:50:00.228617+0000","last_fullsized":"2024-09-21T07:50:00.228617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227531+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:50:00.227531+0000","last_peered":"2024-09-21T07:50:00.227531+0000","last_clean":"2024-09-21T07:50:00.227531+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:50:00.227531+0000","last_undegraded":"2024-09-21T07:50:00.227531+0000","last_fullsized":"2024-09-21T07:50:00.227531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210770+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:50:00.210770+0000","last_peered":"2024-09-21T07:50:00.210770+0000","last_clean":"2024-09-21T07:50:00.210770+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:50:00.210770+0000","last_undegraded":"2024-09-21T07:50:00.210770+0000","last_fullsized":"2024-09-21T07:50:00.210770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229015+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:50:00.229015+0000","last_peered":"2024-09-21T07:50:00.229015+0000","last_clean":"2024-09-21T07:50:00.229015+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:50:00.229015+0000","last_undegraded":"2024-09-21T07:50:00.229015+0000","last_fullsized":"2024-09-21T07:50:00.229015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231891+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:50:00.231891+0000","last_peered":"2024-09-21T07:50:00.231891+0000","last_clean":"2024-09-21T07:50:00.231891+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:50:00.231891+0000","last_undegraded":"2024-09-21T07:50:00.231891+0000","last_fullsized":"2024-09-21T07:50:00.231891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235579+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:50:00.235579+0000","last_peered":"2024-09-21T07:50:00.235579+0000","last_clean":"2024-09-21T07:50:00.235579+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:50:00.235579+0000","last_undegraded":"2024-09-21T07:50:00.235579+0000","last_fullsized":"2024-09-21T07:50:00.235579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227718+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:50:00.227718+0000","last_peered":"2024-09-21T07:50:00.227718+0000","last_clean":"2024-09-21T07:50:00.227718+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:50:00.227718+0000","last_undegraded":"2024-09-21T07:50:00.227718+0000","last_fullsized":"2024-09-21T07:50:00.227718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228484+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:50:00.228484+0000","last_peered":"2024-09-21T07:50:00.228484+0000","last_clean":"2024-09-21T07:50:00.228484+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:50:00.228484+0000","last_undegraded":"2024-09-21T07:50:00.228484+0000","last_fullsized":"2024-09-21T07:50:00.228484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223270+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:50:00.223270+0000","last_peered":"2024-09-21T07:50:00.223270+0000","last_clean":"2024-09-21T07:50:00.223270+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:50:00.223270+0000","last_undegraded":"2024-09-21T07:50:00.223270+0000","last_fullsized":"2024-09-21T07:50:00.223270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229604+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:50:00.229604+0000","last_peered":"2024-09-21T07:50:00.229604+0000","last_clean":"2024-09-21T07:50:00.229604+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:50:00.229604+0000","last_undegraded":"2024-09-21T07:50:00.229604+0000","last_fullsized":"2024-09-21T07:50:00.229604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235991+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:50:00.235991+0000","last_peered":"2024-09-21T07:50:00.235991+0000","last_clean":"2024-09-21T07:50:00.235991+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:50:00.235991+0000","last_undegraded":"2024-09-21T07:50:00.235991+0000","last_fullsized":"2024-09-21T07:50:00.235991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210061+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:50:00.210061+0000","last_peered":"2024-09-21T07:50:00.210061+0000","last_clean":"2024-09-21T07:50:00.210061+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:50:00.210061+0000","last_undegraded":"2024-09-21T07:50:00.210061+0000","last_fullsized":"2024-09-21T07:50:00.210061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234725+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:50:00.234725+0000","last_peered":"2024-09-21T07:50:00.234725+0000","last_clean":"2024-09-21T07:50:00.234725+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:50:00.234725+0000","last_undegraded":"2024-09-21T07:50:00.234725+0000","last_fullsized":"2024-09-21T07:50:00.234725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210704+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:50:00.210704+0000","last_peered":"2024-09-21T07:50:00.210704+0000","last_clean":"2024-09-21T07:50:00.210704+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:50:00.210704+0000","last_undegraded":"2024-09-21T07:50:00.210704+0000","last_fullsized":"2024-09-21T07:50:00.210704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233170+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:50:00.233170+0000","last_peered":"2024-09-21T07:50:00.233170+0000","last_clean":"2024-09-21T07:50:00.233170+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:50:00.233170+0000","last_undegraded":"2024-09-21T07:50:00.233170+0000","last_fullsized":"2024-09-21T07:50:00.233170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215521+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:50:00.215521+0000","last_peered":"2024-09-21T07:50:00.215521+0000","last_clean":"2024-09-21T07:50:00.215521+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:50:00.215521+0000","last_undegraded":"2024-09-21T07:50:00.215521+0000","last_fullsized":"2024-09-21T07:50:00.215521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.208038+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:50:00.208038+0000","last_peered":"2024-09-21T07:50:00.208038+0000","last_clean":"2024-09-21T07:50:00.208038+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:50:00.208038+0000","last_undegraded":"2024-09-21T07:50:00.208038+0000","last_fullsized":"2024-09-21T07:50:00.208038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229406+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:50:00.229406+0000","last_peered":"2024-09-21T07:50:00.229406+0000","last_clean":"2024-09-21T07:50:00.229406+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:50:00.229406+0000","last_undegraded":"2024-09-21T07:50:00.229406+0000","last_fullsized":"2024-09-21T07:50:00.229406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230493+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:50:00.230493+0000","last_peered":"2024-09-21T07:50:00.230493+0000","last_clean":"2024-09-21T07:50:00.230493+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:50:00.230493+0000","last_undegraded":"2024-09-21T07:50:00.230493+0000","last_fullsized":"2024-09-21T07:50:00.230493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.220776+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:50:00.220776+0000","last_peered":"2024-09-21T07:50:00.220776+0000","last_clean":"2024-09-21T07:50:00.220776+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:50:00.220776+0000","last_undegraded":"2024-09-21T07:50:00.220776+0000","last_fullsized":"2024-09-21T07:50:00.220776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230134+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:50:00.230134+0000","last_peered":"2024-09-21T07:50:00.230134+0000","last_clean":"2024-09-21T07:50:00.230134+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:50:00.230134+0000","last_undegraded":"2024-09-21T07:50:00.230134+0000","last_fullsized":"2024-09-21T07:50:00.230134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80597,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1343,"num_read_kb":761,"num_write":265,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1392640,"data_stored":1028783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":526920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906999,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37424,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707728,"statfs":{"total":95995035648,"available":95956713472,"internally_reserved":0,"allocated":2129920,"data_stored":1579130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070526,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":529764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266756,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":918680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462985,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1646592,"data_stored":1122995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626510,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822739,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1118266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986265,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":520880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":596218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":595313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705775,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":523160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":74863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":468312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:50:49.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:50:49.718 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:49 smithi162 ceph-mon[34833]: from='client.25573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:49 smithi084 ceph-mon[30411]: from='client.25573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:49.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:49 smithi191 ceph-mon[34667]: from='client.25573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:50.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 -- 172.21.15.84:0/3566856025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 msgr2=0x7f416c10bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 --2- 172.21.15.84:0/3566856025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c10bb00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4158009900 tx=0x7f415802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 -- 172.21.15.84:0/3566856025 shutdown_connections 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 --2- 172.21.15.84:0/3566856025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f416c10c040 0x7f416c112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 --2- 172.21.15.84:0/3566856025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c10bb00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 --2- 172.21.15.84:0/3566856025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c105db0 0x7f416c1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 -- 172.21.15.84:0/3566856025 >> 172.21.15.84:0/3566856025 conn(0x7f416c1017e0 msgr2=0x7f416c103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 -- 172.21.15.84:0/3566856025 shutdown_connections 2024-09-21T07:50:50.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.359+0000 7f4174400640 1 -- 172.21.15.84:0/3566856025 wait complete. 2024-09-21T07:50:50.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.360+0000 7f4174400640 1 Processor -- start 2024-09-21T07:50:50.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4174400640 1 -- start start 2024-09-21T07:50:50.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4174400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f416c105db0 0x7f416c19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:50.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4174400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:50.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4174400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c10c040 0x7f416c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4174400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f416c115d00 con 0x7f416c10b6f0 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4174400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f416c115b80 con 0x7f416c10c040 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4174400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f416c115e80 con 0x7f416c105db0 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4171000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4171000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37968/0 (socket says 172.21.15.84:37968) 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4171000640 1 -- 172.21.15.84:0/188762698 learned_addr learned my addr 172.21.15.84:0/188762698 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4171a00640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f416c105db0 0x7f416c19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:50.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.361+0000 7f4172400640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c10c040 0x7f416c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.362+0000 7f4171000640 1 -- 172.21.15.84:0/188762698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f416c105db0 msgr2=0x7f416c19c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.362+0000 7f4171000640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f416c105db0 0x7f416c19c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.362+0000 7f4171000640 1 -- 172.21.15.84:0/188762698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c10c040 msgr2=0x7f416c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.362+0000 7f4171000640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c10c040 0x7f416c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.362+0000 7f4171000640 1 -- 172.21.15.84:0/188762698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c1a26c0 con 0x7f416c10b6f0 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.362+0000 7f4171000640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c19ccf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f415802a910 tx=0x7f4158031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.362+0000 7f416a000640 1 -- 172.21.15.84:0/188762698 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415803f030 con 0x7f416c10b6f0 2024-09-21T07:50:50.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.363+0000 7f416a000640 1 -- 172.21.15.84:0/188762698 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4158004490 con 0x7f416c10b6f0 2024-09-21T07:50:50.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.363+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c1a2950 con 0x7f416c10b6f0 2024-09-21T07:50:50.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.363+0000 7f416a000640 1 -- 172.21.15.84:0/188762698 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158035070 con 0x7f416c10b6f0 2024-09-21T07:50:50.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.363+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1a9110 con 0x7f416c10b6f0 2024-09-21T07:50:50.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.364+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c107030 con 0x7f416c10b6f0 2024-09-21T07:50:50.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.366+0000 7f416a000640 1 -- 172.21.15.84:0/188762698 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f4158042030 con 0x7f416c10b6f0 2024-09-21T07:50:50.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.367+0000 7f416a000640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41540b65f0 0x7f41540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:50.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.368+0000 7f416a000640 1 -- 172.21.15.84:0/188762698 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4158107c50 con 0x7f416c10b6f0 2024-09-21T07:50:50.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.368+0000 7f4171a00640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41540b65f0 0x7f41540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:50.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.368+0000 7f4171a00640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41540b65f0 0x7f41540b8b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4160009bd0 tx=0x7f4160005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:50.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.372+0000 7f416a000640 1 -- 172.21.15.84:0/188762698 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41580d22d0 con 0x7f416c10b6f0 2024-09-21T07:50:50.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.561+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f416c063800 con 0x7f41540b65f0 2024-09-21T07:50:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.567+0000 7f416a000640 1 -- 172.21.15.84:0/188762698 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340598 (secure 0 0 0) 0x7f416c063800 con 0x7f41540b65f0 2024-09-21T07:50:50.572 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41540b65f0 msgr2=0x7f41540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41540b65f0 0x7f41540b8b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4160009bd0 tx=0x7f4160005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 msgr2=0x7f416c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c19ccf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f415802a910 tx=0x7f4158031a20 comp rx=0 tx=0).stop 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 shutdown_connections 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41540b65f0 0x7f41540b8b00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c10c040 0x7f416c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f416c10b6f0 0x7f416c19ccf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 --2- 172.21.15.84:0/188762698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f416c105db0 0x7f416c19c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.571+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 >> 172.21.15.84:0/188762698 conn(0x7f416c1017e0 msgr2=0x7f416c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.572+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 shutdown_connections 2024-09-21T07:50:50.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:50.572+0000 7f4174400640 1 -- 172.21.15.84:0/188762698 wait complete. 2024-09-21T07:50:50.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:50 smithi162 ceph-mon[34833]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:50.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:50 smithi084 ceph-mon[30411]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:50.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:50 smithi191 ceph-mon[34667]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:51.332 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":386,"stamp":"2024-09-21T07:50:50.024332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1458191,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1784,"num_read_kb":1140,"num_write":614,"num_write_kb":4404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399180,"kb_used_data":16532,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124542644,"statfs":{"total":1151940427776,"available":1151531667456,"internally_reserved":0,"allocated":16928768,"data_stored":10652039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":391492921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":786992,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":361,"num_write":224,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003412"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":194,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:46.366241+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:50:46.366241+0000","last_peered":"2024-09-21T07:50:46.366241+0000","last_clean":"2024-09-21T07:50:46.366241+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:50:46.366241+0000","last_undegraded":"2024-09-21T07:50:46.366241+0000","last_fullsized":"2024-09-21T07:50:46.366241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210401+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:50:00.210401+0000","last_peered":"2024-09-21T07:50:00.210401+0000","last_clean":"2024-09-21T07:50:00.210401+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:50:00.210401+0000","last_undegraded":"2024-09-21T07:50:00.210401+0000","last_fullsized":"2024-09-21T07:50:00.210401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247890+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247890+0000","last_peered":"2024-09-21T07:49:31.247890+0000","last_clean":"2024-09-21T07:49:31.247890+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247890+0000","last_undegraded":"2024-09-21T07:49:31.247890+0000","last_fullsized":"2024-09-21T07:49:31.247890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279185+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279185+0000","last_peered":"2024-09-21T07:49:31.279185+0000","last_clean":"2024-09-21T07:49:31.279185+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279185+0000","last_undegraded":"2024-09-21T07:49:31.279185+0000","last_fullsized":"2024-09-21T07:49:31.279185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230523+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:50:00.230523+0000","last_peered":"2024-09-21T07:50:00.230523+0000","last_clean":"2024-09-21T07:50:00.230523+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:50:00.230523+0000","last_undegraded":"2024-09-21T07:50:00.230523+0000","last_fullsized":"2024-09-21T07:50:00.230523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.280231+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.280231+0000","last_peered":"2024-09-21T07:49:31.280231+0000","last_clean":"2024-09-21T07:49:31.280231+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.280231+0000","last_undegraded":"2024-09-21T07:49:31.280231+0000","last_fullsized":"2024-09-21T07:49:31.280231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162622+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162622+0000","last_peered":"2024-09-21T07:49:31.162622+0000","last_clean":"2024-09-21T07:49:31.162622+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162622+0000","last_undegraded":"2024-09-21T07:49:31.162622+0000","last_fullsized":"2024-09-21T07:49:31.162622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230976+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:50:00.230976+0000","last_peered":"2024-09-21T07:50:00.230976+0000","last_clean":"2024-09-21T07:50:00.230976+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:50:00.230976+0000","last_undegraded":"2024-09-21T07:50:00.230976+0000","last_fullsized":"2024-09-21T07:50:00.230976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162964+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162964+0000","last_peered":"2024-09-21T07:49:31.162964+0000","last_clean":"2024-09-21T07:49:31.162964+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162964+0000","last_undegraded":"2024-09-21T07:49:31.162964+0000","last_fullsized":"2024-09-21T07:49:31.162964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235866+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:50:00.235866+0000","last_peered":"2024-09-21T07:50:00.235866+0000","last_clean":"2024-09-21T07:50:00.235866+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:50:00.235866+0000","last_undegraded":"2024-09-21T07:50:00.235866+0000","last_fullsized":"2024-09-21T07:50:00.235866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162229+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162229+0000","last_peered":"2024-09-21T07:49:31.162229+0000","last_clean":"2024-09-21T07:49:31.162229+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162229+0000","last_undegraded":"2024-09-21T07:49:31.162229+0000","last_fullsized":"2024-09-21T07:49:31.162229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236270+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:50:00.236270+0000","last_peered":"2024-09-21T07:50:00.236270+0000","last_clean":"2024-09-21T07:50:00.236270+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:50:00.236270+0000","last_undegraded":"2024-09-21T07:50:00.236270+0000","last_fullsized":"2024-09-21T07:50:00.236270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162277+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162277+0000","last_peered":"2024-09-21T07:49:31.162277+0000","last_clean":"2024-09-21T07:49:31.162277+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162277+0000","last_undegraded":"2024-09-21T07:49:31.162277+0000","last_fullsized":"2024-09-21T07:49:31.162277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163029+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.163029+0000","last_peered":"2024-09-21T07:49:31.163029+0000","last_clean":"2024-09-21T07:49:31.163029+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.163029+0000","last_undegraded":"2024-09-21T07:49:31.163029+0000","last_fullsized":"2024-09-21T07:49:31.163029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225576+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:50:00.225576+0000","last_peered":"2024-09-21T07:50:00.225576+0000","last_clean":"2024-09-21T07:50:00.225576+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:50:00.225576+0000","last_undegraded":"2024-09-21T07:50:00.225576+0000","last_fullsized":"2024-09-21T07:50:00.225576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247829+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247829+0000","last_peered":"2024-09-21T07:49:31.247829+0000","last_clean":"2024-09-21T07:49:31.247829+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247829+0000","last_undegraded":"2024-09-21T07:49:31.247829+0000","last_fullsized":"2024-09-21T07:49:31.247829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163050+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.163050+0000","last_peered":"2024-09-21T07:49:31.163050+0000","last_clean":"2024-09-21T07:49:31.163050+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.163050+0000","last_undegraded":"2024-09-21T07:49:31.163050+0000","last_fullsized":"2024-09-21T07:49:31.163050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228962+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:50:00.228962+0000","last_peered":"2024-09-21T07:50:00.228962+0000","last_clean":"2024-09-21T07:50:00.228962+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:50:00.228962+0000","last_undegraded":"2024-09-21T07:50:00.228962+0000","last_fullsized":"2024-09-21T07:50:00.228962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278440+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278440+0000","last_peered":"2024-09-21T07:49:31.278440+0000","last_clean":"2024-09-21T07:49:31.278440+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278440+0000","last_undegraded":"2024-09-21T07:49:31.278440+0000","last_fullsized":"2024-09-21T07:49:31.278440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160566+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160566+0000","last_peered":"2024-09-21T07:49:31.160566+0000","last_clean":"2024-09-21T07:49:31.160566+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160566+0000","last_undegraded":"2024-09-21T07:49:31.160566+0000","last_fullsized":"2024-09-21T07:49:31.160566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.182905+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:50:00.182905+0000","last_peered":"2024-09-21T07:50:00.182905+0000","last_clean":"2024-09-21T07:50:00.182905+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:50:00.182905+0000","last_undegraded":"2024-09-21T07:50:00.182905+0000","last_fullsized":"2024-09-21T07:50:00.182905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161028+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.161028+0000","last_peered":"2024-09-21T07:49:31.161028+0000","last_clean":"2024-09-21T07:49:31.161028+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.161028+0000","last_undegraded":"2024-09-21T07:49:31.161028+0000","last_fullsized":"2024-09-21T07:49:31.161028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163163+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163163+0000","last_peered":"2024-09-21T07:49:31.163163+0000","last_clean":"2024-09-21T07:49:31.163163+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163163+0000","last_undegraded":"2024-09-21T07:49:31.163163+0000","last_fullsized":"2024-09-21T07:49:31.163163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228483+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:50:00.228483+0000","last_peered":"2024-09-21T07:50:00.228483+0000","last_clean":"2024-09-21T07:50:00.228483+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:50:00.228483+0000","last_undegraded":"2024-09-21T07:50:00.228483+0000","last_fullsized":"2024-09-21T07:50:00.228483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163371+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163371+0000","last_peered":"2024-09-21T07:49:31.163371+0000","last_clean":"2024-09-21T07:49:31.163371+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163371+0000","last_undegraded":"2024-09-21T07:49:31.163371+0000","last_fullsized":"2024-09-21T07:49:31.163371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247637+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247637+0000","last_peered":"2024-09-21T07:49:31.247637+0000","last_clean":"2024-09-21T07:49:31.247637+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247637+0000","last_undegraded":"2024-09-21T07:49:31.247637+0000","last_fullsized":"2024-09-21T07:49:31.247637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233969+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:50:00.233969+0000","last_peered":"2024-09-21T07:50:00.233969+0000","last_clean":"2024-09-21T07:50:00.233969+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:50:00.233969+0000","last_undegraded":"2024-09-21T07:50:00.233969+0000","last_fullsized":"2024-09-21T07:50:00.233969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'102","reported_seq":236,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:46.009218+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:50:46.009218+0000","last_peered":"2024-09-21T07:50:46.009218+0000","last_clean":"2024-09-21T07:50:46.009218+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:50:46.009218+0000","last_undegraded":"2024-09-21T07:50:46.009218+0000","last_fullsized":"2024-09-21T07:50:46.009218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":186,"num_write_kb":1222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278131+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278131+0000","last_peered":"2024-09-21T07:49:31.278131+0000","last_clean":"2024-09-21T07:49:31.278131+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278131+0000","last_undegraded":"2024-09-21T07:49:31.278131+0000","last_fullsized":"2024-09-21T07:49:31.278131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214205+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:50:00.214205+0000","last_peered":"2024-09-21T07:50:00.214205+0000","last_clean":"2024-09-21T07:50:00.214205+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:50:00.214205+0000","last_undegraded":"2024-09-21T07:50:00.214205+0000","last_fullsized":"2024-09-21T07:50:00.214205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162970+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162970+0000","last_peered":"2024-09-21T07:49:31.162970+0000","last_clean":"2024-09-21T07:49:31.162970+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162970+0000","last_undegraded":"2024-09-21T07:49:31.162970+0000","last_fullsized":"2024-09-21T07:49:31.162970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158456+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158456+0000","last_peered":"2024-09-21T07:49:31.158456+0000","last_clean":"2024-09-21T07:49:31.158456+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158456+0000","last_undegraded":"2024-09-21T07:49:31.158456+0000","last_fullsized":"2024-09-21T07:49:31.158456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212815+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:50:00.212815+0000","last_peered":"2024-09-21T07:50:00.212815+0000","last_clean":"2024-09-21T07:50:00.212815+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:50:00.212815+0000","last_undegraded":"2024-09-21T07:50:00.212815+0000","last_fullsized":"2024-09-21T07:50:00.212815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160485+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160485+0000","last_peered":"2024-09-21T07:49:31.160485+0000","last_clean":"2024-09-21T07:49:31.160485+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160485+0000","last_undegraded":"2024-09-21T07:49:31.160485+0000","last_fullsized":"2024-09-21T07:49:31.160485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162107+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162107+0000","last_peered":"2024-09-21T07:49:31.162107+0000","last_clean":"2024-09-21T07:49:31.162107+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162107+0000","last_undegraded":"2024-09-21T07:49:31.162107+0000","last_fullsized":"2024-09-21T07:49:31.162107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226173+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:50:00.226173+0000","last_peered":"2024-09-21T07:50:00.226173+0000","last_clean":"2024-09-21T07:50:00.226173+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:50:00.226173+0000","last_undegraded":"2024-09-21T07:50:00.226173+0000","last_fullsized":"2024-09-21T07:50:00.226173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":188,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:48.369980+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:50:48.369980+0000","last_peered":"2024-09-21T07:50:48.369980+0000","last_clean":"2024-09-21T07:50:48.369980+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:50:48.369980+0000","last_undegraded":"2024-09-21T07:50:48.369980+0000","last_fullsized":"2024-09-21T07:50:48.369980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":899,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246008+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.246008+0000","last_peered":"2024-09-21T07:49:31.246008+0000","last_clean":"2024-09-21T07:49:31.246008+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.246008+0000","last_undegraded":"2024-09-21T07:49:31.246008+0000","last_fullsized":"2024-09-21T07:49:31.246008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234222+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:50:00.234222+0000","last_peered":"2024-09-21T07:50:00.234222+0000","last_clean":"2024-09-21T07:50:00.234222+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:50:00.234222+0000","last_undegraded":"2024-09-21T07:50:00.234222+0000","last_fullsized":"2024-09-21T07:50:00.234222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:48.369328+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:50:48.369328+0000","last_peered":"2024-09-21T07:50:48.369328+0000","last_clean":"2024-09-21T07:50:48.369328+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:50:48.369328+0000","last_undegraded":"2024-09-21T07:50:48.369328+0000","last_fullsized":"2024-09-21T07:50:48.369328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246470+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246470+0000","last_peered":"2024-09-21T07:49:31.246470+0000","last_clean":"2024-09-21T07:49:31.246470+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246470+0000","last_undegraded":"2024-09-21T07:49:31.246470+0000","last_fullsized":"2024-09-21T07:49:31.246470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215266+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:50:00.215266+0000","last_peered":"2024-09-21T07:50:00.215266+0000","last_clean":"2024-09-21T07:50:00.215266+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:50:00.215266+0000","last_undegraded":"2024-09-21T07:50:00.215266+0000","last_fullsized":"2024-09-21T07:50:00.215266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243292+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243292+0000","last_peered":"2024-09-21T07:49:31.243292+0000","last_clean":"2024-09-21T07:49:31.243292+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243292+0000","last_undegraded":"2024-09-21T07:49:31.243292+0000","last_fullsized":"2024-09-21T07:49:31.243292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247818+0000","last_change":"2024-09-21T07:49:31.247663+0000","last_active":"2024-09-21T07:49:31.247818+0000","last_peered":"2024-09-21T07:49:31.247818+0000","last_clean":"2024-09-21T07:49:31.247818+0000","last_became_active":"2024-09-21T07:49:31.247173+0000","last_became_peered":"2024-09-21T07:49:31.247173+0000","last_unstale":"2024-09-21T07:49:31.247818+0000","last_undegraded":"2024-09-21T07:49:31.247818+0000","last_fullsized":"2024-09-21T07:49:31.247818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:29.114632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229905+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:50:00.229905+0000","last_peered":"2024-09-21T07:50:00.229905+0000","last_clean":"2024-09-21T07:50:00.229905+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:50:00.229905+0000","last_undegraded":"2024-09-21T07:50:00.229905+0000","last_fullsized":"2024-09-21T07:50:00.229905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163025+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.163025+0000","last_peered":"2024-09-21T07:49:31.163025+0000","last_clean":"2024-09-21T07:49:31.163025+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.163025+0000","last_undegraded":"2024-09-21T07:49:31.163025+0000","last_fullsized":"2024-09-21T07:49:31.163025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243589+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243589+0000","last_peered":"2024-09-21T07:49:31.243589+0000","last_clean":"2024-09-21T07:49:31.243589+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243589+0000","last_undegraded":"2024-09-21T07:49:31.243589+0000","last_fullsized":"2024-09-21T07:49:31.243589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236108+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:50:00.236108+0000","last_peered":"2024-09-21T07:50:00.236108+0000","last_clean":"2024-09-21T07:50:00.236108+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:50:00.236108+0000","last_undegraded":"2024-09-21T07:50:00.236108+0000","last_fullsized":"2024-09-21T07:50:00.236108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'7","reported_seq":188,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:45.365098+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:50:45.365098+0000","last_peered":"2024-09-21T07:50:45.365098+0000","last_clean":"2024-09-21T07:50:45.365098+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:50:45.365098+0000","last_undegraded":"2024-09-21T07:50:45.365098+0000","last_fullsized":"2024-09-21T07:50:45.365098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161230+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161230+0000","last_peered":"2024-09-21T07:49:31.161230+0000","last_clean":"2024-09-21T07:49:31.161230+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161230+0000","last_undegraded":"2024-09-21T07:49:31.161230+0000","last_fullsized":"2024-09-21T07:49:31.161230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233772+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:50:00.233772+0000","last_peered":"2024-09-21T07:50:00.233772+0000","last_clean":"2024-09-21T07:50:00.233772+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:50:00.233772+0000","last_undegraded":"2024-09-21T07:50:00.233772+0000","last_fullsized":"2024-09-21T07:50:00.233772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'62","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:45.519934+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:50:45.519934+0000","last_peered":"2024-09-21T07:50:45.519934+0000","last_clean":"2024-09-21T07:50:45.519934+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:50:45.519934+0000","last_undegraded":"2024-09-21T07:50:45.519934+0000","last_fullsized":"2024-09-21T07:50:45.519934+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278758+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278758+0000","last_peered":"2024-09-21T07:49:31.278758+0000","last_clean":"2024-09-21T07:49:31.278758+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278758+0000","last_undegraded":"2024-09-21T07:49:31.278758+0000","last_fullsized":"2024-09-21T07:49:31.278758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231353+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:50:00.231353+0000","last_peered":"2024-09-21T07:50:00.231353+0000","last_clean":"2024-09-21T07:50:00.231353+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:50:00.231353+0000","last_undegraded":"2024-09-21T07:50:00.231353+0000","last_fullsized":"2024-09-21T07:50:00.231353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246326+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246326+0000","last_peered":"2024-09-21T07:49:31.246326+0000","last_clean":"2024-09-21T07:49:31.246326+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246326+0000","last_undegraded":"2024-09-21T07:49:31.246326+0000","last_fullsized":"2024-09-21T07:49:31.246326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246901+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246901+0000","last_peered":"2024-09-21T07:49:31.246901+0000","last_clean":"2024-09-21T07:49:31.246901+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246901+0000","last_undegraded":"2024-09-21T07:49:31.246901+0000","last_fullsized":"2024-09-21T07:49:31.246901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228801+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:50:00.228801+0000","last_peered":"2024-09-21T07:50:00.228801+0000","last_clean":"2024-09-21T07:50:00.228801+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:50:00.228801+0000","last_undegraded":"2024-09-21T07:50:00.228801+0000","last_fullsized":"2024-09-21T07:50:00.228801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162830+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162830+0000","last_peered":"2024-09-21T07:49:31.162830+0000","last_clean":"2024-09-21T07:49:31.162830+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162830+0000","last_undegraded":"2024-09-21T07:49:31.162830+0000","last_fullsized":"2024-09-21T07:49:31.162830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246921+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246921+0000","last_peered":"2024-09-21T07:49:31.246921+0000","last_clean":"2024-09-21T07:49:31.246921+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246921+0000","last_undegraded":"2024-09-21T07:49:31.246921+0000","last_fullsized":"2024-09-21T07:49:31.246921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235805+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:50:00.235805+0000","last_peered":"2024-09-21T07:50:00.235805+0000","last_clean":"2024-09-21T07:50:00.235805+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:50:00.235805+0000","last_undegraded":"2024-09-21T07:50:00.235805+0000","last_fullsized":"2024-09-21T07:50:00.235805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162058+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.162058+0000","last_peered":"2024-09-21T07:49:31.162058+0000","last_clean":"2024-09-21T07:49:31.162058+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.162058+0000","last_undegraded":"2024-09-21T07:49:31.162058+0000","last_fullsized":"2024-09-21T07:49:31.162058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246203+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246203+0000","last_peered":"2024-09-21T07:49:31.246203+0000","last_clean":"2024-09-21T07:49:31.246203+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246203+0000","last_undegraded":"2024-09-21T07:49:31.246203+0000","last_fullsized":"2024-09-21T07:49:31.246203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225861+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:50:00.225861+0000","last_peered":"2024-09-21T07:50:00.225861+0000","last_clean":"2024-09-21T07:50:00.225861+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:50:00.225861+0000","last_undegraded":"2024-09-21T07:50:00.225861+0000","last_fullsized":"2024-09-21T07:50:00.225861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:47.368536+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:50:47.368536+0000","last_peered":"2024-09-21T07:50:47.368536+0000","last_clean":"2024-09-21T07:50:47.368536+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:50:47.368536+0000","last_undegraded":"2024-09-21T07:50:47.368536+0000","last_fullsized":"2024-09-21T07:50:47.368536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226537+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:50:00.226537+0000","last_peered":"2024-09-21T07:50:00.226537+0000","last_clean":"2024-09-21T07:50:00.226537+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:50:00.226537+0000","last_undegraded":"2024-09-21T07:50:00.226537+0000","last_fullsized":"2024-09-21T07:50:00.226537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247713+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247713+0000","last_peered":"2024-09-21T07:49:31.247713+0000","last_clean":"2024-09-21T07:49:31.247713+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247713+0000","last_undegraded":"2024-09-21T07:49:31.247713+0000","last_fullsized":"2024-09-21T07:49:31.247713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158454+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158454+0000","last_peered":"2024-09-21T07:49:31.158454+0000","last_clean":"2024-09-21T07:49:31.158454+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158454+0000","last_undegraded":"2024-09-21T07:49:31.158454+0000","last_fullsized":"2024-09-21T07:49:31.158454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.213866+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:50:00.213866+0000","last_peered":"2024-09-21T07:50:00.213866+0000","last_clean":"2024-09-21T07:50:00.213866+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:50:00.213866+0000","last_undegraded":"2024-09-21T07:50:00.213866+0000","last_fullsized":"2024-09-21T07:50:00.213866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158337+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158337+0000","last_peered":"2024-09-21T07:49:31.158337+0000","last_clean":"2024-09-21T07:49:31.158337+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158337+0000","last_undegraded":"2024-09-21T07:49:31.158337+0000","last_fullsized":"2024-09-21T07:49:31.158337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248339+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248339+0000","last_peered":"2024-09-21T07:49:31.248339+0000","last_clean":"2024-09-21T07:49:31.248339+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248339+0000","last_undegraded":"2024-09-21T07:49:31.248339+0000","last_fullsized":"2024-09-21T07:49:31.248339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.224994+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:50:00.224994+0000","last_peered":"2024-09-21T07:50:00.224994+0000","last_clean":"2024-09-21T07:50:00.224994+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:50:00.224994+0000","last_undegraded":"2024-09-21T07:50:00.224994+0000","last_fullsized":"2024-09-21T07:50:00.224994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'40","reported_seq":357,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:44.363916+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:50:44.363916+0000","last_peered":"2024-09-21T07:50:44.363916+0000","last_clean":"2024-09-21T07:50:44.363916+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:50:44.363916+0000","last_undegraded":"2024-09-21T07:50:44.363916+0000","last_fullsized":"2024-09-21T07:50:44.363916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":208,"num_write":42,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159921+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159921+0000","last_peered":"2024-09-21T07:49:31.159921+0000","last_clean":"2024-09-21T07:49:31.159921+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159921+0000","last_undegraded":"2024-09-21T07:49:31.159921+0000","last_fullsized":"2024-09-21T07:49:31.159921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236544+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:50:00.236544+0000","last_peered":"2024-09-21T07:50:00.236544+0000","last_clean":"2024-09-21T07:50:00.236544+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:50:00.236544+0000","last_undegraded":"2024-09-21T07:50:00.236544+0000","last_fullsized":"2024-09-21T07:50:00.236544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248679+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248679+0000","last_peered":"2024-09-21T07:49:31.248679+0000","last_clean":"2024-09-21T07:49:31.248679+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248679+0000","last_undegraded":"2024-09-21T07:49:31.248679+0000","last_fullsized":"2024-09-21T07:49:31.248679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162313+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162313+0000","last_peered":"2024-09-21T07:49:31.162313+0000","last_clean":"2024-09-21T07:49:31.162313+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162313+0000","last_undegraded":"2024-09-21T07:49:31.162313+0000","last_fullsized":"2024-09-21T07:49:31.162313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227866+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:50:00.227866+0000","last_peered":"2024-09-21T07:50:00.227866+0000","last_clean":"2024-09-21T07:50:00.227866+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:50:00.227866+0000","last_undegraded":"2024-09-21T07:50:00.227866+0000","last_fullsized":"2024-09-21T07:50:00.227866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244633+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244633+0000","last_peered":"2024-09-21T07:49:31.244633+0000","last_clean":"2024-09-21T07:49:31.244633+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244633+0000","last_undegraded":"2024-09-21T07:49:31.244633+0000","last_fullsized":"2024-09-21T07:49:31.244633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159785+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159785+0000","last_peered":"2024-09-21T07:49:31.159785+0000","last_clean":"2024-09-21T07:49:31.159785+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159785+0000","last_undegraded":"2024-09-21T07:49:31.159785+0000","last_fullsized":"2024-09-21T07:49:31.159785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231446+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:50:00.231446+0000","last_peered":"2024-09-21T07:50:00.231446+0000","last_clean":"2024-09-21T07:50:00.231446+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:50:00.231446+0000","last_undegraded":"2024-09-21T07:50:00.231446+0000","last_fullsized":"2024-09-21T07:50:00.231446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":312,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:44.363321+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:50:44.363321+0000","last_peered":"2024-09-21T07:50:44.363321+0000","last_clean":"2024-09-21T07:50:44.363321+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:50:44.363321+0000","last_undegraded":"2024-09-21T07:50:44.363321+0000","last_fullsized":"2024-09-21T07:50:44.363321+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":260,"num_read_kb":260,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277894+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277894+0000","last_peered":"2024-09-21T07:49:31.277894+0000","last_clean":"2024-09-21T07:49:31.277894+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277894+0000","last_undegraded":"2024-09-21T07:49:31.277894+0000","last_fullsized":"2024-09-21T07:49:31.277894+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278984+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278984+0000","last_peered":"2024-09-21T07:49:31.278984+0000","last_clean":"2024-09-21T07:49:31.278984+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278984+0000","last_undegraded":"2024-09-21T07:49:31.278984+0000","last_fullsized":"2024-09-21T07:49:31.278984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225224+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:50:00.225224+0000","last_peered":"2024-09-21T07:50:00.225224+0000","last_clean":"2024-09-21T07:50:00.225224+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:50:00.225224+0000","last_undegraded":"2024-09-21T07:50:00.225224+0000","last_fullsized":"2024-09-21T07:50:00.225224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247909+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247909+0000","last_peered":"2024-09-21T07:49:31.247909+0000","last_clean":"2024-09-21T07:49:31.247909+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247909+0000","last_undegraded":"2024-09-21T07:49:31.247909+0000","last_fullsized":"2024-09-21T07:49:31.247909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158882+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158882+0000","last_peered":"2024-09-21T07:49:31.158882+0000","last_clean":"2024-09-21T07:49:31.158882+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158882+0000","last_undegraded":"2024-09-21T07:49:31.158882+0000","last_fullsized":"2024-09-21T07:49:31.158882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226888+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:50:00.226888+0000","last_peered":"2024-09-21T07:50:00.226888+0000","last_clean":"2024-09-21T07:50:00.226888+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:50:00.226888+0000","last_undegraded":"2024-09-21T07:50:00.226888+0000","last_fullsized":"2024-09-21T07:50:00.226888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245823+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245823+0000","last_peered":"2024-09-21T07:49:31.245823+0000","last_clean":"2024-09-21T07:49:31.245823+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245823+0000","last_undegraded":"2024-09-21T07:49:31.245823+0000","last_fullsized":"2024-09-21T07:49:31.245823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243596+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243596+0000","last_peered":"2024-09-21T07:49:31.243596+0000","last_clean":"2024-09-21T07:49:31.243596+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243596+0000","last_undegraded":"2024-09-21T07:49:31.243596+0000","last_fullsized":"2024-09-21T07:49:31.243596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234552+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:50:00.234552+0000","last_peered":"2024-09-21T07:50:00.234552+0000","last_clean":"2024-09-21T07:50:00.234552+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:50:00.234552+0000","last_undegraded":"2024-09-21T07:50:00.234552+0000","last_fullsized":"2024-09-21T07:50:00.234552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248127+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248127+0000","last_peered":"2024-09-21T07:49:31.248127+0000","last_clean":"2024-09-21T07:49:31.248127+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248127+0000","last_undegraded":"2024-09-21T07:49:31.248127+0000","last_fullsized":"2024-09-21T07:49:31.248127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:46.366626+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:50:46.366626+0000","last_peered":"2024-09-21T07:50:46.366626+0000","last_clean":"2024-09-21T07:50:46.366626+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:50:46.366626+0000","last_undegraded":"2024-09-21T07:50:46.366626+0000","last_fullsized":"2024-09-21T07:50:46.366626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212530+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:50:00.212530+0000","last_peered":"2024-09-21T07:50:00.212530+0000","last_clean":"2024-09-21T07:50:00.212530+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:50:00.212530+0000","last_undegraded":"2024-09-21T07:50:00.212530+0000","last_fullsized":"2024-09-21T07:50:00.212530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248474+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248474+0000","last_peered":"2024-09-21T07:49:31.248474+0000","last_clean":"2024-09-21T07:49:31.248474+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248474+0000","last_undegraded":"2024-09-21T07:49:31.248474+0000","last_fullsized":"2024-09-21T07:49:31.248474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229653+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:50:00.229653+0000","last_peered":"2024-09-21T07:50:00.229653+0000","last_clean":"2024-09-21T07:50:00.229653+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:50:00.229653+0000","last_undegraded":"2024-09-21T07:50:00.229653+0000","last_fullsized":"2024-09-21T07:50:00.229653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214497+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:50:00.214497+0000","last_peered":"2024-09-21T07:50:00.214497+0000","last_clean":"2024-09-21T07:50:00.214497+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:50:00.214497+0000","last_undegraded":"2024-09-21T07:50:00.214497+0000","last_fullsized":"2024-09-21T07:50:00.214497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227306+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:50:00.227306+0000","last_peered":"2024-09-21T07:50:00.227306+0000","last_clean":"2024-09-21T07:50:00.227306+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:50:00.227306+0000","last_undegraded":"2024-09-21T07:50:00.227306+0000","last_fullsized":"2024-09-21T07:50:00.227306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227334+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:50:00.227334+0000","last_peered":"2024-09-21T07:50:00.227334+0000","last_clean":"2024-09-21T07:50:00.227334+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:50:00.227334+0000","last_undegraded":"2024-09-21T07:50:00.227334+0000","last_fullsized":"2024-09-21T07:50:00.227334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227942+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:50:00.227942+0000","last_peered":"2024-09-21T07:50:00.227942+0000","last_clean":"2024-09-21T07:50:00.227942+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:50:00.227942+0000","last_undegraded":"2024-09-21T07:50:00.227942+0000","last_fullsized":"2024-09-21T07:50:00.227942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228389+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:50:00.228389+0000","last_peered":"2024-09-21T07:50:00.228389+0000","last_clean":"2024-09-21T07:50:00.228389+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:50:00.228389+0000","last_undegraded":"2024-09-21T07:50:00.228389+0000","last_fullsized":"2024-09-21T07:50:00.228389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223482+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:50:00.223482+0000","last_peered":"2024-09-21T07:50:00.223482+0000","last_clean":"2024-09-21T07:50:00.223482+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:50:00.223482+0000","last_undegraded":"2024-09-21T07:50:00.223482+0000","last_fullsized":"2024-09-21T07:50:00.223482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.202426+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:50:00.202426+0000","last_peered":"2024-09-21T07:50:00.202426+0000","last_clean":"2024-09-21T07:50:00.202426+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:50:00.202426+0000","last_undegraded":"2024-09-21T07:50:00.202426+0000","last_fullsized":"2024-09-21T07:50:00.202426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228634+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:50:00.228634+0000","last_peered":"2024-09-21T07:50:00.228634+0000","last_clean":"2024-09-21T07:50:00.228634+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:50:00.228634+0000","last_undegraded":"2024-09-21T07:50:00.228634+0000","last_fullsized":"2024-09-21T07:50:00.228634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.219031+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:50:00.219031+0000","last_peered":"2024-09-21T07:50:00.219031+0000","last_clean":"2024-09-21T07:50:00.219031+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:50:00.219031+0000","last_undegraded":"2024-09-21T07:50:00.219031+0000","last_fullsized":"2024-09-21T07:50:00.219031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235687+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:50:00.235687+0000","last_peered":"2024-09-21T07:50:00.235687+0000","last_clean":"2024-09-21T07:50:00.235687+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:50:00.235687+0000","last_undegraded":"2024-09-21T07:50:00.235687+0000","last_fullsized":"2024-09-21T07:50:00.235687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228617+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:50:00.228617+0000","last_peered":"2024-09-21T07:50:00.228617+0000","last_clean":"2024-09-21T07:50:00.228617+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:50:00.228617+0000","last_undegraded":"2024-09-21T07:50:00.228617+0000","last_fullsized":"2024-09-21T07:50:00.228617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227531+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:50:00.227531+0000","last_peered":"2024-09-21T07:50:00.227531+0000","last_clean":"2024-09-21T07:50:00.227531+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:50:00.227531+0000","last_undegraded":"2024-09-21T07:50:00.227531+0000","last_fullsized":"2024-09-21T07:50:00.227531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210770+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:50:00.210770+0000","last_peered":"2024-09-21T07:50:00.210770+0000","last_clean":"2024-09-21T07:50:00.210770+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:50:00.210770+0000","last_undegraded":"2024-09-21T07:50:00.210770+0000","last_fullsized":"2024-09-21T07:50:00.210770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229015+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:50:00.229015+0000","last_peered":"2024-09-21T07:50:00.229015+0000","last_clean":"2024-09-21T07:50:00.229015+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:50:00.229015+0000","last_undegraded":"2024-09-21T07:50:00.229015+0000","last_fullsized":"2024-09-21T07:50:00.229015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231891+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:50:00.231891+0000","last_peered":"2024-09-21T07:50:00.231891+0000","last_clean":"2024-09-21T07:50:00.231891+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:50:00.231891+0000","last_undegraded":"2024-09-21T07:50:00.231891+0000","last_fullsized":"2024-09-21T07:50:00.231891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235579+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:50:00.235579+0000","last_peered":"2024-09-21T07:50:00.235579+0000","last_clean":"2024-09-21T07:50:00.235579+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:50:00.235579+0000","last_undegraded":"2024-09-21T07:50:00.235579+0000","last_fullsized":"2024-09-21T07:50:00.235579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227718+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:50:00.227718+0000","last_peered":"2024-09-21T07:50:00.227718+0000","last_clean":"2024-09-21T07:50:00.227718+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:50:00.227718+0000","last_undegraded":"2024-09-21T07:50:00.227718+0000","last_fullsized":"2024-09-21T07:50:00.227718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228484+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:50:00.228484+0000","last_peered":"2024-09-21T07:50:00.228484+0000","last_clean":"2024-09-21T07:50:00.228484+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:50:00.228484+0000","last_undegraded":"2024-09-21T07:50:00.228484+0000","last_fullsized":"2024-09-21T07:50:00.228484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223270+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:50:00.223270+0000","last_peered":"2024-09-21T07:50:00.223270+0000","last_clean":"2024-09-21T07:50:00.223270+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:50:00.223270+0000","last_undegraded":"2024-09-21T07:50:00.223270+0000","last_fullsized":"2024-09-21T07:50:00.223270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229604+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:50:00.229604+0000","last_peered":"2024-09-21T07:50:00.229604+0000","last_clean":"2024-09-21T07:50:00.229604+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:50:00.229604+0000","last_undegraded":"2024-09-21T07:50:00.229604+0000","last_fullsized":"2024-09-21T07:50:00.229604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235991+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:50:00.235991+0000","last_peered":"2024-09-21T07:50:00.235991+0000","last_clean":"2024-09-21T07:50:00.235991+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:50:00.235991+0000","last_undegraded":"2024-09-21T07:50:00.235991+0000","last_fullsized":"2024-09-21T07:50:00.235991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210061+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:50:00.210061+0000","last_peered":"2024-09-21T07:50:00.210061+0000","last_clean":"2024-09-21T07:50:00.210061+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:50:00.210061+0000","last_undegraded":"2024-09-21T07:50:00.210061+0000","last_fullsized":"2024-09-21T07:50:00.210061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234725+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:50:00.234725+0000","last_peered":"2024-09-21T07:50:00.234725+0000","last_clean":"2024-09-21T07:50:00.234725+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:50:00.234725+0000","last_undegraded":"2024-09-21T07:50:00.234725+0000","last_fullsized":"2024-09-21T07:50:00.234725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210704+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:50:00.210704+0000","last_peered":"2024-09-21T07:50:00.210704+0000","last_clean":"2024-09-21T07:50:00.210704+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:50:00.210704+0000","last_undegraded":"2024-09-21T07:50:00.210704+0000","last_fullsized":"2024-09-21T07:50:00.210704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233170+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:50:00.233170+0000","last_peered":"2024-09-21T07:50:00.233170+0000","last_clean":"2024-09-21T07:50:00.233170+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:50:00.233170+0000","last_undegraded":"2024-09-21T07:50:00.233170+0000","last_fullsized":"2024-09-21T07:50:00.233170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215521+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:50:00.215521+0000","last_peered":"2024-09-21T07:50:00.215521+0000","last_clean":"2024-09-21T07:50:00.215521+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:50:00.215521+0000","last_undegraded":"2024-09-21T07:50:00.215521+0000","last_fullsized":"2024-09-21T07:50:00.215521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.208038+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:50:00.208038+0000","last_peered":"2024-09-21T07:50:00.208038+0000","last_clean":"2024-09-21T07:50:00.208038+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:50:00.208038+0000","last_undegraded":"2024-09-21T07:50:00.208038+0000","last_fullsized":"2024-09-21T07:50:00.208038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229406+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:50:00.229406+0000","last_peered":"2024-09-21T07:50:00.229406+0000","last_clean":"2024-09-21T07:50:00.229406+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:50:00.229406+0000","last_undegraded":"2024-09-21T07:50:00.229406+0000","last_fullsized":"2024-09-21T07:50:00.229406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230493+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:50:00.230493+0000","last_peered":"2024-09-21T07:50:00.230493+0000","last_clean":"2024-09-21T07:50:00.230493+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:50:00.230493+0000","last_undegraded":"2024-09-21T07:50:00.230493+0000","last_fullsized":"2024-09-21T07:50:00.230493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.220776+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:50:00.220776+0000","last_peered":"2024-09-21T07:50:00.220776+0000","last_clean":"2024-09-21T07:50:00.220776+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:50:00.220776+0000","last_undegraded":"2024-09-21T07:50:00.220776+0000","last_fullsized":"2024-09-21T07:50:00.220776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230134+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:50:00.230134+0000","last_peered":"2024-09-21T07:50:00.230134+0000","last_clean":"2024-09-21T07:50:00.230134+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:50:00.230134+0000","last_undegraded":"2024-09-21T07:50:00.230134+0000","last_fullsized":"2024-09-21T07:50:00.230134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":867589,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1703,"num_read_kb":1071,"num_write":489,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2973696,"data_stored":2602767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":526920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906999,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37424,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707728,"statfs":{"total":95995035648,"available":95956713472,"internally_reserved":0,"allocated":2129920,"data_stored":1579130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070527,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36760,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708392,"statfs":{"total":95995035648,"available":95957393408,"internally_reserved":0,"allocated":1449984,"data_stored":922980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266756,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":918680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462986,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1646592,"data_stored":1122995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626511,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822740,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29088,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716064,"statfs":{"total":95995035648,"available":95965249536,"internally_reserved":0,"allocated":2052096,"data_stored":1512042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986266,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182496,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28872,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716280,"statfs":{"total":95995035648,"available":95965470720,"internally_reserved":0,"allocated":1830912,"data_stored":1307872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":596218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":595313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705775,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":523160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":74863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":787422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":468312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:50:51.337 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:50:51.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:50:51.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:51 smithi084 ceph-mon[30411]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:51.710 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:51.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:51 smithi162 ceph-mon[34833]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:51.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:51 smithi191 ceph-mon[34667]: from='client.15594 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:52.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 -- 172.21.15.84:0/259513666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e84103b80 msgr2=0x7f8e84103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:52.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 --2- 172.21.15.84:0/259513666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e84103b80 0x7f8e84103f90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009900 tx=0x7f8e7402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 -- 172.21.15.84:0/259513666 shutdown_connections 2024-09-21T07:50:52.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 --2- 172.21.15.84:0/259513666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e84109e10 0x7f8e84110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 --2- 172.21.15.84:0/259513666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e841094c0 0x7f8e841098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 --2- 172.21.15.84:0/259513666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e84103b80 0x7f8e84103f90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 -- 172.21.15.84:0/259513666 >> 172.21.15.84:0/259513666 conn(0x7f8e840ff5d0 msgr2=0x7f8e84101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:52.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 -- 172.21.15.84:0/259513666 shutdown_connections 2024-09-21T07:50:52.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.310+0000 7f8e89400640 1 -- 172.21.15.84:0/259513666 wait complete. 2024-09-21T07:50:52.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 Processor -- start 2024-09-21T07:50:52.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 -- start start 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e84103b80 0x7f8e8419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e841094c0 0x7f8e8419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e84109e10 0x7f8e841a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84113ad0 con 0x7f8e841094c0 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84113950 con 0x7f8e84103b80 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.312+0000 7f8e89400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84113c50 con 0x7f8e84109e10 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e841094c0 0x7f8e8419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e841094c0 0x7f8e8419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37990/0 (socket says 172.21.15.84:37990) 2024-09-21T07:50:52.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 -- 172.21.15.84:0/1456664587 learned_addr learned my addr 172.21.15.84:0/1456664587 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:52.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e82800640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e84103b80 0x7f8e8419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:52.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e83200640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e84109e10 0x7f8e841a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:52.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 -- 172.21.15.84:0/1456664587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e84109e10 msgr2=0x7f8e841a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:52.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e84109e10 0x7f8e841a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 -- 172.21.15.84:0/1456664587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e84103b80 msgr2=0x7f8e8419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e84103b80 0x7f8e8419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.313+0000 7f8e79e00640 1 -- 172.21.15.84:0/1456664587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e841a2650 con 0x7f8e841094c0 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.314+0000 7f8e79e00640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e841094c0 0x7f8e8419cc80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e9f0 tx=0x7f8e6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.314+0000 7f8e7be00640 1 -- 172.21.15.84:0/1456664587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00ccc0 con 0x7f8e841094c0 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.314+0000 7f8e7be00640 1 -- 172.21.15.84:0/1456664587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e6c0108e0 con 0x7f8e841094c0 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.314+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e841a2940 con 0x7f8e841094c0 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.314+0000 7f8e7be00640 1 -- 172.21.15.84:0/1456664587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c018860 con 0x7f8e841094c0 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.314+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e841a90a0 con 0x7f8e841094c0 2024-09-21T07:50:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.315+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e84103f90 con 0x7f8e841094c0 2024-09-21T07:50:52.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.318+0000 7f8e7be00640 1 -- 172.21.15.84:0/1456664587 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f8e6c010430 con 0x7f8e841094c0 2024-09-21T07:50:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.319+0000 7f8e7be00640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e680b65f0 0x7f8e680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.319+0000 7f8e7be00640 1 -- 172.21.15.84:0/1456664587 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8e6c0e80a0 con 0x7f8e841094c0 2024-09-21T07:50:52.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.320+0000 7f8e82800640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e680b65f0 0x7f8e680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:52.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.320+0000 7f8e82800640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e680b65f0 0x7f8e680b8b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8e74031440 tx=0x7f8e74009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.321+0000 7f8e7be00640 1 -- 172.21.15.84:0/1456664587 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e6c0b2760 con 0x7f8e841094c0 2024-09-21T07:50:52.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.507+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e8410f8f0 con 0x7f8e680b65f0 2024-09-21T07:50:52.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.513+0000 7f8e7be00640 1 -- 172.21.15.84:0/1456664587 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340598 (secure 0 0 0) 0x7f8e8410f8f0 con 0x7f8e680b65f0 2024-09-21T07:50:52.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:52.521 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T07:50:52.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.518+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e680b65f0 msgr2=0x7f8e680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:52.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.518+0000 7f8e89400640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e680b65f0 0x7f8e680b8b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8e74031440 tx=0x7f8e74009560 comp rx=0 tx=0).stop 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.518+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e841094c0 msgr2=0x7f8e8419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.518+0000 7f8e89400640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e841094c0 0x7f8e8419cc80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e9f0 tx=0x7f8e6c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 shutdown_connections 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e680b65f0 0x7f8e680b8b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e84109e10 0x7f8e841a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e841094c0 0x7f8e8419cc80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 --2- 172.21.15.84:0/1456664587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e84103b80 0x7f8e8419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 >> 172.21.15.84:0/1456664587 conn(0x7f8e840ff5d0 msgr2=0x7f8e84108bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 shutdown_connections 2024-09-21T07:50:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:52.519+0000 7f8e89400640 1 -- 172.21.15.84:0/1456664587 wait complete. 2024-09-21T07:50:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:52 smithi162 ceph-mon[34833]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:52.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:52 smithi084 ceph-mon[30411]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:52.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:52 smithi191 ceph-mon[34667]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:53.451 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-21T07:50:52.024941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1458191,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1809,"num_read_kb":1155,"num_write":614,"num_write_kb":4404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951874,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399240,"kb_used_data":16532,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124542584,"statfs":{"total":1151940427776,"available":1151531606016,"internally_reserved":0,"allocated":16928768,"data_stored":10652039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":391492921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":786992,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":366,"num_write":224,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003465"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":194,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:46.366241+0000","last_change":"2024-09-21T07:47:37.671422+0000","last_active":"2024-09-21T07:50:46.366241+0000","last_peered":"2024-09-21T07:50:46.366241+0000","last_clean":"2024-09-21T07:50:46.366241+0000","last_became_active":"2024-09-21T07:47:37.671095+0000","last_became_peered":"2024-09-21T07:47:37.671095+0000","last_unstale":"2024-09-21T07:50:46.366241+0000","last_undegraded":"2024-09-21T07:50:46.366241+0000","last_fullsized":"2024-09-21T07:50:46.366241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:36.145396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210401+0000","last_change":"2024-09-21T07:47:40.724296+0000","last_active":"2024-09-21T07:50:00.210401+0000","last_peered":"2024-09-21T07:50:00.210401+0000","last_clean":"2024-09-21T07:50:00.210401+0000","last_became_active":"2024-09-21T07:47:40.720944+0000","last_became_peered":"2024-09-21T07:47:40.720944+0000","last_unstale":"2024-09-21T07:50:00.210401+0000","last_undegraded":"2024-09-21T07:50:00.210401+0000","last_fullsized":"2024-09-21T07:50:00.210401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:36.256342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247890+0000","last_change":"2024-09-21T07:47:49.754207+0000","last_active":"2024-09-21T07:49:31.247890+0000","last_peered":"2024-09-21T07:49:31.247890+0000","last_clean":"2024-09-21T07:49:31.247890+0000","last_became_active":"2024-09-21T07:47:49.753852+0000","last_became_peered":"2024-09-21T07:47:49.753852+0000","last_unstale":"2024-09-21T07:49:31.247890+0000","last_undegraded":"2024-09-21T07:49:31.247890+0000","last_fullsized":"2024-09-21T07:49:31.247890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:46.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.279185+0000","last_change":"2024-09-21T07:47:38.174101+0000","last_active":"2024-09-21T07:49:31.279185+0000","last_peered":"2024-09-21T07:49:31.279185+0000","last_clean":"2024-09-21T07:49:31.279185+0000","last_became_active":"2024-09-21T07:47:38.172538+0000","last_became_peered":"2024-09-21T07:47:38.172538+0000","last_unstale":"2024-09-21T07:49:31.279185+0000","last_undegraded":"2024-09-21T07:49:31.279185+0000","last_fullsized":"2024-09-21T07:49:31.279185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:31.413353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230523+0000","last_change":"2024-09-21T07:47:40.709216+0000","last_active":"2024-09-21T07:50:00.230523+0000","last_peered":"2024-09-21T07:50:00.230523+0000","last_clean":"2024-09-21T07:50:00.230523+0000","last_became_active":"2024-09-21T07:47:40.708741+0000","last_became_peered":"2024-09-21T07:47:40.708741+0000","last_unstale":"2024-09-21T07:50:00.230523+0000","last_undegraded":"2024-09-21T07:50:00.230523+0000","last_fullsized":"2024-09-21T07:50:00.230523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:30.691122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.280231+0000","last_change":"2024-09-21T07:49:31.279720+0000","last_active":"2024-09-21T07:49:31.280231+0000","last_peered":"2024-09-21T07:49:31.280231+0000","last_clean":"2024-09-21T07:49:31.280231+0000","last_became_active":"2024-09-21T07:49:31.279269+0000","last_became_peered":"2024-09-21T07:49:31.279269+0000","last_unstale":"2024-09-21T07:49:31.280231+0000","last_undegraded":"2024-09-21T07:49:31.280231+0000","last_fullsized":"2024-09-21T07:49:31.280231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:45.481721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162622+0000","last_change":"2024-09-21T07:47:37.670972+0000","last_active":"2024-09-21T07:49:31.162622+0000","last_peered":"2024-09-21T07:49:31.162622+0000","last_clean":"2024-09-21T07:49:31.162622+0000","last_became_active":"2024-09-21T07:47:37.670516+0000","last_became_peered":"2024-09-21T07:47:37.670516+0000","last_unstale":"2024-09-21T07:49:31.162622+0000","last_undegraded":"2024-09-21T07:49:31.162622+0000","last_fullsized":"2024-09-21T07:49:31.162622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:21.474905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230976+0000","last_change":"2024-09-21T07:47:40.715063+0000","last_active":"2024-09-21T07:50:00.230976+0000","last_peered":"2024-09-21T07:50:00.230976+0000","last_clean":"2024-09-21T07:50:00.230976+0000","last_became_active":"2024-09-21T07:47:40.714682+0000","last_became_peered":"2024-09-21T07:47:40.714682+0000","last_unstale":"2024-09-21T07:50:00.230976+0000","last_undegraded":"2024-09-21T07:50:00.230976+0000","last_fullsized":"2024-09-21T07:50:00.230976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:35.816012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162964+0000","last_change":"2024-09-21T07:47:49.752913+0000","last_active":"2024-09-21T07:49:31.162964+0000","last_peered":"2024-09-21T07:49:31.162964+0000","last_clean":"2024-09-21T07:49:31.162964+0000","last_became_active":"2024-09-21T07:47:49.752344+0000","last_became_peered":"2024-09-21T07:47:49.752344+0000","last_unstale":"2024-09-21T07:49:31.162964+0000","last_undegraded":"2024-09-21T07:49:31.162964+0000","last_fullsized":"2024-09-21T07:49:31.162964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:08.145192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158291+0000","last_change":"2024-09-21T07:48:31.106808+0000","last_active":"2024-09-21T07:49:31.158291+0000","last_peered":"2024-09-21T07:49:31.158291+0000","last_clean":"2024-09-21T07:49:31.158291+0000","last_became_active":"2024-09-21T07:48:31.097169+0000","last_became_peered":"2024-09-21T07:48:31.097169+0000","last_unstale":"2024-09-21T07:49:31.158291+0000","last_undegraded":"2024-09-21T07:49:31.158291+0000","last_fullsized":"2024-09-21T07:49:31.158291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:41.194553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235866+0000","last_change":"2024-09-21T07:47:40.720714+0000","last_active":"2024-09-21T07:50:00.235866+0000","last_peered":"2024-09-21T07:50:00.235866+0000","last_clean":"2024-09-21T07:50:00.235866+0000","last_became_active":"2024-09-21T07:47:40.720270+0000","last_became_peered":"2024-09-21T07:47:40.720270+0000","last_unstale":"2024-09-21T07:50:00.235866+0000","last_undegraded":"2024-09-21T07:50:00.235866+0000","last_fullsized":"2024-09-21T07:50:00.235866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:43.835590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162229+0000","last_change":"2024-09-21T07:47:49.754413+0000","last_active":"2024-09-21T07:49:31.162229+0000","last_peered":"2024-09-21T07:49:31.162229+0000","last_clean":"2024-09-21T07:49:31.162229+0000","last_became_active":"2024-09-21T07:47:49.753838+0000","last_became_peered":"2024-09-21T07:47:49.753838+0000","last_unstale":"2024-09-21T07:49:31.162229+0000","last_undegraded":"2024-09-21T07:49:31.162229+0000","last_fullsized":"2024-09-21T07:49:31.162229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:28.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236270+0000","last_change":"2024-09-21T07:47:40.710510+0000","last_active":"2024-09-21T07:50:00.236270+0000","last_peered":"2024-09-21T07:50:00.236270+0000","last_clean":"2024-09-21T07:50:00.236270+0000","last_became_active":"2024-09-21T07:47:40.709642+0000","last_became_peered":"2024-09-21T07:47:40.709642+0000","last_unstale":"2024-09-21T07:50:00.236270+0000","last_undegraded":"2024-09-21T07:50:00.236270+0000","last_fullsized":"2024-09-21T07:50:00.236270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:00.164963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162277+0000","last_change":"2024-09-21T07:47:37.670948+0000","last_active":"2024-09-21T07:49:31.162277+0000","last_peered":"2024-09-21T07:49:31.162277+0000","last_clean":"2024-09-21T07:49:31.162277+0000","last_became_active":"2024-09-21T07:47:37.670526+0000","last_became_peered":"2024-09-21T07:47:37.670526+0000","last_unstale":"2024-09-21T07:49:31.162277+0000","last_undegraded":"2024-09-21T07:49:31.162277+0000","last_fullsized":"2024-09-21T07:49:31.162277+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:25.707191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163029+0000","last_change":"2024-09-21T07:47:50.066316+0000","last_active":"2024-09-21T07:49:31.163029+0000","last_peered":"2024-09-21T07:49:31.163029+0000","last_clean":"2024-09-21T07:49:31.163029+0000","last_became_active":"2024-09-21T07:47:50.065524+0000","last_became_peered":"2024-09-21T07:47:50.065524+0000","last_unstale":"2024-09-21T07:49:31.163029+0000","last_undegraded":"2024-09-21T07:49:31.163029+0000","last_fullsized":"2024-09-21T07:49:31.163029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:49.076494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225576+0000","last_change":"2024-09-21T07:47:40.709185+0000","last_active":"2024-09-21T07:50:00.225576+0000","last_peered":"2024-09-21T07:50:00.225576+0000","last_clean":"2024-09-21T07:50:00.225576+0000","last_became_active":"2024-09-21T07:47:40.708841+0000","last_became_peered":"2024-09-21T07:47:40.708841+0000","last_unstale":"2024-09-21T07:50:00.225576+0000","last_undegraded":"2024-09-21T07:50:00.225576+0000","last_fullsized":"2024-09-21T07:50:00.225576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:14.883027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247829+0000","last_change":"2024-09-21T07:47:37.668598+0000","last_active":"2024-09-21T07:49:31.247829+0000","last_peered":"2024-09-21T07:49:31.247829+0000","last_clean":"2024-09-21T07:49:31.247829+0000","last_became_active":"2024-09-21T07:47:37.668182+0000","last_became_peered":"2024-09-21T07:47:37.668182+0000","last_unstale":"2024-09-21T07:49:31.247829+0000","last_undegraded":"2024-09-21T07:49:31.247829+0000","last_fullsized":"2024-09-21T07:49:31.247829+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:53.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163050+0000","last_change":"2024-09-21T07:47:49.753817+0000","last_active":"2024-09-21T07:49:31.163050+0000","last_peered":"2024-09-21T07:49:31.163050+0000","last_clean":"2024-09-21T07:49:31.163050+0000","last_became_active":"2024-09-21T07:47:49.752366+0000","last_became_peered":"2024-09-21T07:47:49.752366+0000","last_unstale":"2024-09-21T07:49:31.163050+0000","last_undegraded":"2024-09-21T07:49:31.163050+0000","last_fullsized":"2024-09-21T07:49:31.163050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:26.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228962+0000","last_change":"2024-09-21T07:47:40.711650+0000","last_active":"2024-09-21T07:50:00.228962+0000","last_peered":"2024-09-21T07:50:00.228962+0000","last_clean":"2024-09-21T07:50:00.228962+0000","last_became_active":"2024-09-21T07:47:40.711311+0000","last_became_peered":"2024-09-21T07:47:40.711311+0000","last_unstale":"2024-09-21T07:50:00.228962+0000","last_undegraded":"2024-09-21T07:50:00.228962+0000","last_fullsized":"2024-09-21T07:50:00.228962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:04.912074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278440+0000","last_change":"2024-09-21T07:47:37.666983+0000","last_active":"2024-09-21T07:49:31.278440+0000","last_peered":"2024-09-21T07:49:31.278440+0000","last_clean":"2024-09-21T07:49:31.278440+0000","last_became_active":"2024-09-21T07:47:37.666507+0000","last_became_peered":"2024-09-21T07:47:37.666507+0000","last_unstale":"2024-09-21T07:49:31.278440+0000","last_undegraded":"2024-09-21T07:49:31.278440+0000","last_fullsized":"2024-09-21T07:49:31.278440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:37.793922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160566+0000","last_change":"2024-09-21T07:47:49.754615+0000","last_active":"2024-09-21T07:49:31.160566+0000","last_peered":"2024-09-21T07:49:31.160566+0000","last_clean":"2024-09-21T07:49:31.160566+0000","last_became_active":"2024-09-21T07:47:49.752537+0000","last_became_peered":"2024-09-21T07:47:49.752537+0000","last_unstale":"2024-09-21T07:49:31.160566+0000","last_undegraded":"2024-09-21T07:49:31.160566+0000","last_fullsized":"2024-09-21T07:49:31.160566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:07.453997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.182905+0000","last_change":"2024-09-21T07:47:40.706793+0000","last_active":"2024-09-21T07:50:00.182905+0000","last_peered":"2024-09-21T07:50:00.182905+0000","last_clean":"2024-09-21T07:50:00.182905+0000","last_became_active":"2024-09-21T07:47:40.706398+0000","last_became_peered":"2024-09-21T07:47:40.706398+0000","last_unstale":"2024-09-21T07:50:00.182905+0000","last_undegraded":"2024-09-21T07:50:00.182905+0000","last_fullsized":"2024-09-21T07:50:00.182905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:47.330879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161028+0000","last_change":"2024-09-21T07:47:38.172863+0000","last_active":"2024-09-21T07:49:31.161028+0000","last_peered":"2024-09-21T07:49:31.161028+0000","last_clean":"2024-09-21T07:49:31.161028+0000","last_became_active":"2024-09-21T07:47:38.172438+0000","last_became_peered":"2024-09-21T07:47:38.172438+0000","last_unstale":"2024-09-21T07:49:31.161028+0000","last_undegraded":"2024-09-21T07:49:31.161028+0000","last_fullsized":"2024-09-21T07:49:31.161028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:46.357405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163163+0000","last_change":"2024-09-21T07:47:50.065494+0000","last_active":"2024-09-21T07:49:31.163163+0000","last_peered":"2024-09-21T07:49:31.163163+0000","last_clean":"2024-09-21T07:49:31.163163+0000","last_became_active":"2024-09-21T07:47:50.064994+0000","last_became_peered":"2024-09-21T07:47:50.064994+0000","last_unstale":"2024-09-21T07:49:31.163163+0000","last_undegraded":"2024-09-21T07:49:31.163163+0000","last_fullsized":"2024-09-21T07:49:31.163163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:29.750098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228483+0000","last_change":"2024-09-21T07:47:40.725341+0000","last_active":"2024-09-21T07:50:00.228483+0000","last_peered":"2024-09-21T07:50:00.228483+0000","last_clean":"2024-09-21T07:50:00.228483+0000","last_became_active":"2024-09-21T07:47:40.724840+0000","last_became_peered":"2024-09-21T07:47:40.724840+0000","last_unstale":"2024-09-21T07:50:00.228483+0000","last_undegraded":"2024-09-21T07:50:00.228483+0000","last_fullsized":"2024-09-21T07:50:00.228483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:10.344505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163371+0000","last_change":"2024-09-21T07:47:38.528035+0000","last_active":"2024-09-21T07:49:31.163371+0000","last_peered":"2024-09-21T07:49:31.163371+0000","last_clean":"2024-09-21T07:49:31.163371+0000","last_became_active":"2024-09-21T07:47:38.527658+0000","last_became_peered":"2024-09-21T07:47:38.527658+0000","last_unstale":"2024-09-21T07:49:31.163371+0000","last_undegraded":"2024-09-21T07:49:31.163371+0000","last_fullsized":"2024-09-21T07:49:31.163371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:36.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247637+0000","last_change":"2024-09-21T07:47:49.745858+0000","last_active":"2024-09-21T07:49:31.247637+0000","last_peered":"2024-09-21T07:49:31.247637+0000","last_clean":"2024-09-21T07:49:31.247637+0000","last_became_active":"2024-09-21T07:47:49.745360+0000","last_became_peered":"2024-09-21T07:47:49.745360+0000","last_unstale":"2024-09-21T07:49:31.247637+0000","last_undegraded":"2024-09-21T07:49:31.247637+0000","last_fullsized":"2024-09-21T07:49:31.247637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:13.275902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233969+0000","last_change":"2024-09-21T07:47:40.701178+0000","last_active":"2024-09-21T07:50:00.233969+0000","last_peered":"2024-09-21T07:50:00.233969+0000","last_clean":"2024-09-21T07:50:00.233969+0000","last_became_active":"2024-09-21T07:47:40.700678+0000","last_became_peered":"2024-09-21T07:47:40.700678+0000","last_unstale":"2024-09-21T07:50:00.233969+0000","last_undegraded":"2024-09-21T07:50:00.233969+0000","last_fullsized":"2024-09-21T07:50:00.233969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:35.460345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'102","reported_seq":236,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:46.009218+0000","last_change":"2024-09-21T07:47:37.670177+0000","last_active":"2024-09-21T07:50:46.009218+0000","last_peered":"2024-09-21T07:50:46.009218+0000","last_clean":"2024-09-21T07:50:46.009218+0000","last_became_active":"2024-09-21T07:47:37.669777+0000","last_became_peered":"2024-09-21T07:47:37.669777+0000","last_unstale":"2024-09-21T07:50:46.009218+0000","last_undegraded":"2024-09-21T07:50:46.009218+0000","last_fullsized":"2024-09-21T07:50:46.009218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:35.154743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":186,"num_write_kb":1222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278131+0000","last_change":"2024-09-21T07:47:50.065709+0000","last_active":"2024-09-21T07:49:31.278131+0000","last_peered":"2024-09-21T07:49:31.278131+0000","last_clean":"2024-09-21T07:49:31.278131+0000","last_became_active":"2024-09-21T07:47:50.065094+0000","last_became_peered":"2024-09-21T07:47:50.065094+0000","last_unstale":"2024-09-21T07:49:31.278131+0000","last_undegraded":"2024-09-21T07:49:31.278131+0000","last_fullsized":"2024-09-21T07:49:31.278131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:39.181600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214205+0000","last_change":"2024-09-21T07:47:40.717479+0000","last_active":"2024-09-21T07:50:00.214205+0000","last_peered":"2024-09-21T07:50:00.214205+0000","last_clean":"2024-09-21T07:50:00.214205+0000","last_became_active":"2024-09-21T07:47:40.716699+0000","last_became_peered":"2024-09-21T07:47:40.716699+0000","last_unstale":"2024-09-21T07:50:00.214205+0000","last_undegraded":"2024-09-21T07:50:00.214205+0000","last_fullsized":"2024-09-21T07:50:00.214205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:56.826145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162970+0000","last_change":"2024-09-21T07:47:38.173560+0000","last_active":"2024-09-21T07:49:31.162970+0000","last_peered":"2024-09-21T07:49:31.162970+0000","last_clean":"2024-09-21T07:49:31.162970+0000","last_became_active":"2024-09-21T07:47:38.172679+0000","last_became_peered":"2024-09-21T07:47:38.172679+0000","last_unstale":"2024-09-21T07:49:31.162970+0000","last_undegraded":"2024-09-21T07:49:31.162970+0000","last_fullsized":"2024-09-21T07:49:31.162970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:52.379616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158456+0000","last_change":"2024-09-21T07:47:49.745855+0000","last_active":"2024-09-21T07:49:31.158456+0000","last_peered":"2024-09-21T07:49:31.158456+0000","last_clean":"2024-09-21T07:49:31.158456+0000","last_became_active":"2024-09-21T07:47:49.745218+0000","last_became_peered":"2024-09-21T07:47:49.745218+0000","last_unstale":"2024-09-21T07:49:31.158456+0000","last_undegraded":"2024-09-21T07:49:31.158456+0000","last_fullsized":"2024-09-21T07:49:31.158456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:19.425818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212815+0000","last_change":"2024-09-21T07:47:40.713796+0000","last_active":"2024-09-21T07:50:00.212815+0000","last_peered":"2024-09-21T07:50:00.212815+0000","last_clean":"2024-09-21T07:50:00.212815+0000","last_became_active":"2024-09-21T07:47:40.713345+0000","last_became_peered":"2024-09-21T07:47:40.713345+0000","last_unstale":"2024-09-21T07:50:00.212815+0000","last_undegraded":"2024-09-21T07:50:00.212815+0000","last_fullsized":"2024-09-21T07:50:00.212815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.582227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.160485+0000","last_change":"2024-09-21T07:47:38.175042+0000","last_active":"2024-09-21T07:49:31.160485+0000","last_peered":"2024-09-21T07:49:31.160485+0000","last_clean":"2024-09-21T07:49:31.160485+0000","last_became_active":"2024-09-21T07:47:38.173311+0000","last_became_peered":"2024-09-21T07:47:38.173311+0000","last_unstale":"2024-09-21T07:49:31.160485+0000","last_undegraded":"2024-09-21T07:49:31.160485+0000","last_fullsized":"2024-09-21T07:49:31.160485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.940684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162107+0000","last_change":"2024-09-21T07:48:31.097954+0000","last_active":"2024-09-21T07:49:31.162107+0000","last_peered":"2024-09-21T07:49:31.162107+0000","last_clean":"2024-09-21T07:49:31.162107+0000","last_became_active":"2024-09-21T07:48:31.097385+0000","last_became_peered":"2024-09-21T07:48:31.097385+0000","last_unstale":"2024-09-21T07:49:31.162107+0000","last_undegraded":"2024-09-21T07:49:31.162107+0000","last_fullsized":"2024-09-21T07:49:31.162107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226173+0000","last_change":"2024-09-21T07:47:40.727621+0000","last_active":"2024-09-21T07:50:00.226173+0000","last_peered":"2024-09-21T07:50:00.226173+0000","last_clean":"2024-09-21T07:50:00.226173+0000","last_became_active":"2024-09-21T07:47:40.727212+0000","last_became_peered":"2024-09-21T07:47:40.727212+0000","last_unstale":"2024-09-21T07:50:00.226173+0000","last_undegraded":"2024-09-21T07:50:00.226173+0000","last_fullsized":"2024-09-21T07:50:00.226173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:05.276800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":188,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:48.369980+0000","last_change":"2024-09-21T07:47:37.668829+0000","last_active":"2024-09-21T07:50:48.369980+0000","last_peered":"2024-09-21T07:50:48.369980+0000","last_clean":"2024-09-21T07:50:48.369980+0000","last_became_active":"2024-09-21T07:47:37.668388+0000","last_became_peered":"2024-09-21T07:47:37.668388+0000","last_unstale":"2024-09-21T07:50:48.369980+0000","last_undegraded":"2024-09-21T07:50:48.369980+0000","last_fullsized":"2024-09-21T07:50:48.369980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:59.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":899,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246008+0000","last_change":"2024-09-21T07:47:49.757161+0000","last_active":"2024-09-21T07:49:31.246008+0000","last_peered":"2024-09-21T07:49:31.246008+0000","last_clean":"2024-09-21T07:49:31.246008+0000","last_became_active":"2024-09-21T07:47:49.755091+0000","last_became_peered":"2024-09-21T07:47:49.755091+0000","last_unstale":"2024-09-21T07:49:31.246008+0000","last_undegraded":"2024-09-21T07:49:31.246008+0000","last_fullsized":"2024-09-21T07:49:31.246008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:43.250939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234222+0000","last_change":"2024-09-21T07:47:40.712815+0000","last_active":"2024-09-21T07:50:00.234222+0000","last_peered":"2024-09-21T07:50:00.234222+0000","last_clean":"2024-09-21T07:50:00.234222+0000","last_became_active":"2024-09-21T07:47:40.712481+0000","last_became_peered":"2024-09-21T07:47:40.712481+0000","last_unstale":"2024-09-21T07:50:00.234222+0000","last_undegraded":"2024-09-21T07:50:00.234222+0000","last_fullsized":"2024-09-21T07:50:00.234222+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:08.435528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:48.369328+0000","last_change":"2024-09-21T07:47:38.173190+0000","last_active":"2024-09-21T07:50:48.369328+0000","last_peered":"2024-09-21T07:50:48.369328+0000","last_clean":"2024-09-21T07:50:48.369328+0000","last_became_active":"2024-09-21T07:47:38.172502+0000","last_became_peered":"2024-09-21T07:47:38.172502+0000","last_unstale":"2024-09-21T07:50:48.369328+0000","last_undegraded":"2024-09-21T07:50:48.369328+0000","last_fullsized":"2024-09-21T07:50:48.369328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.034104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246470+0000","last_change":"2024-09-21T07:47:50.065527+0000","last_active":"2024-09-21T07:49:31.246470+0000","last_peered":"2024-09-21T07:49:31.246470+0000","last_clean":"2024-09-21T07:49:31.246470+0000","last_became_active":"2024-09-21T07:47:50.065046+0000","last_became_peered":"2024-09-21T07:47:50.065046+0000","last_unstale":"2024-09-21T07:49:31.246470+0000","last_undegraded":"2024-09-21T07:49:31.246470+0000","last_fullsized":"2024-09-21T07:49:31.246470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:15.226090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215266+0000","last_change":"2024-09-21T07:47:40.718770+0000","last_active":"2024-09-21T07:50:00.215266+0000","last_peered":"2024-09-21T07:50:00.215266+0000","last_clean":"2024-09-21T07:50:00.215266+0000","last_became_active":"2024-09-21T07:47:40.711946+0000","last_became_peered":"2024-09-21T07:47:40.711946+0000","last_unstale":"2024-09-21T07:50:00.215266+0000","last_undegraded":"2024-09-21T07:50:00.215266+0000","last_fullsized":"2024-09-21T07:50:00.215266+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:48.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243292+0000","last_change":"2024-09-21T07:47:37.670982+0000","last_active":"2024-09-21T07:49:31.243292+0000","last_peered":"2024-09-21T07:49:31.243292+0000","last_clean":"2024-09-21T07:49:31.243292+0000","last_became_active":"2024-09-21T07:47:37.670542+0000","last_became_peered":"2024-09-21T07:47:37.670542+0000","last_unstale":"2024-09-21T07:49:31.243292+0000","last_undegraded":"2024-09-21T07:49:31.243292+0000","last_fullsized":"2024-09-21T07:49:31.243292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:45.905519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247818+0000","last_change":"2024-09-21T07:49:31.247663+0000","last_active":"2024-09-21T07:49:31.247818+0000","last_peered":"2024-09-21T07:49:31.247818+0000","last_clean":"2024-09-21T07:49:31.247818+0000","last_became_active":"2024-09-21T07:49:31.247173+0000","last_became_peered":"2024-09-21T07:49:31.247173+0000","last_unstale":"2024-09-21T07:49:31.247818+0000","last_undegraded":"2024-09-21T07:49:31.247818+0000","last_fullsized":"2024-09-21T07:49:31.247818+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:29.114632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229905+0000","last_change":"2024-09-21T07:47:40.716485+0000","last_active":"2024-09-21T07:50:00.229905+0000","last_peered":"2024-09-21T07:50:00.229905+0000","last_clean":"2024-09-21T07:50:00.229905+0000","last_became_active":"2024-09-21T07:47:40.714800+0000","last_became_peered":"2024-09-21T07:47:40.714800+0000","last_unstale":"2024-09-21T07:50:00.229905+0000","last_undegraded":"2024-09-21T07:50:00.229905+0000","last_fullsized":"2024-09-21T07:50:00.229905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:14:19.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.163025+0000","last_change":"2024-09-21T07:47:37.671517+0000","last_active":"2024-09-21T07:49:31.163025+0000","last_peered":"2024-09-21T07:49:31.163025+0000","last_clean":"2024-09-21T07:49:31.163025+0000","last_became_active":"2024-09-21T07:47:37.671064+0000","last_became_peered":"2024-09-21T07:47:37.671064+0000","last_unstale":"2024-09-21T07:49:31.163025+0000","last_undegraded":"2024-09-21T07:49:31.163025+0000","last_fullsized":"2024-09-21T07:49:31.163025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:45.337366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243368+0000","last_change":"2024-09-21T07:46:21.461495+0000","last_active":"2024-09-21T07:49:31.243368+0000","last_peered":"2024-09-21T07:49:31.243368+0000","last_clean":"2024-09-21T07:49:31.243368+0000","last_became_active":"2024-09-21T07:46:21.455757+0000","last_became_peered":"2024-09-21T07:46:21.455757+0000","last_unstale":"2024-09-21T07:49:31.243368+0000","last_undegraded":"2024-09-21T07:49:31.243368+0000","last_fullsized":"2024-09-21T07:49:31.243368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:42:37.075040+0000","last_clean_scrub_stamp":"2024-09-21T07:42:37.075040+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:49.831476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243589+0000","last_change":"2024-09-21T07:47:49.745857+0000","last_active":"2024-09-21T07:49:31.243589+0000","last_peered":"2024-09-21T07:49:31.243589+0000","last_clean":"2024-09-21T07:49:31.243589+0000","last_became_active":"2024-09-21T07:47:49.745344+0000","last_became_peered":"2024-09-21T07:47:49.745344+0000","last_unstale":"2024-09-21T07:49:31.243589+0000","last_undegraded":"2024-09-21T07:49:31.243589+0000","last_fullsized":"2024-09-21T07:49:31.243589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:46.596428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236108+0000","last_change":"2024-09-21T07:47:40.710458+0000","last_active":"2024-09-21T07:50:00.236108+0000","last_peered":"2024-09-21T07:50:00.236108+0000","last_clean":"2024-09-21T07:50:00.236108+0000","last_became_active":"2024-09-21T07:47:40.710078+0000","last_became_peered":"2024-09-21T07:47:40.710078+0000","last_unstale":"2024-09-21T07:50:00.236108+0000","last_undegraded":"2024-09-21T07:50:00.236108+0000","last_fullsized":"2024-09-21T07:50:00.236108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:39.597451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'7","reported_seq":193,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:50.373217+0000","last_change":"2024-09-21T07:47:38.528123+0000","last_active":"2024-09-21T07:50:50.373217+0000","last_peered":"2024-09-21T07:50:50.373217+0000","last_clean":"2024-09-21T07:50:50.373217+0000","last_became_active":"2024-09-21T07:47:38.527697+0000","last_became_peered":"2024-09-21T07:47:38.527697+0000","last_unstale":"2024-09-21T07:50:50.373217+0000","last_undegraded":"2024-09-21T07:50:50.373217+0000","last_fullsized":"2024-09-21T07:50:50.373217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.161230+0000","last_change":"2024-09-21T07:47:49.758822+0000","last_active":"2024-09-21T07:49:31.161230+0000","last_peered":"2024-09-21T07:49:31.161230+0000","last_clean":"2024-09-21T07:49:31.161230+0000","last_became_active":"2024-09-21T07:47:49.758307+0000","last_became_peered":"2024-09-21T07:47:49.758307+0000","last_unstale":"2024-09-21T07:49:31.161230+0000","last_undegraded":"2024-09-21T07:49:31.161230+0000","last_fullsized":"2024-09-21T07:49:31.161230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.065182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233772+0000","last_change":"2024-09-21T07:47:40.711845+0000","last_active":"2024-09-21T07:50:00.233772+0000","last_peered":"2024-09-21T07:50:00.233772+0000","last_clean":"2024-09-21T07:50:00.233772+0000","last_became_active":"2024-09-21T07:47:40.711447+0000","last_became_peered":"2024-09-21T07:47:40.711447+0000","last_unstale":"2024-09-21T07:50:00.233772+0000","last_undegraded":"2024-09-21T07:50:00.233772+0000","last_fullsized":"2024-09-21T07:50:00.233772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:08.721829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'62","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:45.519934+0000","last_change":"2024-09-21T07:47:37.674420+0000","last_active":"2024-09-21T07:50:45.519934+0000","last_peered":"2024-09-21T07:50:45.519934+0000","last_clean":"2024-09-21T07:50:45.519934+0000","last_became_active":"2024-09-21T07:47:37.674070+0000","last_became_peered":"2024-09-21T07:47:37.674070+0000","last_unstale":"2024-09-21T07:50:45.519934+0000","last_undegraded":"2024-09-21T07:50:45.519934+0000","last_fullsized":"2024-09-21T07:50:45.519934+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:51.127839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278758+0000","last_change":"2024-09-21T07:47:49.745530+0000","last_active":"2024-09-21T07:49:31.278758+0000","last_peered":"2024-09-21T07:49:31.278758+0000","last_clean":"2024-09-21T07:49:31.278758+0000","last_became_active":"2024-09-21T07:47:49.745039+0000","last_became_peered":"2024-09-21T07:47:49.745039+0000","last_unstale":"2024-09-21T07:49:31.278758+0000","last_undegraded":"2024-09-21T07:49:31.278758+0000","last_fullsized":"2024-09-21T07:49:31.278758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:51:18.898733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231353+0000","last_change":"2024-09-21T07:47:40.706463+0000","last_active":"2024-09-21T07:50:00.231353+0000","last_peered":"2024-09-21T07:50:00.231353+0000","last_clean":"2024-09-21T07:50:00.231353+0000","last_became_active":"2024-09-21T07:47:40.706045+0000","last_became_peered":"2024-09-21T07:47:40.706045+0000","last_unstale":"2024-09-21T07:50:00.231353+0000","last_undegraded":"2024-09-21T07:50:00.231353+0000","last_fullsized":"2024-09-21T07:50:00.231353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:38.342035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246326+0000","last_change":"2024-09-21T07:47:37.671640+0000","last_active":"2024-09-21T07:49:31.246326+0000","last_peered":"2024-09-21T07:49:31.246326+0000","last_clean":"2024-09-21T07:49:31.246326+0000","last_became_active":"2024-09-21T07:47:37.671206+0000","last_became_peered":"2024-09-21T07:47:37.671206+0000","last_unstale":"2024-09-21T07:49:31.246326+0000","last_undegraded":"2024-09-21T07:49:31.246326+0000","last_fullsized":"2024-09-21T07:49:31.246326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:54.162381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246901+0000","last_change":"2024-09-21T07:47:49.747256+0000","last_active":"2024-09-21T07:49:31.246901+0000","last_peered":"2024-09-21T07:49:31.246901+0000","last_clean":"2024-09-21T07:49:31.246901+0000","last_became_active":"2024-09-21T07:47:49.746668+0000","last_became_peered":"2024-09-21T07:47:49.746668+0000","last_unstale":"2024-09-21T07:49:31.246901+0000","last_undegraded":"2024-09-21T07:49:31.246901+0000","last_fullsized":"2024-09-21T07:49:31.246901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:46.717184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228801+0000","last_change":"2024-09-21T07:47:40.713223+0000","last_active":"2024-09-21T07:50:00.228801+0000","last_peered":"2024-09-21T07:50:00.228801+0000","last_clean":"2024-09-21T07:50:00.228801+0000","last_became_active":"2024-09-21T07:47:40.712849+0000","last_became_peered":"2024-09-21T07:47:40.712849+0000","last_unstale":"2024-09-21T07:50:00.228801+0000","last_undegraded":"2024-09-21T07:50:00.228801+0000","last_fullsized":"2024-09-21T07:50:00.228801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:45.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162830+0000","last_change":"2024-09-21T07:47:37.674602+0000","last_active":"2024-09-21T07:49:31.162830+0000","last_peered":"2024-09-21T07:49:31.162830+0000","last_clean":"2024-09-21T07:49:31.162830+0000","last_became_active":"2024-09-21T07:47:37.674243+0000","last_became_peered":"2024-09-21T07:47:37.674243+0000","last_unstale":"2024-09-21T07:49:31.162830+0000","last_undegraded":"2024-09-21T07:49:31.162830+0000","last_fullsized":"2024-09-21T07:49:31.162830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:47:42.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246921+0000","last_change":"2024-09-21T07:47:49.756855+0000","last_active":"2024-09-21T07:49:31.246921+0000","last_peered":"2024-09-21T07:49:31.246921+0000","last_clean":"2024-09-21T07:49:31.246921+0000","last_became_active":"2024-09-21T07:47:49.755701+0000","last_became_peered":"2024-09-21T07:47:49.755701+0000","last_unstale":"2024-09-21T07:49:31.246921+0000","last_undegraded":"2024-09-21T07:49:31.246921+0000","last_fullsized":"2024-09-21T07:49:31.246921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:44.106481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235805+0000","last_change":"2024-09-21T07:48:31.118623+0000","last_active":"2024-09-21T07:50:00.235805+0000","last_peered":"2024-09-21T07:50:00.235805+0000","last_clean":"2024-09-21T07:50:00.235805+0000","last_became_active":"2024-09-21T07:48:31.118242+0000","last_became_peered":"2024-09-21T07:48:31.118242+0000","last_unstale":"2024-09-21T07:50:00.235805+0000","last_undegraded":"2024-09-21T07:50:00.235805+0000","last_fullsized":"2024-09-21T07:50:00.235805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:32.602839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162058+0000","last_change":"2024-09-21T07:47:38.172992+0000","last_active":"2024-09-21T07:49:31.162058+0000","last_peered":"2024-09-21T07:49:31.162058+0000","last_clean":"2024-09-21T07:49:31.162058+0000","last_became_active":"2024-09-21T07:47:38.172551+0000","last_became_peered":"2024-09-21T07:47:38.172551+0000","last_unstale":"2024-09-21T07:49:31.162058+0000","last_undegraded":"2024-09-21T07:49:31.162058+0000","last_fullsized":"2024-09-21T07:49:31.162058+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:12.957815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.246203+0000","last_change":"2024-09-21T07:47:49.754010+0000","last_active":"2024-09-21T07:49:31.246203+0000","last_peered":"2024-09-21T07:49:31.246203+0000","last_clean":"2024-09-21T07:49:31.246203+0000","last_became_active":"2024-09-21T07:47:49.753571+0000","last_became_peered":"2024-09-21T07:47:49.753571+0000","last_unstale":"2024-09-21T07:49:31.246203+0000","last_undegraded":"2024-09-21T07:49:31.246203+0000","last_fullsized":"2024-09-21T07:49:31.246203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:16.652084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225861+0000","last_change":"2024-09-21T07:47:40.715715+0000","last_active":"2024-09-21T07:50:00.225861+0000","last_peered":"2024-09-21T07:50:00.225861+0000","last_clean":"2024-09-21T07:50:00.225861+0000","last_became_active":"2024-09-21T07:47:40.715302+0000","last_became_peered":"2024-09-21T07:47:40.715302+0000","last_unstale":"2024-09-21T07:50:00.225861+0000","last_undegraded":"2024-09-21T07:50:00.225861+0000","last_fullsized":"2024-09-21T07:50:00.225861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:08.706617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:47.368536+0000","last_change":"2024-09-21T07:47:37.672287+0000","last_active":"2024-09-21T07:50:47.368536+0000","last_peered":"2024-09-21T07:50:47.368536+0000","last_clean":"2024-09-21T07:50:47.368536+0000","last_became_active":"2024-09-21T07:47:37.671915+0000","last_became_peered":"2024-09-21T07:47:37.671915+0000","last_unstale":"2024-09-21T07:50:47.368536+0000","last_undegraded":"2024-09-21T07:50:47.368536+0000","last_fullsized":"2024-09-21T07:50:47.368536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:58.028582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162513+0000","last_change":"2024-09-21T07:48:31.116141+0000","last_active":"2024-09-21T07:49:31.162513+0000","last_peered":"2024-09-21T07:49:31.162513+0000","last_clean":"2024-09-21T07:49:31.162513+0000","last_became_active":"2024-09-21T07:48:31.115607+0000","last_became_peered":"2024-09-21T07:48:31.115607+0000","last_unstale":"2024-09-21T07:49:31.162513+0000","last_undegraded":"2024-09-21T07:49:31.162513+0000","last_fullsized":"2024-09-21T07:49:31.162513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:31.318412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226537+0000","last_change":"2024-09-21T07:47:40.714448+0000","last_active":"2024-09-21T07:50:00.226537+0000","last_peered":"2024-09-21T07:50:00.226537+0000","last_clean":"2024-09-21T07:50:00.226537+0000","last_became_active":"2024-09-21T07:47:40.714082+0000","last_became_peered":"2024-09-21T07:47:40.714082+0000","last_unstale":"2024-09-21T07:50:00.226537+0000","last_undegraded":"2024-09-21T07:50:00.226537+0000","last_fullsized":"2024-09-21T07:50:00.226537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:32.213172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247713+0000","last_change":"2024-09-21T07:47:37.672226+0000","last_active":"2024-09-21T07:49:31.247713+0000","last_peered":"2024-09-21T07:49:31.247713+0000","last_clean":"2024-09-21T07:49:31.247713+0000","last_became_active":"2024-09-21T07:47:37.671771+0000","last_became_peered":"2024-09-21T07:47:37.671771+0000","last_unstale":"2024-09-21T07:49:31.247713+0000","last_undegraded":"2024-09-21T07:49:31.247713+0000","last_fullsized":"2024-09-21T07:49:31.247713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:45.057384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158454+0000","last_change":"2024-09-21T07:47:49.745603+0000","last_active":"2024-09-21T07:49:31.158454+0000","last_peered":"2024-09-21T07:49:31.158454+0000","last_clean":"2024-09-21T07:49:31.158454+0000","last_became_active":"2024-09-21T07:47:49.745122+0000","last_became_peered":"2024-09-21T07:47:49.745122+0000","last_unstale":"2024-09-21T07:49:31.158454+0000","last_undegraded":"2024-09-21T07:49:31.158454+0000","last_fullsized":"2024-09-21T07:49:31.158454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:27.525003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.213866+0000","last_change":"2024-09-21T07:47:40.714075+0000","last_active":"2024-09-21T07:50:00.213866+0000","last_peered":"2024-09-21T07:50:00.213866+0000","last_clean":"2024-09-21T07:50:00.213866+0000","last_became_active":"2024-09-21T07:47:40.713707+0000","last_became_peered":"2024-09-21T07:47:40.713707+0000","last_unstale":"2024-09-21T07:50:00.213866+0000","last_undegraded":"2024-09-21T07:50:00.213866+0000","last_fullsized":"2024-09-21T07:50:00.213866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:53.504810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158420+0000","last_change":"2024-09-21T07:48:31.103806+0000","last_active":"2024-09-21T07:49:31.158420+0000","last_peered":"2024-09-21T07:49:31.158420+0000","last_clean":"2024-09-21T07:49:31.158420+0000","last_became_active":"2024-09-21T07:48:31.094505+0000","last_became_peered":"2024-09-21T07:48:31.094505+0000","last_unstale":"2024-09-21T07:49:31.158420+0000","last_undegraded":"2024-09-21T07:49:31.158420+0000","last_fullsized":"2024-09-21T07:49:31.158420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:59.710593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248339+0000","last_change":"2024-09-21T07:47:49.755765+0000","last_active":"2024-09-21T07:49:31.248339+0000","last_peered":"2024-09-21T07:49:31.248339+0000","last_clean":"2024-09-21T07:49:31.248339+0000","last_became_active":"2024-09-21T07:47:49.755327+0000","last_became_peered":"2024-09-21T07:47:49.755327+0000","last_unstale":"2024-09-21T07:49:31.248339+0000","last_undegraded":"2024-09-21T07:49:31.248339+0000","last_fullsized":"2024-09-21T07:49:31.248339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:31.769071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.224994+0000","last_change":"2024-09-21T07:47:40.707263+0000","last_active":"2024-09-21T07:50:00.224994+0000","last_peered":"2024-09-21T07:50:00.224994+0000","last_clean":"2024-09-21T07:50:00.224994+0000","last_became_active":"2024-09-21T07:47:40.706886+0000","last_became_peered":"2024-09-21T07:47:40.706886+0000","last_unstale":"2024-09-21T07:50:00.224994+0000","last_undegraded":"2024-09-21T07:50:00.224994+0000","last_fullsized":"2024-09-21T07:50:00.224994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:06.499578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'40","reported_seq":367,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:49.370928+0000","last_change":"2024-09-21T07:47:37.669977+0000","last_active":"2024-09-21T07:50:49.370928+0000","last_peered":"2024-09-21T07:50:49.370928+0000","last_clean":"2024-09-21T07:50:49.370928+0000","last_became_active":"2024-09-21T07:47:37.669585+0000","last_became_peered":"2024-09-21T07:47:37.669585+0000","last_unstale":"2024-09-21T07:50:49.370928+0000","last_undegraded":"2024-09-21T07:50:49.370928+0000","last_fullsized":"2024-09-21T07:50:49.370928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:06.722078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":281,"num_read_kb":213,"num_write":42,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159921+0000","last_change":"2024-09-21T07:47:49.751408+0000","last_active":"2024-09-21T07:49:31.159921+0000","last_peered":"2024-09-21T07:49:31.159921+0000","last_clean":"2024-09-21T07:49:31.159921+0000","last_became_active":"2024-09-21T07:47:49.750951+0000","last_became_peered":"2024-09-21T07:47:49.750951+0000","last_unstale":"2024-09-21T07:49:31.159921+0000","last_undegraded":"2024-09-21T07:49:31.159921+0000","last_fullsized":"2024-09-21T07:49:31.159921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:28:25.142539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.236544+0000","last_change":"2024-09-21T07:47:40.714300+0000","last_active":"2024-09-21T07:50:00.236544+0000","last_peered":"2024-09-21T07:50:00.236544+0000","last_clean":"2024-09-21T07:50:00.236544+0000","last_became_active":"2024-09-21T07:47:40.713870+0000","last_became_peered":"2024-09-21T07:47:40.713870+0000","last_unstale":"2024-09-21T07:50:00.236544+0000","last_undegraded":"2024-09-21T07:50:00.236544+0000","last_fullsized":"2024-09-21T07:50:00.236544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:45.054273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248679+0000","last_change":"2024-09-21T07:47:38.175274+0000","last_active":"2024-09-21T07:49:31.248679+0000","last_peered":"2024-09-21T07:49:31.248679+0000","last_clean":"2024-09-21T07:49:31.248679+0000","last_became_active":"2024-09-21T07:47:38.174921+0000","last_became_peered":"2024-09-21T07:47:38.174921+0000","last_unstale":"2024-09-21T07:49:31.248679+0000","last_undegraded":"2024-09-21T07:49:31.248679+0000","last_fullsized":"2024-09-21T07:49:31.248679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:30.378137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.162313+0000","last_change":"2024-09-21T07:47:49.753206+0000","last_active":"2024-09-21T07:49:31.162313+0000","last_peered":"2024-09-21T07:49:31.162313+0000","last_clean":"2024-09-21T07:49:31.162313+0000","last_became_active":"2024-09-21T07:47:49.752511+0000","last_became_peered":"2024-09-21T07:47:49.752511+0000","last_unstale":"2024-09-21T07:49:31.162313+0000","last_undegraded":"2024-09-21T07:49:31.162313+0000","last_fullsized":"2024-09-21T07:49:31.162313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:05.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227866+0000","last_change":"2024-09-21T07:47:40.724608+0000","last_active":"2024-09-21T07:50:00.227866+0000","last_peered":"2024-09-21T07:50:00.227866+0000","last_clean":"2024-09-21T07:50:00.227866+0000","last_became_active":"2024-09-21T07:47:40.724244+0000","last_became_peered":"2024-09-21T07:47:40.724244+0000","last_unstale":"2024-09-21T07:50:00.227866+0000","last_undegraded":"2024-09-21T07:50:00.227866+0000","last_fullsized":"2024-09-21T07:50:00.227866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.244633+0000","last_change":"2024-09-21T07:48:31.117165+0000","last_active":"2024-09-21T07:49:31.244633+0000","last_peered":"2024-09-21T07:49:31.244633+0000","last_clean":"2024-09-21T07:49:31.244633+0000","last_became_active":"2024-09-21T07:48:31.116703+0000","last_became_peered":"2024-09-21T07:48:31.116703+0000","last_unstale":"2024-09-21T07:49:31.244633+0000","last_undegraded":"2024-09-21T07:49:31.244633+0000","last_fullsized":"2024-09-21T07:49:31.244633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:09.268214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.159785+0000","last_change":"2024-09-21T07:47:49.748862+0000","last_active":"2024-09-21T07:49:31.159785+0000","last_peered":"2024-09-21T07:49:31.159785+0000","last_clean":"2024-09-21T07:49:31.159785+0000","last_became_active":"2024-09-21T07:47:49.746183+0000","last_became_peered":"2024-09-21T07:47:49.746183+0000","last_unstale":"2024-09-21T07:49:31.159785+0000","last_undegraded":"2024-09-21T07:49:31.159785+0000","last_fullsized":"2024-09-21T07:49:31.159785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:14.673640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231446+0000","last_change":"2024-09-21T07:47:40.710759+0000","last_active":"2024-09-21T07:50:00.231446+0000","last_peered":"2024-09-21T07:50:00.231446+0000","last_clean":"2024-09-21T07:50:00.231446+0000","last_became_active":"2024-09-21T07:47:40.710347+0000","last_became_peered":"2024-09-21T07:47:40.710347+0000","last_unstale":"2024-09-21T07:50:00.231446+0000","last_undegraded":"2024-09-21T07:50:00.231446+0000","last_fullsized":"2024-09-21T07:50:00.231446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:05.042618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":322,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:49.370928+0000","last_change":"2024-09-21T07:47:37.669123+0000","last_active":"2024-09-21T07:50:49.370928+0000","last_peered":"2024-09-21T07:50:49.370928+0000","last_clean":"2024-09-21T07:50:49.370928+0000","last_became_active":"2024-09-21T07:47:37.668667+0000","last_became_peered":"2024-09-21T07:47:37.668667+0000","last_unstale":"2024-09-21T07:50:49.370928+0000","last_undegraded":"2024-09-21T07:50:49.370928+0000","last_fullsized":"2024-09-21T07:50:49.370928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:13.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":270,"num_read_kb":270,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.277894+0000","last_change":"2024-09-21T07:47:49.750094+0000","last_active":"2024-09-21T07:49:31.277894+0000","last_peered":"2024-09-21T07:49:31.277894+0000","last_clean":"2024-09-21T07:49:31.277894+0000","last_became_active":"2024-09-21T07:47:49.749609+0000","last_became_peered":"2024-09-21T07:47:49.749609+0000","last_unstale":"2024-09-21T07:49:31.277894+0000","last_undegraded":"2024-09-21T07:49:31.277894+0000","last_fullsized":"2024-09-21T07:49:31.277894+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:18.876336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.278984+0000","last_change":"2024-09-21T07:47:49.757470+0000","last_active":"2024-09-21T07:49:31.278984+0000","last_peered":"2024-09-21T07:49:31.278984+0000","last_clean":"2024-09-21T07:49:31.278984+0000","last_became_active":"2024-09-21T07:47:49.756787+0000","last_became_peered":"2024-09-21T07:47:49.756787+0000","last_unstale":"2024-09-21T07:49:31.278984+0000","last_undegraded":"2024-09-21T07:49:31.278984+0000","last_fullsized":"2024-09-21T07:49:31.278984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:49.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.225224+0000","last_change":"2024-09-21T07:47:40.709905+0000","last_active":"2024-09-21T07:50:00.225224+0000","last_peered":"2024-09-21T07:50:00.225224+0000","last_clean":"2024-09-21T07:50:00.225224+0000","last_became_active":"2024-09-21T07:47:40.708643+0000","last_became_peered":"2024-09-21T07:47:40.708643+0000","last_unstale":"2024-09-21T07:50:00.225224+0000","last_undegraded":"2024-09-21T07:50:00.225224+0000","last_fullsized":"2024-09-21T07:50:00.225224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:19.468014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.247909+0000","last_change":"2024-09-21T07:47:37.673637+0000","last_active":"2024-09-21T07:49:31.247909+0000","last_peered":"2024-09-21T07:49:31.247909+0000","last_clean":"2024-09-21T07:49:31.247909+0000","last_became_active":"2024-09-21T07:47:37.673216+0000","last_became_peered":"2024-09-21T07:47:37.673216+0000","last_unstale":"2024-09-21T07:49:31.247909+0000","last_undegraded":"2024-09-21T07:49:31.247909+0000","last_fullsized":"2024-09-21T07:49:31.247909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:46.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.158882+0000","last_change":"2024-09-21T07:47:49.755527+0000","last_active":"2024-09-21T07:49:31.158882+0000","last_peered":"2024-09-21T07:49:31.158882+0000","last_clean":"2024-09-21T07:49:31.158882+0000","last_became_active":"2024-09-21T07:47:49.755001+0000","last_became_peered":"2024-09-21T07:47:49.755001+0000","last_unstale":"2024-09-21T07:49:31.158882+0000","last_undegraded":"2024-09-21T07:49:31.158882+0000","last_fullsized":"2024-09-21T07:49:31.158882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:55.796179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.226888+0000","last_change":"2024-09-21T07:48:31.118830+0000","last_active":"2024-09-21T07:50:00.226888+0000","last_peered":"2024-09-21T07:50:00.226888+0000","last_clean":"2024-09-21T07:50:00.226888+0000","last_became_active":"2024-09-21T07:48:31.117764+0000","last_became_peered":"2024-09-21T07:48:31.117764+0000","last_unstale":"2024-09-21T07:50:00.226888+0000","last_undegraded":"2024-09-21T07:50:00.226888+0000","last_fullsized":"2024-09-21T07:50:00.226888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:36.390418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.245823+0000","last_change":"2024-09-21T07:47:37.673346+0000","last_active":"2024-09-21T07:49:31.245823+0000","last_peered":"2024-09-21T07:49:31.245823+0000","last_clean":"2024-09-21T07:49:31.245823+0000","last_became_active":"2024-09-21T07:47:37.672947+0000","last_became_peered":"2024-09-21T07:47:37.672947+0000","last_unstale":"2024-09-21T07:49:31.245823+0000","last_undegraded":"2024-09-21T07:49:31.245823+0000","last_fullsized":"2024-09-21T07:49:31.245823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:11.414650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.243596+0000","last_change":"2024-09-21T07:47:37.668894+0000","last_active":"2024-09-21T07:49:31.243596+0000","last_peered":"2024-09-21T07:49:31.243596+0000","last_clean":"2024-09-21T07:49:31.243596+0000","last_became_active":"2024-09-21T07:47:37.668382+0000","last_became_peered":"2024-09-21T07:47:37.668382+0000","last_unstale":"2024-09-21T07:49:31.243596+0000","last_undegraded":"2024-09-21T07:49:31.243596+0000","last_fullsized":"2024-09-21T07:49:31.243596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:48.934348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234552+0000","last_change":"2024-09-21T07:47:40.722757+0000","last_active":"2024-09-21T07:50:00.234552+0000","last_peered":"2024-09-21T07:50:00.234552+0000","last_clean":"2024-09-21T07:50:00.234552+0000","last_became_active":"2024-09-21T07:47:40.722380+0000","last_became_peered":"2024-09-21T07:47:40.722380+0000","last_unstale":"2024-09-21T07:50:00.234552+0000","last_undegraded":"2024-09-21T07:50:00.234552+0000","last_fullsized":"2024-09-21T07:50:00.234552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.214544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248127+0000","last_change":"2024-09-21T07:47:49.759242+0000","last_active":"2024-09-21T07:49:31.248127+0000","last_peered":"2024-09-21T07:49:31.248127+0000","last_clean":"2024-09-21T07:49:31.248127+0000","last_became_active":"2024-09-21T07:47:49.758736+0000","last_became_peered":"2024-09-21T07:47:49.758736+0000","last_unstale":"2024-09-21T07:49:31.248127+0000","last_undegraded":"2024-09-21T07:49:31.248127+0000","last_fullsized":"2024-09-21T07:49:31.248127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:12.283844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:46.366626+0000","last_change":"2024-09-21T07:47:37.671196+0000","last_active":"2024-09-21T07:50:46.366626+0000","last_peered":"2024-09-21T07:50:46.366626+0000","last_clean":"2024-09-21T07:50:46.366626+0000","last_became_active":"2024-09-21T07:47:37.670763+0000","last_became_peered":"2024-09-21T07:47:37.670763+0000","last_unstale":"2024-09-21T07:50:46.366626+0000","last_undegraded":"2024-09-21T07:50:46.366626+0000","last_fullsized":"2024-09-21T07:50:46.366626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:36.647085+0000","last_clean_scrub_stamp":"2024-09-21T07:47:36.647085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:51.488727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.212530+0000","last_change":"2024-09-21T07:47:40.716623+0000","last_active":"2024-09-21T07:50:00.212530+0000","last_peered":"2024-09-21T07:50:00.212530+0000","last_clean":"2024-09-21T07:50:00.212530+0000","last_became_active":"2024-09-21T07:47:40.716276+0000","last_became_peered":"2024-09-21T07:47:40.716276+0000","last_unstale":"2024-09-21T07:50:00.212530+0000","last_undegraded":"2024-09-21T07:50:00.212530+0000","last_fullsized":"2024-09-21T07:50:00.212530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:29.792550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:49:31.248474+0000","last_change":"2024-09-21T07:47:49.747056+0000","last_active":"2024-09-21T07:49:31.248474+0000","last_peered":"2024-09-21T07:49:31.248474+0000","last_clean":"2024-09-21T07:49:31.248474+0000","last_became_active":"2024-09-21T07:47:49.746444+0000","last_became_peered":"2024-09-21T07:47:49.746444+0000","last_unstale":"2024-09-21T07:49:31.248474+0000","last_undegraded":"2024-09-21T07:49:31.248474+0000","last_fullsized":"2024-09-21T07:49:31.248474+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:48.722046+0000","last_clean_scrub_stamp":"2024-09-21T07:47:48.722046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:33.650571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229653+0000","last_change":"2024-09-21T07:47:40.716180+0000","last_active":"2024-09-21T07:50:00.229653+0000","last_peered":"2024-09-21T07:50:00.229653+0000","last_clean":"2024-09-21T07:50:00.229653+0000","last_became_active":"2024-09-21T07:47:40.715823+0000","last_became_peered":"2024-09-21T07:47:40.715823+0000","last_unstale":"2024-09-21T07:50:00.229653+0000","last_undegraded":"2024-09-21T07:50:00.229653+0000","last_fullsized":"2024-09-21T07:50:00.229653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:52.835488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.214497+0000","last_change":"2024-09-21T07:48:31.095392+0000","last_active":"2024-09-21T07:50:00.214497+0000","last_peered":"2024-09-21T07:50:00.214497+0000","last_clean":"2024-09-21T07:50:00.214497+0000","last_became_active":"2024-09-21T07:48:31.094894+0000","last_became_peered":"2024-09-21T07:48:31.094894+0000","last_unstale":"2024-09-21T07:50:00.214497+0000","last_undegraded":"2024-09-21T07:50:00.214497+0000","last_fullsized":"2024-09-21T07:50:00.214497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:38.905669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,8],"acting":[2,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227306+0000","last_change":"2024-09-21T07:47:40.709616+0000","last_active":"2024-09-21T07:50:00.227306+0000","last_peered":"2024-09-21T07:50:00.227306+0000","last_clean":"2024-09-21T07:50:00.227306+0000","last_became_active":"2024-09-21T07:47:40.709178+0000","last_became_peered":"2024-09-21T07:47:40.709178+0000","last_unstale":"2024-09-21T07:50:00.227306+0000","last_undegraded":"2024-09-21T07:50:00.227306+0000","last_fullsized":"2024-09-21T07:50:00.227306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:49.507489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227334+0000","last_change":"2024-09-21T07:47:40.727566+0000","last_active":"2024-09-21T07:50:00.227334+0000","last_peered":"2024-09-21T07:50:00.227334+0000","last_clean":"2024-09-21T07:50:00.227334+0000","last_became_active":"2024-09-21T07:47:40.727209+0000","last_became_peered":"2024-09-21T07:47:40.727209+0000","last_unstale":"2024-09-21T07:50:00.227334+0000","last_undegraded":"2024-09-21T07:50:00.227334+0000","last_fullsized":"2024-09-21T07:50:00.227334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:43.332610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227942+0000","last_change":"2024-09-21T07:47:40.718125+0000","last_active":"2024-09-21T07:50:00.227942+0000","last_peered":"2024-09-21T07:50:00.227942+0000","last_clean":"2024-09-21T07:50:00.227942+0000","last_became_active":"2024-09-21T07:47:40.716711+0000","last_became_peered":"2024-09-21T07:47:40.716711+0000","last_unstale":"2024-09-21T07:50:00.227942+0000","last_undegraded":"2024-09-21T07:50:00.227942+0000","last_fullsized":"2024-09-21T07:50:00.227942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:25.176186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228389+0000","last_change":"2024-09-21T07:47:40.715035+0000","last_active":"2024-09-21T07:50:00.228389+0000","last_peered":"2024-09-21T07:50:00.228389+0000","last_clean":"2024-09-21T07:50:00.228389+0000","last_became_active":"2024-09-21T07:47:40.714665+0000","last_became_peered":"2024-09-21T07:47:40.714665+0000","last_unstale":"2024-09-21T07:50:00.228389+0000","last_undegraded":"2024-09-21T07:50:00.228389+0000","last_fullsized":"2024-09-21T07:50:00.228389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:13.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223482+0000","last_change":"2024-09-21T07:47:40.710027+0000","last_active":"2024-09-21T07:50:00.223482+0000","last_peered":"2024-09-21T07:50:00.223482+0000","last_clean":"2024-09-21T07:50:00.223482+0000","last_became_active":"2024-09-21T07:47:40.709689+0000","last_became_peered":"2024-09-21T07:47:40.709689+0000","last_unstale":"2024-09-21T07:50:00.223482+0000","last_undegraded":"2024-09-21T07:50:00.223482+0000","last_fullsized":"2024-09-21T07:50:00.223482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:06.312900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.202426+0000","last_change":"2024-09-21T07:47:40.712726+0000","last_active":"2024-09-21T07:50:00.202426+0000","last_peered":"2024-09-21T07:50:00.202426+0000","last_clean":"2024-09-21T07:50:00.202426+0000","last_became_active":"2024-09-21T07:47:40.712356+0000","last_became_peered":"2024-09-21T07:47:40.712356+0000","last_unstale":"2024-09-21T07:50:00.202426+0000","last_undegraded":"2024-09-21T07:50:00.202426+0000","last_fullsized":"2024-09-21T07:50:00.202426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:11.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228634+0000","last_change":"2024-09-21T07:47:40.710848+0000","last_active":"2024-09-21T07:50:00.228634+0000","last_peered":"2024-09-21T07:50:00.228634+0000","last_clean":"2024-09-21T07:50:00.228634+0000","last_became_active":"2024-09-21T07:47:40.710513+0000","last_became_peered":"2024-09-21T07:47:40.710513+0000","last_unstale":"2024-09-21T07:50:00.228634+0000","last_undegraded":"2024-09-21T07:50:00.228634+0000","last_fullsized":"2024-09-21T07:50:00.228634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:42.611264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.219031+0000","last_change":"2024-09-21T07:47:40.713811+0000","last_active":"2024-09-21T07:50:00.219031+0000","last_peered":"2024-09-21T07:50:00.219031+0000","last_clean":"2024-09-21T07:50:00.219031+0000","last_became_active":"2024-09-21T07:47:40.713444+0000","last_became_peered":"2024-09-21T07:47:40.713444+0000","last_unstale":"2024-09-21T07:50:00.219031+0000","last_undegraded":"2024-09-21T07:50:00.219031+0000","last_fullsized":"2024-09-21T07:50:00.219031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235687+0000","last_change":"2024-09-21T07:47:40.722948+0000","last_active":"2024-09-21T07:50:00.235687+0000","last_peered":"2024-09-21T07:50:00.235687+0000","last_clean":"2024-09-21T07:50:00.235687+0000","last_became_active":"2024-09-21T07:47:40.722532+0000","last_became_peered":"2024-09-21T07:47:40.722532+0000","last_unstale":"2024-09-21T07:50:00.235687+0000","last_undegraded":"2024-09-21T07:50:00.235687+0000","last_fullsized":"2024-09-21T07:50:00.235687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:52.493762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228617+0000","last_change":"2024-09-21T07:47:40.721695+0000","last_active":"2024-09-21T07:50:00.228617+0000","last_peered":"2024-09-21T07:50:00.228617+0000","last_clean":"2024-09-21T07:50:00.228617+0000","last_became_active":"2024-09-21T07:47:40.717087+0000","last_became_peered":"2024-09-21T07:47:40.717087+0000","last_unstale":"2024-09-21T07:50:00.228617+0000","last_undegraded":"2024-09-21T07:50:00.228617+0000","last_fullsized":"2024-09-21T07:50:00.228617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:29.111254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227531+0000","last_change":"2024-09-21T07:48:31.100624+0000","last_active":"2024-09-21T07:50:00.227531+0000","last_peered":"2024-09-21T07:50:00.227531+0000","last_clean":"2024-09-21T07:50:00.227531+0000","last_became_active":"2024-09-21T07:48:31.100250+0000","last_became_peered":"2024-09-21T07:48:31.100250+0000","last_unstale":"2024-09-21T07:50:00.227531+0000","last_undegraded":"2024-09-21T07:50:00.227531+0000","last_fullsized":"2024-09-21T07:50:00.227531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:19.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210770+0000","last_change":"2024-09-21T07:47:40.711452+0000","last_active":"2024-09-21T07:50:00.210770+0000","last_peered":"2024-09-21T07:50:00.210770+0000","last_clean":"2024-09-21T07:50:00.210770+0000","last_became_active":"2024-09-21T07:47:40.711092+0000","last_became_peered":"2024-09-21T07:47:40.711092+0000","last_unstale":"2024-09-21T07:50:00.210770+0000","last_undegraded":"2024-09-21T07:50:00.210770+0000","last_fullsized":"2024-09-21T07:50:00.210770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:14.214529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229015+0000","last_change":"2024-09-21T07:47:40.710817+0000","last_active":"2024-09-21T07:50:00.229015+0000","last_peered":"2024-09-21T07:50:00.229015+0000","last_clean":"2024-09-21T07:50:00.229015+0000","last_became_active":"2024-09-21T07:47:40.710390+0000","last_became_peered":"2024-09-21T07:47:40.710390+0000","last_unstale":"2024-09-21T07:50:00.229015+0000","last_undegraded":"2024-09-21T07:50:00.229015+0000","last_fullsized":"2024-09-21T07:50:00.229015+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:57.240577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.231891+0000","last_change":"2024-09-21T07:47:40.713157+0000","last_active":"2024-09-21T07:50:00.231891+0000","last_peered":"2024-09-21T07:50:00.231891+0000","last_clean":"2024-09-21T07:50:00.231891+0000","last_became_active":"2024-09-21T07:47:40.712824+0000","last_became_peered":"2024-09-21T07:47:40.712824+0000","last_unstale":"2024-09-21T07:50:00.231891+0000","last_undegraded":"2024-09-21T07:50:00.231891+0000","last_fullsized":"2024-09-21T07:50:00.231891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:22:13.121285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235579+0000","last_change":"2024-09-21T07:47:40.712352+0000","last_active":"2024-09-21T07:50:00.235579+0000","last_peered":"2024-09-21T07:50:00.235579+0000","last_clean":"2024-09-21T07:50:00.235579+0000","last_became_active":"2024-09-21T07:47:40.712004+0000","last_became_peered":"2024-09-21T07:47:40.712004+0000","last_unstale":"2024-09-21T07:50:00.235579+0000","last_undegraded":"2024-09-21T07:50:00.235579+0000","last_fullsized":"2024-09-21T07:50:00.235579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:35.253733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.227718+0000","last_change":"2024-09-21T07:47:40.723854+0000","last_active":"2024-09-21T07:50:00.227718+0000","last_peered":"2024-09-21T07:50:00.227718+0000","last_clean":"2024-09-21T07:50:00.227718+0000","last_became_active":"2024-09-21T07:47:40.718880+0000","last_became_peered":"2024-09-21T07:47:40.718880+0000","last_unstale":"2024-09-21T07:50:00.227718+0000","last_undegraded":"2024-09-21T07:50:00.227718+0000","last_fullsized":"2024-09-21T07:50:00.227718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:51.747975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.228484+0000","last_change":"2024-09-21T07:47:40.714352+0000","last_active":"2024-09-21T07:50:00.228484+0000","last_peered":"2024-09-21T07:50:00.228484+0000","last_clean":"2024-09-21T07:50:00.228484+0000","last_became_active":"2024-09-21T07:47:40.713841+0000","last_became_peered":"2024-09-21T07:47:40.713841+0000","last_unstale":"2024-09-21T07:50:00.228484+0000","last_undegraded":"2024-09-21T07:50:00.228484+0000","last_fullsized":"2024-09-21T07:50:00.228484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:14.863818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.223270+0000","last_change":"2024-09-21T07:47:40.722155+0000","last_active":"2024-09-21T07:50:00.223270+0000","last_peered":"2024-09-21T07:50:00.223270+0000","last_clean":"2024-09-21T07:50:00.223270+0000","last_became_active":"2024-09-21T07:47:40.720192+0000","last_became_peered":"2024-09-21T07:47:40.720192+0000","last_unstale":"2024-09-21T07:50:00.223270+0000","last_undegraded":"2024-09-21T07:50:00.223270+0000","last_fullsized":"2024-09-21T07:50:00.223270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.745383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229604+0000","last_change":"2024-09-21T07:47:40.711474+0000","last_active":"2024-09-21T07:50:00.229604+0000","last_peered":"2024-09-21T07:50:00.229604+0000","last_clean":"2024-09-21T07:50:00.229604+0000","last_became_active":"2024-09-21T07:47:40.710576+0000","last_became_peered":"2024-09-21T07:47:40.710576+0000","last_unstale":"2024-09-21T07:50:00.229604+0000","last_undegraded":"2024-09-21T07:50:00.229604+0000","last_fullsized":"2024-09-21T07:50:00.229604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:40.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.235991+0000","last_change":"2024-09-21T07:47:40.709968+0000","last_active":"2024-09-21T07:50:00.235991+0000","last_peered":"2024-09-21T07:50:00.235991+0000","last_clean":"2024-09-21T07:50:00.235991+0000","last_became_active":"2024-09-21T07:47:40.709320+0000","last_became_peered":"2024-09-21T07:47:40.709320+0000","last_unstale":"2024-09-21T07:50:00.235991+0000","last_undegraded":"2024-09-21T07:50:00.235991+0000","last_fullsized":"2024-09-21T07:50:00.235991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:44.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210061+0000","last_change":"2024-09-21T07:47:40.713945+0000","last_active":"2024-09-21T07:50:00.210061+0000","last_peered":"2024-09-21T07:50:00.210061+0000","last_clean":"2024-09-21T07:50:00.210061+0000","last_became_active":"2024-09-21T07:47:40.713539+0000","last_became_peered":"2024-09-21T07:47:40.713539+0000","last_unstale":"2024-09-21T07:50:00.210061+0000","last_undegraded":"2024-09-21T07:50:00.210061+0000","last_fullsized":"2024-09-21T07:50:00.210061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:33.296863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.234725+0000","last_change":"2024-09-21T07:47:40.715949+0000","last_active":"2024-09-21T07:50:00.234725+0000","last_peered":"2024-09-21T07:50:00.234725+0000","last_clean":"2024-09-21T07:50:00.234725+0000","last_became_active":"2024-09-21T07:47:40.715578+0000","last_became_peered":"2024-09-21T07:47:40.715578+0000","last_unstale":"2024-09-21T07:50:00.234725+0000","last_undegraded":"2024-09-21T07:50:00.234725+0000","last_fullsized":"2024-09-21T07:50:00.234725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:12.938258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.210704+0000","last_change":"2024-09-21T07:47:40.723671+0000","last_active":"2024-09-21T07:50:00.210704+0000","last_peered":"2024-09-21T07:50:00.210704+0000","last_clean":"2024-09-21T07:50:00.210704+0000","last_became_active":"2024-09-21T07:47:40.717137+0000","last_became_peered":"2024-09-21T07:47:40.717137+0000","last_unstale":"2024-09-21T07:50:00.210704+0000","last_undegraded":"2024-09-21T07:50:00.210704+0000","last_fullsized":"2024-09-21T07:50:00.210704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:23.797528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.233170+0000","last_change":"2024-09-21T07:47:40.715799+0000","last_active":"2024-09-21T07:50:00.233170+0000","last_peered":"2024-09-21T07:50:00.233170+0000","last_clean":"2024-09-21T07:50:00.233170+0000","last_became_active":"2024-09-21T07:47:40.715316+0000","last_became_peered":"2024-09-21T07:47:40.715316+0000","last_unstale":"2024-09-21T07:50:00.233170+0000","last_undegraded":"2024-09-21T07:50:00.233170+0000","last_fullsized":"2024-09-21T07:50:00.233170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:19.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.215521+0000","last_change":"2024-09-21T07:47:40.708948+0000","last_active":"2024-09-21T07:50:00.215521+0000","last_peered":"2024-09-21T07:50:00.215521+0000","last_clean":"2024-09-21T07:50:00.215521+0000","last_became_active":"2024-09-21T07:47:40.708453+0000","last_became_peered":"2024-09-21T07:47:40.708453+0000","last_unstale":"2024-09-21T07:50:00.215521+0000","last_undegraded":"2024-09-21T07:50:00.215521+0000","last_fullsized":"2024-09-21T07:50:00.215521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.762326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.208038+0000","last_change":"2024-09-21T07:47:40.722895+0000","last_active":"2024-09-21T07:50:00.208038+0000","last_peered":"2024-09-21T07:50:00.208038+0000","last_clean":"2024-09-21T07:50:00.208038+0000","last_became_active":"2024-09-21T07:47:40.722521+0000","last_became_peered":"2024-09-21T07:47:40.722521+0000","last_unstale":"2024-09-21T07:50:00.208038+0000","last_undegraded":"2024-09-21T07:50:00.208038+0000","last_fullsized":"2024-09-21T07:50:00.208038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:42.516888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.229406+0000","last_change":"2024-09-21T07:47:40.714951+0000","last_active":"2024-09-21T07:50:00.229406+0000","last_peered":"2024-09-21T07:50:00.229406+0000","last_clean":"2024-09-21T07:50:00.229406+0000","last_became_active":"2024-09-21T07:47:40.713151+0000","last_became_peered":"2024-09-21T07:47:40.713151+0000","last_unstale":"2024-09-21T07:50:00.229406+0000","last_undegraded":"2024-09-21T07:50:00.229406+0000","last_fullsized":"2024-09-21T07:50:00.229406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.364216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230493+0000","last_change":"2024-09-21T07:47:40.725489+0000","last_active":"2024-09-21T07:50:00.230493+0000","last_peered":"2024-09-21T07:50:00.230493+0000","last_clean":"2024-09-21T07:50:00.230493+0000","last_became_active":"2024-09-21T07:47:40.723213+0000","last_became_peered":"2024-09-21T07:47:40.723213+0000","last_unstale":"2024-09-21T07:50:00.230493+0000","last_undegraded":"2024-09-21T07:50:00.230493+0000","last_fullsized":"2024-09-21T07:50:00.230493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:48.288887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.220776+0000","last_change":"2024-09-21T07:47:40.712595+0000","last_active":"2024-09-21T07:50:00.220776+0000","last_peered":"2024-09-21T07:50:00.220776+0000","last_clean":"2024-09-21T07:50:00.220776+0000","last_became_active":"2024-09-21T07:47:40.712218+0000","last_became_peered":"2024-09-21T07:47:40.712218+0000","last_unstale":"2024-09-21T07:50:00.220776+0000","last_undegraded":"2024-09-21T07:50:00.220776+0000","last_fullsized":"2024-09-21T07:50:00.220776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:51.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T07:50:00.230134+0000","last_change":"2024-09-21T07:47:40.713939+0000","last_active":"2024-09-21T07:50:00.230134+0000","last_peered":"2024-09-21T07:50:00.230134+0000","last_clean":"2024-09-21T07:50:00.230134+0000","last_became_active":"2024-09-21T07:47:40.713561+0000","last_became_peered":"2024-09-21T07:47:40.713561+0000","last_unstale":"2024-09-21T07:50:00.230134+0000","last_undegraded":"2024-09-21T07:50:00.230134+0000","last_fullsized":"2024-09-21T07:50:00.230134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:47:39.669775+0000","last_clean_scrub_stamp":"2024-09-21T07:47:39.669775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:28.421424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":867589,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1728,"num_read_kb":1086,"num_write":489,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2973696,"data_stored":2602767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":526920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37484,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707668,"statfs":{"total":95995035648,"available":95956652032,"internally_reserved":0,"allocated":2129920,"data_stored":1579130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070527,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36760,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708392,"statfs":{"total":95995035648,"available":95957393408,"internally_reserved":0,"allocated":1449984,"data_stored":922980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266757,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":918680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462986,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36952,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708200,"statfs":{"total":95995035648,"available":95957196800,"internally_reserved":0,"allocated":1646592,"data_stored":1122995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626511,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822740,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29088,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716064,"statfs":{"total":95995035648,"available":95965249536,"internally_reserved":0,"allocated":2052096,"data_stored":1512042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986266,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182496,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28872,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716280,"statfs":{"total":95995035648,"available":95965470720,"internally_reserved":0,"allocated":1830912,"data_stored":1307872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":596218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":595313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705776,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":523160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":74863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":75768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":787422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":468312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:50:53.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:50:53.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:53 smithi162 ceph-mon[34833]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:53.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:53 smithi084 ceph-mon[30411]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:53.829 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:53.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:53 smithi191 ceph-mon[34667]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:50:54.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 -- 172.21.15.84:0/3666216185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8284105d90 msgr2=0x7f82841061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:54.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 --2- 172.21.15.84:0/3666216185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8284105d90 0x7f82841061a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8274009900 tx=0x7f827402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 -- 172.21.15.84:0/3666216185 shutdown_connections 2024-09-21T07:50:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 --2- 172.21.15.84:0/3666216185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f828410c020 0x7f8284112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 --2- 172.21.15.84:0/3666216185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f828410b6d0 0x7f828410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 --2- 172.21.15.84:0/3666216185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8284105d90 0x7f82841061a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 -- 172.21.15.84:0/3666216185 >> 172.21.15.84:0/3666216185 conn(0x7f8284101860 msgr2=0x7f8284103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 -- 172.21.15.84:0/3666216185 shutdown_connections 2024-09-21T07:50:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.479+0000 7f828a200640 1 -- 172.21.15.84:0/3666216185 wait complete. 2024-09-21T07:50:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.480+0000 7f828a200640 1 Processor -- start 2024-09-21T07:50:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f828a200640 1 -- start start 2024-09-21T07:50:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f828a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8284105d90 0x7f828419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f828a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828410b6d0 0x7f828419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f828a200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f828410c020 0x7f82841a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f828a200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8284115ce0 con 0x7f828410b6d0 2024-09-21T07:50:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f828a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8284115b60 con 0x7f8284105d90 2024-09-21T07:50:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f828a200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8284115e60 con 0x7f828410c020 2024-09-21T07:50:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f827aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828410b6d0 0x7f828419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f8283400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8284105d90 0x7f828419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f8283400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8284105d90 0x7f828419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39792/0 (socket says 172.21.15.84:39792) 2024-09-21T07:50:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f8283400640 1 -- 172.21.15.84:0/793475270 learned_addr learned my addr 172.21.15.84:0/793475270 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.481+0000 7f8283e00640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f828410c020 0x7f82841a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f827aa00640 1 -- 172.21.15.84:0/793475270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f828410c020 msgr2=0x7f82841a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f827aa00640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f828410c020 0x7f82841a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f827aa00640 1 -- 172.21.15.84:0/793475270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8284105d90 msgr2=0x7f828419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f827aa00640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8284105d90 0x7f828419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f827aa00640 1 -- 172.21.15.84:0/793475270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82841a2600 con 0x7f828410b6d0 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f827aa00640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828410b6d0 0x7f828419cc30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f826c005fd0 tx=0x7f826c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f8280c00640 1 -- 172.21.15.84:0/793475270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c009c00 con 0x7f828410b6d0 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f8280c00640 1 -- 172.21.15.84:0/793475270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f826c009da0 con 0x7f828410b6d0 2024-09-21T07:50:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.482+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82841a28f0 con 0x7f828410b6d0 2024-09-21T07:50:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.483+0000 7f8280c00640 1 -- 172.21.15.84:0/793475270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c003e10 con 0x7f828410b6d0 2024-09-21T07:50:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.483+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82841a9050 con 0x7f828410b6d0 2024-09-21T07:50:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.484+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82841061a0 con 0x7f828410b6d0 2024-09-21T07:50:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.487+0000 7f8280c00640 1 -- 172.21.15.84:0/793475270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f826c004000 con 0x7f828410b6d0 2024-09-21T07:50:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.488+0000 7f8280c00640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82680b65f0 0x7f82680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.488+0000 7f8280c00640 1 -- 172.21.15.84:0/793475270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f826c0e7830 con 0x7f828410b6d0 2024-09-21T07:50:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.488+0000 7f8283400640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82680b65f0 0x7f82680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.489+0000 7f8283400640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82680b65f0 0x7f82680b8b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8274031440 tx=0x7f82740058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.490+0000 7f8280c00640 1 -- 172.21.15.84:0/793475270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f826c017020 con 0x7f828410b6d0 2024-09-21T07:50:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.714+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f828419d7c0 con 0x7f828410b6d0 2024-09-21T07:50:54.717 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:54 smithi084 ceph-mon[30411]: pgmap v388: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:50:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.715+0000 7f8280c00640 1 -- 172.21.15.84:0/793475270 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f826c0b1eb0 con 0x7f828410b6d0 2024-09-21T07:50:54.718 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:54.718 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:50:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:50:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82680b65f0 msgr2=0x7f82680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82680b65f0 0x7f82680b8b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8274031440 tx=0x7f82740058d0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828410b6d0 msgr2=0x7f828419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828410b6d0 0x7f828419cc30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f826c005fd0 tx=0x7f826c00dde0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 shutdown_connections 2024-09-21T07:50:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82680b65f0 0x7f82680b8b00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f828410c020 0x7f82841a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828410b6d0 0x7f828419cc30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 --2- 172.21.15.84:0/793475270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8284105d90 0x7f828419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 >> 172.21.15.84:0/793475270 conn(0x7f8284101860 msgr2=0x7f8284103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 shutdown_connections 2024-09-21T07:50:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:54.718+0000 7f828a200640 1 -- 172.21.15.84:0/793475270 wait complete. 2024-09-21T07:50:54.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:54 smithi191 ceph-mon[34667]: pgmap v388: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:50:55.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:54 smithi162 ceph-mon[34833]: pgmap v388: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:50:55.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:50:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:55.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:55 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/793475270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:55.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:55 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/793475270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:55 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/793475270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:56.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 -- 172.21.15.84:0/1720948171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 msgr2=0x7fc7a81028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:56.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 --2- 172.21.15.84:0/1720948171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a81028b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc798009900 tx=0x7fc79802a480 comp rx=0 tx=0).stop 2024-09-21T07:50:56.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 -- 172.21.15.84:0/1720948171 shutdown_connections 2024-09-21T07:50:56.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 --2- 172.21.15.84:0/1720948171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7a8110050 0x7fc7a8112470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 --2- 172.21.15.84:0/1720948171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7a8102df0 0x7fc7a810fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 --2- 172.21.15.84:0/1720948171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a81028b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 -- 172.21.15.84:0/1720948171 >> 172.21.15.84:0/1720948171 conn(0x7fc7a80fe360 msgr2=0x7fc7a81007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:56.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 -- 172.21.15.84:0/1720948171 shutdown_connections 2024-09-21T07:50:56.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.369+0000 7fc7a7200640 1 -- 172.21.15.84:0/1720948171 wait complete. 2024-09-21T07:50:56.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 Processor -- start 2024-09-21T07:50:56.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 -- start start 2024-09-21T07:50:56.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:56.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7a8102df0 0x7fc7a819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:56.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7a8110050 0x7fc7a81a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8115b40 con 0x7fc7a81024a0 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81159c0 con 0x7fc7a8102df0 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.370+0000 7fc7a7200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8115cc0 con 0x7fc7a8110050 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a819c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38004/0 (socket says 172.21.15.84:38004) 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 -- 172.21.15.84:0/999703085 learned_addr learned my addr 172.21.15.84:0/999703085 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc79fe00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7a8102df0 0x7fc7a819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a6800640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7a8110050 0x7fc7a81a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 -- 172.21.15.84:0/999703085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7a8110050 msgr2=0x7fc7a81a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7a8110050 0x7fc7a81a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 -- 172.21.15.84:0/999703085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7a8102df0 msgr2=0x7fc7a819cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7a8102df0 0x7fc7a819cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc7a5e00640 1 -- 172.21.15.84:0/999703085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a81a24a0 con 0x7fc7a81024a0 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.371+0000 7fc79fe00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7a8102df0 0x7fc7a819cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:56.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.372+0000 7fc7a5e00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a819c530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc798005940 tx=0x7fc7980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:56.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.372+0000 7fc79ea00640 1 -- 172.21.15.84:0/999703085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79803f030 con 0x7fc7a81024a0 2024-09-21T07:50:56.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.372+0000 7fc79ea00640 1 -- 172.21.15.84:0/999703085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7980044c0 con 0x7fc7a81024a0 2024-09-21T07:50:56.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.372+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a81a2730 con 0x7fc7a81024a0 2024-09-21T07:50:56.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.372+0000 7fc79ea00640 1 -- 172.21.15.84:0/999703085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798035070 con 0x7fc7a81024a0 2024-09-21T07:50:56.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.372+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a81a8ef0 con 0x7fc7a81024a0 2024-09-21T07:50:56.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.373+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a806c0e0 con 0x7fc7a81024a0 2024-09-21T07:50:56.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.375+0000 7fc79ea00640 1 -- 172.21.15.84:0/999703085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fc798042030 con 0x7fc7a81024a0 2024-09-21T07:50:56.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.377+0000 7fc79ea00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc78c0b65f0 0x7fc78c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:56.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.377+0000 7fc79ea00640 1 -- 172.21.15.84:0/999703085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc798107cf0 con 0x7fc7a81024a0 2024-09-21T07:50:56.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.377+0000 7fc79fe00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc78c0b65f0 0x7fc78c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:56.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.378+0000 7fc79fe00640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc78c0b65f0 0x7fc78c0b8b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8104110 tx=0x7fc790005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:56.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.381+0000 7fc79ea00640 1 -- 172.21.15.84:0/999703085 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7980d2370 con 0x7fc7a81024a0 2024-09-21T07:50:56.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.605+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7a819d660 con 0x7fc7a81024a0 2024-09-21T07:50:56.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.605+0000 7fc79ea00640 1 -- 172.21.15.84:0/999703085 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fc7980d72b0 con 0x7fc7a81024a0 2024-09-21T07:50:56.607 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:56.608 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:50:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:50:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc78c0b65f0 msgr2=0x7fc78c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc78c0b65f0 0x7fc78c0b8b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8104110 tx=0x7fc790005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 msgr2=0x7fc7a819c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a819c530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc798005940 tx=0x7fc7980040c0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 shutdown_connections 2024-09-21T07:50:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc78c0b65f0 0x7fc78c0b8b00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7a8110050 0x7fc7a81a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7a8102df0 0x7fc7a819cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 --2- 172.21.15.84:0/999703085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7a81024a0 0x7fc7a819c530 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 >> 172.21.15.84:0/999703085 conn(0x7fc7a80fe360 msgr2=0x7fc7a8109bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 shutdown_connections 2024-09-21T07:50:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:56.609+0000 7fc7a7200640 1 -- 172.21.15.84:0/999703085 wait complete. 2024-09-21T07:50:56.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:56 smithi191 ceph-mon[34667]: pgmap v389: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:56.953 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:56 smithi084 ceph-mon[30411]: pgmap v389: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:57.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:56 smithi162 ceph-mon[34833]: pgmap v389: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:50:57.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:50:57.689 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:50:57.828 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:57 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/999703085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:57 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/999703085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:58.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:57 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/999703085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:50:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 -- 172.21.15.84:0/1510748208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 msgr2=0x7fd7dc106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 --2- 172.21.15.84:0/1510748208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc106190 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009ca0 tx=0x7fd7cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 -- 172.21.15.84:0/1510748208 shutdown_connections 2024-09-21T07:50:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 --2- 172.21.15.84:0/1510748208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7dc10c010 0x7fd7dc112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 --2- 172.21.15.84:0/1510748208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7dc10b6c0 0x7fd7dc10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 --2- 172.21.15.84:0/1510748208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc106190 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 -- 172.21.15.84:0/1510748208 >> 172.21.15.84:0/1510748208 conn(0x7fd7dc101810 msgr2=0x7fd7dc103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 -- 172.21.15.84:0/1510748208 shutdown_connections 2024-09-21T07:50:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.304+0000 7fd7e1800640 1 -- 172.21.15.84:0/1510748208 wait complete. 2024-09-21T07:50:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.305+0000 7fd7e1800640 1 Processor -- start 2024-09-21T07:50:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.305+0000 7fd7e1800640 1 -- start start 2024-09-21T07:50:58.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7e1800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc19c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:58.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7e1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7dc10b6c0 0x7fd7dc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:58.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7e1800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7dc10c010 0x7fd7dc1a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:58.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7e1800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc115cd0 con 0x7fd7dc105d80 2024-09-21T07:50:58.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7e1800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc115b50 con 0x7fd7dc10b6c0 2024-09-21T07:50:58.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7e1800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc115e50 con 0x7fd7dc10c010 2024-09-21T07:50:58.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc19c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:58.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc19c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52826/0 (socket says 172.21.15.84:52826) 2024-09-21T07:50:58.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 -- 172.21.15.84:0/2469070469 learned_addr learned my addr 172.21.15.84:0/2469070469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:58.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7db400640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7dc10c010 0x7fd7dc1a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:58.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7da000640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7dc10b6c0 0x7fd7dc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:58.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 -- 172.21.15.84:0/2469070469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7dc10c010 msgr2=0x7fd7dc1a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7dc10c010 0x7fd7dc1a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 -- 172.21.15.84:0/2469070469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7dc10b6c0 msgr2=0x7fd7dc19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7dc10b6c0 0x7fd7dc19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.306+0000 7fd7daa00640 1 -- 172.21.15.84:0/2469070469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7dc1a26d0 con 0x7fd7dc105d80 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.307+0000 7fd7daa00640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc19c760 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc033040 tx=0x7fd7cc0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.307+0000 7fd7d3400640 1 -- 172.21.15.84:0/2469070469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc003b70 con 0x7fd7dc105d80 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.307+0000 7fd7d3400640 1 -- 172.21.15.84:0/2469070469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7cc003d10 con 0x7fd7dc105d80 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.307+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7dc1a2960 con 0x7fd7dc105d80 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.307+0000 7fd7d3400640 1 -- 172.21.15.84:0/2469070469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc02f9e0 con 0x7fd7dc105d80 2024-09-21T07:50:58.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.307+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7dc1a9120 con 0x7fd7dc105d80 2024-09-21T07:50:58.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.308+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7dc106190 con 0x7fd7dc105d80 2024-09-21T07:50:58.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.312+0000 7fd7d3400640 1 -- 172.21.15.84:0/2469070469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7fd7cc02fb80 con 0x7fd7dc105d80 2024-09-21T07:50:58.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.314+0000 7fd7d3400640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd7c00b65f0 0x7fd7c00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:58.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.314+0000 7fd7d3400640 1 -- 172.21.15.84:0/2469070469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd7cc108de0 con 0x7fd7dc105d80 2024-09-21T07:50:58.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.314+0000 7fd7da000640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd7c00b65f0 0x7fd7c00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:58.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.315+0000 7fd7da000640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd7c00b65f0 0x7fd7c00b8b00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc10b220 tx=0x7fd7c8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:58.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.316+0000 7fd7d3400640 1 -- 172.21.15.84:0/2469070469 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7cc0cf080 con 0x7fd7dc105d80 2024-09-21T07:50:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.506+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7dc19d890 con 0x7fd7dc105d80 2024-09-21T07:50:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.509+0000 7fd7d3400640 1 -- 172.21.15.84:0/2469070469 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+25144 (secure 0 0 0) 0x7fd7cc0d3460 con 0x7fd7dc105d80 2024-09-21T07:50:58.510 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:50:58.510 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T07:49:31.146906+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.511+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd7c00b65f0 msgr2=0x7fd7c00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.511+0000 7fd7e1800640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd7c00b65f0 0x7fd7c00b8b00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc10b220 tx=0x7fd7c8005f90 comp rx=0 tx=0).stop 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 msgr2=0x7fd7dc19c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc19c760 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc033040 tx=0x7fd7cc0316f0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 shutdown_connections 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd7c00b65f0 0x7fd7c00b8b00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7dc10c010 0x7fd7dc1a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7dc10b6c0 0x7fd7dc19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 --2- 172.21.15.84:0/2469070469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7dc105d80 0x7fd7dc19c760 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 >> 172.21.15.84:0/2469070469 conn(0x7fd7dc101810 msgr2=0x7fd7dc103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 shutdown_connections 2024-09-21T07:50:58.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:50:58.512+0000 7fd7e1800640 1 -- 172.21.15.84:0/2469070469 wait complete. 2024-09-21T07:50:58.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:58 smithi084 ceph-mon[30411]: pgmap v390: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:50:58.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:58 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:50:58.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:50:58 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2469070469' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:58.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:58 smithi191 ceph-mon[34667]: pgmap v390: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:50:58.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:58 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:50:58.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:50:58 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2469070469' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:59.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:58 smithi162 ceph-mon[34833]: pgmap v390: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-09-21T07:50:59.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:58 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:50:59.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:50:58 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2469070469' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:50:59.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T07:50:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.436+0000 7f226ec00640 1 -- 172.21.15.84:0/2375673010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268109260 msgr2=0x7f2268109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.436+0000 7f226ec00640 1 --2- 172.21.15.84:0/2375673010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268109260 0x7f2268109670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2254009860 tx=0x7f225402a340 comp rx=0 tx=0).stop 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.436+0000 7f226ec00640 1 -- 172.21.15.84:0/2375673010 shutdown_connections 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.436+0000 7f226ec00640 1 --2- 172.21.15.84:0/2375673010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 0x7f22681103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.436+0000 7f226ec00640 1 --2- 172.21.15.84:0/2375673010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268109260 0x7f2268109670 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.436+0000 7f226ec00640 1 --2- 172.21.15.84:0/2375673010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2268103930 0x7f2268103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.436+0000 7f226ec00640 1 -- 172.21.15.84:0/2375673010 >> 172.21.15.84:0/2375673010 conn(0x7f22680ff390 msgr2=0x7f22681017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.437+0000 7f226ec00640 1 -- 172.21.15.84:0/2375673010 shutdown_connections 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.437+0000 7f226ec00640 1 -- 172.21.15.84:0/2375673010 wait complete. 2024-09-21T07:50:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 Processor -- start 2024-09-21T07:50:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 -- start start 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268103930 0x7f226819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2268109260 0x7f226819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 0x7f22681a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2268113870 con 0x7f2268109bb0 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22681136f0 con 0x7f2268103930 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.438+0000 7f226ec00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22681139f0 con 0x7f2268109260 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 0x7f22681a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268103930 0x7f226819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 0x7f22681a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52842/0 (socket says 172.21.15.84:52842) 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 -- 172.21.15.84:0/2868499660 learned_addr learned my addr 172.21.15.84:0/2868499660 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226ce00640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2268109260 0x7f226819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 -- 172.21.15.84:0/2868499660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2268109260 msgr2=0x7f226819cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2268109260 0x7f226819cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 -- 172.21.15.84:0/2868499660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268103930 msgr2=0x7f226819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268103930 0x7f226819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 -- 172.21.15.84:0/2868499660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22681a24c0 con 0x7f2268109bb0 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226d800640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268103930 0x7f226819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.439+0000 7f226e200640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 0x7f22681a1dc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2260009fd0 tx=0x7f226000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.440+0000 7f2266000640 1 -- 172.21.15.84:0/2868499660 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260004b20 con 0x7f2268109bb0 2024-09-21T07:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.440+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22681a27b0 con 0x7f2268109bb0 2024-09-21T07:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.440+0000 7f2266000640 1 -- 172.21.15.84:0/2868499660 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2260003e20 con 0x7f2268109bb0 2024-09-21T07:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.440+0000 7f2266000640 1 -- 172.21.15.84:0/2868499660 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260004820 con 0x7f2268109bb0 2024-09-21T07:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.440+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22681a8f40 con 0x7f2268109bb0 2024-09-21T07:50:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.443+0000 7f2266000640 1 -- 172.21.15.84:0/2868499660 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7f226001d020 con 0x7f2268109bb0 2024-09-21T07:50:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.444+0000 7f22772b3740 1 Processor -- start 2024-09-21T07:50:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f22772b3740 1 -- start start 2024-09-21T07:50:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f22772b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188adbde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f22772b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f02f0 0x56188adbe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f22772b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adbe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f22772b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56188ad336b0 con 0x56188aa191b0 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f22772b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56188ad22ae0 con 0x56188a9f02f0 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f22772b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56188ad268f0 con 0x56188a9f84d0 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f2266000640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22500b65f0 0x7f22500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.445+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188adbde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188adbde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52852/0 (socket says 172.21.15.84:52852) 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226ce00640 1 -- 172.21.15.84:0/2616401635 learned_addr learned my addr 172.21.15.84:0/2616401635 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f2266000640 1 -- 172.21.15.84:0/2868499660 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f22600e7910 con 0x7f2268109bb0 2024-09-21T07:50:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226d800640 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f02f0 0x56188adbe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226e200640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22500b65f0 0x7f22500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226ce00640 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adbe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226d800640 1 -- 172.21.15.84:0/2616401635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 msgr2=0x56188adbe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226d800640 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adbe890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226d800640 1 -- 172.21.15.84:0/2616401635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 msgr2=0x56188adbde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226d800640 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188adbde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226d800640 1 -- 172.21.15.84:0/2616401635 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56188acef780 con 0x56188a9f02f0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226d800640 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f02f0 0x56188adbe350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f225c011440 tx=0x7f225c011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb95ae70d18c13dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.446+0000 7f226e200640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22500b65f0 0x7f22500b8b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f22600a9a80 tx=0x7f2260004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.447+0000 7f225aa00640 1 -- 172.21.15.84:0/2616401635 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c004310 con 0x56188a9f02f0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.447+0000 7f225aa00640 1 -- 172.21.15.84:0/2616401635 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f225c0044b0 con 0x56188a9f02f0 2024-09-21T07:50:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.447+0000 7f225aa00640 1 -- 172.21.15.84:0/2616401635 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0035f0 con 0x56188a9f02f0 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 -- 172.21.15.84:0/2616401635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f02f0 msgr2=0x56188adbe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f02f0 0x56188adbe350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f225c011440 tx=0x7f225c011900 comp rx=0 tx=0).stop 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 -- 172.21.15.84:0/2616401635 shutdown_connections 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adbe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f02f0 0x56188adbe350 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 --2- 172.21.15.84:0/2616401635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188adbde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 -- 172.21.15.84:0/2616401635 >> 172.21.15.84:0/2616401635 conn(0x56188aa0d300 msgr2=0x56188adbbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 -- 172.21.15.84:0/2616401635 shutdown_connections 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 -- 172.21.15.84:0/2616401635 wait complete. 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.448+0000 7f22772b3740 1 -- start start 2024-09-21T07:50:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 1 Processor -- start 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adc9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adc9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188adc9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56188ac5aab0 con 0x56188a9f02f0 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56188acc9570 con 0x56188aa191b0 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56188adcc590 con 0x56188a9f84d0 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f22772b3740 10 client.0 _ll_register_callbacks cb 0x56188acd8100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.449+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adc9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adc9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adc9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52858/0 (socket says 172.21.15.84:52858) 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adc9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48664/0 (socket says 172.21.15.84:48664) 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226ce00640 1 -- 172.21.15.84:0/2874455952 learned_addr learned my addr 172.21.15.84:0/2874455952 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226ce00640 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188adc9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 -- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 msgr2=0x56188adc9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188adc9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 -- 172.21.15.84:0/2874455952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 msgr2=0x56188adc9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adc9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 -- 172.21.15.84:0/2874455952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56188aa84790 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226ce00640 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adc9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f226d800640 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adc9980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f225c01b040 tx=0x7f225c0048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c75e6cbff2f50c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.450+0000 7f224f400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.451+0000 7f224f400640 1 -- 172.21.15.84:0/2874455952 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c026070 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.451+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f225c0044b0 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.451+0000 7f224f400640 1 -- 172.21.15.84:0/2874455952 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f225c0037f0 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.451+0000 7f224f400640 1 -- 172.21.15.84:0/2874455952 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f225c032050 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.451+0000 7f22772b3740 10 client.25615 fetch_fsmap learned FSMap version 29 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.451+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56188aafd620 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.451+0000 7f224f400640 1 -- 172.21.15.84:0/2874455952 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f225c0044b0 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f224f400640 1 -- 172.21.15.84:0/2874455952 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f225c004c70 con 0x56188a9f84d0 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f22772b3740 10 client.25615 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f22772b3740 10 client.25615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:50:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f22772b3740 20 client.25615 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f22772b3740 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9d7d80 0x56188addb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f22772b3740 4 client.25615 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:50:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56188ad35600 con 0x56188a9d7d80 2024-09-21T07:50:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.452+0000 7f226ce00640 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9d7d80 0x56188addb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.453+0000 7f226ce00640 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9d7d80 0x56188addb4b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2284284b9b05f72 server_cookie=34e68745c1dca5cc in_seq=0 out_seq=0 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.453+0000 7f224f400640 10 client.25615 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f224f400640 1 -- 172.21.15.84:0/2874455952 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56188ad35600 con 0x56188a9d7d80 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f224f400640 10 client.25615 handle_command_reply: tid=0 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 client.25615 shutdown 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 msgr2=0x56188adc9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adc9980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f225c01b040 tx=0x7f225c0048f0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 shutdown_connections 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188adc9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9d7d80 0x56188addb4b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188adc9980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 --2- 172.21.15.84:0/2874455952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adc9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f224f400640 0 client.25615 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 >> 172.21.15.84:0/2874455952 conn(0x56188aa0d300 msgr2=0x56188adbee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 shutdown_connections 2024-09-21T07:50:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 1 -- 172.21.15.84:0/2874455952 wait complete. 2024-09-21T07:50:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.454+0000 7f22772b3740 20 client.25615 trim_cache size 0 max 16384 2024-09-21T07:50:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.469+0000 7f22772b3740 1 Processor -- start 2024-09-21T07:50:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.469+0000 7f22772b3740 1 -- start start 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f22772b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adcb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f22772b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188ade0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f22772b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188ade0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f22772b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22681b2e50 con 0x56188a9f02f0 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f22772b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22681b4990 con 0x56188aa191b0 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f22772b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22681b3520 con 0x56188a9f84d0 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adcb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f226d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188ade0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adcb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52864/0 (socket says 172.21.15.84:52864) 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f226ce00640 1 -- 172.21.15.84:0/3177363124 learned_addr learned my addr 172.21.15.84:0/3177363124 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.470+0000 7f226ce00640 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188ade0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f226d800640 1 -- 172.21.15.84:0/3177363124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 msgr2=0x56188ade0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f226d800640 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188ade0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f226d800640 1 -- 172.21.15.84:0/3177363124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 msgr2=0x56188adcb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f226d800640 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adcb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f226d800640 1 -- 172.21.15.84:0/3177363124 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56188adc7920 con 0x56188a9f84d0 2024-09-21T07:50:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f226ce00640 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adcb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:50:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f226d800640 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188ade0a80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f225c0051e0 tx=0x7f225c011e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eaa10e183cdff71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f225a000640 1 -- 172.21.15.84:0/3177363124 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c000e60 con 0x56188a9f84d0 2024-09-21T07:50:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f225a000640 1 -- 172.21.15.84:0/3177363124 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f225c004e10 con 0x56188a9f84d0 2024-09-21T07:50:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.471+0000 7f225a000640 1 -- 172.21.15.84:0/3177363124 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c026040 con 0x56188a9f84d0 2024-09-21T07:50:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 -- 172.21.15.84:0/3177363124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 msgr2=0x56188ade0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188ade0a80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f225c0051e0 tx=0x7f225c011e00 comp rx=0 tx=0).stop 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 -- 172.21.15.84:0/3177363124 shutdown_connections 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188aa191b0 0x56188ade0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f84d0 0x56188ade0a80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 --2- 172.21.15.84:0/3177363124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188a9f02f0 0x56188adcb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 -- 172.21.15.84:0/3177363124 >> 172.21.15.84:0/3177363124 conn(0x56188aa0d300 msgr2=0x56188adca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 -- 172.21.15.84:0/3177363124 shutdown_connections 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.472+0000 7f22772b3740 1 -- 172.21.15.84:0/3177363124 wait complete. 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.473+0000 7f22772b3740 1 -- start start 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.473+0000 7f22772b3740 1 Processor -- start 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f22772b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f02f0 0x56188adcf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f22772b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f84d0 0x56188adcf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f22772b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188ae3cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f22772b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22681b42c0 con 0x56188aa191b0 2024-09-21T07:50:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f22772b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22681b3bf0 con 0x56188a9f84d0 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f22772b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22681b0e10 con 0x56188a9f02f0 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f22772b3740 10 client.0 _ll_register_callbacks cb 0x7f2260009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188ae3cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f84d0 0x56188adcf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188ae3cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52872/0 (socket says 172.21.15.84:52872) 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 -- 172.21.15.84:0/1565469990 learned_addr learned my addr 172.21.15.84:0/1565469990 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f02f0 0x56188adcf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 -- 172.21.15.84:0/1565469990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f02f0 msgr2=0x56188adcf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f02f0 0x56188adcf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 -- 172.21.15.84:0/1565469990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f84d0 msgr2=0x56188adcf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:50:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f84d0 0x56188adcf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.474+0000 7f226ce00640 1 -- 172.21.15.84:0/1565469990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56188ae3d2e0 con 0x56188aa191b0 2024-09-21T07:50:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f226ce00640 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188ae3cc40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2254030ef0 tx=0x7f2254030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1c29815d630d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:50:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f224f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f224f400640 1 -- 172.21.15.84:0/1565469990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254037040 con 0x56188aa191b0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f224f400640 1 -- 172.21.15.84:0/1565469990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2254030450 con 0x56188aa191b0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f225c004e10 con 0x56188aa191b0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f224f400640 1 -- 172.21.15.84:0/1565469990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2254030650 con 0x56188aa191b0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f22772b3740 10 client.15636 fetch_fsmap learned FSMap version 29 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56188ae45890 con 0x56188aa191b0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.475+0000 7f224f400640 1 -- 172.21.15.84:0/1565469990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f225c004e10 con 0x56188aa191b0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f224f400640 1 -- 172.21.15.84:0/1565469990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f22540047e0 con 0x56188aa191b0 2024-09-21T07:50:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f22772b3740 10 client.15636 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f22772b3740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f22772b3740 20 client.15636 populate_metadata read hostname 'smithi084' 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f22772b3740 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9ad1c0 0x56188ae48000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f22772b3740 4 client.15636 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56188ad310b0 con 0x56188a9ad1c0 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.476+0000 7f226d800640 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9ad1c0 0x56188ae48000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.477+0000 7f226d800640 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9ad1c0 0x56188ae48000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34d27aeff9c112db server_cookie=76062da5c726e54b in_seq=0 out_seq=0 2024-09-21T07:50:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.477+0000 7f224f400640 10 client.15636 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f224f400640 1 -- 172.21.15.84:0/1565469990 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56188ad310b0 con 0x56188a9ad1c0 2024-09-21T07:50:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f224f400640 10 client.15636 handle_command_reply: tid=0 2024-09-21T07:50:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 client.15636 shutdown 2024-09-21T07:50:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 msgr2=0x56188ae3cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188ae3cc40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2254030ef0 tx=0x7f2254030340 comp rx=0 tx=0).stop 2024-09-21T07:50:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 shutdown_connections 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56188aa191b0 0x56188ae3cc40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56188a9f84d0 0x56188adcf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56188a9ad1c0 0x56188ae48000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 --2- 172.21.15.84:0/1565469990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56188a9f02f0 0x56188adcf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f224f400640 0 client.15636 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 >> 172.21.15.84:0/1565469990 conn(0x56188aa0d300 msgr2=0x56188adbee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 shutdown_connections 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 1 -- 172.21.15.84:0/1565469990 wait complete. 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.492+0000 7f22772b3740 20 client.15636 trim_cache size 0 max 16384 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:50:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:50:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:50:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:50:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22500b65f0 msgr2=0x7f22500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22500b65f0 0x7f22500b8b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f22600a9a80 tx=0x7f2260004a40 comp rx=0 tx=0).stop 2024-09-21T07:50:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 msgr2=0x7f22681a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:50:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 0x7f22681a1dc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2260009fd0 tx=0x7f226000c800 comp rx=0 tx=0).stop 2024-09-21T07:50:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 shutdown_connections 2024-09-21T07:50:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22500b65f0 0x7f22500b8b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2268109bb0 0x7f22681a1dc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2268109260 0x7f226819cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 --2- 172.21.15.84:0/2868499660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2268103930 0x7f226819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:50:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 >> 172.21.15.84:0/2868499660 conn(0x7f22680ff390 msgr2=0x7f2268106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:50:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 shutdown_connections 2024-09-21T07:50:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:50:59.493+0000 7f226ec00640 1 -- 172.21.15.84:0/2868499660 wait complete. 2024-09-21T07:50:59.644 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:01.000 INFO:teuthology.orchestra.run.smithi084.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T07:51:01.000 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T07:51:01.000 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T07:51:01.001 DEBUG:tasks.quiescer:Yielding 2024-09-21T07:51:01.001 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T07:51:01.023 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:51:01.023 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T07:51:01.023 INFO:tasks.workunit:timeout=3h 2024-09-21T07:51:01.023 INFO:tasks.workunit:cleanup=True 2024-09-21T07:51:01.024 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T07:51:01.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 07:48:43.823373765 +0000 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 07:48:43.823373765 +0000 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 07:50:32.184523127 +0000 2024-09-21T07:51:01.067 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 07:48:43.823373765 +0000 2024-09-21T07:51:01.067 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T07:51:01.067 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T07:51:01.176 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:51:01.214 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T07:51:01.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:01 smithi084 ceph-mon[30411]: pgmap v391: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:51:01.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:51:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:51:01.013+0000 7f97f0400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:51:01.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:51:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:51:01.013+0000 7f97f0400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:51:01.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:51:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:51:01.013+0000 7f97f0400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:51:01.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:51:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:51:01.013+0000 7f97f0400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:51:01.307 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 07:51:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T07:51:01.013+0000 7f97f0400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:51:01.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:01 smithi191 ceph-mon[34667]: pgmap v391: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:51:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:01 smithi162 ceph-mon[34833]: pgmap v391: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-09-21T07:51:02.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 -- 172.21.15.84:0/758660193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810c010 msgr2=0x7eff88112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:02.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 --2- 172.21.15.84:0/758660193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810c010 0x7eff88112840 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7eff80009ca0 tx=0x7eff8002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 -- 172.21.15.84:0/758660193 shutdown_connections 2024-09-21T07:51:02.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 --2- 172.21.15.84:0/758660193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810c010 0x7eff88112840 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 --2- 172.21.15.84:0/758660193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff8810b6c0 0x7eff8810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 --2- 172.21.15.84:0/758660193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff88105d80 0x7eff88106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 -- 172.21.15.84:0/758660193 >> 172.21.15.84:0/758660193 conn(0x7eff88101810 msgr2=0x7eff88103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:02.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 -- 172.21.15.84:0/758660193 shutdown_connections 2024-09-21T07:51:02.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.047+0000 7eff8e400640 1 -- 172.21.15.84:0/758660193 wait complete. 2024-09-21T07:51:02.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.048+0000 7eff8e400640 1 Processor -- start 2024-09-21T07:51:02.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.048+0000 7eff8e400640 1 -- start start 2024-09-21T07:51:02.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff8e400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff88105d80 0x7eff8819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff8e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810b6c0 0x7eff8819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff8e400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff8810c010 0x7eff881a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff8e400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7eff88115cd0 con 0x7eff8810b6c0 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff8e400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff88115b50 con 0x7eff88105d80 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff8e400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7eff88115e50 con 0x7eff8810c010 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff86a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810b6c0 0x7eff8819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff87400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff88105d80 0x7eff8819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff87400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff88105d80 0x7eff8819c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38184/0 (socket says 172.21.15.84:38184) 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff87400640 1 -- 172.21.15.84:0/1204505144 learned_addr learned my addr 172.21.15.84:0/1204505144 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.049+0000 7eff87e00640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff8810c010 0x7eff881a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff86a00640 1 -- 172.21.15.84:0/1204505144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff8810c010 msgr2=0x7eff881a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff86a00640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff8810c010 0x7eff881a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff86a00640 1 -- 172.21.15.84:0/1204505144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff88105d80 msgr2=0x7eff8819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:02.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff86a00640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff88105d80 0x7eff8819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff86a00640 1 -- 172.21.15.84:0/1204505144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff881a25d0 con 0x7eff8810b6c0 2024-09-21T07:51:02.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff87400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff88105d80 0x7eff8819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:02.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff86a00640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810b6c0 0x7eff8819cc00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7eff74005fd0 tx=0x7eff7400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:02.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff7fe00640 1 -- 172.21.15.84:0/1204505144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74009c00 con 0x7eff8810b6c0 2024-09-21T07:51:02.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff7fe00640 1 -- 172.21.15.84:0/1204505144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff74009da0 con 0x7eff8810b6c0 2024-09-21T07:51:02.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff881a28c0 con 0x7eff8810b6c0 2024-09-21T07:51:02.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff7fe00640 1 -- 172.21.15.84:0/1204505144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74003db0 con 0x7eff8810b6c0 2024-09-21T07:51:02.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.050+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff881a9020 con 0x7eff8810b6c0 2024-09-21T07:51:02.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.051+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff88106190 con 0x7eff8810b6c0 2024-09-21T07:51:02.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.054+0000 7eff7fe00640 1 -- 172.21.15.84:0/1204505144 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154586+0+0 (secure 0 0 0) 0x7eff74003f50 con 0x7eff8810b6c0 2024-09-21T07:51:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.055+0000 7eff7fe00640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff6c0b65f0 0x7eff6c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.055+0000 7eff7fe00640 1 -- 172.21.15.84:0/1204505144 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7eff740e7360 con 0x7eff8810b6c0 2024-09-21T07:51:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.055+0000 7eff87400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff6c0b65f0 0x7eff6c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:02.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.056+0000 7eff87400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff6c0b65f0 0x7eff6c0b8b00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7eff78011500 tx=0x7eff78005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:02.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.057+0000 7eff7fe00640 1 -- 172.21.15.84:0/1204505144 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff74017020 con 0x7eff8810b6c0 2024-09-21T07:51:02.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.283+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff8819d790 con 0x7eff8810b6c0 2024-09-21T07:51:02.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.284+0000 7eff7fe00640 1 -- 172.21.15.84:0/1204505144 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7eff740b19e0 con 0x7eff8810b6c0 2024-09-21T07:51:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:51:02.287 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:51:02.287 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.287+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff6c0b65f0 msgr2=0x7eff6c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.287+0000 7eff8e400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff6c0b65f0 0x7eff6c0b8b00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7eff78011500 tx=0x7eff78005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.287+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810b6c0 msgr2=0x7eff8819cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.287+0000 7eff8e400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810b6c0 0x7eff8819cc00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7eff74005fd0 tx=0x7eff7400dde0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.287+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 shutdown_connections 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.288+0000 7eff8e400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff6c0b65f0 0x7eff6c0b8b00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.288+0000 7eff8e400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff8810c010 0x7eff881a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.288+0000 7eff8e400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8810b6c0 0x7eff8819cc00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.288+0000 7eff8e400640 1 --2- 172.21.15.84:0/1204505144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff88105d80 0x7eff8819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.288+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 >> 172.21.15.84:0/1204505144 conn(0x7eff88101810 msgr2=0x7eff88108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.288+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 shutdown_connections 2024-09-21T07:51:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:02.288+0000 7eff8e400640 1 -- 172.21.15.84:0/1204505144 wait complete. 2024-09-21T07:51:02.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:47:41.706708+0000', 'modified': '2024-09-21T07:50:33.118994+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24746, 'mds_1': 24742, 'mds_2': 24724, 'mds_3': 24719, 'mds_4': 24712}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14757': {'gid': 14757, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6841/1397513983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6840', 'nonce': 1397513983}, {'type': 'v1', 'addr': '172.21.15.84:6841', 'nonce': 1397513983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24662': {'gid': 24662, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6833/1671465182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1671465182}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1671465182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2170041322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2170041322}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2170041322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2049364491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2049364491}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2049364491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24697': {'gid': 24697, 'name': 'd', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6837/1436382958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1436382958}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1436382958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24712': {'gid': 24712, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.191:6835/1369621448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 1369621448}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 1369621448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24719': {'gid': 24719, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.162:6837/1733531268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 1733531268}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 1733531268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24724': {'gid': 24724, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.191:6837/2311233520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 2311233520}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2311233520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24742': {'gid': 24742, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.191:6839/2322343723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2322343723}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2322343723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24746': {'gid': 24746, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.162:6839/3948328826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 3948328826}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 3948328826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24746, 'qdb_cluster': [24712, 24719, 24724, 24742, 24746]} 2024-09-21T07:51:02.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:51:02.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T07:51:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:03 smithi084 ceph-mon[30411]: pgmap v392: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T07:51:03.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1204505144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:03 smithi191 ceph-mon[34667]: pgmap v392: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T07:51:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1204505144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:03.409 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:03.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:03 smithi162 ceph-mon[34833]: pgmap v392: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T07:51:03.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1204505144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 -- 172.21.15.84:0/181702731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d4105d80 msgr2=0x7fd0d4106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 --2- 172.21.15.84:0/181702731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d4105d80 0x7fd0d4106190 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009ca0 tx=0x7fd0c402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 -- 172.21.15.84:0/181702731 shutdown_connections 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 --2- 172.21.15.84:0/181702731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d410c010 0x7fd0d4112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 --2- 172.21.15.84:0/181702731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0d410b6c0 0x7fd0d410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 --2- 172.21.15.84:0/181702731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d4105d80 0x7fd0d4106190 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 -- 172.21.15.84:0/181702731 >> 172.21.15.84:0/181702731 conn(0x7fd0d4101810 msgr2=0x7fd0d4103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:04.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 -- 172.21.15.84:0/181702731 shutdown_connections 2024-09-21T07:51:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.072+0000 7fd0db600640 1 -- 172.21.15.84:0/181702731 wait complete. 2024-09-21T07:51:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.073+0000 7fd0db600640 1 Processor -- start 2024-09-21T07:51:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.073+0000 7fd0db600640 1 -- start start 2024-09-21T07:51:04.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0db600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d4105d80 0x7fd0d419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0db600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0d410b6c0 0x7fd0d419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0db600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d410c010 0x7fd0d41a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0db600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4115cd0 con 0x7fd0d410c010 2024-09-21T07:51:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0db600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4115b50 con 0x7fd0d4105d80 2024-09-21T07:51:04.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0db600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4115e50 con 0x7fd0d410b6c0 2024-09-21T07:51:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d410c010 0x7fd0d41a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d410c010 0x7fd0d41a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52902/0 (socket says 172.21.15.84:52902) 2024-09-21T07:51:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 -- 172.21.15.84:0/1670964040 learned_addr learned my addr 172.21.15.84:0/1670964040 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0d410b6c0 0x7fd0d419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d4105d80 0x7fd0d419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 -- 172.21.15.84:0/1670964040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0d410b6c0 msgr2=0x7fd0d419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0d410b6c0 0x7fd0d419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 -- 172.21.15.84:0/1670964040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d4105d80 msgr2=0x7fd0d419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d4105d80 0x7fd0d419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.074+0000 7fd0d9600640 1 -- 172.21.15.84:0/1670964040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d41a2650 con 0x7fd0d410c010 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.075+0000 7fd0d9600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d410c010 0x7fd0d41a1f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00e970 tx=0x7fd0cc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.075+0000 7fd0d1600640 1 -- 172.21.15.84:0/1670964040 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc00ccc0 con 0x7fd0d410c010 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.075+0000 7fd0d1600640 1 -- 172.21.15.84:0/1670964040 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0cc00ce60 con 0x7fd0d410c010 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.075+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d41a2940 con 0x7fd0d410c010 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.075+0000 7fd0d1600640 1 -- 172.21.15.84:0/1670964040 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc010430 con 0x7fd0d410c010 2024-09-21T07:51:04.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.075+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d41a90a0 con 0x7fd0d410c010 2024-09-21T07:51:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 Processor -- start 2024-09-21T07:51:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0d1600640 1 -- 172.21.15.84:0/1670964040 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd0cc004ff0 con 0x7fd0d410c010 2024-09-21T07:51:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 -- start start 2024-09-21T07:51:04.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822bd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881ef6280 0x5628822bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562882234d50 con 0x562881ef6280 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562882224180 con 0x562881f16f60 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.079+0000 7fd0e2239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562882227f90 con 0x562881eee0a0 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822bd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881ef6280 0x5628822bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881ef6280 0x5628822bdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52904/0 (socket says 172.21.15.84:52904) 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d3e00640 1 -- 172.21.15.84:0/2151536612 learned_addr learned my addr 172.21.15.84:0/2151536612 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:04.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d8c00640 1 -- 172.21.15.84:0/2151536612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 msgr2=0x5628822bd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822bd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d8c00640 1 -- 172.21.15.84:0/2151536612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881ef6280 msgr2=0x5628822bdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881ef6280 0x5628822bdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d8c00640 1 -- 172.21.15.84:0/2151536612 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628821eea70 con 0x562881eee0a0 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.080+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822bd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.081+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822bd9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000f80 tx=0x7fd0c40094a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c644219aace72205 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.081+0000 7fd0d1600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd0b80b6680 0x7fd0b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.081+0000 7fd0c9c00640 1 -- 172.21.15.84:0/2151536612 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4031cf0 con 0x562881eee0a0 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.081+0000 7fd0c9c00640 1 -- 172.21.15.84:0/2151536612 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c4036030 con 0x562881eee0a0 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.081+0000 7fd0c9c00640 1 -- 172.21.15.84:0/2151536612 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40042a0 con 0x562881eee0a0 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.081+0000 7fd0d1600640 1 -- 172.21.15.84:0/1670964040 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd0cc0e7e80 con 0x7fd0d410c010 2024-09-21T07:51:04.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.081+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd0b80b6680 0x7fd0b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 -- 172.21.15.84:0/2151536612 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 msgr2=0x5628822bd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd0b80b6680 0x7fd0b80b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0d406caa0 tx=0x7fd0c0004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822bd9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000f80 tx=0x7fd0c40094a0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 -- 172.21.15.84:0/2151536612 shutdown_connections 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881ef6280 0x5628822bdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822bd9d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2151536612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822bd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 -- 172.21.15.84:0/2151536612 >> 172.21.15.84:0/2151536612 conn(0x562881f0b350 msgr2=0x5628822bb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:04.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 -- 172.21.15.84:0/2151536612 shutdown_connections 2024-09-21T07:51:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.082+0000 7fd0e2239740 1 -- 172.21.15.84:0/2151536612 wait complete. 2024-09-21T07:51:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.083+0000 7fd0e2239740 1 -- start start 2024-09-21T07:51:04.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.083+0000 7fd0e2239740 1 Processor -- start 2024-09-21T07:51:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881eee0a0 0x5628822c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0e2239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5628820855f0 con 0x562881eee0a0 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0e2239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5628821bf460 con 0x562881f16f60 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0e2239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5628822cba90 con 0x562881ef6280 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0e2239740 10 client.0 _ll_register_callbacks cb 0x5628821cf210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881eee0a0 0x5628822c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881eee0a0 0x5628822c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52912/0 (socket says 172.21.15.84:52912) 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 -- 172.21.15.84:0/2656453492 learned_addr learned my addr 172.21.15.84:0/2656453492 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d9600640 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 -- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 msgr2=0x5628822c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 -- 172.21.15.84:0/2656453492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 msgr2=0x5628822d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.084+0000 7fd0d8c00640 1 -- 172.21.15.84:0/2656453492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562881f82540 con 0x562881eee0a0 2024-09-21T07:51:04.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881eee0a0 0x5628822c9050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4031d20 tx=0x7fd0c402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91029d05c11dd606 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0be000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0be000640 1 -- 172.21.15.84:0/2656453492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4031660 con 0x562881eee0a0 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0be000640 1 -- 172.21.15.84:0/2656453492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd0c4031800 con 0x562881eee0a0 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5628821c1a70 con 0x562881eee0a0 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0be000640 1 -- 172.21.15.84:0/2656453492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd0c405d050 con 0x562881eee0a0 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0e2239740 10 client.15660 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.085+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628821dc6f0 con 0x562881eee0a0 2024-09-21T07:51:04.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0be000640 1 -- 172.21.15.84:0/2656453492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5628821c1a70 con 0x562881eee0a0 2024-09-21T07:51:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0be000640 1 -- 172.21.15.84:0/2656453492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd0c404e070 con 0x562881eee0a0 2024-09-21T07:51:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0e2239740 10 client.15660 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0e2239740 10 client.15660 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:51:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0e2239740 20 client.15660 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:04.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881ed58e0 0x5628822db070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0e2239740 4 client.15660 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.086+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562882236ca0 con 0x562881ed58e0 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.087+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881ed58e0 0x5628822db070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.088+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881ed58e0 0x5628822db070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=40017ee0445c9500 server_cookie=f3fca75450ac6855 in_seq=0 out_seq=0 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.088+0000 7fd0be000640 10 client.15660 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.088+0000 7fd0be000640 1 -- 172.21.15.84:0/2656453492 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562882236ca0 con 0x562881ed58e0 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.088+0000 7fd0be000640 10 client.15660 handle_command_reply: tid=0 2024-09-21T07:51:04.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.088+0000 7fd0e2239740 1 client.15660 shutdown 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881eee0a0 msgr2=0x5628822c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881eee0a0 0x5628822c9050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4031d20 tx=0x7fd0c402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 shutdown_connections 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881ed58e0 0x5628822db070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881f16f60 0x5628822d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 --2- 172.21.15.84:0/2656453492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881eee0a0 0x5628822c9050 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 >> 172.21.15.84:0/2656453492 conn(0x562881f0b350 msgr2=0x5628822c0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0be000640 0 client.15660 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 shutdown_connections 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 1 -- 172.21.15.84:0/2656453492 wait complete. 2024-09-21T07:51:04.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.089+0000 7fd0e2239740 20 client.15660 trim_cache size 0 max 16384 2024-09-21T07:51:04.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.113+0000 7fd0e2239740 1 Processor -- start 2024-09-21T07:51:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.113+0000 7fd0e2239740 1 -- start start 2024-09-21T07:51:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881eee0a0 0x5628822c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822d4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0e2239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5628822d93b0 con 0x562881f16f60 2024-09-21T07:51:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0e2239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5628822d9a80 con 0x562881eee0a0 2024-09-21T07:51:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0e2239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5628822da150 con 0x562881ef6280 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0d9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822d4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0d8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881eee0a0 0x5628822c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0d9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822d4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52916/0 (socket says 172.21.15.84:52916) 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0d8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881eee0a0 0x5628822c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38236/0 (socket says 172.21.15.84:38236) 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.114+0000 7fd0d9600640 1 -- 172.21.15.84:0/397604864 learned_addr learned my addr 172.21.15.84:0/397604864 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0d8c00640 1 -- 172.21.15.84:0/397604864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 msgr2=0x5628822c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0d8c00640 1 -- 172.21.15.84:0/397604864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 msgr2=0x5628822d4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822d4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0d8c00640 1 -- 172.21.15.84:0/397604864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628822ca110 con 0x562881eee0a0 2024-09-21T07:51:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0d9600640 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822d4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881eee0a0 0x5628822c9030 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009ca0 tx=0x7fd0c40094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bbe1cbbcdaaeda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0c9200640 1 -- 172.21.15.84:0/397604864 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4031d50 con 0x562881eee0a0 2024-09-21T07:51:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0c9200640 1 -- 172.21.15.84:0/397604864 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c4054070 con 0x562881eee0a0 2024-09-21T07:51:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.115+0000 7fd0c9200640 1 -- 172.21.15.84:0/397604864 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c402f660 con 0x562881eee0a0 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 -- 172.21.15.84:0/397604864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881eee0a0 msgr2=0x5628822c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881eee0a0 0x5628822c9030 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009ca0 tx=0x7fd0c40094a0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 -- 172.21.15.84:0/397604864 shutdown_connections 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822d4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881ef6280 0x5628822c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 --2- 172.21.15.84:0/397604864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881eee0a0 0x5628822c9030 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 -- 172.21.15.84:0/397604864 >> 172.21.15.84:0/397604864 conn(0x562881f0b350 msgr2=0x5628822b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 -- 172.21.15.84:0/397604864 shutdown_connections 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.116+0000 7fd0e2239740 1 -- 172.21.15.84:0/397604864 wait complete. 2024-09-21T07:51:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.117+0000 7fd0e2239740 1 -- start start 2024-09-21T07:51:04.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.117+0000 7fd0e2239740 1 Processor -- start 2024-09-21T07:51:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881ef6280 0x5628822e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0e2239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0e2239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5628822daef0 con 0x562881f16f60 2024-09-21T07:51:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0e2239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5628822da820 con 0x562881ef6280 2024-09-21T07:51:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0e2239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5628822db5c0 con 0x562881eee0a0 2024-09-21T07:51:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0e2239740 10 client.0 _ll_register_callbacks cb 0x7fd0c40093f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0d9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0d9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822dcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52928/0 (socket says 172.21.15.84:52928) 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0d9600640 1 -- 172.21.15.84:0/1745859431 learned_addr learned my addr 172.21.15.84:0/1745859431 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0d8c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881ef6280 0x5628822e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.118+0000 7fd0d9600640 1 -- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 msgr2=0x5628822e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0d9600640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0d9600640 1 -- 172.21.15.84:0/1745859431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881ef6280 msgr2=0x5628822e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0d9600640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881ef6280 0x5628822e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0d9600640 1 -- 172.21.15.84:0/1745859431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628822dd4b0 con 0x562881f16f60 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0d3e00640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881ef6280 0x5628822e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0d9600640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822dcd40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0aabd0 tx=0x7fd0cc0e5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c949ea6982551df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0be000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0be000640 1 -- 172.21.15.84:0/1745859431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0acdc0 con 0x562881f16f60 2024-09-21T07:51:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0be000640 1 -- 172.21.15.84:0/1745859431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd0cc0c3b10 con 0x562881f16f60 2024-09-21T07:51:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c4054070 con 0x562881f16f60 2024-09-21T07:51:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0be000640 1 -- 172.21.15.84:0/1745859431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd0cc0055f0 con 0x562881f16f60 2024-09-21T07:51:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0e2239740 10 client.15666 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.119+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628822e2e10 con 0x562881f16f60 2024-09-21T07:51:04.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0be000640 1 -- 172.21.15.84:0/1745859431 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c4054070 con 0x562881f16f60 2024-09-21T07:51:04.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0be000640 1 -- 172.21.15.84:0/1745859431 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd0cc0ac630 con 0x562881f16f60 2024-09-21T07:51:04.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0e2239740 10 client.15666 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:04.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0e2239740 10 client.15666 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0e2239740 20 client.15666 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0e2239740 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881eaac90 0x562882352160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0e2239740 4 client.15666 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "status"}) -- 0x5628822d9200 con 0x562881eaac90 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.120+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881eaac90 0x562882352160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.121+0000 7fd0d8c00640 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881eaac90 0x562882352160 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d19875fc1a757653 server_cookie=6b4bed7bde7ad026 in_seq=0 out_seq=0 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.121+0000 7fd0be000640 10 client.15666 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.121+0000 7fd0be000640 1 -- 172.21.15.84:0/1745859431 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5628822d9200 con 0x562881eaac90 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.121+0000 7fd0be000640 10 client.15666 handle_command_reply: tid=0 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.121+0000 7fd0e2239740 1 client.15666 shutdown 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 msgr2=0x5628822dcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822dcd40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0aabd0 tx=0x7fd0cc0e5760 comp rx=0 tx=0).stop 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 shutdown_connections 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x562881eaac90 0x562882352160 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562881f16f60 0x5628822dcd40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562881ef6280 0x5628822e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 --2- 172.21.15.84:0/1745859431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562881eee0a0 0x5628822e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 >> 172.21.15.84:0/1745859431 conn(0x562881f0b350 msgr2=0x5628822be4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0be000640 0 client.15666 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 shutdown_connections 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 1 -- 172.21.15.84:0/1745859431 wait complete. 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.122+0000 7fd0e2239740 20 client.15666 trim_cache size 0 max 16384 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 4, 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24712, 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:51:04.126 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 149.98562709500001, 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 29, 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 232.94399667799999 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd0b80b6680 msgr2=0x7fd0b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd0b80b6680 0x7fd0b80b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0d406caa0 tx=0x7fd0c0004730 comp rx=0 tx=0).stop 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d410c010 msgr2=0x7fd0d41a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d410c010 0x7fd0d41a1f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00e970 tx=0x7fd0cc00ed70 comp rx=0 tx=0).stop 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 shutdown_connections 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd0b80b6680 0x7fd0b80b8b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d410c010 0x7fd0d41a1f20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0d410b6c0 0x7fd0d419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 --2- 172.21.15.84:0/1670964040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d4105d80 0x7fd0d419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 >> 172.21.15.84:0/1670964040 conn(0x7fd0d4101810 msgr2=0x7fd0d4103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 shutdown_connections 2024-09-21T07:51:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:04.123+0000 7fd0db600640 1 -- 172.21.15.84:0/1670964040 wait complete. 2024-09-21T07:51:04.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:04 smithi084 ceph-mon[30411]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-09-21T07:51:04.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:04 smithi191 ceph-mon[34667]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-09-21T07:51:04.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:04 smithi162 ceph-mon[34833]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-09-21T07:51:04.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T07:51:05.313 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:05 smithi191 ceph-mon[34667]: pgmap v393: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-09-21T07:51:05.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:05 smithi084 ceph-mon[30411]: pgmap v393: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-09-21T07:51:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:05 smithi162 ceph-mon[34833]: pgmap v393: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-09-21T07:51:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 -- 172.21.15.84:0/2499083346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 msgr2=0x7f4638112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 --2- 172.21.15.84:0/2499083346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 0x7f4638112610 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4630009ca0 tx=0x7f463002a950 comp rx=0 tx=0).stop 2024-09-21T07:51:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 -- 172.21.15.84:0/2499083346 shutdown_connections 2024-09-21T07:51:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 --2- 172.21.15.84:0/2499083346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 0x7f4638112610 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 --2- 172.21.15.84:0/2499083346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4638102f90 0x7f463810fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 --2- 172.21.15.84:0/2499083346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4638102640 0x7f4638102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 -- 172.21.15.84:0/2499083346 >> 172.21.15.84:0/2499083346 conn(0x7f46380796e0 msgr2=0x7f4638079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 -- 172.21.15.84:0/2499083346 shutdown_connections 2024-09-21T07:51:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.951+0000 7f463ca00640 1 -- 172.21.15.84:0/2499083346 wait complete. 2024-09-21T07:51:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.952+0000 7f463ca00640 1 Processor -- start 2024-09-21T07:51:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.952+0000 7f463ca00640 1 -- start start 2024-09-21T07:51:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f463ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4638102640 0x7f463819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f463ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4638102f90 0x7f463819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f463ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 0x7f46381a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f463ca00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4638115ce0 con 0x7f46381101f0 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f463ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4638115b60 con 0x7f4638102f90 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f463ca00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4638115e60 con 0x7f4638102640 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f462d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4638102f90 0x7f463819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f4636800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 0x7f46381a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f4635e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4638102640 0x7f463819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f462d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4638102f90 0x7f463819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38274/0 (socket says 172.21.15.84:38274) 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.953+0000 7f462d400640 1 -- 172.21.15.84:0/1530894988 learned_addr learned my addr 172.21.15.84:0/1530894988 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f4636800640 1 -- 172.21.15.84:0/1530894988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4638102640 msgr2=0x7f463819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f4636800640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4638102640 0x7f463819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f4636800640 1 -- 172.21.15.84:0/1530894988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4638102f90 msgr2=0x7f463819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f4636800640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4638102f90 0x7f463819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f4636800640 1 -- 172.21.15.84:0/1530894988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46381a2560 con 0x7f46381101f0 2024-09-21T07:51:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f4636800640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 0x7f46381a1e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4630005e30 tx=0x7f4630003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f462f400640 1 -- 172.21.15.84:0/1530894988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630034040 con 0x7f46381101f0 2024-09-21T07:51:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f462f400640 1 -- 172.21.15.84:0/1530894988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f463002fd20 con 0x7f46381101f0 2024-09-21T07:51:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46381a27f0 con 0x7f46381101f0 2024-09-21T07:51:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f462f400640 1 -- 172.21.15.84:0/1530894988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630004540 con 0x7f46381101f0 2024-09-21T07:51:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.954+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46381a8fb0 con 0x7f46381101f0 2024-09-21T07:51:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.957+0000 7f4643662740 1 Processor -- start 2024-09-21T07:51:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f462f400640 1 -- 172.21.15.84:0/1530894988 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4630037020 con 0x7f46381101f0 2024-09-21T07:51:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f4643662740 1 -- start start 2024-09-21T07:51:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f4643662740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd3a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f4643662740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd3a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f4643662740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd3af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f4643662740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561efccb1d50 con 0x561efc973280 2024-09-21T07:51:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f4643662740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561efcca1180 con 0x561efc96b0a0 2024-09-21T07:51:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f4643662740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561efcca4f90 con 0x561efc993f60 2024-09-21T07:51:05.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.958+0000 7f462d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd3a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f4635e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd3a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f462d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd3a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48800/0 (socket says 172.21.15.84:48800) 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f462d400640 1 -- 172.21.15.84:0/2220719152 learned_addr learned my addr 172.21.15.84:0/2220719152 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f462d400640 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd3af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f4635e00640 1 -- 172.21.15.84:0/2220719152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 msgr2=0x561efcd3a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f4635e00640 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd3a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f4635e00640 1 -- 172.21.15.84:0/2220719152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 msgr2=0x561efcd3af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f4635e00640 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd3af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f4635e00640 1 -- 172.21.15.84:0/2220719152 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efcc6ba70 con 0x561efc96b0a0 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f462f400640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f461c0b6680 0x7f461c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.959+0000 7f4635e00640 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd3a9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4628009c00 tx=0x7f4628011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e736438f9bebcf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.960+0000 7f462f400640 1 -- 172.21.15.84:0/1530894988 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4630108300 con 0x7f46381101f0 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.960+0000 7f462d400640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f461c0b6680 0x7f461c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.960+0000 7f4627000640 1 -- 172.21.15.84:0/2220719152 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628004230 con 0x561efc96b0a0 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.960+0000 7f4627000640 1 -- 172.21.15.84:0/2220719152 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46280043d0 con 0x561efc96b0a0 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.960+0000 7f4627000640 1 -- 172.21.15.84:0/2220719152 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628004c60 con 0x561efc96b0a0 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 -- 172.21.15.84:0/2220719152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 msgr2=0x561efcd3a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f462d400640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f461c0b6680 0x7f461c0b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4620004650 tx=0x7f4620004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd3a9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4628009c00 tx=0x7f4628011810 comp rx=0 tx=0).stop 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 -- 172.21.15.84:0/2220719152 shutdown_connections 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd3af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd3a9d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 --2- 172.21.15.84:0/2220719152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd3a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 -- 172.21.15.84:0/2220719152 >> 172.21.15.84:0/2220719152 conn(0x561efc988350 msgr2=0x561efcd38380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 -- 172.21.15.84:0/2220719152 shutdown_connections 2024-09-21T07:51:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 -- 172.21.15.84:0/2220719152 wait complete. 2024-09-21T07:51:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.961+0000 7f4643662740 1 -- start start 2024-09-21T07:51:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 1 Processor -- start 2024-09-21T07:51:05.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd45f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd46470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd51f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561efcb025f0 con 0x561efc973280 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561efcc3c460 con 0x561efc96b0a0 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561efcd48c70 con 0x561efc993f60 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f4643662740 10 client.0 _ll_register_callbacks cb 0x561efcc4c210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.962+0000 7f462d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd46470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd46470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52956/0 (socket says 172.21.15.84:52956) 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 -- 172.21.15.84:0/3855995334 learned_addr learned my addr 172.21.15.84:0/3855995334 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f4635e00640 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd45f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 -- 172.21.15.84:0/3855995334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 msgr2=0x561efcd51f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd51f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 -- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 msgr2=0x561efcd45f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd45f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 -- 172.21.15.84:0/3855995334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efc9ff540 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f462d400640 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd46470 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f462000fd50 tx=0x7f46200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcb39e09b5d3e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.963+0000 7f461b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f461b400640 1 -- 172.21.15.84:0/3855995334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620011e30 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f461b400640 1 -- 172.21.15.84:0/3855995334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f462001a050 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561efcc3ea70 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f461b400640 1 -- 172.21.15.84:0/3855995334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4620037050 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f4643662740 10 client.15678 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561efcc596f0 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f461b400640 1 -- 172.21.15.84:0/3855995334 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561efcc3ea70 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.964+0000 7f461b400640 1 -- 172.21.15.84:0/3855995334 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f462002c970 con 0x561efc973280 2024-09-21T07:51:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.965+0000 7f4643662740 10 client.15678 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.965+0000 7f4643662740 10 client.15678 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.965+0000 7f4643662740 20 client.15678 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.965+0000 7f4643662740 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc9528e0 0x561efcd58590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.965+0000 7f4643662740 4 client.15678 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.965+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561efccb3ca0 con 0x561efc9528e0 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.965+0000 7f4635e00640 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc9528e0 0x561efcd58590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.966+0000 7f4635e00640 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc9528e0 0x561efcd58590 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=10c9c99a9c7ea908 server_cookie=95402bff7b12dafe in_seq=0 out_seq=0 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.966+0000 7f461b400640 10 client.15678 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f461b400640 1 -- 172.21.15.84:0/3855995334 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561efccb3ca0 con 0x561efc9528e0 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f461b400640 10 client.15678 handle_command_reply: tid=0 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 client.15678 shutdown 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 msgr2=0x561efcd46470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd46470 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f462000fd50 tx=0x7f46200046c0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 shutdown_connections 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc9528e0 0x561efcd58590 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd51f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd46470 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 --2- 172.21.15.84:0/3855995334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc96b0a0 0x561efcd45f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f461b400640 0 client.15678 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 >> 172.21.15.84:0/3855995334 conn(0x561efc988350 msgr2=0x561efcd3d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 shutdown_connections 2024-09-21T07:51:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.967+0000 7f4643662740 1 -- 172.21.15.84:0/3855995334 wait complete. 2024-09-21T07:51:05.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.968+0000 7f4643662740 20 client.15678 trim_cache size 0 max 16384 2024-09-21T07:51:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 Processor -- start 2024-09-21T07:51:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 -- start start 2024-09-21T07:51:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc96b0a0 0x561efcd405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc973280 0x561efcd51f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd52440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561efcd568d0 con 0x561efc96b0a0 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561efcd56fa0 con 0x561efc973280 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.986+0000 7f4643662740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561efcd57670 con 0x561efc993f60 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc96b0a0 0x561efcd405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc96b0a0 0x561efcd405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52962/0 (socket says 172.21.15.84:52962) 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 -- 172.21.15.84:0/849404794 learned_addr learned my addr 172.21.15.84:0/849404794 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f462d400640 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc973280 0x561efcd51f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4636800640 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd52440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 -- 172.21.15.84:0/849404794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 msgr2=0x561efcd52440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd52440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 -- 172.21.15.84:0/849404794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc973280 msgr2=0x561efcd51f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc973280 0x561efcd51f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.987+0000 7f4635e00640 1 -- 172.21.15.84:0/849404794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efcd46dd0 con 0x561efc96b0a0 2024-09-21T07:51:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.988+0000 7f4635e00640 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc96b0a0 0x561efcd405b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4628005fd0 tx=0x7f4628011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f559188903530067 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.988+0000 7f4626600640 1 -- 172.21.15.84:0/849404794 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462801e040 con 0x561efc96b0a0 2024-09-21T07:51:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.988+0000 7f4626600640 1 -- 172.21.15.84:0/849404794 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4628030070 con 0x561efc96b0a0 2024-09-21T07:51:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.988+0000 7f4626600640 1 -- 172.21.15.84:0/849404794 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628003d30 con 0x561efc96b0a0 2024-09-21T07:51:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 -- 172.21.15.84:0/849404794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc96b0a0 msgr2=0x561efcd405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc96b0a0 0x561efcd405b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4628005fd0 tx=0x7f4628011810 comp rx=0 tx=0).stop 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 -- 172.21.15.84:0/849404794 shutdown_connections 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc993f60 0x561efcd52440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc973280 0x561efcd51f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 --2- 172.21.15.84:0/849404794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc96b0a0 0x561efcd405b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 -- 172.21.15.84:0/849404794 >> 172.21.15.84:0/849404794 conn(0x561efc988350 msgr2=0x561efcd40f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 -- 172.21.15.84:0/849404794 shutdown_connections 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 -- 172.21.15.84:0/849404794 wait complete. 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.989+0000 7f4643662740 1 -- start start 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 1 Processor -- start 2024-09-21T07:51:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc96b0a0 0x561efcd60df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd5a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc993f60 0x561efcd5a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561efcd58410 con 0x561efc973280 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561efcd57d40 con 0x561efc993f60 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561efcd58ae0 con 0x561efc96b0a0 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4643662740 10 client.0 _ll_register_callbacks cb 0x7f462000fc10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f462d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd5a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f462d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd5a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52974/0 (socket says 172.21.15.84:52974) 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4636800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc993f60 0x561efcd5a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f462d400640 1 -- 172.21.15.84:0/1144963519 learned_addr learned my addr 172.21.15.84:0/1144963519 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.990+0000 7f4635e00640 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc96b0a0 0x561efcd60df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f4636800640 1 -- 172.21.15.84:0/1144963519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc96b0a0 msgr2=0x561efcd60df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f4636800640 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc96b0a0 0x561efcd60df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f4636800640 1 -- 172.21.15.84:0/1144963519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 msgr2=0x561efcd5a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f4636800640 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd5a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f4636800640 1 -- 172.21.15.84:0/1144963519 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efcd5ad50 con 0x561efc993f60 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f4636800640 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc993f60 0x561efcd5a7e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46301056e0 tx=0x7f46300cdc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c6cefe55642246d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f461b400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f461b400640 1 -- 172.21.15.84:0/1144963519 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463002c040 con 0x561efc993f60 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f461b400640 1 -- 172.21.15.84:0/1144963519 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f46300b3bb0 con 0x561efc993f60 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.991+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4628030070 con 0x561efc993f60 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f461b400640 1 -- 172.21.15.84:0/1144963519 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f463002fed0 con 0x561efc993f60 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 10 client.25649 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561efcd607a0 con 0x561efc993f60 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f461b400640 1 -- 172.21.15.84:0/1144963519 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4628030070 con 0x561efc993f60 2024-09-21T07:51:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f461b400640 1 -- 172.21.15.84:0/1144963519 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f463004c020 con 0x561efc993f60 2024-09-21T07:51:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 10 client.25649 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 10 client.25649 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:51:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 20 client.25649 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc927c90 0x561efcdc70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 4 client.25649 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:51:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.992+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "status"}) -- 0x561efccaf750 con 0x561efc927c90 2024-09-21T07:51:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.993+0000 7f4635e00640 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc927c90 0x561efcdc70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.993+0000 7f4635e00640 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc927c90 0x561efcdc70f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d4ac0f09857264e server_cookie=67e29ed4feca9b60 in_seq=0 out_seq=0 2024-09-21T07:51:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.993+0000 7f461b400640 10 client.25649 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.993+0000 7f461b400640 1 -- 172.21.15.84:0/1144963519 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561efccaf750 con 0x561efc927c90 2024-09-21T07:51:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.993+0000 7f461b400640 10 client.25649 handle_command_reply: tid=0 2024-09-21T07:51:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.993+0000 7f4643662740 1 client.25649 shutdown 2024-09-21T07:51:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc993f60 msgr2=0x561efcd5a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc993f60 0x561efcd5a7e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46301056e0 tx=0x7f46300cdc20 comp rx=0 tx=0).stop 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 shutdown_connections 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x561efc927c90 0x561efcdc70f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561efc993f60 0x561efcd5a7e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561efc973280 0x561efcd5a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 --2- 172.21.15.84:0/1144963519 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561efc96b0a0 0x561efcd60df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 >> 172.21.15.84:0/1144963519 conn(0x561efc988350 msgr2=0x561efcd37b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f461b400640 0 client.25649 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 shutdown_connections 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 1 -- 172.21.15.84:0/1144963519 wait complete. 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.994+0000 7f4643662740 20 client.25649 trim_cache size 0 max 16384 2024-09-21T07:51:06.000 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 3, 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24719, 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 152.87146149500001, 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 29, 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T07:51:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 229.49423019700001 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f461c0b6680 msgr2=0x7f461c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f461c0b6680 0x7f461c0b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4620004650 tx=0x7f4620004730 comp rx=0 tx=0).stop 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 msgr2=0x7f46381a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 0x7f46381a1e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4630005e30 tx=0x7f4630003c10 comp rx=0 tx=0).stop 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 shutdown_connections 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f461c0b6680 0x7f461c0b8b90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46381101f0 0x7f46381a1e30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4638102f90 0x7f463819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 --2- 172.21.15.84:0/1530894988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4638102640 0x7f463819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 >> 172.21.15.84:0/1530894988 conn(0x7f46380796e0 msgr2=0x7f46381114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 shutdown_connections 2024-09-21T07:51:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:05.995+0000 7f463ca00640 1 -- 172.21.15.84:0/1530894988 wait complete. 2024-09-21T07:51:06.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:51:07.230 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:07.369 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:07 smithi084 ceph-mon[30411]: pgmap v394: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 31 op/s 2024-09-21T07:51:07.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:07 smithi191 ceph-mon[34667]: pgmap v394: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 31 op/s 2024-09-21T07:51:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:07 smithi162 ceph-mon[34833]: pgmap v394: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 31 op/s 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 -- 172.21.15.84:0/1921399310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c105bb0 msgr2=0x7fe67c105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 --2- 172.21.15.84:0/1921399310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c105bb0 0x7fe67c105fc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009900 tx=0x7fe66c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 -- 172.21.15.84:0/1921399310 shutdown_connections 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 --2- 172.21.15.84:0/1921399310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe67c10be40 0x7fe67c112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 --2- 172.21.15.84:0/1921399310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe67c10b4f0 0x7fe67c10b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 --2- 172.21.15.84:0/1921399310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c105bb0 0x7fe67c105fc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 -- 172.21.15.84:0/1921399310 >> 172.21.15.84:0/1921399310 conn(0x7fe67c101680 msgr2=0x7fe67c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:07.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.883+0000 7fe681400640 1 -- 172.21.15.84:0/1921399310 shutdown_connections 2024-09-21T07:51:07.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.884+0000 7fe681400640 1 -- 172.21.15.84:0/1921399310 wait complete. 2024-09-21T07:51:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.884+0000 7fe681400640 1 Processor -- start 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe681400640 1 -- start start 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe681400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe67c105bb0 0x7fe67c19c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe681400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c10b4f0 0x7fe67c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe681400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe67c10be40 0x7fe67c1a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe681400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c115b00 con 0x7fe67c10b4f0 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe681400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c115980 con 0x7fe67c105bb0 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe681400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c115c80 con 0x7fe67c10be40 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe67b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c10b4f0 0x7fe67c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe67b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c10b4f0 0x7fe67c19cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47154/0 (socket says 172.21.15.84:47154) 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe67b400640 1 -- 172.21.15.84:0/2928705346 learned_addr learned my addr 172.21.15.84:0/2928705346 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.885+0000 7fe67be00640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe67c105bb0 0x7fe67c19c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe680a00640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe67c10be40 0x7fe67c1a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe67b400640 1 -- 172.21.15.84:0/2928705346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe67c10be40 msgr2=0x7fe67c1a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe67b400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe67c10be40 0x7fe67c1a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe67b400640 1 -- 172.21.15.84:0/2928705346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe67c105bb0 msgr2=0x7fe67c19c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe67b400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe67c105bb0 0x7fe67c19c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe67b400640 1 -- 172.21.15.84:0/2928705346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c1a2500 con 0x7fe67c10b4f0 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe67be00640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe67c105bb0 0x7fe67c19c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.886+0000 7fe67b400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c10b4f0 0x7fe67c19cb30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e9c0 tx=0x7fe66800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.887+0000 7fe678c00640 1 -- 172.21.15.84:0/2928705346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800ccc0 con 0x7fe67c10b4f0 2024-09-21T07:51:07.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.887+0000 7fe678c00640 1 -- 172.21.15.84:0/2928705346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6680054d0 con 0x7fe67c10b4f0 2024-09-21T07:51:07.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.887+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c1a27f0 con 0x7fe67c10b4f0 2024-09-21T07:51:07.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.887+0000 7fe678c00640 1 -- 172.21.15.84:0/2928705346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668010430 con 0x7fe67c10b4f0 2024-09-21T07:51:07.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.887+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c1a8f50 con 0x7fe67c10b4f0 2024-09-21T07:51:07.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.890+0000 7fe678c00640 1 -- 172.21.15.84:0/2928705346 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe668004f40 con 0x7fe67c10b4f0 2024-09-21T07:51:07.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.890+0000 7fe689817740 1 Processor -- start 2024-09-21T07:51:07.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.890+0000 7fe689817740 1 -- start start 2024-09-21T07:51:07.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe689817740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b0697670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe689817740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b0697bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe689817740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe689817740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592b060ed50 con 0x5592b02c80a0 2024-09-21T07:51:07.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe689817740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592b05fe180 con 0x5592b02f0f60 2024-09-21T07:51:07.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe689817740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592b0601f90 con 0x5592b02d0280 2024-09-21T07:51:07.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe67be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b0697bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe67be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b0697bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47166/0 (socket says 172.21.15.84:47166) 2024-09-21T07:51:07.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe67be00640 1 -- 172.21.15.84:0/2415130476 learned_addr learned my addr 172.21.15.84:0/2415130476 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:07.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe67b400640 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.891+0000 7fe680a00640 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b0697670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe67be00640 1 -- 172.21.15.84:0/2415130476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 msgr2=0x5592b06980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe67be00640 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe67be00640 1 -- 172.21.15.84:0/2415130476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 msgr2=0x5592b0697670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe67be00640 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b0697670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe67be00640 1 -- 172.21.15.84:0/2415130476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b05c8a70 con 0x5592b02c80a0 2024-09-21T07:51:07.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe67b400640 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:07.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe678c00640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6600b6700 0x7fe6600b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe67be00640 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b0697bb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009900 tx=0x7fe66c005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d85f2ecb407efdb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:07.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe678c00640 1 -- 172.21.15.84:0/2928705346 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe6680e7e40 con 0x7fe67c10b4f0 2024-09-21T07:51:07.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe680a00640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6600b6700 0x7fe6600b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.892+0000 7fe671200640 1 -- 172.21.15.84:0/2415130476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c040070 con 0x5592b02c80a0 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.893+0000 7fe671200640 1 -- 172.21.15.84:0/2415130476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe66c031720 con 0x5592b02c80a0 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.893+0000 7fe671200640 1 -- 172.21.15.84:0/2415130476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c035040 con 0x5592b02c80a0 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 -- 172.21.15.84:0/2415130476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 msgr2=0x5592b0697bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe680a00640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6600b6700 0x7fe6600b8c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe674005fd0 tx=0x7fe674009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b0697bb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009900 tx=0x7fe66c005e20 comp rx=0 tx=0).stop 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 -- 172.21.15.84:0/2415130476 shutdown_connections 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b0697bb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 --2- 172.21.15.84:0/2415130476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b0697670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 -- 172.21.15.84:0/2415130476 >> 172.21.15.84:0/2415130476 conn(0x5592b02e5350 msgr2=0x5592b0695560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:07.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 -- 172.21.15.84:0/2415130476 shutdown_connections 2024-09-21T07:51:07.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 -- 172.21.15.84:0/2415130476 wait complete. 2024-09-21T07:51:07.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.894+0000 7fe689817740 1 -- start start 2024-09-21T07:51:07.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 1 Processor -- start 2024-09-21T07:51:07.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02c80a0 0x5592b06a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02d0280 0x5592b06a3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592b045f5f0 con 0x5592b02d0280 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592b0599460 con 0x5592b02c80a0 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592b06a5df0 con 0x5592b02f0f60 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.895+0000 7fe689817740 10 client.0 _ll_register_callbacks cb 0x5592b05a9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02c80a0 0x5592b06a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02c80a0 0x5592b06a32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45454/0 (socket says 172.21.15.84:45454) 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02d0280 0x5592b06a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 -- 172.21.15.84:0/4139042873 learned_addr learned my addr 172.21.15.84:0/4139042873 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe680a00640 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 -- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 msgr2=0x5592b06af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 -- 172.21.15.84:0/4139042873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02d0280 msgr2=0x5592b06a3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02d0280 0x5592b06a3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 -- 172.21.15.84:0/4139042873 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b035c540 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe67be00640 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02c80a0 0x5592b06a32b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0317d0 tx=0x7fe66c0053f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=170cc5c5b2e5d688 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.896+0000 7fe665600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.897+0000 7fe665600640 1 -- 172.21.15.84:0/4139042873 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c051060 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.897+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5592b059ba70 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.897+0000 7fe665600640 1 -- 172.21.15.84:0/4139042873 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe66c004450 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.897+0000 7fe665600640 1 -- 172.21.15.84:0/4139042873 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe66c058050 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.897+0000 7fe689817740 10 client.25661 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.897+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592b05b66f0 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.897+0000 7fe665600640 1 -- 172.21.15.84:0/4139042873 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5592b059ba70 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe665600640 1 -- 172.21.15.84:0/4139042873 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe66c03c440 con 0x5592b02c80a0 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe689817740 10 client.25661 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe689817740 10 client.25661 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe689817740 20 client.25661 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe689817740 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b02af8e0 0x5592b06b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe689817740 4 client.25661 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592b0610ca0 con 0x5592b02af8e0 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.898+0000 7fe67b400640 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b02af8e0 0x5592b06b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.899+0000 7fe67b400640 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b02af8e0 0x5592b06b52b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ca9796ac21f9b74 server_cookie=55634ce2ff0dc0cd in_seq=0 out_seq=0 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.899+0000 7fe665600640 10 client.25661 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe665600640 1 -- 172.21.15.84:0/4139042873 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592b0610ca0 con 0x5592b02af8e0 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe665600640 10 client.25661 handle_command_reply: tid=0 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 client.25661 shutdown 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02c80a0 msgr2=0x5592b06a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02c80a0 0x5592b06a32b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0317d0 tx=0x7fe66c0053f0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 shutdown_connections 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b02af8e0 0x5592b06b52b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02d0280 0x5592b06a3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 --2- 172.21.15.84:0/4139042873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02c80a0 0x5592b06a32b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 >> 172.21.15.84:0/4139042873 conn(0x5592b02e5350 msgr2=0x5592b069a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe665600640 0 client.25661 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 shutdown_connections 2024-09-21T07:51:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 1 -- 172.21.15.84:0/4139042873 wait complete. 2024-09-21T07:51:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.900+0000 7fe689817740 20 client.25661 trim_cache size 0 max 16384 2024-09-21T07:51:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 Processor -- start 2024-09-21T07:51:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 -- start start 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02d0280 0x5592b069d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592b06b35f0 con 0x5592b02c80a0 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592b06b3cc0 con 0x5592b02d0280 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.919+0000 7fe689817740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592b06b4390 con 0x5592b02f0f60 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02d0280 0x5592b069d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47188/0 (socket says 172.21.15.84:47188) 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67be00640 1 -- 172.21.15.84:0/1261385561 learned_addr learned my addr 172.21.15.84:0/1261385561 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe680a00640 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67b400640 1 -- 172.21.15.84:0/1261385561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 msgr2=0x5592b06af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67b400640 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67b400640 1 -- 172.21.15.84:0/1261385561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 msgr2=0x5592b06a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67b400640 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67b400640 1 -- 172.21.15.84:0/1261385561 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b06a4370 con 0x5592b02d0280 2024-09-21T07:51:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67be00640 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.920+0000 7fe67b400640 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02d0280 0x5592b069d4e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6680e5220 tx=0x7fe6680eb8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9d268f86294404 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.921+0000 7fe667e00640 1 -- 172.21.15.84:0/1261385561 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680a9f70 con 0x5592b02d0280 2024-09-21T07:51:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.921+0000 7fe667e00640 1 -- 172.21.15.84:0/1261385561 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6680ad430 con 0x5592b02d0280 2024-09-21T07:51:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.921+0000 7fe667e00640 1 -- 172.21.15.84:0/1261385561 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680a9090 con 0x5592b02d0280 2024-09-21T07:51:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.921+0000 7fe689817740 1 -- 172.21.15.84:0/1261385561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02d0280 msgr2=0x5592b069d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.921+0000 7fe689817740 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02d0280 0x5592b069d4e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6680e5220 tx=0x7fe6680eb8f0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 -- 172.21.15.84:0/1261385561 shutdown_connections 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02f0f60 0x5592b06af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02d0280 0x5592b069d4e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 --2- 172.21.15.84:0/1261385561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 -- 172.21.15.84:0/1261385561 >> 172.21.15.84:0/1261385561 conn(0x5592b02e5350 msgr2=0x5592b06a3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 -- 172.21.15.84:0/1261385561 shutdown_connections 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 -- 172.21.15.84:0/1261385561 wait complete. 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 -- start start 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.922+0000 7fe689817740 1 Processor -- start 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe689817740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe689817740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe689817740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b06b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe689817740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592b06b5130 con 0x5592b02c80a0 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe689817740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592b06b4a60 con 0x5592b02f0f60 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe689817740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592b06b5800 con 0x5592b02d0280 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe689817740 10 client.0 _ll_register_callbacks cb 0x7fe66c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47200/0 (socket says 172.21.15.84:47200) 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 -- 172.21.15.84:0/3552068306 learned_addr learned my addr 172.21.15.84:0/3552068306 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe680a00640 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b06b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 -- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 msgr2=0x5592b06b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 -- 172.21.15.84:0/3552068306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 msgr2=0x5592b06b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b06b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.923+0000 7fe67be00640 1 -- 172.21.15.84:0/3552068306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b06bcc10 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe67b400640 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe67be00640 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06b74d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009900 tx=0x7fe66c032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb693f3827c94f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe665600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe665600640 1 -- 172.21.15.84:0/3552068306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c051040 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe665600640 1 -- 172.21.15.84:0/3552068306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe66c004250 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6680ad430 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe665600640 1 -- 172.21.15.84:0/3552068306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe66c06a050 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe689817740 10 client.15702 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.924+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592b07209c0 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe665600640 1 -- 172.21.15.84:0/3552068306 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6680ad430 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe665600640 1 -- 172.21.15.84:0/3552068306 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe66c0035f0 con 0x5592b02c80a0 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe689817740 10 client.15702 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe689817740 10 client.15702 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:51:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe689817740 20 client.15702 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe689817740 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b0284c90 0x5592b0724330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe689817740 4 client.15702 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "status"}) -- 0x5592b060c750 con 0x5592b0284c90 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.925+0000 7fe67b400640 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b0284c90 0x5592b0724330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe67b400640 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b0284c90 0x5592b0724330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b42578513f694209 server_cookie=310e0b0dddb811aa in_seq=0 out_seq=0 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe665600640 10 client.15702 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe665600640 1 -- 172.21.15.84:0/3552068306 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5592b060c750 con 0x5592b0284c90 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe665600640 10 client.15702 handle_command_reply: tid=0 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 client.15702 shutdown 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 msgr2=0x5592b06b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06b74d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009900 tx=0x7fe66c032ed0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 shutdown_connections 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5592b0284c90 0x5592b0724330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592b02f0f60 0x5592b06b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592b02d0280 0x5592b06b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 --2- 172.21.15.84:0/3552068306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592b02c80a0 0x5592b06b74d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe665600640 0 client.15702 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.926+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 >> 172.21.15.84:0/3552068306 conn(0x5592b02e5350 msgr2=0x5592b0694df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.927+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 shutdown_connections 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.927+0000 7fe689817740 1 -- 172.21.15.84:0/3552068306 wait complete. 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.927+0000 7fe689817740 20 client.15702 trim_cache size 0 max 16384 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:07.934 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24724, 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 155.810458708, 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 29, 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 234.061627536 2024-09-21T07:51:07.935 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.927+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6600b6700 msgr2=0x7fe6600b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.927+0000 7fe681400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6600b6700 0x7fe6600b8c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe674005fd0 tx=0x7fe674009500 comp rx=0 tx=0).stop 2024-09-21T07:51:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.927+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c10b4f0 msgr2=0x7fe67c19cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.927+0000 7fe681400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c10b4f0 0x7fe67c19cb30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e9c0 tx=0x7fe66800edc0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 shutdown_connections 2024-09-21T07:51:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe6600b6700 0x7fe6600b8c10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe67c10be40 0x7fe67c1a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe67c10b4f0 0x7fe67c19cb30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 --2- 172.21.15.84:0/2928705346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe67c105bb0 0x7fe67c19c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 >> 172.21.15.84:0/2928705346 conn(0x7fe67c101680 msgr2=0x7fe67c103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 shutdown_connections 2024-09-21T07:51:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:07.928+0000 7fe681400640 1 -- 172.21.15.84:0/2928705346 wait complete. 2024-09-21T07:51:08.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:51:09.074 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:09.394 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:09 smithi084 ceph-mon[30411]: pgmap v395: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-09-21T07:51:09.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:09 smithi191 ceph-mon[34667]: pgmap v395: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-09-21T07:51:09.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:09 smithi162 ceph-mon[34833]: pgmap v395: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-09-21T07:51:09.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 -- 172.21.15.84:0/180383791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc410de50 msgr2=0x7fabc4110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:09.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 --2- 172.21.15.84:0/180383791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc410de50 0x7fabc4110320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009ca0 tx=0x7fabbc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 -- 172.21.15.84:0/180383791 shutdown_connections 2024-09-21T07:51:09.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 --2- 172.21.15.84:0/180383791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc410de50 0x7fabc4110320 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 --2- 172.21.15.84:0/180383791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc41052d0 0x7fabc410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 --2- 172.21.15.84:0/180383791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc41048a0 0x7fabc4104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 -- 172.21.15.84:0/180383791 >> 172.21.15.84:0/180383791 conn(0x7fabc4079740 msgr2=0x7fabc4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:09.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 -- 172.21.15.84:0/180383791 shutdown_connections 2024-09-21T07:51:09.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.708+0000 7fabc8c00640 1 -- 172.21.15.84:0/180383791 wait complete. 2024-09-21T07:51:09.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.709+0000 7fabc8c00640 1 Processor -- start 2024-09-21T07:51:09.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabc8c00640 1 -- start start 2024-09-21T07:51:09.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabc8c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc41048a0 0x7fabc41027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabc8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc41052d0 0x7fabc4102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabc8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc410de50 0x7fabc4103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabc8c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4113ae0 con 0x7fabc41052d0 2024-09-21T07:51:09.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabc8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4113960 con 0x7fabc410de50 2024-09-21T07:51:09.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabc8c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4113c60 con 0x7fabc41048a0 2024-09-21T07:51:09.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabb9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc41052d0 0x7fabc4102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabb9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc41052d0 0x7fabc4102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47216/0 (socket says 172.21.15.84:47216) 2024-09-21T07:51:09.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.710+0000 7fabb9400640 1 -- 172.21.15.84:0/1491314334 learned_addr learned my addr 172.21.15.84:0/1491314334 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:09.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabb9400640 1 -- 172.21.15.84:0/1491314334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc41048a0 msgr2=0x7fabc41027b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:51:09.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabb9400640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc41048a0 0x7fabc41027b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabb9400640 1 -- 172.21.15.84:0/1491314334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc410de50 msgr2=0x7fabc4103230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabb9400640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc410de50 0x7fabc4103230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabb9400640 1 -- 172.21.15.84:0/1491314334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc41a8780 con 0x7fabc41052d0 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabb9400640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc41052d0 0x7fabc4102cf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fabac00e9f0 tx=0x7fabac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabbb400640 1 -- 172.21.15.84:0/1491314334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac00ccc0 con 0x7fabc41052d0 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabbb400640 1 -- 172.21.15.84:0/1491314334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabac0054d0 con 0x7fabc41052d0 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabbb400640 1 -- 172.21.15.84:0/1491314334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac010430 con 0x7fabc41052d0 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.711+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc41a8a70 con 0x7fabc41052d0 2024-09-21T07:51:09.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.712+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc41a8f60 con 0x7fabc41052d0 2024-09-21T07:51:09.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.716+0000 7fabcf7be740 1 Processor -- start 2024-09-21T07:51:09.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.716+0000 7fabcf7be740 1 -- start start 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d62490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d62f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabcf7be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557066cd9d50 con 0x55706699b280 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabcf7be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557066cc9180 con 0x5570669930a0 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabcf7be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557066cccf90 con 0x5570669bbf60 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabbb400640 1 -- 172.21.15.84:0/1491314334 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fabac0046c0 con 0x7fabc41052d0 2024-09-21T07:51:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabc2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d62490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabc2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d62490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:45680/0 (socket says 172.21.15.84:45680) 2024-09-21T07:51:09.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabc2800640 1 -- 172.21.15.84:0/2631827113 learned_addr learned my addr 172.21.15.84:0/2631827113 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:09.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabc1e00640 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.717+0000 7fabb9400640 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d62f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabc2800640 1 -- 172.21.15.84:0/2631827113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 msgr2=0x557066d629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabc2800640 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabc2800640 1 -- 172.21.15.84:0/2631827113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 msgr2=0x557066d62f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabc2800640 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d62f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabc2800640 1 -- 172.21.15.84:0/2631827113 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557066c93a70 con 0x5570669bbf60 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabc1e00640 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabb9400640 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d62f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabc2800640 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d62490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabbc02f530 tx=0x7fabbc0093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4da3c975422370 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.718+0000 7fabb3000640 1 -- 172.21.15.84:0/2631827113 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc031cf0 con 0x5570669bbf60 2024-09-21T07:51:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.719+0000 7fabb3000640 1 -- 172.21.15.84:0/2631827113 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabbc03f070 con 0x5570669bbf60 2024-09-21T07:51:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.719+0000 7fabb3000640 1 -- 172.21.15.84:0/2631827113 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc004040 con 0x5570669bbf60 2024-09-21T07:51:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.719+0000 7fabbb400640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faba80b6680 0x7faba80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.719+0000 7fabbb400640 1 -- 172.21.15.84:0/1491314334 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fabac0e7ea0 con 0x7fabc41052d0 2024-09-21T07:51:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.719+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faba80b6680 0x7faba80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.719+0000 7fabcf7be740 1 -- 172.21.15.84:0/2631827113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 msgr2=0x557066d62490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:09.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.719+0000 7fabcf7be740 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d62490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabbc02f530 tx=0x7fabbc0093e0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 -- 172.21.15.84:0/2631827113 shutdown_connections 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d62f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 --2- 172.21.15.84:0/2631827113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d62490 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 -- 172.21.15.84:0/2631827113 >> 172.21.15.84:0/2631827113 conn(0x5570669b0350 msgr2=0x557066d60380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 -- 172.21.15.84:0/2631827113 shutdown_connections 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 -- 172.21.15.84:0/2631827113 wait complete. 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faba80b6680 0x7faba80b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x557066d61110 tx=0x7fabb4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.720+0000 7fabcf7be740 1 -- start start 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 1 Processor -- start 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d6e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55706699b280 0x557066d6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669bbf60 0x557066d79f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557066b2a5f0 con 0x5570669bbf60 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557066c64460 con 0x5570669930a0 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557066d70c10 con 0x55706699b280 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabcf7be740 10 client.0 _ll_register_callbacks cb 0x557066c74210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabc2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669bbf60 0x557066d79f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d6e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d6e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45524/0 (socket says 172.21.15.84:45524) 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabc1e00640 1 -- 172.21.15.84:0/314299678 learned_addr learned my addr 172.21.15.84:0/314299678 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.721+0000 7fabb9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55706699b280 0x557066d6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabc1e00640 1 -- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55706699b280 msgr2=0x557066d6e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabc1e00640 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55706699b280 0x557066d6e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabc1e00640 1 -- 172.21.15.84:0/314299678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669bbf60 msgr2=0x557066d79f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabc1e00640 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669bbf60 0x557066d79f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabc1e00640 1 -- 172.21.15.84:0/314299678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557066a27540 con 0x5570669930a0 2024-09-21T07:51:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabc2800640 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669bbf60 0x557066d79f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabb9400640 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55706699b280 0x557066d6e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7fabc1e00640 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d6e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fabb400e760 tx=0x7fabb4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c1cb0b56ef5ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.722+0000 7faba7400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7faba7400640 1 -- 172.21.15.84:0/314299678 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4026630 con 0x5570669930a0 2024-09-21T07:51:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557066c66a70 con 0x5570669930a0 2024-09-21T07:51:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7faba7400640 1 -- 172.21.15.84:0/314299678 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fabb401d410 con 0x5570669930a0 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7faba7400640 1 -- 172.21.15.84:0/314299678 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fabb40267d0 con 0x5570669930a0 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7fabcf7be740 10 client.25676 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557066c816f0 con 0x5570669930a0 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7faba7400640 1 -- 172.21.15.84:0/314299678 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557066c66a70 con 0x5570669930a0 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.723+0000 7faba7400640 1 -- 172.21.15.84:0/314299678 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fabb40253d0 con 0x5570669930a0 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.724+0000 7fabcf7be740 10 client.25676 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.724+0000 7fabcf7be740 10 client.25676 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.724+0000 7fabcf7be740 20 client.25676 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.724+0000 7fabcf7be740 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706697a8e0 0x557066d80670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.724+0000 7fabcf7be740 4 client.25676 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.724+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557066cdbca0 con 0x55706697a8e0 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.724+0000 7fabb9400640 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706697a8e0 0x557066d80670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.725+0000 7fabb9400640 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706697a8e0 0x557066d80670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a26ab5dc0dead962 server_cookie=b4cb11aa2cbfdfc7 in_seq=0 out_seq=0 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.725+0000 7faba7400640 10 client.25676 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7faba7400640 1 -- 172.21.15.84:0/314299678 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557066cdbca0 con 0x55706697a8e0 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7faba7400640 10 client.25676 handle_command_reply: tid=0 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 client.25676 shutdown 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 msgr2=0x557066d6e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d6e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fabb400e760 tx=0x7fabb4004730 comp rx=0 tx=0).stop 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 shutdown_connections 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706697a8e0 0x557066d80670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669bbf60 0x557066d79f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55706699b280 0x557066d6e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 --2- 172.21.15.84:0/314299678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d6e0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7faba7400640 0 client.25676 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 >> 172.21.15.84:0/314299678 conn(0x5570669b0350 msgr2=0x557066d65620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 shutdown_connections 2024-09-21T07:51:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 1 -- 172.21.15.84:0/314299678 wait complete. 2024-09-21T07:51:09.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.726+0000 7fabcf7be740 20 client.25676 trim_cache size 0 max 16384 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 Processor -- start 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 -- start start 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669930a0 0x557066d80670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55706699b280 0x557066d7eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d79ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557066d7e9b0 con 0x5570669930a0 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557066d7f080 con 0x55706699b280 2024-09-21T07:51:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabcf7be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557066d7f750 con 0x5570669bbf60 2024-09-21T07:51:09.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669930a0 0x557066d80670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669930a0 0x557066d80670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47246/0 (socket says 172.21.15.84:47246) 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabc1e00640 1 -- 172.21.15.84:0/1943326627 learned_addr learned my addr 172.21.15.84:0/1943326627 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.745+0000 7fabb9400640 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55706699b280 0x557066d7eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabc2800640 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d79ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabc1e00640 1 -- 172.21.15.84:0/1943326627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 msgr2=0x557066d79ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d79ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabc1e00640 1 -- 172.21.15.84:0/1943326627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55706699b280 msgr2=0x557066d7eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55706699b280 0x557066d7eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabc1e00640 1 -- 172.21.15.84:0/1943326627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557066d64780 con 0x5570669930a0 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669930a0 0x557066d80670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fabb4016040 tx=0x7fabb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e083b0ee4cb9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabb2600640 1 -- 172.21.15.84:0/1943326627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4039070 con 0x5570669930a0 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabb2600640 1 -- 172.21.15.84:0/1943326627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabb4026430 con 0x5570669930a0 2024-09-21T07:51:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.746+0000 7fabb2600640 1 -- 172.21.15.84:0/1943326627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4026cf0 con 0x5570669930a0 2024-09-21T07:51:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 -- 172.21.15.84:0/1943326627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669930a0 msgr2=0x557066d80670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669930a0 0x557066d80670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fabb4016040 tx=0x7fabb40046c0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 -- 172.21.15.84:0/1943326627 shutdown_connections 2024-09-21T07:51:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d79ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55706699b280 0x557066d7eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1943326627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5570669930a0 0x557066d80670 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 -- 172.21.15.84:0/1943326627 >> 172.21.15.84:0/1943326627 conn(0x5570669b0350 msgr2=0x557066d5fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 -- 172.21.15.84:0/1943326627 shutdown_connections 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.747+0000 7fabcf7be740 1 -- 172.21.15.84:0/1943326627 wait complete. 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.748+0000 7fabcf7be740 1 -- start start 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.748+0000 7fabcf7be740 1 Processor -- start 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d88e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d67710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabcf7be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d67c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabcf7be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557066d804f0 con 0x55706699b280 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabcf7be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557066d7fe20 con 0x5570669930a0 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabcf7be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557066d80bc0 con 0x5570669bbf60 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabcf7be740 10 client.0 _ll_register_callbacks cb 0x7fabb400e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d88e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabb9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d67710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d88e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45536/0 (socket says 172.21.15.84:45536) 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 -- 172.21.15.84:0/1220777749 learned_addr learned my addr 172.21.15.84:0/1220777749 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc2800640 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d67c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 -- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 msgr2=0x557066d67c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d67c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 -- 172.21.15.84:0/1220777749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 msgr2=0x557066d67710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d67710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabc1e00640 1 -- 172.21.15.84:0/1220777749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557066d68190 con 0x5570669930a0 2024-09-21T07:51:09.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.749+0000 7fabb9400640 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d67710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7fabc1e00640 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d88e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fabb4037040 tx=0x7fabb4005ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243f3836d40b0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7faba7400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7faba7400640 1 -- 172.21.15.84:0/1220777749 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4039070 con 0x5570669930a0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb4026430 con 0x5570669930a0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7faba7400640 1 -- 172.21.15.84:0/1220777749 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fabb4025cd0 con 0x5570669930a0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7faba7400640 1 -- 172.21.15.84:0/1220777749 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fabb4048050 con 0x5570669930a0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7fabcf7be740 10 client.25682 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.750+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557066d854d0 con 0x5570669930a0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7faba7400640 1 -- 172.21.15.84:0/1220777749 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabb4026430 con 0x5570669930a0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7faba7400640 1 -- 172.21.15.84:0/1220777749 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fabb4004730 con 0x5570669930a0 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7fabcf7be740 10 client.25682 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7fabcf7be740 10 client.25682 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7fabcf7be740 20 client.25682 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706694fc90 0x557066deebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7fabcf7be740 4 client.25682 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.751+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "status"}) -- 0x557066cd7750 con 0x55706694fc90 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.752+0000 7fabb9400640 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706694fc90 0x557066deebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.752+0000 7fabb9400640 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706694fc90 0x557066deebe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b45fe5f536715cb server_cookie=f36276a83d3251ff in_seq=0 out_seq=0 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.752+0000 7faba7400640 10 client.25682 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7faba7400640 1 -- 172.21.15.84:0/1220777749 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x557066cd7750 con 0x55706694fc90 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7faba7400640 10 client.25682 handle_command_reply: tid=0 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 client.25682 shutdown 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 msgr2=0x557066d88e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d88e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fabb4037040 tx=0x7fabb4005ab0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 shutdown_connections 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55706694fc90 0x557066deebe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570669bbf60 0x557066d67c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55706699b280 0x557066d67710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7faba7400640 0 client.25682 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 --2- 172.21.15.84:0/1220777749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5570669930a0 0x557066d88e20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 >> 172.21.15.84:0/1220777749 conn(0x5570669b0350 msgr2=0x557066d6e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 shutdown_connections 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.753+0000 7fabcf7be740 1 -- 172.21.15.84:0/1220777749 wait complete. 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabcf7be740 20 client.25682 trim_cache size 0 max 16384 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24742, 2024-09-21T07:51:09.758 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 158.650613249, 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 29, 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 230.642503519 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:09.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faba80b6680 msgr2=0x7faba80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faba80b6680 0x7faba80b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x557066d61110 tx=0x7fabb4005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc41052d0 msgr2=0x7fabc4102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc41052d0 0x7fabc4102cf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fabac00e9f0 tx=0x7fabac00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 shutdown_connections 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faba80b6680 0x7faba80b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc410de50 0x7fabc4103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc41052d0 0x7fabc4102cf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 --2- 172.21.15.84:0/1491314334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc41048a0 0x7fabc41027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.754+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 >> 172.21.15.84:0/1491314334 conn(0x7fabc4079740 msgr2=0x7fabc4107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:09.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.755+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 shutdown_connections 2024-09-21T07:51:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:09.755+0000 7fabc8c00640 1 -- 172.21.15.84:0/1491314334 wait complete. 2024-09-21T07:51:10.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:51:10.882 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:11.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:11 smithi084 ceph-mon[30411]: pgmap v396: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-21T07:51:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:11 smithi191 ceph-mon[34667]: pgmap v396: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.535+0000 7ff8fb000640 1 -- 172.21.15.84:0/4027511969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 msgr2=0x7ff8f4112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.535+0000 7ff8fb000640 1 --2- 172.21.15.84:0/4027511969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 0x7ff8f4112850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009ca0 tx=0x7ff8ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.536+0000 7ff8fb000640 1 -- 172.21.15.84:0/4027511969 shutdown_connections 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.536+0000 7ff8fb000640 1 --2- 172.21.15.84:0/4027511969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 0x7ff8f4112850 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.536+0000 7ff8fb000640 1 --2- 172.21.15.84:0/4027511969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f410b6d0 0x7ff8f410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.536+0000 7ff8fb000640 1 --2- 172.21.15.84:0/4027511969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f4105d90 0x7ff8f41061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.536+0000 7ff8fb000640 1 -- 172.21.15.84:0/4027511969 >> 172.21.15.84:0/4027511969 conn(0x7ff8f41017c0 msgr2=0x7ff8f4103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:11.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.536+0000 7ff8fb000640 1 -- 172.21.15.84:0/4027511969 shutdown_connections 2024-09-21T07:51:11.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.536+0000 7ff8fb000640 1 -- 172.21.15.84:0/4027511969 wait complete. 2024-09-21T07:51:11.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 Processor -- start 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 -- start start 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f4105d90 0x7ff8f419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f410b6d0 0x7ff8f419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 0x7ff8f41a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4115ce0 con 0x7ff8f410c020 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4115b60 con 0x7ff8f4105d90 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.537+0000 7ff8fb000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4115e60 con 0x7ff8f410b6d0 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f410b6d0 0x7ff8f419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8f9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 0x7ff8f41a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f410b6d0 0x7ff8f419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:45734/0 (socket says 172.21.15.84:45734) 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 -- 172.21.15.84:0/3107335283 learned_addr learned my addr 172.21.15.84:0/3107335283 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8f9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 0x7ff8f41a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47278/0 (socket says 172.21.15.84:47278) 2024-09-21T07:51:11.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f4105d90 0x7ff8f419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 -- 172.21.15.84:0/3107335283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f4105d90 msgr2=0x7ff8f419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f4105d90 0x7ff8f419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 -- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 msgr2=0x7ff8f41a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 0x7ff8f41a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.538+0000 7ff8eb400640 1 -- 172.21.15.84:0/3107335283 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f41a25e0 con 0x7ff8f410b6d0 2024-09-21T07:51:11.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.539+0000 7ff8eb400640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f410b6d0 0x7ff8f419cc10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00e9f0 tx=0x7ff8dc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:11.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.539+0000 7ff8f1600640 1 -- 172.21.15.84:0/3107335283 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00ccc0 con 0x7ff8f410b6d0 2024-09-21T07:51:11.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.539+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f41a28d0 con 0x7ff8f410b6d0 2024-09-21T07:51:11.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.539+0000 7ff8f1600640 1 -- 172.21.15.84:0/3107335283 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8dc0108e0 con 0x7ff8f410b6d0 2024-09-21T07:51:11.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.539+0000 7ff8f1600640 1 -- 172.21.15.84:0/3107335283 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc018860 con 0x7ff8f410b6d0 2024-09-21T07:51:11.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.539+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f41a9030 con 0x7ff8f410b6d0 2024-09-21T07:51:11.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.542+0000 7ff901cb9740 1 Processor -- start 2024-09-21T07:51:11.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.542+0000 7ff901cb9740 1 -- start start 2024-09-21T07:51:11.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.542+0000 7ff8f1600640 1 -- 172.21.15.84:0/3107335283 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff8dc010430 con 0x7ff8f410b6d0 2024-09-21T07:51:11.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.542+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x5645138fe490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.542+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x5645138fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x5645138fef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff901cb9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564513875d50 con 0x564513537280 2024-09-21T07:51:11.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff901cb9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564513865180 con 0x564513557f60 2024-09-21T07:51:11.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff901cb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564513868f90 con 0x56451352f0a0 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x5645138fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x5645138fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:45748/0 (socket says 172.21.15.84:45748) 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x5645138fe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 -- 172.21.15.84:0/1156007041 learned_addr learned my addr 172.21.15.84:0/1156007041 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8eb400640 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x5645138fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 -- 172.21.15.84:0/1156007041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 msgr2=0x5645138fe490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x5645138fe490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 -- 172.21.15.84:0/1156007041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 msgr2=0x5645138fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x5645138fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8f3e00640 1 -- 172.21.15.84:0/1156007041 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451382fa70 con 0x56451352f0a0 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.543+0000 7ff8eb400640 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x5645138fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:51:11.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.544+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x5645138fe9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400bd10 tx=0x7ff8e40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=993b8ef0455ecbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.544+0000 7ff8e9600640 1 -- 172.21.15.84:0/1156007041 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4004030 con 0x56451352f0a0 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.544+0000 7ff8e9600640 1 -- 172.21.15.84:0/1156007041 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8e40035f0 con 0x56451352f0a0 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.544+0000 7ff8e9600640 1 -- 172.21.15.84:0/1156007041 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40117b0 con 0x56451352f0a0 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.544+0000 7ff8f1600640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8d80b6680 0x7ff8d80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff8f1600640 1 -- 172.21.15.84:0/3107335283 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff8dc0e7d10 con 0x7ff8f410b6d0 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff8f9000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8d80b6680 0x7ff8d80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 -- 172.21.15.84:0/1156007041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 msgr2=0x5645138fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x5645138fe9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400bd10 tx=0x7ff8e40107a0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 -- 172.21.15.84:0/1156007041 shutdown_connections 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x5645138fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x5645138fe9d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 --2- 172.21.15.84:0/1156007041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x5645138fe490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 -- 172.21.15.84:0/1156007041 >> 172.21.15.84:0/1156007041 conn(0x56451354c350 msgr2=0x5645138fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 -- 172.21.15.84:0/1156007041 shutdown_connections 2024-09-21T07:51:11.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.545+0000 7ff901cb9740 1 -- 172.21.15.84:0/1156007041 wait complete. 2024-09-21T07:51:11.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.546+0000 7ff8f9000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8d80b6680 0x7ff8d80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec02f500 tx=0x7ff8ec02f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:11.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.546+0000 7ff901cb9740 1 -- start start 2024-09-21T07:51:11.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.546+0000 7ff901cb9740 1 Processor -- start 2024-09-21T07:51:11.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56451352f0a0 0x56451390a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564513537280 0x56451390a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x564513915f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff901cb9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5645136c65f0 con 0x564513557f60 2024-09-21T07:51:11.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff901cb9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564513800460 con 0x56451352f0a0 2024-09-21T07:51:11.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff901cb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56451390cc70 con 0x564513537280 2024-09-21T07:51:11.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff901cb9740 10 client.0 _ll_register_callbacks cb 0x564513810210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56451352f0a0 0x56451390a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56451352f0a0 0x56451390a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45560/0 (socket says 172.21.15.84:45560) 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x564513915f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 -- 172.21.15.84:0/2878599085 learned_addr learned my addr 172.21.15.84:0/2878599085 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8eb400640 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564513537280 0x56451390a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 -- 172.21.15.84:0/2878599085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564513537280 msgr2=0x56451390a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564513537280 0x56451390a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 -- 172.21.15.84:0/2878599085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 msgr2=0x564513915f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x564513915f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.547+0000 7ff8f3e00640 1 -- 172.21.15.84:0/2878599085 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645135c3540 con 0x56451352f0a0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56451352f0a0 0x56451390a020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4005920 tx=0x7ff8e400b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9988b29454e80575 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff8e2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff8e2000640 1 -- 172.21.15.84:0/2878599085 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4029060 con 0x56451352f0a0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564513802a70 con 0x56451352f0a0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff8e2000640 1 -- 172.21.15.84:0/2878599085 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff8e40035f0 con 0x56451352f0a0 2024-09-21T07:51:11.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff8e2000640 1 -- 172.21.15.84:0/2878599085 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff8e4030050 con 0x56451352f0a0 2024-09-21T07:51:11.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff901cb9740 10 client.25694 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:11.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.548+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56451381d6f0 con 0x56451352f0a0 2024-09-21T07:51:11.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:11 smithi162 ceph-mon[34833]: pgmap v396: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-21T07:51:11.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff8e2000640 1 -- 172.21.15.84:0/2878599085 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564513802a70 con 0x56451352f0a0 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff8e2000640 1 -- 172.21.15.84:0/2878599085 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff8e4023030 con 0x56451352f0a0 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff901cb9740 10 client.25694 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff901cb9740 10 client.25694 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff901cb9740 20 client.25694 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645135168e0 0x56451391c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff901cb9740 4 client.25694 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.549+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564513877ca0 con 0x5645135168e0 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.550+0000 7ff8eb400640 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645135168e0 0x56451391c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.550+0000 7ff8eb400640 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645135168e0 0x56451391c020 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a432f0c5897e99 server_cookie=89de86c0b949ce1b in_seq=0 out_seq=0 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.550+0000 7ff8e2000640 10 client.25694 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff8e2000640 1 -- 172.21.15.84:0/2878599085 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564513877ca0 con 0x5645135168e0 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff8e2000640 10 client.25694 handle_command_reply: tid=0 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 client.25694 shutdown 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56451352f0a0 msgr2=0x56451390a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56451352f0a0 0x56451390a020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4005920 tx=0x7ff8e400b8e0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 shutdown_connections 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x564513915f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645135168e0 0x56451391c020 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564513537280 0x56451390a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff8e2000640 0 client.25694 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2878599085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56451352f0a0 0x56451390a020 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 >> 172.21.15.84:0/2878599085 conn(0x56451354c350 msgr2=0x564513901670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.551+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 shutdown_connections 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.552+0000 7ff901cb9740 1 -- 172.21.15.84:0/2878599085 wait complete. 2024-09-21T07:51:11.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.552+0000 7ff901cb9740 20 client.25694 trim_cache size 0 max 16384 2024-09-21T07:51:11.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.570+0000 7ff901cb9740 1 Processor -- start 2024-09-21T07:51:11.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.570+0000 7ff901cb9740 1 -- start start 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513537280 0x564513915ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x5645139086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff901cb9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56451391a360 con 0x564513557f60 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff901cb9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56451391aa30 con 0x564513537280 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff901cb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56451391b100 con 0x56451352f0a0 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x5645139086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x5645139086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47310/0 (socket says 172.21.15.84:47310) 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f9000640 1 -- 172.21.15.84:0/3870872755 learned_addr learned my addr 172.21.15.84:0/3870872755 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8eb400640 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513537280 0x564513915ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f9000640 1 -- 172.21.15.84:0/3870872755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 msgr2=0x56451391abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f9000640 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f9000640 1 -- 172.21.15.84:0/3870872755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513537280 msgr2=0x564513915ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.571+0000 7ff8f9000640 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513537280 0x564513915ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.572+0000 7ff8f9000640 1 -- 172.21.15.84:0/3870872755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564513900780 con 0x564513557f60 2024-09-21T07:51:11.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.572+0000 7ff8eb400640 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513537280 0x564513915ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:11.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.572+0000 7ff8f9000640 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x5645139086a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009ca0 tx=0x7ff8ec044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7580c3d75b71a391 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:11.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.572+0000 7ff8e8c00640 1 -- 172.21.15.84:0/3870872755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003af0 con 0x564513557f60 2024-09-21T07:51:11.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.572+0000 7ff8e8c00640 1 -- 172.21.15.84:0/3870872755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8ec036050 con 0x564513557f60 2024-09-21T07:51:11.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.572+0000 7ff8e8c00640 1 -- 172.21.15.84:0/3870872755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec02f8c0 con 0x564513557f60 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 -- 172.21.15.84:0/3870872755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 msgr2=0x5645139086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x5645139086a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009ca0 tx=0x7ff8ec044000 comp rx=0 tx=0).stop 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 -- 172.21.15.84:0/3870872755 shutdown_connections 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513557f60 0x5645139086a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513537280 0x564513915ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 --2- 172.21.15.84:0/3870872755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 -- 172.21.15.84:0/3870872755 >> 172.21.15.84:0/3870872755 conn(0x56451354c350 msgr2=0x56451390a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 -- 172.21.15.84:0/3870872755 shutdown_connections 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.573+0000 7ff901cb9740 1 -- 172.21.15.84:0/3870872755 wait complete. 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 -- start start 2024-09-21T07:51:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 Processor -- start 2024-09-21T07:51:11.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x56451391e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x56451391eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56451391bea0 con 0x564513537280 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56451391b7d0 con 0x564513557f60 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56451391c570 con 0x56451352f0a0 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.574+0000 7ff901cb9740 10 client.0 _ll_register_callbacks cb 0x7ff8e4003d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x56451391e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8f3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8f3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:45768/0 (socket says 172.21.15.84:45768) 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x56451391e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47322/0 (socket says 172.21.15.84:47322) 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8f3e00640 1 -- 172.21.15.84:0/2284651986 learned_addr learned my addr 172.21.15.84:0/2284651986 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8f9000640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x56451391eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 -- 172.21.15.84:0/2284651986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 msgr2=0x56451391e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 -- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 msgr2=0x56451391eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x56451391eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 -- 172.21.15.84:0/2284651986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645139239b0 con 0x564513537280 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8f9000640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x56451391eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8eb400640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x56451391e760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0e50f0 tx=0x7ff8dc0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e12132dd10b6bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.575+0000 7ff8e2000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff8e2000640 1 -- 172.21.15.84:0/2284651986 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0d2020 con 0x564513537280 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff8e2000640 1 -- 172.21.15.84:0/2284651986 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff8dc0e5370 con 0x564513537280 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ec036050 con 0x564513537280 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff8e2000640 1 -- 172.21.15.84:0/2284651986 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff8dc0e5570 con 0x564513537280 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 10 client.15735 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564513987720 con 0x564513537280 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff8e2000640 1 -- 172.21.15.84:0/2284651986 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8ec036050 con 0x564513537280 2024-09-21T07:51:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff8e2000640 1 -- 172.21.15.84:0/2284651986 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff8dc0ec040 con 0x564513537280 2024-09-21T07:51:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 10 client.15735 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 10 client.15735 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:51:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 20 client.15735 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645134ebc90 0x56451398afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 4 client.15735 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:51:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.576+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "status"}) -- 0x564513873750 con 0x5645134ebc90 2024-09-21T07:51:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.577+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645134ebc90 0x56451398afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.577+0000 7ff8f3e00640 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645134ebc90 0x56451398afc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86242ff64b03143f server_cookie=de74a7827f73a7e5 in_seq=0 out_seq=0 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.577+0000 7ff8e2000640 10 client.15735 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff8e2000640 1 -- 172.21.15.84:0/2284651986 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564513873750 con 0x5645134ebc90 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff8e2000640 10 client.15735 handle_command_reply: tid=0 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 client.15735 shutdown 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 msgr2=0x56451391e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x56451391e760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0e50f0 tx=0x7ff8dc0096a0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 shutdown_connections 2024-09-21T07:51:11.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564513557f60 0x56451391eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564513537280 0x56451391e760 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645134ebc90 0x56451398afc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 --2- 172.21.15.84:0/2284651986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56451352f0a0 0x56451391e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff8e2000640 0 client.15735 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 >> 172.21.15.84:0/2284651986 conn(0x56451354c350 msgr2=0x564513908610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 shutdown_connections 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 1 -- 172.21.15.84:0/2284651986 wait complete. 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.578+0000 7ff901cb9740 20 client.15735 trim_cache size 0 max 16384 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "56620f92-77ec-11ef-baf5-efdc52797490", 2024-09-21T07:51:11.583 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24746, 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 208.87367403100001, 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 29, 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 223.166673019 2024-09-21T07:51:11.584 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8d80b6680 msgr2=0x7ff8d80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8d80b6680 0x7ff8d80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec02f500 tx=0x7ff8ec02f310 comp rx=0 tx=0).stop 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f410b6d0 msgr2=0x7ff8f419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f410b6d0 0x7ff8f419cc10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00e9f0 tx=0x7ff8dc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 shutdown_connections 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8d80b6680 0x7ff8d80b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8f410c020 0x7ff8f41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8f410b6d0 0x7ff8f419cc10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 --2- 172.21.15.84:0/3107335283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f4105d90 0x7ff8f419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 >> 172.21.15.84:0/3107335283 conn(0x7ff8f41017c0 msgr2=0x7ff8f410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 shutdown_connections 2024-09-21T07:51:11.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:11.579+0000 7ff8fb000640 1 -- 172.21.15.84:0/3107335283 wait complete. 2024-09-21T07:51:12.318 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T07:51:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 -- 172.21.15.84:0/3689692275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810b620 msgr2=0x7efd3810ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 --2- 172.21.15.84:0/3689692275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810b620 0x7efd3810ba30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efd20009900 tx=0x7efd2002a410 comp rx=0 tx=0).stop 2024-09-21T07:51:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 -- 172.21.15.84:0/3689692275 shutdown_connections 2024-09-21T07:51:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 --2- 172.21.15.84:0/3689692275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd3810bf70 0x7efd381127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 --2- 172.21.15.84:0/3689692275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810b620 0x7efd3810ba30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 --2- 172.21.15.84:0/3689692275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd38105cf0 0x7efd38106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 -- 172.21.15.84:0/3689692275 >> 172.21.15.84:0/3689692275 conn(0x7efd381016d0 msgr2=0x7efd38103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 -- 172.21.15.84:0/3689692275 shutdown_connections 2024-09-21T07:51:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.679+0000 7efd3de00640 1 -- 172.21.15.84:0/3689692275 wait complete. 2024-09-21T07:51:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.680+0000 7efd3de00640 1 Processor -- start 2024-09-21T07:51:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.680+0000 7efd3de00640 1 -- start start 2024-09-21T07:51:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd3de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd38105cf0 0x7efd3819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd3de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd3810b620 0x7efd3819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd3de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810bf70 0x7efd381a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd3de00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efd38115c30 con 0x7efd3810bf70 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd3de00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd38115ab0 con 0x7efd38105cf0 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd3de00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd38115db0 con 0x7efd3810b620 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd37400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810bf70 0x7efd381a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd36a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd38105cf0 0x7efd3819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd37400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810bf70 0x7efd381a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47338/0 (socket says 172.21.15.84:47338) 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd37400640 1 -- 172.21.15.84:0/4262935815 learned_addr learned my addr 172.21.15.84:0/4262935815 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.681+0000 7efd2e000640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd3810b620 0x7efd3819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd37400640 1 -- 172.21.15.84:0/4262935815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd3810b620 msgr2=0x7efd3819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd37400640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd3810b620 0x7efd3819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd37400640 1 -- 172.21.15.84:0/4262935815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd38105cf0 msgr2=0x7efd3819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd37400640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd38105cf0 0x7efd3819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd37400640 1 -- 172.21.15.84:0/4262935815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd381a25c0 con 0x7efd3810bf70 2024-09-21T07:51:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd36a00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd38105cf0 0x7efd3819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd37400640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810bf70 0x7efd381a1ec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efd3000eb10 tx=0x7efd3000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd3ca00640 1 -- 172.21.15.84:0/4262935815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30004b20 con 0x7efd3810bf70 2024-09-21T07:51:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd381a28b0 con 0x7efd3810bf70 2024-09-21T07:51:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd3ca00640 1 -- 172.21.15.84:0/4262935815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd30004cc0 con 0x7efd3810bf70 2024-09-21T07:51:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd3ca00640 1 -- 172.21.15.84:0/4262935815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30010670 con 0x7efd3810bf70 2024-09-21T07:51:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.682+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd381a9040 con 0x7efd3810bf70 2024-09-21T07:51:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.685+0000 7efd44e9c740 1 Processor -- start 2024-09-21T07:51:12.688 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd3ca00640 1 -- 172.21.15.84:0/4262935815 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7efd30005020 con 0x7efd3810bf70 2024-09-21T07:51:12.688 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd44e9c740 1 -- start start 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bf81b0 0x55d627f9cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627f9d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bd74d0 0x55d627f9d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd44e9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d627f126b0 con 0x55d627bf81b0 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd44e9c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d627f01ae0 con 0x55d627bcf2f0 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.686+0000 7efd44e9c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d627f058f0 con 0x55d627bd74d0 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bf81b0 0x55d627f9cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bf81b0 0x55d627f9cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47348/0 (socket says 172.21.15.84:47348) 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd2e000640 1 -- 172.21.15.84:0/2268707846 learned_addr learned my addr 172.21.15.84:0/2268707846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd36a00640 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627f9d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd2e000640 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bd74d0 0x55d627f9d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd36a00640 1 -- 172.21.15.84:0/2268707846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bd74d0 msgr2=0x55d627f9d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd36a00640 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bd74d0 0x55d627f9d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd36a00640 1 -- 172.21.15.84:0/2268707846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bf81b0 msgr2=0x55d627f9cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd36a00640 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bf81b0 0x55d627f9cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd36a00640 1 -- 172.21.15.84:0/2268707846 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d627ece780 con 0x55d627bcf2f0 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.687+0000 7efd2e000640 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bf81b0 0x55d627f9cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.688+0000 7efd3ca00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efd1c0b6680 0x7efd1c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.688+0000 7efd36a00640 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627f9d170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd28011440 tx=0x7efd28011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d208a429a284186d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.688+0000 7efd3ca00640 1 -- 172.21.15.84:0/4262935815 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7efd300e8080 con 0x7efd3810bf70 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.688+0000 7efd2e000640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efd1c0b6680 0x7efd1c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.688+0000 7efd27e00640 1 -- 172.21.15.84:0/2268707846 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28004310 con 0x55d627bcf2f0 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.688+0000 7efd27e00640 1 -- 172.21.15.84:0/2268707846 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd280044b0 con 0x55d627bcf2f0 2024-09-21T07:51:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.688+0000 7efd27e00640 1 -- 172.21.15.84:0/2268707846 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd280035f0 con 0x55d627bcf2f0 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 -- 172.21.15.84:0/2268707846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 msgr2=0x55d627f9d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd2e000640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efd1c0b6680 0x7efd1c0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efd200096c0 tx=0x7efd20040040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627f9d170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd28011440 tx=0x7efd28011900 comp rx=0 tx=0).stop 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 -- 172.21.15.84:0/2268707846 shutdown_connections 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bd74d0 0x55d627f9d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627f9d170 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 --2- 172.21.15.84:0/2268707846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bf81b0 0x55d627f9cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 -- 172.21.15.84:0/2268707846 >> 172.21.15.84:0/2268707846 conn(0x55d627bec300 msgr2=0x55d627f9ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 -- 172.21.15.84:0/2268707846 shutdown_connections 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.689+0000 7efd44e9c740 1 -- 172.21.15.84:0/2268707846 wait complete. 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 -- start start 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 Processor -- start 2024-09-21T07:51:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fa8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fa8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fa8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d627e39ab0 con 0x55d627bd74d0 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d627ea8570 con 0x55d627bcf2f0 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d627fab3b0 con 0x55d627bf81b0 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.690+0000 7efd44e9c740 10 client.0 _ll_register_callbacks cb 0x55d627eb7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fa8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fa8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47358/0 (socket says 172.21.15.84:47358) 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd36a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fa8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd2e000640 1 -- 172.21.15.84:0/3027088424 learned_addr learned my addr 172.21.15.84:0/3027088424 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd37400640 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fa8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd36a00640 1 -- 172.21.15.84:0/3027088424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 msgr2=0x55d627fa8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd36a00640 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fa8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd36a00640 1 -- 172.21.15.84:0/3027088424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 msgr2=0x55d627fa8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd36a00640 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fa8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd36a00640 1 -- 172.21.15.84:0/3027088424 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d627c63790 con 0x55d627bcf2f0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd36a00640 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fa8210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efd2801b040 tx=0x7efd28004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa400a471bcaebf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.691+0000 7efd24c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd24c00640 1 -- 172.21.15.84:0/3027088424 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28026070 con 0x55d627bcf2f0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd280044b0 con 0x55d627bcf2f0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd24c00640 1 -- 172.21.15.84:0/3027088424 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7efd280038f0 con 0x55d627bcf2f0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd24c00640 1 -- 172.21.15.84:0/3027088424 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd28032050 con 0x55d627bcf2f0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd44e9c740 10 client.25712 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d627cdc620 con 0x55d627bcf2f0 2024-09-21T07:51:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd24c00640 1 -- 172.21.15.84:0/3027088424 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd280044b0 con 0x55d627bcf2f0 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.692+0000 7efd24c00640 1 -- 172.21.15.84:0/3027088424 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efd28004c00 con 0x55d627bcf2f0 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.693+0000 7efd44e9c740 10 client.25712 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.693+0000 7efd44e9c740 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.693+0000 7efd44e9c740 20 client.25712 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.693+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627bb6d80 0x55d627fba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.693+0000 7efd44e9c740 4 client.25712 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.693+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d627f14600 con 0x55d627bb6d80 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.693+0000 7efd2e000640 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627bb6d80 0x55d627fba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.694+0000 7efd2e000640 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627bb6d80 0x55d627fba2b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d33e1b87d8315a0 server_cookie=2072cfe3a19226d8 in_seq=0 out_seq=0 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.694+0000 7efd24c00640 10 client.25712 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.694+0000 7efd24c00640 1 -- 172.21.15.84:0/3027088424 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d627f14600 con 0x55d627bb6d80 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.694+0000 7efd24c00640 10 client.25712 handle_command_reply: tid=0 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 client.25712 shutdown 2024-09-21T07:51:12.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 msgr2=0x55d627fa8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fa8210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efd2801b040 tx=0x7efd28004970 comp rx=0 tx=0).stop 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 shutdown_connections 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627bb6d80 0x55d627fba2b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fa8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fa8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd24c00640 0 client.25712 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3027088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fa8210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 >> 172.21.15.84:0/3027088424 conn(0x55d627bec300 msgr2=0x55d627f9dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 shutdown_connections 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 1 -- 172.21.15.84:0/3027088424 wait complete. 2024-09-21T07:51:12.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.695+0000 7efd44e9c740 20 client.25712 trim_cache size 0 max 16384 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 Processor -- start 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 -- start start 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bcf2f0 0x55d627f99aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627f9e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bf81b0 0x55d627fbf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efd381b2f60 con 0x55d627bd74d0 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd381b4aa0 con 0x55d627bf81b0 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.710+0000 7efd44e9c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd381b3630 con 0x55d627bcf2f0 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627f9e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627f9e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47370/0 (socket says 172.21.15.84:47370) 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 -- 172.21.15.84:0/3570319104 learned_addr learned my addr 172.21.15.84:0/3570319104 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd36a00640 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bcf2f0 0x55d627f99aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd37400640 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bf81b0 0x55d627fbf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 -- 172.21.15.84:0/3570319104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bcf2f0 msgr2=0x55d627f99aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bcf2f0 0x55d627f99aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 -- 172.21.15.84:0/3570319104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bf81b0 msgr2=0x55d627fbf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bf81b0 0x55d627fbf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 -- 172.21.15.84:0/3570319104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d627f9ef30 con 0x55d627bd74d0 2024-09-21T07:51:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd37400640 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bf81b0 0x55d627fbf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.711+0000 7efd2e000640 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627f9e370 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efd200315b0 tx=0x7efd2003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb96375c17c323d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd27400640 1 -- 172.21.15.84:0/3570319104 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20044040 con 0x55d627bd74d0 2024-09-21T07:51:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd27400640 1 -- 172.21.15.84:0/3570319104 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd20059070 con 0x55d627bd74d0 2024-09-21T07:51:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd27400640 1 -- 172.21.15.84:0/3570319104 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20035040 con 0x55d627bd74d0 2024-09-21T07:51:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd44e9c740 1 -- 172.21.15.84:0/3570319104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 msgr2=0x55d627f9e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627f9e370 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efd200315b0 tx=0x7efd2003a000 comp rx=0 tx=0).stop 2024-09-21T07:51:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd44e9c740 1 -- 172.21.15.84:0/3570319104 shutdown_connections 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bf81b0 0x55d627fbf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627f9e370 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3570319104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bcf2f0 0x55d627f99aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.712+0000 7efd44e9c740 1 -- 172.21.15.84:0/3570319104 >> 172.21.15.84:0/3570319104 conn(0x55d627bec300 msgr2=0x55d627f9dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.713+0000 7efd44e9c740 1 -- 172.21.15.84:0/3570319104 shutdown_connections 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.713+0000 7efd44e9c740 1 -- 172.21.15.84:0/3570319104 wait complete. 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.713+0000 7efd44e9c740 1 -- start start 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.713+0000 7efd44e9c740 1 Processor -- start 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fb0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd44e9c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd44e9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efd381b43d0 con 0x55d627bd74d0 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd44e9c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd381b3d00 con 0x55d627bcf2f0 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd44e9c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efd381b0f20 con 0x55d627bf81b0 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd44e9c740 10 client.0 _ll_register_callbacks cb 0x7efd28005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47384/0 (socket says 172.21.15.84:47384) 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 -- 172.21.15.84:0/3447449576 learned_addr learned my addr 172.21.15.84:0/3447449576 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd36a00640 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fb0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd37400640 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 -- 172.21.15.84:0/3447449576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 msgr2=0x55d627fae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 -- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 msgr2=0x55d627fb0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fb0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.714+0000 7efd2e000640 1 -- 172.21.15.84:0/3447449576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d627faef20 con 0x55d627bd74d0 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd2e000640 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fae270 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efd20009260 tx=0x7efd20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd9582b84f27fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd24c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:12.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd24c00640 1 -- 172.21.15.84:0/3447449576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20044070 con 0x55d627bd74d0 2024-09-21T07:51:12.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd24c00640 1 -- 172.21.15.84:0/3447449576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7efd20004750 con 0x55d627bd74d0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd20059070 con 0x55d627bd74d0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd24c00640 1 -- 172.21.15.84:0/3447449576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd2006a050 con 0x55d627bd74d0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd44e9c740 10 client.15753 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d628024a80 con 0x55d627bd74d0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.715+0000 7efd24c00640 1 -- 172.21.15.84:0/3447449576 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd20059070 con 0x55d627bd74d0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd24c00640 1 -- 172.21.15.84:0/3447449576 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efd2004a040 con 0x55d627bd74d0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd44e9c740 10 client.15753 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd44e9c740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd44e9c740 20 client.15753 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627b8c1c0 0x55d6280271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd44e9c740 4 client.15753 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d627f100b0 con 0x55d627b8c1c0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.716+0000 7efd36a00640 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627b8c1c0 0x55d6280271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.717+0000 7efd36a00640 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627b8c1c0 0x55d6280271b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2efe505bb8dae98 server_cookie=89dbea8de29ad000 in_seq=0 out_seq=0 2024-09-21T07:51:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.717+0000 7efd24c00640 10 client.15753 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd24c00640 1 -- 172.21.15.84:0/3447449576 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d627f100b0 con 0x55d627b8c1c0 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd24c00640 10 client.15753 handle_command_reply: tid=0 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 client.15753 shutdown 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 msgr2=0x55d627fae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fae270 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efd20009260 tx=0x7efd20000bc0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 shutdown_connections 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d627b8c1c0 0x55d6280271b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d627bf81b0 0x55d627fae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d627bd74d0 0x55d627fae270 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 --2- 172.21.15.84:0/3447449576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d627bcf2f0 0x55d627fb0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd24c00640 0 client.15753 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 >> 172.21.15.84:0/3447449576 conn(0x55d627bec300 msgr2=0x55d627f99870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 shutdown_connections 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 1 -- 172.21.15.84:0/3447449576 wait complete. 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.726+0000 7efd44e9c740 20 client.15753 trim_cache size 0 max 16384 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:51:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:51:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efd1c0b6680 msgr2=0x7efd1c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efd1c0b6680 0x7efd1c0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efd200096c0 tx=0x7efd20040040 comp rx=0 tx=0).stop 2024-09-21T07:51:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810bf70 msgr2=0x7efd381a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810bf70 0x7efd381a1ec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efd3000eb10 tx=0x7efd3000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 shutdown_connections 2024-09-21T07:51:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efd1c0b6680 0x7efd1c0b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd3810bf70 0x7efd381a1ec0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd3810b620 0x7efd3819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 --2- 172.21.15.84:0/4262935815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd38105cf0 0x7efd3819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 >> 172.21.15.84:0/4262935815 conn(0x7efd381016d0 msgr2=0x7efd38109df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 shutdown_connections 2024-09-21T07:51:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:12.727+0000 7efd3de00640 1 -- 172.21.15.84:0/4262935815 wait complete. 2024-09-21T07:51:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:13 smithi191 ceph-mon[34667]: pgmap v397: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-21T07:51:13.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:13 smithi162 ceph-mon[34833]: pgmap v397: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-21T07:51:13.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:13 smithi084 ceph-mon[30411]: pgmap v397: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-21T07:51:15.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:15 smithi191 ceph-mon[34667]: pgmap v398: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-21T07:51:15.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:15 smithi162 ceph-mon[34833]: pgmap v398: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-21T07:51:15.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:15 smithi084 ceph-mon[30411]: pgmap v398: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-21T07:51:17.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:17 smithi191 ceph-mon[34667]: pgmap v399: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 15 op/s 2024-09-21T07:51:17.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:17 smithi162 ceph-mon[34833]: pgmap v399: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 15 op/s 2024-09-21T07:51:17.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:17 smithi084 ceph-mon[30411]: pgmap v399: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 15 op/s 2024-09-21T07:51:17.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:51:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:18.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 -- 172.21.15.84:0/2160800762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105d90 msgr2=0x7f55441061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 --2- 172.21.15.84:0/2160800762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105d90 0x7f55441061a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5534009900 tx=0x7f553402a410 comp rx=0 tx=0).stop 2024-09-21T07:51:18.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 -- 172.21.15.84:0/2160800762 shutdown_connections 2024-09-21T07:51:18.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 --2- 172.21.15.84:0/2160800762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554410c020 0x7f5544112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 --2- 172.21.15.84:0/2160800762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f554410b6d0 0x7f554410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 --2- 172.21.15.84:0/2160800762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105d90 0x7f55441061a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 -- 172.21.15.84:0/2160800762 >> 172.21.15.84:0/2160800762 conn(0x7f5544101860 msgr2=0x7f5544103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:18.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 -- 172.21.15.84:0/2160800762 shutdown_connections 2024-09-21T07:51:18.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.654+0000 7f5549600640 1 -- 172.21.15.84:0/2160800762 wait complete. 2024-09-21T07:51:18.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.655+0000 7f5549600640 1 Processor -- start 2024-09-21T07:51:18.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.655+0000 7f5549600640 1 -- start start 2024-09-21T07:51:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5549600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5544105d90 0x7f554419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5549600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f554410b6d0 0x7f554419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5549600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f554410c020 0x7f55441a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5549600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5544115ce0 con 0x7f554410c020 2024-09-21T07:51:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5549600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5544115b60 con 0x7f5544105d90 2024-09-21T07:51:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5549600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5544115e60 con 0x7f554410b6d0 2024-09-21T07:51:18.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5543400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f554410c020 0x7f55441a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5542a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5544105d90 0x7f554419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5543400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f554410c020 0x7f55441a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40496/0 (socket says 172.21.15.84:40496) 2024-09-21T07:51:18.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5543400640 1 -- 172.21.15.84:0/1239831645 learned_addr learned my addr 172.21.15.84:0/1239831645 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:18.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.656+0000 7f5542000640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f554410b6d0 0x7f554419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5542a00640 1 -- 172.21.15.84:0/1239831645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f554410b6d0 msgr2=0x7f554419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5542a00640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f554410b6d0 0x7f554419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5542a00640 1 -- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f554410c020 msgr2=0x7f55441a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5542a00640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f554410c020 0x7f55441a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5542a00640 1 -- 172.21.15.84:0/1239831645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55441a2640 con 0x7f5544105d90 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5543400640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f554410c020 0x7f55441a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5542000640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f554410b6d0 0x7f554419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.657+0000 7f5542a00640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5544105d90 0x7f554419c6d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f553402a930 tx=0x7f5534031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.658+0000 7f553b400640 1 -- 172.21.15.84:0/1239831645 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553403f030 con 0x7f5544105d90 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.658+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55441a28d0 con 0x7f5544105d90 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.658+0000 7f553b400640 1 -- 172.21.15.84:0/1239831645 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5534004490 con 0x7f5544105d90 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.658+0000 7f553b400640 1 -- 172.21.15.84:0/1239831645 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534035070 con 0x7f5544105d90 2024-09-21T07:51:18.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.658+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55441a9090 con 0x7f5544105d90 2024-09-21T07:51:18.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.661+0000 7f5550420740 1 Processor -- start 2024-09-21T07:51:18.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.661+0000 7f5550420740 1 -- start start 2024-09-21T07:51:18.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5550420740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e70d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5550420740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5550420740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5550420740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562e69de7f70 con 0x562e69aa9390 2024-09-21T07:51:18.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5550420740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e69dd73a0 con 0x562e69aca070 2024-09-21T07:51:18.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5550420740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562e69ddb1b0 con 0x562e69aa11b0 2024-09-21T07:51:18.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f553b400640 1 -- 172.21.15.84:0/1239831645 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5534042030 con 0x7f5544105d90 2024-09-21T07:51:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5543400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e70d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5542000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5543400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e70d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37306/0 (socket says 172.21.15.84:37306) 2024-09-21T07:51:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5542000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40504/0 (socket says 172.21.15.84:40504) 2024-09-21T07:51:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5543400640 1 -- 172.21.15.84:0/2686344805 learned_addr learned my addr 172.21.15.84:0/2686344805 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.662+0000 7f5542a00640 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f5543400640 1 -- 172.21.15.84:0/2686344805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 msgr2=0x562e69e712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f5543400640 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f5543400640 1 -- 172.21.15.84:0/2686344805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 msgr2=0x562e69e717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f5543400640 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f5543400640 1 -- 172.21.15.84:0/2686344805 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e69da1c90 con 0x562e69aca070 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f5542a00640 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f5543400640 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e70d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f553c0118b0 tx=0x7f553c011d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f2202574709d228 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f552f400640 1 -- 172.21.15.84:0/2686344805 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c01e070 con 0x562e69aca070 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f552f400640 1 -- 172.21.15.84:0/2686344805 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f553c00fe70 con 0x562e69aca070 2024-09-21T07:51:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.663+0000 7f552f400640 1 -- 172.21.15.84:0/2686344805 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c019db0 con 0x562e69aca070 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.664+0000 7f553b400640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55280b6680 0x7f55280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.664+0000 7f553b400640 1 -- 172.21.15.84:0/1239831645 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5534107cd0 con 0x7f5544105d90 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.664+0000 7f5542a00640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55280b6680 0x7f55280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 -- 172.21.15.84:0/2686344805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 msgr2=0x562e69e70d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e70d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f553c0118b0 tx=0x7f553c011d70 comp rx=0 tx=0).stop 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 -- 172.21.15.84:0/2686344805 shutdown_connections 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 --2- 172.21.15.84:0/2686344805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e70d60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 -- 172.21.15.84:0/2686344805 >> 172.21.15.84:0/2686344805 conn(0x562e69abe460 msgr2=0x562e69e6ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 -- 172.21.15.84:0/2686344805 shutdown_connections 2024-09-21T07:51:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5550420740 1 -- 172.21.15.84:0/2686344805 wait complete. 2024-09-21T07:51:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.665+0000 7f5542a00640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55280b6680 0x7f55280b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x562e69e6f9e0 tx=0x7f5534000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.666+0000 7f5550420740 1 -- start start 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.666+0000 7f5550420740 1 Processor -- start 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.666+0000 7f5550420740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e7c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.666+0000 7f5550420740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e7c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5550420740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aca070 0x562e69e88860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5550420740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562e69c38700 con 0x562e69aca070 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5550420740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e69d72540 con 0x562e69aa9390 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5550420740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562e69e7f540 con 0x562e69aa11b0 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5550420740 10 client.0 _ll_register_callbacks cb 0x562e69d82430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e7c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5543400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aca070 0x562e69e88860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e7c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37314/0 (socket says 172.21.15.84:37314) 2024-09-21T07:51:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 -- 172.21.15.84:0/2857236010 learned_addr learned my addr 172.21.15.84:0/2857236010 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5543400640 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e7c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 -- 172.21.15.84:0/2857236010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 msgr2=0x562e69e7c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e7c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 -- 172.21.15.84:0/2857236010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aca070 msgr2=0x562e69e88860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aca070 0x562e69e88860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.667+0000 7f5542000640 1 -- 172.21.15.84:0/2857236010 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e69b35650 con 0x562e69aa9390 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5542000640 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e7c980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5530012d20 tx=0x7f553000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8907f0502c46bf3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5523e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5523e00640 1 -- 172.21.15.84:0/2857236010 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530012110 con 0x562e69aa9390 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e69d74b50 con 0x562e69aa9390 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5523e00640 1 -- 172.21.15.84:0/2857236010 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5530004050 con 0x562e69aa9390 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5523e00640 1 -- 172.21.15.84:0/2857236010 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55300122b0 con 0x562e69aa9390 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5550420740 10 client.25730 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.668+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562e69d8f910 con 0x562e69aa9390 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5523e00640 1 -- 172.21.15.84:0/2857236010 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562e69d74b50 con 0x562e69aa9390 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5523e00640 1 -- 172.21.15.84:0/2857236010 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5530010430 con 0x562e69aa9390 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5550420740 10 client.25730 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5550420740 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5550420740 20 client.25730 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5550420740 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a889f0 0x562e69e8e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5550420740 4 client.25730 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e69de9ec0 con 0x562e69a889f0 2024-09-21T07:51:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.669+0000 7f5543400640 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a889f0 0x562e69e8e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.670+0000 7f5543400640 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a889f0 0x562e69e8e5f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23f11bcfc4ede0a5 server_cookie=8330d9d1eb977d2b in_seq=0 out_seq=0 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.670+0000 7f5523e00640 10 client.25730 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5523e00640 1 -- 172.21.15.84:0/2857236010 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e69de9ec0 con 0x562e69a889f0 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5523e00640 10 client.25730 handle_command_reply: tid=0 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 client.25730 shutdown 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 msgr2=0x562e69e7c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e7c980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5530012d20 tx=0x7f553000f790 comp rx=0 tx=0).stop 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 shutdown_connections 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aca070 0x562e69e88860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e7c980 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a889f0 0x562e69e8e5f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 --2- 172.21.15.84:0/2857236010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e7c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5523e00640 0 client.25730 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 >> 172.21.15.84:0/2857236010 conn(0x562e69abe460 msgr2=0x562e69e73ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 shutdown_connections 2024-09-21T07:51:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.671+0000 7f5550420740 1 -- 172.21.15.84:0/2857236010 wait complete. 2024-09-21T07:51:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.672+0000 7f5550420740 20 client.25730 trim_cache size 0 max 16384 2024-09-21T07:51:18.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 Processor -- start 2024-09-21T07:51:18.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 -- start start 2024-09-21T07:51:18.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e77bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e74570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b2f50 con 0x562e69aa9390 2024-09-21T07:51:18.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b4a90 con 0x562e69aca070 2024-09-21T07:51:18.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.690+0000 7f5550420740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b3620 con 0x562e69aa11b0 2024-09-21T07:51:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5543400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e77bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5542000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e74570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5543400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e77bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56446/0 (socket says 172.21.15.84:56446) 2024-09-21T07:51:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5543400640 1 -- 172.21.15.84:0/1361641919 learned_addr learned my addr 172.21.15.84:0/1361641919 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5543400640 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5542000640 1 -- 172.21.15.84:0/1361641919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 msgr2=0x562e69e77bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5542000640 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e77bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5542000640 1 -- 172.21.15.84:0/1361641919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 msgr2=0x562e69e88760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5542000640 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e88760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5542000640 1 -- 172.21.15.84:0/1361641919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e69e73050 con 0x562e69aa9390 2024-09-21T07:51:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.691+0000 7f5543400640 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e77bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.692+0000 7f5542000640 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e74570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5530010a40 tx=0x7f553000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20b6ab12ee9242a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.692+0000 7f552ea00640 1 -- 172.21.15.84:0/1361641919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530010bc0 con 0x562e69aa9390 2024-09-21T07:51:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.692+0000 7f552ea00640 1 -- 172.21.15.84:0/1361641919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f553002e070 con 0x562e69aa9390 2024-09-21T07:51:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.692+0000 7f552ea00640 1 -- 172.21.15.84:0/1361641919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530003850 con 0x562e69aa9390 2024-09-21T07:51:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 -- 172.21.15.84:0/1361641919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 msgr2=0x562e69e74570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e74570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5530010a40 tx=0x7f553000fc90 comp rx=0 tx=0).stop 2024-09-21T07:51:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 -- 172.21.15.84:0/1361641919 shutdown_connections 2024-09-21T07:51:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aca070 0x562e69e88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa9390 0x562e69e74570 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 --2- 172.21.15.84:0/1361641919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aa11b0 0x562e69e77bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 -- 172.21.15.84:0/1361641919 >> 172.21.15.84:0/1361641919 conn(0x562e69abe460 msgr2=0x562e69e73e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 -- 172.21.15.84:0/1361641919 shutdown_connections 2024-09-21T07:51:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.693+0000 7f5550420740 1 -- 172.21.15.84:0/1361641919 wait complete. 2024-09-21T07:51:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.694+0000 7f5550420740 1 -- start start 2024-09-21T07:51:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.694+0000 7f5550420740 1 Processor -- start 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5550420740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa11b0 0x562e69e80a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5550420740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e80f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5550420740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aca070 0x562e69ef7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5550420740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b43c0 con 0x562e69aa11b0 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5550420740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b3cf0 con 0x562e69aa9390 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5550420740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b0f10 con 0x562e69aca070 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5550420740 10 client.0 _ll_register_callbacks cb 0x7f55300127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5543400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa11b0 0x562e69e80a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5543400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa11b0 0x562e69e80a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40524/0 (socket says 172.21.15.84:40524) 2024-09-21T07:51:18.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5543400640 1 -- 172.21.15.84:0/434999278 learned_addr learned my addr 172.21.15.84:0/434999278 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:18.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5543400640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aca070 0x562e69ef7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.695+0000 7f5542000640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e80f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5542000640 1 -- 172.21.15.84:0/434999278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aca070 msgr2=0x562e69ef7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5542000640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aca070 0x562e69ef7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5542000640 1 -- 172.21.15.84:0/434999278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa11b0 msgr2=0x562e69e80a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5542000640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa11b0 0x562e69e80a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5542000640 1 -- 172.21.15.84:0/434999278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e69e81770 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5543400640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa11b0 0x562e69e80a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5542000640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e80f60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5530012cc0 tx=0x7f5530005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799061ce85cab621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5523e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.696+0000 7f5523e00640 1 -- 172.21.15.84:0/434999278 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530010430 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f553002e070 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5523e00640 1 -- 172.21.15.84:0/434999278 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f55300035f0 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5523e00640 1 -- 172.21.15.84:0/434999278 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55300037f0 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5550420740 10 client.25736 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562e69ef94c0 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5523e00640 1 -- 172.21.15.84:0/434999278 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f553002e070 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5523e00640 1 -- 172.21.15.84:0/434999278 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5530029750 con 0x562e69aa9390 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5550420740 10 client.25736 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5550420740 10 client.25736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.697+0000 7f5550420740 20 client.25736 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.698+0000 7f5550420740 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a5dda0 0x562e69efbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.698+0000 7f5550420740 4 client.25736 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:51:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.698+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e69de5970 con 0x562e69a5dda0 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.698+0000 7f5543400640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a5dda0 0x562e69efbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5543400640 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a5dda0 0x562e69efbb40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f16e3db7337645ae server_cookie=127a5ec9f5e3eb3 in_seq=0 out_seq=0 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5523e00640 10 client.25736 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5523e00640 1 -- 172.21.15.84:0/434999278 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x562e69de5970 con 0x562e69a5dda0 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5523e00640 10 client.25736 handle_command_reply: tid=0 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 client.25736 shutdown 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 msgr2=0x562e69e80f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e80f60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5530012cc0 tx=0x7f5530005790 comp rx=0 tx=0).stop 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 shutdown_connections 2024-09-21T07:51:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562e69a5dda0 0x562e69efbb40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e69aca070 0x562e69ef7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e69aa9390 0x562e69e80f60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5523e00640 0 client.25736 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 --2- 172.21.15.84:0/434999278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e69aa11b0 0x562e69e80a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.699+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 >> 172.21.15.84:0/434999278 conn(0x562e69abe460 msgr2=0x562e69e6e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.700+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 shutdown_connections 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.700+0000 7f5550420740 1 -- 172.21.15.84:0/434999278 wait complete. 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.700+0000 7f5550420740 20 client.25736 trim_cache size 0 max 16384 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:18.703 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:18.704 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55280b6680 msgr2=0x7f55280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55280b6680 0x7f55280b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x562e69e6f9e0 tx=0x7f5534000bc0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5544105d90 msgr2=0x7f554419c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5544105d90 0x7f554419c6d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f553402a930 tx=0x7f5534031a20 comp rx=0 tx=0).stop 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 shutdown_connections 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55280b6680 0x7f55280b8b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f554410c020 0x7f55441a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f554410b6d0 0x7f554419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 --2- 172.21.15.84:0/1239831645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5544105d90 0x7f554419c6d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 >> 172.21.15.84:0/1239831645 conn(0x7f5544101860 msgr2=0x7f5544103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 shutdown_connections 2024-09-21T07:51:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:18.701+0000 7f5549600640 1 -- 172.21.15.84:0/1239831645 wait complete. 2024-09-21T07:51:19.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:19 smithi191 ceph-mon[34667]: pgmap v400: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T07:51:19.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:19 smithi084 ceph-mon[30411]: pgmap v400: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T07:51:19.494 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:51:19.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:51:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:19 smithi162 ceph-mon[34833]: pgmap v400: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T07:51:19.878 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 -- 172.21.15.84:0/999758764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e00757b0 msgr2=0x7f24e0075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 --2- 172.21.15.84:0/999758764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e00757b0 0x7f24e0075bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009900 tx=0x7f24d002a400 comp rx=0 tx=0).stop 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 -- 172.21.15.84:0/999758764 shutdown_connections 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 --2- 172.21.15.84:0/999758764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e010ff10 0x7f24e0112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 --2- 172.21.15.84:0/999758764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24e0076100 0x7f24e010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 --2- 172.21.15.84:0/999758764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e00757b0 0x7f24e0075bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 -- 172.21.15.84:0/999758764 >> 172.21.15.84:0/999758764 conn(0x7f24e00ff440 msgr2=0x7f24e0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.581+0000 7f24e5c00640 1 -- 172.21.15.84:0/999758764 shutdown_connections 2024-09-21T07:51:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.583+0000 7f24e5c00640 1 -- 172.21.15.84:0/999758764 wait complete. 2024-09-21T07:51:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 Processor -- start 2024-09-21T07:51:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 -- start start 2024-09-21T07:51:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e00757b0 0x7f24e019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e0076100 0x7f24e019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24e010ff10 0x7f24e01a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f24e0115ac0 con 0x7f24e00757b0 2024-09-21T07:51:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24e0115940 con 0x7f24e0076100 2024-09-21T07:51:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24e5c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f24e0115c40 con 0x7f24e010ff10 2024-09-21T07:51:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.584+0000 7f24dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e00757b0 0x7f24e019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e00757b0 0x7f24e019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40532/0 (socket says 172.21.15.84:40532) 2024-09-21T07:51:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24dfe00640 1 -- 172.21.15.84:0/2553530485 learned_addr learned my addr 172.21.15.84:0/2553530485 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24df400640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e0076100 0x7f24e019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24e5200640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24e010ff10 0x7f24e01a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24dfe00640 1 -- 172.21.15.84:0/2553530485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24e010ff10 msgr2=0x7f24e01a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24dfe00640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24e010ff10 0x7f24e01a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24dfe00640 1 -- 172.21.15.84:0/2553530485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e0076100 msgr2=0x7f24e019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24dfe00640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e0076100 0x7f24e019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.585+0000 7f24dfe00640 1 -- 172.21.15.84:0/2553530485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e01a2480 con 0x7f24e00757b0 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.586+0000 7f24dfe00640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e00757b0 0x7f24e019c510 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f24d0005940 tx=0x7f24d00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.586+0000 7f24dcc00640 1 -- 172.21.15.84:0/2553530485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d003f030 con 0x7f24e00757b0 2024-09-21T07:51:20.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.586+0000 7f24dcc00640 1 -- 172.21.15.84:0/2553530485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24d00044c0 con 0x7f24e00757b0 2024-09-21T07:51:20.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.586+0000 7f24e5c00640 1 -- 172.21.15.84:0/2553530485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e01a2710 con 0x7f24e00757b0 2024-09-21T07:51:20.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.586+0000 7f24e5c00640 1 -- 172.21.15.84:0/2553530485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e01a8ed0 con 0x7f24e00757b0 2024-09-21T07:51:20.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.587+0000 7f24dcc00640 1 -- 172.21.15.84:0/2553530485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0035070 con 0x7f24e00757b0 2024-09-21T07:51:20.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.588+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e0075bc0 con 0x7f24e00757b0 2024-09-21T07:51:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.590+0000 7f24dcc00640 1 -- 172.21.15.84:0/2553530485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f24d0042030 con 0x7f24e00757b0 2024-09-21T07:51:20.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.592+0000 7f24dcc00640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f24c40b67d0 0x7f24c40b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:20.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.592+0000 7f24dcc00640 1 -- 172.21.15.84:0/2553530485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f24d0107cd0 con 0x7f24e00757b0 2024-09-21T07:51:20.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.593+0000 7f24df400640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f24c40b67d0 0x7f24c40b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:20.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.593+0000 7f24df400640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f24c40b67d0 0x7f24c40b8ce0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24e01122c0 tx=0x7f24cc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:20.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.596+0000 7f24dcc00640 1 -- 172.21.15.84:0/2553530485 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24d00cdeb0 con 0x7f24e00757b0 2024-09-21T07:51:20.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.845+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24e0063fc0 con 0x7f24e00757b0 2024-09-21T07:51:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.846+0000 7f24dcc00640 1 -- 172.21.15.84:0/2553530485 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f24d00d2290 con 0x7f24e00757b0 2024-09-21T07:51:20.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:51:20.849 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:51:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:51:20.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f24c40b67d0 msgr2=0x7f24c40b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:20.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f24c40b67d0 0x7f24c40b8ce0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24e01122c0 tx=0x7f24cc005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:20.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e00757b0 msgr2=0x7f24e019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:20.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e00757b0 0x7f24e019c510 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f24d0005940 tx=0x7f24d00040c0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 shutdown_connections 2024-09-21T07:51:20.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f24c40b67d0 0x7f24c40b8ce0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24e010ff10 0x7f24e01a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24e0076100 0x7f24e019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 --2- 172.21.15.84:0/2553530485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e00757b0 0x7f24e019c510 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:20.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 >> 172.21.15.84:0/2553530485 conn(0x7f24e00ff440 msgr2=0x7f24e0109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:20.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.850+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 shutdown_connections 2024-09-21T07:51:20.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:20.851+0000 7f24d6000640 1 -- 172.21.15.84:0/2553530485 wait complete. 2024-09-21T07:51:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:21 smithi191 ceph-mon[34667]: pgmap v401: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T07:51:21.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:21 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2553530485' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:21.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:21 smithi162 ceph-mon[34833]: pgmap v401: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T07:51:21.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:21 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2553530485' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:21.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:21 smithi084 ceph-mon[30411]: pgmap v401: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T07:51:21.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:21 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2553530485' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:21.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:51:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 -- 172.21.15.84:0/1080572281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 msgr2=0x7f71f0116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 --2- 172.21.15.84:0/1080572281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 0x7f71f0116920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009be0 tx=0x7f71ec02a6c0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 -- 172.21.15.84:0/1080572281 shutdown_connections 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 --2- 172.21.15.84:0/1080572281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 0x7f71f0116920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 --2- 172.21.15.84:0/1080572281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 0x7f71f00761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 --2- 172.21.15.84:0/1080572281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f0077380 0x7f71f00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 -- 172.21.15.84:0/1080572281 >> 172.21.15.84:0/1080572281 conn(0x7f71f00ff610 msgr2=0x7f71f0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.701+0000 7f71f8800640 1 -- 172.21.15.84:0/1080572281 shutdown_connections 2024-09-21T07:51:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.702+0000 7f71f8800640 1 -- 172.21.15.84:0/1080572281 wait complete. 2024-09-21T07:51:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.703+0000 7f71f8800640 1 Processor -- start 2024-09-21T07:51:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.703+0000 7f71f8800640 1 -- start start 2024-09-21T07:51:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f8800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 0x7f71f01a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f8800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f0077380 0x7f71f01a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f8800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 0x7f71f01a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f8800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71f011a080 con 0x7f71f0077380 2024-09-21T07:51:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f8800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0119f00 con 0x7f71f0075dd0 2024-09-21T07:51:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f8800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f71f011a200 con 0x7f71f0114450 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 0x7f71f01a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f0077380 0x7f71f01a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 0x7f71f01a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37372/0 (socket says 172.21.15.84:37372) 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.704+0000 7f71f5e00640 1 -- 172.21.15.84:0/61882621 learned_addr learned my addr 172.21.15.84:0/61882621 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f6800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 0x7f71f01a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f5e00640 1 -- 172.21.15.84:0/61882621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 msgr2=0x7f71f01a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f5e00640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 0x7f71f01a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f5e00640 1 -- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f0077380 msgr2=0x7f71f01a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f5e00640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f0077380 0x7f71f01a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f5e00640 1 -- 172.21.15.84:0/61882621 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f01a6a20 con 0x7f71f0075dd0 2024-09-21T07:51:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f5e00640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 0x7f71f01a0ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71e400e9c0 tx=0x7f71e400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71eaa00640 1 -- 172.21.15.84:0/61882621 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e400cde0 con 0x7f71f0075dd0 2024-09-21T07:51:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71eaa00640 1 -- 172.21.15.84:0/61882621 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e40035f0 con 0x7f71f0075dd0 2024-09-21T07:51:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.705+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f01a6d10 con 0x7f71f0075dd0 2024-09-21T07:51:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.706+0000 7f71eaa00640 1 -- 172.21.15.84:0/61882621 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4010690 con 0x7f71f0075dd0 2024-09-21T07:51:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.706+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f01ad470 con 0x7f71f0075dd0 2024-09-21T07:51:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.709+0000 7f71ff45c740 1 Processor -- start 2024-09-21T07:51:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.709+0000 7f71ff45c740 1 -- start start 2024-09-21T07:51:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.709+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x563247516ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632471471b0 0x5632475170e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247517620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71ff45c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56324748dfb0 con 0x5632471471b0 2024-09-21T07:51:22.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71ff45c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56324747d3e0 con 0x563247170070 2024-09-21T07:51:22.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71ff45c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5632474811f0 con 0x56324714f390 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71eaa00640 1 -- 172.21.15.84:0/61882621 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f71e4004000 con 0x7f71f0075dd0 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71f5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632471471b0 0x5632475170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71f6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x563247516ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71f5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247517620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71f6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x563247516ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37376/0 (socket says 172.21.15.84:37376) 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.710+0000 7f71f6800640 1 -- 172.21.15.84:0/2009622268 learned_addr learned my addr 172.21.15.84:0/2009622268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.711+0000 7f71f5400640 1 -- 172.21.15.84:0/2009622268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 msgr2=0x563247516ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.711+0000 7f71f5400640 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x563247516ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.711+0000 7f71f5400640 1 -- 172.21.15.84:0/2009622268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632471471b0 msgr2=0x5632475170e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.711+0000 7f71f5400640 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632471471b0 0x5632475170e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.711+0000 7f71f5400640 1 -- 172.21.15.84:0/2009622268 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563247447cd0 con 0x56324714f390 2024-09-21T07:51:22.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.711+0000 7f71f6800640 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x563247516ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:22.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.711+0000 7f71f5400640 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247517620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71f006cc00 tx=0x7f71e0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0284f3e0c3663ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.712+0000 7f71df000640 1 -- 172.21.15.84:0/2009622268 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0004050 con 0x56324714f390 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.712+0000 7f71df000640 1 -- 172.21.15.84:0/2009622268 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e00054d0 con 0x56324714f390 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.712+0000 7f71eaa00640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f71d80b6700 0x7f71d80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.712+0000 7f71df000640 1 -- 172.21.15.84:0/2009622268 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0004c80 con 0x56324714f390 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.712+0000 7f71eaa00640 1 -- 172.21.15.84:0/61882621 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f71e40e7dc0 con 0x7f71f0075dd0 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.712+0000 7f71f6800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f71d80b6700 0x7f71d80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 -- 172.21.15.84:0/2009622268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 msgr2=0x563247517620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247517620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71f006cc00 tx=0x7f71e0011810 comp rx=0 tx=0).stop 2024-09-21T07:51:22.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 -- 172.21.15.84:0/2009622268 shutdown_connections 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247517620 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632471471b0 0x5632475170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2009622268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x563247516ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 -- 172.21.15.84:0/2009622268 >> 172.21.15.84:0/2009622268 conn(0x563247164460 msgr2=0x563247514a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71f6800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f71d80b6700 0x7f71d80b8c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005cc0 tx=0x7f71ec005bf0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 -- 172.21.15.84:0/2009622268 shutdown_connections 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.713+0000 7f71ff45c740 1 -- 172.21.15.84:0/2009622268 wait complete. 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.714+0000 7f71ff45c740 1 -- start start 2024-09-21T07:51:22.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.714+0000 7f71ff45c740 1 Processor -- start 2024-09-21T07:51:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475227f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x563247522d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x56324752e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71ff45c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632472de700 con 0x56324714f390 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71ff45c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563247418580 con 0x563247170070 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71ff45c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563247525380 con 0x5632471471b0 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71ff45c740 10 client.0 _ll_register_callbacks cb 0x563247428470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71f5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x563247522d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71f5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475227f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56500/0 (socket says 172.21.15.84:56500) 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71f5e00640 1 -- 172.21.15.84:0/3846664567 learned_addr learned my addr 172.21.15.84:0/3846664567 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.715+0000 7f71f6800640 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x56324752e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.716+0000 7f71f5400640 1 -- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 msgr2=0x5632475227f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.716+0000 7f71f5400640 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475227f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.716+0000 7f71f5400640 1 -- 172.21.15.84:0/3846664567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 msgr2=0x56324752e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.716+0000 7f71f5400640 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x56324752e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.716+0000 7f71f5400640 1 -- 172.21.15.84:0/3846664567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632471db650 con 0x56324714f390 2024-09-21T07:51:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.716+0000 7f71f5e00640 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71f5400640 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x563247522d70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71e0000c00 tx=0x7f71e0009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1a5fdf08b08b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71d3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71d3400640 1 -- 172.21.15.84:0/3846664567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0029070 con 0x56324714f390 2024-09-21T07:51:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71d3400640 1 -- 172.21.15.84:0/3846664567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f71e0003a00 con 0x56324714f390 2024-09-21T07:51:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56324741ab90 con 0x56324714f390 2024-09-21T07:51:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71d3400640 1 -- 172.21.15.84:0/3846664567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71e0035050 con 0x56324714f390 2024-09-21T07:51:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71ff45c740 10 client.15789 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.717+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563247435950 con 0x56324714f390 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71d3400640 1 -- 172.21.15.84:0/3846664567 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56324741ab90 con 0x56324714f390 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71d3400640 1 -- 172.21.15.84:0/3846664567 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f71e0023b80 con 0x56324714f390 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71ff45c740 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71ff45c740 10 client.15789 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71ff45c740 20 client.15789 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71ff45c740 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x56324712e9f0 0x563247534600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71ff45c740 4 client.15789 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56324748ff00 con 0x56324712e9f0 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.718+0000 7f71f5e00640 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x56324712e9f0 0x563247534600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.719+0000 7f71d3400640 10 client.15789 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.719+0000 7f71f5e00640 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x56324712e9f0 0x563247534600 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1e7fec9c471065a server_cookie=cbb48ac6c5371251 in_seq=0 out_seq=0 2024-09-21T07:51:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71d3400640 1 -- 172.21.15.84:0/3846664567 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56324748ff00 con 0x56324712e9f0 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71d3400640 10 client.15789 handle_command_reply: tid=0 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 client.15789 shutdown 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 msgr2=0x563247522d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x563247522d70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71e0000c00 tx=0x7f71e0009f80 comp rx=0 tx=0).stop 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 shutdown_connections 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x56324712e9f0 0x563247534600 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x56324752e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x563247522d70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71d3400640 0 client.15789 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 --2- 172.21.15.84:0/3846664567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.720+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 >> 172.21.15.84:0/3846664567 conn(0x563247164460 msgr2=0x563247519d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.721+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 shutdown_connections 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.721+0000 7f71ff45c740 1 -- 172.21.15.84:0/3846664567 wait complete. 2024-09-21T07:51:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.721+0000 7f71ff45c740 20 client.15789 trim_cache size 0 max 16384 2024-09-21T07:51:22.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.735+0000 7f71ff45c740 1 Processor -- start 2024-09-21T07:51:22.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.735+0000 7f71ff45c740 1 -- start start 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.735+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.735+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x5632475182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x56324752e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71ff45c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01b7320 con 0x56324714f390 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71ff45c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01b8e60 con 0x563247170070 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71ff45c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01b79f0 con 0x5632471471b0 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x5632475182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x5632475182e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40582/0 (socket says 172.21.15.84:40582) 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 -- 172.21.15.84:0/2555877381 learned_addr learned my addr 172.21.15.84:0/2555877381 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5e00640 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 -- 172.21.15.84:0/2555877381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 msgr2=0x5632475244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475244d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 -- 172.21.15.84:0/2555877381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 msgr2=0x56324752e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x56324752e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.736+0000 7f71f5400640 1 -- 172.21.15.84:0/2555877381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632475238b0 con 0x56324714f390 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.737+0000 7f71f5400640 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x5632475182e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f71e0023fd0 tx=0x7f71e0011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e362a3bf3465094 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.737+0000 7f71de600640 1 -- 172.21.15.84:0/2555877381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0029040 con 0x56324714f390 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.737+0000 7f71de600640 1 -- 172.21.15.84:0/2555877381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e0003cb0 con 0x56324714f390 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.737+0000 7f71de600640 1 -- 172.21.15.84:0/2555877381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0005360 con 0x56324714f390 2024-09-21T07:51:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 -- 172.21.15.84:0/2555877381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 msgr2=0x5632475182e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x5632475182e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f71e0023fd0 tx=0x7f71e0011e40 comp rx=0 tx=0).stop 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 -- 172.21.15.84:0/2555877381 shutdown_connections 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563247170070 0x56324752e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56324714f390 0x5632475182e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 --2- 172.21.15.84:0/2555877381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632471471b0 0x5632475244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 -- 172.21.15.84:0/2555877381 >> 172.21.15.84:0/2555877381 conn(0x563247164460 msgr2=0x563247517bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 -- 172.21.15.84:0/2555877381 shutdown_connections 2024-09-21T07:51:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.738+0000 7f71ff45c740 1 -- 172.21.15.84:0/2555877381 wait complete. 2024-09-21T07:51:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.739+0000 7f71ff45c740 1 -- start start 2024-09-21T07:51:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.739+0000 7f71ff45c740 1 Processor -- start 2024-09-21T07:51:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632471471b0 0x563247526590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247526ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71ff45c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563247170070 0x563247527010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71ff45c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01b8790 con 0x563247170070 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71ff45c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01b80c0 con 0x5632471471b0 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71ff45c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f71f01b52e0 con 0x56324714f390 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71ff45c740 10 client.0 _ll_register_callbacks cb 0x7f71e0009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632471471b0 0x563247526590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632471471b0 0x563247526590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37412/0 (socket says 172.21.15.84:37412) 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71f5e00640 1 -- 172.21.15.84:0/822546779 learned_addr learned my addr 172.21.15.84:0/822546779 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71f5400640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247526ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.740+0000 7f71f6800640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563247170070 0x563247527010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71f5e00640 1 -- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 msgr2=0x563247526ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71f5e00640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247526ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71f5e00640 1 -- 172.21.15.84:0/822546779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563247170070 msgr2=0x563247527010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71f5e00640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563247170070 0x563247527010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71f5e00640 1 -- 172.21.15.84:0/822546779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324759ded0 con 0x5632471471b0 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71f5400640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247526ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71f5e00640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632471471b0 0x563247526590 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f71e40ad830 tx=0x7f71e4003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14212ececc8bcb23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71d3400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71d3400640 1 -- 172.21.15.84:0/822546779 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e40b2070 con 0x5632471471b0 2024-09-21T07:51:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71d3400640 1 -- 172.21.15.84:0/822546779 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f71e40a9b10 con 0x5632471471b0 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.741+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71e0003cb0 con 0x5632471471b0 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71d3400640 1 -- 172.21.15.84:0/822546779 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71e40ad670 con 0x5632471471b0 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 10 client.25757 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56324759f160 con 0x5632471471b0 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71d3400640 1 -- 172.21.15.84:0/822546779 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e0003cb0 con 0x5632471471b0 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71d3400640 1 -- 172.21.15.84:0/822546779 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f71e40aebd0 con 0x5632471471b0 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 10 client.25757 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 10 client.25757 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 20 client.25757 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x563247103da0 0x5632475a1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 4 client.25757 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.742+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56324748b9b0 con 0x563247103da0 2024-09-21T07:51:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.743+0000 7f71f5400640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x563247103da0 0x5632475a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:22.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.743+0000 7f71f5400640 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x563247103da0 0x5632475a1900 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=545eb13c58128e21 server_cookie=1aae97cb0e251eb3 in_seq=0 out_seq=0 2024-09-21T07:51:22.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.743+0000 7f71d3400640 10 client.25757 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:22.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.743+0000 7f71d3400640 1 -- 172.21.15.84:0/822546779 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56324748b9b0 con 0x563247103da0 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.743+0000 7f71d3400640 10 client.25757 handle_command_reply: tid=0 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 client.25757 shutdown 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632471471b0 msgr2=0x563247526590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632471471b0 0x563247526590 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f71e40ad830 tx=0x7f71e4003cd0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 shutdown_connections 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x563247103da0 0x5632475a1900 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563247170070 0x563247527010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56324714f390 0x563247526ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71d3400640 0 client.25757 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 --2- 172.21.15.84:0/822546779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632471471b0 0x563247526590 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 >> 172.21.15.84:0/822546779 conn(0x563247164460 msgr2=0x563247524210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 shutdown_connections 2024-09-21T07:51:22.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 1 -- 172.21.15.84:0/822546779 wait complete. 2024-09-21T07:51:22.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.744+0000 7f71ff45c740 20 client.25757 trim_cache size 0 max 16384 2024-09-21T07:51:22.749 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:51:22.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f71d80b6700 msgr2=0x7f71d80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f71d80b6700 0x7f71d80b8c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005cc0 tx=0x7f71ec005bf0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 msgr2=0x7f71f01a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 0x7f71f01a0ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71e400e9c0 tx=0x7f71e400ee80 comp rx=0 tx=0).stop 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 shutdown_connections 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f71d80b6700 0x7f71d80b8c10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0114450 0x7f71f01a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f0077380 0x7f71f01a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 --2- 172.21.15.84:0/61882621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71f0075dd0 0x7f71f01a0ab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 >> 172.21.15.84:0/61882621 conn(0x7f71f00ff610 msgr2=0x7f71f0110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 shutdown_connections 2024-09-21T07:51:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:22.745+0000 7f71f8800640 1 -- 172.21.15.84:0/61882621 wait complete. 2024-09-21T07:51:23.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:23 smithi191 ceph-mon[34667]: pgmap v402: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T07:51:23.548 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:23 smithi084 ceph-mon[30411]: pgmap v402: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T07:51:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:23 smithi162 ceph-mon[34833]: pgmap v402: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T07:51:23.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:51:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 -- 172.21.15.84:0/2832168921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 msgr2=0x7f273010d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 --2- 172.21.15.84:0/2832168921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 0x7f273010d6c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f271c009900 tx=0x7f271c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 -- 172.21.15.84:0/2832168921 shutdown_connections 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 --2- 172.21.15.84:0/2832168921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273010dc00 0x7f2730110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 --2- 172.21.15.84:0/2832168921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 0x7f273010d6c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 --2- 172.21.15.84:0/2832168921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2730104650 0x7f2730104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 -- 172.21.15.84:0/2832168921 >> 172.21.15.84:0/2832168921 conn(0x7f27300fe2c0 msgr2=0x7f2730100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 -- 172.21.15.84:0/2832168921 shutdown_connections 2024-09-21T07:51:24.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.630+0000 7f2737000640 1 -- 172.21.15.84:0/2832168921 wait complete. 2024-09-21T07:51:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 Processor -- start 2024-09-21T07:51:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 -- start start 2024-09-21T07:51:24.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2730104650 0x7f273019c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 0x7f273019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273010dc00 0x7f27301a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27301138d0 con 0x7f273010dc00 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2730113750 con 0x7f2730105080 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.632+0000 7f2737000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2730113a50 con 0x7f2730104650 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 0x7f273019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2730104650 0x7f273019c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 0x7f273019cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37432/0 (socket says 172.21.15.84:37432) 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735200640 1 -- 172.21.15.84:0/2234549761 learned_addr learned my addr 172.21.15.84:0/2234549761 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:24.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2736600640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273010dc00 0x7f27301a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735c00640 1 -- 172.21.15.84:0/2234549761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 msgr2=0x7f273019cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735c00640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 0x7f273019cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735c00640 1 -- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273010dc00 msgr2=0x7f27301a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735c00640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273010dc00 0x7f27301a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735c00640 1 -- 172.21.15.84:0/2234549761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27301a2490 con 0x7f2730104650 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.633+0000 7f2735c00640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2730104650 0x7f273019c520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f272400e9f0 tx=0x7f272400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.634+0000 7f272e000640 1 -- 172.21.15.84:0/2234549761 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272400ccc0 con 0x7f2730104650 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.634+0000 7f272e000640 1 -- 172.21.15.84:0/2234549761 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2724005020 con 0x7f2730104650 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.634+0000 7f272e000640 1 -- 172.21.15.84:0/2234549761 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724004a00 con 0x7f2730104650 2024-09-21T07:51:24.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.634+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27301a2780 con 0x7f2730104650 2024-09-21T07:51:24.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.634+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27301a8ee0 con 0x7f2730104650 2024-09-21T07:51:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.638+0000 7f273f21b740 1 Processor -- start 2024-09-21T07:51:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.638+0000 7f272e000640 1 -- 172.21.15.84:0/2234549761 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2724004ba0 con 0x7f2730104650 2024-09-21T07:51:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.638+0000 7f273f21b740 1 -- start start 2024-09-21T07:51:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.638+0000 7f273f21b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b563d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.638+0000 7f273f21b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1941b0 0x55ba3b564270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f273f21b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b19c390 0x55ba3b5647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f273f21b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ba3b4dafb0 con 0x55ba3b1bd070 2024-09-21T07:51:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f273f21b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ba3b4ca3e0 con 0x55ba3b1941b0 2024-09-21T07:51:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f273f21b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ba3b4ce1f0 con 0x55ba3b19c390 2024-09-21T07:51:24.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b563d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b563d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40620/0 (socket says 172.21.15.84:40620) 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 -- 172.21.15.84:0/3444260337 learned_addr learned my addr 172.21.15.84:0/3444260337 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2735c00640 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1941b0 0x55ba3b564270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2735200640 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b19c390 0x55ba3b5647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 -- 172.21.15.84:0/3444260337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b19c390 msgr2=0x55ba3b5647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b19c390 0x55ba3b5647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 -- 172.21.15.84:0/3444260337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1941b0 msgr2=0x55ba3b564270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1941b0 0x55ba3b564270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.639+0000 7f2736600640 1 -- 172.21.15.84:0/3444260337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3b494cd0 con 0x55ba3b1bd070 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f2735200640 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b19c390 0x55ba3b5647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:51:24.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f2736600640 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b563d30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f2728010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409bf07b7923bd6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f272e000640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27180b6700 0x7f27180b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f2722a00640 1 -- 172.21.15.84:0/3444260337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728011700 con 0x55ba3b1bd070 2024-09-21T07:51:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f2722a00640 1 -- 172.21.15.84:0/3444260337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2728011d50 con 0x55ba3b1bd070 2024-09-21T07:51:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f2722a00640 1 -- 172.21.15.84:0/3444260337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272801a380 con 0x55ba3b1bd070 2024-09-21T07:51:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f272e000640 1 -- 172.21.15.84:0/2234549761 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f27240e7a80 con 0x7f2730104650 2024-09-21T07:51:24.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.640+0000 7f2735c00640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27180b6700 0x7f27180b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.641+0000 7f273f21b740 1 -- 172.21.15.84:0/3444260337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 msgr2=0x55ba3b563d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.641+0000 7f273f21b740 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b563d30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f2728010860 comp rx=0 tx=0).stop 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.641+0000 7f2735c00640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27180b6700 0x7f27180b8c10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55ba3b5629b0 tx=0x7f2724005460 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 -- 172.21.15.84:0/3444260337 shutdown_connections 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b19c390 0x55ba3b5647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1941b0 0x55ba3b564270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 --2- 172.21.15.84:0/3444260337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b563d30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 -- 172.21.15.84:0/3444260337 >> 172.21.15.84:0/3444260337 conn(0x55ba3b1b1460 msgr2=0x55ba3b561bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 -- 172.21.15.84:0/3444260337 shutdown_connections 2024-09-21T07:51:24.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 -- 172.21.15.84:0/3444260337 wait complete. 2024-09-21T07:51:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.642+0000 7f273f21b740 1 -- start start 2024-09-21T07:51:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 1 Processor -- start 2024-09-21T07:51:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b56f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b56ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b57b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ba3b32b700 con 0x55ba3b19c390 2024-09-21T07:51:24.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ba3b465580 con 0x55ba3b1bd070 2024-09-21T07:51:24.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ba3b572510 con 0x55ba3b1941b0 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.643+0000 7f273f21b740 10 client.0 _ll_register_callbacks cb 0x55ba3b475470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b56f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b56f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56560/0 (socket says 172.21.15.84:56560) 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 -- 172.21.15.84:0/3889860304 learned_addr learned my addr 172.21.15.84:0/3889860304 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2735200640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b56ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b57b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 -- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 msgr2=0x55ba3b57b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b57b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 -- 172.21.15.84:0/3889860304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 msgr2=0x55ba3b56ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b56ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 -- 172.21.15.84:0/3889860304 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba3b228650 con 0x55ba3b1941b0 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2735200640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b56ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2736600640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b56f9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2728011010 tx=0x7f272801c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b1e5fa461f21e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.644+0000 7f2717400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.645+0000 7f2717400640 1 -- 172.21.15.84:0/3889860304 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728024040 con 0x55ba3b1941b0 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.645+0000 7f2717400640 1 -- 172.21.15.84:0/3889860304 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2728011700 con 0x55ba3b1941b0 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.645+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ba3b467b90 con 0x55ba3b1941b0 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.645+0000 7f2717400640 1 -- 172.21.15.84:0/3889860304 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2728011900 con 0x55ba3b1941b0 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.645+0000 7f273f21b740 10 client.25783 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:24.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.645+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ba3b482950 con 0x55ba3b1941b0 2024-09-21T07:51:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.645+0000 7f2717400640 1 -- 172.21.15.84:0/3889860304 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ba3b467b90 con 0x55ba3b1941b0 2024-09-21T07:51:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f2717400640 1 -- 172.21.15.84:0/3889860304 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f272802bc40 con 0x55ba3b1941b0 2024-09-21T07:51:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f273f21b740 10 client.25783 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f273f21b740 10 client.25783 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:51:24.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f273f21b740 20 client.25783 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f273f21b740 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b17b9f0 0x55ba3b5816e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f273f21b740 4 client.25783 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba3b4dcf00 con 0x55ba3b17b9f0 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.646+0000 7f2735200640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b17b9f0 0x55ba3b5816e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.647+0000 7f2735200640 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b17b9f0 0x55ba3b5816e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f5437173e890f53f server_cookie=fc5cf80e05d2b30b in_seq=0 out_seq=0 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.647+0000 7f2717400640 10 client.25783 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f2717400640 1 -- 172.21.15.84:0/3889860304 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba3b4dcf00 con 0x55ba3b17b9f0 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f2717400640 10 client.25783 handle_command_reply: tid=0 2024-09-21T07:51:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 client.25783 shutdown 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 msgr2=0x55ba3b56f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b56f9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2728011010 tx=0x7f272801c9e0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 shutdown_connections 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b17b9f0 0x55ba3b5816e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b57b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b56ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 --2- 172.21.15.84:0/3889860304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b56f9e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f2717400640 0 client.25783 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 >> 172.21.15.84:0/3889860304 conn(0x55ba3b1b1460 msgr2=0x55ba3b566f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 shutdown_connections 2024-09-21T07:51:24.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 1 -- 172.21.15.84:0/3889860304 wait complete. 2024-09-21T07:51:24.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.648+0000 7f273f21b740 20 client.25783 trim_cache size 0 max 16384 2024-09-21T07:51:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 Processor -- start 2024-09-21T07:51:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 -- start start 2024-09-21T07:51:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b568e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b569380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b561210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b2e10 con 0x55ba3b19c390 2024-09-21T07:51:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b4950 con 0x55ba3b1bd070 2024-09-21T07:51:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.662+0000 7f273f21b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b34e0 con 0x55ba3b1941b0 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b568e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2735200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b569380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b568e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56564/0 (socket says 172.21.15.84:56564) 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 -- 172.21.15.84:0/66086512 learned_addr learned my addr 172.21.15.84:0/66086512 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b561210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 -- 172.21.15.84:0/66086512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 msgr2=0x55ba3b561210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b561210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 -- 172.21.15.84:0/66086512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 msgr2=0x55ba3b569380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b569380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2736600640 1 -- 172.21.15.84:0/66086512 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3b566b90 con 0x55ba3b1941b0 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.663+0000 7f2735200640 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b569380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.664+0000 7f2736600640 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b568e40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f2728010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9febf1c7f9d693 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.664+0000 7f2722000640 1 -- 172.21.15.84:0/66086512 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728011500 con 0x55ba3b1941b0 2024-09-21T07:51:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.664+0000 7f2722000640 1 -- 172.21.15.84:0/66086512 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27280116a0 con 0x55ba3b1941b0 2024-09-21T07:51:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.664+0000 7f2722000640 1 -- 172.21.15.84:0/66086512 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728005020 con 0x55ba3b1941b0 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 -- 172.21.15.84:0/66086512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 msgr2=0x55ba3b568e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b568e40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f2728010860 comp rx=0 tx=0).stop 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 -- 172.21.15.84:0/66086512 shutdown_connections 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b1bd070 0x55ba3b561210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b19c390 0x55ba3b569380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 --2- 172.21.15.84:0/66086512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b568e40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 -- 172.21.15.84:0/66086512 >> 172.21.15.84:0/66086512 conn(0x55ba3b1b1460 msgr2=0x55ba3b56e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 -- 172.21.15.84:0/66086512 shutdown_connections 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.665+0000 7f273f21b740 1 -- 172.21.15.84:0/66086512 wait complete. 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 -- start start 2024-09-21T07:51:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 Processor -- start 2024-09-21T07:51:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b582740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b19c390 0x55ba3b582c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b5831c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b4280 con 0x55ba3b1bd070 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b3bb0 con 0x55ba3b19c390 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b0dd0 con 0x55ba3b1941b0 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.666+0000 7f273f21b740 10 client.0 _ll_register_callbacks cb 0x7f272801c600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2736600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b582740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2736600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b582740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56580/0 (socket says 172.21.15.84:56580) 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2736600640 1 -- 172.21.15.84:0/3085720561 learned_addr learned my addr 172.21.15.84:0/3085720561 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2736600640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b5831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2735200640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b19c390 0x55ba3b582c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2735200640 1 -- 172.21.15.84:0/3085720561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 msgr2=0x55ba3b582740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2735200640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b582740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2735200640 1 -- 172.21.15.84:0/3085720561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 msgr2=0x55ba3b5831c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2735200640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b5831c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2735200640 1 -- 172.21.15.84:0/3085720561 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba3b5eae90 con 0x55ba3b19c390 2024-09-21T07:51:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.667+0000 7f2736600640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b5831c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.668+0000 7f2735200640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b19c390 0x55ba3b582c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f271c005ab0 tx=0x7f271c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c06bca1dc798dae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.668+0000 7f2717400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.668+0000 7f2717400640 1 -- 172.21.15.84:0/3085720561 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c035040 con 0x55ba3b19c390 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.668+0000 7f2717400640 1 -- 172.21.15.84:0/3085720561 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f271c005220 con 0x55ba3b19c390 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.668+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27280116a0 con 0x55ba3b19c390 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f2717400640 1 -- 172.21.15.84:0/3085720561 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f271c005420 con 0x55ba3b19c390 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 10 client.25775 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ba3b5ec110 con 0x55ba3b19c390 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f2717400640 1 -- 172.21.15.84:0/3085720561 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27280116a0 con 0x55ba3b19c390 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f2717400640 1 -- 172.21.15.84:0/3085720561 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f271c003920 con 0x55ba3b19c390 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 10 client.25775 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 10 client.25775 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:51:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 20 client.25775 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b150da0 0x55ba3b5ee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 4 client.25775 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:51:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.669+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba3b4d89b0 con 0x55ba3b150da0 2024-09-21T07:51:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.670+0000 7f2736600640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b150da0 0x55ba3b5ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.670+0000 7f2717400640 10 client.25775 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.670+0000 7f2736600640 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b150da0 0x55ba3b5ee8a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=67c4545975ebe10e server_cookie=861bbe46766568fc in_seq=0 out_seq=0 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.670+0000 7f2717400640 1 -- 172.21.15.84:0/3085720561 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba3b4d89b0 con 0x55ba3b150da0 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.670+0000 7f2717400640 10 client.25775 handle_command_reply: tid=0 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.670+0000 7f273f21b740 1 client.25775 shutdown 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b19c390 msgr2=0x55ba3b582c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b19c390 0x55ba3b582c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f271c005ab0 tx=0x7f271c005fd0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 shutdown_connections 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ba3b150da0 0x55ba3b5ee8a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ba3b1bd070 0x55ba3b5831c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba3b19c390 0x55ba3b582c80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 --2- 172.21.15.84:0/3085720561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ba3b1941b0 0x55ba3b582740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f2717400640 0 client.25775 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:51:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 >> 172.21.15.84:0/3085720561 conn(0x55ba3b1b1460 msgr2=0x55ba3b568e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 shutdown_connections 2024-09-21T07:51:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 1 -- 172.21.15.84:0/3085720561 wait complete. 2024-09-21T07:51:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.671+0000 7f273f21b740 20 client.25775 trim_cache size 0 max 16384 2024-09-21T07:51:24.675 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:51:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27180b6700 msgr2=0x7f27180b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27180b6700 0x7f27180b8c10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55ba3b5629b0 tx=0x7f2724005460 comp rx=0 tx=0).stop 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2730104650 msgr2=0x7f273019c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2730104650 0x7f273019c520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f272400e9f0 tx=0x7f272400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 shutdown_connections 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f27180b6700 0x7f27180b8c10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f273010dc00 0x7f27301a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2730105080 0x7f273019cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 --2- 172.21.15.84:0/2234549761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2730104650 0x7f273019c520 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 >> 172.21.15.84:0/2234549761 conn(0x7f27300fe2c0 msgr2=0x7f2730102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 shutdown_connections 2024-09-21T07:51:24.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:24.672+0000 7f2737000640 1 -- 172.21.15.84:0/2234549761 wait complete. 2024-09-21T07:51:25.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:25 smithi191 ceph-mon[34667]: pgmap v403: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T07:51:25.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:25 smithi084 ceph-mon[30411]: pgmap v403: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T07:51:25.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:51:25.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:25 smithi162 ceph-mon[34833]: pgmap v403: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T07:51:25.876 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 -- 172.21.15.84:0/576529629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 msgr2=0x7f604810d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 --2- 172.21.15.84:0/576529629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 0x7f604810d7b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6034009900 tx=0x7f603402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 -- 172.21.15.84:0/576529629 shutdown_connections 2024-09-21T07:51:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 --2- 172.21.15.84:0/576529629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604810dd70 0x7f6048110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 --2- 172.21.15.84:0/576529629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 0x7f604810d7b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 --2- 172.21.15.84:0/576529629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 0x7f6048104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 -- 172.21.15.84:0/576529629 >> 172.21.15.84:0/576529629 conn(0x7f604807a6f0 msgr2=0x7f604807ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.939+0000 7f6050200640 1 -- 172.21.15.84:0/576529629 shutdown_connections 2024-09-21T07:51:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.940+0000 7f6050200640 1 -- 172.21.15.84:0/576529629 wait complete. 2024-09-21T07:51:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.941+0000 7f6050200640 1 Processor -- start 2024-09-21T07:51:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.941+0000 7f6050200640 1 -- start start 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f6050200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 0x7f604819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f6050200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 0x7f604819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f6050200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604810dd70 0x7f604819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f6050200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60481139d0 con 0x7f6048104920 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f6050200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6048113850 con 0x7f6048105270 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f6050200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6048113b50 con 0x7f604810dd70 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f604d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 0x7f604819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f604d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 0x7f604819a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40682/0 (socket says 172.21.15.84:40682) 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f604d800640 1 -- 172.21.15.84:0/1640397116 learned_addr learned my addr 172.21.15.84:0/1640397116 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f604ce00640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 0x7f604819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.942+0000 7f604e200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604810dd70 0x7f604819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f604d800640 1 -- 172.21.15.84:0/1640397116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604810dd70 msgr2=0x7f604819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f604d800640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604810dd70 0x7f604819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f604d800640 1 -- 172.21.15.84:0/1640397116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 msgr2=0x7f604819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f604d800640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 0x7f604819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f604d800640 1 -- 172.21.15.84:0/1640397116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60481a02e0 con 0x7f6048104920 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f604d800640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 0x7f604819a3b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e9f0 tx=0x7f603c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f6046000640 1 -- 172.21.15.84:0/1640397116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c00cd80 con 0x7f6048104920 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f6046000640 1 -- 172.21.15.84:0/1640397116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f603c0108e0 con 0x7f6048104920 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60481a05d0 con 0x7f6048104920 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.943+0000 7f6046000640 1 -- 172.21.15.84:0/1640397116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c018980 con 0x7f6048104920 2024-09-21T07:51:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.944+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60481a6d60 con 0x7f6048104920 2024-09-21T07:51:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.947+0000 7f6046000640 1 -- 172.21.15.84:0/1640397116 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f603c010430 con 0x7f6048104920 2024-09-21T07:51:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.948+0000 7f6057270740 1 Processor -- start 2024-09-21T07:51:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.948+0000 7f6057270740 1 -- start start 2024-09-21T07:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6046000640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6680 0x7f60300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6057270740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x55640754fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6057270740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x556407550170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6057270740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075506b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6057270740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5564074c56b0 con 0x55640718a4d0 2024-09-21T07:51:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6057270740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5564074b4ae0 con 0x5564071822f0 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6057270740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5564074b88f0 con 0x5564071ab1b0 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f6046000640 1 -- 172.21.15.84:0/1640397116 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f603c0e7dc0 con 0x7f6048104920 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f604e200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6680 0x7f60300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f604ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x556407550170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f604d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x55640754fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f604d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x55640754fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56600/0 (socket says 172.21.15.84:56600) 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f604d800640 1 -- 172.21.15.84:0/1369806839 learned_addr learned my addr 172.21.15.84:0/1369806839 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.949+0000 7f604e200640 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.950+0000 7f604d800640 1 -- 172.21.15.84:0/1369806839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 msgr2=0x556407550170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.950+0000 7f604d800640 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x556407550170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.950+0000 7f604d800640 1 -- 172.21.15.84:0/1369806839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 msgr2=0x5564075506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.950+0000 7f604d800640 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.950+0000 7f604d800640 1 -- 172.21.15.84:0/1369806839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556407481780 con 0x5564071ab1b0 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.950+0000 7f604e200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6680 0x7f60300b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6040005fd0 tx=0x7f6040009f30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.950+0000 7f604d800640 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x55640754fc30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f603c0aabc0 tx=0x7f603c0ad360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93499d99beefbf24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.951+0000 7f603aa00640 1 -- 172.21.15.84:0/1369806839 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c010720 con 0x5564071ab1b0 2024-09-21T07:51:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.951+0000 7f603aa00640 1 -- 172.21.15.84:0/1369806839 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f603c0ad460 con 0x5564071ab1b0 2024-09-21T07:51:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.951+0000 7f603aa00640 1 -- 172.21.15.84:0/1369806839 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c0a3740 con 0x5564071ab1b0 2024-09-21T07:51:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 -- 172.21.15.84:0/1369806839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 msgr2=0x55640754fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x55640754fc30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f603c0aabc0 tx=0x7f603c0ad360 comp rx=0 tx=0).stop 2024-09-21T07:51:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 -- 172.21.15.84:0/1369806839 shutdown_connections 2024-09-21T07:51:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x556407550170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 --2- 172.21.15.84:0/1369806839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x55640754fc30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 -- 172.21.15.84:0/1369806839 >> 172.21.15.84:0/1369806839 conn(0x55640719f300 msgr2=0x55640754db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 -- 172.21.15.84:0/1369806839 shutdown_connections 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 -- 172.21.15.84:0/1369806839 wait complete. 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.952+0000 7f6057270740 1 -- start start 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 1 Processor -- start 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071822f0 0x55640755b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55640718a4d0 0x55640755b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071ab1b0 0x55640755bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5564073ecab0 con 0x5564071822f0 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55640745b570 con 0x5564071ab1b0 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55640755e350 con 0x55640718a4d0 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f6057270740 10 client.0 _ll_register_callbacks cb 0x55640746a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f604d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071822f0 0x55640755b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f604d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071822f0 0x55640755b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40712/0 (socket says 172.21.15.84:40712) 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f604d800640 1 -- 172.21.15.84:0/3470111236 learned_addr learned my addr 172.21.15.84:0/3470111236 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f604ce00640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55640718a4d0 0x55640755b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.953+0000 7f604e200640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071ab1b0 0x55640755bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f604d800640 1 -- 172.21.15.84:0/3470111236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55640718a4d0 msgr2=0x55640755b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f604d800640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55640718a4d0 0x55640755b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f604d800640 1 -- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071ab1b0 msgr2=0x55640755bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f604d800640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071ab1b0 0x55640755bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f604d800640 1 -- 172.21.15.84:0/3470111236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556407216790 con 0x5564071822f0 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f604e200640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071ab1b0 0x55640755bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f604d800640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071822f0 0x55640755b260 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f603c0057a0 tx=0x7f603c0ad3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4756ed8e1ae2e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f602f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f602f400640 1 -- 172.21.15.84:0/3470111236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c0b2070 con 0x5564071822f0 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f602f400640 1 -- 172.21.15.84:0/3470111236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f603c0a36a0 con 0x5564071822f0 2024-09-21T07:51:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.954+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f603c0ad460 con 0x5564071822f0 2024-09-21T07:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f602f400640 1 -- 172.21.15.84:0/3470111236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f603c010720 con 0x5564071822f0 2024-09-21T07:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 10 client.15825 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55640728f620 con 0x5564071822f0 2024-09-21T07:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f602f400640 1 -- 172.21.15.84:0/3470111236 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f603c0ad460 con 0x5564071822f0 2024-09-21T07:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f602f400640 1 -- 172.21.15.84:0/3470111236 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f603c0a3b70 con 0x5564071822f0 2024-09-21T07:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 20 client.15825 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556407169d80 0x55640756d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 4 client.15825 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.955+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564074c7600 con 0x556407169d80 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.956+0000 7f604ce00640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556407169d80 0x55640756d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.956+0000 7f602f400640 10 client.15825 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.956+0000 7f604ce00640 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556407169d80 0x55640756d180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f662da444e47f42b server_cookie=5b614692313cc22e in_seq=0 out_seq=0 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.957+0000 7f602f400640 1 -- 172.21.15.84:0/3470111236 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564074c7600 con 0x556407169d80 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.957+0000 7f602f400640 10 client.15825 handle_command_reply: tid=0 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.957+0000 7f6057270740 1 client.15825 shutdown 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.957+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071822f0 msgr2=0x55640755b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071822f0 0x55640755b260 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f603c0057a0 tx=0x7f603c0ad3d0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 shutdown_connections 2024-09-21T07:51:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071ab1b0 0x55640755bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556407169d80 0x55640756d180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55640718a4d0 0x55640755b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 --2- 172.21.15.84:0/3470111236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071822f0 0x55640755b260 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 >> 172.21.15.84:0/3470111236 conn(0x55640719f300 msgr2=0x556407550c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f602f400640 0 client.15825 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 shutdown_connections 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 1 -- 172.21.15.84:0/3470111236 wait complete. 2024-09-21T07:51:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.958+0000 7f6057270740 20 client.15825 trim_cache size 0 max 16384 2024-09-21T07:51:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.973+0000 7f6057270740 1 Processor -- start 2024-09-21T07:51:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.973+0000 7f6057270740 1 -- start start 2024-09-21T07:51:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f6057270740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071822f0 0x556407566cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f6057270740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640718a4d0 0x556407558430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f6057270740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071ab1b0 0x556407558970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f6057270740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60481b0ca0 con 0x5564071ab1b0 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f6057270740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60481b27e0 con 0x55640718a4d0 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f6057270740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f60481b1370 con 0x5564071822f0 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f604e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071ab1b0 0x556407558970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f604e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071ab1b0 0x556407558970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40728/0 (socket says 172.21.15.84:40728) 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f604e200640 1 -- 172.21.15.84:0/3190178043 learned_addr learned my addr 172.21.15.84:0/3190178043 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f604ce00640 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640718a4d0 0x556407558430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.974+0000 7f604d800640 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071822f0 0x556407566cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f604ce00640 1 -- 172.21.15.84:0/3190178043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071822f0 msgr2=0x556407566cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f604ce00640 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071822f0 0x556407566cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f604ce00640 1 -- 172.21.15.84:0/3190178043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071ab1b0 msgr2=0x556407558970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f604ce00640 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071ab1b0 0x556407558970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f604ce00640 1 -- 172.21.15.84:0/3190178043 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564075491e0 con 0x55640718a4d0 2024-09-21T07:51:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f604e200640 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071ab1b0 0x556407558970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f604ce00640 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640718a4d0 0x556407558430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6034006010 tx=0x7f6034031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37367a2bd64490a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f603a000640 1 -- 172.21.15.84:0/3190178043 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034035040 con 0x55640718a4d0 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f603a000640 1 -- 172.21.15.84:0/3190178043 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60340054f0 con 0x55640718a4d0 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.975+0000 7f603a000640 1 -- 172.21.15.84:0/3190178043 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034004d80 con 0x55640718a4d0 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 -- 172.21.15.84:0/3190178043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640718a4d0 msgr2=0x556407558430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640718a4d0 0x556407558430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6034006010 tx=0x7f6034031400 comp rx=0 tx=0).stop 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 -- 172.21.15.84:0/3190178043 shutdown_connections 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564071ab1b0 0x556407558970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55640718a4d0 0x556407558430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 --2- 172.21.15.84:0/3190178043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071822f0 0x556407566cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 -- 172.21.15.84:0/3190178043 >> 172.21.15.84:0/3190178043 conn(0x55640719f300 msgr2=0x5564075665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 -- 172.21.15.84:0/3190178043 shutdown_connections 2024-09-21T07:51:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.976+0000 7f6057270740 1 -- 172.21.15.84:0/3190178043 wait complete. 2024-09-21T07:51:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.977+0000 7f6057270740 1 -- start start 2024-09-21T07:51:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.977+0000 7f6057270740 1 Processor -- start 2024-09-21T07:51:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.977+0000 7f6057270740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x5564075701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f6057270740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f6057270740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x5564075cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f6057270740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60481b2110 con 0x55640718a4d0 2024-09-21T07:51:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f6057270740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60481b1a40 con 0x5564071822f0 2024-09-21T07:51:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f6057270740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f60481aec60 con 0x5564071ab1b0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f6057270740 10 client.0 _ll_register_callbacks cb 0x7f6040009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40732/0 (socket says 172.21.15.84:40732) 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 -- 172.21.15.84:0/4189419361 learned_addr learned my addr 172.21.15.84:0/4189419361 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604d800640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x5564075701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604e200640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x5564075cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 -- 172.21.15.84:0/4189419361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 msgr2=0x5564075cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x5564075cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 -- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 msgr2=0x5564075701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x5564075701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604ce00640 1 -- 172.21.15.84:0/4189419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564075d05e0 con 0x55640718a4d0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.978+0000 7f604d800640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x5564075701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f604ce00640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075707d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f603402a910 tx=0x7f6034032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbea4c793716bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f602f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f602f400640 1 -- 172.21.15.84:0/4189419361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034054070 con 0x55640718a4d0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f602f400640 1 -- 172.21.15.84:0/4189419361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6034004100 con 0x55640718a4d0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60340054f0 con 0x55640718a4d0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f602f400640 1 -- 172.21.15.84:0/4189419361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6034035040 con 0x55640718a4d0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f6057270740 10 client.15831 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.979+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564075d7a00 con 0x55640718a4d0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f602f400640 1 -- 172.21.15.84:0/4189419361 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60340054f0 con 0x55640718a4d0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f602f400640 1 -- 172.21.15.84:0/4189419361 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6034003960 con 0x55640718a4d0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f6057270740 10 client.15831 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f6057270740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f6057270740 20 client.15831 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f6057270740 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55640713f1c0 0x5564075da190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f6057270740 4 client.15831 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564074c30b0 con 0x55640713f1c0 2024-09-21T07:51:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.980+0000 7f604d800640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55640713f1c0 0x5564075da190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.981+0000 7f604d800640 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55640713f1c0 0x5564075da190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4cb5469aefc1fd1 server_cookie=ba142f431e080013 in_seq=0 out_seq=0 2024-09-21T07:51:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.981+0000 7f602f400640 10 client.15831 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.987+0000 7f602f400640 1 -- 172.21.15.84:0/4189419361 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564074c30b0 con 0x55640713f1c0 2024-09-21T07:51:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.987+0000 7f602f400640 10 client.15831 handle_command_reply: tid=0 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.987+0000 7f6057270740 1 client.15831 shutdown 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.987+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 msgr2=0x5564075707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.987+0000 7f6057270740 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075707d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f603402a910 tx=0x7f6034032e40 comp rx=0 tx=0).stop 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 shutdown_connections 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55640713f1c0 0x5564075da190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564071ab1b0 0x5564075cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55640718a4d0 0x5564075707d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 --2- 172.21.15.84:0/4189419361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564071822f0 0x5564075701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f602f400640 0 client.15831 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 >> 172.21.15.84:0/4189419361 conn(0x55640719f300 msgr2=0x55640754dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 shutdown_connections 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 1 -- 172.21.15.84:0/4189419361 wait complete. 2024-09-21T07:51:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.988+0000 7f6057270740 20 client.15831 trim_cache size 0 max 16384 2024-09-21T07:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:51:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6680 msgr2=0x7f60300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6680 0x7f60300b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6040005fd0 tx=0x7f6040009f30 comp rx=0 tx=0).stop 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 msgr2=0x7f604819a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 0x7f604819a3b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e9f0 tx=0x7f603c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 shutdown_connections 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60300b6680 0x7f60300b8b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f604810dd70 0x7f604819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6048105270 0x7f604819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 --2- 172.21.15.84:0/1640397116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6048104920 0x7f604819a3b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 >> 172.21.15.84:0/1640397116 conn(0x7f604807a6f0 msgr2=0x7f6048100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 shutdown_connections 2024-09-21T07:51:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:25.989+0000 7f6050200640 1 -- 172.21.15.84:0/1640397116 wait complete. 2024-09-21T07:51:26.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 -- 172.21.15.84:0/3634208608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc52010be50 msgr2=0x7fc520112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 --2- 172.21.15.84:0/3634208608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc52010be50 0x7fc520112680 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc518009ca0 tx=0x7fc51802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 -- 172.21.15.84:0/3634208608 shutdown_connections 2024-09-21T07:51:26.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 --2- 172.21.15.84:0/3634208608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc52010be50 0x7fc520112680 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 --2- 172.21.15.84:0/3634208608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52010b500 0x7fc52010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 --2- 172.21.15.84:0/3634208608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc520105bc0 0x7fc520105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 -- 172.21.15.84:0/3634208608 >> 172.21.15.84:0/3634208608 conn(0x7fc520101630 msgr2=0x7fc520103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:26.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 -- 172.21.15.84:0/3634208608 shutdown_connections 2024-09-21T07:51:26.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.534+0000 7fc526e00640 1 -- 172.21.15.84:0/3634208608 wait complete. 2024-09-21T07:51:26.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.535+0000 7fc526e00640 1 Processor -- start 2024-09-21T07:51:26.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.535+0000 7fc526e00640 1 -- start start 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc526e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc520105bc0 0x7fc52019c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc526e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52010b500 0x7fc52019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc526e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc52010be50 0x7fc5201a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc526e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc520115b60 con 0x7fc520105bc0 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc526e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5201159e0 con 0x7fc52010b500 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc526e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc520115ce0 con 0x7fc52010be50 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc525a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc520105bc0 0x7fc52019c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc525a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc520105bc0 0x7fc52019c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40754/0 (socket says 172.21.15.84:40754) 2024-09-21T07:51:26.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc525a00640 1 -- 172.21.15.84:0/272645881 learned_addr learned my addr 172.21.15.84:0/272645881 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:26.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc525000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52010b500 0x7fc52019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.536+0000 7fc526400640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc52010be50 0x7fc5201a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc525000640 1 -- 172.21.15.84:0/272645881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc52010be50 msgr2=0x7fc5201a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc525000640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc52010be50 0x7fc5201a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc525000640 1 -- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc520105bc0 msgr2=0x7fc52019c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc525000640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc520105bc0 0x7fc52019c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc525000640 1 -- 172.21.15.84:0/272645881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5201a2440 con 0x7fc52010b500 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc525000640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52010b500 0x7fc52019ca70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc52006b930 tx=0x7fc50c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc51e000640 1 -- 172.21.15.84:0/272645881 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00cc40 con 0x7fc52010b500 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5201a2730 con 0x7fc52010b500 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.537+0000 7fc51e000640 1 -- 172.21.15.84:0/272645881 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc50c00cde0 con 0x7fc52010b500 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.538+0000 7fc51e000640 1 -- 172.21.15.84:0/272645881 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c018760 con 0x7fc52010b500 2024-09-21T07:51:26.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.538+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5201a8e90 con 0x7fc52010b500 2024-09-21T07:51:26.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.541+0000 7fc52f1e3740 1 Processor -- start 2024-09-21T07:51:26.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc52f1e3740 1 -- start start 2024-09-21T07:51:26.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec72580270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec725807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ec724f6fb0 con 0x55ec721b01b0 2024-09-21T07:51:26.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec724e63e0 con 0x55ec721b8390 2024-09-21T07:51:26.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ec724ea1f0 con 0x55ec721d9070 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc525a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec72580270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.542+0000 7fc526400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56652/0 (socket says 172.21.15.84:56652) 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 -- 172.21.15.84:0/1244717111 learned_addr learned my addr 172.21.15.84:0/1244717111 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 -- 172.21.15.84:0/1244717111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 msgr2=0x55ec725807b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec725807b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 -- 172.21.15.84:0/1244717111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 msgr2=0x55ec72580270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec72580270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 -- 172.21.15.84:0/1244717111 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec724b0cd0 con 0x55ec721d9070 2024-09-21T07:51:26.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc525a00640 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec72580270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:26.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc51e000640 1 -- 172.21.15.84:0/272645881 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc50c018900 con 0x7fc52010b500 2024-09-21T07:51:26.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.543+0000 7fc526400640 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257fd30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc518009ca0 tx=0x7fc518009430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35c7ed02da4e3e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:26.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.544+0000 7fc512a00640 1 -- 172.21.15.84:0/1244717111 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518031cf0 con 0x55ec721d9070 2024-09-21T07:51:26.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.544+0000 7fc512a00640 1 -- 172.21.15.84:0/1244717111 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc518036030 con 0x55ec721d9070 2024-09-21T07:51:26.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.544+0000 7fc512a00640 1 -- 172.21.15.84:0/1244717111 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5180042a0 con 0x55ec721d9070 2024-09-21T07:51:26.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc52f1e3740 1 -- 172.21.15.84:0/1244717111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 msgr2=0x55ec7257fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257fd30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc518009ca0 tx=0x7fc518009430 comp rx=0 tx=0).stop 2024-09-21T07:51:26.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc52f1e3740 1 -- 172.21.15.84:0/1244717111 shutdown_connections 2024-09-21T07:51:26.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec725807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec72580270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/1244717111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257fd30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc52f1e3740 1 -- 172.21.15.84:0/1244717111 >> 172.21.15.84:0/1244717111 conn(0x55ec721cd460 msgr2=0x55ec7257dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:26.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.545+0000 7fc51e000640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5080b6680 0x7fc5080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.546+0000 7fc51e000640 1 -- 172.21.15.84:0/272645881 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc50c0e7ae0 con 0x7fc52010b500 2024-09-21T07:51:26.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.546+0000 7fc52f1e3740 1 -- 172.21.15.84:0/1244717111 shutdown_connections 2024-09-21T07:51:26.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.546+0000 7fc525a00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5080b6680 0x7fc5080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.546+0000 7fc52f1e3740 1 -- 172.21.15.84:0/1244717111 wait complete. 2024-09-21T07:51:26.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.547+0000 7fc525a00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5080b6680 0x7fc5080b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55ec7257e9b0 tx=0x7fc514005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:26.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.547+0000 7fc52f1e3740 1 -- start start 2024-09-21T07:51:26.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.547+0000 7fc52f1e3740 1 Processor -- start 2024-09-21T07:51:26.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b01b0 0x55ec7258b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec7258be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721d9070 0x55ec725976b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ec72347700 con 0x55ec721d9070 2024-09-21T07:51:26.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec72481580 con 0x55ec721b8390 2024-09-21T07:51:26.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ec7258e330 con 0x55ec721b01b0 2024-09-21T07:51:26.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc52f1e3740 10 client.0 _ll_register_callbacks cb 0x55ec72491470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:26.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc525000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec7258be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc525000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec7258be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37570/0 (socket says 172.21.15.84:37570) 2024-09-21T07:51:26.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc525000640 1 -- 172.21.15.84:0/2454085725 learned_addr learned my addr 172.21.15.84:0/2454085725 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:26.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc525a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b01b0 0x55ec7258b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.548+0000 7fc526400640 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721d9070 0x55ec725976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc525000640 1 -- 172.21.15.84:0/2454085725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b01b0 msgr2=0x55ec7258b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:26.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc525000640 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b01b0 0x55ec7258b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc525000640 1 -- 172.21.15.84:0/2454085725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721d9070 msgr2=0x55ec725976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc525000640 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721d9070 0x55ec725976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc525000640 1 -- 172.21.15.84:0/2454085725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec72244650 con 0x55ec721b8390 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc526400640 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721d9070 0x55ec725976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc525000640 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec7258be50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0aa8e0 tx=0x7fc50c0b6f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb1ddfb4405000f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc507400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc507400640 1 -- 172.21.15.84:0/2454085725 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0ad180 con 0x55ec721b8390 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc507400640 1 -- 172.21.15.84:0/2454085725 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc50c0ac340 con 0x55ec721b8390 2024-09-21T07:51:26.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.549+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec72483b90 con 0x55ec721b8390 2024-09-21T07:51:26.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc507400640 1 -- 172.21.15.84:0/2454085725 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc50c0b20a0 con 0x55ec721b8390 2024-09-21T07:51:26.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 10 client.25802 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:26.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec7249e950 con 0x55ec721b8390 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc507400640 1 -- 172.21.15.84:0/2454085725 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ec72483b90 con 0x55ec721b8390 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc507400640 1 -- 172.21.15.84:0/2454085725 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc50c0b6690 con 0x55ec721b8390 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 10 client.25802 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 10 client.25802 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 20 client.25802 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec721979f0 0x55ec7259d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 4 client.25802 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.550+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec724f8f00 con 0x55ec721979f0 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.551+0000 7fc525a00640 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec721979f0 0x55ec7259d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.552+0000 7fc525a00640 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec721979f0 0x55ec7259d780 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=27b8258cb6726c27 server_cookie=711f6050c15d06b2 in_seq=0 out_seq=0 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.552+0000 7fc507400640 10 client.25802 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.552+0000 7fc507400640 1 -- 172.21.15.84:0/2454085725 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec724f8f00 con 0x55ec721979f0 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.552+0000 7fc507400640 10 client.25802 handle_command_reply: tid=0 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 client.25802 shutdown 2024-09-21T07:51:26.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 msgr2=0x55ec7258be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec7258be50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0aa8e0 tx=0x7fc50c0b6f10 comp rx=0 tx=0).stop 2024-09-21T07:51:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 shutdown_connections 2024-09-21T07:51:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec721979f0 0x55ec7259d780 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721d9070 0x55ec725976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b8390 0x55ec7258be50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/2454085725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b01b0 0x55ec7258b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 >> 172.21.15.84:0/2454085725 conn(0x55ec721cd460 msgr2=0x55ec72582ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:26.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc507400640 0 client.25802 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:26.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 shutdown_connections 2024-09-21T07:51:26.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.553+0000 7fc52f1e3740 1 -- 172.21.15.84:0/2454085725 wait complete. 2024-09-21T07:51:26.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.554+0000 7fc52f1e3740 20 client.25802 trim_cache size 0 max 16384 2024-09-21T07:51:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.567+0000 7fc52f1e3740 1 Processor -- start 2024-09-21T07:51:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.567+0000 7fc52f1e3740 1 -- start start 2024-09-21T07:51:26.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b01b0 0x55ec72585550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b8390 0x55ec7257d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc50000fdf0 con 0x55ec721b8390 2024-09-21T07:51:26.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc500011930 con 0x55ec721b01b0 2024-09-21T07:51:26.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc5000104c0 con 0x55ec721d9070 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc525000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b8390 0x55ec7257d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc525a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b01b0 0x55ec72585550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc525a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b01b0 0x55ec72585550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:37576/0 (socket says 172.21.15.84:37576) 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc525a00640 1 -- 172.21.15.84:0/3529645901 learned_addr learned my addr 172.21.15.84:0/3529645901 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc525000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b8390 0x55ec7257d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40784/0 (socket says 172.21.15.84:40784) 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.568+0000 7fc526400640 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc525000640 1 -- 172.21.15.84:0/3529645901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 msgr2=0x55ec7257d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc525000640 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc525000640 1 -- 172.21.15.84:0/3529645901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b01b0 msgr2=0x55ec72585550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc525000640 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b01b0 0x55ec72585550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc525000640 1 -- 172.21.15.84:0/3529645901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec725792a0 con 0x55ec721b8390 2024-09-21T07:51:26.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc526400640 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:26.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc525000640 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b8390 0x55ec7257d450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc50c096040 tx=0x7fc50c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13436a3010d39749 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:26.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.569+0000 7fc512000640 1 -- 172.21.15.84:0/3529645901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0ad180 con 0x55ec721b8390 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.570+0000 7fc512000640 1 -- 172.21.15.84:0/3529645901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc50c0b6fe0 con 0x55ec721b8390 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.570+0000 7fc512000640 1 -- 172.21.15.84:0/3529645901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0ac5a0 con 0x55ec721b8390 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 -- 172.21.15.84:0/3529645901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b8390 msgr2=0x55ec7257d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b8390 0x55ec7257d450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc50c096040 tx=0x7fc50c00cf90 comp rx=0 tx=0).stop 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 -- 172.21.15.84:0/3529645901 shutdown_connections 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721d9070 0x55ec7257d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b8390 0x55ec7257d450 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/3529645901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721b01b0 0x55ec72585550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 -- 172.21.15.84:0/3529645901 >> 172.21.15.84:0/3529645901 conn(0x55ec721cd460 msgr2=0x55ec72584e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 -- 172.21.15.84:0/3529645901 shutdown_connections 2024-09-21T07:51:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 -- 172.21.15.84:0/3529645901 wait complete. 2024-09-21T07:51:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.571+0000 7fc52f1e3740 1 -- start start 2024-09-21T07:51:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 1 Processor -- start 2024-09-21T07:51:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec7258f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b8390 0x55ec7258fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721d9070 0x55ec72590060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc500011260 con 0x55ec721b01b0 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc500010b90 con 0x55ec721d9070 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc50000ddb0 con 0x55ec721b8390 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc52f1e3740 10 client.0 _ll_register_callbacks cb 0x7fc50c0a9b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.572+0000 7fc525a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec7258f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc526400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721d9070 0x55ec72590060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec7258f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40796/0 (socket says 172.21.15.84:40796) 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525a00640 1 -- 172.21.15.84:0/259105127 learned_addr learned my addr 172.21.15.84:0/259105127 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525000640 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b8390 0x55ec7258fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525a00640 1 -- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b8390 msgr2=0x55ec7258fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525a00640 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b8390 0x55ec7258fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525a00640 1 -- 172.21.15.84:0/259105127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721d9070 msgr2=0x55ec72590060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525a00640 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721d9070 0x55ec72590060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.573+0000 7fc525a00640 1 -- 172.21.15.84:0/259105127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec72607170 con 0x55ec721b01b0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc525a00640 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec7258f5e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc514005c10 tx=0x7fc5140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd627dffa4f53b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc507400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc507400640 1 -- 172.21.15.84:0/259105127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51401dc30 con 0x55ec721b01b0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc507400640 1 -- 172.21.15.84:0/259105127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc51401ddd0 con 0x55ec721b01b0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc50c0b6fe0 con 0x55ec721b01b0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc507400640 1 -- 172.21.15.84:0/259105127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc51403b050 con 0x55ec721b01b0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc52f1e3740 10 client.15849 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec72608480 con 0x55ec721b01b0 2024-09-21T07:51:26.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.574+0000 7fc507400640 1 -- 172.21.15.84:0/259105127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc50c0b6fe0 con 0x55ec721b01b0 2024-09-21T07:51:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc507400640 1 -- 172.21.15.84:0/259105127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc51402f070 con 0x55ec721b01b0 2024-09-21T07:51:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc52f1e3740 10 client.15849 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc52f1e3740 10 client.15849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:51:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc52f1e3740 20 client.15849 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec7216cda0 0x55ec7260aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc52f1e3740 4 client.15849 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:51:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec724f49b0 con 0x55ec7216cda0 2024-09-21T07:51:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.575+0000 7fc525000640 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec7216cda0 0x55ec7260aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.576+0000 7fc525000640 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec7216cda0 0x55ec7260aca0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9115540fda30dcfd server_cookie=f97b1c9c9d3e6e6d in_seq=0 out_seq=0 2024-09-21T07:51:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.576+0000 7fc507400640 10 client.15849 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.576+0000 7fc507400640 1 -- 172.21.15.84:0/259105127 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec724f49b0 con 0x55ec7216cda0 2024-09-21T07:51:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.576+0000 7fc507400640 10 client.15849 handle_command_reply: tid=0 2024-09-21T07:51:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.576+0000 7fc52f1e3740 1 client.15849 shutdown 2024-09-21T07:51:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.576+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 msgr2=0x55ec7258f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.576+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec7258f5e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc514005c10 tx=0x7fc5140046c0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 shutdown_connections 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55ec7216cda0 0x55ec7260aca0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec721d9070 0x55ec72590060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ec721b8390 0x55ec7258fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 --2- 172.21.15.84:0/259105127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec721b01b0 0x55ec7258f5e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc507400640 0 client.15849 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 >> 172.21.15.84:0/259105127 conn(0x55ec721cd460 msgr2=0x55ec7258cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 shutdown_connections 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 1 -- 172.21.15.84:0/259105127 wait complete. 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.577+0000 7fc52f1e3740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T07:51:26.580 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:51:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5080b6680 msgr2=0x7fc5080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5080b6680 0x7fc5080b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55ec7257e9b0 tx=0x7fc514005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52010b500 msgr2=0x7fc52019ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52010b500 0x7fc52019ca70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc52006b930 tx=0x7fc50c00ee50 comp rx=0 tx=0).stop 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 shutdown_connections 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5080b6680 0x7fc5080b8b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc52010be50 0x7fc5201a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52010b500 0x7fc52019ca70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 --2- 172.21.15.84:0/272645881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc520105bc0 0x7fc52019c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 >> 172.21.15.84:0/272645881 conn(0x7fc520101630 msgr2=0x7fc520108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 shutdown_connections 2024-09-21T07:51:26.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:26.578+0000 7fc526e00640 1 -- 172.21.15.84:0/272645881 wait complete. 2024-09-21T07:51:27.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:27 smithi084 ceph-mon[30411]: pgmap v404: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:27.319 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T07:51:27.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:51:27.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:51:27.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:27 smithi191 ceph-mon[34667]: pgmap v404: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:27 smithi162 ceph-mon[34833]: pgmap v404: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:27.748 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:27.830 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 -- 172.21.15.84:0/1886568066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa401092f0 msgr2=0x7faa40109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 --2- 172.21.15.84:0/1886568066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa401092f0 0x7faa40109700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009900 tx=0x7faa2c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 -- 172.21.15.84:0/1886568066 shutdown_connections 2024-09-21T07:51:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 --2- 172.21.15.84:0/1886568066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa40109c40 0x7faa40110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 --2- 172.21.15.84:0/1886568066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa401092f0 0x7faa40109700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 --2- 172.21.15.84:0/1886568066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa401039b0 0x7faa40103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 -- 172.21.15.84:0/1886568066 >> 172.21.15.84:0/1886568066 conn(0x7faa400ff440 msgr2=0x7faa40101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 -- 172.21.15.84:0/1886568066 shutdown_connections 2024-09-21T07:51:28.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.711+0000 7faa46c00640 1 -- 172.21.15.84:0/1886568066 wait complete. 2024-09-21T07:51:28.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.712+0000 7faa46c00640 1 Processor -- start 2024-09-21T07:51:28.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.712+0000 7faa46c00640 1 -- start start 2024-09-21T07:51:28.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa46c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa401039b0 0x7faa40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa46c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa401092f0 0x7faa40075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa46c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa40109c40 0x7faa40076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa46c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faa40113900 con 0x7faa401092f0 2024-09-21T07:51:28.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa46c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa40113780 con 0x7faa40109c40 2024-09-21T07:51:28.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa46c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faa40113a80 con 0x7faa401039b0 2024-09-21T07:51:28.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa44e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa401092f0 0x7faa40075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa45800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa401039b0 0x7faa40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa44e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa401092f0 0x7faa40075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46418/0 (socket says 172.21.15.84:46418) 2024-09-21T07:51:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa44e00640 1 -- 172.21.15.84:0/3810315037 learned_addr learned my addr 172.21.15.84:0/3810315037 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.713+0000 7faa46200640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa40109c40 0x7faa40076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.714+0000 7faa45800640 1 -- 172.21.15.84:0/3810315037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa40109c40 msgr2=0x7faa40076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.714+0000 7faa45800640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa40109c40 0x7faa40076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.714+0000 7faa45800640 1 -- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa401092f0 msgr2=0x7faa40075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.714+0000 7faa45800640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa401092f0 0x7faa40075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.714+0000 7faa45800640 1 -- 172.21.15.84:0/3810315037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa401a85b0 con 0x7faa401039b0 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.714+0000 7faa45800640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa401039b0 0x7faa40075710 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e9f0 tx=0x7faa3400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.715+0000 7faa3e000640 1 -- 172.21.15.84:0/3810315037 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3400ccc0 con 0x7faa401039b0 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.715+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa401a88a0 con 0x7faa401039b0 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.715+0000 7faa3e000640 1 -- 172.21.15.84:0/3810315037 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa340108e0 con 0x7faa401039b0 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.715+0000 7faa3e000640 1 -- 172.21.15.84:0/3810315037 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34018880 con 0x7faa401039b0 2024-09-21T07:51:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.715+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa401a8de0 con 0x7faa401039b0 2024-09-21T07:51:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.718+0000 7faa4ee63740 1 Processor -- start 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa4ee63740 1 -- start start 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51a75d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51a76270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51a767b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa4ee63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557c519ecfb0 con 0x557c516ae390 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa4ee63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557c519dc3e0 con 0x557c516a61b0 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa4ee63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557c519e01f0 con 0x557c516cf070 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.719+0000 7faa46200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51a75d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa46200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51a75d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53164/0 (socket says 172.21.15.84:53164) 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa46200640 1 -- 172.21.15.84:0/709645401 learned_addr learned my addr 172.21.15.84:0/709645401 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa44e00640 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51a767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa3e000640 1 -- 172.21.15.84:0/3810315037 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7faa34010430 con 0x7faa401039b0 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa46200640 1 -- 172.21.15.84:0/709645401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 msgr2=0x557c51a76270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa46200640 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51a76270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa46200640 1 -- 172.21.15.84:0/709645401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 msgr2=0x557c51a767b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa46200640 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51a767b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.720+0000 7faa46200640 1 -- 172.21.15.84:0/709645401 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c519a6cd0 con 0x557c516cf070 2024-09-21T07:51:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.721+0000 7faa46200640 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51a75d30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa38009fd0 tx=0x7faa380118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60671fbfa30fd6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.721+0000 7faa32a00640 1 -- 172.21.15.84:0/709645401 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3801e070 con 0x557c516cf070 2024-09-21T07:51:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.721+0000 7faa32a00640 1 -- 172.21.15.84:0/709645401 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa38003c30 con 0x557c516cf070 2024-09-21T07:51:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.721+0000 7faa32a00640 1 -- 172.21.15.84:0/709645401 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3800f930 con 0x557c516cf070 2024-09-21T07:51:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.722+0000 7faa3e000640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faa280b6680 0x7faa280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.722+0000 7faa3e000640 1 -- 172.21.15.84:0/3810315037 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7faa340e7dc0 con 0x7faa401039b0 2024-09-21T07:51:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.722+0000 7faa4ee63740 1 -- 172.21.15.84:0/709645401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 msgr2=0x557c51a75d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.722+0000 7faa4ee63740 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51a75d30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa38009fd0 tx=0x7faa380118d0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.722+0000 7faa45800640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faa280b6680 0x7faa280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa4ee63740 1 -- 172.21.15.84:0/709645401 shutdown_connections 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa4ee63740 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51a767b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa4ee63740 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51a76270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa4ee63740 1 --2- 172.21.15.84:0/709645401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51a75d30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa4ee63740 1 -- 172.21.15.84:0/709645401 >> 172.21.15.84:0/709645401 conn(0x557c516c3460 msgr2=0x557c51a73bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa4ee63740 1 -- 172.21.15.84:0/709645401 shutdown_connections 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa4ee63740 1 -- 172.21.15.84:0/709645401 wait complete. 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.723+0000 7faa45800640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faa280b6680 0x7faa280b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x557c51a749b0 tx=0x7faa34009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.724+0000 7faa4ee63740 1 -- start start 2024-09-21T07:51:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.724+0000 7faa4ee63740 1 Processor -- start 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 -- 172.21.15.84:0/2541625920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81092f0 msgr2=0x7f80e8109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 --2- 172.21.15.84:0/2541625920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81092f0 0x7f80e8109700 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009900 tx=0x7f80d402a410 comp rx=0 tx=0).stop 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 -- 172.21.15.84:0/2541625920 shutdown_connections 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 --2- 172.21.15.84:0/2541625920 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80e8109c40 0x7f80e8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 --2- 172.21.15.84:0/2541625920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81092f0 0x7f80e8109700 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 --2- 172.21.15.84:0/2541625920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e81039b0 0x7f80e8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 -- 172.21.15.84:0/2541625920 >> 172.21.15.84:0/2541625920 conn(0x7f80e80ff440 msgr2=0x7f80e8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 -- 172.21.15.84:0/2541625920 shutdown_connections 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.592+0000 7f80ee800640 1 -- 172.21.15.84:0/2541625920 wait complete. 2024-09-21T07:51:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.594+0000 7f80ee800640 1 Processor -- start 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.594+0000 7f80ee800640 1 -- start start 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.594+0000 7f80ee800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81039b0 0x7f80e81a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.594+0000 7f80ee800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e81092f0 0x7f80e81a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ee800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80e8109c40 0x7f80e81ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ee800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8113900 con 0x7f80e81039b0 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ee800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8113780 con 0x7f80e81092f0 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ee800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8113a80 con 0x7f80e8109c40 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81039b0 0x7f80e81a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81039b0 0x7f80e81a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46398/0 (socket says 172.21.15.84:46398) 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 -- 172.21.15.84:0/1962868309 learned_addr learned my addr 172.21.15.84:0/1962868309 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80eca00640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e81092f0 0x7f80e81a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ede00640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80e8109c40 0x7f80e81ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 -- 172.21.15.84:0/1962868309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80e8109c40 msgr2=0x7f80e81ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80e8109c40 0x7f80e81ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 -- 172.21.15.84:0/1962868309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e81092f0 msgr2=0x7f80e81a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e81092f0 0x7f80e81a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.595+0000 7f80ed400640 1 -- 172.21.15.84:0/1962868309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e81acb40 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.596+0000 7f80ed400640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81039b0 0x7f80e81a1580 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e9f0 tx=0x7f80dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.596+0000 7f80e6000640 1 -- 172.21.15.84:0/1962868309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00cd80 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.596+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e81acd70 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.596+0000 7f80e6000640 1 -- 172.21.15.84:0/1962868309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80dc0108e0 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.596+0000 7f80e6000640 1 -- 172.21.15.84:0/1962868309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc018980 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.596+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e81ad220 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.598+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e8103dc0 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.601+0000 7f80e6000640 1 -- 172.21.15.84:0/1962868309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f80dc010430 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.605+0000 7f80e6000640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80d00b6700 0x7f80d00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.605+0000 7f80e6000640 1 -- 172.21.15.84:0/1962868309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f80dc0e7d00 con 0x7f80e81039b0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.605+0000 7f80eca00640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80d00b6700 0x7f80d00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.606+0000 7f80eca00640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80d00b6700 0x7f80d00b8c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009230 tx=0x7f80d4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.607+0000 7f80e6000640 1 -- 172.21.15.84:0/1962868309 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80dc0b2300 con 0x7f80e81039b0 2024-09-21T07:51:28.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.725+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a81f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.725+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a82530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.725+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a87570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.725+0000 7faa4ee63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557c5183d700 con 0x557c516a61b0 2024-09-21T07:51:28.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.725+0000 7faa4ee63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557c51977580 con 0x557c516cf070 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.725+0000 7faa4ee63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557c51a7c3e0 con 0x557c516ae390 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.725+0000 7faa4ee63740 10 client.0 _ll_register_callbacks cb 0x557c51987470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.726+0000 7faa46200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a81f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.726+0000 7faa46200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a81f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46428/0 (socket says 172.21.15.84:46428) 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.726+0000 7faa46200640 1 -- 172.21.15.84:0/644790113 learned_addr learned my addr 172.21.15.84:0/644790113 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.726+0000 7faa44e00640 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a82530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.726+0000 7faa46200640 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a87570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa46200640 1 -- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 msgr2=0x557c51a82530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa46200640 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a82530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa46200640 1 -- 172.21.15.84:0/644790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 msgr2=0x557c51a87570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa46200640 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a87570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa46200640 1 -- 172.21.15.84:0/644790113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5173a650 con 0x557c516a61b0 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa46200640 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a81f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faa38005c40 tx=0x7faa3800f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846234db0571aba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa27400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.727+0000 7faa27400640 1 -- 172.21.15.84:0/644790113 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3802d060 con 0x557c516a61b0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.728+0000 7faa27400640 1 -- 172.21.15.84:0/644790113 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7faa3800f830 con 0x557c516a61b0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.728+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c51979b90 con 0x557c516a61b0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.728+0000 7faa27400640 1 -- 172.21.15.84:0/644790113 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa38034050 con 0x557c516a61b0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.728+0000 7faa4ee63740 10 client.15867 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.728+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c51994950 con 0x557c516a61b0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.728+0000 7faa27400640 1 -- 172.21.15.84:0/644790113 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557c51979b90 con 0x557c516a61b0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa27400640 1 -- 172.21.15.84:0/644790113 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faa38004400 con 0x557c516a61b0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa4ee63740 10 client.15867 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa4ee63740 10 client.15867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa4ee63740 20 client.15867 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa4ee63740 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c5168d9f0 0x557c51aa4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa4ee63740 4 client.15867 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c519eef00 con 0x557c5168d9f0 2024-09-21T07:51:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.729+0000 7faa44e00640 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c5168d9f0 0x557c51aa4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.730+0000 7faa27400640 10 client.15867 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.730+0000 7faa44e00640 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c5168d9f0 0x557c51aa4710 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a35d2654e38d06af server_cookie=847c99ec0eca95a9 in_seq=0 out_seq=0 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.731+0000 7faa27400640 1 -- 172.21.15.84:0/644790113 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c519eef00 con 0x557c5168d9f0 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.731+0000 7faa27400640 10 client.15867 handle_command_reply: tid=0 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.731+0000 7faa4ee63740 1 client.15867 shutdown 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.731+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 msgr2=0x557c51a81f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.731+0000 7faa4ee63740 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a81f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faa38005c40 tx=0x7faa3800f500 comp rx=0 tx=0).stop 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 shutdown_connections 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c5168d9f0 0x557c51aa4710 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a87570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a82530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 --2- 172.21.15.84:0/644790113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a81f70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 >> 172.21.15.84:0/644790113 conn(0x557c516c3460 msgr2=0x557c51a72200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa27400640 0 client.15867 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 shutdown_connections 2024-09-21T07:51:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 1 -- 172.21.15.84:0/644790113 wait complete. 2024-09-21T07:51:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.732+0000 7faa4ee63740 20 client.15867 trim_cache size 0 max 16384 2024-09-21T07:51:28.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.762+0000 7faa4ee63740 1 Processor -- start 2024-09-21T07:51:28.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.763+0000 7faa4ee63740 1 -- start start 2024-09-21T07:51:28.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.763+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a805f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.763+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a80b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.763+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a72200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.763+0000 7faa4ee63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faa401aea00 con 0x557c516a61b0 2024-09-21T07:51:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.763+0000 7faa4ee63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa401b0540 con 0x557c516cf070 2024-09-21T07:51:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.763+0000 7faa4ee63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faa401af0d0 con 0x557c516ae390 2024-09-21T07:51:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa46200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa46200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a805f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46436/0 (socket says 172.21.15.84:46436) 2024-09-21T07:51:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa46200640 1 -- 172.21.15.84:0/1176616926 learned_addr learned my addr 172.21.15.84:0/1176616926 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa44e00640 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a80b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa46200640 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a72200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa44e00640 1 -- 172.21.15.84:0/1176616926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 msgr2=0x557c51a72200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa44e00640 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a72200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa44e00640 1 -- 172.21.15.84:0/1176616926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 msgr2=0x557c51a805f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa44e00640 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a805f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.764+0000 7faa44e00640 1 -- 172.21.15.84:0/1176616926 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c51a7c2c0 con 0x557c516ae390 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.765+0000 7faa46200640 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a72200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.765+0000 7faa44e00640 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a80b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faa2c031440 tx=0x7faa2c005890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93d68f7607713d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.765+0000 7faa32000640 1 -- 172.21.15.84:0/1176616926 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c04a070 con 0x557c516ae390 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.765+0000 7faa32000640 1 -- 172.21.15.84:0/1176616926 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa2c031950 con 0x557c516ae390 2024-09-21T07:51:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.765+0000 7faa32000640 1 -- 172.21.15.84:0/1176616926 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c035040 con 0x557c516ae390 2024-09-21T07:51:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.766+0000 7faa4ee63740 1 -- 172.21.15.84:0/1176616926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 msgr2=0x557c51a80b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.766+0000 7faa4ee63740 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a80b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faa2c031440 tx=0x7faa2c005890 comp rx=0 tx=0).stop 2024-09-21T07:51:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 -- 172.21.15.84:0/1176616926 shutdown_connections 2024-09-21T07:51:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516cf070 0x557c51a72200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516ae390 0x557c51a80b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 --2- 172.21.15.84:0/1176616926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516a61b0 0x557c51a805f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 -- 172.21.15.84:0/1176616926 >> 172.21.15.84:0/1176616926 conn(0x557c516c3460 msgr2=0x557c51a7ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 -- 172.21.15.84:0/1176616926 shutdown_connections 2024-09-21T07:51:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 -- 172.21.15.84:0/1176616926 wait complete. 2024-09-21T07:51:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.767+0000 7faa4ee63740 1 -- start start 2024-09-21T07:51:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.768+0000 7faa4ee63740 1 Processor -- start 2024-09-21T07:51:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.768+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51ab5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51ab6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa4ee63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51ab0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa4ee63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faa401afe70 con 0x557c516ae390 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa4ee63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa401af7a0 con 0x557c516a61b0 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa4ee63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faa401ac9c0 con 0x557c516cf070 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa4ee63740 10 client.0 _ll_register_callbacks cb 0x7faa38009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa46200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51ab5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa46200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51ab5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43914/0 (socket says 172.21.15.84:43914) 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa46200640 1 -- 172.21.15.84:0/388957214 learned_addr learned my addr 172.21.15.84:0/388957214 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa46200640 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51ab0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.769+0000 7faa44e00640 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51ab6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.770+0000 7faa46200640 1 -- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 msgr2=0x557c51ab0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.770+0000 7faa46200640 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51ab0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.770+0000 7faa46200640 1 -- 172.21.15.84:0/388957214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 msgr2=0x557c51ab6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.770+0000 7faa46200640 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51ab6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.770+0000 7faa46200640 1 -- 172.21.15.84:0/388957214 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c51ab1160 con 0x557c516a61b0 2024-09-21T07:51:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.770+0000 7faa46200640 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51ab5c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa38005280 tx=0x7faa38009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e5eabd6d94e6a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.770+0000 7faa27400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.771+0000 7faa27400640 1 -- 172.21.15.84:0/388957214 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3802d050 con 0x557c516a61b0 2024-09-21T07:51:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.771+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c519ea9b0 con 0x557c516a61b0 2024-09-21T07:51:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.771+0000 7faa27400640 1 -- 172.21.15.84:0/388957214 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7faa3800f770 con 0x557c516a61b0 2024-09-21T07:51:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.771+0000 7faa27400640 1 -- 172.21.15.84:0/388957214 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa3801e040 con 0x557c516a61b0 2024-09-21T07:51:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.771+0000 7faa4ee63740 10 client.25829 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.771+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c51b0f620 con 0x557c516a61b0 2024-09-21T07:51:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa27400640 1 -- 172.21.15.84:0/388957214 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557c519ea9b0 con 0x557c516a61b0 2024-09-21T07:51:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa27400640 1 -- 172.21.15.84:0/388957214 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faa38019880 con 0x557c516a61b0 2024-09-21T07:51:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa4ee63740 10 client.25829 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa4ee63740 10 client.25829 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:51:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa4ee63740 20 client.25829 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa4ee63740 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c51662da0 0x557c51b11cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa4ee63740 4 client.25829 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:51:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.772+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c519e7de0 con 0x557c51662da0 2024-09-21T07:51:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.773+0000 7faa44e00640 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c51662da0 0x557c51b11cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.774+0000 7faa44e00640 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c51662da0 0x557c51b11cc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6f9d1d45a997fde server_cookie=c35b767dc615d1a7 in_seq=0 out_seq=0 2024-09-21T07:51:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.774+0000 7faa27400640 10 client.25829 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.774+0000 7faa27400640 1 -- 172.21.15.84:0/388957214 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c519e7de0 con 0x557c51662da0 2024-09-21T07:51:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.774+0000 7faa27400640 10 client.25829 handle_command_reply: tid=0 2024-09-21T07:51:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.774+0000 7faa4ee63740 1 client.25829 shutdown 2024-09-21T07:51:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.774+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 msgr2=0x557c51ab5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51ab5c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa38005280 tx=0x7faa38009500 comp rx=0 tx=0).stop 2024-09-21T07:51:28.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 shutdown_connections 2024-09-21T07:51:28.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x557c51662da0 0x557c51b11cc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c516cf070 0x557c51ab0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c516ae390 0x557c51ab6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 --2- 172.21.15.84:0/388957214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c516a61b0 0x557c51ab5c70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 >> 172.21.15.84:0/388957214 conn(0x557c516c3460 msgr2=0x557c51a72200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa27400640 0 client.25829 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:51:28.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 shutdown_connections 2024-09-21T07:51:28.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 1 -- 172.21.15.84:0/388957214 wait complete. 2024-09-21T07:51:28.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.775+0000 7faa4ee63740 20 client.25829 trim_cache size 0 max 16384 2024-09-21T07:51:28.778 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.776+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faa280b6680 msgr2=0x7faa280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.776+0000 7faa46c00640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faa280b6680 0x7faa280b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x557c51a749b0 tx=0x7faa34009700 comp rx=0 tx=0).stop 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.776+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa401039b0 msgr2=0x7faa40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.776+0000 7faa46c00640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa401039b0 0x7faa40075710 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e9f0 tx=0x7faa3400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.776+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 shutdown_connections 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.777+0000 7faa46c00640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faa280b6680 0x7faa280b8b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.777+0000 7faa46c00640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa40109c40 0x7faa40076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.777+0000 7faa46c00640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa401092f0 0x7faa40075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.777+0000 7faa46c00640 1 --2- 172.21.15.84:0/3810315037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa401039b0 0x7faa40075710 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.777+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 >> 172.21.15.84:0/3810315037 conn(0x7faa400ff440 msgr2=0x7faa40101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.777+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 shutdown_connections 2024-09-21T07:51:28.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.777+0000 7faa46c00640 1 -- 172.21.15.84:0/3810315037 wait complete. 2024-09-21T07:51:28.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.917+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80e802e640 con 0x7f80e81039b0 2024-09-21T07:51:28.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.918+0000 7f80e6000640 1 -- 172.21.15.84:0/1962868309 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f80dc0b7240 con 0x7f80e81039b0 2024-09-21T07:51:28.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:51:28.921 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:51:28.921 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80d00b6700 msgr2=0x7f80d00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80d00b6700 0x7f80d00b8c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009230 tx=0x7f80d4031400 comp rx=0 tx=0).stop 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81039b0 msgr2=0x7f80e81a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81039b0 0x7f80e81a1580 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e9f0 tx=0x7f80dc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 shutdown_connections 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80d00b6700 0x7f80d00b8c10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80e8109c40 0x7f80e81ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e81092f0 0x7f80e81a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 --2- 172.21.15.84:0/1962868309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80e81039b0 0x7f80e81a1580 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:28.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 >> 172.21.15.84:0/1962868309 conn(0x7f80e80ff440 msgr2=0x7f80e8106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:28.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 shutdown_connections 2024-09-21T07:51:28.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:28.922+0000 7f80ee800640 1 -- 172.21.15.84:0/1962868309 wait complete. 2024-09-21T07:51:29.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:29 smithi084 ceph-mon[30411]: pgmap v405: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:51:29.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:29 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1962868309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:29.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:29 smithi191 ceph-mon[34667]: pgmap v405: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:51:29.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:29 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1962868309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:29 smithi162 ceph-mon[34833]: pgmap v405: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T07:51:29.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:29 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1962868309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:29.697 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T07:51:29.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T07:51:30.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:51:30.308 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:30.964 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.987+0000 7f0186200640 1 -- 172.21.15.84:0/310081232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 msgr2=0x7f01801080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.987+0000 7f0186200640 1 --2- 172.21.15.84:0/310081232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 0x7f01801080e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0178009c10 tx=0x7f017802a6e0 comp rx=0 tx=0).stop 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.988+0000 7f0186200640 1 -- 172.21.15.84:0/310081232 shutdown_connections 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.988+0000 7f0186200640 1 --2- 172.21.15.84:0/310081232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 0x7f01801080e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.988+0000 7f0186200640 1 --2- 172.21.15.84:0/310081232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0180103110 0x7f0180107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.988+0000 7f0186200640 1 --2- 172.21.15.84:0/310081232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01801027c0 0x7f0180102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.988+0000 7f0186200640 1 -- 172.21.15.84:0/310081232 >> 172.21.15.84:0/310081232 conn(0x7f0180079760 msgr2=0x7f0180079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.988+0000 7f0186200640 1 -- 172.21.15.84:0/310081232 shutdown_connections 2024-09-21T07:51:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.988+0000 7f0186200640 1 -- 172.21.15.84:0/310081232 wait complete. 2024-09-21T07:51:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.990+0000 7f0186200640 1 Processor -- start 2024-09-21T07:51:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.990+0000 7f0186200640 1 -- start start 2024-09-21T07:51:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.990+0000 7f0186200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01801027c0 0x7f01801a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.990+0000 7f0186200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0180103110 0x7f01801a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f017f400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01801027c0 0x7f01801a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f017f400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01801027c0 0x7f01801a0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53212/0 (socket says 172.21.15.84:53212) 2024-09-21T07:51:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f0186200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 0x7f01801a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f017f400640 1 -- 172.21.15.84:0/931935402 learned_addr learned my addr 172.21.15.84:0/931935402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f018011a0a0 con 0x7f0180103110 2024-09-21T07:51:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0180119f20 con 0x7f0180107c00 2024-09-21T07:51:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f018011a220 con 0x7f01801027c0 2024-09-21T07:51:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.991+0000 7f017fe00640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 0x7f01801a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f017f400640 1 -- 172.21.15.84:0/931935402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 msgr2=0x7f01801a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f017f400640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 0x7f01801a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f017f400640 1 -- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0180103110 msgr2=0x7f01801a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f017f400640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0180103110 0x7f01801a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f017f400640 1 -- 172.21.15.84:0/931935402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01801a6a00 con 0x7f01801027c0 2024-09-21T07:51:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f017f400640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01801027c0 0x7f01801a0a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f017000e9f0 tx=0x7f017000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f0177e00640 1 -- 172.21.15.84:0/931935402 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017000ccc0 con 0x7f01801027c0 2024-09-21T07:51:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01801a6cf0 con 0x7f01801027c0 2024-09-21T07:51:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01801ad450 con 0x7f01801027c0 2024-09-21T07:51:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f0177e00640 1 -- 172.21.15.84:0/931935402 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01700035f0 con 0x7f01801027c0 2024-09-21T07:51:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.992+0000 7f0177e00640 1 -- 172.21.15.84:0/931935402 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017000ce60 con 0x7f01801027c0 2024-09-21T07:51:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.996+0000 7f0177e00640 1 -- 172.21.15.84:0/931935402 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0170003aa0 con 0x7f01801027c0 2024-09-21T07:51:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.997+0000 7f018cdf3740 1 Processor -- start 2024-09-21T07:51:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.997+0000 7f018cdf3740 1 -- start start 2024-09-21T07:51:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7e6840 0x55a08fb8e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb8e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7c5b60 0x55a08fb8edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f018cdf3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a08fb03ca0 con 0x55a08f7c5b60 2024-09-21T07:51:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f018cdf3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a08faf30d0 con 0x55a08f7bd980 2024-09-21T07:51:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f018cdf3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a08faf6ee0 con 0x55a08f7e6840 2024-09-21T07:51:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f017fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7e6840 0x55a08fb8e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f017fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7e6840 0x55a08fb8e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53218/0 (socket says 172.21.15.84:53218) 2024-09-21T07:51:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f017fe00640 1 -- 172.21.15.84:0/2030254805 learned_addr learned my addr 172.21.15.84:0/2030254805 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.998+0000 7f017f400640 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb8e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f0177e00640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01640b6700 0x7f01640b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f017fe00640 1 -- 172.21.15.84:0/2030254805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 msgr2=0x55a08fb8e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f017fe00640 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb8e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f017fe00640 1 -- 172.21.15.84:0/2030254805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7c5b60 msgr2=0x55a08fb8edd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:51:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f0177e00640 1 -- 172.21.15.84:0/931935402 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f01700e7ab0 con 0x7f01801027c0 2024-09-21T07:51:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f017ea00640 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7c5b60 0x55a08fb8edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f017fe00640 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7c5b60 0x55a08fb8edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:30.999+0000 7f017fe00640 1 -- 172.21.15.84:0/2030254805 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a08faa5400 con 0x55a08f7e6840 2024-09-21T07:51:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.000+0000 7f017ea00640 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7c5b60 0x55a08fb8edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:51:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.000+0000 7f017fe00640 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7e6840 0x55a08fb8e350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0178009be0 tx=0x7f0178030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff8e3d09a873675 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.000+0000 7f017fe00640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01640b6700 0x7f01640b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.000+0000 7f016be00640 1 -- 172.21.15.84:0/2030254805 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178041030 con 0x55a08f7e6840 2024-09-21T07:51:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.001+0000 7f016be00640 1 -- 172.21.15.84:0/2030254805 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0178003e20 con 0x55a08f7e6840 2024-09-21T07:51:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.001+0000 7f016be00640 1 -- 172.21.15.84:0/2030254805 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178036040 con 0x55a08f7e6840 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 -- 172.21.15.84:0/2030254805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7e6840 msgr2=0x55a08fb8e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f017fe00640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01640b6700 0x7f01640b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0178044000 tx=0x7f01780044e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7e6840 0x55a08fb8e350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0178009be0 tx=0x7f0178030430 comp rx=0 tx=0).stop 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 -- 172.21.15.84:0/2030254805 shutdown_connections 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7c5b60 0x55a08fb8edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb8e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2030254805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7e6840 0x55a08fb8e350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 -- 172.21.15.84:0/2030254805 >> 172.21.15.84:0/2030254805 conn(0x55a08f7da990 msgr2=0x55a08fb8c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 -- 172.21.15.84:0/2030254805 shutdown_connections 2024-09-21T07:51:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.002+0000 7f018cdf3740 1 -- 172.21.15.84:0/2030254805 wait complete. 2024-09-21T07:51:31.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.003+0000 7f018cdf3740 1 -- start start 2024-09-21T07:51:31.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.003+0000 7f018cdf3740 1 Processor -- start 2024-09-21T07:51:31.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.003+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7bd980 0x55a08fb99a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.003+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7c5b60 0x55a08fb99f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fba5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f018cdf3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a08f9547a0 con 0x55a08f7e6840 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f018cdf3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a08fa98a10 con 0x55a08f7c5b60 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f018cdf3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a08fb9cad0 con 0x55a08f7bd980 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f018cdf3740 10 client.0 _ll_register_callbacks cb 0x55a08faa8be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f017ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7c5b60 0x55a08fb99f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f017fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fba5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f017fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fba5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46470/0 (socket says 172.21.15.84:46470) 2024-09-21T07:51:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f017fe00640 1 -- 172.21.15.84:0/1674104873 learned_addr learned my addr 172.21.15.84:0/1674104873 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.004+0000 7f017f400640 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7bd980 0x55a08fb99a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.005+0000 7f017fe00640 1 -- 172.21.15.84:0/1674104873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7bd980 msgr2=0x55a08fb99a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.005+0000 7f017fe00640 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7bd980 0x55a08fb99a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.005+0000 7f017fe00640 1 -- 172.21.15.84:0/1674104873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7c5b60 msgr2=0x55a08fb99f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.005+0000 7f017fe00640 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7c5b60 0x55a08fb99f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.005+0000 7f017fe00640 1 -- 172.21.15.84:0/1674104873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a08f860b90 con 0x55a08f7e6840 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.005+0000 7f017fe00640 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fba5e20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f017802a720 tx=0x7f0178045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c694061b25f3189 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.005+0000 7f0168c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.006+0000 7f0168c00640 1 -- 172.21.15.84:0/1674104873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178036030 con 0x55a08f7e6840 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.006+0000 7f0168c00640 1 -- 172.21.15.84:0/1674104873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0178004140 con 0x55a08f7e6840 2024-09-21T07:51:31.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.006+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0178003e20 con 0x55a08f7e6840 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.006+0000 7f0168c00640 1 -- 172.21.15.84:0/1674104873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0178041040 con 0x55a08f7e6840 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.006+0000 7f018cdf3740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.006+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a08fba8770 con 0x55a08f7e6840 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f0168c00640 1 -- 172.21.15.84:0/1674104873 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0178003e20 con 0x55a08f7e6840 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f0168c00640 1 -- 172.21.15.84:0/1674104873 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0178030970 con 0x55a08f7e6840 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f018cdf3740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f018cdf3740 10 client.15879 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:51:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f018cdf3740 20 client.15879 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f7a51c0 0x55a08fbabad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f018cdf3740 4 client.15879 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.007+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a08fb05bf0 con 0x55a08f7a51c0 2024-09-21T07:51:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.008+0000 7f017f400640 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f7a51c0 0x55a08fbabad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.008+0000 7f017f400640 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f7a51c0 0x55a08fbabad0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1633de2af5b0e0c server_cookie=7396c531107ed1f9 in_seq=0 out_seq=0 2024-09-21T07:51:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.008+0000 7f0168c00640 10 client.15879 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.009+0000 7f0168c00640 1 -- 172.21.15.84:0/1674104873 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a08fb05bf0 con 0x55a08f7a51c0 2024-09-21T07:51:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.009+0000 7f0168c00640 10 client.15879 handle_command_reply: tid=0 2024-09-21T07:51:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.009+0000 7f018cdf3740 1 client.15879 shutdown 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 msgr2=0x55a08fba5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fba5e20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f017802a720 tx=0x7f0178045000 comp rx=0 tx=0).stop 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 shutdown_connections 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fba5e20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7c5b60 0x55a08fb99f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f7a51c0 0x55a08fbabad0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1674104873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7bd980 0x55a08fb99a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 >> 172.21.15.84:0/1674104873 conn(0x55a08f7da990 msgr2=0x55a08fb914e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f0168c00640 0 client.15879 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 shutdown_connections 2024-09-21T07:51:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 1 -- 172.21.15.84:0/1674104873 wait complete. 2024-09-21T07:51:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.010+0000 7f018cdf3740 20 client.15879 trim_cache size 0 max 16384 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.031+0000 7f018cdf3740 1 Processor -- start 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.032+0000 7f018cdf3740 1 -- start start 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.032+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb9b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.032+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fba5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.032+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fb8b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.032+0000 7f018cdf3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f016000fde0 con 0x55a08f7e6840 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.032+0000 7f018cdf3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0160011920 con 0x55a08f7bd980 2024-09-21T07:51:31.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.032+0000 7f018cdf3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01600104b0 con 0x55a08f7c5b60 2024-09-21T07:51:31.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fba5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb9b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fb8b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb9b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43970/0 (socket says 172.21.15.84:43970) 2024-09-21T07:51:31.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fba5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53246/0 (socket says 172.21.15.84:53246) 2024-09-21T07:51:31.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017f400640 1 -- 172.21.15.84:0/2996570684 learned_addr learned my addr 172.21.15.84:0/2996570684 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017fe00640 1 -- 172.21.15.84:0/2996570684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 msgr2=0x55a08fba5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017fe00640 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fba5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017fe00640 1 -- 172.21.15.84:0/2996570684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 msgr2=0x55a08fb9b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017fe00640 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb9b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017fe00640 1 -- 172.21.15.84:0/2996570684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a08fb87c50 con 0x55a08f7e6840 2024-09-21T07:51:31.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.033+0000 7f017f400640 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb9b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:31.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.034+0000 7f017fe00640 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fb8b0b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f017803d8f0 tx=0x7f0178009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51694dc46b6521f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.034+0000 7f016b400640 1 -- 172.21.15.84:0/2996570684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178036050 con 0x55a08f7e6840 2024-09-21T07:51:31.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.035+0000 7f016b400640 1 -- 172.21.15.84:0/2996570684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0178056070 con 0x55a08f7e6840 2024-09-21T07:51:31.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.035+0000 7f016b400640 1 -- 172.21.15.84:0/2996570684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178003bb0 con 0x55a08f7e6840 2024-09-21T07:51:31.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.036+0000 7f018cdf3740 1 -- 172.21.15.84:0/2996570684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 msgr2=0x55a08fb8b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.036+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fb8b0b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f017803d8f0 tx=0x7f0178009900 comp rx=0 tx=0).stop 2024-09-21T07:51:31.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.037+0000 7f018cdf3740 1 -- 172.21.15.84:0/2996570684 shutdown_connections 2024-09-21T07:51:31.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.037+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7e6840 0x55a08fb8b0b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.037+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fba5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.037+0000 7f018cdf3740 1 --2- 172.21.15.84:0/2996570684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7bd980 0x55a08fb9b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.037+0000 7f018cdf3740 1 -- 172.21.15.84:0/2996570684 >> 172.21.15.84:0/2996570684 conn(0x55a08f7da990 msgr2=0x55a08fb8a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.037+0000 7f018cdf3740 1 -- 172.21.15.84:0/2996570684 shutdown_connections 2024-09-21T07:51:31.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.038+0000 7f018cdf3740 1 -- 172.21.15.84:0/2996570684 wait complete. 2024-09-21T07:51:31.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.038+0000 7f018cdf3740 1 -- start start 2024-09-21T07:51:31.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.038+0000 7f018cdf3740 1 Processor -- start 2024-09-21T07:51:31.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.039+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7bd980 0x55a08fbab560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.039+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fbabb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.039+0000 7f018cdf3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7e6840 0x55a08fc0f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.039+0000 7f018cdf3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0160011250 con 0x55a08f7bd980 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.039+0000 7f018cdf3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0160010b80 con 0x55a08f7e6840 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.039+0000 7f018cdf3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f016000dda0 con 0x55a08f7c5b60 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.039+0000 7f018cdf3740 10 client.0 _ll_register_callbacks cb 0x7f01700eb430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.040+0000 7f017ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fbabb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.040+0000 7f017ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fbabb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53254/0 (socket says 172.21.15.84:53254) 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.040+0000 7f017ea00640 1 -- 172.21.15.84:0/1353728951 learned_addr learned my addr 172.21.15.84:0/1353728951 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.040+0000 7f017fe00640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7e6840 0x55a08fc0f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.040+0000 7f017f400640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7bd980 0x55a08fbab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.041+0000 7f017ea00640 1 -- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7e6840 msgr2=0x55a08fc0f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.041+0000 7f017ea00640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7e6840 0x55a08fc0f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.041+0000 7f017ea00640 1 -- 172.21.15.84:0/1353728951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7bd980 msgr2=0x55a08fbab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.041+0000 7f017ea00640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7bd980 0x55a08fbab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.041+0000 7f017ea00640 1 -- 172.21.15.84:0/1353728951 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a08fc0f960 con 0x55a08f7c5b60 2024-09-21T07:51:31.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.041+0000 7f017f400640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7bd980 0x55a08fbab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:31.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.042+0000 7f017ea00640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fbabb00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f016c013710 tx=0x7f016c013b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b2d02370329d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.042+0000 7f0168c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:51:31.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.042+0000 7f0168c00640 1 -- 172.21.15.84:0/1353728951 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c004260 con 0x55a08f7c5b60 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.042+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0178056070 con 0x55a08f7c5b60 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.042+0000 7f0168c00640 1 -- 172.21.15.84:0/1353728951 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f016c004400 con 0x55a08f7c5b60 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f0168c00640 1 -- 172.21.15.84:0/1353728951 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f016c0118c0 con 0x55a08f7c5b60 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f018cdf3740 10 client.25867 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a08fc16dc0 con 0x55a08f7c5b60 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f0168c00640 1 -- 172.21.15.84:0/1353728951 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0178056070 con 0x55a08f7c5b60 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f0168c00640 1 -- 172.21.15.84:0/1353728951 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f016c00f040 con 0x55a08f7c5b60 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f018cdf3740 10 client.25867 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:31.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f018cdf3740 10 client.25867 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:51:31.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.043+0000 7f018cdf3740 20 client.25867 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:31.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.044+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f77a570 0x55a08fc19650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.044+0000 7f018cdf3740 4 client.25867 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T07:51:31.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.044+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x55a08fb016a0 con 0x55a08f77a570 2024-09-21T07:51:31.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.044+0000 7f017f400640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f77a570 0x55a08fc19650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.044+0000 7f017f400640 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f77a570 0x55a08fc19650 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=335c3f9e8d39374c server_cookie=a673342e11035739 in_seq=0 out_seq=0 2024-09-21T07:51:31.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.044+0000 7f0168c00640 10 client.25867 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f0168c00640 1 -- 172.21.15.84:0/1353728951 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a08fb016a0 con 0x55a08f77a570 2024-09-21T07:51:31.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f0168c00640 10 client.25867 handle_command_reply: tid=0 2024-09-21T07:51:31.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 client.25867 shutdown 2024-09-21T07:51:31.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 msgr2=0x55a08fbabb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fbabb00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f016c013710 tx=0x7f016c013b10 comp rx=0 tx=0).stop 2024-09-21T07:51:31.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 shutdown_connections 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a08f7e6840 0x55a08fc0f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a08f77a570 0x55a08fc19650 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a08f7c5b60 0x55a08fbabb00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 --2- 172.21.15.84:0/1353728951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a08f7bd980 0x55a08fbab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 >> 172.21.15.84:0/1353728951 conn(0x55a08f7da990 msgr2=0x55a08fb8b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f0168c00640 0 client.25867 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.057+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 shutdown_connections 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.058+0000 7f018cdf3740 1 -- 172.21.15.84:0/1353728951 wait complete. 2024-09-21T07:51:31.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.058+0000 7f018cdf3740 20 client.25867 trim_cache size 0 max 16384 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 2, 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "9c9b1bd9": { 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 2, 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:51:31.061 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 134.5, 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:31.062 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01640b6700 msgr2=0x7f01640b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01640b6700 0x7f01640b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0178044000 tx=0x7f01780044e0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01801027c0 msgr2=0x7f01801a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01801027c0 0x7f01801a0a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f017000e9f0 tx=0x7f017000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 shutdown_connections 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01640b6700 0x7f01640b8c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0180107c00 0x7f01801a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0180103110 0x7f01801a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 --2- 172.21.15.84:0/931935402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01801027c0 0x7f01801a0a90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 >> 172.21.15.84:0/931935402 conn(0x7f0180079760 msgr2=0x7f0180105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 shutdown_connections 2024-09-21T07:51:31.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.059+0000 7f0186200640 1 -- 172.21.15.84:0/931935402 wait complete. 2024-09-21T07:51:31.287 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:31 smithi084 ceph-mon[30411]: pgmap v406: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:51:31.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:31 smithi191 ceph-mon[34667]: pgmap v406: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:51:31.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:31 smithi162 ceph-mon[34833]: pgmap v406: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:51:31.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 -- 172.21.15.84:0/814059684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a7410be50 msgr2=0x7f3a74112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 --2- 172.21.15.84:0/814059684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a7410be50 0x7f3a74112680 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009ca0 tx=0x7f3a6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 -- 172.21.15.84:0/814059684 shutdown_connections 2024-09-21T07:51:31.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 --2- 172.21.15.84:0/814059684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a7410be50 0x7f3a74112680 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 --2- 172.21.15.84:0/814059684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a7410b500 0x7f3a7410b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 --2- 172.21.15.84:0/814059684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a74105bc0 0x7f3a74105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 -- 172.21.15.84:0/814059684 >> 172.21.15.84:0/814059684 conn(0x7f3a74101630 msgr2=0x7f3a74103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 -- 172.21.15.84:0/814059684 shutdown_connections 2024-09-21T07:51:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.702+0000 7f3a73200640 1 -- 172.21.15.84:0/814059684 wait complete. 2024-09-21T07:51:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.703+0000 7f3a73200640 1 Processor -- start 2024-09-21T07:51:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.704+0000 7f3a73200640 1 -- start start 2024-09-21T07:51:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.704+0000 7f3a73200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a74105bc0 0x7f3a7419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.704+0000 7f3a73200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7410b500 0x7f3a7419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.704+0000 7f3a73200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a7410be50 0x7f3a741a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.704+0000 7f3a73200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3a74115b60 con 0x7f3a74105bc0 2024-09-21T07:51:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.704+0000 7f3a73200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741159e0 con 0x7f3a7410b500 2024-09-21T07:51:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.704+0000 7f3a73200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3a74115ce0 con 0x7f3a7410be50 2024-09-21T07:51:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7410b500 0x7f3a7419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a74105bc0 0x7f3a7419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7410b500 0x7f3a7419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43986/0 (socket says 172.21.15.84:43986) 2024-09-21T07:51:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 -- 172.21.15.84:0/3324285301 learned_addr learned my addr 172.21.15.84:0/3324285301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a72800640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a7410be50 0x7f3a741a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 -- 172.21.15.84:0/3324285301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a7410be50 msgr2=0x7f3a741a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a7410be50 0x7f3a741a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 -- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a74105bc0 msgr2=0x7f3a7419c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a74105bc0 0x7f3a7419c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71400640 1 -- 172.21.15.84:0/3324285301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a741a23c0 con 0x7f3a7410b500 2024-09-21T07:51:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.705+0000 7f3a71e00640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a74105bc0 0x7f3a7419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.706+0000 7f3a71400640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7410b500 0x7f3a7419c9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000e9f0 tx=0x7f3a6000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.707+0000 7f3a6aa00640 1 -- 172.21.15.84:0/3324285301 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000ccc0 con 0x7f3a7410b500 2024-09-21T07:51:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.707+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a741a26b0 con 0x7f3a7410b500 2024-09-21T07:51:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.707+0000 7f3a6aa00640 1 -- 172.21.15.84:0/3324285301 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a600108e0 con 0x7f3a7410b500 2024-09-21T07:51:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.707+0000 7f3a6aa00640 1 -- 172.21.15.84:0/3324285301 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60018860 con 0x7f3a7410b500 2024-09-21T07:51:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.707+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a741a8e10 con 0x7f3a7410b500 2024-09-21T07:51:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 Processor -- start 2024-09-21T07:51:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 -- start start 2024-09-21T07:51:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a6a070 0x555657e10d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e11270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a49390 0x555657e117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555657d87fb0 con 0x555657a411b0 2024-09-21T07:51:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555657d773e0 con 0x555657a6a070 2024-09-21T07:51:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.711+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555657d7b1f0 con 0x555657a49390 2024-09-21T07:51:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a6a070 0x555657e10d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a6a070 0x555657e10d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43998/0 (socket says 172.21.15.84:43998) 2024-09-21T07:51:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 -- 172.21.15.84:0/3137949344 learned_addr learned my addr 172.21.15.84:0/3137949344 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a71e00640 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e11270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 -- 172.21.15.84:0/3137949344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a49390 msgr2=0x555657e117b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:51:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a49390 0x555657e117b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 -- 172.21.15.84:0/3137949344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 msgr2=0x555657e11270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e11270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.712+0000 7f3a72800640 1 -- 172.21.15.84:0/3137949344 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555657d41cd0 con 0x555657a6a070 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.713+0000 7f3a6aa00640 1 -- 172.21.15.84:0/3324285301 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3a60010430 con 0x7f3a7410b500 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.713+0000 7f3a72800640 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a6a070 0x555657e10d30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009ca0 tx=0x7f3a6c009430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9274f01bacaddc38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.713+0000 7f3a5f000640 1 -- 172.21.15.84:0/3137949344 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c031cf0 con 0x555657a6a070 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.713+0000 7f3a5f000640 1 -- 172.21.15.84:0/3137949344 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a6c036030 con 0x555657a6a070 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.713+0000 7f3a5f000640 1 -- 172.21.15.84:0/3137949344 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0042a0 con 0x555657a6a070 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.714+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3137949344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a6a070 msgr2=0x555657e10d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.714+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a6a070 0x555657e10d30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009ca0 tx=0x7f3a6c009430 comp rx=0 tx=0).stop 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3137949344 shutdown_connections 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a49390 0x555657e117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e11270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3137949344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a6a070 0x555657e10d30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3137949344 >> 172.21.15.84:0/3137949344 conn(0x555657a5e460 msgr2=0x555657e0ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3137949344 shutdown_connections 2024-09-21T07:51:31.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3137949344 wait complete. 2024-09-21T07:51:31.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.715+0000 7f3a6aa00640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3a580b6590 0x7f3a580b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.716+0000 7f3a7f9fc740 1 -- start start 2024-09-21T07:51:31.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.716+0000 7f3a6aa00640 1 -- 172.21.15.84:0/3324285301 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3a600e7c70 con 0x7f3a7410b500 2024-09-21T07:51:31.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.716+0000 7f3a72800640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3a580b6590 0x7f3a580b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.716+0000 7f3a7f9fc740 1 Processor -- start 2024-09-21T07:51:31.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e1c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e1ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a6a070 0x555657e286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555657bd8700 con 0x555657a411b0 2024-09-21T07:51:31.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555657d12580 con 0x555657a49390 2024-09-21T07:51:31.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555657e1f330 con 0x555657a6a070 2024-09-21T07:51:31.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a7f9fc740 10 client.0 _ll_register_callbacks cb 0x555657d22470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:31.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a71e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e1c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a72800640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3a580b6590 0x7f3a580b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c003d10 tx=0x7f3a6c005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a71e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e1c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46534/0 (socket says 172.21.15.84:46534) 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a71e00640 1 -- 172.21.15.84:0/3277787290 learned_addr learned my addr 172.21.15.84:0/3277787290 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.717+0000 7f3a72800640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a6a070 0x555657e286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.718+0000 7f3a71400640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e1ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.718+0000 7f3a72800640 1 -- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 msgr2=0x555657e1ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.718+0000 7f3a72800640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e1ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.718+0000 7f3a72800640 1 -- 172.21.15.84:0/3277787290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 msgr2=0x555657e1c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.718+0000 7f3a72800640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e1c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.718+0000 7f3a72800640 1 -- 172.21.15.84:0/3277787290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555657ad5650 con 0x555657a6a070 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.718+0000 7f3a71e00640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e1c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.719+0000 7f3a72800640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a6a070 0x555657e286b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c02ade0 tx=0x7f3a6c0094a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859ef7b778b8d626 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.719+0000 7f3a53400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:51:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.719+0000 7f3a53400640 1 -- 172.21.15.84:0/3277787290 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c05e060 con 0x555657a6a070 2024-09-21T07:51:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.719+0000 7f3a53400640 1 -- 172.21.15.84:0/3277787290 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3a6c003fb0 con 0x555657a6a070 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.719+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555657d14b90 con 0x555657a6a070 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.719+0000 7f3a53400640 1 -- 172.21.15.84:0/3277787290 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a6c065050 con 0x555657a6a070 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.720+0000 7f3a7f9fc740 10 client.25876 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.720+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555657d2f950 con 0x555657a6a070 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.720+0000 7f3a53400640 1 -- 172.21.15.84:0/3277787290 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555657d14b90 con 0x555657a6a070 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.720+0000 7f3a53400640 1 -- 172.21.15.84:0/3277787290 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3a6c04e050 con 0x555657a6a070 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.721+0000 7f3a7f9fc740 10 client.25876 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.721+0000 7f3a7f9fc740 10 client.25876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.721+0000 7f3a7f9fc740 20 client.25876 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.721+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a289f0 0x555657e3f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.721+0000 7f3a7f9fc740 4 client.25876 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.721+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555657d89f00 con 0x555657a289f0 2024-09-21T07:51:31.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.721+0000 7f3a71e00640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a289f0 0x555657e3f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.722+0000 7f3a53400640 10 client.25876 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.722+0000 7f3a71e00640 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a289f0 0x555657e3f520 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343bb902a8f07b19 server_cookie=8c3c16fdc924b92a in_seq=0 out_seq=0 2024-09-21T07:51:31.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a53400640 1 -- 172.21.15.84:0/3277787290 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555657d89f00 con 0x555657a289f0 2024-09-21T07:51:31.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a53400640 10 client.25876 handle_command_reply: tid=0 2024-09-21T07:51:31.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 client.25876 shutdown 2024-09-21T07:51:31.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a6a070 msgr2=0x555657e286b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a6a070 0x555657e286b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c02ade0 tx=0x7f3a6c0094a0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 shutdown_connections 2024-09-21T07:51:31.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a289f0 0x555657e3f520 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a6a070 0x555657e286b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e1ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a53400640 0 client.25876 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.723+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/3277787290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e1c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.724+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 >> 172.21.15.84:0/3277787290 conn(0x555657a5e460 msgr2=0x555657e13ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.724+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 shutdown_connections 2024-09-21T07:51:31.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.724+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/3277787290 wait complete. 2024-09-21T07:51:31.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.724+0000 7f3a7f9fc740 20 client.25876 trim_cache size 0 max 16384 2024-09-21T07:51:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.751+0000 7f3a7f9fc740 1 Processor -- start 2024-09-21T07:51:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.751+0000 7f3a7f9fc740 1 -- start start 2024-09-21T07:51:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e15e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e16380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e0e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5400fde0 con 0x555657a411b0 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54011920 con 0x555657a49390 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a7f9fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3a540104b0 con 0x555657a289f0 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a71e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e15e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a71e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e15e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53298/0 (socket says 172.21.15.84:53298) 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a71e00640 1 -- 172.21.15.84:0/2223883109 learned_addr learned my addr 172.21.15.84:0/2223883109 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a72800640 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e0e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.752+0000 7f3a71400640 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e16380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.753+0000 7f3a71e00640 1 -- 172.21.15.84:0/2223883109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 msgr2=0x555657e0e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.753+0000 7f3a71e00640 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e0e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.753+0000 7f3a71e00640 1 -- 172.21.15.84:0/2223883109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 msgr2=0x555657e16380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.753+0000 7f3a71e00640 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e16380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.753+0000 7f3a71e00640 1 -- 172.21.15.84:0/2223883109 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555657e13250 con 0x555657a289f0 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.753+0000 7f3a71400640 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e16380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.754+0000 7f3a71e00640 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e15e40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a64012a70 tx=0x7f3a64005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edba6241982bb16b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.754+0000 7f3a5e600640 1 -- 172.21.15.84:0/2223883109 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64029070 con 0x555657a289f0 2024-09-21T07:51:31.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.754+0000 7f3a5e600640 1 -- 172.21.15.84:0/2223883109 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64011d70 con 0x555657a289f0 2024-09-21T07:51:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.754+0000 7f3a5e600640 1 -- 172.21.15.84:0/2223883109 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64003cd0 con 0x555657a289f0 2024-09-21T07:51:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.755+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/2223883109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 msgr2=0x555657e15e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.755+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e15e40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a64012a70 tx=0x7f3a64005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.756+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/2223883109 shutdown_connections 2024-09-21T07:51:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.756+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a49390 0x555657e0e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.756+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a411b0 0x555657e16380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.756+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/2223883109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e15e40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.756+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/2223883109 >> 172.21.15.84:0/2223883109 conn(0x555657a5e460 msgr2=0x555657e1afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.756+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/2223883109 shutdown_connections 2024-09-21T07:51:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.756+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/2223883109 wait complete. 2024-09-21T07:51:31.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.757+0000 7f3a7f9fc740 1 -- start start 2024-09-21T07:51:31.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.757+0000 7f3a7f9fc740 1 Processor -- start 2024-09-21T07:51:31.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e248d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a411b0 0x555657e24e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a7f9fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a49390 0x555657e1f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a71e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e248d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a71e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e248d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53314/0 (socket says 172.21.15.84:53314) 2024-09-21T07:51:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a71e00640 1 -- 172.21.15.84:0/1216346049 learned_addr learned my addr 172.21.15.84:0/1216346049 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54011250 con 0x555657a49390 2024-09-21T07:51:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54010b80 con 0x555657a411b0 2024-09-21T07:51:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5400dda0 con 0x555657a289f0 2024-09-21T07:51:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.758+0000 7f3a72800640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a49390 0x555657e1f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.759+0000 7f3a72800640 1 -- 172.21.15.84:0/1216346049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 msgr2=0x555657e248d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.759+0000 7f3a72800640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e248d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.759+0000 7f3a72800640 1 -- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a411b0 msgr2=0x555657e24e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.759+0000 7f3a71400640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a411b0 0x555657e24e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.759+0000 7f3a7f9fc740 10 client.0 _ll_register_callbacks cb 0x7f3a6c003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.759+0000 7f3a72800640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a411b0 0x555657e24e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.759+0000 7f3a72800640 1 -- 172.21.15.84:0/1216346049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555657e1fd60 con 0x555657a49390 2024-09-21T07:51:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.760+0000 7f3a71400640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a411b0 0x555657e24e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:51:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.760+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a64011d70 con 0x555657a49390 2024-09-21T07:51:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.760+0000 7f3a72800640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a49390 0x555657e1f5d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009620 tx=0x7f3a6c02fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5bd67c27518975 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.760+0000 7f3a53400640 10 client.15900 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.761+0000 7f3a53400640 1 -- 172.21.15.84:0/1216346049 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c05e050 con 0x555657a49390 2024-09-21T07:51:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.761+0000 7f3a53400640 1 -- 172.21.15.84:0/1216346049 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3a6c0305c0 con 0x555657a49390 2024-09-21T07:51:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.761+0000 7f3a53400640 1 -- 172.21.15.84:0/1216346049 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a6c030800 con 0x555657a49390 2024-09-21T07:51:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.761+0000 7f3a7f9fc740 10 client.15900 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.761+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555657eb2e90 con 0x555657a49390 2024-09-21T07:51:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a53400640 1 -- 172.21.15.84:0/1216346049 <== mon.0 v2:172.21.15.84:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3a6c043070 con 0x555657a49390 2024-09-21T07:51:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a7f9fc740 10 client.15900 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a7f9fc740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a7f9fc740 20 client.15900 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a6a070 0x555657eb5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a7f9fc740 4 client.15900 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:51:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555657d859b0 con 0x555657a6a070 2024-09-21T07:51:31.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.762+0000 7f3a71e00640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a6a070 0x555657eb5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:31.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.763+0000 7f3a71e00640 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a6a070 0x555657eb5480 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f96354abeb293cc server_cookie=60dcc9c57b13cd8b in_seq=0 out_seq=0 2024-09-21T07:51:31.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.763+0000 7f3a53400640 10 client.15900 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.763+0000 7f3a53400640 1 -- 172.21.15.84:0/1216346049 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555657d859b0 con 0x555657a6a070 2024-09-21T07:51:31.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.763+0000 7f3a53400640 10 client.15900 handle_command_reply: tid=0 2024-09-21T07:51:31.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 client.15900 shutdown 2024-09-21T07:51:31.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a49390 msgr2=0x555657e1f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a49390 0x555657e1f5d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009620 tx=0x7f3a6c02fec0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 shutdown_connections 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555657a49390 0x555657e1f5d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555657a411b0 0x555657e24e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555657a6a070 0x555657eb5480 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 --2- 172.21.15.84:0/1216346049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555657a289f0 0x555657e248d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 >> 172.21.15.84:0/1216346049 conn(0x555657a5e460 msgr2=0x555657e15e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a53400640 0 client.15900 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.764+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 shutdown_connections 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.765+0000 7f3a7f9fc740 1 -- 172.21.15.84:0/1216346049 wait complete. 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.765+0000 7f3a7f9fc740 20 client.15900 trim_cache size 0 max 16384 2024-09-21T07:51:31.767 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:51:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3a580b6590 msgr2=0x7f3a580b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3a580b6590 0x7f3a580b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c003d10 tx=0x7f3a6c005fd0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7410b500 msgr2=0x7f3a7419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7410b500 0x7f3a7419c9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000e9f0 tx=0x7f3a6000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 shutdown_connections 2024-09-21T07:51:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3a580b6590 0x7f3a580b8aa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a7410be50 0x7f3a741a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7410b500 0x7f3a7419c9f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 --2- 172.21.15.84:0/3324285301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a74105bc0 0x7f3a7419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:31.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.766+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 >> 172.21.15.84:0/3324285301 conn(0x7f3a74101630 msgr2=0x7f3a74108ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:31.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.767+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 shutdown_connections 2024-09-21T07:51:31.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:31.767+0000 7f3a73200640 1 -- 172.21.15.84:0/3324285301 wait complete. 2024-09-21T07:51:33.170 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9c9b1bd9', quiesce took 5.9 seconds. Will release after: 8.6 2024-09-21T07:51:33.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:33 smithi191 ceph-mon[34667]: pgmap v407: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T07:51:33.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:33 smithi162 ceph-mon[34833]: pgmap v407: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T07:51:33.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:33 smithi084 ceph-mon[30411]: pgmap v407: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T07:51:33.824 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:51:33.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:51:34.404 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 -- 172.21.15.84:0/3863171469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81039b0 msgr2=0x7f76f8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 --2- 172.21.15.84:0/3863171469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81039b0 0x7f76f8103dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009900 tx=0x7f76e802a410 comp rx=0 tx=0).stop 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 -- 172.21.15.84:0/3863171469 shutdown_connections 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 --2- 172.21.15.84:0/3863171469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76f8109c40 0x7f76f8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 --2- 172.21.15.84:0/3863171469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76f81092f0 0x7f76f8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 --2- 172.21.15.84:0/3863171469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81039b0 0x7f76f8103dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 -- 172.21.15.84:0/3863171469 >> 172.21.15.84:0/3863171469 conn(0x7f76f80ff440 msgr2=0x7f76f8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:35.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.156+0000 7f76f7200640 1 -- 172.21.15.84:0/3863171469 shutdown_connections 2024-09-21T07:51:35.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.157+0000 7f76f7200640 1 -- 172.21.15.84:0/3863171469 wait complete. 2024-09-21T07:51:35.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.158+0000 7f76f7200640 1 Processor -- start 2024-09-21T07:51:35.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.159+0000 7f76f7200640 1 -- start start 2024-09-21T07:51:35.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.159+0000 7f76f7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76f81039b0 0x7f76f819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.159+0000 7f76f7200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81092f0 0x7f76f819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.159+0000 7f76f7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76f8109c40 0x7f76f819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.159+0000 7f76f7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8113950 con 0x7f76f8109c40 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.159+0000 7f76f7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81137d0 con 0x7f76f81039b0 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.159+0000 7f76f7200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8113ad0 con 0x7f76f81092f0 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81092f0 0x7f76f819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76f81039b0 0x7f76f819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81092f0 0x7f76f819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53324/0 (socket says 172.21.15.84:53324) 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5400640 1 -- 172.21.15.84:0/3133760325 learned_addr learned my addr 172.21.15.84:0/3133760325 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:35.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f6800640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76f8109c40 0x7f76f819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5e00640 1 -- 172.21.15.84:0/3133760325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81092f0 msgr2=0x7f76f819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5e00640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81092f0 0x7f76f819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5e00640 1 -- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76f8109c40 msgr2=0x7f76f819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5e00640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76f8109c40 0x7f76f819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.160+0000 7f76f5e00640 1 -- 172.21.15.84:0/3133760325 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f81a02b0 con 0x7f76f81039b0 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.161+0000 7f76f5400640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81092f0 0x7f76f819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:35.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.162+0000 7f76f5e00640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76f81039b0 0x7f76f819a340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76e802aa00 tx=0x7f76e80035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.162+0000 7f76eea00640 1 -- 172.21.15.84:0/3133760325 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e804d070 con 0x7f76f81039b0 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.162+0000 7f76eea00640 1 -- 172.21.15.84:0/3133760325 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76e8003bf0 con 0x7f76f81039b0 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.162+0000 7f76eea00640 1 -- 172.21.15.84:0/3133760325 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8035070 con 0x7f76f81039b0 2024-09-21T07:51:35.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.162+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f81a0540 con 0x7f76f81039b0 2024-09-21T07:51:35.165 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:35 smithi084 ceph-mon[30411]: pgmap v408: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T07:51:35.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.163+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f81a09a0 con 0x7f76f81039b0 2024-09-21T07:51:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 Processor -- start 2024-09-21T07:51:35.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 -- start start 2024-09-21T07:51:35.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788b0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e78825e90 con 0x561e784e7670 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e788152c0 con 0x561e78508350 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.169+0000 7f7703a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561e788190d0 con 0x561e784df490 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.170+0000 7f76f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.170+0000 7f76f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46562/0 (socket says 172.21.15.84:46562) 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.170+0000 7f76f6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.170+0000 7f76f5400640 1 -- 172.21.15.84:0/164421693 learned_addr learned my addr 172.21.15.84:0/164421693 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76f6800640 1 -- 172.21.15.84:0/164421693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 msgr2=0x561e788b0440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76f6800640 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b0440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76f6800640 1 -- 172.21.15.84:0/164421693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 msgr2=0x561e788b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76f6800640 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76f6800640 1 -- 172.21.15.84:0/164421693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e78573930 con 0x561e78508350 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76f5400640 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76f6800640 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788aff00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009f00 tx=0x7f76f0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a8431084f4fefff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:35.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76e3400640 1 -- 172.21.15.84:0/164421693 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0004d20 con 0x561e78508350 2024-09-21T07:51:35.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76e3400640 1 -- 172.21.15.84:0/164421693 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f0004030 con 0x561e78508350 2024-09-21T07:51:35.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76e3400640 1 -- 172.21.15.84:0/164421693 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0005280 con 0x561e78508350 2024-09-21T07:51:35.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.171+0000 7f76eea00640 1 -- 172.21.15.84:0/3133760325 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f76e80314a0 con 0x7f76f81039b0 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 -- 172.21.15.84:0/164421693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 msgr2=0x561e788aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788aff00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009f00 tx=0x7f76f0011810 comp rx=0 tx=0).stop 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 -- 172.21.15.84:0/164421693 shutdown_connections 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 --2- 172.21.15.84:0/164421693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788aff00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 -- 172.21.15.84:0/164421693 >> 172.21.15.84:0/164421693 conn(0x561e784fc740 msgr2=0x561e788addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f76eea00640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76dc0b6850 0x7f76dc0b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f7703a0d740 1 -- 172.21.15.84:0/164421693 shutdown_connections 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.173+0000 7f76eea00640 1 -- 172.21.15.84:0/3133760325 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f76e810fb80 con 0x7f76f81039b0 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.174+0000 7f76f5400640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76dc0b6850 0x7f76dc0b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.174+0000 7f7703a0d740 1 -- 172.21.15.84:0/164421693 wait complete. 2024-09-21T07:51:35.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.175+0000 7f7703a0d740 1 -- start start 2024-09-21T07:51:35.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.175+0000 7f76f5400640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76dc0b6850 0x7f76dc0b8d60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f76e4004650 tx=0x7f76e4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:35.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.175+0000 7f7703a0d740 1 Processor -- start 2024-09-21T07:51:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e788c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f76f5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f76f5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:44074/0 (socket says 172.21.15.84:44074) 2024-09-21T07:51:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f7703a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e78676890 con 0x561e78508350 2024-09-21T07:51:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f7703a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e787b0160 con 0x561e784e7670 2024-09-21T07:51:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.176+0000 7f7703a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561e788be6e0 con 0x561e784df490 2024-09-21T07:51:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f7703a0d740 10 client.0 _ll_register_callbacks cb 0x561e787cca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f5400640 1 -- 172.21.15.84:0/1630078856 learned_addr learned my addr 172.21.15.84:0/1630078856 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f6800640 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e788c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f5400640 1 -- 172.21.15.84:0/1630078856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 msgr2=0x561e788bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f5400640 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f5400640 1 -- 172.21.15.84:0/1630078856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 msgr2=0x561e788c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f5400640 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e788c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.177+0000 7f76f5400640 1 -- 172.21.15.84:0/1630078856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e788c7ff0 con 0x561e784e7670 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.178+0000 7f76f5400640 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788bc040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f76e400fbf0 tx=0x7f76e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dfa5948a60f3f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:35.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.178+0000 7f76d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.178+0000 7f76d7e00640 1 -- 172.21.15.84:0/1630078856 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e400e930 con 0x561e784e7670 2024-09-21T07:51:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.178+0000 7f76d7e00640 1 -- 172.21.15.84:0/1630078856 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f76e400ead0 con 0x561e784e7670 2024-09-21T07:51:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.178+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76f0004030 con 0x561e784e7670 2024-09-21T07:51:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.179+0000 7f76d7e00640 1 -- 172.21.15.84:0/1630078856 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76e400ecd0 con 0x561e784e7670 2024-09-21T07:51:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.179+0000 7f7703a0d740 10 client.25874 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.179+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e788ca980 con 0x561e784e7670 2024-09-21T07:51:35.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.180+0000 7f76d7e00640 1 -- 172.21.15.84:0/1630078856 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f0004030 con 0x561e784e7670 2024-09-21T07:51:35.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f76d7e00640 1 -- 172.21.15.84:0/1630078856 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f76e4038430 con 0x561e784e7670 2024-09-21T07:51:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f7703a0d740 10 client.25874 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f7703a0d740 10 client.25874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f7703a0d740 20 client.25874 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e784c6cd0 0x561e788cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f7703a0d740 4 client.25874 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e78827de0 con 0x561e784c6cd0 2024-09-21T07:51:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.181+0000 7f76f5e00640 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e784c6cd0 0x561e788cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.182+0000 7f76f5e00640 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e784c6cd0 0x561e788cde60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e69b7cf83c4b5c server_cookie=c98629e068395b99 in_seq=0 out_seq=0 2024-09-21T07:51:35.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.182+0000 7f76d7e00640 10 client.25874 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.183+0000 7f76d7e00640 1 -- 172.21.15.84:0/1630078856 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e78827de0 con 0x561e784c6cd0 2024-09-21T07:51:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.183+0000 7f76d7e00640 10 client.25874 handle_command_reply: tid=0 2024-09-21T07:51:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.183+0000 7f7703a0d740 1 client.25874 shutdown 2024-09-21T07:51:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.183+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 msgr2=0x561e788bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.183+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788bc040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f76e400fbf0 tx=0x7f76e40046c0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.184+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 shutdown_connections 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.184+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e788c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.184+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788bc040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.184+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e784c6cd0 0x561e788cde60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.184+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1630078856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.184+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 >> 172.21.15.84:0/1630078856 conn(0x561e784fc740 msgr2=0x561e788b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.184+0000 7f76d7e00640 0 client.25874 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.185+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 shutdown_connections 2024-09-21T07:51:35.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.185+0000 7f7703a0d740 1 -- 172.21.15.84:0/1630078856 wait complete. 2024-09-21T07:51:35.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.185+0000 7f7703a0d740 20 client.25874 trim_cache size 0 max 16384 2024-09-21T07:51:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 Processor -- start 2024-09-21T07:51:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 -- start start 2024-09-21T07:51:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788bb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788bd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8074940 con 0x561e784e7670 2024-09-21T07:51:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81a7b90 con 0x561e78508350 2024-09-21T07:51:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.220+0000 7f7703a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8075010 con 0x561e784df490 2024-09-21T07:51:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788bb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788bb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46568/0 (socket says 172.21.15.84:46568) 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f5400640 1 -- 172.21.15.84:0/1985080639 learned_addr learned my addr 172.21.15.84:0/1985080639 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f6800640 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788bd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f5e00640 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f6800640 1 -- 172.21.15.84:0/1985080639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 msgr2=0x561e788b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f6800640 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.221+0000 7f76f6800640 1 -- 172.21.15.84:0/1985080639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 msgr2=0x561e788bb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76f6800640 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788bb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76f6800640 1 -- 172.21.15.84:0/1985080639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e788b2d60 con 0x561e78508350 2024-09-21T07:51:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76f5e00640 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76f5400640 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788bb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76f6800640 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788bd470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76f0011d10 tx=0x7f76f00049c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65101b15748584a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76e2a00640 1 -- 172.21.15.84:0/1985080639 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f001e040 con 0x561e78508350 2024-09-21T07:51:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76e2a00640 1 -- 172.21.15.84:0/1985080639 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f0004df0 con 0x561e78508350 2024-09-21T07:51:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.222+0000 7f76e2a00640 1 -- 172.21.15.84:0/1985080639 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0024980 con 0x561e78508350 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 -- 172.21.15.84:0/1985080639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 msgr2=0x561e788bd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788bd470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76f0011d10 tx=0x7f76f00049c0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 -- 172.21.15.84:0/1985080639 shutdown_connections 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e78508350 0x561e788bd470 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e784e7670 0x561e788bb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 --2- 172.21.15.84:0/1985080639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 -- 172.21.15.84:0/1985080639 >> 172.21.15.84:0/1985080639 conn(0x561e784fc740 msgr2=0x561e788b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 -- 172.21.15.84:0/1985080639 shutdown_connections 2024-09-21T07:51:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.224+0000 7f7703a0d740 1 -- 172.21.15.84:0/1985080639 wait complete. 2024-09-21T07:51:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.225+0000 7f7703a0d740 1 -- start start 2024-09-21T07:51:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.225+0000 7f7703a0d740 1 Processor -- start 2024-09-21T07:51:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f7703a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e78937860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f7703a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81a74c0 con 0x561e78508350 2024-09-21T07:51:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f7703a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81a6df0 con 0x561e784e7670 2024-09-21T07:51:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f7703a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8072900 con 0x561e784df490 2024-09-21T07:51:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f7703a0d740 10 client.0 _ll_register_callbacks cb 0x7f76e400f8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f76f5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f76f5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788c01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:44092/0 (socket says 172.21.15.84:44092) 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.226+0000 7f76f5400640 1 -- 172.21.15.84:0/2799259533 learned_addr learned my addr 172.21.15.84:0/2799259533 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.227+0000 7f76f5e00640 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.227+0000 7f76f6800640 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e78937860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.227+0000 7f76f5400640 1 -- 172.21.15.84:0/2799259533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 msgr2=0x561e788bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.227+0000 7f76f5400640 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.227+0000 7f76f5400640 1 -- 172.21.15.84:0/2799259533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 msgr2=0x561e78937860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.228+0000 7f76f5400640 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e78937860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.228+0000 7f76f5400640 1 -- 172.21.15.84:0/2799259533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e78937da0 con 0x561e784e7670 2024-09-21T07:51:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.228+0000 7f76f5400640 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788c01f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f76e4023cc0 tx=0x7f76e400ff10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c90c96db0ed90b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.228+0000 7f76d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.228+0000 7f76d7e00640 1 -- 172.21.15.84:0/2799259533 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4038630 con 0x561e784e7670 2024-09-21T07:51:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.229+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76f0004df0 con 0x561e784e7670 2024-09-21T07:51:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.229+0000 7f76d7e00640 1 -- 172.21.15.84:0/2799259533 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f76e400e780 con 0x561e784e7670 2024-09-21T07:51:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.229+0000 7f76d7e00640 1 -- 172.21.15.84:0/2799259533 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76e4053050 con 0x561e784e7670 2024-09-21T07:51:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.229+0000 7f7703a0d740 10 client.25880 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.229+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561e78938ea0 con 0x561e784e7670 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.229+0000 7f76d7e00640 1 -- 172.21.15.84:0/2799259533 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f0004df0 con 0x561e784e7670 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.230+0000 7f76d7e00640 1 -- 172.21.15.84:0/2799259533 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f76e4004a30 con 0x561e784e7670 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.230+0000 7f7703a0d740 10 client.25880 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.230+0000 7f7703a0d740 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.230+0000 7f7703a0d740 20 client.25880 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.230+0000 7f7703a0d740 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e7849c080 0x561e7893b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.230+0000 7f7703a0d740 4 client.25880 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.231+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561e78823890 con 0x561e7849c080 2024-09-21T07:51:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.231+0000 7f76f5e00640 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e7849c080 0x561e7893b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.232+0000 7f76f5e00640 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e7849c080 0x561e7893b6c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdcf66997f7704c2 server_cookie=523402e5e085e367 in_seq=0 out_seq=0 2024-09-21T07:51:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.232+0000 7f76d7e00640 10 client.25880 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.234+0000 7f76d7e00640 1 -- 172.21.15.84:0/2799259533 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561e78823890 con 0x561e7849c080 2024-09-21T07:51:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.234+0000 7f76d7e00640 10 client.25880 handle_command_reply: tid=0 2024-09-21T07:51:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.234+0000 7f7703a0d740 1 client.25880 shutdown 2024-09-21T07:51:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.234+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 msgr2=0x561e788c01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.234+0000 7f7703a0d740 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788c01f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f76e4023cc0 tx=0x7f76e400ff10 comp rx=0 tx=0).stop 2024-09-21T07:51:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.234+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 shutdown_connections 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.234+0000 7f7703a0d740 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e78508350 0x561e78937860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f7703a0d740 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e784e7670 0x561e788c01f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f7703a0d740 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561e7849c080 0x561e7893b6c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f7703a0d740 1 --2- 172.21.15.84:0/2799259533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e784df490 0x561e788bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 >> 172.21.15.84:0/2799259533 conn(0x561e784fc740 msgr2=0x561e788b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f76d7e00640 0 client.25880 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 shutdown_connections 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f7703a0d740 1 -- 172.21.15.84:0/2799259533 wait complete. 2024-09-21T07:51:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.235+0000 7f7703a0d740 20 client.25880 trim_cache size 0 max 16384 2024-09-21T07:51:35.238 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:35.238 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:51:35.238 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "5cf97035-fd04-41b7-9d39-d10e5b22671b", 2024-09-21T07:51:35.238 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:51:35.238 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.236+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76dc0b6850 msgr2=0x7f76dc0b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.236+0000 7f76f7200640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76dc0b6850 0x7f76dc0b8d60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f76e4004650 tx=0x7f76e4005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.236+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76f81039b0 msgr2=0x7f76f819a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.236+0000 7f76f7200640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76f81039b0 0x7f76f819a340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76e802aa00 tx=0x7f76e80035f0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 shutdown_connections 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76dc0b6850 0x7f76dc0b8d60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76f8109c40 0x7f76f819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76f81092f0 0x7f76f819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 --2- 172.21.15.84:0/3133760325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76f81039b0 0x7f76f819a340 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 >> 172.21.15.84:0/3133760325 conn(0x7f76f80ff440 msgr2=0x7f76f8101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 shutdown_connections 2024-09-21T07:51:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:35.237+0000 7f76f7200640 1 -- 172.21.15.84:0/3133760325 wait complete. 2024-09-21T07:51:35.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:35 smithi191 ceph-mon[34667]: pgmap v408: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T07:51:35.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:35 smithi162 ceph-mon[34833]: pgmap v408: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-21T07:51:35.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:51:36.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:36 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:51:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:36 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:51:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:36 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:51:36.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:36 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:51:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:36.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:36 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:51:36.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:36 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:51:36.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:36 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:51:36.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:36 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:51:36.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:36 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:51:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:36 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:51:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:36 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:51:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:36 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:51:37.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 -- 172.21.15.84:0/2218045123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac81039b0 msgr2=0x7f2ac8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 --2- 172.21.15.84:0/2218045123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac81039b0 0x7f2ac8103dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009860 tx=0x7f2abc02a340 comp rx=0 tx=0).stop 2024-09-21T07:51:37.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 -- 172.21.15.84:0/2218045123 shutdown_connections 2024-09-21T07:51:37.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 --2- 172.21.15.84:0/2218045123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac8109c40 0x7f2ac8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 --2- 172.21.15.84:0/2218045123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ac81092f0 0x7f2ac8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 --2- 172.21.15.84:0/2218045123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac81039b0 0x7f2ac8103dc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 -- 172.21.15.84:0/2218045123 >> 172.21.15.84:0/2218045123 conn(0x7f2ac80ff440 msgr2=0x7f2ac8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 -- 172.21.15.84:0/2218045123 shutdown_connections 2024-09-21T07:51:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.253+0000 7f2acec00640 1 -- 172.21.15.84:0/2218045123 wait complete. 2024-09-21T07:51:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 Processor -- start 2024-09-21T07:51:37.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 -- start start 2024-09-21T07:51:37.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ac81039b0 0x7f2ac819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac81092f0 0x7f2ac819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac8109c40 0x7f2ac81a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8113900 con 0x7f2ac81092f0 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8113780 con 0x7f2ac8109c40 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.255+0000 7f2acec00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8113a80 con 0x7f2ac81039b0 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.256+0000 7f2acd800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ac81039b0 0x7f2ac819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.256+0000 7f2acd800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ac81039b0 0x7f2ac819c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53380/0 (socket says 172.21.15.84:53380) 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.256+0000 7f2acce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac81092f0 0x7f2ac819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.256+0000 7f2acd800640 1 -- 172.21.15.84:0/1064891108 learned_addr learned my addr 172.21.15.84:0/1064891108 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.256+0000 7f2ace200640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac8109c40 0x7f2ac81a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.257+0000 7f2acce00640 1 -- 172.21.15.84:0/1064891108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ac81039b0 msgr2=0x7f2ac819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.257+0000 7f2acce00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ac81039b0 0x7f2ac819c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.257+0000 7f2acce00640 1 -- 172.21.15.84:0/1064891108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac8109c40 msgr2=0x7f2ac81a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.257+0000 7f2acce00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac8109c40 0x7f2ac81a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.257+0000 7f2acce00640 1 -- 172.21.15.84:0/1064891108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac81a2520 con 0x7f2ac81092f0 2024-09-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.257+0000 7f2acce00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac81092f0 0x7f2ac819cb50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2ac806b990 tx=0x7f2ab400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.258+0000 7f2ac6000640 1 -- 172.21.15.84:0/1064891108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab400cc40 con 0x7f2ac81092f0 2024-09-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.258+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac81a2810 con 0x7f2ac81092f0 2024-09-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.258+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac81a8f70 con 0x7f2ac81092f0 2024-09-21T07:51:37.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.258+0000 7f2ac6000640 1 -- 172.21.15.84:0/1064891108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab400cde0 con 0x7f2ac81092f0 2024-09-21T07:51:37.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.258+0000 7f2ac6000640 1 -- 172.21.15.84:0/1064891108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4004a00 con 0x7f2ac81092f0 2024-09-21T07:51:37.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.261+0000 7f2ad6fed740 1 Processor -- start 2024-09-21T07:51:37.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.261+0000 7f2ad6fed740 1 -- start start 2024-09-21T07:51:37.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bbca070 0x55b23bf70cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba11b0 0x55b23bf71230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba9390 0x55b23bf71770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b23bee7f70 con 0x55b23bba9390 2024-09-21T07:51:37.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b23bed73a0 con 0x55b23bba11b0 2024-09-21T07:51:37.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b23bedb1b0 con 0x55b23bbca070 2024-09-21T07:51:37.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2acd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba11b0 0x55b23bf71230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2ace200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bbca070 0x55b23bf70cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2acd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba11b0 0x55b23bf71230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:44120/0 (socket says 172.21.15.84:44120) 2024-09-21T07:51:37.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.262+0000 7f2acd800640 1 -- 172.21.15.84:0/2230416385 learned_addr learned my addr 172.21.15.84:0/2230416385 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:37.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.263+0000 7f2ace200640 1 -- 172.21.15.84:0/2230416385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba11b0 msgr2=0x55b23bf71230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.263+0000 7f2ace200640 1 --2- 172.21.15.84:0/2230416385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba11b0 0x55b23bf71230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.263+0000 7f2ace200640 1 -- 172.21.15.84:0/2230416385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba9390 msgr2=0x55b23bf71770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.263+0000 7f2ace200640 1 --2- 172.21.15.84:0/2230416385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba9390 0x55b23bf71770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.263+0000 7f2ace200640 1 -- 172.21.15.84:0/2230416385 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23bea1c90 con 0x55b23bbca070 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.263+0000 7f2ace200640 1 --2- 172.21.15.84:0/2230416385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bbca070 0x55b23bf70cf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009800 tx=0x7f2ac00095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad805384d1dc905 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.264+0000 7f2ac6000640 1 -- 172.21.15.84:0/1064891108 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2ab4004ba0 con 0x7f2ac81092f0 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.264+0000 7f2abaa00640 1 -- 172.21.15.84:0/2230416385 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac001d070 con 0x55b23bbca070 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.264+0000 7f2abaa00640 1 -- 172.21.15.84:0/2230416385 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac0003e40 con 0x55b23bbca070 2024-09-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.264+0000 7f2abaa00640 1 -- 172.21.15.84:0/2230416385 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0018a20 con 0x55b23bbca070 2024-09-21T07:51:37.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.265+0000 7f2ad6fed740 1 -- 172.21.15.84:0/2230416385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bbca070 msgr2=0x55b23bf70cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.265+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/2230416385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bbca070 0x55b23bf70cf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009800 tx=0x7f2ac00095c0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.265+0000 7f2ad6fed740 1 -- 172.21.15.84:0/2230416385 shutdown_connections 2024-09-21T07:51:37.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.265+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/2230416385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba9390 0x55b23bf71770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.265+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/2230416385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba11b0 0x55b23bf71230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.265+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/2230416385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bbca070 0x55b23bf70cf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.265+0000 7f2ad6fed740 1 -- 172.21.15.84:0/2230416385 >> 172.21.15.84:0/2230416385 conn(0x55b23bbbe460 msgr2=0x55b23bf6eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:37.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.266+0000 7f2ad6fed740 1 -- 172.21.15.84:0/2230416385 shutdown_connections 2024-09-21T07:51:37.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.266+0000 7f2ad6fed740 1 -- 172.21.15.84:0/2230416385 wait complete. 2024-09-21T07:51:37.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.266+0000 7f2ac6000640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2ab00b6610 0x7f2ab00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.266+0000 7f2ac6000640 1 -- 172.21.15.84:0/1064891108 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2ab40e77f0 con 0x7f2ac81092f0 2024-09-21T07:51:37.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.267+0000 7f2ad6fed740 1 -- start start 2024-09-21T07:51:37.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.267+0000 7f2acd800640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2ab00b6610 0x7f2ab00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.267+0000 7f2ad6fed740 1 Processor -- start 2024-09-21T07:51:37.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.268+0000 7f2acd800640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2ab00b6610 0x7f2ab00b8b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009830 tx=0x7f2abc02c040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:37.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.268+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba11b0 0x55b23bf85820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.268+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf85e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.268+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf8ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.268+0000 7f2acd800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba11b0 0x55b23bf85820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acd800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba11b0 0x55b23bf85820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46600/0 (socket says 172.21.15.84:46600) 2024-09-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acd800640 1 -- 172.21.15.84:0/3701786502 learned_addr learned my addr 172.21.15.84:0/3701786502 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b23bd38700 con 0x55b23bba11b0 2024-09-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b23be72540 con 0x55b23bbca070 2024-09-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b23bf7f4d0 con 0x55b23bba9390 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2ad6fed740 10 client.0 _ll_register_callbacks cb 0x55b23be82430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2ace200640 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf8ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acce00640 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf85e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acd800640 1 -- 172.21.15.84:0/3701786502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 msgr2=0x55b23bf85e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acd800640 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf85e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acd800640 1 -- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 msgr2=0x55b23bf8ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acd800640 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf8ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2acd800640 1 -- 172.21.15.84:0/3701786502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b23bc35650 con 0x55b23bba11b0 2024-09-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.269+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b23be74b50 con 0x55b23bba11b0 2024-09-21T07:51:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.270+0000 7f2acd800640 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba11b0 0x55b23bf85820 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2abc035040 tx=0x7f2abc02a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2d0fa16a078d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.270+0000 7f2aaf400640 10 client.15927 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.270+0000 7f2aaf400640 1 -- 172.21.15.84:0/3701786502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc037040 con 0x55b23bba11b0 2024-09-21T07:51:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.270+0000 7f2aaf400640 1 -- 172.21.15.84:0/3701786502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2abc0035f0 con 0x55b23bba11b0 2024-09-21T07:51:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.271+0000 7f2aaf400640 1 -- 172.21.15.84:0/3701786502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2abc003810 con 0x55b23bba11b0 2024-09-21T07:51:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.271+0000 7f2ad6fed740 10 client.15927 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.271+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b23be8f910 con 0x55b23bba11b0 2024-09-21T07:51:37.273 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:37 smithi084 ceph-mon[30411]: pgmap v409: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.271+0000 7f2aaf400640 1 -- 172.21.15.84:0/3701786502 <== mon.0 v2:172.21.15.84:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2abc0039b0 con 0x55b23bba11b0 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.272+0000 7f2ad6fed740 10 client.15927 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.272+0000 7f2ad6fed740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.272+0000 7f2ad6fed740 20 client.15927 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.272+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23bb889f0 0x55b23bf96f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.272+0000 7f2ad6fed740 4 client.15927 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.272+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b23bee9ec0 con 0x55b23bb889f0 2024-09-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.272+0000 7f2acce00640 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23bb889f0 0x55b23bf96f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.273+0000 7f2acce00640 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23bb889f0 0x55b23bf96f30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12a66c0a0d64adac server_cookie=b1ff4e2e98d128b6 in_seq=0 out_seq=0 2024-09-21T07:51:37.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.273+0000 7f2aaf400640 10 client.15927 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:37.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.274+0000 7f2aaf400640 1 -- 172.21.15.84:0/3701786502 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b23bee9ec0 con 0x55b23bb889f0 2024-09-21T07:51:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.274+0000 7f2aaf400640 10 client.15927 handle_command_reply: tid=0 2024-09-21T07:51:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.274+0000 7f2ad6fed740 1 client.15927 shutdown 2024-09-21T07:51:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.274+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba11b0 msgr2=0x55b23bf85820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.274+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba11b0 0x55b23bf85820 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2abc035040 tx=0x7f2abc02a340 comp rx=0 tx=0).stop 2024-09-21T07:51:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 shutdown_connections 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf8ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23bb889f0 0x55b23bf96f30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf85e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3701786502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bba11b0 0x55b23bf85820 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 >> 172.21.15.84:0/3701786502 conn(0x55b23bbbe460 msgr2=0x55b23bf73e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2aaf400640 0 client.15927 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 shutdown_connections 2024-09-21T07:51:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.275+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3701786502 wait complete. 2024-09-21T07:51:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.276+0000 7f2ad6fed740 20 client.15927 trim_cache size 0 max 16384 2024-09-21T07:51:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.311+0000 7f2ad6fed740 1 Processor -- start 2024-09-21T07:51:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.311+0000 7f2ad6fed740 1 -- start start 2024-09-21T07:51:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.311+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf74500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.311+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf7e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bb5dda0 0x55b23bf6e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa800fdd0 con 0x55b23bb5dda0 2024-09-21T07:51:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa8011910 con 0x55b23bbca070 2024-09-21T07:51:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa80104a0 con 0x55b23bba9390 2024-09-21T07:51:37.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2acd800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf74500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2acd800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf74500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53418/0 (socket says 172.21.15.84:53418) 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2acd800640 1 -- 172.21.15.84:0/3260983403 learned_addr learned my addr 172.21.15.84:0/3260983403 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2acce00640 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf7e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.312+0000 7f2ace200640 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bb5dda0 0x55b23bf6e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.313+0000 7f2acd800640 1 -- 172.21.15.84:0/3260983403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 msgr2=0x55b23bf7e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.313+0000 7f2acd800640 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf7e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.313+0000 7f2acd800640 1 -- 172.21.15.84:0/3260983403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bb5dda0 msgr2=0x55b23bf6e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.313+0000 7f2acd800640 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bb5dda0 0x55b23bf6e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.313+0000 7f2acd800640 1 -- 172.21.15.84:0/3260983403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23bf68d80 con 0x55b23bba9390 2024-09-21T07:51:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.313+0000 7f2acce00640 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf7e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:51:37.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.313+0000 7f2acd800640 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf74500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2abc000c00 tx=0x7f2abc047000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5130166f162a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:37.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.314+0000 7f2aba000640 1 -- 172.21.15.84:0/3260983403 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc062070 con 0x55b23bba9390 2024-09-21T07:51:37.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.314+0000 7f2aba000640 1 -- 172.21.15.84:0/3260983403 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b23be74b50 con 0x55b23bba9390 2024-09-21T07:51:37.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.314+0000 7f2aba000640 1 -- 172.21.15.84:0/3260983403 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc037040 con 0x55b23bba9390 2024-09-21T07:51:37.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.315+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3260983403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 msgr2=0x55b23bf74500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.315+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf74500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2abc000c00 tx=0x7f2abc047000 comp rx=0 tx=0).stop 2024-09-21T07:51:37.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.315+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3260983403 shutdown_connections 2024-09-21T07:51:37.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.315+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bb5dda0 0x55b23bf6e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.315+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bbca070 0x55b23bf7e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.315+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/3260983403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bba9390 0x55b23bf74500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.315+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3260983403 >> 172.21.15.84:0/3260983403 conn(0x55b23bbbe460 msgr2=0x55b23bf73df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:37.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.316+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3260983403 shutdown_connections 2024-09-21T07:51:37.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.316+0000 7f2ad6fed740 1 -- 172.21.15.84:0/3260983403 wait complete. 2024-09-21T07:51:37.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.316+0000 7f2ad6fed740 1 -- start start 2024-09-21T07:51:37.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.317+0000 7f2ad6fed740 1 Processor -- start 2024-09-21T07:51:37.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.317+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bb5dda0 0x55b23bf91b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.317+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba9390 0x55b23bf8c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.317+0000 7f2ad6fed740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bbca070 0x55b23bf8c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.317+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa8011240 con 0x55b23bbca070 2024-09-21T07:51:37.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.317+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa8010b70 con 0x55b23bba9390 2024-09-21T07:51:37.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.317+0000 7f2ad6fed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa800dd90 con 0x55b23bb5dda0 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2ad6fed740 10 client.0 _ll_register_callbacks cb 0x7f2abc030e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba9390 0x55b23bf8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2ace200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bbca070 0x55b23bf8c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba9390 0x55b23bf8c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:44156/0 (socket says 172.21.15.84:44156) 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acce00640 1 -- 172.21.15.84:0/1207725589 learned_addr learned my addr 172.21.15.84:0/1207725589 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acd800640 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bb5dda0 0x55b23bf91b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acce00640 1 -- 172.21.15.84:0/1207725589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bb5dda0 msgr2=0x55b23bf91b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acce00640 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bb5dda0 0x55b23bf91b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acce00640 1 -- 172.21.15.84:0/1207725589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bbca070 msgr2=0x55b23bf8c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.318+0000 7f2acce00640 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bbca070 0x55b23bf8c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.319+0000 7f2acce00640 1 -- 172.21.15.84:0/1207725589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b23bf74a40 con 0x55b23bba9390 2024-09-21T07:51:37.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.319+0000 7f2acce00640 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba9390 0x55b23bf8c090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c6a0 tx=0x7f2ab40acd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f940ad5228e493 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.319+0000 7f2aaf400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.319+0000 7f2aaf400640 1 -- 172.21.15.84:0/1207725589 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab401c040 con 0x55b23bba9390 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.319+0000 7f2aaf400640 1 -- 172.21.15.84:0/1207725589 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2ab40b6a60 con 0x55b23bba9390 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.319+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b23be74b50 con 0x55b23bba9390 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.319+0000 7f2aaf400640 1 -- 172.21.15.84:0/1207725589 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ab40b1db0 con 0x55b23bba9390 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.320+0000 7f2ad6fed740 10 client.25895 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.320+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b23c0027c0 con 0x55b23bba9390 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.320+0000 7f2aaf400640 1 -- 172.21.15.84:0/1207725589 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b23be74b50 con 0x55b23bba9390 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.320+0000 7f2aaf400640 1 -- 172.21.15.84:0/1207725589 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ab40a8c20 con 0x55b23bba9390 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.320+0000 7f2ad6fed740 10 client.25895 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.320+0000 7f2ad6fed740 10 client.25895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.321+0000 7f2ad6fed740 20 client.25895 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.321+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23c002ef0 0x55b23c005310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.321+0000 7f2ad6fed740 4 client.25895 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:51:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.321+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b23bee5970 con 0x55b23c002ef0 2024-09-21T07:51:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.321+0000 7f2acd800640 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23c002ef0 0x55b23c005310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2aaf400640 10 client.25895 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2acd800640 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23c002ef0 0x55b23c005310 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d42a78f71053a6c server_cookie=68b9cd3d59bd800 in_seq=0 out_seq=0 2024-09-21T07:51:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2aaf400640 1 -- 172.21.15.84:0/1207725589 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55b23bee5970 con 0x55b23c002ef0 2024-09-21T07:51:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2aaf400640 10 client.25895 handle_command_reply: tid=0 2024-09-21T07:51:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 client.25895 shutdown 2024-09-21T07:51:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba9390 msgr2=0x55b23bf8c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba9390 0x55b23bf8c090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c6a0 tx=0x7f2ab40acd20 comp rx=0 tx=0).stop 2024-09-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 shutdown_connections 2024-09-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b23bbca070 0x55b23bf8c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b23bba9390 0x55b23bf8c090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b23c002ef0 0x55b23c005310 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 --2- 172.21.15.84:0/1207725589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b23bb5dda0 0x55b23bf91b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.322+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 >> 172.21.15.84:0/1207725589 conn(0x55b23bbbe460 msgr2=0x55b23bf6e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.323+0000 7f2aaf400640 0 client.25895 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.323+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 shutdown_connections 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.323+0000 7f2ad6fed740 1 -- 172.21.15.84:0/1207725589 wait complete. 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.323+0000 7f2ad6fed740 20 client.25895 trim_cache size 0 max 16384 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:51:37.326 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "5cf97035-fd04-41b7-9d39-d10e5b22671b", 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:51:37.327 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2ab00b6610 msgr2=0x7f2ab00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2ab00b6610 0x7f2ab00b8b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009830 tx=0x7f2abc02c040 comp rx=0 tx=0).stop 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac81092f0 msgr2=0x7f2ac819cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac81092f0 0x7f2ac819cb50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2ac806b990 tx=0x7f2ab400ee50 comp rx=0 tx=0).stop 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 shutdown_connections 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2ab00b6610 0x7f2ab00b8b20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ac8109c40 0x7f2ac81a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ac81092f0 0x7f2ac819cb50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 --2- 172.21.15.84:0/1064891108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ac81039b0 0x7f2ac819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 >> 172.21.15.84:0/1064891108 conn(0x7f2ac80ff440 msgr2=0x7f2ac8108a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 shutdown_connections 2024-09-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:37.324+0000 7f2acec00640 1 -- 172.21.15.84:0/1064891108 wait complete. 2024-09-21T07:51:37.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:37 smithi162 ceph-mon[34833]: pgmap v409: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:37 smithi191 ceph-mon[34667]: pgmap v409: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:38.111 INFO:tasks.cephfs.filesystem:scrub status for tag:5cf97035-fd04-41b7-9d39-d10e5b22671b - {'path': '/', 'tag': '5cf97035-fd04-41b7-9d39-d10e5b22671b', 'options': 'recursive,force'} 2024-09-21T07:51:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 -- 172.21.15.84:0/732743967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 msgr2=0x7f0e04109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 --2- 172.21.15.84:0/732743967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e04109670 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009860 tx=0x7f0df002a340 comp rx=0 tx=0).stop 2024-09-21T07:51:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 -- 172.21.15.84:0/732743967 shutdown_connections 2024-09-21T07:51:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 --2- 172.21.15.84:0/732743967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e04109bb0 0x7f0e041103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 --2- 172.21.15.84:0/732743967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e04109670 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 --2- 172.21.15.84:0/732743967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 0x7f0e04103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 -- 172.21.15.84:0/732743967 >> 172.21.15.84:0/732743967 conn(0x7f0e040ff390 msgr2=0x7f0e041017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 -- 172.21.15.84:0/732743967 shutdown_connections 2024-09-21T07:51:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.251+0000 7f0e03200640 1 -- 172.21.15.84:0/732743967 wait complete. 2024-09-21T07:51:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.252+0000 7f0e03200640 1 Processor -- start 2024-09-21T07:51:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.253+0000 7f0e03200640 1 -- start start 2024-09-21T07:51:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.253+0000 7f0e03200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 0x7f0e0419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.253+0000 7f0e03200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e0419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.253+0000 7f0e03200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e04109bb0 0x7f0e0419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.253+0000 7f0e03200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0e04113870 con 0x7f0e04109bb0 2024-09-21T07:51:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.253+0000 7f0e03200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041136f0 con 0x7f0e04103930 2024-09-21T07:51:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.253+0000 7f0e03200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041139f0 con 0x7f0e04109260 2024-09-21T07:51:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e0419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 0x7f0e0419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e0419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47078/0 (socket says 172.21.15.84:47078) 2024-09-21T07:51:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 0x7f0e0419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42900/0 (socket says 172.21.15.84:42900) 2024-09-21T07:51:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 -- 172.21.15.84:0/3732047115 learned_addr learned my addr 172.21.15.84:0/3732047115 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e02800640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e04109bb0 0x7f0e0419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 -- 172.21.15.84:0/3732047115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 msgr2=0x7f0e0419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 0x7f0e0419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 -- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e04109bb0 msgr2=0x7f0e0419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e04109bb0 0x7f0e0419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01400640 1 -- 172.21.15.84:0/3732047115 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e041a02a0 con 0x7f0e04109260 2024-09-21T07:51:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.254+0000 7f0e01e00640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 0x7f0e0419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.255+0000 7f0e01400640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e0419a910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0df0035040 tx=0x7f0df0032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.255+0000 7f0dfaa00640 1 -- 172.21.15.84:0/3732047115 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0037040 con 0x7f0e04109260 2024-09-21T07:51:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.255+0000 7f0dfaa00640 1 -- 172.21.15.84:0/3732047115 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df0030c10 con 0x7f0e04109260 2024-09-21T07:51:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.255+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e041a0530 con 0x7f0e04109260 2024-09-21T07:51:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.255+0000 7f0dfaa00640 1 -- 172.21.15.84:0/3732047115 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df00035f0 con 0x7f0e04109260 2024-09-21T07:51:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.255+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e041a6d20 con 0x7f0e04109260 2024-09-21T07:51:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.259+0000 7f0e1029e740 1 Processor -- start 2024-09-21T07:51:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.259+0000 7f0e1029e740 1 -- start start 2024-09-21T07:51:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b631fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6320350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b6320890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e1029e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5571b62956b0 con 0x5571b5f5a4d0 2024-09-21T07:51:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e1029e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5571b6284ae0 con 0x5571b5f522f0 2024-09-21T07:51:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e1029e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5571b62888f0 con 0x5571b5f7b1b0 2024-09-21T07:51:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e02800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b631fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e02800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b631fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47082/0 (socket says 172.21.15.84:47082) 2024-09-21T07:51:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e02800640 1 -- 172.21.15.84:0/2239897018 learned_addr learned my addr 172.21.15.84:0/2239897018 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.260+0000 7f0e01e00640 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6320350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0dfaa00640 1 -- 172.21.15.84:0/3732047115 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0df0043020 con 0x7f0e04109260 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0e02800640 1 -- 172.21.15.84:0/2239897018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 msgr2=0x5571b6320350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0e02800640 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6320350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0e02800640 1 -- 172.21.15.84:0/2239897018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 msgr2=0x5571b6320890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0e02800640 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b6320890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0e02800640 1 -- 172.21.15.84:0/2239897018 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571b6251780 con 0x5571b5f7b1b0 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0e02800640 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b631fe10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009a20 tx=0x7f0dfc0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2176ad4066f67a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.261+0000 7f0def400640 1 -- 172.21.15.84:0/2239897018 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc01d070 con 0x5571b5f7b1b0 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.262+0000 7f0def400640 1 -- 172.21.15.84:0/2239897018 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc003e40 con 0x5571b5f7b1b0 2024-09-21T07:51:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.262+0000 7f0def400640 1 -- 172.21.15.84:0/2239897018 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc018a40 con 0x5571b5f7b1b0 2024-09-21T07:51:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 -- 172.21.15.84:0/2239897018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 msgr2=0x5571b631fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b631fe10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009a20 tx=0x7f0dfc0095c0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 -- 172.21.15.84:0/2239897018 shutdown_connections 2024-09-21T07:51:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b6320890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6320350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0dfaa00640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0de80b6780 0x7f0de80b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 --2- 172.21.15.84:0/2239897018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b631fe10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 -- 172.21.15.84:0/2239897018 >> 172.21.15.84:0/2239897018 conn(0x5571b5f6f300 msgr2=0x5571b631dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0dfaa00640 1 -- 172.21.15.84:0/3732047115 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0df0106b50 con 0x7f0e04109260 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e1029e740 1 -- 172.21.15.84:0/2239897018 shutdown_connections 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.263+0000 7f0e02800640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0de80b6780 0x7f0de80b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.264+0000 7f0e1029e740 1 -- 172.21.15.84:0/2239897018 wait complete. 2024-09-21T07:51:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.264+0000 7f0e02800640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0de80b6780 0x7f0de80b8c90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0185c0 tx=0x7f0dfc000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.264+0000 7f0e1029e740 1 -- start start 2024-09-21T07:51:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 1 Processor -- start 2024-09-21T07:51:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b632b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b632b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63378b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5571b61bcab0 con 0x5571b5f522f0 2024-09-21T07:51:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5571b622b570 con 0x5571b5f7b1b0 2024-09-21T07:51:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5571b632e590 con 0x5571b5f5a4d0 2024-09-21T07:51:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.265+0000 7f0e1029e740 10 client.0 _ll_register_callbacks cb 0x5571b623a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b632b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b632b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b632b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48326/0 (socket says 172.21.15.84:48326) 2024-09-21T07:51:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01e00640 1 -- 172.21.15.84:0/839901543 learned_addr learned my addr 172.21.15.84:0/839901543 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e02800640 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01400640 1 -- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 msgr2=0x5571b63378b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01400640 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63378b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01400640 1 -- 172.21.15.84:0/839901543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 msgr2=0x5571b632b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01400640 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b632b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.266+0000 7f0e01400640 1 -- 172.21.15.84:0/839901543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571b5fe6790 con 0x5571b5f5a4d0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0e01400640 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b632b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0df0103f30 tx=0x7f0df00d5f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e421c46d394a4aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0de3e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0de3e00640 1 -- 172.21.15.84:0/839901543 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df00cc400 con 0x5571b5f5a4d0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0de3e00640 1 -- 172.21.15.84:0/839901543 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0df00c7f80 con 0x5571b5f5a4d0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5571b6297600 con 0x5571b5f5a4d0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0de3e00640 1 -- 172.21.15.84:0/839901543 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0df00cbda0 con 0x5571b5f5a4d0 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0e1029e740 10 client.25921 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.267+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571b605f620 con 0x5571b5f5a4d0 2024-09-21T07:51:39.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0de3e00640 1 -- 172.21.15.84:0/839901543 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5571b6297600 con 0x5571b5f5a4d0 2024-09-21T07:51:39.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0de3e00640 1 -- 172.21.15.84:0/839901543 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0df00c8180 con 0x5571b5f5a4d0 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0e1029e740 10 client.25921 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0e1029e740 10 client.25921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0e1029e740 20 client.25921 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0e1029e740 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f39d80 0x5571b633d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0e1029e740 4 client.25921 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.268+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571b62930b0 con 0x5571b5f39d80 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.269+0000 7f0e01e00640 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f39d80 0x5571b633d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.269+0000 7f0e01e00640 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f39d80 0x5571b633d560 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65331fe3ea1a524f server_cookie=ba3479be2d7a78c2 in_seq=0 out_seq=0 2024-09-21T07:51:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.269+0000 7f0de3e00640 10 client.25921 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.270+0000 7f0de3e00640 1 -- 172.21.15.84:0/839901543 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571b62930b0 con 0x5571b5f39d80 2024-09-21T07:51:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.270+0000 7f0de3e00640 10 client.25921 handle_command_reply: tid=0 2024-09-21T07:51:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.270+0000 7f0e1029e740 1 client.25921 shutdown 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 msgr2=0x5571b632b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b632b9d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0df0103f30 tx=0x7f0df00d5f80 comp rx=0 tx=0).stop 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 shutdown_connections 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63378b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f39d80 0x5571b633d560 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b632b9d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 --2- 172.21.15.84:0/839901543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b632b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 >> 172.21.15.84:0/839901543 conn(0x5571b5f6f300 msgr2=0x5571b6320e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0de3e00640 0 client.25921 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 shutdown_connections 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 1 -- 172.21.15.84:0/839901543 wait complete. 2024-09-21T07:51:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.271+0000 7f0e1029e740 20 client.25921 trim_cache size 0 max 16384 2024-09-21T07:51:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.292+0000 7f0e1029e740 1 Processor -- start 2024-09-21T07:51:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.292+0000 7f0e1029e740 1 -- start start 2024-09-21T07:51:39.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.292+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6321550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.292+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b63377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b6328660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e1029e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041b0b60 con 0x5571b5f5a4d0 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e1029e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041b26a0 con 0x5571b5f522f0 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e1029e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041b1230 con 0x5571b5f7b1b0 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b63377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b63377b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48336/0 (socket says 172.21.15.84:48336) 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01400640 1 -- 172.21.15.84:0/3123659567 learned_addr learned my addr 172.21.15.84:0/3123659567 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01e00640 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6321550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e02800640 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b6328660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01e00640 1 -- 172.21.15.84:0/3123659567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 msgr2=0x5571b6328660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01e00640 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b6328660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01e00640 1 -- 172.21.15.84:0/3123659567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 msgr2=0x5571b63377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.293+0000 7f0e01e00640 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b63377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.294+0000 7f0e01e00640 1 -- 172.21.15.84:0/3123659567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571b6329970 con 0x5571b5f522f0 2024-09-21T07:51:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.294+0000 7f0e01e00640 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6321550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5571b633dcd0 tx=0x7f0df4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56a76206338d08dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.294+0000 7f0deea00640 1 -- 172.21.15.84:0/3123659567 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4012d60 con 0x5571b5f522f0 2024-09-21T07:51:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.294+0000 7f0deea00640 1 -- 172.21.15.84:0/3123659567 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df40044d0 con 0x5571b5f522f0 2024-09-21T07:51:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.294+0000 7f0deea00640 1 -- 172.21.15.84:0/3123659567 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4004e00 con 0x5571b5f522f0 2024-09-21T07:51:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.295+0000 7f0e1029e740 1 -- 172.21.15.84:0/3123659567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 msgr2=0x5571b6321550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.295+0000 7f0e1029e740 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6321550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5571b633dcd0 tx=0x7f0df4005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.295+0000 7f0e1029e740 1 -- 172.21.15.84:0/3123659567 shutdown_connections 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.295+0000 7f0e1029e740 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f7b1b0 0x5571b6328660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.295+0000 7f0e1029e740 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f5a4d0 0x5571b63377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.295+0000 7f0e1029e740 1 --2- 172.21.15.84:0/3123659567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f522f0 0x5571b6321550 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.295+0000 7f0e1029e740 1 -- 172.21.15.84:0/3123659567 >> 172.21.15.84:0/3123659567 conn(0x5571b5f6f300 msgr2=0x5571b6320e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.296+0000 7f0e1029e740 1 -- 172.21.15.84:0/3123659567 shutdown_connections 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.296+0000 7f0e1029e740 1 -- 172.21.15.84:0/3123659567 wait complete. 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.296+0000 7f0e1029e740 1 -- start start 2024-09-21T07:51:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.296+0000 7f0e1029e740 1 Processor -- start 2024-09-21T07:51:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b6330ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b6331430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e1029e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e1029e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041b1fd0 con 0x5571b5f522f0 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e1029e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041b1900 con 0x5571b5f7b1b0 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e1029e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0e041aeb20 con 0x5571b5f5a4d0 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e1029e740 10 client.0 _ll_register_callbacks cb 0x7f0df0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e01e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b6330ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e01e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b6330ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48342/0 (socket says 172.21.15.84:48342) 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e01e00640 1 -- 172.21.15.84:0/561343058 learned_addr learned my addr 172.21.15.84:0/561343058 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e01400640 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b6331430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.297+0000 7f0e02800640 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.298+0000 7f0e01e00640 1 -- 172.21.15.84:0/561343058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 msgr2=0x5571b6331430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.298+0000 7f0e01e00640 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b6331430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.298+0000 7f0e01e00640 1 -- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 msgr2=0x5571b63a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.298+0000 7f0e01e00640 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.298+0000 7f0e01e00640 1 -- 172.21.15.84:0/561343058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571b63a64a0 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.298+0000 7f0e01e00640 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b6330ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0df4012110 tx=0x7f0df4012140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896c15068802bfe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.298+0000 7f0de3e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.299+0000 7f0de3e00640 1 -- 172.21.15.84:0/561343058 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4035020 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.299+0000 7f0de3e00640 1 -- 172.21.15.84:0/561343058 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0df4012b60 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.299+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0df40044d0 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.299+0000 7f0de3e00640 1 -- 172.21.15.84:0/561343058 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0df4040050 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.299+0000 7f0e1029e740 10 client.15948 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.299+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571b63a7700 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.299+0000 7f0de3e00640 1 -- 172.21.15.84:0/561343058 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df40044d0 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0de3e00640 1 -- 172.21.15.84:0/561343058 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0df4003710 con 0x5571b5f522f0 2024-09-21T07:51:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0e1029e740 10 client.15948 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0e1029e740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0e1029e740 20 client.15948 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0e1029e740 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f0f1c0 0x5571b63a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0e1029e740 4 client.15948 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5571b62904e0 con 0x5571b5f0f1c0 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.300+0000 7f0e01400640 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f0f1c0 0x5571b63a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.301+0000 7f0e01400640 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f0f1c0 0x5571b63a9e10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6484d2f206587f4e server_cookie=f05faaa2effc84d1 in_seq=0 out_seq=0 2024-09-21T07:51:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.301+0000 7f0de3e00640 10 client.15948 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.309+0000 7f0de3e00640 1 -- 172.21.15.84:0/561343058 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5571b62904e0 con 0x5571b5f0f1c0 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.309+0000 7f0de3e00640 10 client.15948 handle_command_reply: tid=0 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.309+0000 7f0e1029e740 1 client.15948 shutdown 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.309+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 msgr2=0x5571b6330ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.309+0000 7f0e1029e740 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b6330ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0df4012110 tx=0x7f0df4012140 comp rx=0 tx=0).stop 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 shutdown_connections 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571b5f7b1b0 0x5571b63a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5571b5f0f1c0 0x5571b63a9e10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5571b5f5a4d0 0x5571b6331430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 --2- 172.21.15.84:0/561343058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5571b5f522f0 0x5571b6330ef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 >> 172.21.15.84:0/561343058 conn(0x5571b5f6f300 msgr2=0x5571b6320d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0de3e00640 0 client.15948 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 shutdown_connections 2024-09-21T07:51:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 1 -- 172.21.15.84:0/561343058 wait complete. 2024-09-21T07:51:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.310+0000 7f0e1029e740 20 client.15948 trim_cache size 0 max 16384 2024-09-21T07:51:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:51:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:51:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:51:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0de80b6780 msgr2=0x7f0de80b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0de80b6780 0x7f0de80b8c90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0185c0 tx=0x7f0dfc000f40 comp rx=0 tx=0).stop 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 msgr2=0x7f0e0419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e0419a910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0df0035040 tx=0x7f0df0032d50 comp rx=0 tx=0).stop 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 shutdown_connections 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0de80b6780 0x7f0de80b8c90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e04109bb0 0x7f0e0419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e04109260 0x7f0e0419a910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 --2- 172.21.15.84:0/3732047115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e04103930 0x7f0e0419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.311+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 >> 172.21.15.84:0/3732047115 conn(0x7f0e040ff390 msgr2=0x7f0e041017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.312+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 shutdown_connections 2024-09-21T07:51:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:39.312+0000 7f0e03200640 1 -- 172.21.15.84:0/3732047115 wait complete. 2024-09-21T07:51:39.456 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:39 smithi191 ceph-mon[34667]: pgmap v410: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T07:51:39.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:39 smithi162 ceph-mon[34833]: pgmap v410: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T07:51:39.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:39 smithi084 ceph-mon[30411]: pgmap v410: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T07:51:41.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:41 smithi162 ceph-mon[34833]: pgmap v411: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:41 smithi084 ceph-mon[30411]: pgmap v411: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:41 smithi191 ceph-mon[34667]: pgmap v411: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-21T07:51:41.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:51:42.227 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 -- 172.21.15.84:0/1627641895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec1092f0 msgr2=0x7fdcec109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 --2- 172.21.15.84:0/1627641895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec1092f0 0x7fdcec109700 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009900 tx=0x7fdcd802a400 comp rx=0 tx=0).stop 2024-09-21T07:51:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 -- 172.21.15.84:0/1627641895 shutdown_connections 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 --2- 172.21.15.84:0/1627641895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcec109c40 0x7fdcec110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 --2- 172.21.15.84:0/1627641895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec1092f0 0x7fdcec109700 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 --2- 172.21.15.84:0/1627641895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdcec1039b0 0x7fdcec103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 -- 172.21.15.84:0/1627641895 >> 172.21.15.84:0/1627641895 conn(0x7fdcec0ff440 msgr2=0x7fdcec101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 -- 172.21.15.84:0/1627641895 shutdown_connections 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.933+0000 7fdceb200640 1 -- 172.21.15.84:0/1627641895 wait complete. 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.935+0000 7fdceb200640 1 Processor -- start 2024-09-21T07:51:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.935+0000 7fdceb200640 1 -- start start 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdceb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcec1039b0 0x7fdcec19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdceb200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdcec1092f0 0x7fdcec19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdceb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec109c40 0x7fdcec1a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdceb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec113950 con 0x7fdcec109c40 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdceb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec1137d0 con 0x7fdcec1039b0 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdceb200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec113ad0 con 0x7fdcec1092f0 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdcea800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec109c40 0x7fdcec1a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.936+0000 7fdce9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcec1039b0 0x7fdcec19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdcea800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec109c40 0x7fdcec1a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48356/0 (socket says 172.21.15.84:48356) 2024-09-21T07:51:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdcea800640 1 -- 172.21.15.84:0/1479963144 learned_addr learned my addr 172.21.15.84:0/1479963144 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdcea800640 1 -- 172.21.15.84:0/1479963144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdcec1092f0 msgr2=0x7fdcec19cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdce9400640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdcec1092f0 0x7fdcec19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdcea800640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdcec1092f0 0x7fdcec19cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdcea800640 1 -- 172.21.15.84:0/1479963144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcec1039b0 msgr2=0x7fdcec19c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:42.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdcea800640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcec1039b0 0x7fdcec19c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:42.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdcea800640 1 -- 172.21.15.84:0/1479963144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcec1a2490 con 0x7fdcec109c40 2024-09-21T07:51:42.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.937+0000 7fdce9400640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdcec1092f0 0x7fdcec19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:51:42.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.938+0000 7fdce9e00640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcec1039b0 0x7fdcec19c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:42.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.938+0000 7fdcea800640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec109c40 0x7fdcec1a1d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdce400eb10 tx=0x7fdce400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:42.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.939+0000 7fdce2a00640 1 -- 172.21.15.84:0/1479963144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4004b20 con 0x7fdcec109c40 2024-09-21T07:51:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.939+0000 7fdce2a00640 1 -- 172.21.15.84:0/1479963144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce4004cc0 con 0x7fdcec109c40 2024-09-21T07:51:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.939+0000 7fdce2a00640 1 -- 172.21.15.84:0/1479963144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4010670 con 0x7fdcec109c40 2024-09-21T07:51:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.939+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcec1a2780 con 0x7fdcec109c40 2024-09-21T07:51:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.939+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcec1a8ee0 con 0x7fdcec109c40 2024-09-21T07:51:42.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.941+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcec103dc0 con 0x7fdcec109c40 2024-09-21T07:51:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.946+0000 7fdce2a00640 1 -- 172.21.15.84:0/1479963144 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fdce4005000 con 0x7fdcec109c40 2024-09-21T07:51:42.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.949+0000 7fdce2a00640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdcd00b67d0 0x7fdcd00b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:42.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.949+0000 7fdce2a00640 1 -- 172.21.15.84:0/1479963144 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fdce40e81a0 con 0x7fdcec109c40 2024-09-21T07:51:42.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.949+0000 7fdce9e00640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdcd00b67d0 0x7fdcd00b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:42.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.950+0000 7fdce9e00640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdcd00b67d0 0x7fdcd00b8ce0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009fc0 tx=0x7fdcdc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:42.952+0000 7fdce2a00640 1 -- 172.21.15.84:0/1479963144 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdce4056710 con 0x7fdcec109c40 2024-09-21T07:51:43.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:43 smithi084 ceph-mon[30411]: pgmap v412: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T07:51:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.414+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcec19d650 con 0x7fdcec109c40 2024-09-21T07:51:43.418 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:51:43.418 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:51:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.415+0000 7fdce2a00640 1 -- 172.21.15.84:0/1479963144 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fdcec19d650 con 0x7fdcec109c40 2024-09-21T07:51:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:51:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdcd00b67d0 msgr2=0x7fdcd00b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdcd00b67d0 0x7fdcd00b8ce0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009fc0 tx=0x7fdcdc005f90 comp rx=0 tx=0).stop 2024-09-21T07:51:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec109c40 msgr2=0x7fdcec1a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec109c40 0x7fdcec1a1d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdce400eb10 tx=0x7fdce400c2d0 comp rx=0 tx=0).stop 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 shutdown_connections 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdcd00b67d0 0x7fdcd00b8ce0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcec109c40 0x7fdcec1a1d60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdcec1092f0 0x7fdcec19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 --2- 172.21.15.84:0/1479963144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcec1039b0 0x7fdcec19c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.419+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 >> 172.21.15.84:0/1479963144 conn(0x7fdcec0ff440 msgr2=0x7fdcec106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.420+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 shutdown_connections 2024-09-21T07:51:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:43.420+0000 7fdceb200640 1 -- 172.21.15.84:0/1479963144 wait complete. 2024-09-21T07:51:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:43 smithi162 ceph-mon[34833]: pgmap v412: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T07:51:43.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:43 smithi191 ceph-mon[34667]: pgmap v412: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T07:51:44.340 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 9c9b1bd9 --release --await' 2024-09-21T07:51:44.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 9c9b1bd9 --release --await 2024-09-21T07:51:44.511 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:44 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1479963144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:44.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:44 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1479963144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:44.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:44 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1479963144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:51:44.793 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:51:45.257 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:45 smithi084 ceph-mon[30411]: pgmap v413: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T07:51:45.453 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:45 smithi162 ceph-mon[34833]: pgmap v413: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T07:51:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.576+0000 7efc25400640 1 -- 172.21.15.84:0/2857611653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc20076100 msgr2=0x7efc2010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.576+0000 7efc25400640 1 --2- 172.21.15.84:0/2857611653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc20076100 0x7efc2010f9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009900 tx=0x7efc0c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.576+0000 7efc25400640 1 -- 172.21.15.84:0/2857611653 shutdown_connections 2024-09-21T07:51:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.576+0000 7efc25400640 1 --2- 172.21.15.84:0/2857611653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc2010ff10 0x7efc20112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.576+0000 7efc25400640 1 --2- 172.21.15.84:0/2857611653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc20076100 0x7efc2010f9d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.576+0000 7efc25400640 1 --2- 172.21.15.84:0/2857611653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc200757b0 0x7efc20075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.576+0000 7efc25400640 1 -- 172.21.15.84:0/2857611653 >> 172.21.15.84:0/2857611653 conn(0x7efc200ff440 msgr2=0x7efc20101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.577+0000 7efc25400640 1 -- 172.21.15.84:0/2857611653 shutdown_connections 2024-09-21T07:51:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.578+0000 7efc25400640 1 -- 172.21.15.84:0/2857611653 wait complete. 2024-09-21T07:51:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.579+0000 7efc25400640 1 Processor -- start 2024-09-21T07:51:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.580+0000 7efc25400640 1 -- start start 2024-09-21T07:51:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.580+0000 7efc25400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc200757b0 0x7efc2019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc25400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc20076100 0x7efc2019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc25400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc2010ff10 0x7efc201a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc25400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc20115ac0 con 0x7efc20076100 2024-09-21T07:51:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc25400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc20115940 con 0x7efc200757b0 2024-09-21T07:51:45.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc25400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efc20115c40 con 0x7efc2010ff10 2024-09-21T07:51:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc1fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc200757b0 0x7efc2019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc20076100 0x7efc2019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.581+0000 7efc1fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc200757b0 0x7efc2019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42968/0 (socket says 172.21.15.84:42968) 2024-09-21T07:51:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.582+0000 7efc1fe00640 1 -- 172.21.15.84:0/3090801615 learned_addr learned my addr 172.21.15.84:0/3090801615 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.582+0000 7efc1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc20076100 0x7efc2019ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48374/0 (socket says 172.21.15.84:48374) 2024-09-21T07:51:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.583+0000 7efc24a00640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc2010ff10 0x7efc201a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.584+0000 7efc1fe00640 1 -- 172.21.15.84:0/3090801615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc2010ff10 msgr2=0x7efc201a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.584+0000 7efc1fe00640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc2010ff10 0x7efc201a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.584+0000 7efc1fe00640 1 -- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc20076100 msgr2=0x7efc2019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.585+0000 7efc1fe00640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc20076100 0x7efc2019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.585+0000 7efc1fe00640 1 -- 172.21.15.84:0/3090801615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc201a2460 con 0x7efc200757b0 2024-09-21T07:51:45.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.585+0000 7efc1f400640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc20076100 0x7efc2019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:45.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.586+0000 7efc1fe00640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc200757b0 0x7efc2019c4f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc1000ea60 tx=0x7efc1000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:45.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.586+0000 7efc1cc00640 1 -- 172.21.15.84:0/3090801615 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1000cde0 con 0x7efc200757b0 2024-09-21T07:51:45.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.586+0000 7efc1cc00640 1 -- 172.21.15.84:0/3090801615 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc100035f0 con 0x7efc200757b0 2024-09-21T07:51:45.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.586+0000 7efc1cc00640 1 -- 172.21.15.84:0/3090801615 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10010690 con 0x7efc200757b0 2024-09-21T07:51:45.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.586+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201a2750 con 0x7efc200757b0 2024-09-21T07:51:45.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.587+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc201a8eb0 con 0x7efc200757b0 2024-09-21T07:51:45.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.591+0000 7efc2d652740 1 Processor -- start 2024-09-21T07:51:45.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.592+0000 7efc2d652740 1 -- start start 2024-09-21T07:51:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.592+0000 7efc1cc00640 1 -- 172.21.15.84:0/3090801615 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7efc10010830 con 0x7efc200757b0 2024-09-21T07:51:45.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc2d652740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef356b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc2d652740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef7e660 0x55f6ef357090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc2d652740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef3575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc2d652740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f6ef2c5290 con 0x55f6eef86840 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc2d652740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f6ef2b46c0 con 0x55f6eefa7520 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc2d652740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f6ef2b84d0 con 0x55f6eef7e660 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc24a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef356b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc24a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef356b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:42982/0 (socket says 172.21.15.84:42982) 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.593+0000 7efc24a00640 1 -- 172.21.15.84:0/1237559486 learned_addr learned my addr 172.21.15.84:0/1237559486 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.594+0000 7efc24a00640 1 -- 172.21.15.84:0/1237559486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef7e660 msgr2=0x55f6ef357090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.594+0000 7efc24a00640 1 --2- 172.21.15.84:0/1237559486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef7e660 0x55f6ef357090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.594+0000 7efc24a00640 1 -- 172.21.15.84:0/1237559486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 msgr2=0x55f6ef3575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.594+0000 7efc24a00640 1 --2- 172.21.15.84:0/1237559486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef3575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.594+0000 7efc24a00640 1 -- 172.21.15.84:0/1237559486 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ef241460 con 0x55f6eefa7520 2024-09-21T07:51:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.594+0000 7efc24a00640 1 --2- 172.21.15.84:0/1237559486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef356b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc18010370 tx=0x7efc18010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dece499bf75f766 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.595+0000 7efc15200640 1 -- 172.21.15.84:0/1237559486 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18016070 con 0x55f6eefa7520 2024-09-21T07:51:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.595+0000 7efc15200640 1 -- 172.21.15.84:0/1237559486 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc18004d20 con 0x55f6eefa7520 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.596+0000 7efc1cc00640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efc040b6780 0x7efc040b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.596+0000 7efc15200640 1 -- 172.21.15.84:0/1237559486 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18005420 con 0x55f6eefa7520 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.597+0000 7efc1cc00640 1 -- 172.21.15.84:0/3090801615 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7efc100e7cd0 con 0x7efc200757b0 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc2d652740 1 -- 172.21.15.84:0/1237559486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 msgr2=0x55f6ef356b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc2d652740 1 --2- 172.21.15.84:0/1237559486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef356b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc18010370 tx=0x7efc18010830 comp rx=0 tx=0).stop 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc1fe00640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efc040b6780 0x7efc040b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc2d652740 1 -- 172.21.15.84:0/1237559486 shutdown_connections 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc2d652740 1 --2- 172.21.15.84:0/1237559486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef3575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc2d652740 1 --2- 172.21.15.84:0/1237559486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef7e660 0x55f6ef357090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc2d652740 1 --2- 172.21.15.84:0/1237559486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef356b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.598+0000 7efc2d652740 1 -- 172.21.15.84:0/1237559486 >> 172.21.15.84:0/1237559486 conn(0x55f6eef9b910 msgr2=0x55f6ef354a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:45.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.599+0000 7efc2d652740 1 -- 172.21.15.84:0/1237559486 shutdown_connections 2024-09-21T07:51:45.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.599+0000 7efc1fe00640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efc040b6780 0x7efc040b8c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f6ef3557d0 tx=0x7efc10009540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:45.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.599+0000 7efc2d652740 1 -- 172.21.15.84:0/1237559486 wait complete. 2024-09-21T07:51:45.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.600+0000 7efc2d652740 1 -- start start 2024-09-21T07:51:45.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.601+0000 7efc2d652740 1 Processor -- start 2024-09-21T07:51:45.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc2d652740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef7e660 0x55f6ef3626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc2d652740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef86840 0x55f6ef362bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc2d652740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef36e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc2d652740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f6ef115bb0 con 0x55f6eef7e660 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc2d652740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f6ef24f6c0 con 0x55f6eefa7520 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc2d652740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f6ef365330 con 0x55f6eef86840 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc2d652740 10 client.0 _ll_register_callbacks cb 0x55f6ef26a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc1f400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef86840 0x55f6ef362bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc1f400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef86840 0x55f6ef362bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47178/0 (socket says 172.21.15.84:47178) 2024-09-21T07:51:45.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.602+0000 7efc1f400640 1 -- 172.21.15.84:0/1285261435 learned_addr learned my addr 172.21.15.84:0/1285261435 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:45.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.603+0000 7efc24a00640 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef36e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.603+0000 7efc24a00640 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef7e660 0x55f6ef3626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.603+0000 7efc1f400640 1 -- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 msgr2=0x55f6ef36e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.603+0000 7efc1f400640 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef36e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.603+0000 7efc1f400640 1 -- 172.21.15.84:0/1285261435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef7e660 msgr2=0x55f6ef3626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.603+0000 7efc1f400640 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef7e660 0x55f6ef3626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.603+0000 7efc1f400640 1 -- 172.21.15.84:0/1285261435 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ef012b00 con 0x55f6eef86840 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.604+0000 7efc09600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:51:45.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.604+0000 7efc1f400640 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef86840 0x55f6ef362bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc2006b700 tx=0x7efc0c0316d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b62366b1c3cb8d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:45.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.605+0000 7efc09600640 1 -- 172.21.15.84:0/1285261435 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c040070 con 0x55f6eef86840 2024-09-21T07:51:45.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.605+0000 7efc09600640 1 -- 172.21.15.84:0/1285261435 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7efc0c004240 con 0x55f6eef86840 2024-09-21T07:51:45.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.605+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc18004d20 con 0x55f6eef86840 2024-09-21T07:51:45.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.607+0000 7efc09600640 1 -- 172.21.15.84:0/1285261435 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efc0c035040 con 0x55f6eef86840 2024-09-21T07:51:45.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.607+0000 7efc2d652740 10 client.25939 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:45.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.607+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f6ef089960 con 0x55f6eef86840 2024-09-21T07:51:45.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.607+0000 7efc09600640 1 -- 172.21.15.84:0/1285261435 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc18004d20 con 0x55f6eef86840 2024-09-21T07:51:45.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.607+0000 7efc09600640 1 -- 172.21.15.84:0/1285261435 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efc0c004a40 con 0x55f6eef86840 2024-09-21T07:51:45.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.608+0000 7efc2d652740 10 client.25939 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:45.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.608+0000 7efc2d652740 10 client.25939 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:51:45.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.608+0000 7efc2d652740 20 client.25939 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:45.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.608+0000 7efc2d652740 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef65ea0 0x55f6ef374660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.608+0000 7efc2d652740 4 client.25939 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:45.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.608+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6ef2c71e0 con 0x55f6eef65ea0 2024-09-21T07:51:45.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.609+0000 7efc24a00640 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef65ea0 0x55f6ef374660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.610+0000 7efc24a00640 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef65ea0 0x55f6ef374660 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad703f2892c6ba4d server_cookie=2bd50c3130d3496c in_seq=0 out_seq=0 2024-09-21T07:51:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.610+0000 7efc09600640 10 client.25939 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:45.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.611+0000 7efc09600640 1 -- 172.21.15.84:0/1285261435 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6ef2c71e0 con 0x55f6eef65ea0 2024-09-21T07:51:45.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.611+0000 7efc09600640 10 client.25939 handle_command_reply: tid=0 2024-09-21T07:51:45.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.611+0000 7efc2d652740 1 client.25939 shutdown 2024-09-21T07:51:45.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.611+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef86840 msgr2=0x55f6ef362bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.611+0000 7efc2d652740 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef86840 0x55f6ef362bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc2006b700 tx=0x7efc0c0316d0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.612+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 shutdown_connections 2024-09-21T07:51:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.612+0000 7efc2d652740 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eefa7520 0x55f6ef36e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.612+0000 7efc2d652740 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef65ea0 0x55f6ef374660 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.612+0000 7efc2d652740 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eef86840 0x55f6ef362bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.612+0000 7efc09600640 0 client.25939 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.612+0000 7efc2d652740 1 --2- 172.21.15.84:0/1285261435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef7e660 0x55f6ef3626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.612+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 >> 172.21.15.84:0/1285261435 conn(0x55f6eef9b910 msgr2=0x55f6ef355b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:45.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.613+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 shutdown_connections 2024-09-21T07:51:45.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.613+0000 7efc2d652740 1 -- 172.21.15.84:0/1285261435 wait complete. 2024-09-21T07:51:45.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.613+0000 7efc2d652740 20 client.25939 trim_cache size 0 max 16384 2024-09-21T07:51:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.648+0000 7efc2d652740 1 Processor -- start 2024-09-21T07:51:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.649+0000 7efc2d652740 1 -- start start 2024-09-21T07:51:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.649+0000 7efc2d652740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef360d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.649+0000 7efc2d652740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef361270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.649+0000 7efc2d652740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef36e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.649+0000 7efc2d652740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc201aeaa0 con 0x55f6eef86840 2024-09-21T07:51:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.649+0000 7efc2d652740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc201b05e0 con 0x55f6eef7e660 2024-09-21T07:51:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.649+0000 7efc2d652740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efc201af170 con 0x55f6eefa7520 2024-09-21T07:51:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef361270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef361270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48392/0 (socket says 172.21.15.84:48392) 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc1f400640 1 -- 172.21.15.84:0/1927533774 learned_addr learned my addr 172.21.15.84:0/1927533774 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc24a00640 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef360d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc24a00640 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef36e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc24a00640 1 -- 172.21.15.84:0/1927533774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 msgr2=0x55f6ef36e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc24a00640 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef36e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc24a00640 1 -- 172.21.15.84:0/1927533774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 msgr2=0x55f6ef361270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc24a00640 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef361270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.650+0000 7efc24a00640 1 -- 172.21.15.84:0/1927533774 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ef362d90 con 0x55f6eef7e660 2024-09-21T07:51:45.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.651+0000 7efc24a00640 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef360d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55f6ef374dd0 tx=0x7efc18009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00821b36b9c0ead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.651+0000 7efc0be00640 1 -- 172.21.15.84:0/1927533774 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18016040 con 0x55f6eef7e660 2024-09-21T07:51:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.651+0000 7efc0be00640 1 -- 172.21.15.84:0/1927533774 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc18012ae0 con 0x55f6eef7e660 2024-09-21T07:51:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.651+0000 7efc0be00640 1 -- 172.21.15.84:0/1927533774 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18005610 con 0x55f6eef7e660 2024-09-21T07:51:45.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:45 smithi191 ceph-mon[34667]: pgmap v413: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 -- 172.21.15.84:0/1927533774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 msgr2=0x55f6ef360d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef360d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55f6ef374dd0 tx=0x7efc18009600 comp rx=0 tx=0).stop 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 -- 172.21.15.84:0/1927533774 shutdown_connections 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef36e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef361270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 --2- 172.21.15.84:0/1927533774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef360d30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 -- 172.21.15.84:0/1927533774 >> 172.21.15.84:0/1927533774 conn(0x55f6eef9b910 msgr2=0x55f6ef3543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 -- 172.21.15.84:0/1927533774 shutdown_connections 2024-09-21T07:51:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.653+0000 7efc2d652740 1 -- 172.21.15.84:0/1927533774 wait complete. 2024-09-21T07:51:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.654+0000 7efc2d652740 1 -- start start 2024-09-21T07:51:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.654+0000 7efc2d652740 1 Processor -- start 2024-09-21T07:51:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.655+0000 7efc2d652740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef3659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.655+0000 7efc2d652740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef365f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.655+0000 7efc2d652740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef3df060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.655+0000 7efc2d652740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc201aff10 con 0x55f6eef86840 2024-09-21T07:51:45.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.655+0000 7efc2d652740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc201af840 con 0x55f6eef7e660 2024-09-21T07:51:45.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.655+0000 7efc2d652740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efc201acac0 con 0x55f6eefa7520 2024-09-21T07:51:45.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.655+0000 7efc2d652740 10 client.0 _ll_register_callbacks cb 0x7efc0c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:45.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.656+0000 7efc1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef365f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.656+0000 7efc24a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef3df060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.656+0000 7efc24a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef3659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.656+0000 7efc24a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef3659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43012/0 (socket says 172.21.15.84:43012) 2024-09-21T07:51:45.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.656+0000 7efc24a00640 1 -- 172.21.15.84:0/2267401517 learned_addr learned my addr 172.21.15.84:0/2267401517 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:45.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.657+0000 7efc1f400640 1 -- 172.21.15.84:0/2267401517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 msgr2=0x55f6ef3df060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:45.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.657+0000 7efc1f400640 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef3df060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.657+0000 7efc1f400640 1 -- 172.21.15.84:0/2267401517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 msgr2=0x55f6ef3659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:45.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.657+0000 7efc1f400640 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef3659f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.657+0000 7efc1f400640 1 -- 172.21.15.84:0/2267401517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ef3593e0 con 0x55f6eef86840 2024-09-21T07:51:45.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.658+0000 7efc1f400640 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef365f30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efc0c001eb0 tx=0x7efc0c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97ec0933b3294b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.659+0000 7efc09600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.659+0000 7efc09600640 1 -- 172.21.15.84:0/2267401517 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c040070 con 0x55f6eef86840 2024-09-21T07:51:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.659+0000 7efc09600640 1 -- 172.21.15.84:0/2267401517 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7efc0c0051b0 con 0x55f6eef86840 2024-09-21T07:51:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.659+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc18012ae0 con 0x55f6eef86840 2024-09-21T07:51:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.659+0000 7efc09600640 1 -- 172.21.15.84:0/2267401517 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efc0c055040 con 0x55f6eef86840 2024-09-21T07:51:45.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.659+0000 7efc2d652740 10 client.15969 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.659+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f6ef3e0490 con 0x55f6eef86840 2024-09-21T07:51:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc09600640 1 -- 172.21.15.84:0/2267401517 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc18012ae0 con 0x55f6eef86840 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc09600640 1 -- 172.21.15.84:0/2267401517 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7efc0c0459e0 con 0x55f6eef86840 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc2d652740 10 client.15969 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc2d652740 10 client.15969 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc2d652740 20 client.15969 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc2d652740 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef3b250 0x55f6ef3e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc2d652740 4 client.15969 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9c9b1bd9", "release": true, "await": true}] 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.660+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9c9b1bd9", "release": true, "await": true}) -- 0x55f6ef2c2c90 con 0x55f6eef3b250 2024-09-21T07:51:45.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.661+0000 7efc24a00640 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef3b250 0x55f6ef3e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:45.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.661+0000 7efc09600640 10 client.15969 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:45.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.662+0000 7efc24a00640 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef3b250 0x55f6ef3e2c30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a24b978d9a2133 server_cookie=a4a59d4ad75f4d1c in_seq=0 out_seq=0 2024-09-21T07:51:45.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.665+0000 7efc09600640 1 -- 172.21.15.84:0/2267401517 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55f6ef2c2c90 con 0x55f6eef3b250 2024-09-21T07:51:45.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.665+0000 7efc09600640 10 client.15969 handle_command_reply: tid=0 2024-09-21T07:51:45.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.665+0000 7efc2d652740 1 client.15969 shutdown 2024-09-21T07:51:45.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.665+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 msgr2=0x55f6ef365f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.665+0000 7efc2d652740 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef365f30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efc0c001eb0 tx=0x7efc0c031400 comp rx=0 tx=0).stop 2024-09-21T07:51:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.666+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 shutdown_connections 2024-09-21T07:51:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.666+0000 7efc2d652740 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f6eef3b250 0x55f6ef3e2c30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.666+0000 7efc2d652740 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f6eefa7520 0x55f6ef3df060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.666+0000 7efc2d652740 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6eef86840 0x55f6ef365f30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.666+0000 7efc2d652740 1 --2- 172.21.15.84:0/2267401517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6eef7e660 0x55f6ef3659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.666+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 >> 172.21.15.84:0/2267401517 conn(0x55f6eef9b910 msgr2=0x55f6ef354380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.666+0000 7efc09600640 0 client.15969 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:45.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.667+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 shutdown_connections 2024-09-21T07:51:45.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.667+0000 7efc2d652740 1 -- 172.21.15.84:0/2267401517 wait complete. 2024-09-21T07:51:45.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.667+0000 7efc2d652740 20 client.15969 trim_cache size 0 max 16384 2024-09-21T07:51:45.670 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 4, 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "9c9b1bd9": { 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 4, 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:51:45.671 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 134.5, 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:45.672 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:45.673 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:45.673 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:51:45.673 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:51:45.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.668+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efc040b6780 msgr2=0x7efc040b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.668+0000 7efc25400640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efc040b6780 0x7efc040b8c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f6ef3557d0 tx=0x7efc10009540 comp rx=0 tx=0).stop 2024-09-21T07:51:45.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.668+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc200757b0 msgr2=0x7efc2019c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.668+0000 7efc25400640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc200757b0 0x7efc2019c4f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc1000ea60 tx=0x7efc1000ef20 comp rx=0 tx=0).stop 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.669+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 shutdown_connections 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.669+0000 7efc25400640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7efc040b6780 0x7efc040b8c90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.669+0000 7efc25400640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc2010ff10 0x7efc201a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.669+0000 7efc25400640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc20076100 0x7efc2019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.669+0000 7efc25400640 1 --2- 172.21.15.84:0/3090801615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc200757b0 0x7efc2019c4f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.669+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 >> 172.21.15.84:0/3090801615 conn(0x7efc200ff440 msgr2=0x7efc20109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.669+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 shutdown_connections 2024-09-21T07:51:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:51:45.670+0000 7efc25400640 1 -- 172.21.15.84:0/3090801615 wait complete. 2024-09-21T07:51:46.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:46 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:46.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:46 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:46.625 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9c9b1bd9', total seconds elapsed: 19.3 2024-09-21T07:51:46.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:46 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:47.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:47 smithi162 ceph-mon[34833]: pgmap v414: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-21T07:51:47.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:47 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:47.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:47 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:47.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:47 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:51:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:47 smithi084 ceph-mon[30411]: pgmap v414: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-21T07:51:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:47 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:47 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:47.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:47 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:51:47.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:47 smithi191 ceph-mon[34667]: pgmap v414: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-21T07:51:47.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:47 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:47.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:47 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:47.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:47 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:51:48.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:48 smithi162 ceph-mon[34833]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T07:51:48.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:48 smithi084 ceph-mon[30411]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T07:51:48.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:48 smithi191 ceph-mon[34667]: pgmap v415: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-21T07:51:49.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:49 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:51:49.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:49 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:51:49.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:49 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:51:50.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:50 smithi162 ceph-mon[34833]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-21T07:51:50.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:50 smithi084 ceph-mon[30411]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-21T07:51:50.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:50 smithi191 ceph-mon[34667]: pgmap v416: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.541+0000 7f6506a00640 1 -- 172.21.15.84:0/4179545308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109b90 msgr2=0x7f65001103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.541+0000 7f6506a00640 1 --2- 172.21.15.84:0/4179545308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109b90 0x7f65001103c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009ca0 tx=0x7f64f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.541+0000 7f6506a00640 1 -- 172.21.15.84:0/4179545308 shutdown_connections 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.541+0000 7f6506a00640 1 --2- 172.21.15.84:0/4179545308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109b90 0x7f65001103c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.541+0000 7f6506a00640 1 --2- 172.21.15.84:0/4179545308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6500109240 0x7f6500109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.541+0000 7f6506a00640 1 --2- 172.21.15.84:0/4179545308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 0x7f6500103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.541+0000 7f6506a00640 1 -- 172.21.15.84:0/4179545308 >> 172.21.15.84:0/4179545308 conn(0x7f65000ff330 msgr2=0x7f6500101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.542+0000 7f6506a00640 1 -- 172.21.15.84:0/4179545308 shutdown_connections 2024-09-21T07:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.542+0000 7f6506a00640 1 -- 172.21.15.84:0/4179545308 wait complete. 2024-09-21T07:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 Processor -- start 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 -- start start 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 0x7f650019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109240 0x7f650019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6500109b90 0x7f65001a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f65001138a0 con 0x7f6500109240 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6500113720 con 0x7f6500103910 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.543+0000 7f6506a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6500113a20 con 0x7f6500109b90 2024-09-21T07:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6505600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 0x7f650019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6505600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 0x7f650019c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59438/0 (socket says 172.21.15.84:59438) 2024-09-21T07:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6504c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109240 0x7f650019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6505600640 1 -- 172.21.15.84:0/1698320552 learned_addr learned my addr 172.21.15.84:0/1698320552 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6506000640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6500109b90 0x7f65001a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6504c00640 1 -- 172.21.15.84:0/1698320552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6500109b90 msgr2=0x7f65001a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6504c00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6500109b90 0x7f65001a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6504c00640 1 -- 172.21.15.84:0/1698320552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 msgr2=0x7f650019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6504c00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 0x7f650019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.544+0000 7f6504c00640 1 -- 172.21.15.84:0/1698320552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65001a2350 con 0x7f6500109240 2024-09-21T07:51:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.545+0000 7f6505600640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 0x7f650019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.545+0000 7f6504c00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109240 0x7f650019c9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f650006c690 tx=0x7f64ec00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.545+0000 7f64fe000640 1 -- 172.21.15.84:0/1698320552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00cc40 con 0x7f6500109240 2024-09-21T07:51:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.545+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65001a2640 con 0x7f6500109240 2024-09-21T07:51:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.545+0000 7f64fe000640 1 -- 172.21.15.84:0/1698320552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64ec00cde0 con 0x7f6500109240 2024-09-21T07:51:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.545+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65001a8dd0 con 0x7f6500109240 2024-09-21T07:51:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.545+0000 7f64fe000640 1 -- 172.21.15.84:0/1698320552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec018840 con 0x7f6500109240 2024-09-21T07:51:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.549+0000 7f650f040740 1 Processor -- start 2024-09-21T07:51:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.549+0000 7f650f040740 1 -- start start 2024-09-21T07:51:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f650f040740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fee1b0 0x55d1e7392e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f650f040740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fc52f0 0x55d1e7393350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f650f040740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e7393890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f650f040740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d1e73086b0 con 0x55d1e6fee1b0 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f650f040740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d1e72f7ae0 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f650f040740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d1e72fb8f0 con 0x55d1e6fc52f0 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f6506000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fee1b0 0x55d1e7392e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f6506000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fee1b0 0x55d1e7392e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56804/0 (socket says 172.21.15.84:56804) 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f6506000640 1 -- 172.21.15.84:0/3715117348 learned_addr learned my addr 172.21.15.84:0/3715117348 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.550+0000 7f6505600640 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fc52f0 0x55d1e7393350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.551+0000 7f6506000640 1 -- 172.21.15.84:0/3715117348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fc52f0 msgr2=0x55d1e7393350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.551+0000 7f6506000640 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fc52f0 0x55d1e7393350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.551+0000 7f6506000640 1 -- 172.21.15.84:0/3715117348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 msgr2=0x55d1e7393890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.551+0000 7f6506000640 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e7393890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.551+0000 7f6506000640 1 -- 172.21.15.84:0/3715117348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1e72c4780 con 0x55d1e6fee1b0 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.551+0000 7f64fe000640 1 -- 172.21.15.84:0/1698320552 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f64ec010430 con 0x7f6500109240 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.551+0000 7f6506000640 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fee1b0 0x55d1e7392e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009ca0 tx=0x7f64f8009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d703e497a51d48fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.552+0000 7f64f2600640 1 -- 172.21.15.84:0/3715117348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8031cf0 con 0x55d1e6fee1b0 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.552+0000 7f64f2600640 1 -- 172.21.15.84:0/3715117348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64f8036030 con 0x55d1e6fee1b0 2024-09-21T07:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.552+0000 7f64f2600640 1 -- 172.21.15.84:0/3715117348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f80042a0 con 0x55d1e6fee1b0 2024-09-21T07:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f650f040740 1 -- 172.21.15.84:0/3715117348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fee1b0 msgr2=0x55d1e7392e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f650f040740 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fee1b0 0x55d1e7392e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009ca0 tx=0x7f64f8009430 comp rx=0 tx=0).stop 2024-09-21T07:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f650f040740 1 -- 172.21.15.84:0/3715117348 shutdown_connections 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f650f040740 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e7393890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f650f040740 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fc52f0 0x55d1e7393350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f650f040740 1 --2- 172.21.15.84:0/3715117348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fee1b0 0x55d1e7392e10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f650f040740 1 -- 172.21.15.84:0/3715117348 >> 172.21.15.84:0/3715117348 conn(0x55d1e6fe2300 msgr2=0x55d1e7390d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.553+0000 7f64fe000640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64e80b6680 0x7f64e80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.554+0000 7f64fe000640 1 -- 172.21.15.84:0/1698320552 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f64ec0e7d00 con 0x7f6500109240 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.554+0000 7f650f040740 1 -- 172.21.15.84:0/3715117348 shutdown_connections 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.554+0000 7f6506000640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64e80b6680 0x7f64e80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.554+0000 7f650f040740 1 -- 172.21.15.84:0/3715117348 wait complete. 2024-09-21T07:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.555+0000 7f650f040740 1 -- start start 2024-09-21T07:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.555+0000 7f6506000640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64e80b6680 0x7f64e80b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f64f8003cb0 tx=0x7f64f802a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.555+0000 7f650f040740 1 Processor -- start 2024-09-21T07:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f650f040740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f650f040740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f650f040740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fee1b0 0x55d1e73ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f650f040740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d1e722fab0 con 0x55d1e6fc52f0 2024-09-21T07:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f650f040740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d1e729e570 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f650f040740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d1e73a13b0 con 0x55d1e6fee1b0 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f650f040740 10 client.0 _ll_register_callbacks cb 0x55d1e72ad100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f6504c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f6504c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59454/0 (socket says 172.21.15.84:59454) 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f6504c00640 1 -- 172.21.15.84:0/2782161471 learned_addr learned my addr 172.21.15.84:0/2782161471 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f6505600640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.556+0000 7f6506000640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fee1b0 0x55d1e73ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f6504c00640 1 -- 172.21.15.84:0/2782161471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fee1b0 msgr2=0x55d1e73ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f6504c00640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fee1b0 0x55d1e73ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f6504c00640 1 -- 172.21.15.84:0/2782161471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 msgr2=0x55d1e73a73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f6504c00640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f6504c00640 1 -- 172.21.15.84:0/2782161471 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1e7059790 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f6505600640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f6504c00640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a79d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0a7fd0 tx=0x7f64ec0ad6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6750b132282b4d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.557+0000 7f64e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f64e6a00640 1 -- 172.21.15.84:0/2782161471 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0aed50 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64f8036030 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f64e6a00640 1 -- 172.21.15.84:0/2782161471 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f64ec0a9220 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f64e6a00640 1 -- 172.21.15.84:0/2782161471 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f64ec0ad3e0 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f650f040740 10 client.25943 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d1e70d2620 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f64e6a00640 1 -- 172.21.15.84:0/2782161471 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64f8036030 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.558+0000 7f64e6a00640 1 -- 172.21.15.84:0/2782161471 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f64ec0b3490 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.559+0000 7f650f040740 10 client.25943 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.559+0000 7f650f040740 10 client.25943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.559+0000 7f650f040740 20 client.25943 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.559+0000 7f650f040740 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6facd80 0x55d1e73b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.559+0000 7f650f040740 4 client.25943 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.559+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1e730a600 con 0x55d1e6facd80 2024-09-21T07:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.559+0000 7f6505600640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6facd80 0x55d1e73b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.560+0000 7f64e6a00640 10 client.25943 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.560+0000 7f6505600640 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6facd80 0x55d1e73b8c90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=445688ab08f44f20 server_cookie=35990ea150bb9976 in_seq=0 out_seq=0 2024-09-21T07:51:52.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f64e6a00640 1 -- 172.21.15.84:0/2782161471 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1e730a600 con 0x55d1e6facd80 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f64e6a00640 10 client.25943 handle_command_reply: tid=0 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 client.25943 shutdown 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 msgr2=0x55d1e73a79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a79d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0a7fd0 tx=0x7f64ec0ad6a0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 shutdown_connections 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6facd80 0x55d1e73b8c90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fee1b0 0x55d1e73ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a79d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f64e6a00640 0 client.25943 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 --2- 172.21.15.84:0/2782161471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 >> 172.21.15.84:0/2782161471 conn(0x55d1e6fe2300 msgr2=0x55d1e7393e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 shutdown_connections 2024-09-21T07:51:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 1 -- 172.21.15.84:0/2782161471 wait complete. 2024-09-21T07:51:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.561+0000 7f650f040740 20 client.25943 trim_cache size 0 max 16384 2024-09-21T07:51:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 Processor -- start 2024-09-21T07:51:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 -- start start 2024-09-21T07:51:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e7390620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f65001ae8a0 con 0x55d1e6fc52f0 2024-09-21T07:51:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65001b03e0 con 0x55d1e6fee1b0 2024-09-21T07:51:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.577+0000 7f650f040740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f65001aef70 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6506000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e7390620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6504c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6505600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6506000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e7390620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59468/0 (socket says 172.21.15.84:59468) 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6506000640 1 -- 172.21.15.84:0/3179361629 learned_addr learned my addr 172.21.15.84:0/3179361629 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6504c00640 1 -- 172.21.15.84:0/3179361629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 msgr2=0x55d1e7390620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6504c00640 1 --2- 172.21.15.84:0/3179361629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e7390620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6504c00640 1 -- 172.21.15.84:0/3179361629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 msgr2=0x55d1e73a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6504c00640 1 --2- 172.21.15.84:0/3179361629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.578+0000 7f6504c00640 1 -- 172.21.15.84:0/3179361629 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1e73b5840 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.579+0000 7f6504c00640 1 --2- 172.21.15.84:0/3179361629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a0910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0a9ea0 tx=0x7f64ec0ad7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e55f9fb73c628d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.579+0000 7f64f1c00640 1 -- 172.21.15.84:0/3179361629 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0b7240 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.579+0000 7f64f1c00640 1 -- 172.21.15.84:0/3179361629 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64ec0b6800 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.579+0000 7f64f1c00640 1 -- 172.21.15.84:0/3179361629 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0ac800 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.580+0000 7f650f040740 1 -- 172.21.15.84:0/3179361629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 msgr2=0x55d1e73a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.580+0000 7f650f040740 1 --2- 172.21.15.84:0/3179361629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a0910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0a9ea0 tx=0x7f64ec0ad7d0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.580+0000 7f650f040740 1 -- 172.21.15.84:0/3179361629 shutdown_connections 2024-09-21T07:51:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.580+0000 7f650f040740 1 --2- 172.21.15.84:0/3179361629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e7390620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.580+0000 7f650f040740 1 --2- 172.21.15.84:0/3179361629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a0910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.580+0000 7f650f040740 1 --2- 172.21.15.84:0/3179361629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.580+0000 7f650f040740 1 -- 172.21.15.84:0/3179361629 >> 172.21.15.84:0/3179361629 conn(0x55d1e6fe2300 msgr2=0x55d1e73a66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.581+0000 7f650f040740 1 -- 172.21.15.84:0/3179361629 shutdown_connections 2024-09-21T07:51:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.581+0000 7f650f040740 1 -- 172.21.15.84:0/3179361629 wait complete. 2024-09-21T07:51:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.581+0000 7f650f040740 1 -- start start 2024-09-21T07:51:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.581+0000 7f650f040740 1 Processor -- start 2024-09-21T07:51:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f650f040740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73bee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f650f040740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f650f040740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e73a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f650f040740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f65001afd10 con 0x55d1e6fc52f0 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f650f040740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65001af640 con 0x55d1e6fee1b0 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f650f040740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f65001ac8a0 con 0x55d1e6fcd4d0 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f650f040740 10 client.0 _ll_register_callbacks cb 0x7f64ec010d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f6504c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f6505600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73bee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f6505600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73bee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56832/0 (socket says 172.21.15.84:56832) 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f6505600640 1 -- 172.21.15.84:0/3840247798 learned_addr learned my addr 172.21.15.84:0/3840247798 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.582+0000 7f6506000640 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e73a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f6505600640 1 -- 172.21.15.84:0/3840247798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 msgr2=0x55d1e73a86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f6505600640 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f6505600640 1 -- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 msgr2=0x55d1e73a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f6505600640 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e73a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f6505600640 1 -- 172.21.15.84:0/3840247798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1e73b2a50 con 0x55d1e6fc52f0 2024-09-21T07:51:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f6505600640 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73bee00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64f4000c00 tx=0x7f64f40207d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6081980a39a21e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:51:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f64e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:51:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.583+0000 7f64e6a00640 1 -- 172.21.15.84:0/3840247798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f402a030 con 0x55d1e6fc52f0 2024-09-21T07:51:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.584+0000 7f64e6a00640 1 -- 172.21.15.84:0/3840247798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f64f4005020 con 0x55d1e6fc52f0 2024-09-21T07:51:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.584+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64ec0b6800 con 0x55d1e6fc52f0 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.584+0000 7f64e6a00640 1 -- 172.21.15.84:0/3840247798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f64f4005220 con 0x55d1e6fc52f0 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.584+0000 7f650f040740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.584+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d1e7423600 con 0x55d1e6fc52f0 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.584+0000 7f64e6a00640 1 -- 172.21.15.84:0/3840247798 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64ec0b6800 con 0x55d1e6fc52f0 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f64e6a00640 1 -- 172.21.15.84:0/3840247798 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f64f4010430 con 0x55d1e6fc52f0 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f650f040740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f650f040740 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:51:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f650f040740 20 client.15987 populate_metadata read hostname 'smithi084' 2024-09-21T07:51:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f650f040740 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6f821c0 0x55d1e7425d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:51:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f650f040740 4 client.15987 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:51:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1e73060b0 con 0x55d1e6f821c0 2024-09-21T07:51:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.585+0000 7f6504c00640 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6f821c0 0x55d1e7425d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:51:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.586+0000 7f64e6a00640 10 client.15987 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.586+0000 7f6504c00640 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6f821c0 0x55d1e7425d60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3d34bd03ae2b37b server_cookie=533bc9e9a79c35f8 in_seq=0 out_seq=0 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.592+0000 7f64e6a00640 1 -- 172.21.15.84:0/3840247798 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d1e73060b0 con 0x55d1e6f821c0 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.592+0000 7f64e6a00640 10 client.15987 handle_command_reply: tid=0 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.592+0000 7f650f040740 1 client.15987 shutdown 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.592+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 msgr2=0x55d1e73bee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.592+0000 7f650f040740 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73bee00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64f4000c00 tx=0x7f64f40207d0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 shutdown_connections 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d1e6fee1b0 0x55d1e73a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d1e6f821c0 0x55d1e7425d60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1e6fcd4d0 0x55d1e73a86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 --2- 172.21.15.84:0/3840247798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1e6fc52f0 0x55d1e73bee00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 >> 172.21.15.84:0/3840247798 conn(0x55d1e6fe2300 msgr2=0x55d1e73905b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f64e6a00640 0 client.15987 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 shutdown_connections 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 1 -- 172.21.15.84:0/3840247798 wait complete. 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.593+0000 7f650f040740 20 client.15987 trim_cache size 0 max 16384 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64e80b6680 msgr2=0x7f64e80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64e80b6680 0x7f64e80b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f64f8003cb0 tx=0x7f64f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109240 msgr2=0x7f650019c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109240 0x7f650019c9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f650006c690 tx=0x7f64ec00ee50 comp rx=0 tx=0).stop 2024-09-21T07:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 shutdown_connections 2024-09-21T07:51:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f64e80b6680 0x7f64e80b8b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6500109b90 0x7f65001a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6500109240 0x7f650019c9c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 --2- 172.21.15.84:0/1698320552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6500103910 0x7f650019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:51:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 >> 172.21.15.84:0/1698320552 conn(0x7f65000ff330 msgr2=0x7f6500106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:51:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 shutdown_connections 2024-09-21T07:51:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:51:52.594+0000 7f6506a00640 1 -- 172.21.15.84:0/1698320552 wait complete. 2024-09-21T07:51:53.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:53 smithi191 ceph-mon[34667]: pgmap v417: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T07:51:53.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:53 smithi162 ceph-mon[34833]: pgmap v417: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T07:51:53.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:53 smithi084 ceph-mon[30411]: pgmap v417: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T07:51:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:55 smithi191 ceph-mon[34667]: pgmap v418: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:51:55.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:55 smithi162 ceph-mon[34833]: pgmap v418: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:51:55.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:55 smithi084 ceph-mon[30411]: pgmap v418: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:51:57.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:57 smithi191 ceph-mon[34667]: pgmap v419: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T07:51:57.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:57 smithi162 ceph-mon[34833]: pgmap v419: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T07:51:57.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:57 smithi084 ceph-mon[30411]: pgmap v419: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T07:51:59.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:51:59 smithi191 ceph-mon[34667]: pgmap v420: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:51:59.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:51:59 smithi162 ceph-mon[34833]: pgmap v420: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:51:59.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:51:59 smithi084 ceph-mon[30411]: pgmap v420: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:52:01.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:01 smithi191 ceph-mon[34667]: pgmap v421: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:52:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:01 smithi162 ceph-mon[34833]: pgmap v421: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:52:01.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:01 smithi084 ceph-mon[30411]: pgmap v421: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:52:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:03 smithi191 ceph-mon[34667]: pgmap v422: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:52:03.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:03 smithi162 ceph-mon[34833]: pgmap v422: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:52:03.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:03 smithi084 ceph-mon[30411]: pgmap v422: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:52:05.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:05 smithi084 ceph-mon[30411]: pgmap v423: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:52:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:05 smithi191 ceph-mon[34667]: pgmap v423: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:52:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:05 smithi162 ceph-mon[34833]: pgmap v423: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 -- 172.21.15.84:0/950117424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 msgr2=0x7fbaa8103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 --2- 172.21.15.84:0/950117424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 0x7fbaa8103d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009860 tx=0x7fba9c02a340 comp rx=0 tx=0).stop 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 -- 172.21.15.84:0/950117424 shutdown_connections 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 --2- 172.21.15.84:0/950117424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 0x7fbaa81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 --2- 172.21.15.84:0/950117424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa8109240 0x7fbaa8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 --2- 172.21.15.84:0/950117424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 0x7fbaa8103d20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 -- 172.21.15.84:0/950117424 >> 172.21.15.84:0/950117424 conn(0x7fbaa80ff330 msgr2=0x7fbaa8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 -- 172.21.15.84:0/950117424 shutdown_connections 2024-09-21T07:52:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.802+0000 7fbaaf000640 1 -- 172.21.15.84:0/950117424 wait complete. 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 Processor -- start 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 -- start start 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 0x7fbaa819c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa8109240 0x7fbaa819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 0x7fbaa81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8113850 con 0x7fbaa8109b90 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81136d0 con 0x7fbaa8103910 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.803+0000 7fbaaf000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81139d0 con 0x7fbaa8109240 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 0x7fbaa81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaad200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa8109240 0x7fbaa819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaadc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 0x7fbaa819c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 0x7fbaa81a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52942/0 (socket says 172.21.15.84:52942) 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 -- 172.21.15.84:0/38266074 learned_addr learned my addr 172.21.15.84:0/38266074 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 -- 172.21.15.84:0/38266074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa8109240 msgr2=0x7fbaa819ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa8109240 0x7fbaa819ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 -- 172.21.15.84:0/38266074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 msgr2=0x7fbaa819c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 0x7fbaa819c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 -- 172.21.15.84:0/38266074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa81a23c0 con 0x7fbaa8109b90 2024-09-21T07:52:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaadc00640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 0x7fbaa819c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.804+0000 7fbaae600640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 0x7fbaa81a1cc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009fd0 tx=0x7fbaa000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.805+0000 7fbaa6000640 1 -- 172.21.15.84:0/38266074 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0004b20 con 0x7fbaa8109b90 2024-09-21T07:52:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.805+0000 7fbaa6000640 1 -- 172.21.15.84:0/38266074 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa0003e20 con 0x7fbaa8109b90 2024-09-21T07:52:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.805+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa81a26b0 con 0x7fbaa8109b90 2024-09-21T07:52:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.805+0000 7fbaa6000640 1 -- 172.21.15.84:0/38266074 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0004820 con 0x7fbaa8109b90 2024-09-21T07:52:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.805+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa81a8e40 con 0x7fbaa8109b90 2024-09-21T07:52:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.809+0000 7fbaa6000640 1 -- 172.21.15.84:0/38266074 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbaa001d020 con 0x7fbaa8109b90 2024-09-21T07:52:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbab7655740 1 Processor -- start 2024-09-21T07:52:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbab7655740 1 -- start start 2024-09-21T07:52:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbab7655740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68edde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbab7655740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ede350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbab7655740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ede890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbab7655740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cf68e536b0 con 0x55cf68b391b0 2024-09-21T07:52:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbaa6000640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fba900b6680 0x7fba900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.810+0000 7fbab7655740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cf68e42ae0 con 0x55cf68b102f0 2024-09-21T07:52:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbab7655740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55cf68e468f0 con 0x55cf68b184d0 2024-09-21T07:52:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaa6000640 1 -- 172.21.15.84:0/38266074 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fbaa00e7a70 con 0x7fbaa8109b90 2024-09-21T07:52:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68edde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaae600640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fba900b6680 0x7fba900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68edde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52948/0 (socket says 172.21.15.84:52948) 2024-09-21T07:52:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 -- 172.21.15.84:0/4201394750 learned_addr learned my addr 172.21.15.84:0/4201394750 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaadc00640 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ede350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ede890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 -- 172.21.15.84:0/4201394750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 msgr2=0x55cf68ede890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ede890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 -- 172.21.15.84:0/4201394750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 msgr2=0x55cf68ede350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ede350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaad200640 1 -- 172.21.15.84:0/4201394750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf68e0f780 con 0x55cf68b391b0 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.811+0000 7fbaadc00640 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ede350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.812+0000 7fbaae600640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fba900b6680 0x7fba900b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00e4eb0 tx=0x7fbaa0009b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.812+0000 7fbaad200640 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68edde10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fba94013530 tx=0x7fba94005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f180e94746a6cf07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.812+0000 7fba9aa00640 1 -- 172.21.15.84:0/4201394750 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94004050 con 0x55cf68b391b0 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.812+0000 7fba9aa00640 1 -- 172.21.15.84:0/4201394750 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba940041f0 con 0x55cf68b391b0 2024-09-21T07:52:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.812+0000 7fba9aa00640 1 -- 172.21.15.84:0/4201394750 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9400f700 con 0x55cf68b391b0 2024-09-21T07:52:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 -- 172.21.15.84:0/4201394750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 msgr2=0x55cf68edde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68edde10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fba94013530 tx=0x7fba94005850 comp rx=0 tx=0).stop 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 -- 172.21.15.84:0/4201394750 shutdown_connections 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ede890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ede350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 --2- 172.21.15.84:0/4201394750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68edde10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 -- 172.21.15.84:0/4201394750 >> 172.21.15.84:0/4201394750 conn(0x55cf68b2d300 msgr2=0x55cf68edbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 -- 172.21.15.84:0/4201394750 shutdown_connections 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.813+0000 7fbab7655740 1 -- 172.21.15.84:0/4201394750 wait complete. 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.814+0000 7fbab7655740 1 -- start start 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.814+0000 7fbab7655740 1 Processor -- start 2024-09-21T07:52:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.814+0000 7fbab7655740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ee9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbab7655740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ee99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbab7655740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68ef5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbab7655740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cf68d7aab0 con 0x55cf68b391b0 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbab7655740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cf68de9570 con 0x55cf68b102f0 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbab7655740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55cf68eec590 con 0x55cf68b184d0 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbab7655740 10 client.0 _ll_register_callbacks cb 0x55cf68df8100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68ef5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68ef5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52954/0 (socket says 172.21.15.84:52954) 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaadc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ee99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaad200640 1 -- 172.21.15.84:0/3072217021 learned_addr learned my addr 172.21.15.84:0/3072217021 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaad200640 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ee9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaadc00640 1 -- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 msgr2=0x55cf68ee9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaadc00640 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ee9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaadc00640 1 -- 172.21.15.84:0/3072217021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 msgr2=0x55cf68ef5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaadc00640 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68ef5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.815+0000 7fbaadc00640 1 -- 172.21.15.84:0/3072217021 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf68ba4790 con 0x55cf68b184d0 2024-09-21T07:52:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.816+0000 7fbaadc00640 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ee99b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba9c005940 tx=0x7fba9c005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9efc07696ca78f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.816+0000 7fba8f400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.816+0000 7fba8f400640 1 -- 172.21.15.84:0/3072217021 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c037040 con 0x55cf68b184d0 2024-09-21T07:52:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.816+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba940041f0 con 0x55cf68b184d0 2024-09-21T07:52:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.816+0000 7fba8f400640 1 -- 172.21.15.84:0/3072217021 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fba9c030450 con 0x55cf68b184d0 2024-09-21T07:52:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.816+0000 7fba8f400640 1 -- 172.21.15.84:0/3072217021 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba9c04c050 con 0x55cf68b184d0 2024-09-21T07:52:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.816+0000 7fbab7655740 10 client.25975 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf68c1d620 con 0x55cf68b184d0 2024-09-21T07:52:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fba8f400640 1 -- 172.21.15.84:0/3072217021 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba940041f0 con 0x55cf68b184d0 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fba8f400640 1 -- 172.21.15.84:0/3072217021 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fba9c0035f0 con 0x55cf68b184d0 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fbab7655740 10 client.25975 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fbab7655740 10 client.25975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fbab7655740 20 client.25975 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fbab7655740 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68af7d80 0x55cf68efb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fbab7655740 4 client.25975 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.817+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf68e55600 con 0x55cf68af7d80 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.818+0000 7fbaad200640 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68af7d80 0x55cf68efb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.818+0000 7fbaad200640 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68af7d80 0x55cf68efb5d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95b6a2c9bc1ad181 server_cookie=1ef6ea62cd50cb08 in_seq=0 out_seq=0 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.818+0000 7fba8f400640 10 client.25975 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fba8f400640 1 -- 172.21.15.84:0/3072217021 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf68e55600 con 0x55cf68af7d80 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fba8f400640 10 client.25975 handle_command_reply: tid=0 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 client.25975 shutdown 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 msgr2=0x55cf68ee99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ee99b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba9c005940 tx=0x7fba9c005d30 comp rx=0 tx=0).stop 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 shutdown_connections 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b391b0 0x55cf68ef5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68af7d80 0x55cf68efb5d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fba8f400640 0 client.25975 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ee99b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 --2- 172.21.15.84:0/3072217021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b102f0 0x55cf68ee9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.819+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 >> 172.21.15.84:0/3072217021 conn(0x55cf68b2d300 msgr2=0x55cf68edee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.820+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 shutdown_connections 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.820+0000 7fbab7655740 1 -- 172.21.15.84:0/3072217021 wait complete. 2024-09-21T07:52:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.820+0000 7fbab7655740 20 client.25975 trim_cache size 0 max 16384 2024-09-21T07:52:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 Processor -- start 2024-09-21T07:52:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 -- start start 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68edaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ef5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68ee6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b2d40 con 0x55cf68b102f0 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b4880 con 0x55cf68b391b0 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbab7655740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b3410 con 0x55cf68b184d0 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68edaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68edaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52970/0 (socket says 172.21.15.84:52970) 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbaad200640 1 -- 172.21.15.84:0/2054649782 learned_addr learned my addr 172.21.15.84:0/2054649782 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.835+0000 7fbaadc00640 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ef5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaad200640 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68ee6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaad200640 1 -- 172.21.15.84:0/2054649782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 msgr2=0x55cf68ef5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaad200640 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ef5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaad200640 1 -- 172.21.15.84:0/2054649782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 msgr2=0x55cf68ee6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaad200640 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68ee6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaad200640 1 -- 172.21.15.84:0/2054649782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf68ee7950 con 0x55cf68b102f0 2024-09-21T07:52:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaadc00640 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ef5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fbaad200640 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68edaa70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba94003d20 tx=0x7fba94009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8eb2798a93f360a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fba9a000640 1 -- 172.21.15.84:0/2054649782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94029040 con 0x55cf68b102f0 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fba9a000640 1 -- 172.21.15.84:0/2054649782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba94005130 con 0x55cf68b102f0 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.836+0000 7fba9a000640 1 -- 172.21.15.84:0/2054649782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9400f8f0 con 0x55cf68b102f0 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 -- 172.21.15.84:0/2054649782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 msgr2=0x55cf68edaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68edaa70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba94003d20 tx=0x7fba94009f20 comp rx=0 tx=0).stop 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 -- 172.21.15.84:0/2054649782 shutdown_connections 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68ee6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68ef5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 --2- 172.21.15.84:0/2054649782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68edaa70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 -- 172.21.15.84:0/2054649782 >> 172.21.15.84:0/2054649782 conn(0x55cf68b2d300 msgr2=0x55cf68eda360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 -- 172.21.15.84:0/2054649782 shutdown_connections 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.837+0000 7fbab7655740 1 -- 172.21.15.84:0/2054649782 wait complete. 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 -- start start 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 Processor -- start 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68eeee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68eef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68f63f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b41b0 con 0x55cf68b102f0 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b3ae0 con 0x55cf68b391b0 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.838+0000 7fbab7655740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81b0d00 con 0x55cf68b184d0 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbab7655740 10 client.0 _ll_register_callbacks cb 0x7fba94005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68eeee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaad200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68eeee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52982/0 (socket says 172.21.15.84:52982) 2024-09-21T07:52:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaad200640 1 -- 172.21.15.84:0/2607917539 learned_addr learned my addr 172.21.15.84:0/2607917539 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaadc00640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68eef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaad200640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68f63f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaadc00640 1 -- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 msgr2=0x55cf68f63f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaadc00640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68f63f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaadc00640 1 -- 172.21.15.84:0/2607917539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 msgr2=0x55cf68eeee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaadc00640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68eeee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaadc00640 1 -- 172.21.15.84:0/2607917539 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf68f644b0 con 0x55cf68b184d0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.839+0000 7fbaad200640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68eeee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fbaadc00640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68eef3d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba9c02a860 tx=0x7fba9c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37c956ad278e932d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fba8f400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fba8f400640 1 -- 172.21.15.84:0/2607917539 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c056070 con 0x55cf68b184d0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fba8f400640 1 -- 172.21.15.84:0/2607917539 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fba9c003e30 con 0x55cf68b184d0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba94005130 con 0x55cf68b184d0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fba8f400640 1 -- 172.21.15.84:0/2607917539 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba9c05f050 con 0x55cf68b184d0 2024-09-21T07:52:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fbab7655740 10 client.25981 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf68f656c0 con 0x55cf68b184d0 2024-09-21T07:52:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.840+0000 7fba8f400640 1 -- 172.21.15.84:0/2607917539 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba94005130 con 0x55cf68b184d0 2024-09-21T07:52:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fba8f400640 1 -- 172.21.15.84:0/2607917539 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fba9c059020 con 0x55cf68b184d0 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fbab7655740 10 client.25981 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fbab7655740 10 client.25981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fbab7655740 20 client.25981 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fbab7655740 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68acd1c0 0x55cf68f67f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fbab7655740 4 client.25981 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf68e510b0 con 0x55cf68acd1c0 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.841+0000 7fbaad200640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68acd1c0 0x55cf68f67f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.842+0000 7fba8f400640 10 client.25981 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.842+0000 7fbaad200640 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68acd1c0 0x55cf68f67f00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a819b3a7be5f5e89 server_cookie=194da6f50ce1fd6d in_seq=0 out_seq=0 2024-09-21T07:52:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fba8f400640 1 -- 172.21.15.84:0/2607917539 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf68e510b0 con 0x55cf68acd1c0 2024-09-21T07:52:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fba8f400640 10 client.25981 handle_command_reply: tid=0 2024-09-21T07:52:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 client.25981 shutdown 2024-09-21T07:52:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 msgr2=0x55cf68eef3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68eef3d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba9c02a860 tx=0x7fba9c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 shutdown_connections 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf68b391b0 0x55cf68f63f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cf68acd1c0 0x55cf68f67f00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf68b184d0 0x55cf68eef3d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 --2- 172.21.15.84:0/2607917539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf68b102f0 0x55cf68eeee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fba8f400640 0 client.25981 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 >> 172.21.15.84:0/2607917539 conn(0x55cf68b2d300 msgr2=0x55cf68edee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 shutdown_connections 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.848+0000 7fbab7655740 1 -- 172.21.15.84:0/2607917539 wait complete. 2024-09-21T07:52:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.849+0000 7fbab7655740 20 client.25981 trim_cache size 0 max 16384 2024-09-21T07:52:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:52:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:52:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:52:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fba900b6680 msgr2=0x7fba900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fba900b6680 0x7fba900b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00e4eb0 tx=0x7fbaa0009b50 comp rx=0 tx=0).stop 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 msgr2=0x7fbaa81a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 0x7fbaa81a1cc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009fd0 tx=0x7fbaa000c800 comp rx=0 tx=0).stop 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 shutdown_connections 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fba900b6680 0x7fba900b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa8109b90 0x7fbaa81a1cc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa8109240 0x7fbaa819ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 --2- 172.21.15.84:0/38266074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa8103910 0x7fbaa819c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 >> 172.21.15.84:0/38266074 conn(0x7fbaa80ff330 msgr2=0x7fbaa8108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 shutdown_connections 2024-09-21T07:52:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:05.850+0000 7fbaaf000640 1 -- 172.21.15.84:0/38266074 wait complete. 2024-09-21T07:52:07.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:07 smithi191 ceph-mon[34667]: pgmap v424: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:52:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:07 smithi162 ceph-mon[34833]: pgmap v424: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:52:07.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:07 smithi084 ceph-mon[30411]: pgmap v424: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-21T07:52:08.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:52:08.516 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 -- 172.21.15.84:0/4111281270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 msgr2=0x7fbb4c103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 --2- 172.21.15.84:0/4111281270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c103dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009900 tx=0x7fbb3c02a410 comp rx=0 tx=0).stop 2024-09-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 -- 172.21.15.84:0/4111281270 shutdown_connections 2024-09-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 --2- 172.21.15.84:0/4111281270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb4c109c40 0x7fbb4c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 --2- 172.21.15.84:0/4111281270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4c1092f0 0x7fbb4c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 --2- 172.21.15.84:0/4111281270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c103dc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 -- 172.21.15.84:0/4111281270 >> 172.21.15.84:0/4111281270 conn(0x7fbb4c0ff440 msgr2=0x7fbb4c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 -- 172.21.15.84:0/4111281270 shutdown_connections 2024-09-21T07:52:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.166+0000 7fbb51600640 1 -- 172.21.15.84:0/4111281270 wait complete. 2024-09-21T07:52:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.167+0000 7fbb51600640 1 Processor -- start 2024-09-21T07:52:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.167+0000 7fbb51600640 1 -- start start 2024-09-21T07:52:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb51600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb51600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4c1092f0 0x7fbb4c19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb51600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb4c109c40 0x7fbb4c1a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb51600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c113950 con 0x7fbb4c1039b0 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb51600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1137d0 con 0x7fbb4c109c40 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb51600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c113ad0 con 0x7fbb4c1092f0 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c19c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45022/0 (socket says 172.21.15.84:45022) 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb4be00640 1 -- 172.21.15.84:0/2879983562 learned_addr learned my addr 172.21.15.84:0/2879983562 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb4b400640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4c1092f0 0x7fbb4c19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.168+0000 7fbb50c00640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb4c109c40 0x7fbb4c1a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb4b400640 1 -- 172.21.15.84:0/2879983562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb4c109c40 msgr2=0x7fbb4c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb4b400640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb4c109c40 0x7fbb4c1a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb4b400640 1 -- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 msgr2=0x7fbb4c19c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb4b400640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c19c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb4b400640 1 -- 172.21.15.84:0/2879983562 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c1a24f0 con 0x7fbb4c1092f0 2024-09-21T07:52:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb4be00640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c19c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb4b400640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4c1092f0 0x7fbb4c19cb20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c06b990 tx=0x7fbb3800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb48c00640 1 -- 172.21.15.84:0/2879983562 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800ccc0 con 0x7fbb4c1092f0 2024-09-21T07:52:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb48c00640 1 -- 172.21.15.84:0/2879983562 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb38009e40 con 0x7fbb4c1092f0 2024-09-21T07:52:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c1a27e0 con 0x7fbb4c1092f0 2024-09-21T07:52:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.169+0000 7fbb48c00640 1 -- 172.21.15.84:0/2879983562 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004a00 con 0x7fbb4c1092f0 2024-09-21T07:52:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.170+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c1a8f40 con 0x7fbb4c1092f0 2024-09-21T07:52:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.173+0000 7fbb48c00640 1 -- 172.21.15.84:0/2879983562 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbb38005020 con 0x7fbb4c1092f0 2024-09-21T07:52:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.174+0000 7fbb59a0d740 1 Processor -- start 2024-09-21T07:52:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.174+0000 7fbb59a0d740 1 -- start start 2024-09-21T07:52:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b74f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137a51b0 0x564313b75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb48c00640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb300b6680 0x7fbb300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564313aebf70 con 0x5643137ad390 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564313adb3a0 con 0x5643137ce070 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564313adf1b0 con 0x5643137a51b0 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb48c00640 1 -- 172.21.15.84:0/2879983562 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fbb380e7a50 con 0x7fbb4c1092f0 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b74f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb4be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137a51b0 0x564313b75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b74f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53356/0 (socket says 172.21.15.84:53356) 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb4be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137a51b0 0x564313b75470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49374/0 (socket says 172.21.15.84:49374) 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.175+0000 7fbb50c00640 1 -- 172.21.15.84:0/2906927491 learned_addr learned my addr 172.21.15.84:0/2906927491 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb50c00640 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb4b400640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb300b6680 0x7fbb300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb50c00640 1 -- 172.21.15.84:0/2906927491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137a51b0 msgr2=0x564313b75470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb50c00640 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137a51b0 0x564313b75470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb50c00640 1 -- 172.21.15.84:0/2906927491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 msgr2=0x564313b759b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb50c00640 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b759b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb50c00640 1 -- 172.21.15.84:0/2906927491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564313aa5c90 con 0x5643137ce070 2024-09-21T07:52:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb50c00640 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b74f30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009b80 tx=0x7fbb44009af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d02bb29c8cbb11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.176+0000 7fbb4b400640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb300b6680 0x7fbb300b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb38004770 tx=0x7fbb380046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.177+0000 7fbb41200640 1 -- 172.21.15.84:0/2906927491 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400fc20 con 0x5643137ce070 2024-09-21T07:52:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.177+0000 7fbb41200640 1 -- 172.21.15.84:0/2906927491 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb4400fdc0 con 0x5643137ce070 2024-09-21T07:52:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.177+0000 7fbb41200640 1 -- 172.21.15.84:0/2906927491 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44004450 con 0x5643137ce070 2024-09-21T07:52:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 -- 172.21.15.84:0/2906927491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 msgr2=0x564313b74f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b74f30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009b80 tx=0x7fbb44009af0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 -- 172.21.15.84:0/2906927491 shutdown_connections 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b759b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137a51b0 0x564313b75470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/2906927491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b74f30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 -- 172.21.15.84:0/2906927491 >> 172.21.15.84:0/2906927491 conn(0x5643137c2460 msgr2=0x564313b72e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 -- 172.21.15.84:0/2906927491 shutdown_connections 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.178+0000 7fbb59a0d740 1 -- 172.21.15.84:0/2906927491 wait complete. 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 -- start start 2024-09-21T07:52:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 Processor -- start 2024-09-21T07:52:09.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b80690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b80bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b8ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56431393c700 con 0x5643137a51b0 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564313a76540 con 0x5643137ce070 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.179+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564313b83710 con 0x5643137ad390 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb59a0d740 10 client.0 _ll_register_callbacks cb 0x564313a86430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b80690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b80690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45036/0 (socket says 172.21.15.84:45036) 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 -- 172.21.15.84:0/4082414993 learned_addr learned my addr 172.21.15.84:0/4082414993 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb4be00640 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b80bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b8ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 -- 172.21.15.84:0/4082414993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 msgr2=0x564313b80bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b80bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 -- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 msgr2=0x564313b8ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b8ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.180+0000 7fbb50c00640 1 -- 172.21.15.84:0/4082414993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564313839650 con 0x5643137a51b0 2024-09-21T07:52:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb50c00640 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b80690 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009860 tx=0x7fbb44003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ee6b6457e1ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb35600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:52:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb35600640 1 -- 172.21.15.84:0/4082414993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb440041f0 con 0x5643137a51b0 2024-09-21T07:52:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564313a78b50 con 0x5643137a51b0 2024-09-21T07:52:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb35600640 1 -- 172.21.15.84:0/4082414993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fbb44004390 con 0x5643137a51b0 2024-09-21T07:52:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb35600640 1 -- 172.21.15.84:0/4082414993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb44035050 con 0x5643137a51b0 2024-09-21T07:52:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb59a0d740 10 client.16017 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.181+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564313a93910 con 0x5643137a51b0 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb35600640 1 -- 172.21.15.84:0/4082414993 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564313a78b50 con 0x5643137a51b0 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb35600640 1 -- 172.21.15.84:0/4082414993 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbb4401fab0 con 0x5643137a51b0 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb59a0d740 10 client.16017 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb59a0d740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb59a0d740 20 client.16017 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56431378c9f0 0x564313b92630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb59a0d740 4 client.16017 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.182+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564313aedec0 con 0x56431378c9f0 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.183+0000 7fbb4be00640 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56431378c9f0 0x564313b92630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.183+0000 7fbb35600640 10 client.16017 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.183+0000 7fbb4be00640 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56431378c9f0 0x564313b92630 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d69b357978a5b2 server_cookie=5b9c847e930cae48 in_seq=0 out_seq=0 2024-09-21T07:52:09.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.184+0000 7fbb35600640 1 -- 172.21.15.84:0/4082414993 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564313aedec0 con 0x56431378c9f0 2024-09-21T07:52:09.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.184+0000 7fbb35600640 10 client.16017 handle_command_reply: tid=0 2024-09-21T07:52:09.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.184+0000 7fbb59a0d740 1 client.16017 shutdown 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 msgr2=0x564313b80690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b80690 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009860 tx=0x7fbb44003f00 comp rx=0 tx=0).stop 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 shutdown_connections 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b8ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56431378c9f0 0x564313b92630 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b80bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/4082414993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b80690 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb35600640 0 client.16017 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 >> 172.21.15.84:0/4082414993 conn(0x5643137c2460 msgr2=0x564313b78110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 shutdown_connections 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 1 -- 172.21.15.84:0/4082414993 wait complete. 2024-09-21T07:52:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.185+0000 7fbb59a0d740 20 client.16017 trim_cache size 0 max 16384 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 Processor -- start 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 -- start start 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b7f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b76920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1b2dd0 con 0x5643137a51b0 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1b4910 con 0x5643137ce070 2024-09-21T07:52:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1b34a0 con 0x5643137ad390 2024-09-21T07:52:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b7f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b7f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45046/0 (socket says 172.21.15.84:45046) 2024-09-21T07:52:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.217+0000 7fbb50c00640 1 -- 172.21.15.84:0/3930672611 learned_addr learned my addr 172.21.15.84:0/3930672611 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb4be00640 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b76920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb50c00640 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb4be00640 1 -- 172.21.15.84:0/3930672611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 msgr2=0x564313b822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb4be00640 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b822c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb4be00640 1 -- 172.21.15.84:0/3930672611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 msgr2=0x564313b7f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb4be00640 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b7f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb4be00640 1 -- 172.21.15.84:0/3930672611 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564313b81950 con 0x5643137ad390 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.218+0000 7fbb4be00640 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b76920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000c00 tx=0x7fbb3c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72a455a73b91aea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.219+0000 7fbb37e00640 1 -- 172.21.15.84:0/3930672611 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c035040 con 0x5643137ad390 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.219+0000 7fbb37e00640 1 -- 172.21.15.84:0/3930672611 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3c0314a0 con 0x5643137ad390 2024-09-21T07:52:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.219+0000 7fbb37e00640 1 -- 172.21.15.84:0/3930672611 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c04e6e0 con 0x5643137ad390 2024-09-21T07:52:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.219+0000 7fbb59a0d740 1 -- 172.21.15.84:0/3930672611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 msgr2=0x564313b76920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.219+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b76920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000c00 tx=0x7fbb3c009260 comp rx=0 tx=0).stop 2024-09-21T07:52:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 -- 172.21.15.84:0/3930672611 shutdown_connections 2024-09-21T07:52:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137ce070 0x564313b822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ad390 0x564313b76920 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/3930672611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137a51b0 0x564313b7f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 -- 172.21.15.84:0/3930672611 >> 172.21.15.84:0/3930672611 conn(0x5643137c2460 msgr2=0x564313b81bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 -- 172.21.15.84:0/3930672611 shutdown_connections 2024-09-21T07:52:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 -- 172.21.15.84:0/3930672611 wait complete. 2024-09-21T07:52:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.220+0000 7fbb59a0d740 1 -- start start 2024-09-21T07:52:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 1 Processor -- start 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137a51b0 0x564313b89390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b839a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ce070 0x564313b840b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1b4240 con 0x5643137ad390 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1b3b70 con 0x5643137a51b0 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1b0d90 con 0x5643137ce070 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb59a0d740 10 client.0 _ll_register_callbacks cb 0x7fbb44011aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137a51b0 0x564313b89390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb50c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137a51b0 0x564313b89390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53382/0 (socket says 172.21.15.84:53382) 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b839a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45052/0 (socket says 172.21.15.84:45052) 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.221+0000 7fbb50c00640 1 -- 172.21.15.84:0/1263069033 learned_addr learned my addr 172.21.15.84:0/1263069033 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb50c00640 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ce070 0x564313b840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb4be00640 1 -- 172.21.15.84:0/1263069033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ce070 msgr2=0x564313b840b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb4be00640 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ce070 0x564313b840b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb4be00640 1 -- 172.21.15.84:0/1263069033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137a51b0 msgr2=0x564313b89390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb4be00640 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137a51b0 0x564313b89390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb4be00640 1 -- 172.21.15.84:0/1263069033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564313bfce90 con 0x5643137ad390 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb4be00640 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b839a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c031440 tx=0x7fbb3c0316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf793409bed4eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.222+0000 7fbb35600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:52:09.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb35600640 1 -- 172.21.15.84:0/1263069033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c035040 con 0x5643137ad390 2024-09-21T07:52:09.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb35600640 1 -- 172.21.15.84:0/1263069033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fbb3c005020 con 0x5643137ad390 2024-09-21T07:52:09.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3c0314a0 con 0x5643137ad390 2024-09-21T07:52:09.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb35600640 1 -- 172.21.15.84:0/1263069033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb3c005220 con 0x5643137ad390 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb59a0d740 10 client.16023 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564313bfe030 con 0x5643137ad390 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb35600640 1 -- 172.21.15.84:0/1263069033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3c0314a0 con 0x5643137ad390 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.223+0000 7fbb35600640 1 -- 172.21.15.84:0/1263069033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbb3c003750 con 0x5643137ad390 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.224+0000 7fbb59a0d740 10 client.16023 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.224+0000 7fbb59a0d740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.224+0000 7fbb59a0d740 20 client.16023 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.224+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564313761da0 0x564313c00770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.224+0000 7fbb59a0d740 4 client.16023 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.224+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564313ae9970 con 0x564313761da0 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.224+0000 7fbb50c00640 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564313761da0 0x564313c00770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb35600640 10 client.16023 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb50c00640 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564313761da0 0x564313c00770 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecd967e1b70430c4 server_cookie=6e22d63229af39ab in_seq=0 out_seq=0 2024-09-21T07:52:09.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb35600640 1 -- 172.21.15.84:0/1263069033 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x564313ae9970 con 0x564313761da0 2024-09-21T07:52:09.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb35600640 10 client.16023 handle_command_reply: tid=0 2024-09-21T07:52:09.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 client.16023 shutdown 2024-09-21T07:52:09.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 msgr2=0x564313b839a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b839a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c031440 tx=0x7fbb3c0316e0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 shutdown_connections 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564313761da0 0x564313c00770 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643137ce070 0x564313b840b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643137ad390 0x564313b839a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb35600640 0 client.16023 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 --2- 172.21.15.84:0/1263069033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5643137a51b0 0x564313b89390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.225+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 >> 172.21.15.84:0/1263069033 conn(0x5643137c2460 msgr2=0x564313b766d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.226+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 shutdown_connections 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.226+0000 7fbb59a0d740 1 -- 172.21.15.84:0/1263069033 wait complete. 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.226+0000 7fbb59a0d740 20 client.16023 trim_cache size 0 max 16384 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:52:09.229 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:52:09.230 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:52:09.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.226+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb300b6680 msgr2=0x7fbb300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.226+0000 7fbb51600640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb300b6680 0x7fbb300b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb38004770 tx=0x7fbb380046c0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.226+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4c1092f0 msgr2=0x7fbb4c19cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.226+0000 7fbb51600640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4c1092f0 0x7fbb4c19cb20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c06b990 tx=0x7fbb3800ed90 comp rx=0 tx=0).stop 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 shutdown_connections 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbb300b6680 0x7fbb300b8b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb4c109c40 0x7fbb4c1a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4c1092f0 0x7fbb4c19cb20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 --2- 172.21.15.84:0/2879983562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4c1039b0 0x7fbb4c19c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 >> 172.21.15.84:0/2879983562 conn(0x7fbb4c0ff440 msgr2=0x7fbb4c1089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 shutdown_connections 2024-09-21T07:52:09.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:09.227+0000 7fbb51600640 1 -- 172.21.15.84:0/2879983562 wait complete. 2024-09-21T07:52:09.251 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:09 smithi084 ceph-mon[30411]: pgmap v425: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:52:09.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:09 smithi191 ceph-mon[34667]: pgmap v425: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:52:09.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:09 smithi162 ceph-mon[34833]: pgmap v425: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T07:52:10.290 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:52:10.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:52:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:10.700 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 59% (7493/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 97% (12414/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T07:52:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 -- 172.21.15.84:0/2843507182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 msgr2=0x7f62cc075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2843507182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc075bc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009900 tx=0x7f62bc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 -- 172.21.15.84:0/2843507182 shutdown_connections 2024-09-21T07:52:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2843507182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62cc10ff10 0x7f62cc112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2843507182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62cc076100 0x7f62cc10f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2843507182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc075bc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 -- 172.21.15.84:0/2843507182 >> 172.21.15.84:0/2843507182 conn(0x7f62cc0ff440 msgr2=0x7f62cc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 -- 172.21.15.84:0/2843507182 shutdown_connections 2024-09-21T07:52:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.328+0000 7f62cbe00640 1 -- 172.21.15.84:0/2843507182 wait complete. 2024-09-21T07:52:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.329+0000 7f62cbe00640 1 Processor -- start 2024-09-21T07:52:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.329+0000 7f62cbe00640 1 -- start start 2024-09-21T07:52:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62cc076100 0x7f62cc19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62cc10ff10 0x7f62cc1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62cbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc115ac0 con 0x7f62cc0757b0 2024-09-21T07:52:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62cbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc115940 con 0x7f62cc10ff10 2024-09-21T07:52:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62cbe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc115c40 con 0x7f62cc076100 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc19c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45068/0 (socket says 172.21.15.84:45068) 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 -- 172.21.15.84:0/2474298490 learned_addr learned my addr 172.21.15.84:0/2474298490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62ca000640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62cc076100 0x7f62cc19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62cb400640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62cc10ff10 0x7f62cc1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 -- 172.21.15.84:0/2474298490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62cc076100 msgr2=0x7f62cc19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62cc076100 0x7f62cc19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 -- 172.21.15.84:0/2474298490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62cc10ff10 msgr2=0x7f62cc1a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62cc10ff10 0x7f62cc1a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.330+0000 7f62caa00640 1 -- 172.21.15.84:0/2474298490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc1a2440 con 0x7f62cc0757b0 2024-09-21T07:52:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.331+0000 7f62caa00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc19c4d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f62bc005940 tx=0x7f62bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.331+0000 7f62c3400640 1 -- 172.21.15.84:0/2474298490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc03f030 con 0x7f62cc0757b0 2024-09-21T07:52:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.331+0000 7f62c3400640 1 -- 172.21.15.84:0/2474298490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62bc003aa0 con 0x7f62cc0757b0 2024-09-21T07:52:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.331+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc1a26d0 con 0x7f62cc0757b0 2024-09-21T07:52:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.331+0000 7f62c3400640 1 -- 172.21.15.84:0/2474298490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc035070 con 0x7f62cc0757b0 2024-09-21T07:52:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.331+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc1a8e90 con 0x7f62cc0757b0 2024-09-21T07:52:11.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.333+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc075bc0 con 0x7f62cc0757b0 2024-09-21T07:52:11.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.335+0000 7f62c3400640 1 -- 172.21.15.84:0/2474298490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f62bc042030 con 0x7f62cc0757b0 2024-09-21T07:52:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.337+0000 7f62c3400640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f62b00b6700 0x7f62b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:11.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.338+0000 7f62c3400640 1 -- 172.21.15.84:0/2474298490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f62bc108380 con 0x7f62cc0757b0 2024-09-21T07:52:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.338+0000 7f62ca000640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f62b00b6700 0x7f62b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:11.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.338+0000 7f62ca000640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f62b00b6700 0x7f62b00b8c10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f62b80095f0 tx=0x7f62b8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:11.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.339+0000 7f62c3400640 1 -- 172.21.15.84:0/2474298490 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62bc0d2940 con 0x7f62cc0757b0 2024-09-21T07:52:11.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:11 smithi191 ceph-mon[34667]: pgmap v426: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:52:11.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:11 smithi162 ceph-mon[34833]: pgmap v426: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:52:11.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:11 smithi084 ceph-mon[30411]: pgmap v426: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-21T07:52:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.574+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62cc19d600 con 0x7f62cc0757b0 2024-09-21T07:52:11.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.575+0000 7f62c3400640 1 -- 172.21.15.84:0/2474298490 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f62bc0d7880 con 0x7f62cc0757b0 2024-09-21T07:52:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:52:11.577 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:52:11.577 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:52:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f62b00b6700 msgr2=0x7f62b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f62b00b6700 0x7f62b00b8c10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f62b80095f0 tx=0x7f62b8005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:11.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 msgr2=0x7f62cc19c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc19c4d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f62bc005940 tx=0x7f62bc004270 comp rx=0 tx=0).stop 2024-09-21T07:52:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 shutdown_connections 2024-09-21T07:52:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f62b00b6700 0x7f62b00b8c10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62cc10ff10 0x7f62cc1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62cc076100 0x7f62cc19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 --2- 172.21.15.84:0/2474298490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62cc0757b0 0x7f62cc19c4d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:11.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 >> 172.21.15.84:0/2474298490 conn(0x7f62cc0ff440 msgr2=0x7f62cc109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 shutdown_connections 2024-09-21T07:52:11.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:11.578+0000 7f62cbe00640 1 -- 172.21.15.84:0/2474298490 wait complete. 2024-09-21T07:52:11.748 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-09-21T07:52:11.749 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:11.750 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T07:52:11.750 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:11.750 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:52:11.763 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T07:52:11.850 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T07:52:11.855 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:52:11.855 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T07:52:12.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:12 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2474298490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:12.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:12 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2474298490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:12.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:12 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2474298490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:12.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:52:13.015 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:13.141 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T07:52:13.283 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T07:52:13.349 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:52:13.353 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:52:13.353 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T07:52:13.398 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:13 smithi084 ceph-mon[30411]: pgmap v427: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T07:52:13.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:13 smithi191 ceph-mon[34667]: pgmap v427: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T07:52:13.424 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:52:13.432 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T07:52:13.432 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T07:52:13.468 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-21T07:52:13.469 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-21T07:52:13.469 DEBUG:teuthology.orchestra.run.smithi084:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-21T07:52:13.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:13 smithi162 ceph-mon[34833]: pgmap v427: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T07:52:13.555 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T07:52:13.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:52:13.559 INFO:tasks.workunit.client.0.smithi084.stdout:getting iogen 2024-09-21T07:52:13.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'getting iogen' 2024-09-21T07:52:13.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-21T07:52:13.640 INFO:tasks.workunit.client.0.smithi084.stderr:--2024-09-21 07:52:13-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-21T07:52:13.649 INFO:tasks.workunit.client.0.smithi084.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T07:52:13.671 INFO:tasks.workunit.client.0.smithi084.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T07:52:13.691 INFO:tasks.workunit.client.0.smithi084.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T07:52:13.691 INFO:tasks.workunit.client.0.smithi084.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-21T07:52:13.693 INFO:tasks.workunit.client.0.smithi084.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-21T07:52:13.697 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:13.697 INFO:tasks.workunit.client.0.smithi084.stderr: 0K ....... 100% 585M=0s 2024-09-21T07:52:13.697 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:13.698 INFO:tasks.workunit.client.0.smithi084.stderr:2024-09-21 07:52:13 (585 MB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-21T07:52:13.698 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T07:52:13.698 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-21T07:52:13.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 -- 172.21.15.84:0/505959713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 msgr2=0x7f131c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 --2- 172.21.15.84:0/505959713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 0x7f131c104de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f130c009900 tx=0x7f130c02a410 comp rx=0 tx=0).stop 2024-09-21T07:52:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 -- 172.21.15.84:0/505959713 shutdown_connections 2024-09-21T07:52:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 --2- 172.21.15.84:0/505959713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c10de30 0x7f131c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 --2- 172.21.15.84:0/505959713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 0x7f131c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 --2- 172.21.15.84:0/505959713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 0x7f131c104de0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 -- 172.21.15.84:0/505959713 >> 172.21.15.84:0/505959713 conn(0x7f131c079740 msgr2=0x7f131c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 -- 172.21.15.84:0/505959713 shutdown_connections 2024-09-21T07:52:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.718+0000 7f1320c00640 1 -- 172.21.15.84:0/505959713 wait complete. 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.719+0000 7f1320c00640 1 Processor -- start 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.719+0000 7f1320c00640 1 -- start start 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1320c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 0x7f131c19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1320c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 0x7f131c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1320c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c10de30 0x7f131c1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1320c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f131c113ab0 con 0x7f131c1049d0 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1320c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f131c113930 con 0x7f131c10de30 2024-09-21T07:52:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1320c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f131c113c30 con 0x7f131c105320 2024-09-21T07:52:13.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1319e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 0x7f131c19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1319400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 0x7f131c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1319400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 0x7f131c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49444/0 (socket says 172.21.15.84:49444) 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f1319400640 1 -- 172.21.15.84:0/3881562404 learned_addr learned my addr 172.21.15.84:0/3881562404 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.720+0000 7f131a800640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c10de30 0x7f131c1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1319400640 1 -- 172.21.15.84:0/3881562404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c10de30 msgr2=0x7f131c1a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1319400640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c10de30 0x7f131c1a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1319400640 1 -- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 msgr2=0x7f131c19c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1319400640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 0x7f131c19c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1319400640 1 -- 172.21.15.84:0/3881562404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c1a2630 con 0x7f131c105320 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1319400640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 0x7f131c19cc60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f130800e9c0 tx=0x7f130800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1312a00640 1 -- 172.21.15.84:0/3881562404 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130800ccc0 con 0x7f131c105320 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c1a2920 con 0x7f131c105320 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1312a00640 1 -- 172.21.15.84:0/3881562404 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13080054d0 con 0x7f131c105320 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.721+0000 7f1312a00640 1 -- 172.21.15.84:0/3881562404 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308010430 con 0x7f131c105320 2024-09-21T07:52:13.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.722+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c1a9080 con 0x7f131c105320 2024-09-21T07:52:13.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 Processor -- start 2024-09-21T07:52:13.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 -- start start 2024-09-21T07:52:13.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb5b070 0x55d62bf01ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf020e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb3a390 0x55d62bf02620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d62be78fb0 con 0x55d62bb321b0 2024-09-21T07:52:13.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d62be683e0 con 0x55d62bb5b070 2024-09-21T07:52:13.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f13277ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d62be6c1f0 con 0x55d62bb3a390 2024-09-21T07:52:13.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f1312a00640 1 -- 172.21.15.84:0/3881562404 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f1308005020 con 0x7f131c105320 2024-09-21T07:52:13.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f1319e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f1319e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45096/0 (socket says 172.21.15.84:45096) 2024-09-21T07:52:13.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.725+0000 7f1319e00640 1 -- 172.21.15.84:0/3786104417 learned_addr learned my addr 172.21.15.84:0/3786104417 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f131a800640 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb5b070 0x55d62bf01ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f1319400640 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb3a390 0x55d62bf02620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f1319e00640 1 -- 172.21.15.84:0/3786104417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb3a390 msgr2=0x55d62bf02620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f1319e00640 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb3a390 0x55d62bf02620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f1319e00640 1 -- 172.21.15.84:0/3786104417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb5b070 msgr2=0x55d62bf01ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f1319e00640 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb5b070 0x55d62bf01ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f1319e00640 1 -- 172.21.15.84:0/3786104417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62be32cd0 con 0x55d62bb321b0 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f131a800640 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb5b070 0x55d62bf01ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.726+0000 7f1319400640 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb3a390 0x55d62bf02620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.727+0000 7f1319e00640 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf020e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f131c06c940 tx=0x7f130c032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d67849799020aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:13.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.727+0000 7f1307000640 1 -- 172.21.15.84:0/3786104417 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c040070 con 0x55d62bb321b0 2024-09-21T07:52:13.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.727+0000 7f1307000640 1 -- 172.21.15.84:0/3786104417 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f130c004030 con 0x55d62bb321b0 2024-09-21T07:52:13.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.727+0000 7f1307000640 1 -- 172.21.15.84:0/3786104417 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c035040 con 0x55d62bb321b0 2024-09-21T07:52:13.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f1312a00640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f13000b6700 0x7f13000b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f1312a00640 1 -- 172.21.15.84:0/3881562404 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f13080e7d70 con 0x7f131c105320 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f131a800640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f13000b6700 0x7f13000b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f13277ef740 1 -- 172.21.15.84:0/3786104417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 msgr2=0x55d62bf020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f13277ef740 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf020e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f131c06c940 tx=0x7f130c032b20 comp rx=0 tx=0).stop 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f13277ef740 1 -- 172.21.15.84:0/3786104417 shutdown_connections 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f13277ef740 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb3a390 0x55d62bf02620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f13277ef740 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf020e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f13277ef740 1 --2- 172.21.15.84:0/3786104417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb5b070 0x55d62bf01ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.728+0000 7f13277ef740 1 -- 172.21.15.84:0/3786104417 >> 172.21.15.84:0/3786104417 conn(0x55d62bb4f460 msgr2=0x55d62beffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.729+0000 7f13277ef740 1 -- 172.21.15.84:0/3786104417 shutdown_connections 2024-09-21T07:52:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.729+0000 7f13277ef740 1 -- 172.21.15.84:0/3786104417 wait complete. 2024-09-21T07:52:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.729+0000 7f131a800640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f13000b6700 0x7f13000b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1314009fd0 tx=0x7f1314009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.729+0000 7f13277ef740 1 -- start start 2024-09-21T07:52:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 1 Processor -- start 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb321b0 0x55d62bf0d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf0dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb5b070 0x55d62bf19640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d62bcc9700 con 0x55d62bb5b070 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d62be03580 con 0x55d62bb3a390 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d62bf10320 con 0x55d62bb321b0 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.730+0000 7f13277ef740 10 client.0 _ll_register_callbacks cb 0x55d62be13470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f131a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb5b070 0x55d62bf19640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb321b0 0x55d62bf0d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f131a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb5b070 0x55d62bf19640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45098/0 (socket says 172.21.15.84:45098) 2024-09-21T07:52:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f131a800640 1 -- 172.21.15.84:0/3826039090 learned_addr learned my addr 172.21.15.84:0/3826039090 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:13.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319400640 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf0dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319400640 1 -- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb321b0 msgr2=0x55d62bf0d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319400640 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb321b0 0x55d62bf0d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319400640 1 -- 172.21.15.84:0/3826039090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb5b070 msgr2=0x55d62bf19640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319400640 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb5b070 0x55d62bf19640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319400640 1 -- 172.21.15.84:0/3826039090 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62bbc6650 con 0x55d62bb3a390 2024-09-21T07:52:13.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319e00640 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb321b0 0x55d62bf0d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:13.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f1319400640 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf0dc60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13080e5150 tx=0x7f13080ad6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd573646dbfed4ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:13.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.731+0000 7f12fb400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:13.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f12fb400640 1 -- 172.21.15.84:0/3826039090 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130800ce60 con 0x55d62bb3a390 2024-09-21T07:52:13.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f12fb400640 1 -- 172.21.15.84:0/3826039090 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f13080accc0 con 0x55d62bb3a390 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d62be05b90 con 0x55d62bb3a390 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f12fb400640 1 -- 172.21.15.84:0/3826039090 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1308005310 con 0x55d62bb3a390 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f13277ef740 10 client.26003 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d62be20950 con 0x55d62bb3a390 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f12fb400640 1 -- 172.21.15.84:0/3826039090 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d62be05b90 con 0x55d62bb3a390 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f12fb400640 1 -- 172.21.15.84:0/3826039090 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f13080ac520 con 0x55d62bb3a390 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f13277ef740 10 client.26003 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.732+0000 7f13277ef740 10 client.26003 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.733+0000 7f13277ef740 20 client.26003 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.733+0000 7f13277ef740 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62bb199f0 0x55d62bf1f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.733+0000 7f13277ef740 4 client.26003 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.733+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d62be7af00 con 0x55d62bb199f0 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.733+0000 7f1319e00640 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62bb199f0 0x55d62bf1f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.734+0000 7f1319e00640 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62bb199f0 0x55d62bf1f5e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=22668aa46a96a5fd server_cookie=129d20fc494d133c in_seq=0 out_seq=0 2024-09-21T07:52:13.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.734+0000 7f12fb400640 10 client.26003 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.734+0000 7f12fb400640 1 -- 172.21.15.84:0/3826039090 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d62be7af00 con 0x55d62bb199f0 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.734+0000 7f12fb400640 10 client.26003 handle_command_reply: tid=0 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 client.26003 shutdown 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 msgr2=0x55d62bf0dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf0dc60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13080e5150 tx=0x7f13080ad6e0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 shutdown_connections 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62bb199f0 0x55d62bf1f5e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb5b070 0x55d62bf19640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf0dc60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 --2- 172.21.15.84:0/3826039090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb321b0 0x55d62bf0d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 >> 172.21.15.84:0/3826039090 conn(0x55d62bb4f460 msgr2=0x55d62bf04d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f12fb400640 0 client.26003 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 shutdown_connections 2024-09-21T07:52:13.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 1 -- 172.21.15.84:0/3826039090 wait complete. 2024-09-21T07:52:13.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.735+0000 7f13277ef740 20 client.26003 trim_cache size 0 max 16384 2024-09-21T07:52:13.743 INFO:tasks.workunit.client.0.smithi084.stdout:iogen_3.1p0 2024-09-21T07:52:13.745 INFO:tasks.workunit.client.0.smithi084.stdout:iogen_3.1p0/src 2024-09-21T07:52:13.746 INFO:tasks.workunit.client.0.smithi084.stdout:iogen_3.1p0/src/iogen.8 2024-09-21T07:52:13.747 INFO:tasks.workunit.client.0.smithi084.stdout:iogen_3.1p0/src/iogen.c 2024-09-21T07:52:13.749 INFO:tasks.workunit.client.0.smithi084.stdout:iogen_3.1p0/README 2024-09-21T07:52:13.750 INFO:tasks.workunit.client.0.smithi084.stdout:iogen_3.1p0/Makefile.bsd 2024-09-21T07:52:13.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.749+0000 7f13277ef740 1 Processor -- start 2024-09-21T07:52:13.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f13277ef740 1 -- start start 2024-09-21T07:52:13.752 INFO:tasks.workunit.client.0.smithi084.stdout:iogen_3.1p0/Makefile 2024-09-21T07:52:13.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f13277ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb321b0 0x55d62bf0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f13277ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb3a390 0x55d62bf0c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f13277ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf19540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f13277ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1b2ee0 con 0x55d62bb3a390 2024-09-21T07:52:13.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f13277ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1b4a20 con 0x55d62bb321b0 2024-09-21T07:52:13.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f13277ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1b35b0 con 0x55d62bb5b070 2024-09-21T07:52:13.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f1319e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb321b0 0x55d62bf0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f131a800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf19540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f1319e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb321b0 0x55d62bf0bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53442/0 (socket says 172.21.15.84:53442) 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.750+0000 7f1319e00640 1 -- 172.21.15.84:0/2139241388 learned_addr learned my addr 172.21.15.84:0/2139241388 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f1319400640 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb3a390 0x55d62bf0c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f131a800640 1 -- 172.21.15.84:0/2139241388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb321b0 msgr2=0x55d62bf0bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f131a800640 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb321b0 0x55d62bf0bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f131a800640 1 -- 172.21.15.84:0/2139241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb3a390 msgr2=0x55d62bf0c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f131a800640 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb3a390 0x55d62bf0c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f131a800640 1 -- 172.21.15.84:0/2139241388 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62bf0ba20 con 0x55d62bb5b070 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f1319e00640 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb321b0 0x55d62bf0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f1319400640 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb3a390 0x55d62bf0c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.751+0000 7f131a800640 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf19540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f131400f660 tx=0x7f1314019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1532d86ca5726c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:13.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.752+0000 7f1306600640 1 -- 172.21.15.84:0/2139241388 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314003a30 con 0x55d62bb5b070 2024-09-21T07:52:13.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.752+0000 7f1306600640 1 -- 172.21.15.84:0/2139241388 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1314003bd0 con 0x55d62bb5b070 2024-09-21T07:52:13.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.752+0000 7f1306600640 1 -- 172.21.15.84:0/2139241388 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13140109a0 con 0x55d62bb5b070 2024-09-21T07:52:13.755 INFO:tasks.workunit.client.0.smithi084.stderr:+ cd iogen_3.1p0 2024-09-21T07:52:13.755 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'making iogen' 2024-09-21T07:52:13.755 INFO:tasks.workunit.client.0.smithi084.stdout:making iogen 2024-09-21T07:52:13.756 INFO:tasks.workunit.client.0.smithi084.stderr:+ make 2024-09-21T07:52:13.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 -- 172.21.15.84:0/2139241388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 msgr2=0x55d62bf19540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf19540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f131400f660 tx=0x7f1314019000 comp rx=0 tx=0).stop 2024-09-21T07:52:13.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 -- 172.21.15.84:0/2139241388 shutdown_connections 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf19540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb3a390 0x55d62bf0c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 --2- 172.21.15.84:0/2139241388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb321b0 0x55d62bf0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 -- 172.21.15.84:0/2139241388 >> 172.21.15.84:0/2139241388 conn(0x55d62bb4f460 msgr2=0x55d62bf08660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 -- 172.21.15.84:0/2139241388 shutdown_connections 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.753+0000 7f13277ef740 1 -- 172.21.15.84:0/2139241388 wait complete. 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.754+0000 7f13277ef740 1 -- start start 2024-09-21T07:52:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.754+0000 7f13277ef740 1 Processor -- start 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f13277ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf15df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f13277ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f13277ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf11840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f13277ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1b4350 con 0x55d62bb321b0 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f13277ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1b3c80 con 0x55d62bb3a390 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f13277ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1b0ea0 con 0x55d62bb5b070 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f13277ef740 10 client.0 _ll_register_callbacks cb 0x7f13080a97c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f1319e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf15df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f131a800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf11840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f1319e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf15df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45122/0 (socket says 172.21.15.84:45122) 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f1319e00640 1 -- 172.21.15.84:0/1549365321 learned_addr learned my addr 172.21.15.84:0/1549365321 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.755+0000 7f1319400640 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.756+0000 7f131a800640 1 -- 172.21.15.84:0/1549365321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 msgr2=0x55d62bf112a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.756+0000 7f131a800640 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf112a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.756+0000 7f131a800640 1 -- 172.21.15.84:0/1549365321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 msgr2=0x55d62bf15df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.756+0000 7f131a800640 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf15df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.756+0000 7f131a800640 1 -- 172.21.15.84:0/1549365321 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62bf11fd0 con 0x55d62bb5b070 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.756+0000 7f131a800640 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf11840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f131400f660 tx=0x7f1314003a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97f3a9299c0189e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:13.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.756+0000 7f12fb400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.757+0000 7f12fb400640 1 -- 172.21.15.84:0/1549365321 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314004250 con 0x55d62bb5b070 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.757+0000 7f12fb400640 1 -- 172.21.15.84:0/1549365321 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f13140043f0 con 0x55d62bb5b070 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.757+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1314003bd0 con 0x55d62bb5b070 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.757+0000 7f12fb400640 1 -- 172.21.15.84:0/1549365321 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f131403b050 con 0x55d62bb5b070 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.757+0000 7f13277ef740 10 client.26020 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.757+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d62bf89f90 con 0x55d62bb5b070 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.757+0000 7f12fb400640 1 -- 172.21.15.84:0/1549365321 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1314003bd0 con 0x55d62bb5b070 2024-09-21T07:52:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f12fb400640 1 -- 172.21.15.84:0/1549365321 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f13140295f0 con 0x55d62bb5b070 2024-09-21T07:52:13.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f13277ef740 10 client.26020 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:13.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f13277ef740 10 client.26020 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:52:13.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f13277ef740 20 client.26020 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:13.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f13277ef740 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62baeeda0 0x55d62bf8c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:13.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f13277ef740 4 client.26020 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:13.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d62be769b0 con 0x55d62baeeda0 2024-09-21T07:52:13.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.758+0000 7f1319e00640 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62baeeda0 0x55d62bf8c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.759+0000 7f1319e00640 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62baeeda0 0x55d62bf8c670 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c8ed653f0f71dfcd server_cookie=1c4680f9c06194ec in_seq=0 out_seq=0 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.759+0000 7f12fb400640 10 client.26020 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.759+0000 7f12fb400640 1 -- 172.21.15.84:0/1549365321 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d62be769b0 con 0x55d62baeeda0 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.759+0000 7f12fb400640 10 client.26020 handle_command_reply: tid=0 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.759+0000 7f13277ef740 1 client.26020 shutdown 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 msgr2=0x55d62bf11840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf11840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f131400f660 tx=0x7f1314003a30 comp rx=0 tx=0).stop 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 shutdown_connections 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55d62baeeda0 0x55d62bf8c670 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d62bb5b070 0x55d62bf11840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d62bb3a390 0x55d62bf112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 --2- 172.21.15.84:0/1549365321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d62bb321b0 0x55d62bf15df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 >> 172.21.15.84:0/1549365321 conn(0x55d62bb4f460 msgr2=0x55d62bf08660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:13.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f12fb400640 0 client.26020 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:13.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 shutdown_connections 2024-09-21T07:52:13.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.760+0000 7f13277ef740 1 -- 172.21.15.84:0/1549365321 wait complete. 2024-09-21T07:52:13.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.761+0000 7f13277ef740 20 client.26020 trim_cache size 0 max 16384 2024-09-21T07:52:13.764 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:13.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f13000b6700 msgr2=0x7f13000b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f13000b6700 0x7f13000b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1314009fd0 tx=0x7f1314009500 comp rx=0 tx=0).stop 2024-09-21T07:52:13.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 msgr2=0x7f131c19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:13.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 0x7f131c19cc60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f130800e9c0 tx=0x7f130800ee80 comp rx=0 tx=0).stop 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 shutdown_connections 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f13000b6700 0x7f13000b8c10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c10de30 0x7f131c1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f131c105320 0x7f131c19cc60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 --2- 172.21.15.84:0/3881562404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c1049d0 0x7f131c19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.762+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 >> 172.21.15.84:0/3881562404 conn(0x7f131c079740 msgr2=0x7f131c100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.763+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 shutdown_connections 2024-09-21T07:52:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:13.763+0000 7f1320c00640 1 -- 172.21.15.84:0/3881562404 wait complete. 2024-09-21T07:52:13.769 INFO:tasks.workunit.client.0.smithi084.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-21T07:52:14.354 INFO:tasks.workunit.client.0.smithi084.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-21T07:52:14.706 INFO:tasks.workunit.client.0.smithi084.stdout:running iogen 2024-09-21T07:52:14.706 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'running iogen' 2024-09-21T07:52:14.706 INFO:tasks.workunit.client.0.smithi084.stderr:+ ./iogen -n 5 -s 2g 2024-09-21T07:52:14.708 INFO:tasks.workunit.client.0.smithi084.stderr:child spawned 92832 2024-09-21T07:52:14.708 INFO:tasks.workunit.client.0.smithi084.stderr:child spawned 92833 2024-09-21T07:52:14.709 INFO:tasks.workunit.client.0.smithi084.stderr:child spawned 92834 2024-09-21T07:52:14.709 INFO:tasks.workunit.client.0.smithi084.stderr:child spawned 92835 2024-09-21T07:52:14.709 INFO:tasks.workunit.client.0.smithi084.stderr:child spawned 92836 2024-09-21T07:52:14.710 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'sleep for 10 min' 2024-09-21T07:52:14.710 INFO:tasks.workunit.client.0.smithi084.stdout:sleep for 10 min 2024-09-21T07:52:14.710 INFO:tasks.workunit.client.0.smithi084.stderr:+ sleep 600 2024-09-21T07:52:14.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:52:14.752 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:15.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:15 smithi084 ceph-mon[30411]: pgmap v428: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:52:15.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:15 smithi191 ceph-mon[34667]: pgmap v428: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:52:15.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:15 smithi162 ceph-mon[34833]: pgmap v428: 129 pgs: 129 active+clean; 1.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-21T07:52:15.581 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.639+0000 7fc067200640 1 -- 172.21.15.84:0/4172642402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068114280 msgr2=0x7fc068116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.639+0000 7fc067200640 1 --2- 172.21.15.84:0/4172642402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068114280 0x7fc068116750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc060009be0 tx=0x7fc06002a6d0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.641+0000 7fc067200640 1 -- 172.21.15.84:0/4172642402 shutdown_connections 2024-09-21T07:52:15.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.641+0000 7fc067200640 1 --2- 172.21.15.84:0/4172642402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068114280 0x7fc068116750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.641+0000 7fc067200640 1 --2- 172.21.15.84:0/4172642402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc068075dd0 0x7fc0680761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.641+0000 7fc067200640 1 --2- 172.21.15.84:0/4172642402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068077380 0x7fc0680757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.641+0000 7fc067200640 1 -- 172.21.15.84:0/4172642402 >> 172.21.15.84:0/4172642402 conn(0x7fc0680ff440 msgr2=0x7fc068101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:15.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.642+0000 7fc067200640 1 -- 172.21.15.84:0/4172642402 shutdown_connections 2024-09-21T07:52:15.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.642+0000 7fc067200640 1 -- 172.21.15.84:0/4172642402 wait complete. 2024-09-21T07:52:15.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.643+0000 7fc067200640 1 Processor -- start 2024-09-21T07:52:15.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.644+0000 7fc067200640 1 -- start start 2024-09-21T07:52:15.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.644+0000 7fc067200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc068075dd0 0x7fc0681a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.644+0000 7fc067200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068077380 0x7fc0681a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.644+0000 7fc067200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068114280 0x7fc0681a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.644+0000 7fc067200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc068119ec0 con 0x7fc068114280 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.644+0000 7fc067200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc068119d40 con 0x7fc068077380 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.644+0000 7fc067200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc06811a040 con 0x7fc068075dd0 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.645+0000 7fc066800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068114280 0x7fc0681a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.645+0000 7fc066800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068114280 0x7fc0681a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45154/0 (socket says 172.21.15.84:45154) 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.645+0000 7fc066800640 1 -- 172.21.15.84:0/1123187169 learned_addr learned my addr 172.21.15.84:0/1123187169 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.645+0000 7fc065e00640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc068075dd0 0x7fc0681a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.645+0000 7fc065400640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068077380 0x7fc0681a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.646+0000 7fc066800640 1 -- 172.21.15.84:0/1123187169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc068075dd0 msgr2=0x7fc0681a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.646+0000 7fc066800640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc068075dd0 0x7fc0681a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.646+0000 7fc066800640 1 -- 172.21.15.84:0/1123187169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068077380 msgr2=0x7fc0681a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:15.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.646+0000 7fc066800640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068077380 0x7fc0681a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:15.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.646+0000 7fc066800640 1 -- 172.21.15.84:0/1123187169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0681a67e0 con 0x7fc068114280 2024-09-21T07:52:15.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.647+0000 7fc066800640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068114280 0x7fc0681a60b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc060009b30 tx=0x7fc060003cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:15.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.648+0000 7fc05ea00640 1 -- 172.21.15.84:0/1123187169 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060040020 con 0x7fc068114280 2024-09-21T07:52:15.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.648+0000 7fc05ea00640 1 -- 172.21.15.84:0/1123187169 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc060030970 con 0x7fc068114280 2024-09-21T07:52:15.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.648+0000 7fc05ea00640 1 -- 172.21.15.84:0/1123187169 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060036040 con 0x7fc068114280 2024-09-21T07:52:15.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.649+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0681a6a70 con 0x7fc068114280 2024-09-21T07:52:15.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.649+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0681a6ed0 con 0x7fc068114280 2024-09-21T07:52:15.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.651+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0680761e0 con 0x7fc068114280 2024-09-21T07:52:15.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.656+0000 7fc05ea00640 1 -- 172.21.15.84:0/1123187169 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc060043020 con 0x7fc068114280 2024-09-21T07:52:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.659+0000 7fc05ea00640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc04c0b6780 0x7fc04c0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.659+0000 7fc05ea00640 1 -- 172.21.15.84:0/1123187169 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc0601089b0 con 0x7fc068114280 2024-09-21T07:52:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.660+0000 7fc065e00640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc04c0b6780 0x7fc04c0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.661+0000 7fc065e00640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc04c0b6780 0x7fc04c0b8c90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc058005fd0 tx=0x7fc05800b590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:15.664+0000 7fc05ea00640 1 -- 172.21.15.84:0/1123187169 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc06004a070 con 0x7fc068114280 2024-09-21T07:52:16.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.204+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0681a19a0 con 0x7fc068114280 2024-09-21T07:52:16.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:52:16.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.222+0000 7fc05ea00640 1 -- 172.21.15.84:0/1123187169 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fc0681a19a0 con 0x7fc068114280 2024-09-21T07:52:16.228 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:52:16.229 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:52:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc04c0b6780 msgr2=0x7fc04c0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc04c0b6780 0x7fc04c0b8c90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc058005fd0 tx=0x7fc05800b590 comp rx=0 tx=0).stop 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068114280 msgr2=0x7fc0681a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068114280 0x7fc0681a60b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc060009b30 tx=0x7fc060003cc0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 shutdown_connections 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc04c0b6780 0x7fc04c0b8c90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc068114280 0x7fc0681a60b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.232+0000 7fc067200640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068077380 0x7fc0681a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.233+0000 7fc067200640 1 --2- 172.21.15.84:0/1123187169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc068075dd0 0x7fc0681a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.233+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 >> 172.21.15.84:0/1123187169 conn(0x7fc0680ff440 msgr2=0x7fc068110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.233+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 shutdown_connections 2024-09-21T07:52:16.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.233+0000 7fc067200640 1 -- 172.21.15.84:0/1123187169 wait complete. 2024-09-21T07:52:16.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.540+0000 7f73d2a00640 1 -- 172.21.15.84:0/3994991008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc076100 msgr2=0x7f73cc10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.540+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3994991008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc076100 0x7f73cc10f9d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009900 tx=0x7f73b802a420 comp rx=0 tx=0).stop 2024-09-21T07:52:16.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.540+0000 7f73d2a00640 1 -- 172.21.15.84:0/3994991008 shutdown_connections 2024-09-21T07:52:16.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.540+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3994991008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73cc10ff10 0x7f73cc112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.540+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3994991008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc076100 0x7f73cc10f9d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.540+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3994991008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73cc0757b0 0x7f73cc075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.540+0000 7f73d2a00640 1 -- 172.21.15.84:0/3994991008 >> 172.21.15.84:0/3994991008 conn(0x7f73cc0ff440 msgr2=0x7f73cc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.541+0000 7f73d2a00640 1 -- 172.21.15.84:0/3994991008 shutdown_connections 2024-09-21T07:52:16.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.541+0000 7f73d2a00640 1 -- 172.21.15.84:0/3994991008 wait complete. 2024-09-21T07:52:16.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.542+0000 7f73d2a00640 1 Processor -- start 2024-09-21T07:52:16.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.545+0000 7f73d2a00640 1 -- start start 2024-09-21T07:52:16.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.545+0000 7f73d2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73cc0757b0 0x7f73cc10f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.547+0000 7f73d2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73cc076100 0x7f73cc109830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.547+0000 7f73d2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc10ff10 0x7f73cc109d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.547+0000 7f73d2a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc06d3f0 con 0x7f73cc0757b0 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.547+0000 7f73d2a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc06d270 con 0x7f73cc10ff10 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.547+0000 7f73d2a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc06d570 con 0x7f73cc076100 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.548+0000 7f73d0c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73cc076100 0x7f73cc109830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.548+0000 7f73d0c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73cc076100 0x7f73cc109830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49508/0 (socket says 172.21.15.84:49508) 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.548+0000 7f73d0c00640 1 -- 172.21.15.84:0/3744522739 learned_addr learned my addr 172.21.15.84:0/3744522739 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.549+0000 7f73d1600640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73cc0757b0 0x7f73cc10f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.552+0000 7f73d2000640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc10ff10 0x7f73cc109d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.553+0000 7f73d2000640 1 -- 172.21.15.84:0/3744522739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73cc076100 msgr2=0x7f73cc109830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.553+0000 7f73d2000640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73cc076100 0x7f73cc109830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.553+0000 7f73d2000640 1 -- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73cc0757b0 msgr2=0x7f73cc10f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.553+0000 7f73d2000640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73cc0757b0 0x7f73cc10f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.553+0000 7f73d2000640 1 -- 172.21.15.84:0/3744522739 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc10a3b0 con 0x7f73cc10ff10 2024-09-21T07:52:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.558+0000 7f73d2000640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc10ff10 0x7f73cc109d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c740 tx=0x7f73c000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.559+0000 7f73ca000640 1 -- 172.21.15.84:0/3744522739 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0004220 con 0x7f73cc10ff10 2024-09-21T07:52:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.559+0000 7f73ca000640 1 -- 172.21.15.84:0/3744522739 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c000ce50 con 0x7f73cc10ff10 2024-09-21T07:52:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.559+0000 7f73ca000640 1 -- 172.21.15.84:0/3744522739 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c00047a0 con 0x7f73cc10ff10 2024-09-21T07:52:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.561+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc1b12d0 con 0x7f73cc10ff10 2024-09-21T07:52:16.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.561+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc1b1670 con 0x7f73cc10ff10 2024-09-21T07:52:16.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.591+0000 7f73dac3f740 1 Processor -- start 2024-09-21T07:52:16.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.591+0000 7f73ca000640 1 -- 172.21.15.84:0/3744522739 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f73c00079b0 con 0x7f73cc10ff10 2024-09-21T07:52:16.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.592+0000 7f73dac3f740 1 -- start start 2024-09-21T07:52:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e9d1070 0x55b33ed80540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9a81b0 0x55b33ed80a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73dac3f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b33eceefb0 con 0x55b33e9d1070 2024-09-21T07:52:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73dac3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b33ecde3e0 con 0x55b33e9a81b0 2024-09-21T07:52:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73dac3f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b33ece21f0 con 0x55b33e9b0390 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73d1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9a81b0 0x55b33ed80a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73d1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9a81b0 0x55b33ed80a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53504/0 (socket says 172.21.15.84:53504) 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.599+0000 7f73d1600640 1 -- 172.21.15.84:0/1146523420 learned_addr learned my addr 172.21.15.84:0/1146523420 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.600+0000 7f73d1600640 1 -- 172.21.15.84:0/1146523420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 msgr2=0x55b33ed80fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.600+0000 7f73d1600640 1 --2- 172.21.15.84:0/1146523420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed80fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.600+0000 7f73d1600640 1 -- 172.21.15.84:0/1146523420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e9d1070 msgr2=0x55b33ed80540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.600+0000 7f73d1600640 1 --2- 172.21.15.84:0/1146523420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e9d1070 0x55b33ed80540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.600+0000 7f73d1600640 1 -- 172.21.15.84:0/1146523420 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33eca8cd0 con 0x55b33e9a81b0 2024-09-21T07:52:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.601+0000 7f73ca000640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73b40b6800 0x7f73b40b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.601+0000 7f73d1600640 1 --2- 172.21.15.84:0/1146523420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9a81b0 0x55b33ed80a80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009fa0 tx=0x7f73c400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d1e88fe4afa214 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.601+0000 7f73ca000640 1 -- 172.21.15.84:0/3744522739 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f73c00e78a0 con 0x7f73cc10ff10 2024-09-21T07:52:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.603+0000 7f73be600640 1 -- 172.21.15.84:0/1146523420 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c401a070 con 0x55b33e9a81b0 2024-09-21T07:52:16.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.603+0000 7f73be600640 1 -- 172.21.15.84:0/1146523420 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c400aaa0 con 0x55b33e9a81b0 2024-09-21T07:52:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.604+0000 7f73dac3f740 1 -- 172.21.15.84:0/1146523420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9a81b0 msgr2=0x55b33ed80a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.604+0000 7f73dac3f740 1 --2- 172.21.15.84:0/1146523420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9a81b0 0x55b33ed80a80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009fa0 tx=0x7f73c400c890 comp rx=0 tx=0).stop 2024-09-21T07:52:16.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.607+0000 7f73dac3f740 1 -- 172.21.15.84:0/1146523420 shutdown_connections 2024-09-21T07:52:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.607+0000 7f73dac3f740 1 --2- 172.21.15.84:0/1146523420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed80fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.607+0000 7f73dac3f740 1 --2- 172.21.15.84:0/1146523420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9a81b0 0x55b33ed80a80 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009fa0 tx=0x7f73c400c890 comp rx=0 tx=0).stop 2024-09-21T07:52:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.607+0000 7f73dac3f740 1 --2- 172.21.15.84:0/1146523420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e9d1070 0x55b33ed80540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.607+0000 7f73dac3f740 1 -- 172.21.15.84:0/1146523420 >> 172.21.15.84:0/1146523420 conn(0x55b33e9c5460 msgr2=0x55b33ed7e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.610+0000 7f73d0c00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73b40b6800 0x7f73b40b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.610+0000 7f73dac3f740 1 -- 172.21.15.84:0/1146523420 shutdown_connections 2024-09-21T07:52:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.610+0000 7f73dac3f740 1 -- 172.21.15.84:0/1146523420 wait complete. 2024-09-21T07:52:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.612+0000 7f73dac3f740 1 -- start start 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.612+0000 7f73dac3f740 1 Processor -- start 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.617+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed8c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.618+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9d1070 0x55b33ed8c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.618+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed92100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.619+0000 7f73dac3f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b33eb3f700 con 0x55b33e98f9f0 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.619+0000 7f73dac3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b33ec79580 con 0x55b33e9b0390 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.619+0000 7f73dac3f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b33ed8edc0 con 0x55b33e9d1070 2024-09-21T07:52:16.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.619+0000 7f73dac3f740 10 client.0 _ll_register_callbacks cb 0x55b33ec89470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.620+0000 7f73d1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed8c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.620+0000 7f73d1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed8c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53520/0 (socket says 172.21.15.84:53520) 2024-09-21T07:52:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.620+0000 7f73d1600640 1 -- 172.21.15.84:0/2899923737 learned_addr learned my addr 172.21.15.84:0/2899923737 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.620+0000 7f73d0c00640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9d1070 0x55b33ed8c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d0c00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73b40b6800 0x7f73b40b8d10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f73b80096c0 tx=0x7f73b8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d2000640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed92100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d0c00640 1 -- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 msgr2=0x55b33ed8c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d0c00640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed8c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d0c00640 1 -- 172.21.15.84:0/2899923737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 msgr2=0x55b33ed92100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d0c00640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed92100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d0c00640 1 -- 172.21.15.84:0/2899923737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33ea3c650 con 0x55b33e9d1070 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d2000640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed92100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:16.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.621+0000 7f73d1600640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed8c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:16.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.622+0000 7f73d0c00640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9d1070 0x55b33ed8c7d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f73b8000c00 tx=0x7f73b8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd080a4661bb909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.622+0000 7f73b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:16.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.623+0000 7f73b2a00640 1 -- 172.21.15.84:0/2899923737 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b804c070 con 0x55b33e9d1070 2024-09-21T07:52:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.624+0000 7f73b2a00640 1 -- 172.21.15.84:0/2899923737 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f73b8031a30 con 0x55b33e9d1070 2024-09-21T07:52:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.624+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b33ec7bb90 con 0x55b33e9d1070 2024-09-21T07:52:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.626+0000 7f73b2a00640 1 -- 172.21.15.84:0/2899923737 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73b8056050 con 0x55b33e9d1070 2024-09-21T07:52:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.626+0000 7f73dac3f740 10 client.26032 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.626+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b33ec96950 con 0x55b33e9d1070 2024-09-21T07:52:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.627+0000 7f73b2a00640 1 -- 172.21.15.84:0/2899923737 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b33ec7bb90 con 0x55b33e9d1070 2024-09-21T07:52:16.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.631+0000 7f73b2a00640 1 -- 172.21.15.84:0/2899923737 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f73b8048450 con 0x55b33e9d1070 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.635+0000 7f73dac3f740 10 client.26032 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.635+0000 7f73dac3f740 10 client.26032 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.638+0000 7f73dac3f740 20 client.26032 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.638+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e964da0 0x55b33ed9e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.638+0000 7f73dac3f740 4 client.26032 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.638+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b33ecf0f00 con 0x55b33e964da0 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.639+0000 7f73d1600640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e964da0 0x55b33ed9e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.640+0000 7f73d1600640 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e964da0 0x55b33ed9e440 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7bfe5966ff475434 server_cookie=3d9944333c34d3df in_seq=0 out_seq=0 2024-09-21T07:52:16.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.640+0000 7f73b2a00640 10 client.26032 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:16.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.641+0000 7f73b2a00640 1 -- 172.21.15.84:0/2899923737 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b33ecf0f00 con 0x55b33e964da0 2024-09-21T07:52:16.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.641+0000 7f73b2a00640 10 client.26032 handle_command_reply: tid=0 2024-09-21T07:52:16.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.641+0000 7f73dac3f740 1 client.26032 shutdown 2024-09-21T07:52:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.646+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9d1070 msgr2=0x55b33ed8c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.646+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9d1070 0x55b33ed8c7d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f73b8000c00 tx=0x7f73b8009260 comp rx=0 tx=0).stop 2024-09-21T07:52:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.648+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 shutdown_connections 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.648+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e964da0 0x55b33ed9e440 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.648+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed92100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.648+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9d1070 0x55b33ed8c7d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.648+0000 7f73b2a00640 0 client.26032 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.648+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2899923737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed8c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.648+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 >> 172.21.15.84:0/2899923737 conn(0x55b33e9c5460 msgr2=0x55b33ed83720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.649+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 shutdown_connections 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.649+0000 7f73dac3f740 1 -- 172.21.15.84:0/2899923737 wait complete. 2024-09-21T07:52:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.649+0000 7f73dac3f740 20 client.26032 trim_cache size 0 max 16384 2024-09-21T07:52:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.703+0000 7f73dac3f740 1 Processor -- start 2024-09-21T07:52:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.703+0000 7f73dac3f740 1 -- start start 2024-09-21T07:52:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.705+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e964da0 0x55b33ed92070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.705+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e98f9f0 0x55b33ed7e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.705+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed857c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.706+0000 7f73d0c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e98f9f0 0x55b33ed7e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.706+0000 7f73d0c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e98f9f0 0x55b33ed7e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49516/0 (socket says 172.21.15.84:49516) 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.706+0000 7f73d0c00640 1 -- 172.21.15.84:0/2310596663 learned_addr learned my addr 172.21.15.84:0/2310596663 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.706+0000 7f73d2000640 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed857c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.706+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b7370 con 0x55b33e964da0 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.706+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b8eb0 con 0x55b33e9b0390 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.706+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b7a40 con 0x55b33e98f9f0 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.707+0000 7f73d0c00640 1 -- 172.21.15.84:0/2310596663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 msgr2=0x55b33ed857c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.707+0000 7f73d0c00640 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed857c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.707+0000 7f73d0c00640 1 -- 172.21.15.84:0/2310596663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e964da0 msgr2=0x55b33ed92070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:16.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.707+0000 7f73d0c00640 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e964da0 0x55b33ed92070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.707+0000 7f73d0c00640 1 -- 172.21.15.84:0/2310596663 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ed7eda0 con 0x55b33e98f9f0 2024-09-21T07:52:16.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.708+0000 7f73d0c00640 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e98f9f0 0x55b33ed7e410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73b8048820 tx=0x7f73b8048690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5338b9d795805ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.709+0000 7f73bdc00640 1 -- 172.21.15.84:0/2310596663 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b804c070 con 0x55b33e98f9f0 2024-09-21T07:52:16.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.709+0000 7f73bdc00640 1 -- 172.21.15.84:0/2310596663 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b8031ce0 con 0x55b33e98f9f0 2024-09-21T07:52:16.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.709+0000 7f73bdc00640 1 -- 172.21.15.84:0/2310596663 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8035050 con 0x55b33e98f9f0 2024-09-21T07:52:16.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.711+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e98f9f0 msgr2=0x55b33ed7e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.711+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e98f9f0 0x55b33ed7e410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73b8048820 tx=0x7f73b8048690 comp rx=0 tx=0).stop 2024-09-21T07:52:16.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.711+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 shutdown_connections 2024-09-21T07:52:16.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.711+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e9b0390 0x55b33ed857c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.711+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e98f9f0 0x55b33ed7e410 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.711+0000 7f73dac3f740 1 --2- 172.21.15.84:0/2310596663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e964da0 0x55b33ed92070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.711+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 >> 172.21.15.84:0/2310596663 conn(0x55b33e9c5460 msgr2=0x55b33ed7dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.712+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 shutdown_connections 2024-09-21T07:52:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.712+0000 7f73dac3f740 1 -- 172.21.15.84:0/2310596663 wait complete. 2024-09-21T07:52:16.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.713+0000 7f73dac3f740 1 -- start start 2024-09-21T07:52:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.714+0000 7f73dac3f740 1 Processor -- start 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.715+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e964da0 0x55b33ed92d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.716+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed93280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.716+0000 7f73dac3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed937c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.716+0000 7f73d1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e964da0 0x55b33ed92d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.716+0000 7f73d1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e964da0 0x55b33ed92d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53528/0 (socket says 172.21.15.84:53528) 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.717+0000 7f73dac3f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b87e0 con 0x55b33e98f9f0 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.717+0000 7f73dac3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b8110 con 0x55b33e964da0 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.717+0000 7f73dac3f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b5350 con 0x55b33e9b0390 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.717+0000 7f73dac3f740 10 client.0 _ll_register_callbacks cb 0x7f73b80035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.717+0000 7f73d1600640 1 -- 172.21.15.84:0/3168078855 learned_addr learned my addr 172.21.15.84:0/3168078855 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:16.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.717+0000 7f73d2000640 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.718+0000 7f73d1600640 1 -- 172.21.15.84:0/3168078855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 msgr2=0x55b33ed937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.718+0000 7f73d1600640 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed937c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.718+0000 7f73d1600640 1 -- 172.21.15.84:0/3168078855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 msgr2=0x55b33ed93280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.718+0000 7f73d1600640 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed93280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.718+0000 7f73d1600640 1 -- 172.21.15.84:0/3168078855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33ed97e90 con 0x55b33e964da0 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.718+0000 7f73d2000640 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed937c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.719+0000 7f73d1600640 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e964da0 0x55b33ed92d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73c40022f0 tx=0x7f73c40097a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f478f8cf124da5bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.719+0000 7f73b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:16.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.719+0000 7f73b2a00640 1 -- 172.21.15.84:0/3168078855 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c402d060 con 0x55b33e964da0 2024-09-21T07:52:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.719+0000 7f73b2a00640 1 -- 172.21.15.84:0/3168078855 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f73c4015710 con 0x55b33e964da0 2024-09-21T07:52:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.722+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b8031ce0 con 0x55b33e964da0 2024-09-21T07:52:16.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.722+0000 7f73b2a00640 1 -- 172.21.15.84:0/3168078855 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73c401a040 con 0x55b33e964da0 2024-09-21T07:52:16.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.722+0000 7f73dac3f740 10 client.26033 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:16.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.722+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b33ee091e0 con 0x55b33e964da0 2024-09-21T07:52:16.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.725+0000 7f73b2a00640 1 -- 172.21.15.84:0/3168078855 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b8031ce0 con 0x55b33e964da0 2024-09-21T07:52:16.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.725+0000 7f73b2a00640 1 -- 172.21.15.84:0/3168078855 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f73c400aab0 con 0x55b33e964da0 2024-09-21T07:52:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.726+0000 7f73dac3f740 10 client.26033 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.726+0000 7f73dac3f740 10 client.26033 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:52:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.726+0000 7f73dac3f740 20 client.26033 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.726+0000 7f73dac3f740 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e9d1070 0x55b33ee0b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.726+0000 7f73dac3f740 4 client.26033 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.726+0000 7f73d0c00640 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e9d1070 0x55b33ee0b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.727+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b33ecec9b0 con 0x55b33e9d1070 2024-09-21T07:52:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.727+0000 7f73d0c00640 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e9d1070 0x55b33ee0b5f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d150223582aeab28 server_cookie=10d0edf54629bc5e in_seq=0 out_seq=0 2024-09-21T07:52:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.727+0000 7f73b2a00640 10 client.26033 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.728+0000 7f73b2a00640 1 -- 172.21.15.84:0/3168078855 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b33ecec9b0 con 0x55b33e9d1070 2024-09-21T07:52:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.728+0000 7f73b2a00640 10 client.26033 handle_command_reply: tid=0 2024-09-21T07:52:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.728+0000 7f73dac3f740 1 client.26033 shutdown 2024-09-21T07:52:16.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.728+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e964da0 msgr2=0x55b33ed92d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.728+0000 7f73dac3f740 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e964da0 0x55b33ed92d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73c40022f0 tx=0x7f73c40097a0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.729+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 shutdown_connections 2024-09-21T07:52:16.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.729+0000 7f73dac3f740 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b33e9d1070 0x55b33ee0b5f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.729+0000 7f73dac3f740 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b33e9b0390 0x55b33ed937c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.729+0000 7f73dac3f740 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b33e98f9f0 0x55b33ed93280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.729+0000 7f73dac3f740 1 --2- 172.21.15.84:0/3168078855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b33e964da0 0x55b33ed92d40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.729+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 >> 172.21.15.84:0/3168078855 conn(0x55b33e9c5460 msgr2=0x55b33ed8a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.729+0000 7f73b2a00640 0 client.26033 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:16.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.730+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 shutdown_connections 2024-09-21T07:52:16.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.730+0000 7f73dac3f740 1 -- 172.21.15.84:0/3168078855 wait complete. 2024-09-21T07:52:16.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.731+0000 7f73dac3f740 20 client.26033 trim_cache size 0 max 16384 2024-09-21T07:52:16.734 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.734+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73b40b6800 msgr2=0x7f73b40b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.734+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73b40b6800 0x7f73b40b8d10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f73b80096c0 tx=0x7f73b8031400 comp rx=0 tx=0).stop 2024-09-21T07:52:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.734+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc10ff10 msgr2=0x7f73cc109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.734+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc10ff10 0x7f73cc109d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c740 tx=0x7f73c000cc00 comp rx=0 tx=0).stop 2024-09-21T07:52:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.735+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 shutdown_connections 2024-09-21T07:52:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.735+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f73b40b6800 0x7f73b40b8d10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.735+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc10ff10 0x7f73cc109d70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.735+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73cc076100 0x7f73cc109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.735+0000 7f73d2a00640 1 --2- 172.21.15.84:0/3744522739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73cc0757b0 0x7f73cc10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.735+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 >> 172.21.15.84:0/3744522739 conn(0x7f73cc0ff440 msgr2=0x7f73cc101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.736+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 shutdown_connections 2024-09-21T07:52:16.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:16.737+0000 7f73d2a00640 1 -- 172.21.15.84:0/3744522739 wait complete. 2024-09-21T07:52:17.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:17 smithi162 ceph-mon[34833]: pgmap v429: 129 pgs: 129 active+clean; 1.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-21T07:52:17.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:17 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1123187169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:17.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:17 smithi084 ceph-mon[30411]: pgmap v429: 129 pgs: 129 active+clean; 1.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-21T07:52:17.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:17 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1123187169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:17.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:17 smithi191 ceph-mon[34667]: pgmap v429: 129 pgs: 129 active+clean; 1.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-21T07:52:17.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:17 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1123187169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.177+0000 7f31eb000640 1 -- 172.21.15.84:0/3757203760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e4103040 msgr2=0x7f31e4107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.177+0000 7f31eb000640 1 --2- 172.21.15.84:0/3757203760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e4103040 0x7f31e4107560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009900 tx=0x7f31cc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.180+0000 7f31eb000640 1 -- 172.21.15.84:0/3757203760 shutdown_connections 2024-09-21T07:52:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.180+0000 7f31eb000640 1 --2- 172.21.15.84:0/3757203760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e4107bb0 0x7f31e4108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.180+0000 7f31eb000640 1 --2- 172.21.15.84:0/3757203760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e4103040 0x7f31e4107560 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.180+0000 7f31eb000640 1 --2- 172.21.15.84:0/3757203760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 0x7f31e4102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.180+0000 7f31eb000640 1 -- 172.21.15.84:0/3757203760 >> 172.21.15.84:0/3757203760 conn(0x7f31e407a740 msgr2=0x7f31e407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.181+0000 7f31eb000640 1 -- 172.21.15.84:0/3757203760 shutdown_connections 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.181+0000 7f31eb000640 1 -- 172.21.15.84:0/3757203760 wait complete. 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.182+0000 7f31eb000640 1 Processor -- start 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.182+0000 7f31eb000640 1 -- start start 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31eb000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 0x7f31e4116cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31eb000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e4103040 0x7f31e410ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31eb000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e4107bb0 0x7f31e41105e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31eb000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31e411a010 con 0x7f31e41026f0 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31eb000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31e4119e90 con 0x7f31e4107bb0 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31eb000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31e411a190 con 0x7f31e4103040 2024-09-21T07:52:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 0x7f31e4116cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 0x7f31e4116cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33130/0 (socket says 172.21.15.84:33130) 2024-09-21T07:52:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.183+0000 7f31e3e00640 1 -- 172.21.15.84:0/629449930 learned_addr learned my addr 172.21.15.84:0/629449930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.184+0000 7f31e3e00640 1 -- 172.21.15.84:0/629449930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e4103040 msgr2=0x7f31e410ff80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:52:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.184+0000 7f31e3e00640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e4103040 0x7f31e410ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.184+0000 7f31e3e00640 1 -- 172.21.15.84:0/629449930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e4107bb0 msgr2=0x7f31e41105e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:52:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.184+0000 7f31e3e00640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e4107bb0 0x7f31e41105e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.184+0000 7f31e3e00640 1 -- 172.21.15.84:0/629449930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e4115920 con 0x7f31e41026f0 2024-09-21T07:52:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.184+0000 7f31e3e00640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 0x7f31e4116cc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009d50 tx=0x7f31dc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.185+0000 7f31e0c00640 1 -- 172.21.15.84:0/629449930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc003b70 con 0x7f31e41026f0 2024-09-21T07:52:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.185+0000 7f31e0c00640 1 -- 172.21.15.84:0/629449930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31dc003d10 con 0x7f31e41026f0 2024-09-21T07:52:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.185+0000 7f31e0c00640 1 -- 172.21.15.84:0/629449930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc010960 con 0x7f31e41026f0 2024-09-21T07:52:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.185+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e4115c10 con 0x7f31e41026f0 2024-09-21T07:52:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.185+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e4116110 con 0x7f31e41026f0 2024-09-21T07:52:19.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.189+0000 7f31f20d6740 1 Processor -- start 2024-09-21T07:52:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31f20d6740 1 -- start start 2024-09-21T07:52:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31e0c00640 1 -- 172.21.15.84:0/629449930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f31dc0045f0 con 0x7f31e41026f0 2024-09-21T07:52:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31f20d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558d77f296b0 con 0x558d77bee4d0 2024-09-21T07:52:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31f20d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558d77f18ae0 con 0x558d77be62f0 2024-09-21T07:52:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.193+0000 7f31f20d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558d77f1c8f0 con 0x558d77c0f1b0 2024-09-21T07:52:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:51542/0 (socket says 172.21.15.84:51542) 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 -- 172.21.15.84:0/233032733 learned_addr learned my addr 172.21.15.84:0/233032733 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e3400640 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e3e00640 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 -- 172.21.15.84:0/233032733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 msgr2=0x558d77fb4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 -- 172.21.15.84:0/233032733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 msgr2=0x558d77fb46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e9000640 1 -- 172.21.15.84:0/233032733 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d77ee5780 con 0x558d77c0f1b0 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.194+0000 7f31e3e00640 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.195+0000 7f31e9000640 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb3c30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009a50 tx=0x7f31d4009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a643f8ccd809704 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.195+0000 7f31d9600640 1 -- 172.21.15.84:0/233032733 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4004220 con 0x558d77c0f1b0 2024-09-21T07:52:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.195+0000 7f31d9600640 1 -- 172.21.15.84:0/233032733 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d40043c0 con 0x558d77c0f1b0 2024-09-21T07:52:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.195+0000 7f31d9600640 1 -- 172.21.15.84:0/233032733 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4010430 con 0x558d77c0f1b0 2024-09-21T07:52:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 -- 172.21.15.84:0/233032733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 msgr2=0x558d77fb3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb3c30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009a50 tx=0x7f31d4009f10 comp rx=0 tx=0).stop 2024-09-21T07:52:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 -- 172.21.15.84:0/233032733 shutdown_connections 2024-09-21T07:52:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 --2- 172.21.15.84:0/233032733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb3c30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 -- 172.21.15.84:0/233032733 >> 172.21.15.84:0/233032733 conn(0x558d77c03300 msgr2=0x558d77fb1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 -- 172.21.15.84:0/233032733 shutdown_connections 2024-09-21T07:52:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31f20d6740 1 -- 172.21.15.84:0/233032733 wait complete. 2024-09-21T07:52:19.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.196+0000 7f31e0c00640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c80b6690 0x7f31c80b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.197+0000 7f31e0c00640 1 -- 172.21.15.84:0/629449930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f31dc0e82c0 con 0x7f31e41026f0 2024-09-21T07:52:19.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.197+0000 7f31e3400640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c80b6690 0x7f31c80b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.197+0000 7f31f20d6740 1 -- start start 2024-09-21T07:52:19.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.198+0000 7f31f20d6740 1 Processor -- start 2024-09-21T07:52:19.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.198+0000 7f31e3400640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c80b6690 0x7f31c80b8ba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02a910 tx=0x7f31cc031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.198+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77be62f0 0x558d77fbf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.198+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fbf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.198+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77c0f1b0 0x558d77fbfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31f20d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558d77e50ab0 con 0x558d77c0f1b0 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31f20d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558d77ebf570 con 0x558d77bee4d0 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31f20d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558d77fc23b0 con 0x558d77be62f0 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77be62f0 0x558d77fbf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77be62f0 0x558d77fbf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:51546/0 (socket says 172.21.15.84:51546) 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 -- 172.21.15.84:0/1694887536 learned_addr learned my addr 172.21.15.84:0/1694887536 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31f20d6740 10 client.0 _ll_register_callbacks cb 0x558d77ece100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e9000640 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77c0f1b0 0x558d77fbfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 -- 172.21.15.84:0/1694887536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 msgr2=0x558d77fbf770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fbf770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 -- 172.21.15.84:0/1694887536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77c0f1b0 msgr2=0x558d77fbfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77c0f1b0 0x558d77fbfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 -- 172.21.15.84:0/1694887536 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d77c7a790 con 0x558d77be62f0 2024-09-21T07:52:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e9000640 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77c0f1b0 0x558d77fbfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31e3e00640 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77be62f0 0x558d77fbf230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009d20 tx=0x7f31dc0aa480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b3c14697dd9ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.199+0000 7f31d2000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31d2000640 1 -- 172.21.15.84:0/1694887536 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0ad6f0 con 0x558d77be62f0 2024-09-21T07:52:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31d2000640 1 -- 172.21.15.84:0/1694887536 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f31dc0ad000 con 0x558d77be62f0 2024-09-21T07:52:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31d40043c0 con 0x558d77be62f0 2024-09-21T07:52:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31d2000640 1 -- 172.21.15.84:0/1694887536 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f31dc0ad510 con 0x558d77be62f0 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31f20d6740 10 client.26047 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558d77cf3620 con 0x558d77be62f0 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31d2000640 1 -- 172.21.15.84:0/1694887536 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d40043c0 con 0x558d77be62f0 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.200+0000 7f31d2000640 1 -- 172.21.15.84:0/1694887536 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f31dc0d5190 con 0x558d77be62f0 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.201+0000 7f31f20d6740 10 client.26047 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.201+0000 7f31f20d6740 10 client.26047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.201+0000 7f31f20d6740 20 client.26047 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.201+0000 7f31f20d6740 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77bcdd80 0x558d77fd1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.201+0000 7f31f20d6740 4 client.26047 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.201+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d77f2b600 con 0x558d77bcdd80 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.201+0000 7f31e3400640 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77bcdd80 0x558d77fd1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.202+0000 7f31e3400640 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77bcdd80 0x558d77fd1410 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df4850180be7261b server_cookie=6f6ac597d7fba078 in_seq=0 out_seq=0 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.202+0000 7f31d2000640 10 client.26047 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.202+0000 7f31d2000640 1 -- 172.21.15.84:0/1694887536 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d77f2b600 con 0x558d77bcdd80 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.202+0000 7f31d2000640 10 client.26047 handle_command_reply: tid=0 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 client.26047 shutdown 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77be62f0 msgr2=0x558d77fbf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77be62f0 0x558d77fbf230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009d20 tx=0x7f31dc0aa480 comp rx=0 tx=0).stop 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 shutdown_connections 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77c0f1b0 0x558d77fbfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fbf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77bcdd80 0x558d77fd1410 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 --2- 172.21.15.84:0/1694887536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77be62f0 0x558d77fbf230 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 >> 172.21.15.84:0/1694887536 conn(0x558d77c03300 msgr2=0x558d77fb4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31d2000640 0 client.26047 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 shutdown_connections 2024-09-21T07:52:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 1 -- 172.21.15.84:0/1694887536 wait complete. 2024-09-21T07:52:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.203+0000 7f31f20d6740 20 client.26047 trim_cache size 0 max 16384 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 Processor -- start 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 -- start start 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41bfc50 con 0x558d77bee4d0 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41c1790 con 0x558d77be62f0 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31f20d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41c0320 con 0x558d77c0f1b0 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.224+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50732/0 (socket says 172.21.15.84:50732) 2024-09-21T07:52:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3e00640 1 -- 172.21.15.84:0/2043043219 learned_addr learned my addr 172.21.15.84:0/2043043219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3400640 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e9000640 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3e00640 1 -- 172.21.15.84:0/2043043219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 msgr2=0x558d77fb1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3e00640 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3e00640 1 -- 172.21.15.84:0/2043043219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 msgr2=0x558d77fb10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3e00640 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3e00640 1 -- 172.21.15.84:0/2043043219 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d77fbe4d0 con 0x558d77be62f0 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3400640 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31e3e00640 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb5370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0add30 tx=0x7f31dc0ad250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0bc2c45410fd39a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.225+0000 7f31d8c00640 1 -- 172.21.15.84:0/2043043219 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0ad6f0 con 0x558d77be62f0 2024-09-21T07:52:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.226+0000 7f31d8c00640 1 -- 172.21.15.84:0/2043043219 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31dc0b1020 con 0x558d77be62f0 2024-09-21T07:52:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.226+0000 7f31d8c00640 1 -- 172.21.15.84:0/2043043219 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc0d5190 con 0x558d77be62f0 2024-09-21T07:52:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.226+0000 7f31f20d6740 1 -- 172.21.15.84:0/2043043219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 msgr2=0x558d77fb5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.226+0000 7f31f20d6740 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb5370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0add30 tx=0x7f31dc0ad250 comp rx=0 tx=0).stop 2024-09-21T07:52:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 -- 172.21.15.84:0/2043043219 shutdown_connections 2024-09-21T07:52:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d77fb1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77bee4d0 0x558d77fb10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 --2- 172.21.15.84:0/2043043219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77be62f0 0x558d77fb5370 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 -- 172.21.15.84:0/2043043219 >> 172.21.15.84:0/2043043219 conn(0x558d77c03300 msgr2=0x558d77fb4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 -- 172.21.15.84:0/2043043219 shutdown_connections 2024-09-21T07:52:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 -- 172.21.15.84:0/2043043219 wait complete. 2024-09-21T07:52:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 -- start start 2024-09-21T07:52:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.227+0000 7f31f20d6740 1 Processor -- start 2024-09-21T07:52:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77be62f0 0x558d77fc5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fc5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31f20d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d78033e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31f20d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41c10c0 con 0x558d77be62f0 2024-09-21T07:52:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31f20d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41c09f0 con 0x558d77bee4d0 2024-09-21T07:52:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77be62f0 0x558d77fc5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31f20d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41bdc10 con 0x558d77c0f1b0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77be62f0 0x558d77fc5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33176/0 (socket says 172.21.15.84:33176) 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31e3e00640 1 -- 172.21.15.84:0/991354855 learned_addr learned my addr 172.21.15.84:0/991354855 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31e9000640 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d78033e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.228+0000 7f31e3400640 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fc5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31f20d6740 10 client.0 _ll_register_callbacks cb 0x7f31dc0e5b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31e3400640 1 -- 172.21.15.84:0/991354855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 msgr2=0x558d78033e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31e3400640 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d78033e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31e3400640 1 -- 172.21.15.84:0/991354855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77be62f0 msgr2=0x558d77fc5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31e3400640 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77be62f0 0x558d77fc5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31e3400640 1 -- 172.21.15.84:0/991354855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d780344f0 con 0x558d77bee4d0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31e3400640 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fc5610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31e4100300 tx=0x7f31cc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f882563887ec5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31d2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.229+0000 7f31d2000640 1 -- 172.21.15.84:0/991354855 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc035040 con 0x558d77bee4d0 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31dc0b1020 con 0x558d77bee4d0 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31d2000640 1 -- 172.21.15.84:0/991354855 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f31cc0048c0 con 0x558d77bee4d0 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31d2000640 1 -- 172.21.15.84:0/991354855 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f31cc05e050 con 0x558d77bee4d0 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 10 client.26045 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558d7803b880 con 0x558d77bee4d0 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31d2000640 1 -- 172.21.15.84:0/991354855 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31dc0b1020 con 0x558d77bee4d0 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31d2000640 1 -- 172.21.15.84:0/991354855 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f31cc047040 con 0x558d77bee4d0 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 10 client.26045 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 10 client.26045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 20 client.26045 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77ba31c0 0x558d7803e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 4 client.26045 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:52:19.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.230+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d77f270b0 con 0x558d77ba31c0 2024-09-21T07:52:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.231+0000 7f31e3e00640 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77ba31c0 0x558d7803e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.232+0000 7f31e3e00640 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77ba31c0 0x558d7803e070 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9677a05bb5a5d47b server_cookie=ff68498331c762a2 in_seq=0 out_seq=0 2024-09-21T07:52:19.235 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.232+0000 7f31d2000640 10 client.26045 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31d2000640 1 -- 172.21.15.84:0/991354855 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d77f270b0 con 0x558d77ba31c0 2024-09-21T07:52:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31d2000640 10 client.26045 handle_command_reply: tid=0 2024-09-21T07:52:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 client.26045 shutdown 2024-09-21T07:52:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 msgr2=0x558d77fc5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fc5610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31e4100300 tx=0x7f31cc009260 comp rx=0 tx=0).stop 2024-09-21T07:52:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 shutdown_connections 2024-09-21T07:52:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558d77ba31c0 0x558d7803e070 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d77c0f1b0 0x558d78033e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d77bee4d0 0x558d77fc5610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31f20d6740 1 --2- 172.21.15.84:0/991354855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d77be62f0 0x558d77fc5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.267+0000 7f31d2000640 0 client.26045 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.268+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 >> 172.21.15.84:0/991354855 conn(0x558d77c03300 msgr2=0x558d77fc06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.268+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 shutdown_connections 2024-09-21T07:52:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.268+0000 7f31f20d6740 1 -- 172.21.15.84:0/991354855 wait complete. 2024-09-21T07:52:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.268+0000 7f31f20d6740 20 client.26045 trim_cache size 0 max 16384 2024-09-21T07:52:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:52:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:52:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:52:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:52:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c80b6690 msgr2=0x7f31c80b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c80b6690 0x7f31c80b8ba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02a910 tx=0x7f31cc031400 comp rx=0 tx=0).stop 2024-09-21T07:52:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 msgr2=0x7f31e4116cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 0x7f31e4116cc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009d50 tx=0x7f31dc00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 shutdown_connections 2024-09-21T07:52:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31c80b6690 0x7f31c80b8ba0 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02a910 tx=0x7f31cc031400 comp rx=0 tx=0).stop 2024-09-21T07:52:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e4107bb0 0x7f31e41105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e4103040 0x7f31e410ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 --2- 172.21.15.84:0/629449930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e41026f0 0x7f31e4116cc0 secure :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009d50 tx=0x7f31dc00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:52:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.272+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 >> 172.21.15.84:0/629449930 conn(0x7f31e407a740 msgr2=0x7f31e4105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.274+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 shutdown_connections 2024-09-21T07:52:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:19.274+0000 7f31eb000640 1 -- 172.21.15.84:0/629449930 wait complete. 2024-09-21T07:52:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:19 smithi084 ceph-mon[30411]: pgmap v430: 129 pgs: 129 active+clean; 5.6 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 361 KiB/s wr, 13 op/s 2024-09-21T07:52:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:19 smithi162 ceph-mon[34833]: pgmap v430: 129 pgs: 129 active+clean; 5.6 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 361 KiB/s wr, 13 op/s 2024-09-21T07:52:19.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:19 smithi191 ceph-mon[34667]: pgmap v430: 129 pgs: 129 active+clean; 5.6 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 361 KiB/s wr, 13 op/s 2024-09-21T07:52:20.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:52:21.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:21 smithi084 ceph-mon[30411]: pgmap v431: 129 pgs: 129 active+clean; 302 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-21T07:52:21.450 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T07:52:21.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T07:52:21.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:21 smithi162 ceph-mon[34833]: pgmap v431: 129 pgs: 129 active+clean; 302 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-21T07:52:21.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:21 smithi191 ceph-mon[34667]: pgmap v431: 129 pgs: 129 active+clean; 302 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 25 MiB/s wr, 23 op/s 2024-09-21T07:52:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.876+0000 7fc793e00640 1 -- 172.21.15.84:0/2469905653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 msgr2=0x7fc79410cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.876+0000 7fc793e00640 1 --2- 172.21.15.84:0/2469905653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 0x7fc79410cac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc784009930 tx=0x7fc78402a440 comp rx=0 tx=0).stop 2024-09-21T07:52:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.876+0000 7fc793e00640 1 -- 172.21.15.84:0/2469905653 shutdown_connections 2024-09-21T07:52:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.876+0000 7fc793e00640 1 --2- 172.21.15.84:0/2469905653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 0x7fc794116a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.876+0000 7fc793e00640 1 --2- 172.21.15.84:0/2469905653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 0x7fc79410cac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.876+0000 7fc793e00640 1 --2- 172.21.15.84:0/2469905653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc79410a490 0x7fc79410a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.876+0000 7fc793e00640 1 -- 172.21.15.84:0/2469905653 >> 172.21.15.84:0/2469905653 conn(0x7fc794079420 msgr2=0x7fc79407b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.878+0000 7fc793e00640 1 -- 172.21.15.84:0/2469905653 shutdown_connections 2024-09-21T07:52:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.878+0000 7fc793e00640 1 -- 172.21.15.84:0/2469905653 wait complete. 2024-09-21T07:52:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.881+0000 7fc793e00640 1 Processor -- start 2024-09-21T07:52:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.881+0000 7fc793e00640 1 -- start start 2024-09-21T07:52:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.882+0000 7fc793e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc79410a490 0x7fc7941a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.882+0000 7fc793e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 0x7fc7941a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.882+0000 7fc793e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 0x7fc7941a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.883+0000 7fc793e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc794119f20 con 0x7fc79410a490 2024-09-21T07:52:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.883+0000 7fc793e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc794119da0 con 0x7fc79410c6b0 2024-09-21T07:52:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.883+0000 7fc793400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 0x7fc7941a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.883+0000 7fc793e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc79411a0a0 con 0x7fc79410d000 2024-09-21T07:52:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.883+0000 7fc793400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 0x7fc7941a6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:51594/0 (socket says 172.21.15.84:51594) 2024-09-21T07:52:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.883+0000 7fc793400640 1 -- 172.21.15.84:0/365814645 learned_addr learned my addr 172.21.15.84:0/365814645 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.884+0000 7fc792000640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 0x7fc7941a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.884+0000 7fc793400640 1 -- 172.21.15.84:0/365814645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 msgr2=0x7fc7941a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.885+0000 7fc793400640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 0x7fc7941a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.885+0000 7fc793400640 1 -- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc79410a490 msgr2=0x7fc7941a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.885+0000 7fc793400640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc79410a490 0x7fc7941a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.885+0000 7fc793400640 1 -- 172.21.15.84:0/365814645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7941a67e0 con 0x7fc79410d000 2024-09-21T07:52:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.885+0000 7fc792000640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 0x7fc7941a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.886+0000 7fc793400640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 0x7fc7941a6170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00cce0 tx=0x7fc78c00a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.887+0000 7fc78b400640 1 -- 172.21.15.84:0/365814645 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00f450 con 0x7fc79410d000 2024-09-21T07:52:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.887+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7941a6ad0 con 0x7fc79410d000 2024-09-21T07:52:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.887+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7941ad2f0 con 0x7fc79410d000 2024-09-21T07:52:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.890+0000 7fc78b400640 1 -- 172.21.15.84:0/365814645 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc78c00faa0 con 0x7fc79410d000 2024-09-21T07:52:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.890+0000 7fc78b400640 1 -- 172.21.15.84:0/365814645 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00f450 con 0x7fc79410d000 2024-09-21T07:52:22.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.900+0000 7fc78b400640 1 -- 172.21.15.84:0/365814645 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc78c00f5f0 con 0x7fc79410d000 2024-09-21T07:52:22.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.902+0000 7fc78b400640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7780b69b0 0x7fc7780b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.903+0000 7fc792a00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7780b69b0 0x7fc7780b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.906+0000 7fc78b400640 1 -- 172.21.15.84:0/365814645 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc78c0e7be0 con 0x7fc79410d000 2024-09-21T07:52:22.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.908+0000 7fc792a00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7780b69b0 0x7fc7780b8ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc780005fd0 tx=0x7fc78000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.915+0000 7fc7a0239740 1 Processor -- start 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.919+0000 7fc7a0239740 1 -- start start 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.919+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5fa6070 0x5556d634cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.919+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5f7d1b0 0x5556d634d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.920+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d634d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.920+0000 7fc7a0239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5556d62c3fb0 con 0x5556d5f85390 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.920+0000 7fc7a0239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5556d62b33e0 con 0x5556d5f7d1b0 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.920+0000 7fc7a0239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5556d62b71f0 con 0x5556d5fa6070 2024-09-21T07:52:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.921+0000 7fc792a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5fa6070 0x5556d634cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.921+0000 7fc792a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5fa6070 0x5556d634cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:51600/0 (socket says 172.21.15.84:51600) 2024-09-21T07:52:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.921+0000 7fc792000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5f7d1b0 0x5556d634d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.921+0000 7fc792000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5f7d1b0 0x5556d634d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50772/0 (socket says 172.21.15.84:50772) 2024-09-21T07:52:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.921+0000 7fc792000640 1 -- 172.21.15.84:0/1846152623 learned_addr learned my addr 172.21.15.84:0/1846152623 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.921+0000 7fc793400640 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d634d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.922+0000 7fc792a00640 1 -- 172.21.15.84:0/1846152623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5f7d1b0 msgr2=0x5556d634d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.922+0000 7fc792a00640 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5f7d1b0 0x5556d634d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.922+0000 7fc792a00640 1 -- 172.21.15.84:0/1846152623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 msgr2=0x5556d634d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.922+0000 7fc792a00640 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d634d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.922+0000 7fc792a00640 1 -- 172.21.15.84:0/1846152623 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d627dcd0 con 0x5556d5fa6070 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.924+0000 7fc792a00640 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5fa6070 0x5556d634cf70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc79407dc00 tx=0x7fc780010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60feb9086252400c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.924+0000 7fc77f400640 1 -- 172.21.15.84:0/1846152623 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780021070 con 0x5556d5fa6070 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.925+0000 7fc77f400640 1 -- 172.21.15.84:0/1846152623 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc780017070 con 0x5556d5fa6070 2024-09-21T07:52:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.925+0000 7fc77f400640 1 -- 172.21.15.84:0/1846152623 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780021070 con 0x5556d5fa6070 2024-09-21T07:52:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 -- 172.21.15.84:0/1846152623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5fa6070 msgr2=0x5556d634cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5fa6070 0x5556d634cf70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc79407dc00 tx=0x7fc780010000 comp rx=0 tx=0).stop 2024-09-21T07:52:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 -- 172.21.15.84:0/1846152623 shutdown_connections 2024-09-21T07:52:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d634d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5f7d1b0 0x5556d634d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 --2- 172.21.15.84:0/1846152623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5fa6070 0x5556d634cf70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 -- 172.21.15.84:0/1846152623 >> 172.21.15.84:0/1846152623 conn(0x5556d5f9a460 msgr2=0x5556d634ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 -- 172.21.15.84:0/1846152623 shutdown_connections 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.927+0000 7fc7a0239740 1 -- 172.21.15.84:0/1846152623 wait complete. 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.928+0000 7fc7a0239740 1 -- start start 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.929+0000 7fc7a0239740 1 Processor -- start 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6358770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6358cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6386a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc7a0239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5556d6114700 con 0x5556d5f7d1b0 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc7a0239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5556d624e580 con 0x5556d5fa6070 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc7a0239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5556d636c760 con 0x5556d5f85390 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc7a0239740 10 client.0 _ll_register_callbacks cb 0x5556d625e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.930+0000 7fc793400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6386a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.931+0000 7fc793400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6386a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50774/0 (socket says 172.21.15.84:50774) 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.931+0000 7fc793400640 1 -- 172.21.15.84:0/4272394617 learned_addr learned my addr 172.21.15.84:0/4272394617 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.931+0000 7fc792000640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6358cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.932+0000 7fc793400640 1 -- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 msgr2=0x5556d6358cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.932+0000 7fc793400640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6358cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.932+0000 7fc792a00640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6358770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.932+0000 7fc793400640 1 -- 172.21.15.84:0/4272394617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 msgr2=0x5556d6358770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.934+0000 7fc793400640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6358770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.934+0000 7fc793400640 1 -- 172.21.15.84:0/4272394617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556d6011650 con 0x5556d5fa6070 2024-09-21T07:52:22.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.934+0000 7fc792000640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6358cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:22.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.935+0000 7fc792a00640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6358770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:22.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.936+0000 7fc793400640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6386a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0e5020 tx=0x7fc78c0e5540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279043be425e7acd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:22.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.936+0000 7fc773e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:22.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.936+0000 7fc773e00640 1 -- 172.21.15.84:0/4272394617 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0addc0 con 0x5556d5fa6070 2024-09-21T07:52:22.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.937+0000 7fc773e00640 1 -- 172.21.15.84:0/4272394617 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc78c017de0 con 0x5556d5fa6070 2024-09-21T07:52:22.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.937+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556d6250b90 con 0x5556d5fa6070 2024-09-21T07:52:22.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.937+0000 7fc773e00640 1 -- 172.21.15.84:0/4272394617 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc78c0b21a0 con 0x5556d5fa6070 2024-09-21T07:52:22.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.938+0000 7fc7a0239740 10 client.26054 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:22.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.938+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556d626b950 con 0x5556d5fa6070 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.938+0000 7fc773e00640 1 -- 172.21.15.84:0/4272394617 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5556d6250b90 con 0x5556d5fa6070 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.939+0000 7fc773e00640 1 -- 172.21.15.84:0/4272394617 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc78c0a9010 con 0x5556d5fa6070 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.939+0000 7fc7a0239740 10 client.26054 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.939+0000 7fc7a0239740 10 client.26054 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.939+0000 7fc7a0239740 20 client.26054 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.939+0000 7fc7a0239740 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f649f0 0x5556d638c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.939+0000 7fc7a0239740 4 client.26054 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.939+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556d62c5f00 con 0x5556d5f649f0 2024-09-21T07:52:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.940+0000 7fc792a00640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f649f0 0x5556d638c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.941+0000 7fc773e00640 10 client.26054 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.941+0000 7fc792a00640 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f649f0 0x5556d638c890 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc09a1cf889966ac server_cookie=f3ab66a52515e6c6 in_seq=0 out_seq=0 2024-09-21T07:52:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.945+0000 7fc773e00640 1 -- 172.21.15.84:0/4272394617 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556d62c5f00 con 0x5556d5f649f0 2024-09-21T07:52:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.945+0000 7fc773e00640 10 client.26054 handle_command_reply: tid=0 2024-09-21T07:52:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.945+0000 7fc7a0239740 1 client.26054 shutdown 2024-09-21T07:52:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.948+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 msgr2=0x5556d6386a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.948+0000 7fc7a0239740 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6386a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0e5020 tx=0x7fc78c0e5540 comp rx=0 tx=0).stop 2024-09-21T07:52:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.950+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 shutdown_connections 2024-09-21T07:52:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.950+0000 7fc7a0239740 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f649f0 0x5556d638c890 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.950+0000 7fc7a0239740 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6386a90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.950+0000 7fc773e00640 0 client.26054 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.950+0000 7fc7a0239740 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6358cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.950+0000 7fc7a0239740 1 --2- 172.21.15.84:0/4272394617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6358770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.950+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 >> 172.21.15.84:0/4272394617 conn(0x5556d5f9a460 msgr2=0x5556d6350100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.951+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 shutdown_connections 2024-09-21T07:52:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.952+0000 7fc7a0239740 1 -- 172.21.15.84:0/4272394617 wait complete. 2024-09-21T07:52:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.952+0000 7fc7a0239740 20 client.26054 trim_cache size 0 max 16384 2024-09-21T07:52:22.979 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:22.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.978+0000 7fc7a0239740 1 Processor -- start 2024-09-21T07:52:22.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.978+0000 7fc7a0239740 1 -- start start 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6349d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6355960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6355ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc7a0239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc79407f120 con 0x5556d5f7d1b0 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc7a0239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc794080c60 con 0x5556d5fa6070 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc7a0239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc79407f7f0 con 0x5556d5f85390 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc792a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6349d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc792000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6355960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc793400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6355ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc793400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6355ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50780/0 (socket says 172.21.15.84:50780) 2024-09-21T07:52:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc793400640 1 -- 172.21.15.84:0/2002458910 learned_addr learned my addr 172.21.15.84:0/2002458910 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:22.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc793400640 1 -- 172.21.15.84:0/2002458910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 msgr2=0x5556d6355960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc793400640 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6355960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.979+0000 7fc793400640 1 -- 172.21.15.84:0/2002458910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 msgr2=0x5556d6349d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.980+0000 7fc793400640 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6349d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.980+0000 7fc793400640 1 -- 172.21.15.84:0/2002458910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d634f530 con 0x5556d5fa6070 2024-09-21T07:52:22.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.980+0000 7fc792a00640 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6349d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:22.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.980+0000 7fc793400640 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6355ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00ab20 tx=0x7fc78c005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=589406c55a42a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:22.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.980+0000 7fc77ea00640 1 -- 172.21.15.84:0/2002458910 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0b70e0 con 0x5556d5fa6070 2024-09-21T07:52:22.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.980+0000 7fc77ea00640 1 -- 172.21.15.84:0/2002458910 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc78c0c7070 con 0x5556d5fa6070 2024-09-21T07:52:22.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.980+0000 7fc77ea00640 1 -- 172.21.15.84:0/2002458910 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0b6040 con 0x5556d5fa6070 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 -- 172.21.15.84:0/2002458910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 msgr2=0x5556d6355ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6355ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00ab20 tx=0x7fc78c005b50 comp rx=0 tx=0).stop 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 -- 172.21.15.84:0/2002458910 shutdown_connections 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d6355ea0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f85390 0x5556d6355960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 --2- 172.21.15.84:0/2002458910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f7d1b0 0x5556d6349d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 -- 172.21.15.84:0/2002458910 >> 172.21.15.84:0/2002458910 conn(0x5556d5f9a460 msgr2=0x5556d6349600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 -- 172.21.15.84:0/2002458910 shutdown_connections 2024-09-21T07:52:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.982+0000 7fc7a0239740 1 -- 172.21.15.84:0/2002458910 wait complete. 2024-09-21T07:52:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.983+0000 7fc7a0239740 1 -- start start 2024-09-21T07:52:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.983+0000 7fc7a0239740 1 Processor -- start 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f7d1b0 0x5556d6382a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d6382fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc7a0239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d637da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc7a0239740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc794080590 con 0x5556d5f85390 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc7a0239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc79407fec0 con 0x5556d5fa6070 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc7a0239740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc794074aa0 con 0x5556d5f7d1b0 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc7a0239740 10 client.0 _ll_register_callbacks cb 0x7fc78c0acf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f7d1b0 0x5556d6382a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f7d1b0 0x5556d6382a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:51612/0 (socket says 172.21.15.84:51612) 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 -- 172.21.15.84:0/776646921 learned_addr learned my addr 172.21.15.84:0/776646921 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:22.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792000640 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d6382fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 -- 172.21.15.84:0/776646921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 msgr2=0x5556d637da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d637da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 -- 172.21.15.84:0/776646921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 msgr2=0x5556d6382fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d6382fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792a00640 1 -- 172.21.15.84:0/776646921 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556d6383530 con 0x5556d5f7d1b0 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.984+0000 7fc792000640 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d6382fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc792a00640 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f7d1b0 0x5556d6382a80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc78001dfd0 tx=0x7fc78001dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b069625bebce44bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc773e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc773e00640 1 -- 172.21.15.84:0/776646921 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780021040 con 0x5556d5f7d1b0 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc78c0c7070 con 0x5556d5f7d1b0 2024-09-21T07:52:22.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc773e00640 1 -- 172.21.15.84:0/776646921 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc78001d5f0 con 0x5556d5f7d1b0 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc773e00640 1 -- 172.21.15.84:0/776646921 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc78000d930 con 0x5556d5f7d1b0 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc7a0239740 10 client.26065 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.985+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556d63f7550 con 0x5556d5f7d1b0 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc773e00640 1 -- 172.21.15.84:0/776646921 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc78c0c7070 con 0x5556d5f7d1b0 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc773e00640 1 -- 172.21.15.84:0/776646921 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc780030070 con 0x5556d5f7d1b0 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc7a0239740 10 client.26065 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc7a0239740 10 client.26065 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc7a0239740 20 client.26065 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc7a0239740 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f39da0 0x5556d63f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:22.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc7a0239740 4 client.26065 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:22.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.986+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556d62c19b0 con 0x5556d5f39da0 2024-09-21T07:52:22.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.987+0000 7fc792000640 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f39da0 0x5556d63f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:22.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.987+0000 7fc792000640 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f39da0 0x5556d63f9bb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89e3f763037f849a server_cookie=4144499dcf6a2992 in_seq=0 out_seq=0 2024-09-21T07:52:22.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.987+0000 7fc773e00640 10 client.26065 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc773e00640 1 -- 172.21.15.84:0/776646921 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556d62c19b0 con 0x5556d5f39da0 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc773e00640 10 client.26065 handle_command_reply: tid=0 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 client.26065 shutdown 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f7d1b0 msgr2=0x5556d6382a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f7d1b0 0x5556d6382a80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc78001dfd0 tx=0x7fc78001dd50 comp rx=0 tx=0).stop 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 shutdown_connections 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5556d5f39da0 0x5556d63f9bb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5556d5fa6070 0x5556d637da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556d5f85390 0x5556d6382fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 --2- 172.21.15.84:0/776646921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556d5f7d1b0 0x5556d6382a80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 >> 172.21.15.84:0/776646921 conn(0x5556d5f9a460 msgr2=0x5556d634ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc773e00640 0 client.26065 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 shutdown_connections 2024-09-21T07:52:22.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.988+0000 7fc7a0239740 1 -- 172.21.15.84:0/776646921 wait complete. 2024-09-21T07:52:22.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.989+0000 7fc7a0239740 20 client.26065 trim_cache size 0 max 16384 2024-09-21T07:52:22.992 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7780b69b0 msgr2=0x7fc7780b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7780b69b0 0x7fc7780b8ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc780005fd0 tx=0x7fc78000b410 comp rx=0 tx=0).stop 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 msgr2=0x7fc7941a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 0x7fc7941a6170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00cce0 tx=0x7fc78c00a620 comp rx=0 tx=0).stop 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 shutdown_connections 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc7780b69b0 0x7fc7780b8ec0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc79410d000 0x7fc7941a6170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc79410c6b0 0x7fc7941a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 --2- 172.21.15.84:0/365814645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc79410a490 0x7fc7941a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 >> 172.21.15.84:0/365814645 conn(0x7fc794079420 msgr2=0x7fc79407b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 shutdown_connections 2024-09-21T07:52:22.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:22.990+0000 7fc793e00640 1 -- 172.21.15.84:0/365814645 wait complete. 2024-09-21T07:52:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:23 smithi162 ceph-mon[34833]: pgmap v432: 129 pgs: 129 active+clean; 674 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 MiB/s wr, 38 op/s 2024-09-21T07:52:23.565 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:23 smithi084 ceph-mon[30411]: pgmap v432: 129 pgs: 129 active+clean; 674 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 MiB/s wr, 38 op/s 2024-09-21T07:52:23.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:23 smithi191 ceph-mon[34667]: pgmap v432: 129 pgs: 129 active+clean; 674 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 MiB/s wr, 38 op/s 2024-09-21T07:52:24.816 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:52:25.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:25 smithi084 ceph-mon[30411]: pgmap v433: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 79 MiB/s wr, 44 op/s 2024-09-21T07:52:25.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:25 smithi162 ceph-mon[34833]: pgmap v433: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 79 MiB/s wr, 44 op/s 2024-09-21T07:52:25.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:25 smithi191 ceph-mon[34667]: pgmap v433: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 79 MiB/s wr, 44 op/s 2024-09-21T07:52:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:26.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.133+0000 7f2137800640 1 -- 172.21.15.84:0/3671490644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 msgr2=0x7f213011cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.133+0000 7f2137800640 1 --2- 172.21.15.84:0/3671490644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 0x7f213011cba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f211c009860 tx=0x7f211c02a360 comp rx=0 tx=0).stop 2024-09-21T07:52:26.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.135+0000 7f2137800640 1 -- 172.21.15.84:0/3671490644 shutdown_connections 2024-09-21T07:52:26.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.135+0000 7f2137800640 1 --2- 172.21.15.84:0/3671490644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 0x7f213011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.135+0000 7f2137800640 1 --2- 172.21.15.84:0/3671490644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 0x7f213011cba0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.135+0000 7f2137800640 1 --2- 172.21.15.84:0/3671490644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f213010a3c0 0x7f213010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.136+0000 7f2137800640 1 -- 172.21.15.84:0/3671490644 >> 172.21.15.84:0/3671490644 conn(0x7f2130070e80 msgr2=0x7f2130071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.137+0000 7f2137800640 1 -- 172.21.15.84:0/3671490644 shutdown_connections 2024-09-21T07:52:26.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.138+0000 7f2137800640 1 -- 172.21.15.84:0/3671490644 wait complete. 2024-09-21T07:52:26.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.139+0000 7f2137800640 1 Processor -- start 2024-09-21T07:52:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.140+0000 7f2137800640 1 -- start start 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.140+0000 7f2137800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f213010a3c0 0x7f21301a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.143+0000 7f2137800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 0x7f21301a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.144+0000 7f2137800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 0x7f21301aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.144+0000 7f2137800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2130122950 con 0x7f213010a3c0 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.144+0000 7f2137800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21301227d0 con 0x7f213010ad10 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.144+0000 7f2137800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2130122ad0 con 0x7f213011d0e0 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.144+0000 7f2134e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f213010a3c0 0x7f21301a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.145+0000 7f2135800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 0x7f21301aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.145+0000 7f212fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 0x7f21301a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.146+0000 7f2135800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 0x7f21301aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:51626/0 (socket says 172.21.15.84:51626) 2024-09-21T07:52:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.146+0000 7f2135800640 1 -- 172.21.15.84:0/3664536497 learned_addr learned my addr 172.21.15.84:0/3664536497 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.147+0000 7f2135800640 1 -- 172.21.15.84:0/3664536497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 msgr2=0x7f21301a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.147+0000 7f2135800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 0x7f21301a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.147+0000 7f2135800640 1 -- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f213010a3c0 msgr2=0x7f21301a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.147+0000 7f2135800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f213010a3c0 0x7f21301a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.147+0000 7f2135800640 1 -- 172.21.15.84:0/3664536497 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21301af350 con 0x7f213011d0e0 2024-09-21T07:52:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.148+0000 7f2135800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 0x7f21301aec20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f212800eda0 tx=0x7f212800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.149+0000 7f212d600640 1 -- 172.21.15.84:0/3664536497 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128003b70 con 0x7f213011d0e0 2024-09-21T07:52:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.149+0000 7f212d600640 1 -- 172.21.15.84:0/3664536497 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2128003d10 con 0x7f213011d0e0 2024-09-21T07:52:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.150+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21301af640 con 0x7f213011d0e0 2024-09-21T07:52:26.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.150+0000 7f212d600640 1 -- 172.21.15.84:0/3664536497 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280178e0 con 0x7f213011d0e0 2024-09-21T07:52:26.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.150+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21301b5da0 con 0x7f213011d0e0 2024-09-21T07:52:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.158+0000 7f212d600640 1 -- 172.21.15.84:0/3664536497 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2128004560 con 0x7f213011d0e0 2024-09-21T07:52:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.160+0000 7f212d600640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21140b6730 0x7f21140b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.160+0000 7f213e480740 1 Processor -- start 2024-09-21T07:52:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.160+0000 7f213e480740 1 -- start start 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f213e480740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x561771229350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f213e480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e58980 0x561771229890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f213e480740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e60b60 0x561771229dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f213e480740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56177119eca0 con 0x561770e58980 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f213e480740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56177118e0d0 con 0x561770e60b60 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f213e480740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561771191ee0 con 0x561770e81840 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f2135800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e60b60 0x561771229dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f2135800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e60b60 0x561771229dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50808/0 (socket says 172.21.15.84:50808) 2024-09-21T07:52:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f2135800640 1 -- 172.21.15.84:0/2659427594 learned_addr learned my addr 172.21.15.84:0/2659427594 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.161+0000 7f212fe00640 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e58980 0x561771229890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.163+0000 7f212d600640 1 -- 172.21.15.84:0/3664536497 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f21280e7960 con 0x7f213011d0e0 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f2134e00640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21140b6730 0x7f21140b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f2134e00640 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x561771229350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f212fe00640 1 -- 172.21.15.84:0/2659427594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 msgr2=0x561771229350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f212fe00640 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x561771229350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f212fe00640 1 -- 172.21.15.84:0/2659427594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e60b60 msgr2=0x561771229dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f212fe00640 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e60b60 0x561771229dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f212fe00640 1 -- 172.21.15.84:0/2659427594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561771140400 con 0x561770e58980 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.164+0000 7f2134e00640 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x561771229350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.165+0000 7f212fe00640 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e58980 0x561771229890 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f211c035040 tx=0x7f211c030420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa69aefdf71c626b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.165+0000 7f2134e00640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21140b6730 0x7f21140b8c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2130075270 tx=0x7f212000b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.166+0000 7f2126000640 1 -- 172.21.15.84:0/2659427594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c043020 con 0x561770e58980 2024-09-21T07:52:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.166+0000 7f2126000640 1 -- 172.21.15.84:0/2659427594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f211c038040 con 0x561770e58980 2024-09-21T07:52:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.166+0000 7f2126000640 1 -- 172.21.15.84:0/2659427594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c037040 con 0x561770e58980 2024-09-21T07:52:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.167+0000 7f213e480740 1 -- 172.21.15.84:0/2659427594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e58980 msgr2=0x561771229890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.167+0000 7f213e480740 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e58980 0x561771229890 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f211c035040 tx=0x7f211c030420 comp rx=0 tx=0).stop 2024-09-21T07:52:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.168+0000 7f213e480740 1 -- 172.21.15.84:0/2659427594 shutdown_connections 2024-09-21T07:52:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.168+0000 7f213e480740 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e60b60 0x561771229dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.168+0000 7f213e480740 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e58980 0x561771229890 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.168+0000 7f213e480740 1 --2- 172.21.15.84:0/2659427594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x561771229350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.168+0000 7f213e480740 1 -- 172.21.15.84:0/2659427594 >> 172.21.15.84:0/2659427594 conn(0x561770e75990 msgr2=0x561771227240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.168+0000 7f213e480740 1 -- 172.21.15.84:0/2659427594 shutdown_connections 2024-09-21T07:52:26.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.168+0000 7f213e480740 1 -- 172.21.15.84:0/2659427594 wait complete. 2024-09-21T07:52:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.169+0000 7f213e480740 1 -- start start 2024-09-21T07:52:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.169+0000 7f213e480740 1 Processor -- start 2024-09-21T07:52:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.170+0000 7f213e480740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x5617712349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f213e480740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e60b60 0x561771234f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f213e480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e81840 0x561771240dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f2134e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x5617712349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f212fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e60b60 0x561771234f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f2135800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e81840 0x561771240dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f2135800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e81840 0x561771240dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33262/0 (socket says 172.21.15.84:33262) 2024-09-21T07:52:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f2135800640 1 -- 172.21.15.84:0/1566578068 learned_addr learned my addr 172.21.15.84:0/1566578068 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:26.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561770fef7a0 con 0x561770e81840 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561771133a10 con 0x561770e58980 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.171+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561771237ad0 con 0x561770e60b60 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.172+0000 7f213e480740 10 client.0 _ll_register_callbacks cb 0x561771143be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.172+0000 7f2135800640 1 -- 172.21.15.84:0/1566578068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e60b60 msgr2=0x561771234f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.172+0000 7f2135800640 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e60b60 0x561771234f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.172+0000 7f2135800640 1 -- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 msgr2=0x5617712349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.172+0000 7f2135800640 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x5617712349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.172+0000 7f2135800640 1 -- 172.21.15.84:0/1566578068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561770efbb90 con 0x561770e81840 2024-09-21T07:52:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.172+0000 7f2134e00640 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x5617712349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f2135800640 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e81840 0x561771240dc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f21280ed2d0 tx=0x7f2128005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd099d1b30462eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f211aa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:52:26.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f211aa00640 1 -- 172.21.15.84:0/1566578068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280acdd0 con 0x561770e81840 2024-09-21T07:52:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f211c038040 con 0x561770e81840 2024-09-21T07:52:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f211aa00640 1 -- 172.21.15.84:0/1566578068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f21280d0e00 con 0x561770e81840 2024-09-21T07:52:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f212fe00640 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e60b60 0x561771234f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f211aa00640 1 -- 172.21.15.84:0/1566578068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f21280acbf0 con 0x561770e81840 2024-09-21T07:52:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f213e480740 10 client.16095 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.173+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617712437a0 con 0x561770e81840 2024-09-21T07:52:26.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f211aa00640 1 -- 172.21.15.84:0/1566578068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f211c038040 con 0x561770e81840 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f211aa00640 1 -- 172.21.15.84:0/1566578068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f212801f030 con 0x561770e81840 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f213e480740 10 client.16095 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f213e480740 10 client.16095 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f213e480740 20 client.16095 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f213e480740 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e401c0 0x561771246c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f213e480740 4 client.16095 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617711a0bf0 con 0x561770e401c0 2024-09-21T07:52:26.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.175+0000 7f2134e00640 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e401c0 0x561771246c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.176+0000 7f2134e00640 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e401c0 0x561771246c70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1017f094e7081c3b server_cookie=3ed1e1b88f2dae37 in_seq=0 out_seq=0 2024-09-21T07:52:26.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.176+0000 7f211aa00640 10 client.16095 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:26.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f211aa00640 1 -- 172.21.15.84:0/1566578068 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617711a0bf0 con 0x561770e401c0 2024-09-21T07:52:26.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f211aa00640 10 client.16095 handle_command_reply: tid=0 2024-09-21T07:52:26.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f213e480740 1 client.16095 shutdown 2024-09-21T07:52:26.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e81840 msgr2=0x561771240dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f213e480740 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e81840 0x561771240dc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f21280ed2d0 tx=0x7f2128005a50 comp rx=0 tx=0).stop 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 shutdown_connections 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f213e480740 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e81840 0x561771240dc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.177+0000 7f213e480740 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e401c0 0x561771246c70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.178+0000 7f213e480740 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e60b60 0x561771234f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.178+0000 7f213e480740 1 --2- 172.21.15.84:0/1566578068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x5617712349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.178+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 >> 172.21.15.84:0/1566578068 conn(0x561770e75990 msgr2=0x56177122c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.178+0000 7f211aa00640 0 client.16095 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.178+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 shutdown_connections 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.178+0000 7f213e480740 1 -- 172.21.15.84:0/1566578068 wait complete. 2024-09-21T07:52:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.178+0000 7f213e480740 20 client.16095 trim_cache size 0 max 16384 2024-09-21T07:52:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.214+0000 7f213e480740 1 Processor -- start 2024-09-21T07:52:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.214+0000 7f213e480740 1 -- start start 2024-09-21T07:52:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f213e480740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e58980 0x5617712369c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f213e480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x561771231bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f213e480740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e81840 0x561771232100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f213e480740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21301bfc30 con 0x561770e60b60 2024-09-21T07:52:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f213e480740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21301c1770 con 0x561770e81840 2024-09-21T07:52:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f213e480740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21301c0300 con 0x561770e58980 2024-09-21T07:52:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f2135800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e81840 0x561771232100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f2135800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e81840 0x561771232100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50832/0 (socket says 172.21.15.84:50832) 2024-09-21T07:52:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.215+0000 7f2135800640 1 -- 172.21.15.84:0/1176813969 learned_addr learned my addr 172.21.15.84:0/1176813969 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.216+0000 7f2134e00640 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e58980 0x5617712369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.216+0000 7f2135800640 1 -- 172.21.15.84:0/1176813969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e58980 msgr2=0x5617712369c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.216+0000 7f2135800640 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e58980 0x5617712369c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.216+0000 7f2135800640 1 -- 172.21.15.84:0/1176813969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 msgr2=0x561771231bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.216+0000 7f212fe00640 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x561771231bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.216+0000 7f2135800640 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x561771231bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.216+0000 7f2135800640 1 -- 172.21.15.84:0/1176813969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177122c1b0 con 0x561770e81840 2024-09-21T07:52:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.217+0000 7f2134e00640 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e58980 0x5617712369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.217+0000 7f2135800640 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e81840 0x561771232100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2128000f80 tx=0x7f21280e7c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88c22b0664271b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.217+0000 7f212fe00640 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x561771231bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.217+0000 7f2125600640 1 -- 172.21.15.84:0/1176813969 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280acdd0 con 0x561770e81840 2024-09-21T07:52:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.217+0000 7f2125600640 1 -- 172.21.15.84:0/1176813969 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2128098020 con 0x561770e81840 2024-09-21T07:52:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.217+0000 7f2125600640 1 -- 172.21.15.84:0/1176813969 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128094dc0 con 0x561770e81840 2024-09-21T07:52:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 -- 172.21.15.84:0/1176813969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e81840 msgr2=0x561771232100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e81840 0x561771232100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2128000f80 tx=0x7f21280e7c00 comp rx=0 tx=0).stop 2024-09-21T07:52:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 -- 172.21.15.84:0/1176813969 shutdown_connections 2024-09-21T07:52:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e81840 0x561771232100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x561771231bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 --2- 172.21.15.84:0/1176813969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e58980 0x5617712369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 -- 172.21.15.84:0/1176813969 >> 172.21.15.84:0/1176813969 conn(0x561770e75990 msgr2=0x56177122ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.219+0000 7f213e480740 1 -- 172.21.15.84:0/1176813969 shutdown_connections 2024-09-21T07:52:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.220+0000 7f213e480740 1 -- 172.21.15.84:0/1176813969 wait complete. 2024-09-21T07:52:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.220+0000 7f213e480740 1 -- start start 2024-09-21T07:52:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.221+0000 7f213e480740 1 Processor -- start 2024-09-21T07:52:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.221+0000 7f213e480740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x561771239070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.221+0000 7f213e480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x5617712395b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.221+0000 7f213e480740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x5617712b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.221+0000 7f213e480740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21301c10a0 con 0x561770e60b60 2024-09-21T07:52:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.221+0000 7f213e480740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21301c09d0 con 0x561770e58980 2024-09-21T07:52:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.221+0000 7f213e480740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21301bdbf0 con 0x561770e81840 2024-09-21T07:52:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.222+0000 7f2134e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x561771239070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.222+0000 7f213e480740 10 client.0 _ll_register_callbacks cb 0x7f21280ed220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:26.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.223+0000 7f212fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x5617712395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.223+0000 7f212fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x5617712395b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33274/0 (socket says 172.21.15.84:33274) 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.223+0000 7f212fe00640 1 -- 172.21.15.84:0/927356967 learned_addr learned my addr 172.21.15.84:0/927356967 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.223+0000 7f2134e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x561771239070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50844/0 (socket says 172.21.15.84:50844) 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.224+0000 7f2135800640 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x5617712b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.224+0000 7f2134e00640 1 -- 172.21.15.84:0/927356967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 msgr2=0x5617712b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.224+0000 7f2134e00640 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x5617712b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.224+0000 7f2134e00640 1 -- 172.21.15.84:0/927356967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 msgr2=0x5617712395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.225+0000 7f2134e00640 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x5617712395b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.226+0000 7f2134e00640 1 -- 172.21.15.84:0/927356967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561771222c50 con 0x561770e58980 2024-09-21T07:52:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.226+0000 7f2134e00640 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x561771239070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5617712473a0 tx=0x7f21200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769a5d0a463d0670 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.227+0000 7f211aa00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.228+0000 7f211aa00640 1 -- 172.21.15.84:0/927356967 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212001f830 con 0x561770e58980 2024-09-21T07:52:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.228+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2128098020 con 0x561770e58980 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.228+0000 7f211aa00640 1 -- 172.21.15.84:0/927356967 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f212001f9d0 con 0x561770e58980 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.228+0000 7f211aa00640 1 -- 172.21.15.84:0/927356967 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f212001fbd0 con 0x561770e58980 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 10 client.26072 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617712b18d0 con 0x561770e58980 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f211aa00640 1 -- 172.21.15.84:0/927356967 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2128098020 con 0x561770e58980 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f211aa00640 1 -- 172.21.15.84:0/927356967 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f21200103d0 con 0x561770e58980 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 10 client.26072 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 10 client.26072 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:52:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 20 client.26072 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e15570 0x5617712b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 4 client.26072 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T07:52:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.229+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x56177119c6a0 con 0x561770e15570 2024-09-21T07:52:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.230+0000 7f212fe00640 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e15570 0x5617712b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.231+0000 7f211aa00640 10 client.26072 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:26.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.231+0000 7f212fe00640 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e15570 0x5617712b40a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de2cc76d231b85c server_cookie=efedcdac0aff7b1 in_seq=0 out_seq=0 2024-09-21T07:52:26.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f211aa00640 1 -- 172.21.15.84:0/927356967 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56177119c6a0 con 0x561770e15570 2024-09-21T07:52:26.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f211aa00640 10 client.26072 handle_command_reply: tid=0 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 client.26072 shutdown 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 msgr2=0x561771239070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x561771239070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5617712473a0 tx=0x7f21200046c0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 shutdown_connections 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561770e15570 0x5617712b40a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561770e81840 0x5617712b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561770e60b60 0x5617712395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 --2- 172.21.15.84:0/927356967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561770e58980 0x561771239070 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f211aa00640 0 client.26072 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 >> 172.21.15.84:0/927356967 conn(0x561770e75990 msgr2=0x561771226360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 shutdown_connections 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 1 -- 172.21.15.84:0/927356967 wait complete. 2024-09-21T07:52:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.280+0000 7f213e480740 20 client.26072 trim_cache size 0 max 16384 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 6, 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "a18219b2": { 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 6, 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:52:26.285 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 137.0, 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:26.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:26.287 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:52:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21140b6730 msgr2=0x7f21140b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21140b6730 0x7f21140b8c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2130075270 tx=0x7f212000b540 comp rx=0 tx=0).stop 2024-09-21T07:52:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 msgr2=0x7f21301aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 0x7f21301aec20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f212800eda0 tx=0x7f212800c6e0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 shutdown_connections 2024-09-21T07:52:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21140b6730 0x7f21140b8c40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f213011d0e0 0x7f21301aec20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213010ad10 0x7f21301a9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 --2- 172.21.15.84:0/3664536497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f213010a3c0 0x7f21301a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.281+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 >> 172.21.15.84:0/3664536497 conn(0x7f2130070e80 msgr2=0x7f2130071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.282+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 shutdown_connections 2024-09-21T07:52:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:26.282+0000 7f2137800640 1 -- 172.21.15.84:0/3664536497 wait complete. 2024-09-21T07:52:27.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:27 smithi084 ceph-mon[30411]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 134 MiB/s wr, 62 op/s 2024-09-21T07:52:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:27 smithi162 ceph-mon[34833]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 134 MiB/s wr, 62 op/s 2024-09-21T07:52:27.586 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a18219b2', quiesce took 14.0 seconds. Will release after: 3.0 2024-09-21T07:52:27.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:27 smithi191 ceph-mon[34667]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 134 MiB/s wr, 62 op/s 2024-09-21T07:52:28.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.027+0000 7f623ae00640 1 -- 172.21.15.84:0/3428606142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f623410fff0 msgr2=0x7f6234112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.027+0000 7f623ae00640 1 --2- 172.21.15.84:0/3428606142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f623410fff0 0x7f6234112410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f622c009ca0 tx=0x7f622c02a950 comp rx=0 tx=0).stop 2024-09-21T07:52:28.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.028+0000 7f623ae00640 1 -- 172.21.15.84:0/3428606142 shutdown_connections 2024-09-21T07:52:28.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.028+0000 7f623ae00640 1 --2- 172.21.15.84:0/3428606142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f623410fff0 0x7f6234112410 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.028+0000 7f623ae00640 1 --2- 172.21.15.84:0/3428606142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6234102d90 0x7f623410fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.028+0000 7f623ae00640 1 --2- 172.21.15.84:0/3428606142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6234102440 0x7f6234102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.028+0000 7f623ae00640 1 -- 172.21.15.84:0/3428606142 >> 172.21.15.84:0/3428606142 conn(0x7f62340fe2c0 msgr2=0x7f6234100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.028+0000 7f623ae00640 1 -- 172.21.15.84:0/3428606142 shutdown_connections 2024-09-21T07:52:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.028+0000 7f623ae00640 1 -- 172.21.15.84:0/3428606142 wait complete. 2024-09-21T07:52:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.029+0000 7f623ae00640 1 Processor -- start 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.029+0000 7f623ae00640 1 -- start start 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.029+0000 7f623ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6234102440 0x7f623419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623ae00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6234102d90 0x7f623419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623ae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f623410fff0 0x7f62341a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623ae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6234115ae0 con 0x7f623410fff0 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6234115960 con 0x7f6234102440 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623ae00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6234115c60 con 0x7f6234102d90 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f6239a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6234102440 0x7f623419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f623410fff0 0x7f62341a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f623410fff0 0x7f62341a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36574/0 (socket says 172.21.15.84:36574) 2024-09-21T07:52:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.030+0000 7f623a400640 1 -- 172.21.15.84:0/4130598428 learned_addr learned my addr 172.21.15.84:0/4130598428 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.031+0000 7f6239a00640 1 -- 172.21.15.84:0/4130598428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6234102d90 msgr2=0x7f623419c9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:52:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.031+0000 7f6239a00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6234102d90 0x7f623419c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.031+0000 7f6239a00640 1 -- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f623410fff0 msgr2=0x7f62341a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.031+0000 7f6239a00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f623410fff0 0x7f62341a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.031+0000 7f6239a00640 1 -- 172.21.15.84:0/4130598428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62341a23c0 con 0x7f6234102440 2024-09-21T07:52:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.031+0000 7f623a400640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f623410fff0 0x7f62341a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.032+0000 7f6239a00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6234102440 0x7f623419c450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f622800e9f0 tx=0x7f622800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.032+0000 7f6232000640 1 -- 172.21.15.84:0/4130598428 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622800ccc0 con 0x7f6234102440 2024-09-21T07:52:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.032+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62341a26b0 con 0x7f6234102440 2024-09-21T07:52:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.032+0000 7f6232000640 1 -- 172.21.15.84:0/4130598428 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62280108e0 con 0x7f6234102440 2024-09-21T07:52:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.032+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341a8e10 con 0x7f6234102440 2024-09-21T07:52:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.032+0000 7f6232000640 1 -- 172.21.15.84:0/4130598428 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228018880 con 0x7f6234102440 2024-09-21T07:52:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.039+0000 7f6242fbd740 1 Processor -- start 2024-09-21T07:52:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.039+0000 7f6242fbd740 1 -- start start 2024-09-21T07:52:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.040+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 0x563276ba2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.040+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276ba34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.040+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276ba39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.040+0000 7f6242fbd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563276b19fb0 con 0x5632767fc070 2024-09-21T07:52:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.040+0000 7f6242fbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563276b093e0 con 0x5632767d31b0 2024-09-21T07:52:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.040+0000 7f6242fbd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563276b0d1f0 con 0x5632767db390 2024-09-21T07:52:28.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.041+0000 7f6239a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276ba34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.041+0000 7f6239a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276ba34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43424/0 (socket says 172.21.15.84:43424) 2024-09-21T07:52:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.041+0000 7f6239a00640 1 -- 172.21.15.84:0/3506411217 learned_addr learned my addr 172.21.15.84:0/3506411217 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6239a00640 1 -- 172.21.15.84:0/3506411217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 msgr2=0x563276ba39f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6239a00640 1 --2- 172.21.15.84:0/3506411217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276ba39f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6239a00640 1 -- 172.21.15.84:0/3506411217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 msgr2=0x563276ba2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6239a00640 1 --2- 172.21.15.84:0/3506411217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 0x563276ba2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6239a00640 1 -- 172.21.15.84:0/3506411217 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563276ad3cd0 con 0x5632767d31b0 2024-09-21T07:52:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6232000640 1 -- 172.21.15.84:0/4130598428 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f6228010430 con 0x7f6234102440 2024-09-21T07:52:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6239a00640 1 --2- 172.21.15.84:0/3506411217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276ba34b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62280e4fe0 tx=0x7f62280f07c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be1f57ccff05bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.042+0000 7f6226a00640 1 -- 172.21.15.84:0/3506411217 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62280f9c60 con 0x5632767d31b0 2024-09-21T07:52:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.043+0000 7f6226a00640 1 -- 172.21.15.84:0/3506411217 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62280fd070 con 0x5632767d31b0 2024-09-21T07:52:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.043+0000 7f6226a00640 1 -- 172.21.15.84:0/3506411217 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62280ed630 con 0x5632767d31b0 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 -- 172.21.15.84:0/3506411217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 msgr2=0x563276ba34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 --2- 172.21.15.84:0/3506411217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276ba34b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62280e4fe0 tx=0x7f62280f07c0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 -- 172.21.15.84:0/3506411217 shutdown_connections 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 --2- 172.21.15.84:0/3506411217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276ba39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 --2- 172.21.15.84:0/3506411217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276ba34b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 --2- 172.21.15.84:0/3506411217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 0x563276ba2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 -- 172.21.15.84:0/3506411217 >> 172.21.15.84:0/3506411217 conn(0x5632767f0460 msgr2=0x563276ba0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.044+0000 7f6242fbd740 1 -- 172.21.15.84:0/3506411217 shutdown_connections 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.045+0000 7f6242fbd740 1 -- 172.21.15.84:0/3506411217 wait complete. 2024-09-21T07:52:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.045+0000 7f6232000640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f621c0b6610 0x7f621c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.045+0000 7f6232000640 1 -- 172.21.15.84:0/4130598428 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f62280e7cc0 con 0x7f6234102440 2024-09-21T07:52:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.045+0000 7f6239000640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f621c0b6610 0x7f621c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.045+0000 7f6242fbd740 1 -- start start 2024-09-21T07:52:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6242fbd740 1 Processor -- start 2024-09-21T07:52:28.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6239000640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f621c0b6610 0x7f621c0b8b20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6234104260 tx=0x7f6220005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276bae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276baec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 0x563276bbaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6242fbd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56327696a700 con 0x5632767fc070 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6242fbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563276aa4580 con 0x5632767d31b0 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.046+0000 7f6242fbd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563276bb1750 con 0x5632767db390 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6242fbd740 10 client.0 _ll_register_callbacks cb 0x563276ab4470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276bae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276baec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276bae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43432/0 (socket says 172.21.15.84:43432) 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239a00640 1 -- 172.21.15.84:0/1691908756 learned_addr learned my addr 172.21.15.84:0/1691908756 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f623a400640 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 0x563276bbaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239000640 1 -- 172.21.15.84:0/1691908756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 msgr2=0x563276bae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239000640 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276bae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239000640 1 -- 172.21.15.84:0/1691908756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 msgr2=0x563276bbaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:28.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239000640 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 0x563276bbaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.047+0000 7f6239000640 1 -- 172.21.15.84:0/1691908756 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563276867650 con 0x5632767db390 2024-09-21T07:52:28.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.048+0000 7f6239000640 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276baec90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62200106b0 tx=0x7f6220004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8066e3e4c45e1ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.048+0000 7f621b400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.048+0000 7f621b400640 1 -- 172.21.15.84:0/1691908756 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220020070 con 0x5632767db390 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.048+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563276aa6b90 con 0x5632767db390 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.048+0000 7f621b400640 1 -- 172.21.15.84:0/1691908756 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6220005220 con 0x5632767db390 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.048+0000 7f621b400640 1 -- 172.21.15.84:0/1691908756 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6220005460 con 0x5632767db390 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 10 client.26083 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563276ac1950 con 0x5632767db390 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f621b400640 1 -- 172.21.15.84:0/1691908756 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563276aa6b90 con 0x5632767db390 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f621b400640 1 -- 172.21.15.84:0/1691908756 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f622001c890 con 0x5632767db390 2024-09-21T07:52:28.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 10 client.26083 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 10 client.26083 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 20 client.26083 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5632767ba9f0 0x563276bc0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 4 client.26083 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.049+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563276b1bf00 con 0x5632767ba9f0 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.050+0000 7f6239a00640 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5632767ba9f0 0x563276bc0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.051+0000 7f6239a00640 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5632767ba9f0 0x563276bc0910 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9be0d29e9ac6aa66 server_cookie=17386fd117889ee2 in_seq=0 out_seq=0 2024-09-21T07:52:28.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.051+0000 7f621b400640 10 client.26083 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f621b400640 1 -- 172.21.15.84:0/1691908756 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563276b1bf00 con 0x5632767ba9f0 2024-09-21T07:52:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f621b400640 10 client.26083 handle_command_reply: tid=0 2024-09-21T07:52:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 client.26083 shutdown 2024-09-21T07:52:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 msgr2=0x563276baec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276baec90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62200106b0 tx=0x7f6220004730 comp rx=0 tx=0).stop 2024-09-21T07:52:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 shutdown_connections 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x5632767ba9f0 0x563276bc0910 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767fc070 0x563276bbaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f621b400640 0 client.26083 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276baec90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 --2- 172.21.15.84:0/1691908756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767d31b0 0x563276bae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.052+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 >> 172.21.15.84:0/1691908756 conn(0x5632767f0460 msgr2=0x563276b9f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.053+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 shutdown_connections 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.053+0000 7f6242fbd740 1 -- 172.21.15.84:0/1691908756 wait complete. 2024-09-21T07:52:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.053+0000 7f6242fbd740 20 client.26083 trim_cache size 0 max 16384 2024-09-21T07:52:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 Processor -- start 2024-09-21T07:52:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 -- start start 2024-09-21T07:52:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276ba0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276ba0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f621400fde0 con 0x5632767d31b0 2024-09-21T07:52:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6214011920 con 0x5632767fc070 2024-09-21T07:52:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.069+0000 7f6242fbd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f62140104b0 con 0x5632767db390 2024-09-21T07:52:28.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.070+0000 7f623a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276ba0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.070+0000 7f623a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276ba0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43438/0 (socket says 172.21.15.84:43438) 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.070+0000 7f623a400640 1 -- 172.21.15.84:0/2557153119 learned_addr learned my addr 172.21.15.84:0/2557153119 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.070+0000 7f6239a00640 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.070+0000 7f6239000640 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276ba0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f623a400640 1 -- 172.21.15.84:0/2557153119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 msgr2=0x563276ba0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f623a400640 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276ba0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f623a400640 1 -- 172.21.15.84:0/2557153119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 msgr2=0x563276bb0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f623a400640 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f623a400640 1 -- 172.21.15.84:0/2557153119 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563276b9c280 con 0x5632767fc070 2024-09-21T07:52:28.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f6239a00640 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:28.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f623a400640 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276ba0b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f622c003970 tx=0x7f622c0039a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afbd1bec920d28c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.071+0000 7f6226000640 1 -- 172.21.15.84:0/2557153119 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c049070 con 0x5632767fc070 2024-09-21T07:52:28.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.072+0000 7f6226000640 1 -- 172.21.15.84:0/2557153119 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f622c003cc0 con 0x5632767fc070 2024-09-21T07:52:28.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.072+0000 7f6226000640 1 -- 172.21.15.84:0/2557153119 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c034040 con 0x5632767fc070 2024-09-21T07:52:28.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 -- 172.21.15.84:0/2557153119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 msgr2=0x563276ba0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276ba0b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f622c003970 tx=0x7f622c0039a0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 -- 172.21.15.84:0/2557153119 shutdown_connections 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276ba0b50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276ba0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2557153119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 -- 172.21.15.84:0/2557153119 >> 172.21.15.84:0/2557153119 conn(0x5632767f0460 msgr2=0x563276bafc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.073+0000 7f6242fbd740 1 -- 172.21.15.84:0/2557153119 shutdown_connections 2024-09-21T07:52:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.074+0000 7f6242fbd740 1 -- 172.21.15.84:0/2557153119 wait complete. 2024-09-21T07:52:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.074+0000 7f6242fbd740 1 -- start start 2024-09-21T07:52:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.074+0000 7f6242fbd740 1 Processor -- start 2024-09-21T07:52:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276bb3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6242fbd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276c2a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6242fbd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6214011250 con 0x5632767d31b0 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6242fbd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6214010b80 con 0x5632767fc070 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6242fbd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f621400dda0 con 0x5632767db390 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6242fbd740 10 client.0 _ll_register_callbacks cb 0x7f622000ee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6239000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276bb3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6239000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276bb3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55214/0 (socket says 172.21.15.84:55214) 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6239000640 1 -- 172.21.15.84:0/2399197041 learned_addr learned my addr 172.21.15.84:0/2399197041 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.075+0000 7f6239a00640 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f623a400640 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276c2a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f6239000640 1 -- 172.21.15.84:0/2399197041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 msgr2=0x563276c2a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f6239000640 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276c2a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f6239000640 1 -- 172.21.15.84:0/2399197041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 msgr2=0x563276bb2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f6239000640 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f6239000640 1 -- 172.21.15.84:0/2399197041 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563276c2a850 con 0x5632767db390 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f6239000640 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276bb3410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f622001ccb0 tx=0x7f6220009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=202ff651d8ec5e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f621b400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.076+0000 7f621b400640 1 -- 172.21.15.84:0/2399197041 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220037070 con 0x5632767db390 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f622c003cc0 con 0x5632767db390 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f621b400640 1 -- 172.21.15.84:0/2399197041 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6220005600 con 0x5632767db390 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f621b400640 1 -- 172.21.15.84:0/2399197041 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6220020040 con 0x5632767db390 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 10 client.26089 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563276c2b9b0 con 0x5632767db390 2024-09-21T07:52:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f621b400640 1 -- 172.21.15.84:0/2399197041 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f622c003cc0 con 0x5632767db390 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f621b400640 1 -- 172.21.15.84:0/2399197041 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f622003c710 con 0x5632767db390 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 10 client.26089 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 10 client.26089 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 20 client.26089 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56327678fda0 0x563276c2e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 4 client.26089 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.077+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563276b179b0 con 0x56327678fda0 2024-09-21T07:52:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.078+0000 7f6239a00640 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56327678fda0 0x563276c2e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.078+0000 7f6239a00640 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56327678fda0 0x563276c2e1a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ace39b70f2588032 server_cookie=3c100b2d925c8635 in_seq=0 out_seq=0 2024-09-21T07:52:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.078+0000 7f621b400640 10 client.26089 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.079+0000 7f621b400640 1 -- 172.21.15.84:0/2399197041 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563276b179b0 con 0x56327678fda0 2024-09-21T07:52:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.079+0000 7f621b400640 10 client.26089 handle_command_reply: tid=0 2024-09-21T07:52:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.079+0000 7f6242fbd740 1 client.26089 shutdown 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.079+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 msgr2=0x563276bb3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.079+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276bb3410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f622001ccb0 tx=0x7f6220009790 comp rx=0 tx=0).stop 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 shutdown_connections 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56327678fda0 0x563276c2e1a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632767fc070 0x563276c2a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5632767db390 0x563276bb3410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f621b400640 0 client.26089 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 --2- 172.21.15.84:0/2399197041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632767d31b0 0x563276bb2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 >> 172.21.15.84:0/2399197041 conn(0x5632767f0460 msgr2=0x563276bafa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 shutdown_connections 2024-09-21T07:52:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.080+0000 7f6242fbd740 1 -- 172.21.15.84:0/2399197041 wait complete. 2024-09-21T07:52:28.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.083+0000 7f6242fbd740 20 client.26089 trim_cache size 0 max 16384 2024-09-21T07:52:28.085 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f621c0b6610 msgr2=0x7f621c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f621c0b6610 0x7f621c0b8b20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6234104260 tx=0x7f6220005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6234102440 msgr2=0x7f623419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6234102440 0x7f623419c450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f622800e9f0 tx=0x7f622800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 shutdown_connections 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f621c0b6610 0x7f621c0b8b20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f623410fff0 0x7f62341a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6234102d90 0x7f623419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 --2- 172.21.15.84:0/4130598428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6234102440 0x7f623419c450 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:28.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 >> 172.21.15.84:0/4130598428 conn(0x7f62340fe2c0 msgr2=0x7f6234112090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:28.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.084+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 shutdown_connections 2024-09-21T07:52:28.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:28.085+0000 7f623ae00640 1 -- 172.21.15.84:0/4130598428 wait complete. 2024-09-21T07:52:29.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:52:29.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:29 smithi084 ceph-mon[30411]: pgmap v435: 129 pgs: 129 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 159 MiB/s wr, 61 op/s 2024-09-21T07:52:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:29 smithi162 ceph-mon[34833]: pgmap v435: 129 pgs: 129 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 159 MiB/s wr, 61 op/s 2024-09-21T07:52:29.652 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:29.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:29 smithi191 ceph-mon[34667]: pgmap v435: 129 pgs: 129 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 159 MiB/s wr, 61 op/s 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.544+0000 7fefe5400640 1 -- 172.21.15.84:0/2046493030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 msgr2=0x7fefe010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.544+0000 7fefe5400640 1 --2- 172.21.15.84:0/2046493030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 0x7fefe010f9d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009900 tx=0x7fefd002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.545+0000 7fefe5400640 1 -- 172.21.15.84:0/2046493030 shutdown_connections 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.545+0000 7fefe5400640 1 --2- 172.21.15.84:0/2046493030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe010ff10 0x7fefe0112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.545+0000 7fefe5400640 1 --2- 172.21.15.84:0/2046493030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 0x7fefe010f9d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.545+0000 7fefe5400640 1 --2- 172.21.15.84:0/2046493030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe00757b0 0x7fefe0075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.545+0000 7fefe5400640 1 -- 172.21.15.84:0/2046493030 >> 172.21.15.84:0/2046493030 conn(0x7fefe00ff440 msgr2=0x7fefe0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.546+0000 7fefe5400640 1 -- 172.21.15.84:0/2046493030 shutdown_connections 2024-09-21T07:52:30.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.546+0000 7fefe5400640 1 -- 172.21.15.84:0/2046493030 wait complete. 2024-09-21T07:52:30.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.549+0000 7fefe5400640 1 Processor -- start 2024-09-21T07:52:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.550+0000 7fefe5400640 1 -- start start 2024-09-21T07:52:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.551+0000 7fefe5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe00757b0 0x7fefe01073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.551+0000 7fefe5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 0x7fefe0103680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.551+0000 7fefe5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010ff10 0x7fefe0103da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.551+0000 7fefe5400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0115b10 con 0x7fefe0076100 2024-09-21T07:52:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.551+0000 7fefe5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0115990 con 0x7fefe010ff10 2024-09-21T07:52:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.551+0000 7fefe5400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0115c90 con 0x7fefe00757b0 2024-09-21T07:52:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.551+0000 7fefdf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 0x7fefe0103680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.552+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe00757b0 0x7fefe01073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.552+0000 7fefdf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 0x7fefe0103680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36650/0 (socket says 172.21.15.84:36650) 2024-09-21T07:52:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.552+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe00757b0 0x7fefe01073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55232/0 (socket says 172.21.15.84:55232) 2024-09-21T07:52:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.552+0000 7fefdfe00640 1 -- 172.21.15.84:0/3847923825 learned_addr learned my addr 172.21.15.84:0/3847923825 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.552+0000 7fefe4a00640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010ff10 0x7fefe0103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.553+0000 7fefdfe00640 1 -- 172.21.15.84:0/3847923825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010ff10 msgr2=0x7fefe0103da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.553+0000 7fefdfe00640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010ff10 0x7fefe0103da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.553+0000 7fefdfe00640 1 -- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 msgr2=0x7fefe0103680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.553+0000 7fefdfe00640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 0x7fefe0103680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.553+0000 7fefdfe00640 1 -- 172.21.15.84:0/3847923825 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe019c210 con 0x7fefe00757b0 2024-09-21T07:52:30.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.554+0000 7fefdfe00640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe00757b0 0x7fefe01073a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00d950 tx=0x7fefcc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.554+0000 7fefdcc00640 1 -- 172.21.15.84:0/3847923825 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc017070 con 0x7fefe00757b0 2024-09-21T07:52:30.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.554+0000 7fefdcc00640 1 -- 172.21.15.84:0/3847923825 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefcc009c30 con 0x7fefe00757b0 2024-09-21T07:52:30.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.554+0000 7fefdcc00640 1 -- 172.21.15.84:0/3847923825 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00f620 con 0x7fefe00757b0 2024-09-21T07:52:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.556+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe019c500 con 0x7fefe00757b0 2024-09-21T07:52:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.556+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe019c9c0 con 0x7fefe00757b0 2024-09-21T07:52:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.560+0000 7fefed640740 1 Processor -- start 2024-09-21T07:52:30.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.561+0000 7fefed640740 1 -- start start 2024-09-21T07:52:30.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.561+0000 7fefed640740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080984070 0x55f080d2ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.561+0000 7fefed640740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 0x55f080d2b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.561+0000 7fefed640740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.561+0000 7fefed640740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f080ca1fb0 con 0x55f08095b1b0 2024-09-21T07:52:30.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.561+0000 7fefed640740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f080c913e0 con 0x55f080963390 2024-09-21T07:52:30.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.561+0000 7fefed640740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f080c951f0 con 0x55f080984070 2024-09-21T07:52:30.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.562+0000 7fefdf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.562+0000 7fefdf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43466/0 (socket says 172.21.15.84:43466) 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.562+0000 7fefdf400640 1 -- 172.21.15.84:0/1410741655 learned_addr learned my addr 172.21.15.84:0/1410741655 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.562+0000 7fefe4a00640 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080984070 0x55f080d2ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.563+0000 7fefe4a00640 1 -- 172.21.15.84:0/1410741655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 msgr2=0x55f080d2b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.563+0000 7fefe4a00640 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.563+0000 7fefe4a00640 1 -- 172.21.15.84:0/1410741655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 msgr2=0x55f080d2b270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.563+0000 7fefe4a00640 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 0x55f080d2b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.563+0000 7fefe4a00640 1 -- 172.21.15.84:0/1410741655 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f080c5bcd0 con 0x55f080984070 2024-09-21T07:52:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.563+0000 7fefdcc00640 1 -- 172.21.15.84:0/3847923825 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fefcc010460 con 0x7fefe00757b0 2024-09-21T07:52:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.563+0000 7fefe4a00640 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080984070 0x55f080d2ad30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009e20 tx=0x7fefd8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=854cfa386c4d921c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.565+0000 7fefd5200640 1 -- 172.21.15.84:0/1410741655 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8016070 con 0x55f080984070 2024-09-21T07:52:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.565+0000 7fefd5200640 1 -- 172.21.15.84:0/1410741655 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefd8004d20 con 0x55f080984070 2024-09-21T07:52:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.565+0000 7fefd5200640 1 -- 172.21.15.84:0/1410741655 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8012780 con 0x55f080984070 2024-09-21T07:52:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.565+0000 7fefdcc00640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefc40b67b0 0x7fefc40b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.566+0000 7fefdcc00640 1 -- 172.21.15.84:0/3847923825 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fefcc0e7490 con 0x7fefe00757b0 2024-09-21T07:52:30.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.567+0000 7fefed640740 1 -- 172.21.15.84:0/1410741655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080984070 msgr2=0x55f080d2ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.567+0000 7fefed640740 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080984070 0x55f080d2ad30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009e20 tx=0x7fefd8010740 comp rx=0 tx=0).stop 2024-09-21T07:52:30.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.567+0000 7fefdfe00640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefc40b67b0 0x7fefc40b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.568+0000 7fefdfe00640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefc40b67b0 0x7fefc40b8cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55f080d299b0 tx=0x7fefcc00df40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.568+0000 7fefed640740 1 -- 172.21.15.84:0/1410741655 shutdown_connections 2024-09-21T07:52:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.568+0000 7fefed640740 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.568+0000 7fefed640740 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 0x55f080d2b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.568+0000 7fefed640740 1 --2- 172.21.15.84:0/1410741655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080984070 0x55f080d2ad30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.568+0000 7fefed640740 1 -- 172.21.15.84:0/1410741655 >> 172.21.15.84:0/1410741655 conn(0x55f080978460 msgr2=0x55f080d28bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.568+0000 7fefed640740 1 -- 172.21.15.84:0/1410741655 shutdown_connections 2024-09-21T07:52:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.569+0000 7fefed640740 1 -- 172.21.15.84:0/1410741655 wait complete. 2024-09-21T07:52:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.569+0000 7fefed640740 1 -- start start 2024-09-21T07:52:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.570+0000 7fefed640740 1 Processor -- start 2024-09-21T07:52:30.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.571+0000 7fefed640740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d36a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefed640740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080963390 0x55f080d36ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefed640740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d42830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefed640740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f080af2700 con 0x55f080963390 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefed640740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f080c2c580 con 0x55f080984070 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefed640740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f080d39510 con 0x55f08095b1b0 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d36a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d36a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55254/0 (socket says 172.21.15.84:55254) 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefe4a00640 1 -- 172.21.15.84:0/390315671 learned_addr learned my addr 172.21.15.84:0/390315671 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefed640740 10 client.0 _ll_register_callbacks cb 0x55f080c3c470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.572+0000 7fefe4a00640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d42830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.573+0000 7fefe4a00640 1 -- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 msgr2=0x55f080d42830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.573+0000 7fefe4a00640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d42830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.573+0000 7fefe4a00640 1 -- 172.21.15.84:0/390315671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080963390 msgr2=0x55f080d36ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.573+0000 7fefdf400640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080963390 0x55f080d36ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.573+0000 7fefe4a00640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080963390 0x55f080d36ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.573+0000 7fefe4a00640 1 -- 172.21.15.84:0/390315671 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0809ef650 con 0x55f08095b1b0 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.573+0000 7fefdf400640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080963390 0x55f080d36ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.574+0000 7fefe4a00640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d36a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005b40 tx=0x7fefd8010f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bd2910d0b195c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.574+0000 7fefc9600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.574+0000 7fefc9600640 1 -- 172.21.15.84:0/390315671 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8022040 con 0x55f08095b1b0 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.574+0000 7fefc9600640 1 -- 172.21.15.84:0/390315671 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fefd8012d70 con 0x55f08095b1b0 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.574+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f080c2eb90 con 0x55f08095b1b0 2024-09-21T07:52:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.575+0000 7fefc9600640 1 -- 172.21.15.84:0/390315671 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefd8016040 con 0x55f08095b1b0 2024-09-21T07:52:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.576+0000 7fefed640740 10 client.26101 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.576+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f080c49950 con 0x55f08095b1b0 2024-09-21T07:52:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefc9600640 1 -- 172.21.15.84:0/390315671 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f080c2eb90 con 0x55f08095b1b0 2024-09-21T07:52:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefc9600640 1 -- 172.21.15.84:0/390315671 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fefd800f040 con 0x55f08095b1b0 2024-09-21T07:52:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefed640740 10 client.26101 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefed640740 10 client.26101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefed640740 20 client.26101 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefed640740 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f0809429f0 0x55f080d48770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefed640740 4 client.26101 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.577+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f080ca3f00 con 0x55f0809429f0 2024-09-21T07:52:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.578+0000 7fefdf400640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f0809429f0 0x55f080d48770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.579+0000 7fefc9600640 10 client.26101 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.581+0000 7fefdf400640 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f0809429f0 0x55f080d48770 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a39483b8486024f server_cookie=fe4e03df6e8c5418 in_seq=0 out_seq=0 2024-09-21T07:52:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.582+0000 7fefc9600640 1 -- 172.21.15.84:0/390315671 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f080ca3f00 con 0x55f0809429f0 2024-09-21T07:52:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.582+0000 7fefc9600640 10 client.26101 handle_command_reply: tid=0 2024-09-21T07:52:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.582+0000 7fefed640740 1 client.26101 shutdown 2024-09-21T07:52:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 msgr2=0x55f080d36a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d36a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005b40 tx=0x7fefd8010f80 comp rx=0 tx=0).stop 2024-09-21T07:52:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 shutdown_connections 2024-09-21T07:52:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d42830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080963390 0x55f080d36ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f0809429f0 0x55f080d48770 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 --2- 172.21.15.84:0/390315671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d36a10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefc9600640 0 client.26101 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 >> 172.21.15.84:0/390315671 conn(0x55f080978460 msgr2=0x55f080d2dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.583+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 shutdown_connections 2024-09-21T07:52:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.584+0000 7fefed640740 1 -- 172.21.15.84:0/390315671 wait complete. 2024-09-21T07:52:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.584+0000 7fefed640740 20 client.26101 trim_cache size 0 max 16384 2024-09-21T07:52:30.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:52:30.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.612+0000 7fefed640740 1 Processor -- start 2024-09-21T07:52:30.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.612+0000 7fefed640740 1 -- start start 2024-09-21T07:52:30.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.612+0000 7fefed640740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d42730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.612+0000 7fefed640740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefed640740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080984070 0x55f080d304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefed640740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01c1ce0 con 0x55f080984070 2024-09-21T07:52:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefed640740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01bfad0 con 0x55f080963390 2024-09-21T07:52:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefed640740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01c1610 con 0x55f08095b1b0 2024-09-21T07:52:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d42730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d42730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55266/0 (socket says 172.21.15.84:55266) 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 -- 172.21.15.84:0/3935295876 learned_addr learned my addr 172.21.15.84:0/3935295876 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080984070 0x55f080d304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefdf400640 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 -- 172.21.15.84:0/3935295876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 msgr2=0x55f080d2ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 -- 172.21.15.84:0/3935295876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080984070 msgr2=0x55f080d304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.613+0000 7fefe4a00640 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080984070 0x55f080d304f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.614+0000 7fefe4a00640 1 -- 172.21.15.84:0/3935295876 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f080d37ad0 con 0x55f08095b1b0 2024-09-21T07:52:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.614+0000 7fefdf400640 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:30.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.614+0000 7fefe4a00640 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d42730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009be0 tx=0x7fefd8010f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f823858fe7a992b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.614+0000 7fefcbe00640 1 -- 172.21.15.84:0/3935295876 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8032030 con 0x55f08095b1b0 2024-09-21T07:52:30.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.614+0000 7fefcbe00640 1 -- 172.21.15.84:0/3935295876 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefd802e040 con 0x55f08095b1b0 2024-09-21T07:52:30.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.614+0000 7fefcbe00640 1 -- 172.21.15.84:0/3935295876 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8011a00 con 0x55f08095b1b0 2024-09-21T07:52:30.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 -- 172.21.15.84:0/3935295876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 msgr2=0x55f080d42730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d42730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009be0 tx=0x7fefd8010f10 comp rx=0 tx=0).stop 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 -- 172.21.15.84:0/3935295876 shutdown_connections 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f080984070 0x55f080d304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080963390 0x55f080d2ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 --2- 172.21.15.84:0/3935295876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f08095b1b0 0x55f080d42730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 -- 172.21.15.84:0/3935295876 >> 172.21.15.84:0/3935295876 conn(0x55f080978460 msgr2=0x55f080d31950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 -- 172.21.15.84:0/3935295876 shutdown_connections 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 -- 172.21.15.84:0/3935295876 wait complete. 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.616+0000 7fefed640740 1 -- start start 2024-09-21T07:52:30.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.617+0000 7fefed640740 1 Processor -- start 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefed640740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 0x55f080d2f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefed640740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080963390 0x55f080d2ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefed640740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d30450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefed640740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01c0870 con 0x55f08095b1b0 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefed640740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01c01a0 con 0x55f080984070 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefed640740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01c0f40 con 0x55f080963390 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefed640740 10 client.0 _ll_register_callbacks cb 0x7fefd8012640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d30450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d30450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43496/0 (socket says 172.21.15.84:43496) 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefe4a00640 1 -- 172.21.15.84:0/634246922 learned_addr learned my addr 172.21.15.84:0/634246922 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefdf400640 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080963390 0x55f080d2ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.618+0000 7fefe4a00640 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 0x55f080d2f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.619+0000 7fefe4a00640 1 -- 172.21.15.84:0/634246922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080963390 msgr2=0x55f080d2ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.619+0000 7fefe4a00640 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080963390 0x55f080d2ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.619+0000 7fefe4a00640 1 -- 172.21.15.84:0/634246922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 msgr2=0x55f080d2f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.619+0000 7fefe4a00640 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 0x55f080d2f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.619+0000 7fefe4a00640 1 -- 172.21.15.84:0/634246922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f080d3e780 con 0x55f080984070 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.619+0000 7fefe4a00640 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d30450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009660 tx=0x7fefd8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9bc8d43acce73f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.619+0000 7fefc9600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.620+0000 7fefc9600640 1 -- 172.21.15.84:0/634246922 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8032040 con 0x55f080984070 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.620+0000 7fefc9600640 1 -- 172.21.15.84:0/634246922 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fefd8012b70 con 0x55f080984070 2024-09-21T07:52:30.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.620+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefd802e040 con 0x55f080984070 2024-09-21T07:52:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.620+0000 7fefc9600640 1 -- 172.21.15.84:0/634246922 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefd8048050 con 0x55f080984070 2024-09-21T07:52:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.620+0000 7fefed640740 10 client.26105 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.620+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f080dc4100 con 0x55f080984070 2024-09-21T07:52:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefc9600640 1 -- 172.21.15.84:0/634246922 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefd802e040 con 0x55f080984070 2024-09-21T07:52:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefc9600640 1 -- 172.21.15.84:0/634246922 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fefd803f070 con 0x55f080984070 2024-09-21T07:52:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefed640740 10 client.26105 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:30.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefed640740 10 client.26105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefed640740 20 client.26105 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefed640740 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f080917da0 0x55f080dc6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefed640740 4 client.26105 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.621+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f080c9f9b0 con 0x55f080917da0 2024-09-21T07:52:30.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.622+0000 7fefdf400640 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f080917da0 0x55f080dc6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.623+0000 7fefc9600640 10 client.26105 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.623+0000 7fefdf400640 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f080917da0 0x55f080dc6770 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cedbee7856c11ee server_cookie=239996fae2a87bb9 in_seq=0 out_seq=0 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.623+0000 7fefc9600640 1 -- 172.21.15.84:0/634246922 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f080c9f9b0 con 0x55f080917da0 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.623+0000 7fefc9600640 10 client.26105 handle_command_reply: tid=0 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.623+0000 7fefed640740 1 client.26105 shutdown 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 msgr2=0x55f080d30450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d30450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009660 tx=0x7fefd8010740 comp rx=0 tx=0).stop 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 shutdown_connections 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f080984070 0x55f080d30450 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f080917da0 0x55f080dc6770 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f080963390 0x55f080d2ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 --2- 172.21.15.84:0/634246922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f08095b1b0 0x55f080d2f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 >> 172.21.15.84:0/634246922 conn(0x55f080978460 msgr2=0x55f080d34cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefc9600640 0 client.26105 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:30.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 shutdown_connections 2024-09-21T07:52:30.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.624+0000 7fefed640740 1 -- 172.21.15.84:0/634246922 wait complete. 2024-09-21T07:52:30.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.625+0000 7fefed640740 20 client.26105 trim_cache size 0 max 16384 2024-09-21T07:52:30.628 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefc40b67b0 msgr2=0x7fefc40b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefc40b67b0 0x7fefc40b8cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55f080d299b0 tx=0x7fefcc00df40 comp rx=0 tx=0).stop 2024-09-21T07:52:30.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe00757b0 msgr2=0x7fefe01073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe00757b0 0x7fefe01073a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00d950 tx=0x7fefcc00de10 comp rx=0 tx=0).stop 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 shutdown_connections 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefc40b67b0 0x7fefc40b8cc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefe010ff10 0x7fefe0103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe0076100 0x7fefe0103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 --2- 172.21.15.84:0/3847923825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefe00757b0 0x7fefe01073a0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00d950 tx=0x7fefcc00de10 comp rx=0 tx=0).stop 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 >> 172.21.15.84:0/3847923825 conn(0x7fefe00ff440 msgr2=0x7fefe0109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.626+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 shutdown_connections 2024-09-21T07:52:30.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:30.627+0000 7fefe5400640 1 -- 172.21.15.84:0/3847923825 wait complete. 2024-09-21T07:52:31.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:31 smithi162 ceph-mon[34833]: pgmap v436: 129 pgs: 129 active+clean; 2.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 232 MiB/s wr, 81 op/s 2024-09-21T07:52:31.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:31 smithi084 ceph-mon[30411]: pgmap v436: 129 pgs: 129 active+clean; 2.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 232 MiB/s wr, 81 op/s 2024-09-21T07:52:31.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:31 smithi191 ceph-mon[34667]: pgmap v436: 129 pgs: 129 active+clean; 2.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 232 MiB/s wr, 81 op/s 2024-09-21T07:52:32.063 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.571+0000 7f879e800640 1 -- 172.21.15.84:0/882384161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87900a6d40 msgr2=0x7f87900a9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.571+0000 7f879e800640 1 --2- 172.21.15.84:0/882384161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87900a6d40 0x7f87900a9160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f878c009900 tx=0x7f878c02a410 comp rx=0 tx=0).stop 2024-09-21T07:52:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.571+0000 7f879e800640 1 -- 172.21.15.84:0/882384161 shutdown_connections 2024-09-21T07:52:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.571+0000 7f879e800640 1 --2- 172.21.15.84:0/882384161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87900a6d40 0x7f87900a9160 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.571+0000 7f879e800640 1 --2- 172.21.15.84:0/882384161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900097e0 0x7f87900a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.571+0000 7f879e800640 1 --2- 172.21.15.84:0/882384161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8790008e90 0x7f87900092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.571+0000 7f879e800640 1 -- 172.21.15.84:0/882384161 >> 172.21.15.84:0/882384161 conn(0x7f8790093db0 msgr2=0x7f8790096200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.573+0000 7f879e800640 1 -- 172.21.15.84:0/882384161 shutdown_connections 2024-09-21T07:52:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.573+0000 7f879e800640 1 -- 172.21.15.84:0/882384161 wait complete. 2024-09-21T07:52:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.575+0000 7f879e800640 1 Processor -- start 2024-09-21T07:52:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.575+0000 7f879e800640 1 -- start start 2024-09-21T07:52:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.576+0000 7f879e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8790008e90 0x7f87901440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.577+0000 7f879e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87900097e0 0x7f8790144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.577+0000 7f879e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900a6d40 0x7f87901498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.577+0000 7f879d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8790008e90 0x7f87901440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.577+0000 7f879d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8790008e90 0x7f87901440b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55288/0 (socket says 172.21.15.84:55288) 2024-09-21T07:52:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.578+0000 7f879ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87900097e0 0x7f8790144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.578+0000 7f879de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900a6d40 0x7f87901498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.578+0000 7f879de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900a6d40 0x7f87901498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43514/0 (socket says 172.21.15.84:43514) 2024-09-21T07:52:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.578+0000 7f879ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87900097e0 0x7f8790144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36680/0 (socket says 172.21.15.84:36680) 2024-09-21T07:52:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.578+0000 7f879d400640 1 -- 172.21.15.84:0/1560555494 learned_addr learned my addr 172.21.15.84:0/1560555494 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.578+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87900ac6c0 con 0x7f87900097e0 2024-09-21T07:52:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.579+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87900ac540 con 0x7f87900a6d40 2024-09-21T07:52:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.579+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f87900ac840 con 0x7f8790008e90 2024-09-21T07:52:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.580+0000 7f879de00640 1 -- 172.21.15.84:0/1560555494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8790008e90 msgr2=0x7f87901440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.580+0000 7f879de00640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8790008e90 0x7f87901440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.580+0000 7f879de00640 1 -- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87900097e0 msgr2=0x7f8790144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.580+0000 7f879de00640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87900097e0 0x7f8790144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.580+0000 7f879d400640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8790008e90 0x7f87901440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.580+0000 7f879de00640 1 -- 172.21.15.84:0/1560555494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8790149fe0 con 0x7f87900a6d40 2024-09-21T07:52:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.581+0000 7f879de00640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900a6d40 0x7f87901498e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f878c009850 tx=0x7f878c003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.581+0000 7f8796000640 1 -- 172.21.15.84:0/1560555494 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c03f070 con 0x7f87900a6d40 2024-09-21T07:52:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.582+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879014a270 con 0x7f87900a6d40 2024-09-21T07:52:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.582+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8790150a60 con 0x7f87900a6d40 2024-09-21T07:52:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.582+0000 7f8796000640 1 -- 172.21.15.84:0/1560555494 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f878c031b50 con 0x7f87900a6d40 2024-09-21T07:52:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.584+0000 7f8796000640 1 -- 172.21.15.84:0/1560555494 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c03f070 con 0x7f87900a6d40 2024-09-21T07:52:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.588+0000 7f87a6e0e740 1 Processor -- start 2024-09-21T07:52:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.590+0000 7f8796000640 1 -- 172.21.15.84:0/1560555494 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f878c042070 con 0x7f87900a6d40 2024-09-21T07:52:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.591+0000 7f87a6e0e740 1 -- start start 2024-09-21T07:52:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.592+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc244e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.592+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc245350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.592+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc245890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.592+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5638dc1ba6b0 con 0x5638dbe772f0 2024-09-21T07:52:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.592+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5638dc1a9ae0 con 0x5638dbe7f4d0 2024-09-21T07:52:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.592+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5638dc1ad8f0 con 0x5638dbea01b0 2024-09-21T07:52:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.593+0000 7f879ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc244e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.594+0000 7f8796000640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f87800b69c0 0x7f87800b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.594+0000 7f879d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc245350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.594+0000 7f879d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc245350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36694/0 (socket says 172.21.15.84:36694) 2024-09-21T07:52:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.594+0000 7f879d400640 1 -- 172.21.15.84:0/1208272865 learned_addr learned my addr 172.21.15.84:0/1208272865 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.594+0000 7f8796000640 1 -- 172.21.15.84:0/1560555494 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f878c107d10 con 0x7f87900a6d40 2024-09-21T07:52:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.594+0000 7f879ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc244e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55298/0 (socket says 172.21.15.84:55298) 2024-09-21T07:52:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.596+0000 7f879ca00640 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc245890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.596+0000 7f879de00640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f87800b69c0 0x7f87800b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.597+0000 7f879ca00640 1 -- 172.21.15.84:0/1208272865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 msgr2=0x5638dc245890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.598+0000 7f879ca00640 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc245890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.598+0000 7f879ca00640 1 -- 172.21.15.84:0/1208272865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 msgr2=0x5638dc245350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.598+0000 7f879ca00640 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc245350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.598+0000 7f879ca00640 1 -- 172.21.15.84:0/1208272865 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dc176780 con 0x5638dbea01b0 2024-09-21T07:52:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.598+0000 7f879d400640 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc245350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.599+0000 7f879ca00640 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc244e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87900056e0 tx=0x7f878400b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ff16173c0bc400 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.600+0000 7f879de00640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f87800b69c0 0x7f87800b8ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f878c0cd4f0 tx=0x7f878c005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.600+0000 7f878a600640 1 -- 172.21.15.84:0/1208272865 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784004030 con 0x5638dbea01b0 2024-09-21T07:52:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.600+0000 7f878a600640 1 -- 172.21.15.84:0/1208272865 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87840041d0 con 0x5638dbea01b0 2024-09-21T07:52:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.600+0000 7f878a600640 1 -- 172.21.15.84:0/1208272865 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87840035f0 con 0x5638dbea01b0 2024-09-21T07:52:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1208272865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 msgr2=0x5638dc244e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc244e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87900056e0 tx=0x7f878400b410 comp rx=0 tx=0).stop 2024-09-21T07:52:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1208272865 shutdown_connections 2024-09-21T07:52:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc245890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc245350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1208272865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc244e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1208272865 >> 172.21.15.84:0/1208272865 conn(0x5638dbe94300 msgr2=0x5638dc242d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1208272865 shutdown_connections 2024-09-21T07:52:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.601+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1208272865 wait complete. 2024-09-21T07:52:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.602+0000 7f87a6e0e740 1 -- start start 2024-09-21T07:52:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.602+0000 7f87a6e0e740 1 Processor -- start 2024-09-21T07:52:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.603+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc250440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.604+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc250980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.604+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc250f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.604+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5638dc0e1ab0 con 0x5638dbe772f0 2024-09-21T07:52:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.604+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5638dc150570 con 0x5638dbe7f4d0 2024-09-21T07:52:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.604+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5638dc253590 con 0x5638dbea01b0 2024-09-21T07:52:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.604+0000 7f87a6e0e740 10 client.0 _ll_register_callbacks cb 0x5638dc15f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.605+0000 7f879ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc250440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.605+0000 7f879ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc250440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36710/0 (socket says 172.21.15.84:36710) 2024-09-21T07:52:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.605+0000 7f879ca00640 1 -- 172.21.15.84:0/4084057911 learned_addr learned my addr 172.21.15.84:0/4084057911 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.605+0000 7f879d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc250980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.605+0000 7f879ca00640 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc250f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.606+0000 7f879ca00640 1 -- 172.21.15.84:0/4084057911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 msgr2=0x5638dc250f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.606+0000 7f879ca00640 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc250f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.606+0000 7f879ca00640 1 -- 172.21.15.84:0/4084057911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 msgr2=0x5638dc250980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.606+0000 7f879ca00640 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc250980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.606+0000 7f879ca00640 1 -- 172.21.15.84:0/4084057911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638dbf0b790 con 0x5638dbe772f0 2024-09-21T07:52:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.606+0000 7f879ca00640 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc250440 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f878400dc60 tx=0x7f8784014eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db9228c3433fd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.606+0000 7f877ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:52:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.607+0000 7f877ea00640 1 -- 172.21.15.84:0/4084057911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87840044a0 con 0x5638dbe772f0 2024-09-21T07:52:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.607+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87840041d0 con 0x5638dbe772f0 2024-09-21T07:52:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.607+0000 7f877ea00640 1 -- 172.21.15.84:0/4084057911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f878400d6b0 con 0x5638dbe772f0 2024-09-21T07:52:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.610+0000 7f877ea00640 1 -- 172.21.15.84:0/4084057911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f878400d8d0 con 0x5638dbe772f0 2024-09-21T07:52:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.610+0000 7f87a6e0e740 10 client.16134 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.610+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5638dbf84620 con 0x5638dbe772f0 2024-09-21T07:52:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.611+0000 7f877ea00640 1 -- 172.21.15.84:0/4084057911 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87840041d0 con 0x5638dbe772f0 2024-09-21T07:52:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.612+0000 7f877ea00640 1 -- 172.21.15.84:0/4084057911 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8784003d70 con 0x5638dbe772f0 2024-09-21T07:52:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.612+0000 7f87a6e0e740 10 client.16134 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.612+0000 7f87a6e0e740 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.612+0000 7f87a6e0e740 20 client.16134 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.612+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe5ed80 0x5638dc2624d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.612+0000 7f87a6e0e740 4 client.16134 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.612+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638dc1bc600 con 0x5638dbe5ed80 2024-09-21T07:52:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.613+0000 7f879d400640 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe5ed80 0x5638dc2624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.614+0000 7f877ea00640 10 client.16134 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.614+0000 7f879d400640 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe5ed80 0x5638dc2624d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1076df3416947392 server_cookie=3750bc134d95142d in_seq=0 out_seq=0 2024-09-21T07:52:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f877ea00640 1 -- 172.21.15.84:0/4084057911 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638dc1bc600 con 0x5638dbe5ed80 2024-09-21T07:52:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f877ea00640 10 client.16134 handle_command_reply: tid=0 2024-09-21T07:52:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 client.16134 shutdown 2024-09-21T07:52:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 msgr2=0x5638dc250440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc250440 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f878400dc60 tx=0x7f8784014eb0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 shutdown_connections 2024-09-21T07:52:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe5ed80 0x5638dc2624d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbea01b0 0x5638dc250f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f877ea00640 0 client.16134 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc250980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/4084057911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbe772f0 0x5638dc250440 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.615+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 >> 172.21.15.84:0/4084057911 conn(0x5638dbe94300 msgr2=0x5638dc245e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.616+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 shutdown_connections 2024-09-21T07:52:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.616+0000 7f87a6e0e740 1 -- 172.21.15.84:0/4084057911 wait complete. 2024-09-21T07:52:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.616+0000 7f87a6e0e740 20 client.16134 trim_cache size 0 max 16384 2024-09-21T07:52:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.639+0000 7f87a6e0e740 1 Processor -- start 2024-09-21T07:52:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.639+0000 7f87a6e0e740 1 -- start start 2024-09-21T07:52:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe772f0 0x5638dc246920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc241d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc252070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f877800fde0 con 0x5638dbea01b0 2024-09-21T07:52:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8778011920 con 0x5638dbe7f4d0 2024-09-21T07:52:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f87780104b0 con 0x5638dbe772f0 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc241d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe772f0 0x5638dc246920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc241d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43538/0 (socket says 172.21.15.84:43538) 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 -- 172.21.15.84:0/414719234 learned_addr learned my addr 172.21.15.84:0/414719234 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879ca00640 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc252070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 -- 172.21.15.84:0/414719234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe772f0 msgr2=0x5638dc246920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe772f0 0x5638dc246920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 -- 172.21.15.84:0/414719234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 msgr2=0x5638dc252070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc252070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.640+0000 7f879d400640 1 -- 172.21.15.84:0/414719234 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dc2533e0 con 0x5638dbe7f4d0 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.641+0000 7f879d400640 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc241d20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8798052860 tx=0x7f87980519a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c6f88d88b49757 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.641+0000 7f8789c00640 1 -- 172.21.15.84:0/414719234 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798075dc0 con 0x5638dbe7f4d0 2024-09-21T07:52:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.641+0000 7f8789c00640 1 -- 172.21.15.84:0/414719234 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8798081e20 con 0x5638dbe7f4d0 2024-09-21T07:52:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.641+0000 7f8789c00640 1 -- 172.21.15.84:0/414719234 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798086c80 con 0x5638dbe7f4d0 2024-09-21T07:52:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 -- 172.21.15.84:0/414719234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 msgr2=0x5638dc241d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc241d20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8798052860 tx=0x7f87980519a0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 -- 172.21.15.84:0/414719234 shutdown_connections 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc252070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe7f4d0 0x5638dc241d20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/414719234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe772f0 0x5638dc246920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 -- 172.21.15.84:0/414719234 >> 172.21.15.84:0/414719234 conn(0x5638dbe94300 msgr2=0x5638dc251960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 -- 172.21.15.84:0/414719234 shutdown_connections 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.642+0000 7f87a6e0e740 1 -- 172.21.15.84:0/414719234 wait complete. 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 -- start start 2024-09-21T07:52:32.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 Processor -- start 2024-09-21T07:52:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe772f0 0x5638dc258f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe7f4d0 0x5638dc256440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc256980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8778011250 con 0x5638dbea01b0 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8778010b80 con 0x5638dbe772f0 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f877800dda0 con 0x5638dbe7f4d0 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.643+0000 7f87a6e0e740 10 client.0 _ll_register_callbacks cb 0x7f87980698d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe772f0 0x5638dc258f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe772f0 0x5638dc258f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43542/0 (socket says 172.21.15.84:43542) 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe7f4d0 0x5638dc256440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879ca00640 1 -- 172.21.15.84:0/1441910846 learned_addr learned my addr 172.21.15.84:0/1441910846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879ca00640 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc256980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879d400640 1 -- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe772f0 msgr2=0x5638dc258f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879d400640 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe772f0 0x5638dc258f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879d400640 1 -- 172.21.15.84:0/1441910846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 msgr2=0x5638dc256980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879d400640 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc256980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879d400640 1 -- 172.21.15.84:0/1441910846 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638dc257070 con 0x5638dbe7f4d0 2024-09-21T07:52:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879ca00640 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe772f0 0x5638dc258f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f879d400640 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe7f4d0 0x5638dc256440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5638dc2518a0 tx=0x7f8798075f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c3b06c6fda94e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.644+0000 7f877ea00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.645+0000 7f877ea00640 1 -- 172.21.15.84:0/1441910846 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798093070 con 0x5638dbe7f4d0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.645+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8798081e20 con 0x5638dbe7f4d0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.645+0000 7f877ea00640 1 -- 172.21.15.84:0/1441910846 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8798081970 con 0x5638dbe7f4d0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.645+0000 7f877ea00640 1 -- 172.21.15.84:0/1441910846 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f879809d050 con 0x5638dbe7f4d0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.645+0000 7f87a6e0e740 10 client.26125 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.645+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5638dc2cccb0 con 0x5638dbe7f4d0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.645+0000 7f877ea00640 1 -- 172.21.15.84:0/1441910846 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8798081e20 con 0x5638dbe7f4d0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f877ea00640 1 -- 172.21.15.84:0/1441910846 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8798084040 con 0x5638dbe7f4d0 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f87a6e0e740 10 client.26125 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f87a6e0e740 10 client.26125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f87a6e0e740 20 client.26125 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe341c0 0x5638dc2cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f87a6e0e740 4 client.26125 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:52:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5638dc1b80b0 con 0x5638dbe341c0 2024-09-21T07:52:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f879ca00640 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe341c0 0x5638dc2cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f877ea00640 10 client.26125 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.646+0000 7f879ca00640 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe341c0 0x5638dc2cf380 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b410a16a8f813da server_cookie=ae40a089f0d7c5d2 in_seq=0 out_seq=0 2024-09-21T07:52:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f877ea00640 1 -- 172.21.15.84:0/1441910846 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5638dc1b80b0 con 0x5638dbe341c0 2024-09-21T07:52:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f877ea00640 10 client.26125 handle_command_reply: tid=0 2024-09-21T07:52:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 client.26125 shutdown 2024-09-21T07:52:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe7f4d0 msgr2=0x5638dc256440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe7f4d0 0x5638dc256440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5638dc2518a0 tx=0x7f8798075f40 comp rx=0 tx=0).stop 2024-09-21T07:52:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 shutdown_connections 2024-09-21T07:52:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5638dbea01b0 0x5638dc256980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5638dbe341c0 0x5638dc2cf380 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5638dbe7f4d0 0x5638dc256440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 --2- 172.21.15.84:0/1441910846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638dbe772f0 0x5638dc258f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f877ea00640 0 client.26125 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.660+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 >> 172.21.15.84:0/1441910846 conn(0x5638dbe94300 msgr2=0x5638dc241af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.661+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 shutdown_connections 2024-09-21T07:52:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.661+0000 7f87a6e0e740 1 -- 172.21.15.84:0/1441910846 wait complete. 2024-09-21T07:52:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.661+0000 7f87a6e0e740 20 client.26125 trim_cache size 0 max 16384 2024-09-21T07:52:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:52:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:52:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:52:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.661+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f87800b69c0 msgr2=0x7f87800b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.661+0000 7f879e800640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f87800b69c0 0x7f87800b8ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f878c0cd4f0 tx=0x7f878c005c90 comp rx=0 tx=0).stop 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.661+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900a6d40 msgr2=0x7f87901498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.661+0000 7f879e800640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900a6d40 0x7f87901498e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f878c009850 tx=0x7f878c003cd0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 shutdown_connections 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f87800b69c0 0x7f87800b8ed0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87900a6d40 0x7f87901498e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87900097e0 0x7f8790144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 --2- 172.21.15.84:0/1560555494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8790008e90 0x7f87901440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 >> 172.21.15.84:0/1560555494 conn(0x7f8790093db0 msgr2=0x7f87900a8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 shutdown_connections 2024-09-21T07:52:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:32.662+0000 7f879e800640 1 -- 172.21.15.84:0/1560555494 wait complete. 2024-09-21T07:52:32.949 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:52:32.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:52:32.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 -- 172.21.15.84:0/3394262858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 msgr2=0x7fc3b8102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 --2- 172.21.15.84:0/3394262858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 0x7fc3b8102a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009900 tx=0x7fc3a802a480 comp rx=0 tx=0).stop 2024-09-21T07:52:32.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 -- 172.21.15.84:0/3394262858 shutdown_connections 2024-09-21T07:52:32.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 --2- 172.21.15.84:0/3394262858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3b81101a0 0x7fc3b81125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 --2- 172.21.15.84:0/3394262858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 0x7fc3b810fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 --2- 172.21.15.84:0/3394262858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 0x7fc3b8102a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 -- 172.21.15.84:0/3394262858 >> 172.21.15.84:0/3394262858 conn(0x7fc3b8079740 msgr2=0x7fc3b8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:32.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.985+0000 7fc3bee00640 1 -- 172.21.15.84:0/3394262858 shutdown_connections 2024-09-21T07:52:32.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.986+0000 7fc3bee00640 1 -- 172.21.15.84:0/3394262858 wait complete. 2024-09-21T07:52:32.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 Processor -- start 2024-09-21T07:52:32.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 -- start start 2024-09-21T07:52:32.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 0x7fc3b819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 0x7fc3b819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3b81101a0 0x7fc3b81a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8115ca0 con 0x7fc3b81101a0 2024-09-21T07:52:32.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8115b20 con 0x7fc3b8102f40 2024-09-21T07:52:32.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.988+0000 7fc3bee00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8115e20 con 0x7fc3b81025f0 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 0x7fc3b819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 0x7fc3b819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43552/0 (socket says 172.21.15.84:43552) 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 -- 172.21.15.84:0/213984910 learned_addr learned my addr 172.21.15.84:0/213984910 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7e00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 0x7fc3b819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3bce00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3b81101a0 0x7fc3b81a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 -- 172.21.15.84:0/213984910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 msgr2=0x7fc3b819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 0x7fc3b819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 -- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3b81101a0 msgr2=0x7fc3b81a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3b81101a0 0x7fc3b81a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 -- 172.21.15.84:0/213984910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81a2580 con 0x7fc3b8102f40 2024-09-21T07:52:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.989+0000 7fc3b7400640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 0x7fc3b819cbb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9f0 tx=0x7fc3a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.990+0000 7fc3b4c00640 1 -- 172.21.15.84:0/213984910 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400cd80 con 0x7fc3b8102f40 2024-09-21T07:52:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.990+0000 7fc3b4c00640 1 -- 172.21.15.84:0/213984910 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3a40108e0 con 0x7fc3b8102f40 2024-09-21T07:52:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.990+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b81a2870 con 0x7fc3b8102f40 2024-09-21T07:52:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.990+0000 7fc3b4c00640 1 -- 172.21.15.84:0/213984910 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4018980 con 0x7fc3b8102f40 2024-09-21T07:52:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.990+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81a8fd0 con 0x7fc3b8102f40 2024-09-21T07:52:32.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.993+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3980052c0 con 0x7fc3b8102f40 2024-09-21T07:52:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.995+0000 7fc3b4c00640 1 -- 172.21.15.84:0/213984910 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc3a4010430 con 0x7fc3b8102f40 2024-09-21T07:52:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.997+0000 7fc3b4c00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc39c0b66b0 0x7fc39c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.997+0000 7fc3b4c00640 1 -- 172.21.15.84:0/213984910 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc3a40e7c10 con 0x7fc3b8102f40 2024-09-21T07:52:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:32.998+0000 7fc3b7e00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc39c0b66b0 0x7fc39c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.002+0000 7fc3b4c00640 1 -- 172.21.15.84:0/213984910 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3a4018420 con 0x7fc3b8102f40 2024-09-21T07:52:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.002+0000 7fc3b7e00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc39c0b66b0 0x7fc39c0b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8005ab0 tx=0x7fc3a8000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:33.212 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:33 smithi084 ceph-mon[30411]: pgmap v437: 129 pgs: 129 active+clean; 3.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 254 MiB/s wr, 88 op/s 2024-09-21T07:52:33.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.455+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc398005880 con 0x7fc3b8102f40 2024-09-21T07:52:33.461 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:52:33.461 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:52:33.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.456+0000 7fc3b4c00640 1 -- 172.21.15.84:0/213984910 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fc3a40addf0 con 0x7fc3b8102f40 2024-09-21T07:52:33.462 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:52:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc39c0b66b0 msgr2=0x7fc39c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc39c0b66b0 0x7fc39c0b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8005ab0 tx=0x7fc3a8000bc0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 msgr2=0x7fc3b819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:33.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 0x7fc3b819cbb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9f0 tx=0x7fc3a400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 shutdown_connections 2024-09-21T07:52:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc39c0b66b0 0x7fc39c0b8bc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3b81101a0 0x7fc3b81a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3b8102f40 0x7fc3b819cbb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 --2- 172.21.15.84:0/213984910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3b81025f0 0x7fc3b819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:33.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.463+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 >> 172.21.15.84:0/213984910 conn(0x7fc3b8079740 msgr2=0x7fc3b8109d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:33.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.466+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 shutdown_connections 2024-09-21T07:52:33.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:33.466+0000 7fc3bee00640 1 -- 172.21.15.84:0/213984910 wait complete. 2024-09-21T07:52:33.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:33 smithi162 ceph-mon[34833]: pgmap v437: 129 pgs: 129 active+clean; 3.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 254 MiB/s wr, 88 op/s 2024-09-21T07:52:33.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:33 smithi191 ceph-mon[34667]: pgmap v437: 129 pgs: 129 active+clean; 3.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 254 MiB/s wr, 88 op/s 2024-09-21T07:52:33.813 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:34.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:34 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/213984910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:34.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:34 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/213984910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:34.588 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id a18219b2 --release --await' 2024-09-21T07:52:34.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id a18219b2 --release --await 2024-09-21T07:52:34.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:34 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/213984910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:35.338 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:35.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.495+0000 7f8caf400640 1 -- 172.21.15.84:0/2838386209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 msgr2=0x7f8ca81080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.496+0000 7f8caf400640 1 --2- 172.21.15.84:0/2838386209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 0x7f8ca81080c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009cd0 tx=0x7f8ca002a910 comp rx=0 tx=0).stop 2024-09-21T07:52:35.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.497+0000 7f8caf400640 1 -- 172.21.15.84:0/2838386209 shutdown_connections 2024-09-21T07:52:35.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:35 smithi084 ceph-mon[30411]: pgmap v438: 129 pgs: 129 active+clean; 4.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 284 MiB/s wr, 88 op/s 2024-09-21T07:52:35.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.497+0000 7f8caf400640 1 --2- 172.21.15.84:0/2838386209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 0x7f8ca81080c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.497+0000 7f8caf400640 1 --2- 172.21.15.84:0/2838386209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81030f0 0x7f8ca8107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.497+0000 7f8caf400640 1 --2- 172.21.15.84:0/2838386209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca81027a0 0x7f8ca8102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.497+0000 7f8caf400640 1 -- 172.21.15.84:0/2838386209 >> 172.21.15.84:0/2838386209 conn(0x7f8ca8079730 msgr2=0x7f8ca8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:35.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.497+0000 7f8caf400640 1 -- 172.21.15.84:0/2838386209 shutdown_connections 2024-09-21T07:52:35.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.498+0000 7f8caf400640 1 -- 172.21.15.84:0/2838386209 wait complete. 2024-09-21T07:52:35.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.501+0000 7f8caf400640 1 Processor -- start 2024-09-21T07:52:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.503+0000 7f8caf400640 1 -- start start 2024-09-21T07:52:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.504+0000 7f8caf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81027a0 0x7f8ca81a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.504+0000 7f8caf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca81030f0 0x7f8ca81a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.504+0000 7f8caf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 0x7f8ca81a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.504+0000 7f8caf400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca811a170 con 0x7f8ca8107be0 2024-09-21T07:52:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.504+0000 7f8caf400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8119ff0 con 0x7f8ca81027a0 2024-09-21T07:52:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.504+0000 7f8caf400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca811a2f0 con 0x7f8ca81030f0 2024-09-21T07:52:35.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.505+0000 7f8caca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81027a0 0x7f8ca81a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.505+0000 7f8caca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81027a0 0x7f8ca81a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43576/0 (socket says 172.21.15.84:43576) 2024-09-21T07:52:35.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.505+0000 7f8caca00640 1 -- 172.21.15.84:0/3503198853 learned_addr learned my addr 172.21.15.84:0/3503198853 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:35.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.506+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca81030f0 0x7f8ca81a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.507+0000 7f8cad400640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 0x7f8ca81a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.507+0000 7f8caca00640 1 -- 172.21.15.84:0/3503198853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca81030f0 msgr2=0x7f8ca81a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.507+0000 7f8caca00640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca81030f0 0x7f8ca81a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.507+0000 7f8caca00640 1 -- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 msgr2=0x7f8ca81a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.507+0000 7f8caca00640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 0x7f8ca81a6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.507+0000 7f8caca00640 1 -- 172.21.15.84:0/3503198853 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca81a6870 con 0x7f8ca81027a0 2024-09-21T07:52:35.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.508+0000 7f8caca00640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81027a0 0x7f8ca81a0930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400b4a0 tx=0x7f8c9400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.508+0000 7f8ca5600640 1 -- 172.21.15.84:0/3503198853 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94014070 con 0x7f8ca81027a0 2024-09-21T07:52:35.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.508+0000 7f8ca5600640 1 -- 172.21.15.84:0/3503198853 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c94010ac0 con 0x7f8ca81027a0 2024-09-21T07:52:35.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.508+0000 7f8ca5600640 1 -- 172.21.15.84:0/3503198853 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94017ba0 con 0x7f8ca81027a0 2024-09-21T07:52:35.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.509+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca81a6b60 con 0x7f8ca81027a0 2024-09-21T07:52:35.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.509+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca8108bf0 con 0x7f8ca81027a0 2024-09-21T07:52:35.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.515+0000 7f8cb6028740 1 Processor -- start 2024-09-21T07:52:35.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.516+0000 7f8cb6028740 1 -- start start 2024-09-21T07:52:35.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.517+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f63d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.517+0000 7f8ca5600640 1 -- 172.21.15.84:0/3503198853 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8c94017070 con 0x7f8ca81027a0 2024-09-21T07:52:35.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.518+0000 7f8cad400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f63d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.519+0000 7f8cad400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f63d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36794/0 (socket says 172.21.15.84:36794) 2024-09-21T07:52:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.519+0000 7f8cad400640 1 -- 172.21.15.84:0/1643795773 learned_addr learned my addr 172.21.15.84:0/1643795773 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.519+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f64250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.519+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b9b670 0x563353f64790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.519+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563353ed9e90 con 0x563353bbc350 2024-09-21T07:52:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.519+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563353ec92c0 con 0x563353b93490 2024-09-21T07:52:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.519+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563353ecd0d0 con 0x563353b9b670 2024-09-21T07:52:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.521+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b9b670 0x563353f64790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.521+0000 7f8cad400640 1 -- 172.21.15.84:0/1643795773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b9b670 msgr2=0x563353f64790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:35.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.521+0000 7f8cad400640 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b9b670 0x563353f64790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.521+0000 7f8cad400640 1 -- 172.21.15.84:0/1643795773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 msgr2=0x563353f64250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:35.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.521+0000 7f8cad400640 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f64250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.521+0000 7f8cad400640 1 -- 172.21.15.84:0/1643795773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563353c27930 con 0x563353bbc350 2024-09-21T07:52:35.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.522+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b9b670 0x563353f64790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:35.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.523+0000 7f8ca5600640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8c900b6850 0x7f8c900b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.523+0000 7f8ca5600640 1 -- 172.21.15.84:0/3503198853 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8c940e6cb0 con 0x7f8ca81027a0 2024-09-21T07:52:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.524+0000 7f8cad400640 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f63d10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0004af0 tx=0x7f8ca0000fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a546dbd10902ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.524+0000 7f8caca00640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8c900b6850 0x7f8c900b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.525+0000 7f8caca00640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8c900b6850 0x7f8c900b8d60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x563353f62990 tx=0x7f8c940069a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.525+0000 7f8c99c00640 1 -- 172.21.15.84:0/1643795773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0009800 con 0x563353bbc350 2024-09-21T07:52:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.526+0000 7f8c99c00640 1 -- 172.21.15.84:0/1643795773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca0036070 con 0x563353bbc350 2024-09-21T07:52:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.526+0000 7f8c99c00640 1 -- 172.21.15.84:0/1643795773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0004040 con 0x563353bbc350 2024-09-21T07:52:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.528+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 msgr2=0x563353f63d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.528+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f63d10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0004af0 tx=0x7f8ca0000fd0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.529+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 shutdown_connections 2024-09-21T07:52:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.529+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b9b670 0x563353f64790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.529+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f64250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.529+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1643795773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f63d10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.529+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 >> 172.21.15.84:0/1643795773 conn(0x563353bb0740 msgr2=0x563353f61c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.529+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 shutdown_connections 2024-09-21T07:52:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.530+0000 7f8cb6028740 1 -- 172.21.15.84:0/1643795773 wait complete. 2024-09-21T07:52:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.531+0000 7f8cb6028740 1 -- start start 2024-09-21T07:52:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.531+0000 7f8cb6028740 1 Processor -- start 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.532+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.532+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b9b670 0x563353f6ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.532+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353bbc350 0x563353f7b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.532+0000 7f8cb6028740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563353d2a890 con 0x563353b9b670 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.532+0000 7f8cb6028740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563353e64160 con 0x563353b93490 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.532+0000 7f8cb6028740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563353f72490 con 0x563353bbc350 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.532+0000 7f8cb6028740 10 client.0 _ll_register_callbacks cb 0x563353e80a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.533+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b9b670 0x563353f6ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.533+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b9b670 0x563353f6ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36806/0 (socket says 172.21.15.84:36806) 2024-09-21T07:52:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.533+0000 7f8ca7e00640 1 -- 172.21.15.84:0/2891412502 learned_addr learned my addr 172.21.15.84:0/2891412502 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.534+0000 7f8cad400640 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.534+0000 7f8ca7e00640 1 -- 172.21.15.84:0/2891412502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353bbc350 msgr2=0x563353f7b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:35.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.534+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353bbc350 0x563353f7b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.534+0000 7f8ca7e00640 1 -- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 msgr2=0x563353f6f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:35.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.534+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.534+0000 7f8ca7e00640 1 -- 172.21.15.84:0/2891412502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563353f8ce30 con 0x563353b9b670 2024-09-21T07:52:35.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.535+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b9b670 0x563353f6ffc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c010670 tx=0x7f8c9c010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a231cae05fbb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.535+0000 7f8c8e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:52:35.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.536+0000 7f8c8e000640 1 -- 172.21.15.84:0/2891412502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00ead0 con 0x563353b9b670 2024-09-21T07:52:35.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.536+0000 7f8c8e000640 1 -- 172.21.15.84:0/2891412502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8c9c00ec70 con 0x563353b9b670 2024-09-21T07:52:35.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.536+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca0036070 con 0x563353b9b670 2024-09-21T07:52:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.537+0000 7f8c8e000640 1 -- 172.21.15.84:0/2891412502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c9c010e70 con 0x563353b9b670 2024-09-21T07:52:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.537+0000 7f8cb6028740 10 client.16152 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.537+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563353f8f730 con 0x563353b9b670 2024-09-21T07:52:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.538+0000 7f8c8e000640 1 -- 172.21.15.84:0/2891412502 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca0036070 con 0x563353b9b670 2024-09-21T07:52:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.539+0000 7f8c8e000640 1 -- 172.21.15.84:0/2891412502 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8c9c00f040 con 0x563353b9b670 2024-09-21T07:52:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.539+0000 7f8cb6028740 10 client.16152 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.539+0000 7f8cb6028740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.540+0000 7f8cb6028740 20 client.16152 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.540+0000 7f8cb6028740 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353b7acd0 0x563353f92ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.540+0000 7f8cb6028740 4 client.16152 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.540+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563353edbde0 con 0x563353b7acd0 2024-09-21T07:52:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.540+0000 7f8cad400640 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353b7acd0 0x563353f92ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.541+0000 7f8cad400640 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353b7acd0 0x563353f92ce0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca31b3cf6164885f server_cookie=a9d4047815956e14 in_seq=0 out_seq=0 2024-09-21T07:52:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.541+0000 7f8c8e000640 10 client.16152 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:35.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.541+0000 7f8c8e000640 1 -- 172.21.15.84:0/2891412502 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563353edbde0 con 0x563353b7acd0 2024-09-21T07:52:35.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.541+0000 7f8c8e000640 10 client.16152 handle_command_reply: tid=0 2024-09-21T07:52:35.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 client.16152 shutdown 2024-09-21T07:52:35.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b9b670 msgr2=0x563353f6ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b9b670 0x563353f6ffc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c010670 tx=0x7f8c9c010b30 comp rx=0 tx=0).stop 2024-09-21T07:52:35.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 shutdown_connections 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353b7acd0 0x563353f92ce0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353bbc350 0x563353f7b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b9b670 0x563353f6ffc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 --2- 172.21.15.84:0/2891412502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 >> 172.21.15.84:0/2891412502 conn(0x563353bb0740 msgr2=0x563353f60280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.542+0000 7f8c8e000640 0 client.16152 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.543+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 shutdown_connections 2024-09-21T07:52:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.543+0000 7f8cb6028740 1 -- 172.21.15.84:0/2891412502 wait complete. 2024-09-21T07:52:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.543+0000 7f8cb6028740 20 client.16152 trim_cache size 0 max 16384 2024-09-21T07:52:35.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:35 smithi162 ceph-mon[34833]: pgmap v438: 129 pgs: 129 active+clean; 4.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 284 MiB/s wr, 88 op/s 2024-09-21T07:52:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.577+0000 7f8cb6028740 1 Processor -- start 2024-09-21T07:52:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.577+0000 7f8cb6028740 1 -- start start 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f6ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f60280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cb6028740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca810b750 con 0x563353bbc350 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cb6028740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca810d290 con 0x563353b93490 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cb6028740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca810be20 con 0x563353b50080 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cad400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cad400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43602/0 (socket says 172.21.15.84:43602) 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cad400640 1 -- 172.21.15.84:0/1420016083 learned_addr learned my addr 172.21.15.84:0/1420016083 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.578+0000 7f8cad400640 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f60280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.579+0000 7f8cad400640 1 -- 172.21.15.84:0/1420016083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 msgr2=0x563353f60280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.579+0000 7f8cad400640 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f60280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.579+0000 7f8cad400640 1 -- 172.21.15.84:0/1420016083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 msgr2=0x563353f6ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.579+0000 7f8cad400640 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f6ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.579+0000 7f8cad400640 1 -- 172.21.15.84:0/1420016083 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563353f70aa0 con 0x563353b93490 2024-09-21T07:52:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.580+0000 7f8cad400640 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009ca0 tx=0x7f8ca0003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b09f789ca8e3dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.580+0000 7f8c99200640 1 -- 172.21.15.84:0/1420016083 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0049040 con 0x563353b93490 2024-09-21T07:52:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.580+0000 7f8c99200640 1 -- 172.21.15.84:0/1420016083 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca0036070 con 0x563353b93490 2024-09-21T07:52:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.580+0000 7f8c99200640 1 -- 172.21.15.84:0/1420016083 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0004120 con 0x563353b93490 2024-09-21T07:52:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.581+0000 7f8cb6028740 1 -- 172.21.15.84:0/1420016083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 msgr2=0x563353f6f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.581+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009ca0 tx=0x7f8ca0003970 comp rx=0 tx=0).stop 2024-09-21T07:52:35.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.582+0000 7f8cb6028740 1 -- 172.21.15.84:0/1420016083 shutdown_connections 2024-09-21T07:52:35.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.582+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f60280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.582+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353bbc350 0x563353f6ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.582+0000 7f8cb6028740 1 --2- 172.21.15.84:0/1420016083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353b93490 0x563353f6f9e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.582+0000 7f8cb6028740 1 -- 172.21.15.84:0/1420016083 >> 172.21.15.84:0/1420016083 conn(0x563353bb0740 msgr2=0x563353f6e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:35.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.584+0000 7f8cb6028740 1 -- 172.21.15.84:0/1420016083 shutdown_connections 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.584+0000 7f8cb6028740 1 -- 172.21.15.84:0/1420016083 wait complete. 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.585+0000 7f8cb6028740 1 -- start start 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.586+0000 7f8cb6028740 1 Processor -- start 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.587+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f77e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.587+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b93490 0x563353f6c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.587+0000 7f8cb6028740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353bbc350 0x563353f6cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.588+0000 7f8cb6028740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca810cbc0 con 0x563353b93490 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.588+0000 7f8cb6028740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca810c4f0 con 0x563353bbc350 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.588+0000 7f8cb6028740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81a1a60 con 0x563353b50080 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.588+0000 7f8cad400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f77e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.588+0000 7f8cad400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f77e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55388/0 (socket says 172.21.15.84:55388) 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.588+0000 7f8cad400640 1 -- 172.21.15.84:0/727716797 learned_addr learned my addr 172.21.15.84:0/727716797 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.588+0000 7f8cb6028740 10 client.0 _ll_register_callbacks cb 0x7f8c9c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.589+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b93490 0x563353f6c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.590+0000 7f8ca7e00640 1 -- 172.21.15.84:0/727716797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 msgr2=0x563353f77e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:35.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.590+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f77e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.590+0000 7f8ca7e00640 1 -- 172.21.15.84:0/727716797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353bbc350 msgr2=0x563353f6cb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:52:35.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.590+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353bbc350 0x563353f6cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.590+0000 7f8ca7e00640 1 -- 172.21.15.84:0/727716797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563353f6d190 con 0x563353b93490 2024-09-21T07:52:35.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.591+0000 7f8c8e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:52:35.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.591+0000 7f8ca7e00640 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b93490 0x563353f6c5e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x563353f6df70 tx=0x7f8c9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3c1bed77ab49c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:35.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.595+0000 7f8c8e000640 1 -- 172.21.15.84:0/727716797 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c005ab0 con 0x563353b93490 2024-09-21T07:52:35.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.595+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca0036070 con 0x563353b93490 2024-09-21T07:52:35.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.595+0000 7f8c8e000640 1 -- 172.21.15.84:0/727716797 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8c9c031020 con 0x563353b93490 2024-09-21T07:52:35.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.596+0000 7f8c8e000640 1 -- 172.21.15.84:0/727716797 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c9c005ab0 con 0x563353b93490 2024-09-21T07:52:35.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.601+0000 7f8cb6028740 10 client.16155 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:35.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.601+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563353ffd6e0 con 0x563353b93490 2024-09-21T07:52:35.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.603+0000 7f8c8e000640 1 -- 172.21.15.84:0/727716797 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca0036070 con 0x563353b93490 2024-09-21T07:52:35.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.603+0000 7f8c8e000640 1 -- 172.21.15.84:0/727716797 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8c9c00e9c0 con 0x563353b93490 2024-09-21T07:52:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.605+0000 7f8cb6028740 10 client.16155 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.605+0000 7f8cb6028740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.605+0000 7f8cb6028740 20 client.16155 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.605+0000 7f8cb6028740 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353ffdce0 0x563354000100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.605+0000 7f8cb6028740 4 client.16155 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:52:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.605+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563353ed7890 con 0x563353ffdce0 2024-09-21T07:52:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.606+0000 7f8cad400640 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353ffdce0 0x563354000100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.606+0000 7f8cad400640 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353ffdce0 0x563354000100 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b30367a67d1c2a2 server_cookie=b31583f846c31438 in_seq=0 out_seq=0 2024-09-21T07:52:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.606+0000 7f8c8e000640 10 client.16155 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.608+0000 7f8c8e000640 1 -- 172.21.15.84:0/727716797 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563353ed7890 con 0x563353ffdce0 2024-09-21T07:52:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.608+0000 7f8c8e000640 10 client.16155 handle_command_reply: tid=0 2024-09-21T07:52:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.608+0000 7f8cb6028740 1 client.16155 shutdown 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b93490 msgr2=0x563353f6c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b93490 0x563353f6c5e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x563353f6df70 tx=0x7f8c9c017000 comp rx=0 tx=0).stop 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 shutdown_connections 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563353bbc350 0x563353f6cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563353b93490 0x563353f6c5e0 secure :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0x563353f6df70 tx=0x7f8c9c017000 comp rx=0 tx=0).stop 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563353ffdce0 0x563354000100 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8c8e000640 0 client.16155 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 --2- 172.21.15.84:0/727716797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563353b50080 0x563353f77e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.609+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 >> 172.21.15.84:0/727716797 conn(0x563353bb0740 msgr2=0x563353f60280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.610+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 shutdown_connections 2024-09-21T07:52:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.610+0000 7f8cb6028740 1 -- 172.21.15.84:0/727716797 wait complete. 2024-09-21T07:52:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.610+0000 7f8cb6028740 20 client.16155 trim_cache size 0 max 16384 2024-09-21T07:52:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:52:35.613 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:52:35.613 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "03a9382c-3904-4e30-a4ef-a0d11c4650bc", 2024-09-21T07:52:35.613 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:52:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8c900b6850 msgr2=0x7f8c900b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8c900b6850 0x7f8c900b8d60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x563353f62990 tx=0x7f8c940069a0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81027a0 msgr2=0x7f8ca81a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81027a0 0x7f8ca81a0930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400b4a0 tx=0x7f8c9400b960 comp rx=0 tx=0).stop 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 shutdown_connections 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8c900b6850 0x7f8c900b8d60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca8107be0 0x7f8ca81a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca81030f0 0x7f8ca81a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 --2- 172.21.15.84:0/3503198853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ca81027a0 0x7f8ca81a0930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.612+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 >> 172.21.15.84:0/3503198853 conn(0x7f8ca8079730 msgr2=0x7f8ca81055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.613+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 shutdown_connections 2024-09-21T07:52:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:35.613+0000 7f8caf400640 1 -- 172.21.15.84:0/3503198853 wait complete. 2024-09-21T07:52:35.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:35 smithi191 ceph-mon[34667]: pgmap v438: 129 pgs: 129 active+clean; 4.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 284 MiB/s wr, 88 op/s 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.367+0000 7febcaa00640 1 -- 172.21.15.84:0/4260471649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4077380 msgr2=0x7febc40757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.367+0000 7febcaa00640 1 --2- 172.21.15.84:0/4260471649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4077380 0x7febc40757b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7febb8009900 tx=0x7febb802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.367+0000 7febcaa00640 1 -- 172.21.15.84:0/4260471649 shutdown_connections 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.367+0000 7febcaa00640 1 --2- 172.21.15.84:0/4260471649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4114280 0x7febc4116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.367+0000 7febcaa00640 1 --2- 172.21.15.84:0/4260471649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4075dd0 0x7febc40761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.367+0000 7febcaa00640 1 --2- 172.21.15.84:0/4260471649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4077380 0x7febc40757b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.367+0000 7febcaa00640 1 -- 172.21.15.84:0/4260471649 >> 172.21.15.84:0/4260471649 conn(0x7febc40ff440 msgr2=0x7febc4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.368+0000 7febcaa00640 1 -- 172.21.15.84:0/4260471649 shutdown_connections 2024-09-21T07:52:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.368+0000 7febcaa00640 1 -- 172.21.15.84:0/4260471649 wait complete. 2024-09-21T07:52:36.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 Processor -- start 2024-09-21T07:52:36.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 -- start start 2024-09-21T07:52:36.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4075dd0 0x7febc41a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4077380 0x7febc41a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4114280 0x7febc41a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febc4119ec0 con 0x7febc4114280 2024-09-21T07:52:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febc4119d40 con 0x7febc4077380 2024-09-21T07:52:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.369+0000 7febcaa00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7febc411a040 con 0x7febc4075dd0 2024-09-21T07:52:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4075dd0 0x7febc41a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4075dd0 0x7febc41a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55400/0 (socket says 172.21.15.84:55400) 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4077380 0x7febc41a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 -- 172.21.15.84:0/1623953466 learned_addr learned my addr 172.21.15.84:0/1623953466 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febca000640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4114280 0x7febc41a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 -- 172.21.15.84:0/1623953466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4077380 msgr2=0x7febc41a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4077380 0x7febc41a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 -- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4114280 msgr2=0x7febc41a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4114280 0x7febc41a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 -- 172.21.15.84:0/1623953466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc41a6820 con 0x7febc4075dd0 2024-09-21T07:52:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.370+0000 7febc9600640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4075dd0 0x7febc41a08b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7febb8005940 tx=0x7febb80040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.371+0000 7febc2000640 1 -- 172.21.15.84:0/1623953466 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb803f030 con 0x7febc4075dd0 2024-09-21T07:52:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.371+0000 7febc2000640 1 -- 172.21.15.84:0/1623953466 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb80044c0 con 0x7febc4075dd0 2024-09-21T07:52:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.371+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc41a6ab0 con 0x7febc4075dd0 2024-09-21T07:52:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.371+0000 7febc2000640 1 -- 172.21.15.84:0/1623953466 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8035070 con 0x7febc4075dd0 2024-09-21T07:52:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.371+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc41ad270 con 0x7febc4075dd0 2024-09-21T07:52:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.374+0000 7febc2000640 1 -- 172.21.15.84:0/1623953466 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7febb8042030 con 0x7febc4075dd0 2024-09-21T07:52:36.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.376+0000 7febd2c72740 1 Processor -- start 2024-09-21T07:52:36.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.376+0000 7febd2c72740 1 -- start start 2024-09-21T07:52:36.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.376+0000 7febc2000640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7febac0b6700 0x7febac0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.376+0000 7febc2000640 1 -- 172.21.15.84:0/1623953466 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7febb8107d50 con 0x7febc4075dd0 2024-09-21T07:52:36.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.376+0000 7febca000640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7febac0b6700 0x7febac0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.376+0000 7febd2c72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b37520 0x55b7d3ede340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.376+0000 7febd2c72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b0e660 0x55b7d3ede880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febd2c72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3ededc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febd2c72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b7d3e55290 con 0x55b7d3b0e660 2024-09-21T07:52:36.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febd2c72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b7d3e446c0 con 0x55b7d3b37520 2024-09-21T07:52:36.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febd2c72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b7d3e484d0 con 0x55b7d3b16840 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b37520 0x55b7d3ede340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febca000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3ededc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b37520 0x55b7d3ede340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43644/0 (socket says 172.21.15.84:43644) 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 -- 172.21.15.84:0/2982907924 learned_addr learned my addr 172.21.15.84:0/2982907924 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 -- 172.21.15.84:0/2982907924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 msgr2=0x55b7d3ededc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3ededc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 -- 172.21.15.84:0/2982907924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b0e660 msgr2=0x55b7d3ede880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc8c00640 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b0e660 0x55b7d3ede880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b0e660 0x55b7d3ede880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc9600640 1 -- 172.21.15.84:0/2982907924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7d3dd1460 con 0x55b7d3b37520 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.377+0000 7febc8c00640 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b0e660 0x55b7d3ede880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.378+0000 7febca000640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7febac0b6700 0x7febac0b8c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febbc005fd0 tx=0x7febbc011bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.378+0000 7febc9600640 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b37520 0x55b7d3ede340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7febb8032af0 tx=0x7febb80cd2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651bbab96a92546e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.378+0000 7febb6600640 1 -- 172.21.15.84:0/2982907924 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8049040 con 0x55b7d3b37520 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.378+0000 7febb6600640 1 -- 172.21.15.84:0/2982907924 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb80d7250 con 0x55b7d3b37520 2024-09-21T07:52:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.378+0000 7febb6600640 1 -- 172.21.15.84:0/2982907924 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb80cc810 con 0x55b7d3b37520 2024-09-21T07:52:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 -- 172.21.15.84:0/2982907924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b37520 msgr2=0x55b7d3ede340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b37520 0x55b7d3ede340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7febb8032af0 tx=0x7febb80cd2f0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 -- 172.21.15.84:0/2982907924 shutdown_connections 2024-09-21T07:52:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3ededc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b0e660 0x55b7d3ede880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 --2- 172.21.15.84:0/2982907924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b37520 0x55b7d3ede340 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 -- 172.21.15.84:0/2982907924 >> 172.21.15.84:0/2982907924 conn(0x55b7d3b2b910 msgr2=0x55b7d3edc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 -- 172.21.15.84:0/2982907924 shutdown_connections 2024-09-21T07:52:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.379+0000 7febd2c72740 1 -- 172.21.15.84:0/2982907924 wait complete. 2024-09-21T07:52:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.380+0000 7febd2c72740 1 -- start start 2024-09-21T07:52:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.380+0000 7febd2c72740 1 Processor -- start 2024-09-21T07:52:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febd2c72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ee9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febd2c72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3eea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febd2c72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3ef5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febd2c72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b7d3ca5bb0 con 0x55b7d3b37520 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febd2c72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b7d3ddf6c0 con 0x55b7d3b0e660 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febd2c72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b7d3e446c0 con 0x55b7d3b16840 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febd2c72740 10 client.0 _ll_register_callbacks cb 0x55b7d3dfa490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.381+0000 7febc8c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3eea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3eea4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55420/0 (socket says 172.21.15.84:55420) 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 -- 172.21.15.84:0/3277161229 learned_addr learned my addr 172.21.15.84:0/3277161229 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc9600640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ee9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febca000640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3ef5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 -- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 msgr2=0x55b7d3ee9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ee9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 -- 172.21.15.84:0/3277161229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 msgr2=0x55b7d3ef5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3ef5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 -- 172.21.15.84:0/3277161229 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7d3ba2b00 con 0x55b7d3b16840 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc9600640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ee9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febca000640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3ef5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febc8c00640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3eea4b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7febb00136e0 tx=0x7febb0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f4142a8adfa8409 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.382+0000 7febaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febaaa00640 1 -- 172.21.15.84:0/3277161229 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0004440 con 0x55b7d3b16840 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febaaa00640 1 -- 172.21.15.84:0/3277161229 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7febb00119c0 con 0x55b7d3b16840 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febb80d7250 con 0x55b7d3b16840 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febaaa00640 1 -- 172.21.15.84:0/3277161229 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7febb0011bc0 con 0x55b7d3b16840 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febd2c72740 10 client.26152 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7d3c19960 con 0x55b7d3b16840 2024-09-21T07:52:36.386 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:36 smithi084 ceph-mon[30411]: pgmap v439: 129 pgs: 129 active+clean; 4.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 295 MiB/s wr, 92 op/s 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febaaa00640 1 -- 172.21.15.84:0/3277161229 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb80d7250 con 0x55b7d3b16840 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febaaa00640 1 -- 172.21.15.84:0/3277161229 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7febb001a070 con 0x55b7d3b16840 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febd2c72740 10 client.26152 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.383+0000 7febd2c72740 10 client.26152 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.384+0000 7febd2c72740 20 client.26152 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.384+0000 7febd2c72740 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3af5ea0 0x55b7d3efba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.384+0000 7febd2c72740 4 client.26152 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.384+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7d3e571e0 con 0x55b7d3af5ea0 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.384+0000 7febc9600640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3af5ea0 0x55b7d3efba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.384+0000 7febaaa00640 10 client.26152 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.384+0000 7febc9600640 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3af5ea0 0x55b7d3efba30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d336086c33f15e01 server_cookie=d2bb2497add582f0 in_seq=0 out_seq=0 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.385+0000 7febaaa00640 1 -- 172.21.15.84:0/3277161229 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7d3e571e0 con 0x55b7d3af5ea0 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.385+0000 7febaaa00640 10 client.26152 handle_command_reply: tid=0 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.385+0000 7febd2c72740 1 client.26152 shutdown 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 msgr2=0x55b7d3eea4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3eea4b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7febb00136e0 tx=0x7febb0009f90 comp rx=0 tx=0).stop 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 shutdown_connections 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3ef5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3af5ea0 0x55b7d3efba30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b16840 0x55b7d3eea4b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 --2- 172.21.15.84:0/3277161229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ee9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febaaa00640 0 client.26152 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 >> 172.21.15.84:0/3277161229 conn(0x55b7d3b2b910 msgr2=0x55b7d3ee1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 shutdown_connections 2024-09-21T07:52:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 1 -- 172.21.15.84:0/3277161229 wait complete. 2024-09-21T07:52:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.386+0000 7febd2c72740 20 client.26152 trim_cache size 0 max 16384 2024-09-21T07:52:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.421+0000 7febd2c72740 1 Processor -- start 2024-09-21T07:52:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.421+0000 7febd2c72740 1 -- start start 2024-09-21T07:52:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febd2c72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febd2c72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b16840 0x55b7d3ef5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febd2c72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b37520 0x55b7d3ee3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febd2c72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febc41b7100 con 0x55b7d3b16840 2024-09-21T07:52:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febd2c72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febc41b8c40 con 0x55b7d3b0e660 2024-09-21T07:52:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febd2c72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7febc41b77d0 con 0x55b7d3b37520 2024-09-21T07:52:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b16840 0x55b7d3ef5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43668/0 (socket says 172.21.15.84:43668) 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc9600640 1 -- 172.21.15.84:0/502362820 learned_addr learned my addr 172.21.15.84:0/502362820 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febca000640 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b37520 0x55b7d3ee3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc8c00640 1 -- 172.21.15.84:0/502362820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b37520 msgr2=0x55b7d3ee3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc8c00640 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b37520 0x55b7d3ee3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc8c00640 1 -- 172.21.15.84:0/502362820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 msgr2=0x55b7d3ef5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc8c00640 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc8c00640 1 -- 172.21.15.84:0/502362820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7d3ef63d0 con 0x55b7d3b16840 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.422+0000 7febc9600640 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.423+0000 7febc8c00640 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b16840 0x55b7d3ef5e90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7febb001c860 tx=0x7febb001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71b272252e2c07c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.423+0000 7febb5c00640 1 -- 172.21.15.84:0/502362820 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb002e020 con 0x55b7d3b16840 2024-09-21T07:52:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.423+0000 7febb5c00640 1 -- 172.21.15.84:0/502362820 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb001c8e0 con 0x55b7d3b16840 2024-09-21T07:52:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.423+0000 7febb5c00640 1 -- 172.21.15.84:0/502362820 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0003d10 con 0x55b7d3b16840 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 -- 172.21.15.84:0/502362820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b16840 msgr2=0x55b7d3ef5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b16840 0x55b7d3ef5e90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7febb001c860 tx=0x7febb001c440 comp rx=0 tx=0).stop 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 -- 172.21.15.84:0/502362820 shutdown_connections 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b37520 0x55b7d3ee3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b16840 0x55b7d3ef5e90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 --2- 172.21.15.84:0/502362820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 -- 172.21.15.84:0/502362820 >> 172.21.15.84:0/502362820 conn(0x55b7d3b2b910 msgr2=0x55b7d3ee1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 -- 172.21.15.84:0/502362820 shutdown_connections 2024-09-21T07:52:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 -- 172.21.15.84:0/502362820 wait complete. 2024-09-21T07:52:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.425+0000 7febd2c72740 1 -- start start 2024-09-21T07:52:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.426+0000 7febd2c72740 1 Processor -- start 2024-09-21T07:52:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.426+0000 7febd2c72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febd2c72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b16840 0x55b7d3ef1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febd2c72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3eec970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febd2c72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febc41b8570 con 0x55b7d3b37520 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febd2c72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febc41b7ea0 con 0x55b7d3b16840 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febd2c72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7febc41b50c0 con 0x55b7d3b0e660 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55444/0 (socket says 172.21.15.84:55444) 2024-09-21T07:52:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 -- 172.21.15.84:0/3574395447 learned_addr learned my addr 172.21.15.84:0/3574395447 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febd2c72740 10 client.0 _ll_register_callbacks cb 0x7febb00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febca000640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3eec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc8c00640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b16840 0x55b7d3ef1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 -- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b16840 msgr2=0x55b7d3ef1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b16840 0x55b7d3ef1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 -- 172.21.15.84:0/3574395447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 msgr2=0x55b7d3eec970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3eec970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.427+0000 7febc9600640 1 -- 172.21.15.84:0/3574395447 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7d3ef26f0 con 0x55b7d3b0e660 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.428+0000 7febc8c00640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b16840 0x55b7d3ef1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.428+0000 7febc9600640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef19c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febb80cd870 tx=0x7febb80cd360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41595fb21fcf0915 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.428+0000 7febaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.428+0000 7febaaa00640 1 -- 172.21.15.84:0/3574395447 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8049040 con 0x55b7d3b0e660 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.428+0000 7febaaa00640 1 -- 172.21.15.84:0/3574395447 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7febb80ceb60 con 0x55b7d3b0e660 2024-09-21T07:52:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.428+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febb001c8e0 con 0x55b7d3b0e660 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.428+0000 7febaaa00640 1 -- 172.21.15.84:0/3574395447 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7febb80d7250 con 0x55b7d3b0e660 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 10 client.26158 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7d3f66a70 con 0x55b7d3b0e660 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febaaa00640 1 -- 172.21.15.84:0/3574395447 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb001c8e0 con 0x55b7d3b0e660 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febaaa00640 1 -- 172.21.15.84:0/3574395447 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7febb80cc6d0 con 0x55b7d3b0e660 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 10 client.26158 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 10 client.26158 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 20 client.26158 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3acb250 0x55b7d3f68f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 4 client.26158 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a18219b2", "release": true, "await": true}] 2024-09-21T07:52:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.429+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a18219b2", "release": true, "await": true}) -- 0x55b7d3e52c90 con 0x55b7d3acb250 2024-09-21T07:52:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.430+0000 7febc8c00640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3acb250 0x55b7d3f68f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.432+0000 7febc8c00640 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3acb250 0x55b7d3f68f20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b32ab13ea315f64 server_cookie=18556e3d401bb0e4 in_seq=0 out_seq=0 2024-09-21T07:52:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.432+0000 7febaaa00640 10 client.26158 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febaaa00640 1 -- 172.21.15.84:0/3574395447 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b7d3e52c90 con 0x55b7d3acb250 2024-09-21T07:52:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febaaa00640 10 client.26158 handle_command_reply: tid=0 2024-09-21T07:52:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 client.26158 shutdown 2024-09-21T07:52:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b0e660 msgr2=0x55b7d3ef19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef19c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febb80cd870 tx=0x7febb80cd360 comp rx=0 tx=0).stop 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 shutdown_connections 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7d3b37520 0x55b7d3eec970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7d3b16840 0x55b7d3ef1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7d3acb250 0x55b7d3f68f20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 --2- 172.21.15.84:0/3574395447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7d3b0e660 0x55b7d3ef19c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 >> 172.21.15.84:0/3574395447 conn(0x55b7d3b2b910 msgr2=0x55b7d3ee1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.447+0000 7febaaa00640 0 client.26158 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.448+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 shutdown_connections 2024-09-21T07:52:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.448+0000 7febd2c72740 1 -- 172.21.15.84:0/3574395447 wait complete. 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.448+0000 7febd2c72740 20 client.26158 trim_cache size 0 max 16384 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 8, 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "a18219b2": { 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 8, 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:52:36.451 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 137.0, 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:36.452 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:36.453 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:36.453 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:52:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7febac0b6700 msgr2=0x7febac0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7febac0b6700 0x7febac0b8c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febbc005fd0 tx=0x7febbc011bc0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4075dd0 msgr2=0x7febc41a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4075dd0 0x7febc41a08b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7febb8005940 tx=0x7febb80040c0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 shutdown_connections 2024-09-21T07:52:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7febac0b6700 0x7febac0b8c10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febc4114280 0x7febc41a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4077380 0x7febc41a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 --2- 172.21.15.84:0/1623953466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febc4075dd0 0x7febc41a08b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 >> 172.21.15.84:0/1623953466 conn(0x7febc40ff440 msgr2=0x7febc4110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 shutdown_connections 2024-09-21T07:52:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:36.449+0000 7febcaa00640 1 -- 172.21.15.84:0/1623953466 wait complete. 2024-09-21T07:52:36.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:36 smithi162 ceph-mon[34833]: pgmap v439: 129 pgs: 129 active+clean; 4.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 295 MiB/s wr, 92 op/s 2024-09-21T07:52:36.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:36 smithi191 ceph-mon[34667]: pgmap v439: 129 pgs: 129 active+clean; 4.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 295 MiB/s wr, 92 op/s 2024-09-21T07:52:37.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:37 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:52:37.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:37 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:52:37.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:37 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:52:37.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:37 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:52:37.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:37 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:52:37.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:37 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:52:37.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:37 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:52:37.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:37 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:52:37.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:37 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:52:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:37 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:52:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:37 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:52:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:37 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:52:37.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:52:38.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:38 smithi084 ceph-mon[30411]: pgmap v440: 129 pgs: 129 active+clean; 4.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 265 MiB/s wr, 81 op/s 2024-09-21T07:52:38.443 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a18219b2', total seconds elapsed: 24.9 2024-09-21T07:52:38.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:38 smithi162 ceph-mon[34833]: pgmap v440: 129 pgs: 129 active+clean; 4.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 265 MiB/s wr, 81 op/s 2024-09-21T07:52:38.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:38 smithi191 ceph-mon[34667]: pgmap v440: 129 pgs: 129 active+clean; 4.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 265 MiB/s wr, 81 op/s 2024-09-21T07:52:38.665 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:39.346 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:39 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:52:39.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:39 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:52:39.555 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:39 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:52:39.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.621+0000 7f810ea00640 1 -- 172.21.15.84:0/1901072703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 msgr2=0x7f810810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.621+0000 7f810ea00640 1 --2- 172.21.15.84:0/1901072703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 0x7f810810a7d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8100009ca0 tx=0x7f810002a8f0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.622+0000 7f810ea00640 1 -- 172.21.15.84:0/1901072703 shutdown_connections 2024-09-21T07:52:39.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.622+0000 7f810ea00640 1 --2- 172.21.15.84:0/1901072703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8108118900 0x7f810811ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.622+0000 7f810ea00640 1 --2- 172.21.15.84:0/1901072703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f810810ad10 0x7f81081183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.622+0000 7f810ea00640 1 --2- 172.21.15.84:0/1901072703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 0x7f810810a7d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.622+0000 7f810ea00640 1 -- 172.21.15.84:0/1901072703 >> 172.21.15.84:0/1901072703 conn(0x7f8108070ec0 msgr2=0x7f81080712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:39.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.623+0000 7f810ea00640 1 -- 172.21.15.84:0/1901072703 shutdown_connections 2024-09-21T07:52:39.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.623+0000 7f810ea00640 1 -- 172.21.15.84:0/1901072703 wait complete. 2024-09-21T07:52:39.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.625+0000 7f810ea00640 1 Processor -- start 2024-09-21T07:52:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.625+0000 7f810ea00640 1 -- start start 2024-09-21T07:52:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.625+0000 7f810ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 0x7f8108111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.625+0000 7f810ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f810810ad10 0x7f810810e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.626+0000 7f810ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8108118900 0x7f810810e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.626+0000 7f810ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f810811e600 con 0x7f810810a3c0 2024-09-21T07:52:39.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.626+0000 7f810ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f810811e480 con 0x7f810810ad10 2024-09-21T07:52:39.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.626+0000 7f810ea00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f810811e780 con 0x7f8108118900 2024-09-21T07:52:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.629+0000 7f8107400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f810810ad10 0x7f810810e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.630+0000 7f8107400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f810810ad10 0x7f810810e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41050/0 (socket says 172.21.15.84:41050) 2024-09-21T07:52:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.630+0000 7f8107400640 1 -- 172.21.15.84:0/1933576761 learned_addr learned my addr 172.21.15.84:0/1933576761 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.631+0000 7f8107e00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 0x7f8108111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.633+0000 7f810ca00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8108118900 0x7f810810e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.634+0000 7f810ca00640 1 -- 172.21.15.84:0/1933576761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f810810ad10 msgr2=0x7f810810e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.634+0000 7f810ca00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f810810ad10 0x7f810810e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.634+0000 7f810ca00640 1 -- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 msgr2=0x7f8108111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.634+0000 7f810ca00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 0x7f8108111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.634+0000 7f810ca00640 1 -- 172.21.15.84:0/1933576761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81081a4dc0 con 0x7f8108118900 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.634+0000 7f810ca00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8108118900 0x7f810810e7b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f810810b3a0 tx=0x7f80f400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.635+0000 7f8104c00640 1 -- 172.21.15.84:0/1933576761 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4015020 con 0x7f8108118900 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.635+0000 7f8104c00640 1 -- 172.21.15.84:0/1933576761 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f4011ce0 con 0x7f8108118900 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.635+0000 7f8104c00640 1 -- 172.21.15.84:0/1933576761 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4010e00 con 0x7f8108118900 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.639+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81081a50b0 con 0x7f8108118900 2024-09-21T07:52:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.639+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81081a5620 con 0x7f8108118900 2024-09-21T07:52:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.653+0000 7f81155e9740 1 Processor -- start 2024-09-21T07:52:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.654+0000 7f8104c00640 1 -- 172.21.15.84:0/1933576761 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f80f4018020 con 0x7f8108118900 2024-09-21T07:52:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.655+0000 7f81155e9740 1 -- start start 2024-09-21T07:52:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.655+0000 7f81155e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c707070 0x56321caadb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.655+0000 7f81155e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6de1b0 0x56321caae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.656+0000 7f81155e9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6e6390 0x56321caae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.656+0000 7f81155e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56321ca24f70 con 0x56321c707070 2024-09-21T07:52:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.656+0000 7f81155e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56321ca143a0 con 0x56321c6de1b0 2024-09-21T07:52:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.656+0000 7f81155e9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56321ca181b0 con 0x56321c6e6390 2024-09-21T07:52:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.656+0000 7f8107e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6de1b0 0x56321caae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.656+0000 7f8107e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6de1b0 0x56321caae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41056/0 (socket says 172.21.15.84:41056) 2024-09-21T07:52:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.656+0000 7f8107e00640 1 -- 172.21.15.84:0/283128650 learned_addr learned my addr 172.21.15.84:0/283128650 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.660+0000 7f8107400640 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6e6390 0x56321caae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.661+0000 7f8107400640 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c707070 0x56321caadb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.662+0000 7f8107400640 1 -- 172.21.15.84:0/283128650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6e6390 msgr2=0x56321caae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.662+0000 7f8107400640 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6e6390 0x56321caae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.662+0000 7f8107400640 1 -- 172.21.15.84:0/283128650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6de1b0 msgr2=0x56321caae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.663+0000 7f8107400640 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6de1b0 0x56321caae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.663+0000 7f8107400640 1 -- 172.21.15.84:0/283128650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321c9dec90 con 0x56321c707070 2024-09-21T07:52:39.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.664+0000 7f8104c00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80ec0b67b0 0x7f80ec0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.665+0000 7f8104c00640 1 -- 172.21.15.84:0/1933576761 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f80f40e7060 con 0x7f8108118900 2024-09-21T07:52:39.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.665+0000 7f8107e00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80ec0b67b0 0x7f80ec0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.665+0000 7f8107400640 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c707070 0x56321caadb60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f80f8006a90 tx=0x7f80f8006a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ee8c5f5ecd3f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:39.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.665+0000 7f80fd200640 1 -- 172.21.15.84:0/283128650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8019070 con 0x56321c707070 2024-09-21T07:52:39.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.665+0000 7f80fd200640 1 -- 172.21.15.84:0/283128650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f8011e40 con 0x56321c707070 2024-09-21T07:52:39.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.665+0000 7f80fd200640 1 -- 172.21.15.84:0/283128650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f80136d0 con 0x56321c707070 2024-09-21T07:52:39.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.668+0000 7f8107e00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80ec0b67b0 0x7f80ec0b8cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56321caac7e0 tx=0x7f810002adf0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:39.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.668+0000 7f81155e9740 1 -- 172.21.15.84:0/283128650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c707070 msgr2=0x56321caadb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.668+0000 7f81155e9740 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c707070 0x56321caadb60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f80f8006a90 tx=0x7f80f8006a20 comp rx=0 tx=0).stop 2024-09-21T07:52:39.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.668+0000 7f81155e9740 1 -- 172.21.15.84:0/283128650 shutdown_connections 2024-09-21T07:52:39.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.668+0000 7f81155e9740 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6e6390 0x56321caae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.668+0000 7f81155e9740 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6de1b0 0x56321caae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.669+0000 7f81155e9740 1 --2- 172.21.15.84:0/283128650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c707070 0x56321caadb60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.669+0000 7f81155e9740 1 -- 172.21.15.84:0/283128650 >> 172.21.15.84:0/283128650 conn(0x56321c6fb460 msgr2=0x56321caaba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:39.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.669+0000 7f81155e9740 1 -- 172.21.15.84:0/283128650 shutdown_connections 2024-09-21T07:52:39.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.669+0000 7f81155e9740 1 -- 172.21.15.84:0/283128650 wait complete. 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.670+0000 7f81155e9740 1 -- start start 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.670+0000 7f81155e9740 1 Processor -- start 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.671+0000 7f81155e9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6de1b0 0x56321cab98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.671+0000 7f81155e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6e6390 0x56321cab9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.671+0000 7f81155e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c707070 0x56321cabf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.671+0000 7f81155e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56321c875700 con 0x56321c6e6390 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.671+0000 7f81155e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56321c9af540 con 0x56321c707070 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.671+0000 7f81155e9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56321cabc340 con 0x56321c6de1b0 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.671+0000 7f81155e9740 10 client.0 _ll_register_callbacks cb 0x56321c9bf430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.672+0000 7f8107e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6de1b0 0x56321cab98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.672+0000 7f8107e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6de1b0 0x56321cab98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50396/0 (socket says 172.21.15.84:50396) 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.672+0000 7f8107e00640 1 -- 172.21.15.84:0/3305146617 learned_addr learned my addr 172.21.15.84:0/3305146617 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.672+0000 7f810ca00640 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c707070 0x56321cabf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.673+0000 7f8107e00640 1 -- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c707070 msgr2=0x56321cabf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.673+0000 7f8107e00640 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c707070 0x56321cabf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.673+0000 7f8107e00640 1 -- 172.21.15.84:0/3305146617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6e6390 msgr2=0x56321cab9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.673+0000 7f8107e00640 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6e6390 0x56321cab9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.673+0000 7f8107e00640 1 -- 172.21.15.84:0/3305146617 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321c772650 con 0x56321c6de1b0 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.674+0000 7f8107e00640 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6de1b0 0x56321cab98a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f810002aee0 tx=0x7f810002a8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481a45b1494308b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.674+0000 7f80f1600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.675+0000 7f80f1600640 1 -- 172.21.15.84:0/3305146617 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100004040 con 0x56321c6de1b0 2024-09-21T07:52:39.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.675+0000 7f80f1600640 1 -- 172.21.15.84:0/3305146617 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f81000041e0 con 0x56321c6de1b0 2024-09-21T07:52:39.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.675+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56321c9b1b50 con 0x56321c6de1b0 2024-09-21T07:52:39.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.676+0000 7f80f1600640 1 -- 172.21.15.84:0/3305146617 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f81000043e0 con 0x56321c6de1b0 2024-09-21T07:52:39.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.676+0000 7f81155e9740 10 client.26164 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:39.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.676+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56321c9cc910 con 0x56321c6de1b0 2024-09-21T07:52:39.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.676+0000 7f80f1600640 1 -- 172.21.15.84:0/3305146617 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8100036040 con 0x56321c6de1b0 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.677+0000 7f80f1600640 1 -- 172.21.15.84:0/3305146617 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f810005e020 con 0x56321c6de1b0 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.678+0000 7f81155e9740 10 client.26164 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.678+0000 7f81155e9740 10 client.26164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.678+0000 7f81155e9740 20 client.26164 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.678+0000 7f81155e9740 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321c6c59f0 0x56321cacb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.678+0000 7f81155e9740 4 client.26164 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.678+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56321c9b1b50 con 0x56321c6c59f0 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.678+0000 7f8107400640 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321c6c59f0 0x56321cacb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.679+0000 7f8107400640 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321c6c59f0 0x56321cacb820 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9ce3eafffb59ec7 server_cookie=67311838f397dd92 in_seq=0 out_seq=0 2024-09-21T07:52:39.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.679+0000 7f80f1600640 10 client.26164 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:39.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.680+0000 7f80f1600640 1 -- 172.21.15.84:0/3305146617 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56321c9b1b50 con 0x56321c6c59f0 2024-09-21T07:52:39.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.680+0000 7f80f1600640 10 client.26164 handle_command_reply: tid=0 2024-09-21T07:52:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.684+0000 7f81155e9740 1 client.26164 shutdown 2024-09-21T07:52:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.684+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6de1b0 msgr2=0x56321cab98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.684+0000 7f81155e9740 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6de1b0 0x56321cab98a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f810002aee0 tx=0x7f810002a8f0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.685+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 shutdown_connections 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.685+0000 7f81155e9740 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c707070 0x56321cabf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.685+0000 7f81155e9740 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6e6390 0x56321cab9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.685+0000 7f81155e9740 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321c6c59f0 0x56321cacb820 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.685+0000 7f81155e9740 1 --2- 172.21.15.84:0/3305146617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c6de1b0 0x56321cab98a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.685+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 >> 172.21.15.84:0/3305146617 conn(0x56321c6fb460 msgr2=0x56321cab0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.686+0000 7f80f1600640 0 client.26164 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.687+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 shutdown_connections 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.687+0000 7f81155e9740 1 -- 172.21.15.84:0/3305146617 wait complete. 2024-09-21T07:52:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.687+0000 7f81155e9740 20 client.26164 trim_cache size 0 max 16384 2024-09-21T07:52:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.724+0000 7f81155e9740 1 Processor -- start 2024-09-21T07:52:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f81155e9740 1 -- start start 2024-09-21T07:52:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f81155e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321caabac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f81155e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6e6390 0x56321cab2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f81155e9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f81155e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8108077610 con 0x56321c6de1b0 2024-09-21T07:52:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f81155e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8108079150 con 0x56321c6e6390 2024-09-21T07:52:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f81155e9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8108077ce0 con 0x56321c707070 2024-09-21T07:52:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f810ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f8107400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6e6390 0x56321cab2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f8107400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6e6390 0x56321cab2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41080/0 (socket says 172.21.15.84:41080) 2024-09-21T07:52:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.725+0000 7f8107400640 1 -- 172.21.15.84:0/2519627792 learned_addr learned my addr 172.21.15.84:0/2519627792 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.726+0000 7f8107e00640 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321caabac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.726+0000 7f8107400640 1 -- 172.21.15.84:0/2519627792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 msgr2=0x56321cac63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.726+0000 7f8107400640 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.726+0000 7f8107400640 1 -- 172.21.15.84:0/2519627792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 msgr2=0x56321caabac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.726+0000 7f8107400640 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321caabac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.726+0000 7f8107400640 1 -- 172.21.15.84:0/2519627792 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321cab5210 con 0x56321c6e6390 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.727+0000 7f810ca00640 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.727+0000 7f8107400640 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6e6390 0x56321cab2c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80f800cc90 tx=0x7f80f8014ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e75e70ee353414c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.727+0000 7f80f3e00640 1 -- 172.21.15.84:0/2519627792 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f802c030 con 0x56321c6e6390 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.728+0000 7f80f3e00640 1 -- 172.21.15.84:0/2519627792 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f800c430 con 0x56321c6e6390 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.728+0000 7f80f3e00640 1 -- 172.21.15.84:0/2519627792 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8019040 con 0x56321c6e6390 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.728+0000 7f81155e9740 1 -- 172.21.15.84:0/2519627792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6e6390 msgr2=0x56321cab2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.728+0000 7f81155e9740 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6e6390 0x56321cab2c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80f800cc90 tx=0x7f80f8014ec0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 -- 172.21.15.84:0/2519627792 shutdown_connections 2024-09-21T07:52:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c6e6390 0x56321cab2c70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 --2- 172.21.15.84:0/2519627792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321caabac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 -- 172.21.15.84:0/2519627792 >> 172.21.15.84:0/2519627792 conn(0x56321c6fb460 msgr2=0x56321caab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 -- 172.21.15.84:0/2519627792 shutdown_connections 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 -- 172.21.15.84:0/2519627792 wait complete. 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 -- start start 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.729+0000 7f81155e9740 1 Processor -- start 2024-09-21T07:52:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.730+0000 7f81155e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321cac6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.730+0000 7f81155e9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.730+0000 7f81155e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c69ada0 0x56321cac44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.730+0000 7f81155e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8108078a80 con 0x56321c6de1b0 2024-09-21T07:52:39.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.730+0000 7f81155e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81080783b0 con 0x56321c69ada0 2024-09-21T07:52:39.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.730+0000 7f81155e9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f81080755d0 con 0x56321c707070 2024-09-21T07:52:39.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.730+0000 7f81155e9740 10 client.0 _ll_register_callbacks cb 0x7f8100031480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:39.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f8107e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321cac6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f810ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c69ada0 0x56321cac44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f8107e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321cac6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37290/0 (socket says 172.21.15.84:37290) 2024-09-21T07:52:39.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f8107e00640 1 -- 172.21.15.84:0/636692199 learned_addr learned my addr 172.21.15.84:0/636692199 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:39.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f8107400640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f810ca00640 1 -- 172.21.15.84:0/636692199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 msgr2=0x56321cac3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f810ca00640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f810ca00640 1 -- 172.21.15.84:0/636692199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 msgr2=0x56321cac6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f810ca00640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321cac6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f810ca00640 1 -- 172.21.15.84:0/636692199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321cac4c80 con 0x56321c69ada0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f8107400640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f8107e00640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321cac6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f810ca00640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c69ada0 0x56321cac44f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80f40e4440 tx=0x7f80f4010820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55aab0e81bdf3988 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.731+0000 7f80f1600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.732+0000 7f80f1600640 1 -- 172.21.15.84:0/636692199 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f40ad240 con 0x56321c69ada0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.732+0000 7f80f1600640 1 -- 172.21.15.84:0/636692199 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f80f40e46c0 con 0x56321c69ada0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.732+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f800c430 con 0x56321c69ada0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.732+0000 7f80f1600640 1 -- 172.21.15.84:0/636692199 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f80f40e48c0 con 0x56321c69ada0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.732+0000 7f81155e9740 10 client.26171 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.732+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56321cb362e0 con 0x56321c69ada0 2024-09-21T07:52:39.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.732+0000 7f80f1600640 1 -- 172.21.15.84:0/636692199 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80f800c430 con 0x56321c69ada0 2024-09-21T07:52:39.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f80f1600640 1 -- 172.21.15.84:0/636692199 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f80f4022060 con 0x56321c69ada0 2024-09-21T07:52:39.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f81155e9740 10 client.26171 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:39.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f81155e9740 10 client.26171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:39.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f81155e9740 20 client.26171 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:39.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f81155e9740 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321cb36ab0 0x56321cb38ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:39.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f81155e9740 4 client.26171 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:52:39.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56321ca26ec0 con 0x56321cb36ab0 2024-09-21T07:52:39.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.733+0000 7f8107e00640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321cb36ab0 0x56321cb38ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:39.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.734+0000 7f80f1600640 10 client.26171 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:39.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.734+0000 7f8107e00640 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321cb36ab0 0x56321cb38ed0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e8983eb52435e34 server_cookie=2566ea24f991475c in_seq=0 out_seq=0 2024-09-21T07:52:39.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.734+0000 7f80f1600640 1 -- 172.21.15.84:0/636692199 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x56321ca26ec0 con 0x56321cb36ab0 2024-09-21T07:52:39.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.734+0000 7f80f1600640 10 client.26171 handle_command_reply: tid=0 2024-09-21T07:52:39.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.734+0000 7f81155e9740 1 client.26171 shutdown 2024-09-21T07:52:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c69ada0 msgr2=0x56321cac44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c69ada0 0x56321cac44f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80f40e4440 tx=0x7f80f4010820 comp rx=0 tx=0).stop 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 shutdown_connections 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56321c69ada0 0x56321cac44f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56321cb36ab0 0x56321cb38ed0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321c707070 0x56321cac3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 --2- 172.21.15.84:0/636692199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56321c6de1b0 0x56321cac6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.737+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 >> 172.21.15.84:0/636692199 conn(0x56321c6fb460 msgr2=0x56321cab2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.738+0000 7f80f1600640 0 client.26171 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.738+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 shutdown_connections 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.738+0000 7f81155e9740 1 -- 172.21.15.84:0/636692199 wait complete. 2024-09-21T07:52:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.738+0000 7f81155e9740 20 client.26171 trim_cache size 0 max 16384 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:52:39.741 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:52:39.742 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80ec0b67b0 msgr2=0x7f80ec0b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80ec0b67b0 0x7f80ec0b8cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56321caac7e0 tx=0x7f810002adf0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8108118900 msgr2=0x7f810810e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8108118900 0x7f810810e7b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f810810b3a0 tx=0x7f80f400b870 comp rx=0 tx=0).stop 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 shutdown_connections 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80ec0b67b0 0x7f80ec0b8cc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8108118900 0x7f810810e7b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f810810ad10 0x7f810810e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 --2- 172.21.15.84:0/1933576761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f810810a3c0 0x7f8108111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 >> 172.21.15.84:0/1933576761 conn(0x7f8108070ec0 msgr2=0x7f8108118f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 shutdown_connections 2024-09-21T07:52:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:39.739+0000 7f810ea00640 1 -- 172.21.15.84:0/1933576761 wait complete. 2024-09-21T07:52:40.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:40 smithi162 ceph-mon[34833]: pgmap v441: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 299 MiB/s wr, 93 op/s 2024-09-21T07:52:40.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:40 smithi084 ceph-mon[30411]: pgmap v441: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 299 MiB/s wr, 93 op/s 2024-09-21T07:52:40.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:40 smithi191 ceph-mon[34667]: pgmap v441: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 299 MiB/s wr, 93 op/s 2024-09-21T07:52:40.860 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:52:40.860 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:52:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.291+0000 7fd27ea00640 1 -- 172.21.15.84:0/2603588131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 msgr2=0x7fd278116c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.291+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2603588131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 0x7fd278116c50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd270009be0 tx=0x7fd27002a6c0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.292+0000 7fd27ea00640 1 -- 172.21.15.84:0/2603588131 shutdown_connections 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.292+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2603588131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 0x7fd278116c50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.292+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2603588131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd27810fad0 0x7fd27810fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.292+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2603588131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 0x7fd27810a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.292+0000 7fd27ea00640 1 -- 172.21.15.84:0/2603588131 >> 172.21.15.84:0/2603588131 conn(0x7fd2780780f0 msgr2=0x7fd2781081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.292+0000 7fd27ea00640 1 -- 172.21.15.84:0/2603588131 shutdown_connections 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.292+0000 7fd27ea00640 1 -- 172.21.15.84:0/2603588131 wait complete. 2024-09-21T07:52:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.295+0000 7fd27ea00640 1 Processor -- start 2024-09-21T07:52:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.297+0000 7fd27ea00640 1 -- start start 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.297+0000 7fd27ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 0x7fd2781a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.297+0000 7fd27ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd27810fad0 0x7fd2781a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.297+0000 7fd27ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 0x7fd2781a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.297+0000 7fd27ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd27811a0d0 con 0x7fd278110420 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd27ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd278119f50 con 0x7fd27810fad0 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd27ea00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd27811a250 con 0x7fd27810a190 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 0x7fd2781a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 0x7fd2781a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50416/0 (socket says 172.21.15.84:50416) 2024-09-21T07:52:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 -- 172.21.15.84:0/2311140666 learned_addr learned my addr 172.21.15.84:0/2311140666 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:42.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277400640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd27810fad0 0x7fd2781a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:42.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 -- 172.21.15.84:0/2311140666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd27810fad0 msgr2=0x7fd2781a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:42.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd27810fad0 0x7fd2781a0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd27ca00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 0x7fd2781a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:42.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 -- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 msgr2=0x7fd2781a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:42.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 0x7fd2781a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 -- 172.21.15.84:0/2311140666 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2781a6960 con 0x7fd27810a190 2024-09-21T07:52:42.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.298+0000 7fd277e00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 0x7fd2781a0a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd26800e9f0 tx=0x7fd26800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:42.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.299+0000 7fd274c00640 1 -- 172.21.15.84:0/2311140666 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26800ccc0 con 0x7fd27810a190 2024-09-21T07:52:42.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.299+0000 7fd274c00640 1 -- 172.21.15.84:0/2311140666 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26800ce60 con 0x7fd27810a190 2024-09-21T07:52:42.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.299+0000 7fd274c00640 1 -- 172.21.15.84:0/2311140666 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd268010430 con 0x7fd27810a190 2024-09-21T07:52:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.301+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2781a6c50 con 0x7fd27810a190 2024-09-21T07:52:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.301+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27807bc10 con 0x7fd27810a190 2024-09-21T07:52:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.303+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd27810b410 con 0x7fd27810a190 2024-09-21T07:52:42.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.307+0000 7fd274c00640 1 -- 172.21.15.84:0/2311140666 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd2680046c0 con 0x7fd27810a190 2024-09-21T07:52:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.309+0000 7fd274c00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd25c0b6700 0x7fd25c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.309+0000 7fd274c00640 1 -- 172.21.15.84:0/2311140666 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fd2680e82e0 con 0x7fd27810a190 2024-09-21T07:52:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.310+0000 7fd274c00640 1 -- 172.21.15.84:0/2311140666 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2680e8740 con 0x7fd27810a190 2024-09-21T07:52:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.311+0000 7fd277400640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd25c0b6700 0x7fd25c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.313+0000 7fd277400640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd25c0b6700 0x7fd25c0b8c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd27810e470 tx=0x7fd264005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.825+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd27810a5a0 con 0x7fd27810a190 2024-09-21T07:52:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.828+0000 7fd274c00640 1 -- 172.21.15.84:0/2311140666 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fd2680ae4c0 con 0x7fd27810a190 2024-09-21T07:52:42.838 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:52:42.838 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:52:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:52:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.837+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd25c0b6700 msgr2=0x7fd25c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.837+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd25c0b6700 0x7fd25c0b8c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd27810e470 tx=0x7fd264005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.837+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 msgr2=0x7fd2781a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:42.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.837+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 0x7fd2781a0a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd26800e9f0 tx=0x7fd26800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.842+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 shutdown_connections 2024-09-21T07:52:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.842+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd25c0b6700 0x7fd25c0b8c10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.842+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278110420 0x7fd2781a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.842+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd27810fad0 0x7fd2781a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.842+0000 7fd27ea00640 1 --2- 172.21.15.84:0/2311140666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27810a190 0x7fd2781a0a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.842+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 >> 172.21.15.84:0/2311140666 conn(0x7fd2780780f0 msgr2=0x7fd2781081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:42.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.844+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 shutdown_connections 2024-09-21T07:52:42.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:42.844+0000 7fd27ea00640 1 -- 172.21.15.84:0/2311140666 wait complete. 2024-09-21T07:52:43.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:43 smithi191 ceph-mon[34667]: pgmap v442: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 261 MiB/s wr, 84 op/s 2024-09-21T07:52:43.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:43 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2311140666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:43.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:43 smithi084 ceph-mon[30411]: pgmap v442: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 261 MiB/s wr, 84 op/s 2024-09-21T07:52:43.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:43 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2311140666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:43 smithi162 ceph-mon[34833]: pgmap v442: 129 pgs: 129 active+clean; 5.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 261 MiB/s wr, 84 op/s 2024-09-21T07:52:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:43 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2311140666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:52:44.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:52:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:45.300 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:45 smithi084 ceph-mon[30411]: pgmap v443: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 263 MiB/s wr, 82 op/s 2024-09-21T07:52:45.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:45 smithi191 ceph-mon[34667]: pgmap v443: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 263 MiB/s wr, 82 op/s 2024-09-21T07:52:45.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:45 smithi162 ceph-mon[34833]: pgmap v443: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 263 MiB/s wr, 82 op/s 2024-09-21T07:52:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.799+0000 7f4e7c800640 1 -- 172.21.15.84:0/3583847611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e74103b70 msgr2=0x7f4e74103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.799+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3583847611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e74103b70 0x7f4e74103f80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009900 tx=0x7f4e6802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.803+0000 7f4e7c800640 1 -- 172.21.15.84:0/3583847611 shutdown_connections 2024-09-21T07:52:45.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.803+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3583847611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e74109e00 0x7f4e74110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.803+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3583847611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e741094b0 0x7f4e741098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.803+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3583847611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e74103b70 0x7f4e74103f80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.803+0000 7f4e7c800640 1 -- 172.21.15.84:0/3583847611 >> 172.21.15.84:0/3583847611 conn(0x7f4e740ff5e0 msgr2=0x7f4e74101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:45.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.803+0000 7f4e7c800640 1 -- 172.21.15.84:0/3583847611 shutdown_connections 2024-09-21T07:52:45.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.803+0000 7f4e7c800640 1 -- 172.21.15.84:0/3583847611 wait complete. 2024-09-21T07:52:45.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.804+0000 7f4e7c800640 1 Processor -- start 2024-09-21T07:52:45.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.804+0000 7f4e7c800640 1 -- start start 2024-09-21T07:52:45.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e7c800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e74103b70 0x7f4e7419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e7c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e741094b0 0x7f4e7419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e7c800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e74109e00 0x7f4e741a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e7c800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74113b10 con 0x7f4e74103b70 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e7c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74113990 con 0x7f4e741094b0 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e7c800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74113c90 con 0x7f4e74109e00 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e79400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e741094b0 0x7f4e7419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e74103b70 0x7f4e7419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e79400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e741094b0 0x7f4e7419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41126/0 (socket says 172.21.15.84:41126) 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e79400640 1 -- 172.21.15.84:0/3308712112 learned_addr learned my addr 172.21.15.84:0/3308712112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.805+0000 7f4e7a800640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e74109e00 0x7f4e741a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e79400640 1 -- 172.21.15.84:0/3308712112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e74109e00 msgr2=0x7f4e741a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e79400640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e74109e00 0x7f4e741a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e79400640 1 -- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e74103b70 msgr2=0x7f4e7419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e79400640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e74103b70 0x7f4e7419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e79400640 1 -- 172.21.15.84:0/3308712112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e741a2590 con 0x7f4e741094b0 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e79e00640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e74103b70 0x7f4e7419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e79400640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e741094b0 0x7f4e7419cc80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e9f0 tx=0x7f4e6400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.806+0000 7f4e6ea00640 1 -- 172.21.15.84:0/3308712112 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400ccc0 con 0x7f4e741094b0 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.807+0000 7f4e6ea00640 1 -- 172.21.15.84:0/3308712112 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e640108e0 con 0x7f4e741094b0 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.807+0000 7f4e6ea00640 1 -- 172.21.15.84:0/3308712112 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64018860 con 0x7f4e741094b0 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.807+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e741a2880 con 0x7f4e741094b0 2024-09-21T07:52:45.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.807+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a2cb0 con 0x7f4e741094b0 2024-09-21T07:52:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.813+0000 7f4e6ea00640 1 -- 172.21.15.84:0/3308712112 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4e64010430 con 0x7f4e741094b0 2024-09-21T07:52:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.816+0000 7f4e6ea00640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e5c0b6730 0x7f4e5c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.816+0000 7f4e6ea00640 1 -- 172.21.15.84:0/3308712112 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4e640e7ff0 con 0x7f4e741094b0 2024-09-21T07:52:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.816+0000 7f4e834b8740 1 Processor -- start 2024-09-21T07:52:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.817+0000 7f4e834b8740 1 -- start start 2024-09-21T07:52:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.817+0000 7f4e79e00640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e5c0b6730 0x7f4e5c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.817+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.818+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea0e1b0 0x5558eedde2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.818+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea16390 0x5558eedde820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.818+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.819+0000 7f4e79400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea0e1b0 0x5558eedde2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.819+0000 7f4e79400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea0e1b0 0x5558eedde2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41136/0 (socket says 172.21.15.84:41136) 2024-09-21T07:52:45.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e79400640 1 -- 172.21.15.84:0/1570901259 learned_addr learned my addr 172.21.15.84:0/1570901259 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:45.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5558eed54fb0 con 0x5558eea37070 2024-09-21T07:52:45.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5558eed443e0 con 0x5558eea0e1b0 2024-09-21T07:52:45.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5558eed481f0 con 0x5558eea16390 2024-09-21T07:52:45.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.819+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedddda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37330/0 (socket says 172.21.15.84:37330) 2024-09-21T07:52:45.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e7a800640 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea16390 0x5558eedde820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e79400640 1 -- 172.21.15.84:0/1570901259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea16390 msgr2=0x5558eedde820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e79400640 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea16390 0x5558eedde820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.820+0000 7f4e79400640 1 -- 172.21.15.84:0/1570901259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 msgr2=0x5558eedddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.821+0000 7f4e79400640 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.821+0000 7f4e79400640 1 -- 172.21.15.84:0/1570901259 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558eed0ecd0 con 0x5558eea0e1b0 2024-09-21T07:52:45.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.821+0000 7f4e7a800640 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea16390 0x5558eedde820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:45.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.821+0000 7f4e79e00640 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:45.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.821+0000 7f4e79e00640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e5c0b6730 0x7f4e5c0b8c40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000c00 tx=0x7f4e68005040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:45.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.821+0000 7f4e79400640 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea0e1b0 0x5558eedde2e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e640aa0a0 tx=0x7f4e6400ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd9710411efd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.825+0000 7f4e63000640 1 -- 172.21.15.84:0/1570901259 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640ae1d0 con 0x5558eea0e1b0 2024-09-21T07:52:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.826+0000 7f4e63000640 1 -- 172.21.15.84:0/1570901259 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e640b25b0 con 0x5558eea0e1b0 2024-09-21T07:52:45.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.826+0000 7f4e63000640 1 -- 172.21.15.84:0/1570901259 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640e5650 con 0x5558eea0e1b0 2024-09-21T07:52:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea0e1b0 msgr2=0x5558eedde2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea0e1b0 0x5558eedde2e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e640aa0a0 tx=0x7f4e6400ce60 comp rx=0 tx=0).stop 2024-09-21T07:52:45.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 shutdown_connections 2024-09-21T07:52:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea16390 0x5558eedde820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea0e1b0 0x5558eedde2e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 --2- 172.21.15.84:0/1570901259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 >> 172.21.15.84:0/1570901259 conn(0x5558eea2b460 msgr2=0x5558eeddbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 shutdown_connections 2024-09-21T07:52:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.827+0000 7f4e834b8740 1 -- 172.21.15.84:0/1570901259 wait complete. 2024-09-21T07:52:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.828+0000 7f4e834b8740 1 -- start start 2024-09-21T07:52:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.829+0000 7f4e834b8740 1 Processor -- start 2024-09-21T07:52:45.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.829+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.829+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.829+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedf5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.829+0000 7f4e834b8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5558eeba5700 con 0x5558eea37070 2024-09-21T07:52:45.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e834b8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5558eecdf580 con 0x5558eea16390 2024-09-21T07:52:45.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e834b8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5558eedec580 con 0x5558eea0e1b0 2024-09-21T07:52:45.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e834b8740 10 client.0 _ll_register_callbacks cb 0x5558eecef470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:45.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50458/0 (socket says 172.21.15.84:50458) 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e79e00640 1 -- 172.21.15.84:0/879708967 learned_addr learned my addr 172.21.15.84:0/879708967 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e79400640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.830+0000 7f4e7a800640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedf5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e79e00640 1 -- 172.21.15.84:0/879708967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 msgr2=0x5558eede9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e79e00640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e79e00640 1 -- 172.21.15.84:0/879708967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 msgr2=0x5558eedf5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e79e00640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedf5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e79e00640 1 -- 172.21.15.84:0/879708967 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558eeaa2650 con 0x5558eea0e1b0 2024-09-21T07:52:45.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e79400640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e79e00640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede9820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e68033000 tx=0x7f4e6802a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68f41549bd7477a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.831+0000 7f4e57400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.832+0000 7f4e57400640 1 -- 172.21.15.84:0/879708967 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6804d070 con 0x5558eea0e1b0 2024-09-21T07:52:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.832+0000 7f4e57400640 1 -- 172.21.15.84:0/879708967 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4e68003a00 con 0x5558eea0e1b0 2024-09-21T07:52:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.832+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5558eece1b90 con 0x5558eea0e1b0 2024-09-21T07:52:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.832+0000 7f4e57400640 1 -- 172.21.15.84:0/879708967 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e68057050 con 0x5558eea0e1b0 2024-09-21T07:52:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.835+0000 7f4e834b8740 10 client.26182 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.835+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5558eecfc950 con 0x5558eea0e1b0 2024-09-21T07:52:45.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.835+0000 7f4e57400640 1 -- 172.21.15.84:0/879708967 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5558eece1b90 con 0x5558eea0e1b0 2024-09-21T07:52:45.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.836+0000 7f4e57400640 1 -- 172.21.15.84:0/879708967 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4e68048040 con 0x5558eea0e1b0 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.836+0000 7f4e834b8740 10 client.26182 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.836+0000 7f4e834b8740 10 client.26182 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.836+0000 7f4e834b8740 20 client.26182 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.836+0000 7f4e834b8740 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9f59f0 0x5558eedfb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.836+0000 7f4e834b8740 4 client.26182 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.836+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558eed56f00 con 0x5558ee9f59f0 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.837+0000 7f4e79400640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9f59f0 0x5558eedfb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.838+0000 7f4e57400640 10 client.26182 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:45.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.838+0000 7f4e79400640 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9f59f0 0x5558eedfb730 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1ab0a5dd9bf0e934 server_cookie=4eda960b25f857a9 in_seq=0 out_seq=0 2024-09-21T07:52:45.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.839+0000 7f4e57400640 1 -- 172.21.15.84:0/879708967 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558eed56f00 con 0x5558ee9f59f0 2024-09-21T07:52:45.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.839+0000 7f4e57400640 10 client.26182 handle_command_reply: tid=0 2024-09-21T07:52:45.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.839+0000 7f4e834b8740 1 client.26182 shutdown 2024-09-21T07:52:45.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.840+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 msgr2=0x5558eede9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.840+0000 7f4e834b8740 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede9820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e68033000 tx=0x7f4e6802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.841+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 shutdown_connections 2024-09-21T07:52:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.841+0000 7f4e834b8740 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9f59f0 0x5558eedfb730 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.841+0000 7f4e834b8740 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eedf5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.841+0000 7f4e834b8740 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.841+0000 7f4e834b8740 1 --2- 172.21.15.84:0/879708967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede9820 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.841+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 >> 172.21.15.84:0/879708967 conn(0x5558eea2b460 msgr2=0x5558eede0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.841+0000 7f4e57400640 0 client.26182 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:45.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.849+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 shutdown_connections 2024-09-21T07:52:45.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.850+0000 7f4e834b8740 1 -- 172.21.15.84:0/879708967 wait complete. 2024-09-21T07:52:45.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.850+0000 7f4e834b8740 20 client.26182 trim_cache size 0 max 16384 2024-09-21T07:52:45.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.879+0000 7f4e834b8740 1 Processor -- start 2024-09-21T07:52:45.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.879+0000 7f4e834b8740 1 -- start start 2024-09-21T07:52:45.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.881+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.881+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.881+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eede6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.882+0000 7f4e834b8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741b3060 con 0x5558eea37070 2024-09-21T07:52:45.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.882+0000 7f4e7a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eede6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.883+0000 7f4e7a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eede6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37344/0 (socket says 172.21.15.84:37344) 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.883+0000 7f4e834b8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741b4ba0 con 0x5558eea16390 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.883+0000 7f4e834b8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741b3730 con 0x5558eea0e1b0 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.883+0000 7f4e7a800640 1 -- 172.21.15.84:0/2488198257 learned_addr learned my addr 172.21.15.84:0/2488198257 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.883+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.883+0000 7f4e79400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.884+0000 7f4e7a800640 1 -- 172.21.15.84:0/2488198257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 msgr2=0x5558eede0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.884+0000 7f4e7a800640 1 --2- 172.21.15.84:0/2488198257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.884+0000 7f4e7a800640 1 -- 172.21.15.84:0/2488198257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 msgr2=0x5558eede13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.884+0000 7f4e7a800640 1 --2- 172.21.15.84:0/2488198257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.884+0000 7f4e7a800640 1 -- 172.21.15.84:0/2488198257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558eedec460 con 0x5558eea37070 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.885+0000 7f4e7a800640 1 --2- 172.21.15.84:0/2488198257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eede6810 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4e700127e0 tx=0x7f4e70012ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae4768a6eb4e9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.886+0000 7f4e62600640 1 -- 172.21.15.84:0/2488198257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7001f070 con 0x5558eea37070 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.886+0000 7f4e62600640 1 -- 172.21.15.84:0/2488198257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e7001a3f0 con 0x5558eea37070 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 -- 172.21.15.84:0/2488198257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 msgr2=0x5558eede6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2488198257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eede6810 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4e700127e0 tx=0x7f4e70012ca0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 -- 172.21.15.84:0/2488198257 shutdown_connections 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2488198257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea37070 0x5558eede6810 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2488198257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea16390 0x5558eede13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2488198257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eede0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 -- 172.21.15.84:0/2488198257 >> 172.21.15.84:0/2488198257 conn(0x5558eea2b460 msgr2=0x5558eede7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:45.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 -- 172.21.15.84:0/2488198257 shutdown_connections 2024-09-21T07:52:45.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.888+0000 7f4e834b8740 1 -- 172.21.15.84:0/2488198257 wait complete. 2024-09-21T07:52:45.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.889+0000 7f4e834b8740 1 -- start start 2024-09-21T07:52:45.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.890+0000 7f4e834b8740 1 Processor -- start 2024-09-21T07:52:45.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.891+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eededee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.892+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea16390 0x5558eedee420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.893+0000 7f4e834b8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea37070 0x5558eee650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.894+0000 7f4e834b8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741b44d0 con 0x5558eea16390 2024-09-21T07:52:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.894+0000 7f4e834b8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741b3e00 con 0x5558eea37070 2024-09-21T07:52:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.894+0000 7f4e834b8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741b1020 con 0x5558eea0e1b0 2024-09-21T07:52:45.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.894+0000 7f4e834b8740 10 client.0 _ll_register_callbacks cb 0x7f4e68005410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:45.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.895+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eededee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.895+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eededee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50488/0 (socket says 172.21.15.84:50488) 2024-09-21T07:52:45.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.895+0000 7f4e7a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea37070 0x5558eee650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.896+0000 7f4e79e00640 1 -- 172.21.15.84:0/2334595156 learned_addr learned my addr 172.21.15.84:0/2334595156 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:45.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.896+0000 7f4e79400640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea16390 0x5558eedee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e7a800640 1 -- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 msgr2=0x5558eededee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e7a800640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eededee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e7a800640 1 -- 172.21.15.84:0/2334595156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea16390 msgr2=0x5558eedee420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e7a800640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea16390 0x5558eedee420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e7a800640 1 -- 172.21.15.84:0/2334595156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558eee65630 con 0x5558eea37070 2024-09-21T07:52:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e79400640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea16390 0x5558eedee420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e7a800640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea37070 0x5558eee650f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e7001d040 tx=0x7f4e70003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da73ed4a78195d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e57400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:45.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.898+0000 7f4e79e00640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eededee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:45.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.899+0000 7f4e57400640 1 -- 172.21.15.84:0/2334595156 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70007c40 con 0x5558eea37070 2024-09-21T07:52:45.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.899+0000 7f4e57400640 1 -- 172.21.15.84:0/2334595156 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4e70004c10 con 0x5558eea37070 2024-09-21T07:52:45.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.899+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e7001a3f0 con 0x5558eea37070 2024-09-21T07:52:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.900+0000 7f4e57400640 1 -- 172.21.15.84:0/2334595156 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e70030050 con 0x5558eea37070 2024-09-21T07:52:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.900+0000 7f4e834b8740 10 client.26195 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.900+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5558eee778d0 con 0x5558eea37070 2024-09-21T07:52:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.901+0000 7f4e57400640 1 -- 172.21.15.84:0/2334595156 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e7001a3f0 con 0x5558eea37070 2024-09-21T07:52:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.901+0000 7f4e57400640 1 -- 172.21.15.84:0/2334595156 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4e70022070 con 0x5558eea37070 2024-09-21T07:52:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.901+0000 7f4e834b8740 10 client.26195 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:45.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.901+0000 7f4e834b8740 10 client.26195 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:52:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.902+0000 7f4e834b8740 20 client.26195 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:45.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.903+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9cada0 0x5558eee79f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.903+0000 7f4e834b8740 4 client.26195 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:45.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.903+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558eed529b0 con 0x5558ee9cada0 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.903+0000 7f4e79e00640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9cada0 0x5558eee79f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.904+0000 7f4e79e00640 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9cada0 0x5558eee79f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dacd6fb95f91a90c server_cookie=12fa048c6c998b3b in_seq=0 out_seq=0 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.904+0000 7f4e57400640 10 client.26195 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.905+0000 7f4e57400640 1 -- 172.21.15.84:0/2334595156 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558eed529b0 con 0x5558ee9cada0 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.905+0000 7f4e57400640 10 client.26195 handle_command_reply: tid=0 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.905+0000 7f4e834b8740 1 client.26195 shutdown 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.905+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea37070 msgr2=0x5558eee650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.905+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea37070 0x5558eee650f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e7001d040 tx=0x7f4e70003ba0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 shutdown_connections 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5558ee9cada0 0x5558eee79f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558eea37070 0x5558eee650f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558eea16390 0x5558eedee420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 --2- 172.21.15.84:0/2334595156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558eea0e1b0 0x5558eededee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 >> 172.21.15.84:0/2334595156 conn(0x5558eea2b460 msgr2=0x5558eede0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:45.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e57400640 0 client.26195 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:52:45.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 shutdown_connections 2024-09-21T07:52:45.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.906+0000 7f4e834b8740 1 -- 172.21.15.84:0/2334595156 wait complete. 2024-09-21T07:52:45.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.907+0000 7f4e834b8740 20 client.26195 trim_cache size 0 max 16384 2024-09-21T07:52:45.910 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:45.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.910+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e5c0b6730 msgr2=0x7f4e5c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.910+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e5c0b6730 0x7f4e5c0b8c40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000c00 tx=0x7f4e68005040 comp rx=0 tx=0).stop 2024-09-21T07:52:45.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.910+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e741094b0 msgr2=0x7f4e7419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:45.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.910+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e741094b0 0x7f4e7419cc80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e9f0 tx=0x7f4e6400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.916+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 shutdown_connections 2024-09-21T07:52:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.916+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e5c0b6730 0x7f4e5c0b8c40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.916+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e74109e00 0x7f4e741a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.916+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e741094b0 0x7f4e7419cc80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.916+0000 7f4e7c800640 1 --2- 172.21.15.84:0/3308712112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e74103b70 0x7f4e7419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.916+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 >> 172.21.15.84:0/3308712112 conn(0x7f4e740ff5e0 msgr2=0x7f4e74108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.920+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 shutdown_connections 2024-09-21T07:52:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:45.920+0000 7f4e7c800640 1 -- 172.21.15.84:0/3308712112 wait complete. 2024-09-21T07:52:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:45.999+0000 7ff7f2600640 1 -- 172.21.15.84:0/255700271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec109400 msgr2=0x7ff7ec109810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:45.999+0000 7ff7f2600640 1 --2- 172.21.15.84:0/255700271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec109400 0x7ff7ec109810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009900 tx=0x7ff7d402a420 comp rx=0 tx=0).stop 2024-09-21T07:52:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:45.999+0000 7ff7f2600640 1 -- 172.21.15.84:0/255700271 shutdown_connections 2024-09-21T07:52:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:45.999+0000 7ff7f2600640 1 --2- 172.21.15.84:0/255700271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109d50 0x7ff7ec110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:45.999+0000 7ff7f2600640 1 --2- 172.21.15.84:0/255700271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec109400 0x7ff7ec109810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:45.999+0000 7ff7f2600640 1 --2- 172.21.15.84:0/255700271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7ec103ad0 0x7ff7ec103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:45.999+0000 7ff7f2600640 1 -- 172.21.15.84:0/255700271 >> 172.21.15.84:0/255700271 conn(0x7ff7ec0ff510 msgr2=0x7ff7ec101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.000+0000 7ff7f2600640 1 -- 172.21.15.84:0/255700271 shutdown_connections 2024-09-21T07:52:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.001+0000 7ff7f2600640 1 -- 172.21.15.84:0/255700271 wait complete. 2024-09-21T07:52:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.003+0000 7ff7f2600640 1 Processor -- start 2024-09-21T07:52:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.004+0000 7ff7f2600640 1 -- start start 2024-09-21T07:52:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7f2600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec103ad0 0x7ff7ec19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7f2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109400 0x7ff7ec19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7f2600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7ec109d50 0x7ff7ec1a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7f2600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec113a50 con 0x7ff7ec109d50 2024-09-21T07:52:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7f2600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec1138d0 con 0x7ff7ec109400 2024-09-21T07:52:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7f2600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec113bd0 con 0x7ff7ec103ad0 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109400 0x7ff7ec19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.005+0000 7ff7eb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec103ad0 0x7ff7ec19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109400 0x7ff7ec19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41172/0 (socket says 172.21.15.84:41172) 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7e3e00640 1 -- 172.21.15.84:0/162860437 learned_addr learned my addr 172.21.15.84:0/162860437 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7ec109d50 0x7ff7ec1a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7e3e00640 1 -- 172.21.15.84:0/162860437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec103ad0 msgr2=0x7ff7ec19c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7e3e00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec103ad0 0x7ff7ec19c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7e3e00640 1 -- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7ec109d50 msgr2=0x7ff7ec1a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7e3e00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7ec109d50 0x7ff7ec1a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7e3e00640 1 -- 172.21.15.84:0/162860437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec1a25d0 con 0x7ff7ec109400 2024-09-21T07:52:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.006+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7ec109d50 0x7ff7ec1a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.007+0000 7ff7e3e00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109400 0x7ff7ec19ccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7d402a940 tx=0x7ff7d40042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.008+0000 7ff7e8c00640 1 -- 172.21.15.84:0/162860437 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d403f070 con 0x7ff7ec109400 2024-09-21T07:52:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.008+0000 7ff7e8c00640 1 -- 172.21.15.84:0/162860437 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7d40044d0 con 0x7ff7ec109400 2024-09-21T07:52:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.008+0000 7ff7e8c00640 1 -- 172.21.15.84:0/162860437 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4035070 con 0x7ff7ec109400 2024-09-21T07:52:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.008+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec1a2860 con 0x7ff7ec109400 2024-09-21T07:52:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.008+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec1a2d80 con 0x7ff7ec109400 2024-09-21T07:52:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.011+0000 7ff7f9651740 1 Processor -- start 2024-09-21T07:52:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7f9651740 1 -- start start 2024-09-21T07:52:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ad5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027082f0 0x562b02ad6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02ad66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7f9651740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562b02a4b6b0 con 0x562b027104d0 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7f9651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562b02a3aae0 con 0x562b027311b0 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7f9651740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562b02a3e8f0 con 0x562b027082f0 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7eb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027082f0 0x562b02ad6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7eb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027082f0 0x562b02ad6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50522/0 (socket says 172.21.15.84:50522) 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7eb400640 1 -- 172.21.15.84:0/5856582 learned_addr learned my addr 172.21.15.84:0/5856582 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.012+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ad5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7eb400640 1 -- 172.21.15.84:0/5856582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 msgr2=0x562b02ad5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7eb400640 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ad5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7eb400640 1 -- 172.21.15.84:0/5856582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 msgr2=0x562b02ad66b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7eb400640 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02ad66b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7eb400640 1 -- 172.21.15.84:0/5856582 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b02a07780 con 0x562b027082f0 2024-09-21T07:52:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7eb400640 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027082f0 0x562b02ad6170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ad30 tx=0x7ff7dc00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7946495605d9f980 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7e0c00640 1 -- 172.21.15.84:0/5856582 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc010840 con 0x562b027082f0 2024-09-21T07:52:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7e0c00640 1 -- 172.21.15.84:0/5856582 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7dc014070 con 0x562b027082f0 2024-09-21T07:52:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.013+0000 7ff7e0c00640 1 -- 172.21.15.84:0/5856582 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc018b00 con 0x562b027082f0 2024-09-21T07:52:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.014+0000 7ff7e8c00640 1 -- 172.21.15.84:0/162860437 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff7d4042070 con 0x7ff7ec109400 2024-09-21T07:52:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.014+0000 7ff7f9651740 1 -- 172.21.15.84:0/5856582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027082f0 msgr2=0x562b02ad6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.014+0000 7ff7f9651740 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027082f0 0x562b02ad6170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ad30 tx=0x7ff7dc00f790 comp rx=0 tx=0).stop 2024-09-21T07:52:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.016+0000 7ff7f9651740 1 -- 172.21.15.84:0/5856582 shutdown_connections 2024-09-21T07:52:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.016+0000 7ff7f9651740 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02ad66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.016+0000 7ff7f9651740 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027082f0 0x562b02ad6170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.016+0000 7ff7f9651740 1 --2- 172.21.15.84:0/5856582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ad5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.016+0000 7ff7f9651740 1 -- 172.21.15.84:0/5856582 >> 172.21.15.84:0/5856582 conn(0x562b02725300 msgr2=0x562b02ad3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.016+0000 7ff7f9651740 1 -- 172.21.15.84:0/5856582 shutdown_connections 2024-09-21T07:52:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.016+0000 7ff7f9651740 1 -- 172.21.15.84:0/5856582 wait complete. 2024-09-21T07:52:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.017+0000 7ff7f9651740 1 -- start start 2024-09-21T07:52:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.017+0000 7ff7f9651740 1 Processor -- start 2024-09-21T07:52:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.017+0000 7ff7e8c00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff7d00b6610 0x7ff7d00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.017+0000 7ff7e8c00640 1 -- 172.21.15.84:0/162860437 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff7d4107fc0 con 0x7ff7ec109400 2024-09-21T07:52:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.017+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff7d00b6610 0x7ff7d00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02ae11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02ae16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02ae1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7f9651740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562b02972ab0 con 0x562b027104d0 2024-09-21T07:52:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7f9651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562b029e1570 con 0x562b027082f0 2024-09-21T07:52:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7f9651740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562b02af53c0 con 0x562b027311b0 2024-09-21T07:52:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7f9651740 10 client.0 _ll_register_callbacks cb 0x562b029f0100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02ae1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02ae1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50534/0 (socket says 172.21.15.84:50534) 2024-09-21T07:52:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 -- 172.21.15.84:0/4181759179 learned_addr learned my addr 172.21.15.84:0/4181759179 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7eb400640 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02ae11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff7d00b6610 0x7ff7d00b8b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c5f0 tx=0x7ff7e4010040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7e3e00640 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02ae16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 -- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 msgr2=0x562b02ae11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02ae11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 -- 172.21.15.84:0/4181759179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 msgr2=0x562b02ae16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.018+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02ae16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.019+0000 7ff7ebe00640 1 -- 172.21.15.84:0/4181759179 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b0279c790 con 0x562b027311b0 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.019+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02ae1c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4019dc0 tx=0x7ff7e4004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7d81186b579ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.019+0000 7ff7d9600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.019+0000 7ff7d9600640 1 -- 172.21.15.84:0/4181759179 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4022410 con 0x562b027311b0 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.019+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7dc014070 con 0x562b027311b0 2024-09-21T07:52:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.019+0000 7ff7d9600640 1 -- 172.21.15.84:0/4181759179 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff7e40225b0 con 0x562b027311b0 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7d9600640 1 -- 172.21.15.84:0/4181759179 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff7e4003a30 con 0x562b027311b0 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 10 client.26200 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562b02815620 con 0x562b027311b0 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7d9600640 1 -- 172.21.15.84:0/4181759179 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7dc014070 con 0x562b027311b0 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7d9600640 1 -- 172.21.15.84:0/4181759179 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff7e4004020 con 0x562b027311b0 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 10 client.26200 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 10 client.26200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 20 client.26200 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026efd80 0x562b02b043e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 4 client.26200 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.020+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b02a4d600 con 0x562b026efd80 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.021+0000 7ff7eb400640 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026efd80 0x562b02b043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.021+0000 7ff7eb400640 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026efd80 0x562b02b043e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75cf9cca4b40b320 server_cookie=d6fadd7083d80106 in_seq=0 out_seq=0 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.021+0000 7ff7d9600640 10 client.26200 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7d9600640 1 -- 172.21.15.84:0/4181759179 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b02a4d600 con 0x562b026efd80 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7d9600640 10 client.26200 handle_command_reply: tid=0 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 client.26200 shutdown 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 msgr2=0x562b02ae1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02ae1c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4019dc0 tx=0x7ff7e4004a80 comp rx=0 tx=0).stop 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 shutdown_connections 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026efd80 0x562b02b043e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02ae1c30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7d9600640 0 client.26200 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02ae16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 --2- 172.21.15.84:0/4181759179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02ae11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 >> 172.21.15.84:0/4181759179 conn(0x562b02725300 msgr2=0x562b02ad6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 shutdown_connections 2024-09-21T07:52:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.022+0000 7ff7f9651740 1 -- 172.21.15.84:0/4181759179 wait complete. 2024-09-21T07:52:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.023+0000 7ff7f9651740 20 client.26200 trim_cache size 0 max 16384 2024-09-21T07:52:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.043+0000 7ff7f9651740 1 Processor -- start 2024-09-21T07:52:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.044+0000 7ff7f9651740 1 -- start start 2024-09-21T07:52:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.044+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027082f0 0x562b02ad2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.044+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027104d0 0x562b02ad7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.044+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ade380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.044+0000 7ff7f9651740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec1aa790 con 0x562b027082f0 2024-09-21T07:52:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.044+0000 7ff7f9651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec1ac2d0 con 0x562b027311b0 2024-09-21T07:52:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.044+0000 7ff7f9651740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec1aae60 con 0x562b027104d0 2024-09-21T07:52:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7eb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027082f0 0x562b02ad2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ade380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ade380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41206/0 (socket says 172.21.15.84:41206) 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 -- 172.21.15.84:0/1124243480 learned_addr learned my addr 172.21.15.84:0/1124243480 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7e3e00640 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027104d0 0x562b02ad7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 -- 172.21.15.84:0/1124243480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027104d0 msgr2=0x562b02ad7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027104d0 0x562b02ad7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 -- 172.21.15.84:0/1124243480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027082f0 msgr2=0x562b02ad2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027082f0 0x562b02ad2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7ebe00640 1 -- 172.21.15.84:0/1124243480 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b02adcd00 con 0x562b027311b0 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.045+0000 7ff7eb400640 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027082f0 0x562b02ad2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.046+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ade380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40096e0 tx=0x7ff7e4007cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e54242b12d4b9776 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.046+0000 7ff7dbe00640 1 -- 172.21.15.84:0/1124243480 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4009980 con 0x562b027311b0 2024-09-21T07:52:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.046+0000 7ff7dbe00640 1 -- 172.21.15.84:0/1124243480 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7e4027070 con 0x562b027311b0 2024-09-21T07:52:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.046+0000 7ff7dbe00640 1 -- 172.21.15.84:0/1124243480 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40348d0 con 0x562b027311b0 2024-09-21T07:52:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.047+0000 7ff7f9651740 1 -- 172.21.15.84:0/1124243480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 msgr2=0x562b02ade380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.047+0000 7ff7f9651740 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ade380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40096e0 tx=0x7ff7e4007cf0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 -- 172.21.15.84:0/1124243480 shutdown_connections 2024-09-21T07:52:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027311b0 0x562b02ade380 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027104d0 0x562b02ad7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 --2- 172.21.15.84:0/1124243480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027082f0 0x562b02ad2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 -- 172.21.15.84:0/1124243480 >> 172.21.15.84:0/1124243480 conn(0x562b02725300 msgr2=0x562b02ad6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 -- 172.21.15.84:0/1124243480 shutdown_connections 2024-09-21T07:52:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 -- 172.21.15.84:0/1124243480 wait complete. 2024-09-21T07:52:46.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.048+0000 7ff7f9651740 1 -- start start 2024-09-21T07:52:46.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 1 Processor -- start 2024-09-21T07:52:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02af7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02af8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02b66d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec1abc00 con 0x562b027104d0 2024-09-21T07:52:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec1ab530 con 0x562b027082f0 2024-09-21T07:52:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec19d850 con 0x562b027311b0 2024-09-21T07:52:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7f9651740 10 client.0 _ll_register_callbacks cb 0x7ff7e401c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.049+0000 7ff7eb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02af7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02af7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41218/0 (socket says 172.21.15.84:41218) 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7e3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02af8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 -- 172.21.15.84:0/2204896112 learned_addr learned my addr 172.21.15.84:0/2204896112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7ebe00640 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02b66d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 -- 172.21.15.84:0/2204896112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 msgr2=0x562b02b66d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02b66d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 -- 172.21.15.84:0/2204896112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 msgr2=0x562b02af8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02af8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 -- 172.21.15.84:0/2204896112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b02b67410 con 0x562b027082f0 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7eb400640 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02af7f40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ac50 tx=0x7ff7dc00a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7bdfd9f55b6b845 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7d9600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.050+0000 7ff7d9600640 1 -- 172.21.15.84:0/2204896112 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc005250 con 0x562b027082f0 2024-09-21T07:52:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7e4027070 con 0x562b027082f0 2024-09-21T07:52:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7d9600640 1 -- 172.21.15.84:0/2204896112 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff7dc0053f0 con 0x562b027082f0 2024-09-21T07:52:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7d9600640 1 -- 172.21.15.84:0/2204896112 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff7dc0055f0 con 0x562b027082f0 2024-09-21T07:52:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 10 client.26210 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562b02b6e780 con 0x562b027082f0 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7d9600640 1 -- 172.21.15.84:0/2204896112 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7e4027070 con 0x562b027082f0 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7d9600640 1 -- 172.21.15.84:0/2204896112 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff7dc0048d0 con 0x562b027082f0 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 10 client.26210 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 10 client.26210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 20 client.26210 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026c51c0 0x562b02b70c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 4 client.26210 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.051+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b02a490b0 con 0x562b026c51c0 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.052+0000 7ff7e3e00640 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026c51c0 0x562b02b70c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.052+0000 7ff7d9600640 10 client.26210 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.052+0000 7ff7e3e00640 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026c51c0 0x562b02b70c80 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df9a0a0675cfd7b server_cookie=48dfcda696eef6fa in_seq=0 out_seq=0 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7d9600640 1 -- 172.21.15.84:0/2204896112 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b02a490b0 con 0x562b026c51c0 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7d9600640 10 client.26210 handle_command_reply: tid=0 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 client.26210 shutdown 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 msgr2=0x562b02af7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02af7f40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ac50 tx=0x7ff7dc00a890 comp rx=0 tx=0).stop 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 shutdown_connections 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562b026c51c0 0x562b02b70c80 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b027311b0 0x562b02b66d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b027104d0 0x562b02af8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 --2- 172.21.15.84:0/2204896112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b027082f0 0x562b02af7f40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7d9600640 0 client.26210 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.065+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 >> 172.21.15.84:0/2204896112 conn(0x562b02725300 msgr2=0x562b02ad75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.066+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 shutdown_connections 2024-09-21T07:52:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.066+0000 7ff7f9651740 1 -- 172.21.15.84:0/2204896112 wait complete. 2024-09-21T07:52:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.066+0000 7ff7f9651740 20 client.26210 trim_cache size 0 max 16384 2024-09-21T07:52:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:52:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:52:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:52:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff7d00b6610 msgr2=0x7ff7d00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff7d00b6610 0x7ff7d00b8b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c5f0 tx=0x7ff7e4010040 comp rx=0 tx=0).stop 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109400 msgr2=0x7ff7ec19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109400 0x7ff7ec19ccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7d402a940 tx=0x7ff7d40042e0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 shutdown_connections 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff7d00b6610 0x7ff7d00b8b20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7ec109d50 0x7ff7ec1a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7ec109400 0x7ff7ec19ccd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 --2- 172.21.15.84:0/162860437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7ec103ad0 0x7ff7ec19c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 >> 172.21.15.84:0/162860437 conn(0x7ff7ec0ff510 msgr2=0x7ff7ec108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 shutdown_connections 2024-09-21T07:52:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:46.067+0000 7ff7f2600640 1 -- 172.21.15.84:0/162860437 wait complete. 2024-09-21T07:52:47.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:52:47.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:47 smithi191 ceph-mon[34667]: pgmap v444: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 231 MiB/s wr, 74 op/s 2024-09-21T07:52:47.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:47 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:47.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:47 smithi162 ceph-mon[34833]: pgmap v444: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 231 MiB/s wr, 74 op/s 2024-09-21T07:52:47.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:47 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:47.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:47 smithi084 ceph-mon[30411]: pgmap v444: 129 pgs: 129 active+clean; 6.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 231 MiB/s wr, 74 op/s 2024-09-21T07:52:47.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:47 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:48.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:48.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:48.360 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:48 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:52:48.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:48.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:48.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:48 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:52:48.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:48.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:48.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:48 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:52:48.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3307224013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad00757b0 msgr2=0x7f0ad0075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3307224013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad00757b0 0x7f0ad0075bc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009900 tx=0x7f0ac002a410 comp rx=0 tx=0).stop 2024-09-21T07:52:48.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3307224013 shutdown_connections 2024-09-21T07:52:48.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3307224013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad010ff10 0x7f0ad0112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3307224013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad0076100 0x7f0ad010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3307224013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad00757b0 0x7f0ad0075bc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3307224013 >> 172.21.15.84:0/3307224013 conn(0x7f0ad00ff440 msgr2=0x7f0ad0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:48.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3307224013 shutdown_connections 2024-09-21T07:52:48.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.800+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3307224013 wait complete. 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.801+0000 7f0ad4a00640 1 Processor -- start 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.801+0000 7f0ad4a00640 1 -- start start 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0ad4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad00757b0 0x7f0ad019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0ad4a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad0076100 0x7f0ad019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0ad4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad010ff10 0x7f0ad01a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0ad4a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad0115ac0 con 0x7f0ad010ff10 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0ad4a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad0115940 con 0x7f0ad00757b0 2024-09-21T07:52:48.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0ad4a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad0115c40 con 0x7f0ad0076100 2024-09-21T07:52:48.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad00757b0 0x7f0ad019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad00757b0 0x7f0ad019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53398/0 (socket says 172.21.15.84:53398) 2024-09-21T07:52:48.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 -- 172.21.15.84:0/3537334619 learned_addr learned my addr 172.21.15.84:0/3537334619 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:48.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acea00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad0076100 0x7f0ad019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acfe00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad010ff10 0x7f0ad01a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 -- 172.21.15.84:0/3537334619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad0076100 msgr2=0x7f0ad019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad0076100 0x7f0ad019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 -- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad010ff10 msgr2=0x7f0ad01a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad010ff10 0x7f0ad01a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acf400640 1 -- 172.21.15.84:0/3537334619 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad01a2460 con 0x7f0ad00757b0 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.802+0000 7f0acfe00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad010ff10 0x7f0ad01a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.803+0000 7f0acf400640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad00757b0 0x7f0ad019c4f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0005940 tx=0x7f0ac00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.803+0000 7f0ac7e00640 1 -- 172.21.15.84:0/3537334619 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac003f030 con 0x7f0ad00757b0 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.803+0000 7f0ac7e00640 1 -- 172.21.15.84:0/3537334619 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ac00044c0 con 0x7f0ad00757b0 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.803+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad01a26f0 con 0x7f0ad00757b0 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.803+0000 7f0ac7e00640 1 -- 172.21.15.84:0/3537334619 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0035070 con 0x7f0ad00757b0 2024-09-21T07:52:48.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.803+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad01a8eb0 con 0x7f0ad00757b0 2024-09-21T07:52:48.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.807+0000 7f0adcc6c740 1 Processor -- start 2024-09-21T07:52:48.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.807+0000 7f0adcc6c740 1 -- start start 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6bf0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c68211b0 0x5641c6bf14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c6829390 0x5641c6bf19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5641c6b67fb0 con 0x5641c68211b0 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5641c6b573e0 con 0x5641c684a070 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5641c6b5b1f0 con 0x5641c6829390 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0ac7e00640 1 -- 172.21.15.84:0/3537334619 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0ac0042030 con 0x7f0ad00757b0 2024-09-21T07:52:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0acfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6bf0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0acfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6bf0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53412/0 (socket says 172.21.15.84:53412) 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0acfe00640 1 -- 172.21.15.84:0/2235122832 learned_addr learned my addr 172.21.15.84:0/2235122832 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.808+0000 7f0acea00640 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c6829390 0x5641c6bf19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acf400640 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c68211b0 0x5641c6bf14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acea00640 1 -- 172.21.15.84:0/2235122832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 msgr2=0x5641c6bf0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acea00640 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6bf0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acea00640 1 -- 172.21.15.84:0/2235122832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c68211b0 msgr2=0x5641c6bf14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acea00640 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c68211b0 0x5641c6bf14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acea00640 1 -- 172.21.15.84:0/2235122832 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6b21cd0 con 0x5641c6829390 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acfe00640 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6bf0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acf400640 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c68211b0 0x5641c6bf14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:48.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.809+0000 7f0acea00640 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c6829390 0x5641c6bf19f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ad006b700 tx=0x7f0abc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ad9192fbaa6f032 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:48.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.810+0000 7f0abbe00640 1 -- 172.21.15.84:0/2235122832 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc009d70 con 0x5641c6829390 2024-09-21T07:52:48.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.810+0000 7f0abbe00640 1 -- 172.21.15.84:0/2235122832 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0abc005020 con 0x5641c6829390 2024-09-21T07:52:48.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.810+0000 7f0abbe00640 1 -- 172.21.15.84:0/2235122832 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc004b00 con 0x5641c6829390 2024-09-21T07:52:48.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0ac7e00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ab40b6680 0x7f0ab40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2235122832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c6829390 msgr2=0x5641c6bf19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c6829390 0x5641c6bf19f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ad006b700 tx=0x7f0abc011810 comp rx=0 tx=0).stop 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2235122832 shutdown_connections 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c6829390 0x5641c6bf19f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c68211b0 0x5641c6bf14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2235122832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6bf0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2235122832 >> 172.21.15.84:0/2235122832 conn(0x5641c683e460 msgr2=0x5641c6beee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0ac7e00640 1 -- 172.21.15.84:0/3537334619 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0ac0107ec0 con 0x7f0ad00757b0 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2235122832 shutdown_connections 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2235122832 wait complete. 2024-09-21T07:52:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.811+0000 7f0acfe00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ab40b6680 0x7f0ab40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.812+0000 7f0adcc6c740 1 -- start start 2024-09-21T07:52:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.812+0000 7f0adcc6c740 1 Processor -- start 2024-09-21T07:52:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.812+0000 7f0acfe00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ab40b6680 0x7f0ab40b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8005f10 tx=0x7f0ac8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bfc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 0x5641c6bfcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6c08a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5641c69b8700 con 0x5641c6829390 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5641c6af2580 con 0x5641c684a070 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5641c6bff750 con 0x5641c68211b0 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0adcc6c740 10 client.0 _ll_register_callbacks cb 0x5641c6b02470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bfc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bfc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36636/0 (socket says 172.21.15.84:36636) 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 -- 172.21.15.84:0/3762677740 learned_addr learned my addr 172.21.15.84:0/3762677740 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acea00640 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 0x5641c6bfcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acfe00640 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6c08a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 -- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 msgr2=0x5641c6c08a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6c08a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 -- 172.21.15.84:0/3762677740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 msgr2=0x5641c6bfcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 0x5641c6bfcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.813+0000 7f0acf400640 1 -- 172.21.15.84:0/3762677740 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c68b5650 con 0x5641c68211b0 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0acf400640 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bfc6a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac00c9900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42e86b7f46325af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0ab8c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0ab8c00640 1 -- 172.21.15.84:0/3762677740 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0049030 con 0x5641c68211b0 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0ab8c00640 1 -- 172.21.15.84:0/3762677740 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0ac00d7130 con 0x5641c68211b0 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641c6af4b90 con 0x5641c68211b0 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0ab8c00640 1 -- 172.21.15.84:0/3762677740 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ac00cd110 con 0x5641c68211b0 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0adcc6c740 10 client.26218 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5641c6b0f950 con 0x5641c68211b0 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.814+0000 7f0ab8c00640 1 -- 172.21.15.84:0/3762677740 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5641c6af4b90 con 0x5641c68211b0 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0ab8c00640 1 -- 172.21.15.84:0/3762677740 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0ac00c92f0 con 0x5641c68211b0 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0adcc6c740 10 client.26218 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0adcc6c740 10 client.26218 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0adcc6c740 20 client.26218 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c68089f0 0x5641c6c0e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0adcc6c740 4 client.26218 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641c6b69f00 con 0x5641c68089f0 2024-09-21T07:52:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.815+0000 7f0acea00640 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c68089f0 0x5641c6c0e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.816+0000 7f0acea00640 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c68089f0 0x5641c6c0e740 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5bfe8471d55a03ea server_cookie=513f376ad5a31fde in_seq=0 out_seq=0 2024-09-21T07:52:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.816+0000 7f0ab8c00640 10 client.26218 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.816+0000 7f0ab8c00640 1 -- 172.21.15.84:0/3762677740 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641c6b69f00 con 0x5641c68089f0 2024-09-21T07:52:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.816+0000 7f0ab8c00640 10 client.26218 handle_command_reply: tid=0 2024-09-21T07:52:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.816+0000 7f0adcc6c740 1 client.26218 shutdown 2024-09-21T07:52:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 msgr2=0x5641c6bfc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bfc6a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac00c9900 comp rx=0 tx=0).stop 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 shutdown_connections 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c68089f0 0x5641c6c0e740 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c684a070 0x5641c6c08a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 0x5641c6bfcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/3762677740 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bfc6a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 >> 172.21.15.84:0/3762677740 conn(0x5641c683e460 msgr2=0x5641c6bf4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0ab8c00640 0 client.26218 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 shutdown_connections 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 1 -- 172.21.15.84:0/3762677740 wait complete. 2024-09-21T07:52:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.817+0000 7f0adcc6c740 20 client.26218 trim_cache size 0 max 16384 2024-09-21T07:52:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.831+0000 7f0adcc6c740 1 Processor -- start 2024-09-21T07:52:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.831+0000 7f0adcc6c740 1 -- start start 2024-09-21T07:52:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bf2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c6829390 0x5641c6bf9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c684a070 0x5641c6bf9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad01b2cd0 con 0x5641c684a070 2024-09-21T07:52:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad01b4810 con 0x5641c6829390 2024-09-21T07:52:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad01b33a0 con 0x5641c68211b0 2024-09-21T07:52:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0acea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c6829390 0x5641c6bf9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0acea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c6829390 0x5641c6bf9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53416/0 (socket says 172.21.15.84:53416) 2024-09-21T07:52:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0acea00640 1 -- 172.21.15.84:0/2325066961 learned_addr learned my addr 172.21.15.84:0/2325066961 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0acfe00640 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c684a070 0x5641c6bf9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.832+0000 7f0acf400640 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bf2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0acf400640 1 -- 172.21.15.84:0/2325066961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c6829390 msgr2=0x5641c6bf9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0acf400640 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c6829390 0x5641c6bf9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0acf400640 1 -- 172.21.15.84:0/2325066961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c684a070 msgr2=0x5641c6bf9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0acf400640 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c684a070 0x5641c6bf9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0acf400640 1 -- 172.21.15.84:0/2325066961 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6bef380 con 0x5641c68211b0 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0acea00640 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c6829390 0x5641c6bf9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0acf400640 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bf2960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00cd6a0 tx=0x7f0ac00c9970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0cc4388819d1116 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0abb400640 1 -- 172.21.15.84:0/2325066961 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0049070 con 0x5641c68211b0 2024-09-21T07:52:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0abb400640 1 -- 172.21.15.84:0/2325066961 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ac00cd4b0 con 0x5641c68211b0 2024-09-21T07:52:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.833+0000 7f0abb400640 1 -- 172.21.15.84:0/2325066961 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0105730 con 0x5641c68211b0 2024-09-21T07:52:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2325066961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 msgr2=0x5641c6bf2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bf2960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00cd6a0 tx=0x7f0ac00c9970 comp rx=0 tx=0).stop 2024-09-21T07:52:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2325066961 shutdown_connections 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c684a070 0x5641c6bf9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c6829390 0x5641c6bf9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/2325066961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c68211b0 0x5641c6bf2960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2325066961 >> 172.21.15.84:0/2325066961 conn(0x5641c683e460 msgr2=0x5641c6bee6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.834+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2325066961 shutdown_connections 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.835+0000 7f0adcc6c740 1 -- 172.21.15.84:0/2325066961 wait complete. 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.835+0000 7f0adcc6c740 1 -- start start 2024-09-21T07:52:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 1 Processor -- start 2024-09-21T07:52:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c68211b0 0x5641c6c04be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 0x5641c6c05180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c684a070 0x5641c6bff990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad01b4140 con 0x5641c6829390 2024-09-21T07:52:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad01b3a70 con 0x5641c68211b0 2024-09-21T07:52:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad01b0c90 con 0x5641c684a070 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.836+0000 7f0adcc6c740 10 client.0 _ll_register_callbacks cb 0x7f0ac0003f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.837+0000 7f0acf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c68211b0 0x5641c6c04be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.837+0000 7f0acf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c68211b0 0x5641c6c04be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53418/0 (socket says 172.21.15.84:53418) 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.837+0000 7f0acf400640 1 -- 172.21.15.84:0/1889298585 learned_addr learned my addr 172.21.15.84:0/1889298585 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.837+0000 7f0acfe00640 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c684a070 0x5641c6bff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.837+0000 7f0acf400640 1 -- 172.21.15.84:0/1889298585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c684a070 msgr2=0x5641c6bff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.837+0000 7f0acf400640 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c684a070 0x5641c6bff990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.837+0000 7f0acf400640 1 -- 172.21.15.84:0/1889298585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 msgr2=0x5641c6c05180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.838+0000 7f0acf400640 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 0x5641c6c05180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.838+0000 7f0acf400640 1 -- 172.21.15.84:0/1889298585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c6c00080 con 0x5641c68211b0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.838+0000 7f0acf400640 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c68211b0 0x5641c6c04be0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00092a0 tx=0x7f0ac00d72a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e26d44115fb688 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.838+0000 7f0ab8c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.838+0000 7f0ab8c00640 1 -- 172.21.15.84:0/1889298585 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0049070 con 0x5641c68211b0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.838+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ac00cd4b0 con 0x5641c68211b0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.838+0000 7f0ab8c00640 1 -- 172.21.15.84:0/1889298585 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0ac00e3d50 con 0x5641c68211b0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.839+0000 7f0ab8c00640 1 -- 172.21.15.84:0/1889298585 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ac0105730 con 0x5641c68211b0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.839+0000 7f0adcc6c740 10 client.26228 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.839+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5641c6c00080 con 0x5641c68211b0 2024-09-21T07:52:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.839+0000 7f0ab8c00640 1 -- 172.21.15.84:0/1889298585 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ac00cd4b0 con 0x5641c68211b0 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.840+0000 7f0ab8c00640 1 -- 172.21.15.84:0/1889298585 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0ac00ccd20 con 0x5641c68211b0 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.840+0000 7f0adcc6c740 10 client.26228 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.840+0000 7f0adcc6c740 10 client.26228 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.840+0000 7f0adcc6c740 20 client.26228 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.840+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c67ddda0 0x5641c6c7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.840+0000 7f0adcc6c740 4 client.26228 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.840+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641c6b659b0 con 0x5641c67ddda0 2024-09-21T07:52:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.841+0000 7f0acea00640 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c67ddda0 0x5641c6c7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.842+0000 7f0acea00640 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c67ddda0 0x5641c6c7bed0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3a7edcc353a49a50 server_cookie=6ddf3476fa5fc858 in_seq=0 out_seq=0 2024-09-21T07:52:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.842+0000 7f0ab8c00640 10 client.26228 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:48.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.843+0000 7f0ab8c00640 1 -- 172.21.15.84:0/1889298585 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641c6b659b0 con 0x5641c67ddda0 2024-09-21T07:52:48.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.843+0000 7f0ab8c00640 10 client.26228 handle_command_reply: tid=0 2024-09-21T07:52:48.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.843+0000 7f0adcc6c740 1 client.26228 shutdown 2024-09-21T07:52:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.847+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c68211b0 msgr2=0x5641c6c04be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.847+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c68211b0 0x5641c6c04be0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00092a0 tx=0x7f0ac00d72a0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 shutdown_connections 2024-09-21T07:52:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5641c67ddda0 0x5641c6c7bed0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641c684a070 0x5641c6bff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641c6829390 0x5641c6c05180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 --2- 172.21.15.84:0/1889298585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641c68211b0 0x5641c6c04be0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 >> 172.21.15.84:0/1889298585 conn(0x5641c683e460 msgr2=0x5641c6bedfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0ab8c00640 0 client.26228 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:52:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 shutdown_connections 2024-09-21T07:52:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.849+0000 7f0adcc6c740 1 -- 172.21.15.84:0/1889298585 wait complete. 2024-09-21T07:52:48.852 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.850+0000 7f0adcc6c740 20 client.26228 trim_cache size 0 max 16384 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ab40b6680 msgr2=0x7f0ab40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ab40b6680 0x7f0ab40b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8005f10 tx=0x7f0ac8009500 comp rx=0 tx=0).stop 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad00757b0 msgr2=0x7f0ad019c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad00757b0 0x7f0ad019c4f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0005940 tx=0x7f0ac00040c0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 shutdown_connections 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ab40b6680 0x7f0ab40b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad010ff10 0x7f0ad01a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ad0076100 0x7f0ad019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 --2- 172.21.15.84:0/3537334619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad00757b0 0x7f0ad019c4f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.851+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 >> 172.21.15.84:0/3537334619 conn(0x7f0ad00ff440 msgr2=0x7f0ad0109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.852+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 shutdown_connections 2024-09-21T07:52:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:48.852+0000 7f0ad4a00640 1 -- 172.21.15.84:0/3537334619 wait complete. 2024-09-21T07:52:49.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:49 smithi162 ceph-mon[34833]: pgmap v445: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 222 MiB/s wr, 69 op/s 2024-09-21T07:52:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:49 smithi084 ceph-mon[30411]: pgmap v445: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 222 MiB/s wr, 69 op/s 2024-09-21T07:52:49.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:49 smithi191 ceph-mon[34667]: pgmap v445: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 222 MiB/s wr, 69 op/s 2024-09-21T07:52:49.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:52:50.627 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:51.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:51 smithi084 ceph-mon[30411]: pgmap v446: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 263 MiB/s wr, 81 op/s 2024-09-21T07:52:51.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:51 smithi162 ceph-mon[34833]: pgmap v446: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 263 MiB/s wr, 81 op/s 2024-09-21T07:52:51.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:51 smithi191 ceph-mon[34667]: pgmap v446: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 263 MiB/s wr, 81 op/s 2024-09-21T07:52:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.665+0000 7f4d50000640 1 -- 172.21.15.84:0/2740156089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d48102630 msgr2=0x7f4d48106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.665+0000 7f4d50000640 1 --2- 172.21.15.84:0/2740156089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d48102630 0x7f4d48106190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009ca0 tx=0x7f4d4002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.667+0000 7f4d50000640 1 -- 172.21.15.84:0/2740156089 shutdown_connections 2024-09-21T07:52:51.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.667+0000 7f4d50000640 1 --2- 172.21.15.84:0/2740156089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d48102630 0x7f4d48106190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.667+0000 7f4d50000640 1 --2- 172.21.15.84:0/2740156089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48101ce0 0x7f4d481020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.667+0000 7f4d50000640 1 --2- 172.21.15.84:0/2740156089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d481053f0 0x7f4d48105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.667+0000 7f4d50000640 1 -- 172.21.15.84:0/2740156089 >> 172.21.15.84:0/2740156089 conn(0x7f4d48077c60 msgr2=0x7f4d480780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:51.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.667+0000 7f4d50000640 1 -- 172.21.15.84:0/2740156089 shutdown_connections 2024-09-21T07:52:51.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.667+0000 7f4d50000640 1 -- 172.21.15.84:0/2740156089 wait complete. 2024-09-21T07:52:51.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.668+0000 7f4d50000640 1 Processor -- start 2024-09-21T07:52:51.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.669+0000 7f4d50000640 1 -- start start 2024-09-21T07:52:51.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.669+0000 7f4d50000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48101ce0 0x7f4d481a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.669+0000 7f4d50000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d48102630 0x7f4d481a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.670+0000 7f4d50000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d481053f0 0x7f4d481a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.670+0000 7f4d50000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4811a0d0 con 0x7f4d48101ce0 2024-09-21T07:52:51.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.670+0000 7f4d50000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48119f50 con 0x7f4d48102630 2024-09-21T07:52:51.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.670+0000 7f4d50000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4811a250 con 0x7f4d481053f0 2024-09-21T07:52:51.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.671+0000 7f4d4e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d481053f0 0x7f4d481a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.671+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d48102630 0x7f4d481a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.671+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d48102630 0x7f4d481a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53444/0 (socket says 172.21.15.84:53444) 2024-09-21T07:52:51.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.671+0000 7f4d4cc00640 1 -- 172.21.15.84:0/2634342202 learned_addr learned my addr 172.21.15.84:0/2634342202 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:51.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.671+0000 7f4d4d600640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48101ce0 0x7f4d481a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.672+0000 7f4d4e000640 1 -- 172.21.15.84:0/2634342202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d48102630 msgr2=0x7f4d481a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.672+0000 7f4d4e000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d48102630 0x7f4d481a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.672+0000 7f4d4e000640 1 -- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48101ce0 msgr2=0x7f4d481a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.672+0000 7f4d4e000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48101ce0 0x7f4d481a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.672+0000 7f4d4e000640 1 -- 172.21.15.84:0/2634342202 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d481a6930 con 0x7f4d481053f0 2024-09-21T07:52:51.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.672+0000 7f4d4e000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d481053f0 0x7f4d481a62c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4d40005e30 tx=0x7f4d400317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:51.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.674+0000 7f4d46000640 1 -- 172.21.15.84:0/2634342202 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40003b70 con 0x7f4d481053f0 2024-09-21T07:52:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.674+0000 7f4d46000640 1 -- 172.21.15.84:0/2634342202 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d40003d10 con 0x7f4d481053f0 2024-09-21T07:52:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.674+0000 7f4d46000640 1 -- 172.21.15.84:0/2634342202 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4002f9e0 con 0x7f4d481053f0 2024-09-21T07:52:51.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.674+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d481a6bc0 con 0x7f4d481053f0 2024-09-21T07:52:51.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.674+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d481a70b0 con 0x7f4d481053f0 2024-09-21T07:52:51.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.679+0000 7f4d56be2740 1 Processor -- start 2024-09-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.682+0000 7f4d46000640 1 -- 172.21.15.84:0/2634342202 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4d4002fb80 con 0x7f4d481053f0 2024-09-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.682+0000 7f4d56be2740 1 -- start start 2024-09-21T07:52:51.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.683+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b60da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.683+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.683+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb5799390 0x561eb5b61820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.683+0000 7f4d56be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561eb5ad7fb0 con 0x561eb57ba070 2024-09-21T07:52:51.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.683+0000 7f4d56be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561eb5ac73e0 con 0x561eb5799390 2024-09-21T07:52:51.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.683+0000 7f4d56be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561eb5acb1f0 con 0x561eb57911b0 2024-09-21T07:52:51.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.684+0000 7f4d4d600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.684+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b60da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.684+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb5799390 0x561eb5b61820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.684+0000 7f4d4cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb5799390 0x561eb5b61820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53460/0 (socket says 172.21.15.84:53460) 2024-09-21T07:52:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.684+0000 7f4d4cc00640 1 -- 172.21.15.84:0/716789781 learned_addr learned my addr 172.21.15.84:0/716789781 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:51.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.685+0000 7f4d4d600640 1 -- 172.21.15.84:0/716789781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb5799390 msgr2=0x561eb5b61820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.685+0000 7f4d4d600640 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb5799390 0x561eb5b61820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.685+0000 7f4d4d600640 1 -- 172.21.15.84:0/716789781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 msgr2=0x561eb5b60da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.685+0000 7f4d4d600640 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b60da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.685+0000 7f4d4d600640 1 -- 172.21.15.84:0/716789781 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb5a91cd0 con 0x561eb57911b0 2024-09-21T07:52:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.685+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b60da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.685+0000 7f4d46000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d300b6800 0x7f4d300b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.686+0000 7f4d46000640 1 -- 172.21.15.84:0/2634342202 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4d40108cb0 con 0x7f4d481053f0 2024-09-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.695+0000 7f4d4d600640 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b612e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400cb20 tx=0x7f4d3400e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8f03373bfe6c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.695+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d300b6800 0x7f4d300b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.695+0000 7f4d3a600640 1 -- 172.21.15.84:0/716789781 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34014070 con 0x561eb57911b0 2024-09-21T07:52:51.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.695+0000 7f4d3a600640 1 -- 172.21.15.84:0/716789781 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d34005020 con 0x561eb57911b0 2024-09-21T07:52:51.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.695+0000 7f4d3a600640 1 -- 172.21.15.84:0/716789781 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34014070 con 0x561eb57911b0 2024-09-21T07:52:51.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.697+0000 7f4d56be2740 1 -- 172.21.15.84:0/716789781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 msgr2=0x561eb5b612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.697+0000 7f4d56be2740 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b612e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400cb20 tx=0x7f4d3400e350 comp rx=0 tx=0).stop 2024-09-21T07:52:51.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.697+0000 7f4d56be2740 1 -- 172.21.15.84:0/716789781 shutdown_connections 2024-09-21T07:52:51.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.697+0000 7f4d56be2740 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb5799390 0x561eb5b61820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.697+0000 7f4d56be2740 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b612e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.697+0000 7f4d56be2740 1 --2- 172.21.15.84:0/716789781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b60da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.697+0000 7f4d56be2740 1 -- 172.21.15.84:0/716789781 >> 172.21.15.84:0/716789781 conn(0x561eb57ae460 msgr2=0x561eb5b5ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.700+0000 7f4d56be2740 1 -- 172.21.15.84:0/716789781 shutdown_connections 2024-09-21T07:52:51.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.702+0000 7f4d56be2740 1 -- 172.21.15.84:0/716789781 wait complete. 2024-09-21T07:52:51.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.705+0000 7f4d56be2740 1 -- start start 2024-09-21T07:52:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.706+0000 7f4d56be2740 1 Processor -- start 2024-09-21T07:52:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.707+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b6c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.707+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb5799390 0x561eb5b6ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.707+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b89880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.711+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d300b6800 0x7f4d300b8d10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009600 tx=0x7f4d3c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.715+0000 7f4d56be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561eb5928700 con 0x561eb57ba070 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.715+0000 7f4d56be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561eb5a62580 con 0x561eb57911b0 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.715+0000 7f4d56be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561eb5b6f580 con 0x561eb5799390 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.715+0000 7f4d56be2740 10 client.0 _ll_register_callbacks cb 0x561eb5a72470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.716+0000 7f4d4d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b6c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.716+0000 7f4d4d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b6c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53472/0 (socket says 172.21.15.84:53472) 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.716+0000 7f4d4d600640 1 -- 172.21.15.84:0/1375647318 learned_addr learned my addr 172.21.15.84:0/1375647318 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.717+0000 7f4d4d600640 1 -- 172.21.15.84:0/1375647318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb5799390 msgr2=0x561eb5b6ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.717+0000 7f4d4d600640 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb5799390 0x561eb5b6ca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.717+0000 7f4d4d600640 1 -- 172.21.15.84:0/1375647318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 msgr2=0x561eb5b89880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.717+0000 7f4d4d600640 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b89880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.718+0000 7f4d4d600640 1 -- 172.21.15.84:0/1375647318 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb5825650 con 0x561eb57911b0 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.718+0000 7f4d4d600640 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b6c520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d34006010 tx=0x7f4d3400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20300af0637c9db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.718+0000 7f4d2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:51.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.719+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1375647318 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34026060 con 0x561eb57911b0 2024-09-21T07:52:51.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.719+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1375647318 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4d340046c0 con 0x561eb57911b0 2024-09-21T07:52:51.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.719+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561eb5a64b90 con 0x561eb57911b0 2024-09-21T07:52:51.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.719+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1375647318 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d34014040 con 0x561eb57911b0 2024-09-21T07:52:51.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.722+0000 7f4d56be2740 10 client.26237 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:51.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.722+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561eb5a7f950 con 0x561eb57911b0 2024-09-21T07:52:51.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.723+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1375647318 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561eb5a64b90 con 0x561eb57911b0 2024-09-21T07:52:51.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.723+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1375647318 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4d34020030 con 0x561eb57911b0 2024-09-21T07:52:51.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.725+0000 7f4d56be2740 10 client.26237 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.725+0000 7f4d56be2740 10 client.26237 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:52:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.725+0000 7f4d56be2740 20 client.26237 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.725+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb57789f0 0x561eb5b8f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.725+0000 7f4d56be2740 4 client.26237 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.725+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eb5ad9f00 con 0x561eb57789f0 2024-09-21T07:52:51.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.729+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb57789f0 0x561eb5b8f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.731+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb57789f0 0x561eb5b8f500 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d745c216eca22d3 server_cookie=a2a42083001722e3 in_seq=0 out_seq=0 2024-09-21T07:52:51.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.732+0000 7f4d2ea00640 10 client.26237 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.740+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1375647318 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561eb5ad9f00 con 0x561eb57789f0 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.742+0000 7f4d2ea00640 10 client.26237 handle_command_reply: tid=0 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 client.26237 shutdown 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 msgr2=0x561eb5b6c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b6c520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d34006010 tx=0x7f4d3400c7e0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 shutdown_connections 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb57789f0 0x561eb5b8f500 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb57ba070 0x561eb5b89880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb5799390 0x561eb5b6ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.743+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1375647318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b6c520 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.744+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 >> 172.21.15.84:0/1375647318 conn(0x561eb57ae460 msgr2=0x561eb5b63f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:51.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.744+0000 7f4d2ea00640 0 client.26237 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:51.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.744+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 shutdown_connections 2024-09-21T07:52:51.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.744+0000 7f4d56be2740 1 -- 172.21.15.84:0/1375647318 wait complete. 2024-09-21T07:52:51.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.744+0000 7f4d56be2740 20 client.26237 trim_cache size 0 max 16384 2024-09-21T07:52:51.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.772+0000 7f4d56be2740 1 Processor -- start 2024-09-21T07:52:51.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.772+0000 7f4d56be2740 1 -- start start 2024-09-21T07:52:51.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.772+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b5ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.772+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b89870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.772+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57ba070 0x561eb5b63ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d56be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4810bc30 con 0x561eb5799390 2024-09-21T07:52:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d56be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4810d770 con 0x561eb57ba070 2024-09-21T07:52:51.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d56be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4810c300 con 0x561eb57911b0 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b5ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b5ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36688/0 (socket says 172.21.15.84:36688) 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 -- 172.21.15.84:0/260391295 learned_addr learned my addr 172.21.15.84:0/260391295 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b89870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4e000640 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57ba070 0x561eb5b63ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 -- 172.21.15.84:0/260391295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57ba070 msgr2=0x561eb5b63ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57ba070 0x561eb5b63ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 -- 172.21.15.84:0/260391295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 msgr2=0x561eb5b89870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b89870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4d600640 1 -- 172.21.15.84:0/260391295 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb5b957f0 con 0x561eb57911b0 2024-09-21T07:52:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.773+0000 7f4d4e000640 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57ba070 0x561eb5b63ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.774+0000 7f4d4d600640 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b5ecc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d34003da0 tx=0x7f4d34004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38c01ec0b771794 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.774+0000 7f4d39c00640 1 -- 172.21.15.84:0/260391295 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34030080 con 0x561eb57911b0 2024-09-21T07:52:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.774+0000 7f4d39c00640 1 -- 172.21.15.84:0/260391295 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d34005690 con 0x561eb57911b0 2024-09-21T07:52:51.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.774+0000 7f4d39c00640 1 -- 172.21.15.84:0/260391295 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34014040 con 0x561eb57911b0 2024-09-21T07:52:51.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 -- 172.21.15.84:0/260391295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 msgr2=0x561eb5b5ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b5ecc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d34003da0 tx=0x7f4d34004260 comp rx=0 tx=0).stop 2024-09-21T07:52:51.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 -- 172.21.15.84:0/260391295 shutdown_connections 2024-09-21T07:52:51.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57ba070 0x561eb5b63ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b89870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 --2- 172.21.15.84:0/260391295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57911b0 0x561eb5b5ecc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 -- 172.21.15.84:0/260391295 >> 172.21.15.84:0/260391295 conn(0x561eb57ae460 msgr2=0x561eb5b5e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 -- 172.21.15.84:0/260391295 shutdown_connections 2024-09-21T07:52:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.775+0000 7f4d56be2740 1 -- 172.21.15.84:0/260391295 wait complete. 2024-09-21T07:52:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.776+0000 7f4d56be2740 1 -- start start 2024-09-21T07:52:51.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.776+0000 7f4d56be2740 1 Processor -- start 2024-09-21T07:52:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b92c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b90150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d56be2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57ba070 0x561eb5b90690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d56be2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4810d0a0 con 0x561eb5799390 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d56be2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4810c9d0 con 0x561eb57911b0 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d56be2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481a1bb0 con 0x561eb57ba070 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d56be2740 10 client.0 _ll_register_callbacks cb 0x7f4d3400c970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b92c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b92c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53488/0 (socket says 172.21.15.84:53488) 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4d600640 1 -- 172.21.15.84:0/1239592707 learned_addr learned my addr 172.21.15.84:0/1239592707 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4e000640 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57ba070 0x561eb5b90690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b90150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4d600640 1 -- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57ba070 msgr2=0x561eb5b90690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4d600640 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57ba070 0x561eb5b90690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.777+0000 7f4d4d600640 1 -- 172.21.15.84:0/1239592707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 msgr2=0x561eb5b90150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.778+0000 7f4d4d600640 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b90150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.778+0000 7f4d4d600640 1 -- 172.21.15.84:0/1239592707 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb5b90d80 con 0x561eb57911b0 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.778+0000 7f4d4d600640 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b92c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c730 tx=0x7f4d3400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668eb3eaab52b2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.778+0000 7f4d2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.778+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1239592707 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34041060 con 0x561eb57911b0 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.778+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1239592707 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4d34010980 con 0x561eb57911b0 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.778+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561eb5ad59b0 con 0x561eb57911b0 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1239592707 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d34048050 con 0x561eb57911b0 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 10 client.26243 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:51.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561eb5bf9b20 con 0x561eb57911b0 2024-09-21T07:52:51.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1239592707 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561eb5ad59b0 con 0x561eb57911b0 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1239592707 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4d34020070 con 0x561eb57911b0 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 10 client.26243 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 10 client.26243 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 20 client.26243 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb574dda0 0x561eb5bfc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 4 client.26243 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.779+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561eb5ad2de0 con 0x561eb574dda0 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.780+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb574dda0 0x561eb5bfc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.780+0000 7f4d2ea00640 10 client.26243 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.780+0000 7f4d4cc00640 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb574dda0 0x561eb5bfc1d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d36864a787ba2b6 server_cookie=3e5fc11a077f2471 in_seq=0 out_seq=0 2024-09-21T07:52:51.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.780+0000 7f4d2ea00640 1 -- 172.21.15.84:0/1239592707 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561eb5ad2de0 con 0x561eb574dda0 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.780+0000 7f4d2ea00640 10 client.26243 handle_command_reply: tid=0 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.780+0000 7f4d56be2740 1 client.26243 shutdown 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 msgr2=0x561eb5b92c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b92c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c730 tx=0x7f4d3400c7e0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 shutdown_connections 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561eb574dda0 0x561eb5bfc1d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eb57ba070 0x561eb5b90690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561eb5799390 0x561eb5b90150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d2ea00640 0 client.26243 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 --2- 172.21.15.84:0/1239592707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561eb57911b0 0x561eb5b92c80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 >> 172.21.15.84:0/1239592707 conn(0x561eb57ae460 msgr2=0x561eb5b63ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.781+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 shutdown_connections 2024-09-21T07:52:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.782+0000 7f4d56be2740 1 -- 172.21.15.84:0/1239592707 wait complete. 2024-09-21T07:52:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.782+0000 7f4d56be2740 20 client.26243 trim_cache size 0 max 16384 2024-09-21T07:52:51.785 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d300b6800 msgr2=0x7f4d300b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d300b6800 0x7f4d300b8d10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009600 tx=0x7f4d3c005f90 comp rx=0 tx=0).stop 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d481053f0 msgr2=0x7f4d481a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d481053f0 0x7f4d481a62c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4d40005e30 tx=0x7f4d400317c0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 shutdown_connections 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4d300b6800 0x7f4d300b8d10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d481053f0 0x7f4d481a62c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d48102630 0x7f4d481a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 --2- 172.21.15.84:0/2634342202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48101ce0 0x7f4d481a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 >> 172.21.15.84:0/2634342202 conn(0x7f4d48077c60 msgr2=0x7f4d48100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.783+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 shutdown_connections 2024-09-21T07:52:51.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:51.784+0000 7f4d50000640 1 -- 172.21.15.84:0/2634342202 wait complete. 2024-09-21T07:52:53.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:52:53.313 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:53 smithi084 ceph-mon[30411]: pgmap v447: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 253 MiB/s wr, 78 op/s 2024-09-21T07:52:53.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:53 smithi162 ceph-mon[34833]: pgmap v447: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 253 MiB/s wr, 78 op/s 2024-09-21T07:52:53.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:53 smithi191 ceph-mon[34667]: pgmap v447: 129 pgs: 129 active+clean; 8.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 253 MiB/s wr, 78 op/s 2024-09-21T07:52:53.898 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:54.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.862+0000 7f8e68c00640 1 -- 172.21.15.84:0/3904908960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64075dd0 msgr2=0x7f8e640761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.862+0000 7f8e68c00640 1 --2- 172.21.15.84:0/3904908960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64075dd0 0x7f8e640761e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009900 tx=0x7f8e5002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.862+0000 7f8e68c00640 1 -- 172.21.15.84:0/3904908960 shutdown_connections 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.862+0000 7f8e68c00640 1 --2- 172.21.15.84:0/3904908960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64114280 0x7f8e64116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.862+0000 7f8e68c00640 1 --2- 172.21.15.84:0/3904908960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64075dd0 0x7f8e640761e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.862+0000 7f8e68c00640 1 --2- 172.21.15.84:0/3904908960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e64077380 0x7f8e640757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.862+0000 7f8e68c00640 1 -- 172.21.15.84:0/3904908960 >> 172.21.15.84:0/3904908960 conn(0x7f8e640ff440 msgr2=0x7f8e64101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.863+0000 7f8e68c00640 1 -- 172.21.15.84:0/3904908960 shutdown_connections 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.863+0000 7f8e68c00640 1 -- 172.21.15.84:0/3904908960 wait complete. 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 Processor -- start 2024-09-21T07:52:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 -- start start 2024-09-21T07:52:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64075dd0 0x7f8e641a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e64077380 0x7f8e641a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64114280 0x7f8e641a6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64119f10 con 0x7f8e64075dd0 2024-09-21T07:52:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64119d90 con 0x7f8e64114280 2024-09-21T07:52:54.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.864+0000 7f8e68c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6411a090 con 0x7f8e64077380 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e62a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e64077380 0x7f8e641a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64075dd0 0x7f8e641a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64114280 0x7f8e641a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64114280 0x7f8e641a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53496/0 (socket says 172.21.15.84:53496) 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64075dd0 0x7f8e641a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51168/0 (socket says 172.21.15.84:51168) 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 -- 172.21.15.84:0/2903100407 learned_addr learned my addr 172.21.15.84:0/2903100407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 -- 172.21.15.84:0/2903100407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e64077380 msgr2=0x7f8e641a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e64077380 0x7f8e641a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 -- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64075dd0 msgr2=0x7f8e641a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64075dd0 0x7f8e641a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.865+0000 7f8e63e00640 1 -- 172.21.15.84:0/2903100407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e641a6850 con 0x7f8e64114280 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e62a00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e64077380 0x7f8e641a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e63400640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64075dd0 0x7f8e641a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e63e00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64114280 0x7f8e641a6120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00eb10 tx=0x7f8e5c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e5be00640 1 -- 172.21.15.84:0/2903100407 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c004b20 con 0x7f8e64114280 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e5be00640 1 -- 172.21.15.84:0/2903100407 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5c004cc0 con 0x7f8e64114280 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e5be00640 1 -- 172.21.15.84:0/2903100407 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c010670 con 0x7f8e64114280 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e641a6b40 con 0x7f8e64114280 2024-09-21T07:52:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.866+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e641ad2a0 con 0x7f8e64114280 2024-09-21T07:52:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.870+0000 7f8e70e5a740 1 Processor -- start 2024-09-21T07:52:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.871+0000 7f8e5be00640 1 -- 172.21.15.84:0/2903100407 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8e5c010830 con 0x7f8e64114280 2024-09-21T07:52:54.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.872+0000 7f8e70e5a740 1 -- start start 2024-09-21T07:52:54.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.873+0000 7f8e5be00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e480b6680 0x7f8e480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e5be00640 1 -- 172.21.15.84:0/2903100407 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8e5c0e8000 con 0x7f8e64114280 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e62a00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e480b6680 0x7f8e480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c6a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a86c620fb0 con 0x55a86c2e2390 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a86c6103e0 con 0x55a86c2da1b0 2024-09-21T07:52:54.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a86c6141f0 con 0x55a86c303070 2024-09-21T07:52:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e63400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c6a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e63400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c6a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36704/0 (socket says 172.21.15.84:36704) 2024-09-21T07:52:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.874+0000 7f8e63400640 1 -- 172.21.15.84:0/2726703447 learned_addr learned my addr 172.21.15.84:0/2726703447 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e63e00640 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e63400640 1 -- 172.21.15.84:0/2726703447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 msgr2=0x55a86c6aa4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e63400640 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6aa4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e63400640 1 -- 172.21.15.84:0/2726703447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 msgr2=0x55a86c6aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e63400640 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e63400640 1 -- 172.21.15.84:0/2726703447 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c5dacd0 con 0x55a86c303070 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e62a00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e480b6680 0x7f8e480b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e50031440 tx=0x7f8e50005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e63400640 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c6a9f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e540115c0 tx=0x7f8e54011a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=222e20c4fc1aee4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e4fe00640 1 -- 172.21.15.84:0/2726703447 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5400f640 con 0x55a86c303070 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.875+0000 7f8e4fe00640 1 -- 172.21.15.84:0/2726703447 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5400fc90 con 0x55a86c303070 2024-09-21T07:52:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.876+0000 7f8e4fe00640 1 -- 172.21.15.84:0/2726703447 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54019ce0 con 0x55a86c303070 2024-09-21T07:52:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.876+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2726703447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 msgr2=0x55a86c6a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.876+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c6a9f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e540115c0 tx=0x7f8e54011a80 comp rx=0 tx=0).stop 2024-09-21T07:52:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2726703447 shutdown_connections 2024-09-21T07:52:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2726703447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c6a9f70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2726703447 >> 172.21.15.84:0/2726703447 conn(0x55a86c2f7460 msgr2=0x55a86c6a7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2726703447 shutdown_connections 2024-09-21T07:52:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2726703447 wait complete. 2024-09-21T07:52:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.877+0000 7f8e70e5a740 1 -- start start 2024-09-21T07:52:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 1 Processor -- start 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2e2390 0x55a86c6b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c303070 0x55a86c6c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a86c471700 con 0x55a86c303070 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a86c5ab580 con 0x55a86c2e2390 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a86c6b8750 con 0x55a86c2da1b0 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e70e5a740 10 client.0 _ll_register_callbacks cb 0x55a86c5bb470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e63400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.878+0000 7f8e63400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36718/0 (socket says 172.21.15.84:36718) 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63400640 1 -- 172.21.15.84:0/1241935799 learned_addr learned my addr 172.21.15.84:0/1241935799 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63e00640 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c303070 0x55a86c6c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e62a00640 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2e2390 0x55a86c6b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63400640 1 -- 172.21.15.84:0/1241935799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2e2390 msgr2=0x55a86c6b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63400640 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2e2390 0x55a86c6b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63400640 1 -- 172.21.15.84:0/1241935799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c303070 msgr2=0x55a86c6c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63400640 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c303070 0x55a86c6c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63400640 1 -- 172.21.15.84:0/1241935799 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86c36e650 con 0x55a86c2da1b0 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e63400640 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6b56e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e5401b040 tx=0x7f8e54019c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3012226facddb756 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.879+0000 7f8e4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.880+0000 7f8e4cc00640 1 -- 172.21.15.84:0/1241935799 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54026020 con 0x55a86c2da1b0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.880+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a86c5adb90 con 0x55a86c2da1b0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.880+0000 7f8e4cc00640 1 -- 172.21.15.84:0/1241935799 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8e54005250 con 0x55a86c2da1b0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.880+0000 7f8e4cc00640 1 -- 172.21.15.84:0/1241935799 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e54031050 con 0x55a86c2da1b0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.880+0000 7f8e70e5a740 10 client.26251 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.880+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a86c5c8950 con 0x55a86c2da1b0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.880+0000 7f8e4cc00640 1 -- 172.21.15.84:0/1241935799 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a86c5adb90 con 0x55a86c2da1b0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e4cc00640 1 -- 172.21.15.84:0/1241935799 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8e5400f640 con 0x55a86c2da1b0 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e70e5a740 10 client.26251 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e70e5a740 10 client.26251 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e70e5a740 20 client.26251 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c2c19f0 0x55a86c6c7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e70e5a740 4 client.26251 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a86c622f00 con 0x55a86c2c19f0 2024-09-21T07:52:54.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.881+0000 7f8e62a00640 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c2c19f0 0x55a86c6c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.882+0000 7f8e4cc00640 10 client.26251 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:54.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.882+0000 7f8e62a00640 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c2c19f0 0x55a86c6c7770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4d2986188ddbdf2 server_cookie=3823210db41274ee in_seq=0 out_seq=0 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e4cc00640 1 -- 172.21.15.84:0/1241935799 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a86c622f00 con 0x55a86c2c19f0 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e4cc00640 10 client.26251 handle_command_reply: tid=0 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 client.26251 shutdown 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 msgr2=0x55a86c6b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6b56e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e5401b040 tx=0x7f8e54019c30 comp rx=0 tx=0).stop 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 shutdown_connections 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c2c19f0 0x55a86c6c7770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c303070 0x55a86c6c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2e2390 0x55a86c6b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e4cc00640 0 client.26251 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/1241935799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6b56e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 >> 172.21.15.84:0/1241935799 conn(0x55a86c2f7460 msgr2=0x55a86c6ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 shutdown_connections 2024-09-21T07:52:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 1 -- 172.21.15.84:0/1241935799 wait complete. 2024-09-21T07:52:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.883+0000 7f8e70e5a740 20 client.26251 trim_cache size 0 max 16384 2024-09-21T07:52:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.897+0000 7f8e70e5a740 1 Processor -- start 2024-09-21T07:52:54.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.897+0000 7f8e70e5a740 1 -- start start 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c303070 0x55a86c6b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e641b7190 con 0x55a86c2e2390 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e641b8cd0 con 0x55a86c303070 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e641b7860 con 0x55a86c2da1b0 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c303070 0x55a86c6b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e62a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c303070 0x55a86c6b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53534/0 (socket says 172.21.15.84:53534) 2024-09-21T07:52:54.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63e00640 1 -- 172.21.15.84:0/2657043909 learned_addr learned my addr 172.21.15.84:0/2657043909 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:54.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63400640 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63e00640 1 -- 172.21.15.84:0/2657043909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 msgr2=0x55a86c6c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:54.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63e00640 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63e00640 1 -- 172.21.15.84:0/2657043909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 msgr2=0x55a86c6b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:54.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.898+0000 7f8e63e00640 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.899+0000 7f8e63e00640 1 -- 172.21.15.84:0/2657043909 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86c610370 con 0x55a86c303070 2024-09-21T07:52:54.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.899+0000 7f8e62a00640 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:52:54.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.899+0000 7f8e63e00640 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c303070 0x55a86c6b2e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c004af0 tx=0x7f8e5c00cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5653a46dc1846d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:54.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.899+0000 7f8e4f400640 1 -- 172.21.15.84:0/2657043909 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0a9290 con 0x55a86c303070 2024-09-21T07:52:54.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.899+0000 7f8e4f400640 1 -- 172.21.15.84:0/2657043909 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5c0aee50 con 0x55a86c303070 2024-09-21T07:52:54.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.899+0000 7f8e4f400640 1 -- 172.21.15.84:0/2657043909 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0b7540 con 0x55a86c303070 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2657043909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c303070 msgr2=0x55a86c6b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c303070 0x55a86c6b2e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c004af0 tx=0x7f8e5c00cf70 comp rx=0 tx=0).stop 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2657043909 shutdown_connections 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c303070 0x55a86c6b2e10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/2657043909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c2da1b0 0x55a86c6c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2657043909 >> 172.21.15.84:0/2657043909 conn(0x55a86c2f7460 msgr2=0x55a86c6b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2657043909 shutdown_connections 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.900+0000 7f8e70e5a740 1 -- 172.21.15.84:0/2657043909 wait complete. 2024-09-21T07:52:54.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 -- start start 2024-09-21T07:52:54.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 Processor -- start 2024-09-21T07:52:54.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6b9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6ba290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c731050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e641b8600 con 0x55a86c2e2390 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e641b7f30 con 0x55a86c2da1b0 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.901+0000 7f8e70e5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e641b5150 con 0x55a86c303070 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e70e5a740 10 client.0 _ll_register_callbacks cb 0x7f8e54009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e62a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e63400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6b9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e63400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6b9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53540/0 (socket says 172.21.15.84:53540) 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e63400640 1 -- 172.21.15.84:0/3462206894 learned_addr learned my addr 172.21.15.84:0/3462206894 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e62a00640 1 -- 172.21.15.84:0/3462206894 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 msgr2=0x55a86c731050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e62a00640 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c731050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e62a00640 1 -- 172.21.15.84:0/3462206894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 msgr2=0x55a86c6b9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e62a00640 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6b9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.902+0000 7f8e62a00640 1 -- 172.21.15.84:0/3462206894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86c731590 con 0x55a86c2e2390 2024-09-21T07:52:54.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.903+0000 7f8e62a00640 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6ba290 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8e5002a910 tx=0x7f8e5002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72c6c890e643345 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:54.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.903+0000 7f8e4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:52:54.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.903+0000 7f8e4cc00640 1 -- 172.21.15.84:0/3462206894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5005f060 con 0x55a86c2e2390 2024-09-21T07:52:54.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.903+0000 7f8e4cc00640 1 -- 172.21.15.84:0/3462206894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8e50004d80 con 0x55a86c2e2390 2024-09-21T07:52:54.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.903+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e5c0aee50 con 0x55a86c2e2390 2024-09-21T07:52:54.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.904+0000 7f8e4cc00640 1 -- 172.21.15.84:0/3462206894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e50035040 con 0x55a86c2e2390 2024-09-21T07:52:54.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.904+0000 7f8e70e5a740 10 client.16257 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:54.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.904+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a86c7326c0 con 0x55a86c2e2390 2024-09-21T07:52:54.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.904+0000 7f8e4cc00640 1 -- 172.21.15.84:0/3462206894 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5c0aee50 con 0x55a86c2e2390 2024-09-21T07:52:54.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e4cc00640 1 -- 172.21.15.84:0/3462206894 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8e50032790 con 0x55a86c2e2390 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e70e5a740 10 client.16257 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e70e5a740 10 client.16257 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e70e5a740 20 client.16257 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c296da0 0x55a86c734db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e70e5a740 4 client.16257 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a86c61e9b0 con 0x55a86c296da0 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.906+0000 7f8e63400640 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c296da0 0x55a86c734db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.907+0000 7f8e63400640 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c296da0 0x55a86c734db0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf78d36e4d220ebf server_cookie=dc21008384d0e2cc in_seq=0 out_seq=0 2024-09-21T07:52:54.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.907+0000 7f8e4cc00640 10 client.16257 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:54.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.907+0000 7f8e4cc00640 1 -- 172.21.15.84:0/3462206894 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a86c61e9b0 con 0x55a86c296da0 2024-09-21T07:52:54.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.907+0000 7f8e4cc00640 10 client.16257 handle_command_reply: tid=0 2024-09-21T07:52:54.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.907+0000 7f8e70e5a740 1 client.16257 shutdown 2024-09-21T07:52:54.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.907+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 msgr2=0x55a86c6ba290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.907+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6ba290 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8e5002a910 tx=0x7f8e5002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 shutdown_connections 2024-09-21T07:52:54.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55a86c296da0 0x55a86c734db0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a86c303070 0x55a86c731050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a86c2e2390 0x55a86c6ba290 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 --2- 172.21.15.84:0/3462206894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a86c2da1b0 0x55a86c6b9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 >> 172.21.15.84:0/3462206894 conn(0x55a86c2f7460 msgr2=0x55a86c6b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:54.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e4cc00640 0 client.16257 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:52:54.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 shutdown_connections 2024-09-21T07:52:54.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.909+0000 7f8e70e5a740 1 -- 172.21.15.84:0/3462206894 wait complete. 2024-09-21T07:52:54.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.910+0000 7f8e70e5a740 20 client.16257 trim_cache size 0 max 16384 2024-09-21T07:52:54.912 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:54.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.910+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e480b6680 msgr2=0x7f8e480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.910+0000 7f8e68c00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e480b6680 0x7f8e480b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e50031440 tx=0x7f8e50005a20 comp rx=0 tx=0).stop 2024-09-21T07:52:54.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.910+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64114280 msgr2=0x7f8e641a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:54.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.910+0000 7f8e68c00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64114280 0x7f8e641a6120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00eb10 tx=0x7f8e5c00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 shutdown_connections 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8e480b6680 0x7f8e480b8b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e64114280 0x7f8e641a6120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e64077380 0x7f8e641a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 --2- 172.21.15.84:0/2903100407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e64075dd0 0x7f8e641a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 >> 172.21.15.84:0/2903100407 conn(0x7f8e640ff440 msgr2=0x7f8e64110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 shutdown_connections 2024-09-21T07:52:54.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:54.913+0000 7f8e68c00640 1 -- 172.21.15.84:0/2903100407 wait complete. 2024-09-21T07:52:55.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:55 smithi084 ceph-mon[30411]: pgmap v448: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 270 MiB/s wr, 80 op/s 2024-09-21T07:52:55.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:55 smithi162 ceph-mon[34833]: pgmap v448: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 270 MiB/s wr, 80 op/s 2024-09-21T07:52:55.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:55 smithi191 ceph-mon[34667]: pgmap v448: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 270 MiB/s wr, 80 op/s 2024-09-21T07:52:56.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:52:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:52:57.483 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:57 smithi084 ceph-mon[30411]: pgmap v449: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 254 MiB/s wr, 82 op/s 2024-09-21T07:52:57.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:57 smithi162 ceph-mon[34833]: pgmap v449: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 254 MiB/s wr, 82 op/s 2024-09-21T07:52:57.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:57 smithi191 ceph-mon[34667]: pgmap v449: 129 pgs: 129 active+clean; 9.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 254 MiB/s wr, 82 op/s 2024-09-21T07:52:58.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:52:58 smithi084 ceph-mon[30411]: pgmap v450: 129 pgs: 129 active+clean; 9.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 255 MiB/s wr, 96 op/s 2024-09-21T07:52:58.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:52:58 smithi162 ceph-mon[34833]: pgmap v450: 129 pgs: 129 active+clean; 9.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 255 MiB/s wr, 96 op/s 2024-09-21T07:52:58.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:52:58 smithi191 ceph-mon[34667]: pgmap v450: 129 pgs: 129 active+clean; 9.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 255 MiB/s wr, 96 op/s 2024-09-21T07:52:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.835+0000 7f600d400640 1 -- 172.21.15.84:0/442510562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 msgr2=0x7f60081098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.835+0000 7f600d400640 1 --2- 172.21.15.84:0/442510562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 0x7f60081098b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009900 tx=0x7f5ff402a440 comp rx=0 tx=0).stop 2024-09-21T07:52:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.836+0000 7f600d400640 1 -- 172.21.15.84:0/442510562 shutdown_connections 2024-09-21T07:52:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.836+0000 7f600d400640 1 --2- 172.21.15.84:0/442510562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008109df0 0x7f6008110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.836+0000 7f600d400640 1 --2- 172.21.15.84:0/442510562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 0x7f60081098b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.836+0000 7f600d400640 1 --2- 172.21.15.84:0/442510562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6008103b60 0x7f6008103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.836+0000 7f600d400640 1 -- 172.21.15.84:0/442510562 >> 172.21.15.84:0/442510562 conn(0x7f600807b850 msgr2=0x7f600807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.836+0000 7f600d400640 1 -- 172.21.15.84:0/442510562 shutdown_connections 2024-09-21T07:52:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.837+0000 7f600d400640 1 -- 172.21.15.84:0/442510562 wait complete. 2024-09-21T07:52:58.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.839+0000 7f600d400640 1 Processor -- start 2024-09-21T07:52:58.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.841+0000 7f600d400640 1 -- start start 2024-09-21T07:52:58.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.842+0000 7f600d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008103b60 0x7f600819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.842+0000 7f600d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 0x7f600819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.842+0000 7f6006800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008103b60 0x7f600819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.843+0000 7f6006800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008103b60 0x7f600819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39690/0 (socket says 172.21.15.84:39690) 2024-09-21T07:52:58.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.843+0000 7f6006800640 1 -- 172.21.15.84:0/2568907390 learned_addr learned my addr 172.21.15.84:0/2568907390 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:58.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.843+0000 7f600d400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6008109df0 0x7f60081a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.843+0000 7f6005e00640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 0x7f600819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.843+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6008113b20 con 0x7f6008109df0 2024-09-21T07:52:58.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.843+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60081139a0 con 0x7f60081094a0 2024-09-21T07:52:58.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.843+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6008113ca0 con 0x7f6008103b60 2024-09-21T07:52:58.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.844+0000 7f6006800640 1 -- 172.21.15.84:0/2568907390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 msgr2=0x7f600819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.844+0000 7f6006800640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 0x7f600819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.844+0000 7f6006800640 1 -- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6008109df0 msgr2=0x7f60081a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.844+0000 7f6006800640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6008109df0 0x7f60081a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.844+0000 7f6006800640 1 -- 172.21.15.84:0/2568907390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60081a2640 con 0x7f6008103b60 2024-09-21T07:52:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.845+0000 7f6006800640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008103b60 0x7f600819c6d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800b4a0 tx=0x7f5ff800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.845+0000 7f5fff400640 1 -- 172.21.15.84:0/2568907390 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8014070 con 0x7f6008103b60 2024-09-21T07:52:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.845+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60081a2930 con 0x7f6008103b60 2024-09-21T07:52:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.846+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60081a9090 con 0x7f6008103b60 2024-09-21T07:52:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.848+0000 7f5fff400640 1 -- 172.21.15.84:0/2568907390 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ff8010ac0 con 0x7f6008103b60 2024-09-21T07:52:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.848+0000 7f5fff400640 1 -- 172.21.15.84:0/2568907390 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8017c30 con 0x7f6008103b60 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.857+0000 7f601408a740 1 Processor -- start 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.858+0000 7f5fff400640 1 -- 172.21.15.84:0/2568907390 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5ff8017070 con 0x7f6008103b60 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.861+0000 7f601408a740 1 -- start start 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.863+0000 7f5fff400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5fec0b6780 0x7f5fec0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.863+0000 7f5fff400640 1 -- 172.21.15.84:0/2568907390 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5ff80e6e60 con 0x7f6008103b60 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.863+0000 7f6007200640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5fec0b6780 0x7f5fec0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f601408a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa973caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f601408a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa96ffb1b0 0x55aa973cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f601408a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa97003390 0x55aa973cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f601408a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55aa97341fb0 con 0x55aa96ffb1b0 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f601408a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55aa973313e0 con 0x55aa97003390 2024-09-21T07:52:58.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f601408a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aa973351f0 con 0x55aa97024070 2024-09-21T07:52:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f6006800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa973caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f6006800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa973caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39698/0 (socket says 172.21.15.84:39698) 2024-09-21T07:52:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.864+0000 7f6006800640 1 -- 172.21.15.84:0/3741677598 learned_addr learned my addr 172.21.15.84:0/3741677598 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.865+0000 7f6006800640 1 -- 172.21.15.84:0/3741677598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa97003390 msgr2=0x55aa973cb620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.865+0000 7f6006800640 1 --2- 172.21.15.84:0/3741677598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa97003390 0x55aa973cb620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.865+0000 7f6006800640 1 -- 172.21.15.84:0/3741677598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa96ffb1b0 msgr2=0x55aa973cb0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:58.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.865+0000 7f6006800640 1 --2- 172.21.15.84:0/3741677598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa96ffb1b0 0x55aa973cb0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.865+0000 7f6006800640 1 -- 172.21.15.84:0/3741677598 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa972fbcd0 con 0x55aa97024070 2024-09-21T07:52:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.867+0000 7f6006800640 1 --2- 172.21.15.84:0/3741677598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa973caba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80ac640 tx=0x7f5ff80047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640767f334571417 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.867+0000 7f5ff3400640 1 -- 172.21.15.84:0/3741677598 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80b1070 con 0x55aa97024070 2024-09-21T07:52:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.867+0000 7f5ff3400640 1 -- 172.21.15.84:0/3741677598 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ff80b1210 con 0x55aa97024070 2024-09-21T07:52:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.867+0000 7f5ff3400640 1 -- 172.21.15.84:0/3741677598 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff801e070 con 0x55aa97024070 2024-09-21T07:52:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.869+0000 7f601408a740 1 -- 172.21.15.84:0/3741677598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 msgr2=0x55aa973caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.869+0000 7f601408a740 1 --2- 172.21.15.84:0/3741677598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa973caba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80ac640 tx=0x7f5ff80047d0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.869+0000 7f6007200640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5fec0b6780 0x7f5fec0b8c90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6000005c40 tx=0x7f6000005bd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.873+0000 7f601408a740 1 -- 172.21.15.84:0/3741677598 shutdown_connections 2024-09-21T07:52:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.873+0000 7f601408a740 1 --2- 172.21.15.84:0/3741677598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa97003390 0x55aa973cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.873+0000 7f601408a740 1 --2- 172.21.15.84:0/3741677598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa96ffb1b0 0x55aa973cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.873+0000 7f601408a740 1 --2- 172.21.15.84:0/3741677598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa973caba0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.873+0000 7f601408a740 1 -- 172.21.15.84:0/3741677598 >> 172.21.15.84:0/3741677598 conn(0x55aa97018460 msgr2=0x55aa973c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:58.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.875+0000 7f601408a740 1 -- 172.21.15.84:0/3741677598 shutdown_connections 2024-09-21T07:52:58.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.876+0000 7f601408a740 1 -- 172.21.15.84:0/3741677598 wait complete. 2024-09-21T07:52:58.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.877+0000 7f601408a740 1 -- start start 2024-09-21T07:52:58.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.878+0000 7f601408a740 1 Processor -- start 2024-09-21T07:52:58.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.879+0000 7f601408a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.879+0000 7f601408a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.880+0000 7f601408a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 0x55aa973eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.880+0000 7f6005e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.880+0000 7f6005e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39706/0 (socket says 172.21.15.84:39706) 2024-09-21T07:52:58.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.880+0000 7f6006800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.880+0000 7f6006800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973d67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43836/0 (socket says 172.21.15.84:43836) 2024-09-21T07:52:58.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.881+0000 7f6007200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 0x55aa973eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.882+0000 7f6005e00640 1 -- 172.21.15.84:0/3541598402 learned_addr learned my addr 172.21.15.84:0/3541598402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:58.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.882+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55aa97192700 con 0x55aa97024070 2024-09-21T07:52:58.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.882+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55aa972cc580 con 0x55aa96ffb1b0 2024-09-21T07:52:58.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.882+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aa973e1b90 con 0x55aa97003390 2024-09-21T07:52:58.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.882+0000 7f601408a740 10 client.0 _ll_register_callbacks cb 0x55aa972dc470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:58.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.884+0000 7f6006800640 1 -- 172.21.15.84:0/3541598402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 msgr2=0x55aa973d6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:58.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.884+0000 7f6006800640 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.884+0000 7f6006800640 1 -- 172.21.15.84:0/3541598402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 msgr2=0x55aa973eaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:58.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.884+0000 7f6006800640 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 0x55aa973eaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.884+0000 7f6006800640 1 -- 172.21.15.84:0/3541598402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa9708f650 con 0x55aa96ffb1b0 2024-09-21T07:52:58.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.890+0000 7f6006800640 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973d67b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80ac640 tx=0x7f5ff80a8e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f840d4cef3267d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:58.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.890+0000 7f5fe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:58.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.890+0000 7f5fe7e00640 1 -- 172.21.15.84:0/3541598402 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80c7060 con 0x55aa96ffb1b0 2024-09-21T07:52:58.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.890+0000 7f5fe7e00640 1 -- 172.21.15.84:0/3541598402 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5ff8017360 con 0x55aa96ffb1b0 2024-09-21T07:52:58.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.890+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aa972ceb90 con 0x55aa96ffb1b0 2024-09-21T07:52:58.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.891+0000 7f5fe7e00640 1 -- 172.21.15.84:0/3541598402 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ff801e070 con 0x55aa96ffb1b0 2024-09-21T07:52:58.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.891+0000 7f601408a740 10 client.26267 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:58.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.891+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aa972e9950 con 0x55aa96ffb1b0 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.892+0000 7f5fe7e00640 1 -- 172.21.15.84:0/3541598402 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aa972ceb90 con 0x55aa96ffb1b0 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.893+0000 7f5fe7e00640 1 -- 172.21.15.84:0/3541598402 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5ff80abba0 con 0x55aa96ffb1b0 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.894+0000 7f601408a740 10 client.26267 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.894+0000 7f601408a740 10 client.26267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.894+0000 7f601408a740 20 client.26267 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.894+0000 7f601408a740 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fe29f0 0x55aa973f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.894+0000 7f601408a740 4 client.26267 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.894+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa97343f00 con 0x55aa96fe29f0 2024-09-21T07:52:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.895+0000 7f6005e00640 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fe29f0 0x55aa973f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.897+0000 7f6005e00640 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fe29f0 0x55aa973f0d60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb89ff017364dc34 server_cookie=e667673183b66aa in_seq=0 out_seq=0 2024-09-21T07:52:58.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.897+0000 7f5fe7e00640 10 client.26267 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:58.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.899+0000 7f5fe7e00640 1 -- 172.21.15.84:0/3541598402 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa97343f00 con 0x55aa96fe29f0 2024-09-21T07:52:58.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.899+0000 7f5fe7e00640 10 client.26267 handle_command_reply: tid=0 2024-09-21T07:52:58.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.899+0000 7f601408a740 1 client.26267 shutdown 2024-09-21T07:52:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.899+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 msgr2=0x55aa973d67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.899+0000 7f601408a740 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973d67b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80ac640 tx=0x7f5ff80a8e60 comp rx=0 tx=0).stop 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 shutdown_connections 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 0x55aa973eaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fe29f0 0x55aa973f0d60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 --2- 172.21.15.84:0/3541598402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973d67b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f5fe7e00640 0 client.26267 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 >> 172.21.15.84:0/3541598402 conn(0x55aa97018460 msgr2=0x55aa973cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 shutdown_connections 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.900+0000 7f601408a740 1 -- 172.21.15.84:0/3541598402 wait complete. 2024-09-21T07:52:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.901+0000 7f601408a740 20 client.26267 trim_cache size 0 max 16384 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.938+0000 7f601408a740 1 Processor -- start 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.938+0000 7f601408a740 1 -- start start 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.938+0000 7f601408a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973eae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.938+0000 7f601408a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f601408a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 0x55aa973d5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f601408a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe800fdf0 con 0x55aa97024070 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f601408a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8011930 con 0x55aa96ffb1b0 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f601408a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe80104c0 con 0x55aa97003390 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f6005e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f6006800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f6006800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973eae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43852/0 (socket says 172.21.15.84:43852) 2024-09-21T07:52:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.939+0000 7f6006800640 1 -- 172.21.15.84:0/2828163531 learned_addr learned my addr 172.21.15.84:0/2828163531 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.940+0000 7f6005e00640 1 -- 172.21.15.84:0/2828163531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 msgr2=0x55aa973eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.940+0000 7f6005e00640 1 --2- 172.21.15.84:0/2828163531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.940+0000 7f6005e00640 1 -- 172.21.15.84:0/2828163531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 msgr2=0x55aa973d5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.940+0000 7f6005e00640 1 --2- 172.21.15.84:0/2828163531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 0x55aa973d5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.940+0000 7f6005e00640 1 -- 172.21.15.84:0/2828163531 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa973d2120 con 0x55aa97003390 2024-09-21T07:52:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.943+0000 7f6005e00640 1 --2- 172.21.15.84:0/2828163531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d4e30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ff402aa30 tx=0x7f5ff40095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c466e9acef566cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.943+0000 7f5ff2a00640 1 -- 172.21.15.84:0/2828163531 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4031640 con 0x55aa97003390 2024-09-21T07:52:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.945+0000 7f5ff2a00640 1 -- 172.21.15.84:0/2828163531 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ff404a030 con 0x55aa97003390 2024-09-21T07:52:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.945+0000 7f5ff2a00640 1 -- 172.21.15.84:0/2828163531 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff403d950 con 0x55aa97003390 2024-09-21T07:52:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.946+0000 7f601408a740 1 -- 172.21.15.84:0/2828163531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 msgr2=0x55aa973d4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.946+0000 7f601408a740 1 --2- 172.21.15.84:0/2828163531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d4e30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ff402aa30 tx=0x7f5ff40095c0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.947+0000 7f601408a740 1 -- 172.21.15.84:0/2828163531 shutdown_connections 2024-09-21T07:52:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.947+0000 7f601408a740 1 --2- 172.21.15.84:0/2828163531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97024070 0x55aa973d5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.947+0000 7f601408a740 1 --2- 172.21.15.84:0/2828163531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97003390 0x55aa973d4e30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.947+0000 7f601408a740 1 --2- 172.21.15.84:0/2828163531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.947+0000 7f601408a740 1 -- 172.21.15.84:0/2828163531 >> 172.21.15.84:0/2828163531 conn(0x55aa97018460 msgr2=0x55aa973d6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.947+0000 7f601408a740 1 -- 172.21.15.84:0/2828163531 shutdown_connections 2024-09-21T07:52:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.947+0000 7f601408a740 1 -- 172.21.15.84:0/2828163531 wait complete. 2024-09-21T07:52:58.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.948+0000 7f601408a740 1 -- start start 2024-09-21T07:52:58.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.949+0000 7f601408a740 1 Processor -- start 2024-09-21T07:52:58.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.950+0000 7f601408a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.950+0000 7f601408a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97003390 0x55aa973f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.950+0000 7f6006800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.950+0000 7f6006800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43854/0 (socket says 172.21.15.84:43854) 2024-09-21T07:52:58.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.951+0000 7f601408a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa9745a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.951+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8011260 con 0x55aa97003390 2024-09-21T07:52:58.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.951+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8010b90 con 0x55aa96ffb1b0 2024-09-21T07:52:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.951+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe800ddb0 con 0x55aa97024070 2024-09-21T07:52:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.951+0000 7f6006800640 1 -- 172.21.15.84:0/2135101216 learned_addr learned my addr 172.21.15.84:0/2135101216 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.952+0000 7f601408a740 10 client.0 _ll_register_callbacks cb 0x7f5ff80ac7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:58.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.952+0000 7f6007200640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa9745a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.954+0000 7f6005e00640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97003390 0x55aa973f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.955+0000 7f6006800640 1 -- 172.21.15.84:0/2135101216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 msgr2=0x55aa9745a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:58.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.955+0000 7f6006800640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa9745a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.955+0000 7f6006800640 1 -- 172.21.15.84:0/2135101216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97003390 msgr2=0x55aa973f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:58.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.956+0000 7f6006800640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97003390 0x55aa973f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.956+0000 7f6006800640 1 -- 172.21.15.84:0/2135101216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa973f2e70 con 0x55aa96ffb1b0 2024-09-21T07:52:58.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.956+0000 7f6007200640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa9745a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:52:58.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.956+0000 7f6005e00640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97003390 0x55aa973f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:58.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.958+0000 7f6006800640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973f2090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800b470 tx=0x7f5ff80a8170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca77530a15ff7f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:58.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.958+0000 7f5fe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:52:58.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.959+0000 7f5fe7e00640 1 -- 172.21.15.84:0/2135101216 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80c7070 con 0x55aa96ffb1b0 2024-09-21T07:52:58.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.959+0000 7f5fe7e00640 1 -- 172.21.15.84:0/2135101216 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5ff80e44c0 con 0x55aa96ffb1b0 2024-09-21T07:52:58.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.960+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ff404a030 con 0x55aa96ffb1b0 2024-09-21T07:52:58.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.962+0000 7f5fe7e00640 1 -- 172.21.15.84:0/2135101216 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ff8097070 con 0x55aa96ffb1b0 2024-09-21T07:52:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.963+0000 7f601408a740 10 client.26273 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.963+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aa973f2e70 con 0x55aa96ffb1b0 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f5fe7e00640 1 -- 172.21.15.84:0/2135101216 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ff404a030 con 0x55aa96ffb1b0 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f5fe7e00640 1 -- 172.21.15.84:0/2135101216 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5ff80ab610 con 0x55aa96ffb1b0 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f601408a740 10 client.26273 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f601408a740 10 client.26273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f601408a740 20 client.26273 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f601408a740 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fb7da0 0x55aa9745dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f601408a740 4 client.26273 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa9733f9b0 con 0x55aa96fb7da0 2024-09-21T07:52:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.964+0000 7f6005e00640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fb7da0 0x55aa9745dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.965+0000 7f6005e00640 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fb7da0 0x55aa9745dea0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4b381ddf76c8d server_cookie=13e204ace7ba370e in_seq=0 out_seq=0 2024-09-21T07:52:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.965+0000 7f5fe7e00640 10 client.26273 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.966+0000 7f5fe7e00640 1 -- 172.21.15.84:0/2135101216 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa9733f9b0 con 0x55aa96fb7da0 2024-09-21T07:52:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.966+0000 7f5fe7e00640 10 client.26273 handle_command_reply: tid=0 2024-09-21T07:52:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.966+0000 7f601408a740 1 client.26273 shutdown 2024-09-21T07:52:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.966+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 msgr2=0x55aa973f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.966+0000 7f601408a740 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973f2090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800b470 tx=0x7f5ff80a8170 comp rx=0 tx=0).stop 2024-09-21T07:52:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.967+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 shutdown_connections 2024-09-21T07:52:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.967+0000 7f601408a740 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55aa96fb7da0 0x55aa9745dea0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.967+0000 7f601408a740 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa97024070 0x55aa9745a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.967+0000 7f5fe7e00640 0 client.26273 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.967+0000 7f601408a740 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa97003390 0x55aa973f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.967+0000 7f601408a740 1 --2- 172.21.15.84:0/2135101216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa96ffb1b0 0x55aa973f2090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.967+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 >> 172.21.15.84:0/2135101216 conn(0x55aa97018460 msgr2=0x55aa973d6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.968+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 shutdown_connections 2024-09-21T07:52:58.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.969+0000 7f601408a740 1 -- 172.21.15.84:0/2135101216 wait complete. 2024-09-21T07:52:58.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.969+0000 7f601408a740 20 client.26273 trim_cache size 0 max 16384 2024-09-21T07:52:58.971 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:52:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.970+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5fec0b6780 msgr2=0x7f5fec0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.970+0000 7f600d400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5fec0b6780 0x7f5fec0b8c90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6000005c40 tx=0x7f6000005bd0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.970+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008103b60 msgr2=0x7f600819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.970+0000 7f600d400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008103b60 0x7f600819c6d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800b4a0 tx=0x7f5ff800b960 comp rx=0 tx=0).stop 2024-09-21T07:52:58.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.971+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 shutdown_connections 2024-09-21T07:52:58.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.971+0000 7f600d400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5fec0b6780 0x7f5fec0b8c90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.971+0000 7f600d400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6008109df0 0x7f60081a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.971+0000 7f600d400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60081094a0 0x7f600819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.971+0000 7f600d400640 1 --2- 172.21.15.84:0/2568907390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6008103b60 0x7f600819c6d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.971+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 >> 172.21.15.84:0/2568907390 conn(0x7f600807b850 msgr2=0x7f60081072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.973+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 shutdown_connections 2024-09-21T07:52:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:52:58.973+0000 7f600d400640 1 -- 172.21.15.84:0/2568907390 wait complete. 2024-09-21T07:52:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.382+0000 7f0304e00640 1 -- 172.21.15.84:0/3107640244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0300116510 msgr2=0x7f0300118930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.382+0000 7f0304e00640 1 --2- 172.21.15.84:0/3107640244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0300116510 0x7f0300118930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009860 tx=0x7f02f002a380 comp rx=0 tx=0).stop 2024-09-21T07:52:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.382+0000 7f0304e00640 1 -- 172.21.15.84:0/3107640244 shutdown_connections 2024-09-21T07:52:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.382+0000 7f0304e00640 1 --2- 172.21.15.84:0/3107640244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0300116510 0x7f0300118930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.382+0000 7f0304e00640 1 --2- 172.21.15.84:0/3107640244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f030010ad10 0x7f0300115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.382+0000 7f0304e00640 1 --2- 172.21.15.84:0/3107640244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f030010a3c0 0x7f030010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.382+0000 7f0304e00640 1 -- 172.21.15.84:0/3107640244 >> 172.21.15.84:0/3107640244 conn(0x7f0300070c00 msgr2=0x7f0300071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.384+0000 7f0304e00640 1 -- 172.21.15.84:0/3107640244 shutdown_connections 2024-09-21T07:52:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.384+0000 7f0304e00640 1 -- 172.21.15.84:0/3107640244 wait complete. 2024-09-21T07:52:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.386+0000 7f0304e00640 1 Processor -- start 2024-09-21T07:52:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.386+0000 7f0304e00640 1 -- start start 2024-09-21T07:52:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.387+0000 7f0304e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f030010ad10 0x7f03001a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.387+0000 7f0304e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0300116510 0x7f03001a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.387+0000 7f0304e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03001aa630 0x7f03001aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.387+0000 7f0304e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f030011c0c0 con 0x7f03001aa630 2024-09-21T07:52:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.387+0000 7f0304e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f030011bf40 con 0x7f0300116510 2024-09-21T07:52:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.387+0000 7f0304e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f030011c240 con 0x7f030010ad10 2024-09-21T07:52:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.388+0000 7f02ff400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f030010ad10 0x7f03001a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.388+0000 7f02ff400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f030010ad10 0x7f03001a4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39754/0 (socket says 172.21.15.84:39754) 2024-09-21T07:52:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.388+0000 7f02ff400640 1 -- 172.21.15.84:0/3220778459 learned_addr learned my addr 172.21.15.84:0/3220778459 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.389+0000 7f02fea00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0300116510 0x7f03001a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.389+0000 7f02ff400640 1 -- 172.21.15.84:0/3220778459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0300116510 msgr2=0x7f03001a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.389+0000 7f02ff400640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0300116510 0x7f03001a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.389+0000 7f02ff400640 1 -- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03001aa630 msgr2=0x7f03001aaa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:52:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.389+0000 7f02ff400640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03001aa630 0x7f03001aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.389+0000 7f02ff400640 1 -- 172.21.15.84:0/3220778459 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03001ab140 con 0x7f030010ad10 2024-09-21T07:52:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.389+0000 7f02ff400640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f030010ad10 0x7f03001a4e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b430 tx=0x7f02ec00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.390+0000 7f02f7e00640 1 -- 172.21.15.84:0/3220778459 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec015020 con 0x7f030010ad10 2024-09-21T07:52:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.390+0000 7f02f7e00640 1 -- 172.21.15.84:0/3220778459 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ec011ce0 con 0x7f030010ad10 2024-09-21T07:52:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.390+0000 7f02f7e00640 1 -- 172.21.15.84:0/3220778459 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec010dc0 con 0x7f030010ad10 2024-09-21T07:52:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.390+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03001ab430 con 0x7f030010ad10 2024-09-21T07:52:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.390+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03001b1ab0 con 0x7f030010ad10 2024-09-21T07:52:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.395+0000 7f030d622740 1 Processor -- start 2024-09-21T07:52:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.395+0000 7f030d622740 1 -- start start 2024-09-21T07:52:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.395+0000 7f02f7e00640 1 -- 172.21.15.84:0/3220778459 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f02ec018020 con 0x7f030010ad10 2024-09-21T07:52:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.396+0000 7f030d622740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca851b0 0x55d3bce32620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.396+0000 7f030d622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce32b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f02ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca851b0 0x55d3bce32620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f02ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca851b0 0x55d3bce32620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39764/0 (socket says 172.21.15.84:39764) 2024-09-21T07:52:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f02ffe00640 1 -- 172.21.15.84:0/3256493799 learned_addr learned my addr 172.21.15.84:0/3256493799 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f030d622740 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d3bcd9f6b0 con 0x55d3bca644d0 2024-09-21T07:52:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d3bcd8eae0 con 0x55d3bca5c2f0 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d3bcd928f0 con 0x55d3bca851b0 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f02ff400640 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce32b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.397+0000 7f02f7e00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02e40b6780 0x7f02e40b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02ff400640 1 -- 172.21.15.84:0/3256493799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca851b0 msgr2=0x55d3bce32620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02ff400640 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca851b0 0x55d3bce32620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02ff400640 1 -- 172.21.15.84:0/3256493799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 msgr2=0x55d3bce330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02ff400640 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02ff400640 1 -- 172.21.15.84:0/3256493799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3bcd5b780 con 0x55d3bca5c2f0 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02ffe00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02e40b6780 0x7f02e40b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02ff400640 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce32b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0e45b0 tx=0x7f02ec0ac720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c40067aadd49840 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02f4c00640 1 -- 172.21.15.84:0/3256493799 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0bfde0 con 0x55d3bca5c2f0 2024-09-21T07:52:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02f4c00640 1 -- 172.21.15.84:0/3256493799 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ec00ac50 con 0x55d3bca5c2f0 2024-09-21T07:52:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02f4c00640 1 -- 172.21.15.84:0/3256493799 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0c35c0 con 0x55d3bca5c2f0 2024-09-21T07:52:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.398+0000 7f02f7e00640 1 -- 172.21.15.84:0/3220778459 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f02ec0e7200 con 0x7f030010ad10 2024-09-21T07:52:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.402+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 msgr2=0x55d3bce32b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.402+0000 7f030d622740 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce32b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0e45b0 tx=0x7f02ec0ac720 comp rx=0 tx=0).stop 2024-09-21T07:52:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.402+0000 7f02ffe00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02e40b6780 0x7f02e40b8c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f02f0005eb0 tx=0x7f02f00094b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.407+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 shutdown_connections 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.407+0000 7f030d622740 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.407+0000 7f030d622740 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce32b60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.407+0000 7f030d622740 1 --2- 172.21.15.84:0/3256493799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca851b0 0x55d3bce32620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.407+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 >> 172.21.15.84:0/3256493799 conn(0x55d3bca79300 msgr2=0x55d3bce30510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.407+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 shutdown_connections 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.407+0000 7f030d622740 1 -- 172.21.15.84:0/3256493799 wait complete. 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.408+0000 7f030d622740 1 -- start start 2024-09-21T07:52:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.409+0000 7f030d622740 1 Processor -- start 2024-09-21T07:52:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.410+0000 7f030d622740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.410+0000 7f030d622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca644d0 0x55d3bce3e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.410+0000 7f030d622740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca851b0 0x55d3bce3e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.410+0000 7f030d622740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d3bccc6ab0 con 0x55d3bca851b0 2024-09-21T07:52:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.410+0000 7f030d622740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d3bcd35570 con 0x55d3bca644d0 2024-09-21T07:52:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.410+0000 7f030d622740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d3bce40d40 con 0x55d3bca5c2f0 2024-09-21T07:52:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.410+0000 7f030d622740 10 client.0 _ll_register_callbacks cb 0x55d3bcd44100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39780/0 (socket says 172.21.15.84:39780) 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 -- 172.21.15.84:0/1949623591 learned_addr learned my addr 172.21.15.84:0/1949623591 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 -- 172.21.15.84:0/1949623591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca644d0 msgr2=0x55d3bce3e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca644d0 0x55d3bce3e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 -- 172.21.15.84:0/1949623591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca851b0 msgr2=0x55d3bce3e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca851b0 0x55d3bce3e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 -- 172.21.15.84:0/1949623591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3bcaf0790 con 0x55d3bca5c2f0 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02ff400640 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3dc50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0a92b0 tx=0x7f02ec010640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d35db29a0b7dd7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.411+0000 7f02e9600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.412+0000 7f02e9600640 1 -- 172.21.15.84:0/1949623591 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0c3790 con 0x55d3bca5c2f0 2024-09-21T07:52:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.412+0000 7f02e9600640 1 -- 172.21.15.84:0/1949623591 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f02ec04e5b0 con 0x55d3bca5c2f0 2024-09-21T07:52:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.412+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02ec00ac50 con 0x55d3bca5c2f0 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.413+0000 7f02e9600640 1 -- 172.21.15.84:0/1949623591 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f02ec0c40a0 con 0x55d3bca5c2f0 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.413+0000 7f030d622740 10 client.26284 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.413+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d3bcb69620 con 0x55d3bca5c2f0 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.413+0000 7f02e9600640 1 -- 172.21.15.84:0/1949623591 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ec00ac50 con 0x55d3bca5c2f0 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.413+0000 7f02e9600640 1 -- 172.21.15.84:0/1949623591 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f02ec0e4860 con 0x55d3bca5c2f0 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.414+0000 7f030d622740 10 client.26284 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.414+0000 7f030d622740 10 client.26284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.414+0000 7f030d622740 20 client.26284 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.414+0000 7f030d622740 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca43d80 0x55d3bce4fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.414+0000 7f030d622740 4 client.26284 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:52:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.414+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3bcda1600 con 0x55d3bca43d80 2024-09-21T07:52:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.415+0000 7f02fea00640 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca43d80 0x55d3bce4fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.422+0000 7f02fea00640 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca43d80 0x55d3bce4fae0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30ce690c3b6c36d4 server_cookie=ecc7148851118df8 in_seq=0 out_seq=0 2024-09-21T07:52:59.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.422+0000 7f02e9600640 10 client.26284 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.423+0000 7f02e9600640 1 -- 172.21.15.84:0/1949623591 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3bcda1600 con 0x55d3bca43d80 2024-09-21T07:52:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.423+0000 7f02e9600640 10 client.26284 handle_command_reply: tid=0 2024-09-21T07:52:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.423+0000 7f030d622740 1 client.26284 shutdown 2024-09-21T07:52:59.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.424+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca5c2f0 msgr2=0x55d3bce3dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.424+0000 7f030d622740 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3dc50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0a92b0 tx=0x7f02ec010640 comp rx=0 tx=0).stop 2024-09-21T07:52:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.424+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 shutdown_connections 2024-09-21T07:52:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.424+0000 7f030d622740 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca851b0 0x55d3bce3e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.424+0000 7f030d622740 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca644d0 0x55d3bce3e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.424+0000 7f030d622740 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca43d80 0x55d3bce4fae0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.424+0000 7f02e9600640 0 client.26284 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.425+0000 7f030d622740 1 --2- 172.21.15.84:0/1949623591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3dc50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.425+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 >> 172.21.15.84:0/1949623591 conn(0x55d3bca79300 msgr2=0x55d3bce33650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.425+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 shutdown_connections 2024-09-21T07:52:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.426+0000 7f030d622740 1 -- 172.21.15.84:0/1949623591 wait complete. 2024-09-21T07:52:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.428+0000 7f030d622740 20 client.26284 trim_cache size 0 max 16384 2024-09-21T07:52:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.468+0000 7f030d622740 1 Processor -- start 2024-09-21T07:52:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.468+0000 7f030d622740 1 -- start start 2024-09-21T07:52:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.469+0000 7f030d622740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca43d80 0x55d3bce304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.469+0000 7f030d622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.469+0000 7f030d622740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce3b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.470+0000 7f02ff400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca43d80 0x55d3bce304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.470+0000 7f02ff400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca43d80 0x55d3bce304f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39796/0 (socket says 172.21.15.84:39796) 2024-09-21T07:52:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.470+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03001b7710 con 0x55d3bca644d0 2024-09-21T07:52:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.470+0000 7f02ff400640 1 -- 172.21.15.84:0/803286615 learned_addr learned my addr 172.21.15.84:0/803286615 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.470+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03001b9250 con 0x55d3bca5c2f0 2024-09-21T07:52:59.473 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.470+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f03001b7de0 con 0x55d3bca43d80 2024-09-21T07:52:59.474 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.470+0000 7f02fea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.474 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.472+0000 7f02ffe00640 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce3b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.474 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.473+0000 7f02ff400640 1 -- 172.21.15.84:0/803286615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 msgr2=0x55d3bce3ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.473+0000 7f02ff400640 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.473+0000 7f02ff400640 1 -- 172.21.15.84:0/803286615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 msgr2=0x55d3bce3b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:52:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.473+0000 7f02ff400640 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce3b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.475 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.474+0000 7f02ff400640 1 -- 172.21.15.84:0/803286615 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3bce27370 con 0x55d3bca43d80 2024-09-21T07:52:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.474+0000 7f02ffe00640 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce3b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:52:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.475+0000 7f02ff400640 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca43d80 0x55d3bce304f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0ac990 tx=0x7f02ec0e7170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed50c2eded1be85c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.475+0000 7f02ebe00640 1 -- 172.21.15.84:0/803286615 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0c4290 con 0x55d3bca43d80 2024-09-21T07:52:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.475+0000 7f02ebe00640 1 -- 172.21.15.84:0/803286615 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ec0c0020 con 0x55d3bca43d80 2024-09-21T07:52:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.475+0000 7f02ebe00640 1 -- 172.21.15.84:0/803286615 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0c4480 con 0x55d3bca43d80 2024-09-21T07:52:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.476+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca43d80 msgr2=0x55d3bce304f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.476+0000 7f030d622740 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca43d80 0x55d3bce304f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0ac990 tx=0x7f02ec0e7170 comp rx=0 tx=0).stop 2024-09-21T07:52:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.478+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 shutdown_connections 2024-09-21T07:52:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.478+0000 7f030d622740 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca644d0 0x55d3bce3b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.478+0000 7f030d622740 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce3ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.478+0000 7f030d622740 1 --2- 172.21.15.84:0/803286615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca43d80 0x55d3bce304f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.478+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 >> 172.21.15.84:0/803286615 conn(0x55d3bca79300 msgr2=0x55d3bce2fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.480+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 shutdown_connections 2024-09-21T07:52:59.482 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.480+0000 7f030d622740 1 -- 172.21.15.84:0/803286615 wait complete. 2024-09-21T07:52:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.481+0000 7f030d622740 1 -- start start 2024-09-21T07:52:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.481+0000 7f030d622740 1 Processor -- start 2024-09-21T07:52:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.482+0000 7f030d622740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca43d80 0x55d3bce52920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.482+0000 7f030d622740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce52f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.482+0000 7f030d622740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca644d0 0x55d3bceaf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.482+0000 7f030d622740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03001b8b80 con 0x55d3bca43d80 2024-09-21T07:52:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.482+0000 7f030d622740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03001b84b0 con 0x55d3bca5c2f0 2024-09-21T07:52:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.482+0000 7f030d622740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f03001b5710 con 0x55d3bca644d0 2024-09-21T07:52:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.482+0000 7f030d622740 10 client.0 _ll_register_callbacks cb 0x7f02f0035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.483+0000 7f02ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca644d0 0x55d3bceaf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.483+0000 7f02ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca644d0 0x55d3bceaf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39798/0 (socket says 172.21.15.84:39798) 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.483+0000 7f02ffe00640 1 -- 172.21.15.84:0/66189670 learned_addr learned my addr 172.21.15.84:0/66189670 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02ffe00640 1 -- 172.21.15.84:0/66189670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 msgr2=0x55d3bce52f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02ffe00640 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce52f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02ffe00640 1 -- 172.21.15.84:0/66189670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca43d80 msgr2=0x55d3bce52920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02ffe00640 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca43d80 0x55d3bce52920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02ffe00640 1 -- 172.21.15.84:0/66189670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3bceafad0 con 0x55d3bca644d0 2024-09-21T07:52:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02ffe00640 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca644d0 0x55d3bceaf430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009860 tx=0x7f02f0030340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc9b8c321db7f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:52:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02e9600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.484+0000 7f02e9600640 1 -- 172.21.15.84:0/66189670 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f004f060 con 0x55d3bca644d0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.485+0000 7f02e9600640 1 -- 172.21.15.84:0/66189670 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f02f0005250 con 0x55d3bca644d0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.485+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02ec0c0020 con 0x55d3bca644d0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.485+0000 7f02e9600640 1 -- 172.21.15.84:0/66189670 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f02f0037040 con 0x55d3bca644d0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.485+0000 7f030d622740 10 client.26290 fetch_fsmap learned FSMap version 29 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.485+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d3bceba0a0 con 0x55d3bca644d0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f02e9600640 1 -- 172.21.15.84:0/66189670 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ec0c0020 con 0x55d3bca644d0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f02e9600640 1 -- 172.21.15.84:0/66189670 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f02f00035f0 con 0x55d3bca644d0 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f030d622740 10 client.26290 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f030d622740 10 client.26290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:52:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f030d622740 20 client.26290 populate_metadata read hostname 'smithi084' 2024-09-21T07:52:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f030d622740 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca851b0 0x55d3bcebc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:52:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f030d622740 4 client.26290 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:52:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d3bcd9d0b0 con 0x55d3bca851b0 2024-09-21T07:52:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.486+0000 7f02ff400640 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca851b0 0x55d3bcebc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:52:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.487+0000 7f02ff400640 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca851b0 0x55d3bcebc7f0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd2768c9d8077e4 server_cookie=dafae81f3152a8b7 in_seq=0 out_seq=0 2024-09-21T07:52:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.487+0000 7f02e9600640 10 client.26290 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.515+0000 7f02e9600640 1 -- 172.21.15.84:0/66189670 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d3bcd9d0b0 con 0x55d3bca851b0 2024-09-21T07:52:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.515+0000 7f02e9600640 10 client.26290 handle_command_reply: tid=0 2024-09-21T07:52:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.515+0000 7f030d622740 1 client.26290 shutdown 2024-09-21T07:52:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.516+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca644d0 msgr2=0x55d3bceaf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.516+0000 7f030d622740 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca644d0 0x55d3bceaf430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009860 tx=0x7f02f0030340 comp rx=0 tx=0).stop 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.517+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 shutdown_connections 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.517+0000 7f030d622740 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3bca851b0 0x55d3bcebc7f0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.517+0000 7f030d622740 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3bca644d0 0x55d3bceaf430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.517+0000 7f030d622740 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3bca5c2f0 0x55d3bce52f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.517+0000 7f030d622740 1 --2- 172.21.15.84:0/66189670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3bca43d80 0x55d3bce52920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.517+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 >> 172.21.15.84:0/66189670 conn(0x55d3bca79300 msgr2=0x55d3bce26360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:59.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.517+0000 7f02e9600640 0 client.26290 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:52:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.518+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 shutdown_connections 2024-09-21T07:52:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.518+0000 7f030d622740 1 -- 172.21.15.84:0/66189670 wait complete. 2024-09-21T07:52:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.518+0000 7f030d622740 20 client.26290 trim_cache size 0 max 16384 2024-09-21T07:52:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:52:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:52:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:52:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:52:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.521+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02e40b6780 msgr2=0x7f02e40b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.521+0000 7f0304e00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02e40b6780 0x7f02e40b8c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f02f0005eb0 tx=0x7f02f00094b0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.521+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f030010ad10 msgr2=0x7f03001a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:52:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.521+0000 7f0304e00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f030010ad10 0x7f03001a4e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b430 tx=0x7f02ec00b8f0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 shutdown_connections 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02e40b6780 0x7f02e40b8c90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03001aa630 0x7f03001aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0300116510 0x7f03001a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 --2- 172.21.15.84:0/3220778459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f030010ad10 0x7f03001a4e00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 >> 172.21.15.84:0/3220778459 conn(0x7f0300070c00 msgr2=0x7f0300072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 shutdown_connections 2024-09-21T07:52:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:52:59.522+0000 7f0304e00640 1 -- 172.21.15.84:0/3220778459 wait complete. 2024-09-21T07:53:01.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:01 smithi191 ceph-mon[34667]: pgmap v451: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 293 MiB/s wr, 286 op/s 2024-09-21T07:53:01.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:01 smithi084 ceph-mon[30411]: pgmap v451: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 293 MiB/s wr, 286 op/s 2024-09-21T07:53:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:01 smithi162 ceph-mon[34833]: pgmap v451: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 293 MiB/s wr, 286 op/s 2024-09-21T07:53:02.595 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:53:02.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:53:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:03.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:03 smithi191 ceph-mon[34667]: pgmap v452: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 260 MiB/s wr, 462 op/s 2024-09-21T07:53:03.540 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:03 smithi084 ceph-mon[30411]: pgmap v452: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 260 MiB/s wr, 462 op/s 2024-09-21T07:53:03.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:03 smithi162 ceph-mon[34833]: pgmap v452: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 260 MiB/s wr, 462 op/s 2024-09-21T07:53:04.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 -- 172.21.15.84:0/346117485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df8109e10 msgr2=0x7f7df8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 --2- 172.21.15.84:0/346117485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df8109e10 0x7f7df8110640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009ca0 tx=0x7f7df402a8d0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 -- 172.21.15.84:0/346117485 shutdown_connections 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 --2- 172.21.15.84:0/346117485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df8109e10 0x7f7df8110640 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 --2- 172.21.15.84:0/346117485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7df81094c0 0x7f7df81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 --2- 172.21.15.84:0/346117485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df8103b80 0x7f7df8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 -- 172.21.15.84:0/346117485 >> 172.21.15.84:0/346117485 conn(0x7f7df80ff590 msgr2=0x7f7df81019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 -- 172.21.15.84:0/346117485 shutdown_connections 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.868+0000 7f7e00800640 1 -- 172.21.15.84:0/346117485 wait complete. 2024-09-21T07:53:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.870+0000 7f7e00800640 1 Processor -- start 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.870+0000 7f7e00800640 1 -- start start 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.873+0000 7f7e00800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7df8103b80 0x7f7df8074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.873+0000 7f7e00800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df81094c0 0x7f7df806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.873+0000 7f7e00800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df8109e10 0x7f7df806e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.873+0000 7f7e00800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8113b60 con 0x7f7df8103b80 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7e00800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81139e0 con 0x7f7df8109e10 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7e00800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8113ce0 con 0x7f7df81094c0 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df81094c0 0x7f7df806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df81094c0 0x7f7df806e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39806/0 (socket says 172.21.15.84:39806) 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 -- 172.21.15.84:0/461078402 learned_addr learned my addr 172.21.15.84:0/461078402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfde00640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7df8103b80 0x7f7df8074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfe800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df8109e10 0x7f7df806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 -- 172.21.15.84:0/461078402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df8109e10 msgr2=0x7f7df806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df8109e10 0x7f7df806e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 -- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7df8103b80 msgr2=0x7f7df8074e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7df8103b80 0x7f7df8074e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfd400640 1 -- 172.21.15.84:0/461078402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df806ee50 con 0x7f7df81094c0 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfe800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df8109e10 0x7f7df806e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.874+0000 7f7dfde00640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7df8103b80 0x7f7df8074e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.875+0000 7f7dfd400640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df81094c0 0x7f7df806e0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7de8006fd0 tx=0x7f7de800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.876+0000 7f7df2a00640 1 -- 172.21.15.84:0/461078402 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8011830 con 0x7f7df81094c0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.876+0000 7f7df2a00640 1 -- 172.21.15.84:0/461078402 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7de8016070 con 0x7f7df81094c0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.876+0000 7f7df2a00640 1 -- 172.21.15.84:0/461078402 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8010e00 con 0x7f7df81094c0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.876+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df8073af0 con 0x7f7df81094c0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.876+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df8073fe0 con 0x7f7df81094c0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.882+0000 7f7df2a00640 1 -- 172.21.15.84:0/461078402 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7de801b460 con 0x7f7df81094c0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.883+0000 7f7e07428740 1 Processor -- start 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.885+0000 7f7e07428740 1 -- start start 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.885+0000 7f7df2a00640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7de00b6780 0x7f7de00b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.885+0000 7f7df2a00640 1 -- 172.21.15.84:0/461078402 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7de80e7020 con 0x7f7df81094c0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.886+0000 7f7dfe800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7de00b6780 0x7f7de00b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.886+0000 7f7e07428740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x56185097fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.886+0000 7f7e07428740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850980250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.886+0000 7f7e07428740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x561850980790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.886+0000 7f7e07428740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5618508f5e90 con 0x5618505af490 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.886+0000 7f7e07428740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5618508e52c0 con 0x5618505b7670 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.886+0000 7f7e07428740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5618508e90d0 con 0x5618505d8350 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.887+0000 7f7dfe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x561850980790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.887+0000 7f7dfe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x561850980790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43934/0 (socket says 172.21.15.84:43934) 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.887+0000 7f7dfe800640 1 -- 172.21.15.84:0/1966104663 learned_addr learned my addr 172.21.15.84:0/1966104663 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.887+0000 7f7dfd400640 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850980250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.888+0000 7f7dfe800640 1 -- 172.21.15.84:0/1966104663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 msgr2=0x56185097fd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.888+0000 7f7dfe800640 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x56185097fd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.888+0000 7f7dfe800640 1 -- 172.21.15.84:0/1966104663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 msgr2=0x561850980250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.888+0000 7f7dfe800640 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850980250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.888+0000 7f7dfe800640 1 -- 172.21.15.84:0/1966104663 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561850643930 con 0x5618505b7670 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.888+0000 7f7dfe800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7de00b6780 0x7f7de00b8c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7df4031be0 tx=0x7f7df4031c10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.888+0000 7f7dfe800640 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x561850980790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7df4031c80 tx=0x7f7df4048000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1cbd1b89146f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:04.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.889+0000 7f7de7000640 1 -- 172.21.15.84:0/1966104663 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df403f070 con 0x5618505b7670 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.889+0000 7f7de7000640 1 -- 172.21.15.84:0/1966104663 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7df4036050 con 0x5618505b7670 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.889+0000 7f7de7000640 1 -- 172.21.15.84:0/1966104663 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df402f820 con 0x5618505b7670 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.891+0000 7f7e07428740 1 -- 172.21.15.84:0/1966104663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 msgr2=0x561850980790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.891+0000 7f7e07428740 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x561850980790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7df4031c80 tx=0x7f7df4048000 comp rx=0 tx=0).stop 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.891+0000 7f7e07428740 1 -- 172.21.15.84:0/1966104663 shutdown_connections 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.891+0000 7f7e07428740 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x561850980790 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.891+0000 7f7e07428740 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850980250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.891+0000 7f7e07428740 1 --2- 172.21.15.84:0/1966104663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x56185097fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.891+0000 7f7e07428740 1 -- 172.21.15.84:0/1966104663 >> 172.21.15.84:0/1966104663 conn(0x5618505cc740 msgr2=0x56185097dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.892+0000 7f7e07428740 1 -- 172.21.15.84:0/1966104663 shutdown_connections 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.892+0000 7f7e07428740 1 -- 172.21.15.84:0/1966104663 wait complete. 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.893+0000 7f7e07428740 1 -- start start 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.893+0000 7f7e07428740 1 Processor -- start 2024-09-21T07:53:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.894+0000 7f7e07428740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x56185098c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.895+0000 7f7e07428740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505b7670 0x56185098ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.895+0000 7f7e07428740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 0x561850993730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.895+0000 7f7e07428740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561850746890 con 0x5618505af490 2024-09-21T07:53:04.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.895+0000 7f7e07428740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561850880160 con 0x5618505d8350 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.895+0000 7f7e07428740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56185098c400 con 0x5618505b7670 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.895+0000 7f7e07428740 10 client.0 _ll_register_callbacks cb 0x56185089ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.896+0000 7f7dfde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x56185098c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.896+0000 7f7dfd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505b7670 0x56185098ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.896+0000 7f7dfd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505b7670 0x56185098ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39818/0 (socket says 172.21.15.84:39818) 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.896+0000 7f7dfd400640 1 -- 172.21.15.84:0/2234077267 learned_addr learned my addr 172.21.15.84:0/2234077267 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.897+0000 7f7dfd400640 1 -- 172.21.15.84:0/2234077267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 msgr2=0x561850993730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.897+0000 7f7dfd400640 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 0x561850993730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.897+0000 7f7dfd400640 1 -- 172.21.15.84:0/2234077267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 msgr2=0x56185098c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:04.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.897+0000 7f7dfd400640 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x56185098c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.897+0000 7f7dfd400640 1 -- 172.21.15.84:0/2234077267 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561850993c70 con 0x5618505b7670 2024-09-21T07:53:04.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.899+0000 7f7dfd400640 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505b7670 0x56185098ce10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7de80aca90 tx=0x7f7de8010680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2aa124ccc89c7c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:04.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.899+0000 7f7ddb400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:04.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.899+0000 7f7ddb400640 1 -- 172.21.15.84:0/2234077267 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80ac610 con 0x5618505b7670 2024-09-21T07:53:04.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.899+0000 7f7ddb400640 1 -- 172.21.15.84:0/2234077267 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7de80e4680 con 0x5618505b7670 2024-09-21T07:53:04.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.900+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df4036050 con 0x5618505b7670 2024-09-21T07:53:04.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.900+0000 7f7ddb400640 1 -- 172.21.15.84:0/2234077267 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7de80e4880 con 0x5618505b7670 2024-09-21T07:53:04.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.900+0000 7f7e07428740 10 client.26299 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:04.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.900+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5618509ab630 con 0x5618505b7670 2024-09-21T07:53:04.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.900+0000 7f7ddb400640 1 -- 172.21.15.84:0/2234077267 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7df4036050 con 0x5618505b7670 2024-09-21T07:53:04.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.901+0000 7f7ddb400640 1 -- 172.21.15.84:0/2234077267 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7de80b11d0 con 0x5618505b7670 2024-09-21T07:53:04.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.902+0000 7f7e07428740 10 client.26299 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:04.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.902+0000 7f7e07428740 10 client.26299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:04.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.902+0000 7f7e07428740 20 client.26299 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:04.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.902+0000 7f7e07428740 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561850596cd0 0x5618509aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.902+0000 7f7e07428740 4 client.26299 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:04.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.902+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618508f7de0 con 0x561850596cd0 2024-09-21T07:53:04.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.903+0000 7f7dfde00640 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561850596cd0 0x5618509aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.904+0000 7f7ddb400640 10 client.26299 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:04.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.904+0000 7f7dfde00640 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561850596cd0 0x5618509aeb90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6454f7387b4d039 server_cookie=fa3535720dbe9bbd in_seq=0 out_seq=0 2024-09-21T07:53:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.905+0000 7f7ddb400640 1 -- 172.21.15.84:0/2234077267 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618508f7de0 con 0x561850596cd0 2024-09-21T07:53:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.905+0000 7f7ddb400640 10 client.26299 handle_command_reply: tid=0 2024-09-21T07:53:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 client.26299 shutdown 2024-09-21T07:53:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505b7670 msgr2=0x56185098ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505b7670 0x56185098ce10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7de80aca90 tx=0x7f7de8010680 comp rx=0 tx=0).stop 2024-09-21T07:53:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 shutdown_connections 2024-09-21T07:53:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 0x561850993730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561850596cd0 0x5618509aeb90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505b7670 0x56185098ce10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 --2- 172.21.15.84:0/2234077267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x56185098c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.906+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 >> 172.21.15.84:0/2234077267 conn(0x5618505cc740 msgr2=0x56185097c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.907+0000 7f7ddb400640 0 client.26299 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.907+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 shutdown_connections 2024-09-21T07:53:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.907+0000 7f7e07428740 1 -- 172.21.15.84:0/2234077267 wait complete. 2024-09-21T07:53:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.907+0000 7f7e07428740 20 client.26299 trim_cache size 0 max 16384 2024-09-21T07:53:04.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.949+0000 7f7e07428740 1 Processor -- start 2024-09-21T07:53:04.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.949+0000 7f7e07428740 1 -- start start 2024-09-21T07:53:04.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.950+0000 7f7e07428740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505af490 0x56185097c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.950+0000 7f7e07428740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505b7670 0x561850983e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.950+0000 7f7e07428740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 0x56185098b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.950+0000 7f7e07428740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81b73d0 con 0x5618505b7670 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.950+0000 7f7e07428740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81b8f10 con 0x5618505d8350 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.950+0000 7f7e07428740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81b7aa0 con 0x5618505af490 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505af490 0x56185097c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505af490 0x56185097c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39834/0 (socket says 172.21.15.84:39834) 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 -- 172.21.15.84:0/1350603222 learned_addr learned my addr 172.21.15.84:0/1350603222 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:04.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfe800640 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 0x56185098b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 -- 172.21.15.84:0/1350603222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 msgr2=0x56185098b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:04.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 0x56185098b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 -- 172.21.15.84:0/1350603222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505b7670 msgr2=0x561850983e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:04.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505b7670 0x561850983e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.951+0000 7f7dfde00640 1 -- 172.21.15.84:0/1350603222 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618509885a0 con 0x5618505af490 2024-09-21T07:53:04.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.952+0000 7f7dfde00640 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505af490 0x56185097c990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5618509af2f0 tx=0x7f7dec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77149ebcf9325c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:04.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.952+0000 7f7de6600640 1 -- 172.21.15.84:0/1350603222 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec01f020 con 0x5618505af490 2024-09-21T07:53:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.952+0000 7f7de6600640 1 -- 172.21.15.84:0/1350603222 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5618508f7de0 con 0x5618505af490 2024-09-21T07:53:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.952+0000 7f7de6600640 1 -- 172.21.15.84:0/1350603222 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0116a0 con 0x5618505af490 2024-09-21T07:53:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.954+0000 7f7e07428740 1 -- 172.21.15.84:0/1350603222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505af490 msgr2=0x56185097c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.954+0000 7f7e07428740 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505af490 0x56185097c990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5618509af2f0 tx=0x7f7dec004730 comp rx=0 tx=0).stop 2024-09-21T07:53:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.954+0000 7f7e07428740 1 -- 172.21.15.84:0/1350603222 shutdown_connections 2024-09-21T07:53:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.954+0000 7f7e07428740 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505d8350 0x56185098b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.954+0000 7f7e07428740 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505b7670 0x561850983e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.954+0000 7f7e07428740 1 --2- 172.21.15.84:0/1350603222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505af490 0x56185097c990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.954+0000 7f7e07428740 1 -- 172.21.15.84:0/1350603222 >> 172.21.15.84:0/1350603222 conn(0x5618505cc740 msgr2=0x56185097c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:04.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.956+0000 7f7e07428740 1 -- 172.21.15.84:0/1350603222 shutdown_connections 2024-09-21T07:53:04.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.956+0000 7f7e07428740 1 -- 172.21.15.84:0/1350603222 wait complete. 2024-09-21T07:53:04.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.956+0000 7f7e07428740 1 -- start start 2024-09-21T07:53:04.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.957+0000 7f7e07428740 1 Processor -- start 2024-09-21T07:53:04.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.958+0000 7f7e07428740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850993660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.958+0000 7f7e07428740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x56185098fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.958+0000 7f7e07428740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x561850990210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7e07428740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81b8840 con 0x5618505af490 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7e07428740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81b8170 con 0x5618505b7670 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7e07428740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7df81b5390 con 0x5618505d8350 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7dfe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x561850990210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7dfe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x561850990210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39850/0 (socket says 172.21.15.84:39850) 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7dfe800640 1 -- 172.21.15.84:0/297395302 learned_addr learned my addr 172.21.15.84:0/297395302 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7dfde00640 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850993660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7e07428740 10 client.0 _ll_register_callbacks cb 0x7f7de8009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:04.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.959+0000 7f7dfd400640 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x56185098fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.960+0000 7f7dfe800640 1 -- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 msgr2=0x56185098fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:04.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.960+0000 7f7dfe800640 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x56185098fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.960+0000 7f7dfe800640 1 -- 172.21.15.84:0/297395302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 msgr2=0x561850993660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:04.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.960+0000 7f7dfe800640 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850993660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.960+0000 7f7dfe800640 1 -- 172.21.15.84:0/297395302 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561850a19560 con 0x5618505d8350 2024-09-21T07:53:04.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.960+0000 7f7ddb400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:04.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.960+0000 7f7dfe800640 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x561850990210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7df4031c80 tx=0x7f7df402fbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9e24961271b124 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:04.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.961+0000 7f7ddb400640 1 -- 172.21.15.84:0/297395302 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df403f040 con 0x5618505d8350 2024-09-21T07:53:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.964+0000 7f7ddb400640 1 -- 172.21.15.84:0/297395302 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7df40305d0 con 0x5618505d8350 2024-09-21T07:53:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.964+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5618508f7de0 con 0x5618505d8350 2024-09-21T07:53:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.964+0000 7f7ddb400640 1 -- 172.21.15.84:0/297395302 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7df40318f0 con 0x5618505d8350 2024-09-21T07:53:04.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.964+0000 7f7e07428740 10 client.26305 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.964+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561850a1a650 con 0x5618505d8350 2024-09-21T07:53:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.965+0000 7f7ddb400640 1 -- 172.21.15.84:0/297395302 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5618508f7de0 con 0x5618505d8350 2024-09-21T07:53:04.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.966+0000 7f7ddb400640 1 -- 172.21.15.84:0/297395302 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7df404a5d0 con 0x5618505d8350 2024-09-21T07:53:04.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.967+0000 7f7e07428740 10 client.26305 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:04.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.967+0000 7f7e07428740 10 client.26305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:04.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.967+0000 7f7e07428740 20 client.26305 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:04.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.967+0000 7f7e07428740 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56185056c080 0x561850a1c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:04.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.967+0000 7f7e07428740 4 client.26305 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:53:04.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.967+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618508f3890 con 0x56185056c080 2024-09-21T07:53:04.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.968+0000 7f7dfde00640 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56185056c080 0x561850a1c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:04.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.972+0000 7f7ddb400640 10 client.26305 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:04.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.972+0000 7f7dfde00640 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56185056c080 0x561850a1c890 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=300211aaefa450f9 server_cookie=9c820e53caef8c5d in_seq=0 out_seq=0 2024-09-21T07:53:04.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.974+0000 7f7ddb400640 1 -- 172.21.15.84:0/297395302 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618508f3890 con 0x56185056c080 2024-09-21T07:53:04.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.974+0000 7f7ddb400640 10 client.26305 handle_command_reply: tid=0 2024-09-21T07:53:04.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.974+0000 7f7e07428740 1 client.26305 shutdown 2024-09-21T07:53:04.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.975+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 msgr2=0x561850990210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.975+0000 7f7e07428740 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x561850990210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7df4031c80 tx=0x7f7df402fbc0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.976+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 shutdown_connections 2024-09-21T07:53:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.976+0000 7f7e07428740 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56185056c080 0x561850a1c890 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.976+0000 7f7e07428740 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618505d8350 0x561850990210 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.976+0000 7f7e07428740 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618505b7670 0x56185098fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.976+0000 7f7e07428740 1 --2- 172.21.15.84:0/297395302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618505af490 0x561850993660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.976+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 >> 172.21.15.84:0/297395302 conn(0x5618505cc740 msgr2=0x56185098b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.976+0000 7f7ddb400640 0 client.26305 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:04.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.977+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 shutdown_connections 2024-09-21T07:53:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.978+0000 7f7e07428740 1 -- 172.21.15.84:0/297395302 wait complete. 2024-09-21T07:53:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.978+0000 7f7e07428740 20 client.26305 trim_cache size 0 max 16384 2024-09-21T07:53:04.982 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:53:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:53:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "75f4a8af-c0a2-4631-8028-838e09068109", 2024-09-21T07:53:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:53:04.983 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:53:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7de00b6780 msgr2=0x7f7de00b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7de00b6780 0x7f7de00b8c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7df4031be0 tx=0x7f7df4031c10 comp rx=0 tx=0).stop 2024-09-21T07:53:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df81094c0 msgr2=0x7f7df806e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df81094c0 0x7f7df806e0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7de8006fd0 tx=0x7f7de800b8e0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 shutdown_connections 2024-09-21T07:53:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7de00b6780 0x7f7de00b8c90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df8109e10 0x7f7df806e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7df81094c0 0x7f7df806e0f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 --2- 172.21.15.84:0/461078402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7df8103b80 0x7f7df8074e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.986+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 >> 172.21.15.84:0/461078402 conn(0x7f7df80ff590 msgr2=0x7f7df8108a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.987+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 shutdown_connections 2024-09-21T07:53:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:04.987+0000 7f7e00800640 1 -- 172.21.15.84:0/461078402 wait complete. 2024-09-21T07:53:05.148 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:05 smithi084 ceph-mon[30411]: pgmap v453: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 255 MiB/s wr, 708 op/s 2024-09-21T07:53:05.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:05 smithi191 ceph-mon[34667]: pgmap v453: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 255 MiB/s wr, 708 op/s 2024-09-21T07:53:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:05 smithi162 ceph-mon[34833]: pgmap v453: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 255 MiB/s wr, 708 op/s 2024-09-21T07:53:06.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:06 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:53:06.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:06 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:06.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:06 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:53:06.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:06 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:06.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:06 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:53:06.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:06 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:06.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:06 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:53:06.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:06 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:06.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:06 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:53:06.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:06 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:06.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:06 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:53:06.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:06 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:07 smithi162 ceph-mon[34833]: pgmap v454: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 230 MiB/s wr, 853 op/s 2024-09-21T07:53:07.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:07 smithi084 ceph-mon[30411]: pgmap v454: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 230 MiB/s wr, 853 op/s 2024-09-21T07:53:07.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:07 smithi191 ceph-mon[34667]: pgmap v454: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 230 MiB/s wr, 853 op/s 2024-09-21T07:53:09.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:09 smithi162 ceph-mon[34833]: pgmap v455: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 219 MiB/s wr, 959 op/s 2024-09-21T07:53:09.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:09 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:53:09.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:09 smithi084 ceph-mon[30411]: pgmap v455: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 219 MiB/s wr, 959 op/s 2024-09-21T07:53:09.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:09 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:53:09.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:09 smithi191 ceph-mon[34667]: pgmap v455: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 219 MiB/s wr, 959 op/s 2024-09-21T07:53:09.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:09 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:53:10.015 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T07:53:10.015 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T07:53:10.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:53:10.385 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:10 smithi084 ceph-mon[30411]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 254 MiB/s wr, 1.30k op/s 2024-09-21T07:53:10.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:53:10.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:10 smithi162 ceph-mon[34833]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 254 MiB/s wr, 1.30k op/s 2024-09-21T07:53:10.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:10 smithi191 ceph-mon[34667]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 254 MiB/s wr, 1.30k op/s 2024-09-21T07:53:10.893 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.896+0000 7f9297e00640 1 -- 172.21.15.84:0/1787554991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92880308f0 con 0x7f9298102a60 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.899+0000 7f92a0200640 1 -- 172.21.15.84:0/1787554991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 msgr2=0x7f9298102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.899+0000 7f92a0200640 1 --2- 172.21.15.84:0/1787554991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f9298102e70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9288009860 tx=0x7f928802a360 comp rx=0 tx=0).stop 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.900+0000 7f92a0200640 1 -- 172.21.15.84:0/1787554991 shutdown_connections 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.900+0000 7f92a0200640 1 --2- 172.21.15.84:0/1787554991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9298108cf0 0x7f929810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.900+0000 7f92a0200640 1 --2- 172.21.15.84:0/1787554991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92981083a0 0x7f92981087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.900+0000 7f92a0200640 1 --2- 172.21.15.84:0/1787554991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f9298102e70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.900+0000 7f92a0200640 1 -- 172.21.15.84:0/1787554991 >> 172.21.15.84:0/1787554991 conn(0x7f9298079730 msgr2=0x7f9298079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.900+0000 7f92a0200640 1 -- 172.21.15.84:0/1787554991 shutdown_connections 2024-09-21T07:53:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.900+0000 7f92a0200640 1 -- 172.21.15.84:0/1787554991 wait complete. 2024-09-21T07:53:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.902+0000 7f92a0200640 1 Processor -- start 2024-09-21T07:53:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.903+0000 7f92a0200640 1 -- start start 2024-09-21T07:53:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.904+0000 7f92a0200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f92981a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.904+0000 7f92a0200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92981083a0 0x7f92981a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.905+0000 7f929d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f92981a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.905+0000 7f929d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f92981a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52324/0 (socket says 172.21.15.84:52324) 2024-09-21T07:53:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.906+0000 7f929d800640 1 -- 172.21.15.84:0/3493220313 learned_addr learned my addr 172.21.15.84:0/3493220313 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:11.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.906+0000 7f92a0200640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298108cf0 0x7f92981a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.906+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9298111860 con 0x7f9298102a60 2024-09-21T07:53:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.906+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92981116e0 con 0x7f9298108cf0 2024-09-21T07:53:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.906+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f92981119e0 con 0x7f92981083a0 2024-09-21T07:53:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.906+0000 7f929ce00640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92981083a0 0x7f92981a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.907+0000 7f929d800640 1 -- 172.21.15.84:0/3493220313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92981083a0 msgr2=0x7f92981a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.907+0000 7f929d800640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92981083a0 0x7f92981a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.907+0000 7f929d800640 1 -- 172.21.15.84:0/3493220313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298108cf0 msgr2=0x7f92981a6340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:53:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.907+0000 7f929d800640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298108cf0 0x7f92981a6340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.907+0000 7f929d800640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92981a6a70 con 0x7f9298102a60 2024-09-21T07:53:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.909+0000 7f929d800640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f92981a0b00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9288009830 tx=0x7f9288032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.909+0000 7f9296000640 1 -- 172.21.15.84:0/3493220313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288037050 con 0x7f9298102a60 2024-09-21T07:53:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.909+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92981a6d00 con 0x7f9298102a60 2024-09-21T07:53:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.910+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92981ad4c0 con 0x7f9298102a60 2024-09-21T07:53:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.910+0000 7f9296000640 1 -- 172.21.15.84:0/3493220313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9288043070 con 0x7f9298102a60 2024-09-21T07:53:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.910+0000 7f9296000640 1 -- 172.21.15.84:0/3493220313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92880308f0 con 0x7f9298102a60 2024-09-21T07:53:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.913+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9298102e70 con 0x7f9298102a60 2024-09-21T07:53:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.915+0000 7f9296000640 1 -- 172.21.15.84:0/3493220313 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9288003aa0 con 0x7f9298102a60 2024-09-21T07:53:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.916+0000 7f9296000640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92800b66f0 0x7f92800b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.917+0000 7f9296000640 1 -- 172.21.15.84:0/3493220313 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f92881081a0 con 0x7f9298102a60 2024-09-21T07:53:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.917+0000 7f929ce00640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92800b66f0 0x7f92800b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:11.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.918+0000 7f929ce00640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92800b66f0 0x7f92800b8c00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f928c0095f0 tx=0x7f928c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:11.925+0000 7f9296000640 1 -- 172.21.15.84:0/3493220313 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92880ce380 con 0x7f9298102a60 2024-09-21T07:53:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.343+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92981ad6c0 con 0x7f9298102a60 2024-09-21T07:53:12.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.344+0000 7f9296000640 1 -- 172.21.15.84:0/3493220313 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f92880d2760 con 0x7f9298102a60 2024-09-21T07:53:12.347 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:53:12.347 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:53:12.347 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.348+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92800b66f0 msgr2=0x7f92800b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.348+0000 7f92a0200640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92800b66f0 0x7f92800b8c00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f928c0095f0 tx=0x7f928c005f90 comp rx=0 tx=0).stop 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.348+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 msgr2=0x7f92981a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.348+0000 7f92a0200640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f92981a0b00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9288009830 tx=0x7f9288032d50 comp rx=0 tx=0).stop 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.349+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 shutdown_connections 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.349+0000 7f92a0200640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92800b66f0 0x7f92800b8c00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.349+0000 7f92a0200640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298108cf0 0x7f92981a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.349+0000 7f92a0200640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92981083a0 0x7f92981a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.349+0000 7f92a0200640 1 --2- 172.21.15.84:0/3493220313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9298102a60 0x7f92981a0b00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.349+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 >> 172.21.15.84:0/3493220313 conn(0x7f9298079730 msgr2=0x7f9298105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.350+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 shutdown_connections 2024-09-21T07:53:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.350+0000 7f92a0200640 1 -- 172.21.15.84:0/3493220313 wait complete. 2024-09-21T07:53:12.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.789+0000 7feec9800640 1 -- 172.21.15.84:0/1470564271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 msgr2=0x7feec40757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.789+0000 7feec9800640 1 --2- 172.21.15.84:0/1470564271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec40757b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009900 tx=0x7feeb002a400 comp rx=0 tx=0).stop 2024-09-21T07:53:12.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.789+0000 7feec9800640 1 -- 172.21.15.84:0/1470564271 shutdown_connections 2024-09-21T07:53:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.789+0000 7feec9800640 1 --2- 172.21.15.84:0/1470564271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec4114430 0x7feec4116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.789+0000 7feec9800640 1 --2- 172.21.15.84:0/1470564271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec4075dd0 0x7feec40761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.789+0000 7feec9800640 1 --2- 172.21.15.84:0/1470564271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec40757b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.789+0000 7feec9800640 1 -- 172.21.15.84:0/1470564271 >> 172.21.15.84:0/1470564271 conn(0x7feec407b850 msgr2=0x7feec407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.790+0000 7feec9800640 1 -- 172.21.15.84:0/1470564271 shutdown_connections 2024-09-21T07:53:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.790+0000 7feec9800640 1 -- 172.21.15.84:0/1470564271 wait complete. 2024-09-21T07:53:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.792+0000 7feec9800640 1 Processor -- start 2024-09-21T07:53:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.792+0000 7feec9800640 1 -- start start 2024-09-21T07:53:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec9800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec4075dd0 0x7feec41a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec9800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec41a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec4114430 0x7feec41a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec9800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feec411a0b0 con 0x7feec4114430 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec9800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feec4119f30 con 0x7feec4075dd0 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec9800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feec411a230 con 0x7feec4077380 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec41a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec41a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37810/0 (socket says 172.21.15.84:37810) 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.793+0000 7feec2000640 1 -- 172.21.15.84:0/4082596488 learned_addr learned my addr 172.21.15.84:0/4082596488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.794+0000 7feec3400640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec4114430 0x7feec41a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.794+0000 7feec2000640 1 -- 172.21.15.84:0/4082596488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec4075dd0 msgr2=0x7feec41a0a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.794+0000 7feec2000640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec4075dd0 0x7feec41a0a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.794+0000 7feec2000640 1 -- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec4114430 msgr2=0x7feec41a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.794+0000 7feec2000640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec4114430 0x7feec41a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.794+0000 7feec2000640 1 -- 172.21.15.84:0/4082596488 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec41a69b0 con 0x7feec4077380 2024-09-21T07:53:12.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.794+0000 7feec2000640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec41a0fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feeb400e9c0 tx=0x7feeb400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.795+0000 7feebb400640 1 -- 172.21.15.84:0/4082596488 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb400cd80 con 0x7feec4077380 2024-09-21T07:53:12.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.795+0000 7feebb400640 1 -- 172.21.15.84:0/4082596488 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeb40054d0 con 0x7feec4077380 2024-09-21T07:53:12.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.795+0000 7feebb400640 1 -- 172.21.15.84:0/4082596488 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4010430 con 0x7feec4077380 2024-09-21T07:53:12.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.795+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec41a6ca0 con 0x7feec4077380 2024-09-21T07:53:12.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.795+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec41ad400 con 0x7feec4077380 2024-09-21T07:53:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.801+0000 7feed04b5740 1 Processor -- start 2024-09-21T07:53:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.804+0000 7feebb400640 1 -- 172.21.15.84:0/4082596488 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7feeb4004fc0 con 0x7feec4077380 2024-09-21T07:53:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.805+0000 7feed04b5740 1 -- start start 2024-09-21T07:53:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.806+0000 7feed04b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da2cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.806+0000 7feed04b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da2d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feed04b5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da2d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.806+0000 7feec3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da2cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feed04b5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56522d9a3f70 con 0x56522d665390 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feed04b5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56522d9933a0 con 0x56522d65d1b0 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feed04b5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56522d9971b0 con 0x56522d686070 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feec3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da2cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37818/0 (socket says 172.21.15.84:37818) 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feec3400640 1 -- 172.21.15.84:0/2515441184 learned_addr learned my addr 172.21.15.84:0/2515441184 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feebb400640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feea80b6700 0x7feea80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feec2a00640 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da2d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.807+0000 7feebb400640 1 -- 172.21.15.84:0/4082596488 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7feeb40e7f00 con 0x7feec4077380 2024-09-21T07:53:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feec2a00640 1 -- 172.21.15.84:0/2515441184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 msgr2=0x56522da2cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feec2a00640 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da2cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feec2a00640 1 -- 172.21.15.84:0/2515441184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 msgr2=0x56522da2d7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feec2a00640 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da2d7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feec2a00640 1 -- 172.21.15.84:0/2515441184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56522d95dc90 con 0x56522d65d1b0 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feec3400640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feea80b6700 0x7feea80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feec2a00640 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da2d2a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feeb002a9f0 tx=0x7feeb0009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e04ddf142fad6fff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.808+0000 7feeafe00640 1 -- 172.21.15.84:0/2515441184 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb003e030 con 0x56522d65d1b0 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.809+0000 7feec3400640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feea80b6700 0x7feea80b8c10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feebc009fd0 tx=0x7feebc014040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.809+0000 7feeafe00640 1 -- 172.21.15.84:0/2515441184 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeb00035f0 con 0x56522d65d1b0 2024-09-21T07:53:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.809+0000 7feeafe00640 1 -- 172.21.15.84:0/2515441184 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0035040 con 0x56522d65d1b0 2024-09-21T07:53:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.811+0000 7feed04b5740 1 -- 172.21.15.84:0/2515441184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 msgr2=0x56522da2d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.811+0000 7feed04b5740 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da2d2a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feeb002a9f0 tx=0x7feeb0009600 comp rx=0 tx=0).stop 2024-09-21T07:53:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.811+0000 7feed04b5740 1 -- 172.21.15.84:0/2515441184 shutdown_connections 2024-09-21T07:53:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.811+0000 7feed04b5740 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da2d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.811+0000 7feed04b5740 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da2d2a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.811+0000 7feed04b5740 1 --2- 172.21.15.84:0/2515441184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da2cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.811+0000 7feed04b5740 1 -- 172.21.15.84:0/2515441184 >> 172.21.15.84:0/2515441184 conn(0x56522d67a460 msgr2=0x56522da2ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.812+0000 7feed04b5740 1 -- 172.21.15.84:0/2515441184 shutdown_connections 2024-09-21T07:53:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.813+0000 7feed04b5740 1 -- 172.21.15.84:0/2515441184 wait complete. 2024-09-21T07:53:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.814+0000 7feed04b5740 1 -- start start 2024-09-21T07:53:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.814+0000 7feed04b5740 1 Processor -- start 2024-09-21T07:53:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.816+0000 7feed04b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da38550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.816+0000 7feed04b5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da38ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.816+0000 7feec2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da38550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.816+0000 7feec2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da38550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55016/0 (socket says 172.21.15.84:55016) 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.817+0000 7feec2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da38ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.816+0000 7feed04b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.817+0000 7feec2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da38ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52354/0 (socket says 172.21.15.84:52354) 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.817+0000 7feed04b5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56522d7f4700 con 0x56522d665390 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.817+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56522d92e540 con 0x56522d65d1b0 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.817+0000 7feec2a00640 1 -- 172.21.15.84:0/2216546507 learned_addr learned my addr 172.21.15.84:0/2216546507 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.817+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56522da3b4e0 con 0x56522d686070 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.817+0000 7feec3400640 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feec2a00640 1 -- 172.21.15.84:0/2216546507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 msgr2=0x56522da447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feec2a00640 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feec2a00640 1 -- 172.21.15.84:0/2216546507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 msgr2=0x56522da38ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feec2a00640 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da38ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feec2a00640 1 -- 172.21.15.84:0/2216546507 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56522d6f1650 con 0x56522d65d1b0 2024-09-21T07:53:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feec2000640 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da38ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feec2a00640 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da38550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feeb0005ab0 tx=0x7feeb00043f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2880ec35ae2519d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.818+0000 7feeacc00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:53:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.819+0000 7feed04b5740 10 client.0 _ll_register_callbacks cb 0x56522d93e430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.819+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56522d930b50 con 0x56522d65d1b0 2024-09-21T07:53:12.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.819+0000 7feeacc00640 1 -- 172.21.15.84:0/2216546507 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb003e040 con 0x56522d65d1b0 2024-09-21T07:53:12.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.819+0000 7feeacc00640 1 -- 172.21.15.84:0/2216546507 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7feeb00037f0 con 0x56522d65d1b0 2024-09-21T07:53:12.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.819+0000 7feeacc00640 1 -- 172.21.15.84:0/2216546507 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feeb0035040 con 0x56522d65d1b0 2024-09-21T07:53:12.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.819+0000 7feed04b5740 10 client.26306 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.819+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56522d94b910 con 0x56522d65d1b0 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feeacc00640 1 -- 172.21.15.84:0/2216546507 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feeb00039f0 con 0x56522d65d1b0 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feed04b5740 10 client.26306 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feed04b5740 10 client.26306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feed04b5740 20 client.26306 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feed04b5740 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d6449f0 0x56522da4a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feed04b5740 4 client.26306 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56522d9a5ec0 con 0x56522d6449f0 2024-09-21T07:53:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.820+0000 7feec2000640 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d6449f0 0x56522da4a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.821+0000 7feeacc00640 10 client.26306 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.821+0000 7feec2000640 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d6449f0 0x56522da4a020 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce45261a827ff73b server_cookie=52af9233be923a72 in_seq=0 out_seq=0 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feeacc00640 1 -- 172.21.15.84:0/2216546507 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56522d9a5ec0 con 0x56522d6449f0 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feeacc00640 10 client.26306 handle_command_reply: tid=0 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 client.26306 shutdown 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 msgr2=0x56522da38550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da38550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feeb0005ab0 tx=0x7feeb00043f0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 shutdown_connections 2024-09-21T07:53:12.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d6449f0 0x56522da4a020 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d686070 0x56522da447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da38ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 --2- 172.21.15.84:0/2216546507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da38550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 >> 172.21.15.84:0/2216546507 conn(0x56522d67a460 msgr2=0x56522da2fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.822+0000 7feeacc00640 0 client.26306 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:12.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.823+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 shutdown_connections 2024-09-21T07:53:12.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.823+0000 7feed04b5740 1 -- 172.21.15.84:0/2216546507 wait complete. 2024-09-21T07:53:12.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.823+0000 7feed04b5740 20 client.26306 trim_cache size 0 max 16384 2024-09-21T07:53:12.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.846+0000 7feed04b5740 1 Processor -- start 2024-09-21T07:53:12.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.846+0000 7feed04b5740 1 -- start start 2024-09-21T07:53:12.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feed04b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da33d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feed04b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d665390 0x56522da30570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feed04b5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d686070 0x56522da35740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feed04b5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feec41b7240 con 0x56522d686070 2024-09-21T07:53:12.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feed04b5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feec41b8d80 con 0x56522d65d1b0 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feed04b5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feec41b7910 con 0x56522d665390 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feec2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da33d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feec2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d665390 0x56522da30570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feec2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d665390 0x56522da30570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37834/0 (socket says 172.21.15.84:37834) 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feec2000640 1 -- 172.21.15.84:0/2679910648 learned_addr learned my addr 172.21.15.84:0/2679910648 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.847+0000 7feec2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da33d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55026/0 (socket says 172.21.15.84:55026) 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec3400640 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d686070 0x56522da35740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec2000640 1 -- 172.21.15.84:0/2679910648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 msgr2=0x56522da33d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec2000640 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da33d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec2000640 1 -- 172.21.15.84:0/2679910648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d686070 msgr2=0x56522da35740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec2000640 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d686070 0x56522da35740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec2000640 1 -- 172.21.15.84:0/2679910648 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56522da395f0 con 0x56522d665390 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec2000640 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d665390 0x56522da30570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feeb40e5380 tx=0x7feeb40097a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c63c7c0a40f8d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feec3400640 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d686070 0x56522da35740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:12.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feeaf400640 1 -- 172.21.15.84:0/2679910648 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb40d10c0 con 0x56522d665390 2024-09-21T07:53:12.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feeaf400640 1 -- 172.21.15.84:0/2679910648 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeb40b2070 con 0x56522d665390 2024-09-21T07:53:12.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.848+0000 7feeaf400640 1 -- 172.21.15.84:0/2679910648 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb40b2220 con 0x56522d665390 2024-09-21T07:53:12.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.849+0000 7feed04b5740 1 -- 172.21.15.84:0/2679910648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d665390 msgr2=0x56522da30570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.849+0000 7feed04b5740 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d665390 0x56522da30570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feeb40e5380 tx=0x7feeb40097a0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 -- 172.21.15.84:0/2679910648 shutdown_connections 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d686070 0x56522da35740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d665390 0x56522da30570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 --2- 172.21.15.84:0/2679910648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d65d1b0 0x56522da33d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 -- 172.21.15.84:0/2679910648 >> 172.21.15.84:0/2679910648 conn(0x56522d67a460 msgr2=0x56522da2fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 -- 172.21.15.84:0/2679910648 shutdown_connections 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 -- 172.21.15.84:0/2679910648 wait complete. 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.850+0000 7feed04b5740 1 -- start start 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 1 Processor -- start 2024-09-21T07:53:12.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d65d1b0 0x56522da3cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da3d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d686070 0x56522dab3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feec41b86b0 con 0x56522d665390 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feec41b7fe0 con 0x56522d686070 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feec41b5200 con 0x56522d65d1b0 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.851+0000 7feed04b5740 10 client.0 _ll_register_callbacks cb 0x7feeb0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d65d1b0 0x56522da3cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d65d1b0 0x56522da3cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37840/0 (socket says 172.21.15.84:37840) 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec2a00640 1 -- 172.21.15.84:0/3687327351 learned_addr learned my addr 172.21.15.84:0/3687327351 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec3400640 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d686070 0x56522dab3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec3400640 1 -- 172.21.15.84:0/3687327351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d65d1b0 msgr2=0x56522da3cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec3400640 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d65d1b0 0x56522da3cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec3400640 1 -- 172.21.15.84:0/3687327351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 msgr2=0x56522da3d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec2000640 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da3d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec3400640 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da3d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.852+0000 7feec3400640 1 -- 172.21.15.84:0/3687327351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56522dab3f30 con 0x56522d686070 2024-09-21T07:53:12.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.853+0000 7feec3400640 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d686070 0x56522dab3970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feebc009d60 tx=0x7feebc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66601100c07c6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.853+0000 7feeacc00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.853+0000 7feeacc00640 1 -- 172.21.15.84:0/3687327351 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc02d060 con 0x56522d686070 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.853+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeb40b2070 con 0x56522d686070 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.853+0000 7feeacc00640 1 -- 172.21.15.84:0/3687327351 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7feebc01d7e0 con 0x56522d686070 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.853+0000 7feeacc00640 1 -- 172.21.15.84:0/3687327351 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feebc034050 con 0x56522d686070 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.854+0000 7feed04b5740 10 client.26312 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.854+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56522dab51e0 con 0x56522d686070 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.854+0000 7feeacc00640 1 -- 172.21.15.84:0/3687327351 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeb40b2070 con 0x56522d686070 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feeacc00640 1 -- 172.21.15.84:0/3687327351 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7feebc010b80 con 0x56522d686070 2024-09-21T07:53:12.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feed04b5740 10 client.26312 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feed04b5740 10 client.26312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feed04b5740 20 client.26312 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feed04b5740 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d619da0 0x56522dab7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feed04b5740 4 client.26312 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56522d9a1970 con 0x56522d619da0 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.855+0000 7feec2a00640 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d619da0 0x56522dab7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.856+0000 7feeacc00640 10 client.26312 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:12.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.856+0000 7feec2a00640 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d619da0 0x56522dab7920 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5200e9a8abd61eeb server_cookie=10238c195af7de14 in_seq=0 out_seq=0 2024-09-21T07:53:12.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feeacc00640 1 -- 172.21.15.84:0/3687327351 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x56522d9a1970 con 0x56522d619da0 2024-09-21T07:53:12.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feeacc00640 10 client.26312 handle_command_reply: tid=0 2024-09-21T07:53:12.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 client.26312 shutdown 2024-09-21T07:53:12.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d686070 msgr2=0x56522dab3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d686070 0x56522dab3970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feebc009d60 tx=0x7feebc004a40 comp rx=0 tx=0).stop 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 shutdown_connections 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56522d686070 0x56522dab3970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56522d665390 0x56522da3d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56522d619da0 0x56522dab7920 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 --2- 172.21.15.84:0/3687327351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56522d65d1b0 0x56522da3cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feeacc00640 0 client.26312 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.857+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 >> 172.21.15.84:0/3687327351 conn(0x56522d67a460 msgr2=0x56522da2dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.858+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 shutdown_connections 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.858+0000 7feed04b5740 1 -- 172.21.15.84:0/3687327351 wait complete. 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.858+0000 7feed04b5740 20 client.26312 trim_cache size 0 max 16384 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:53:12.861 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:12.862 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:12.863 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feea80b6700 msgr2=0x7feea80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feea80b6700 0x7feea80b8c10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feebc009fd0 tx=0x7feebc014040 comp rx=0 tx=0).stop 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 msgr2=0x7feec41a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec41a0fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feeb400e9c0 tx=0x7feeb400ee80 comp rx=0 tx=0).stop 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 shutdown_connections 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7feea80b6700 0x7feea80b8c10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec4114430 0x7feec41a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4077380 0x7feec41a0fe0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 --2- 172.21.15.84:0/4082596488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feec4075dd0 0x7feec41a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.859+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 >> 172.21.15.84:0/4082596488 conn(0x7feec407b850 msgr2=0x7feec4113040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.860+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 shutdown_connections 2024-09-21T07:53:12.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:12.860+0000 7feec9800640 1 -- 172.21.15.84:0/4082596488 wait complete. 2024-09-21T07:53:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 -- 172.21.15.84:0/3203951911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109400 msgr2=0x7f0c60109810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 --2- 172.21.15.84:0/3203951911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109400 0x7f0c60109810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009900 tx=0x7f0c4c02a420 comp rx=0 tx=0).stop 2024-09-21T07:53:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 -- 172.21.15.84:0/3203951911 shutdown_connections 2024-09-21T07:53:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 --2- 172.21.15.84:0/3203951911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c60109d50 0x7f0c60110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 --2- 172.21.15.84:0/3203951911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109400 0x7f0c60109810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 --2- 172.21.15.84:0/3203951911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 0x7f0c60103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 -- 172.21.15.84:0/3203951911 >> 172.21.15.84:0/3203951911 conn(0x7f0c600ff510 msgr2=0x7f0c60101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.958+0000 7f0c67a00640 1 -- 172.21.15.84:0/3203951911 shutdown_connections 2024-09-21T07:53:12.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.959+0000 7f0c67a00640 1 -- 172.21.15.84:0/3203951911 wait complete. 2024-09-21T07:53:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.961+0000 7f0c67a00640 1 Processor -- start 2024-09-21T07:53:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.962+0000 7f0c67a00640 1 -- start start 2024-09-21T07:53:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.963+0000 7f0c67a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 0x7f0c601991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.963+0000 7f0c67a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109d50 0x7f0c60199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.963+0000 7f0c67a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c601a0050 0x7f0c601a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.965 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.963+0000 7f0c67a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60113b20 con 0x7f0c60103ad0 2024-09-21T07:53:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.963+0000 7f0c67a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601139a0 con 0x7f0c601a0050 2024-09-21T07:53:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.963+0000 7f0c67a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60113ca0 con 0x7f0c60109d50 2024-09-21T07:53:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.963+0000 7f0c65000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 0x7f0c601991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 0x7f0c601991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52384/0 (socket says 172.21.15.84:52384) 2024-09-21T07:53:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65000640 1 -- 172.21.15.84:0/4222315668 learned_addr learned my addr 172.21.15.84:0/4222315668 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c5fe00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109d50 0x7f0c60199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65a00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c601a0050 0x7f0c601a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65000640 1 -- 172.21.15.84:0/4222315668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109d50 msgr2=0x7f0c60199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65000640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109d50 0x7f0c60199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65000640 1 -- 172.21.15.84:0/4222315668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c601a0050 msgr2=0x7f0c601a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65000640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c601a0050 0x7f0c601a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c65000640 1 -- 172.21.15.84:0/4222315668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c601a0a20 con 0x7f0c60103ad0 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.964+0000 7f0c5fe00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109d50 0x7f0c60199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.965+0000 7f0c65000640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 0x7f0c601991d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400b4a0 tx=0x7f0c5400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.965+0000 7f0c5d600640 1 -- 172.21.15.84:0/4222315668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54014070 con 0x7f0c60103ad0 2024-09-21T07:53:12.968 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.965+0000 7f0c5d600640 1 -- 172.21.15.84:0/4222315668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c54010ac0 con 0x7f0c60103ad0 2024-09-21T07:53:12.968 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.965+0000 7f0c5d600640 1 -- 172.21.15.84:0/4222315668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54017c30 con 0x7f0c60103ad0 2024-09-21T07:53:12.968 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.965+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c601a0d10 con 0x7f0c60103ad0 2024-09-21T07:53:12.968 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.966+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c601a1260 con 0x7f0c60103ad0 2024-09-21T07:53:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.970+0000 7f0c5d600640 1 -- 172.21.15.84:0/4222315668 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0c54017070 con 0x7f0c60103ad0 2024-09-21T07:53:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.972+0000 7f0c5d600640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c480b6730 0x7f0c480b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.972+0000 7f0c5d600640 1 -- 172.21.15.84:0/4222315668 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0c540e6f50 con 0x7f0c60103ad0 2024-09-21T07:53:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.973+0000 7f0c5fe00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c480b6730 0x7f0c480b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.974+0000 7f0c5fe00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c480b6730 0x7f0c480b8c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c008000 tx=0x7f0c4c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.977+0000 7f0c6ea85740 1 Processor -- start 2024-09-21T07:53:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.978+0000 7f0c6ea85740 1 -- start start 2024-09-21T07:53:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.978+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4b0d1b0 0x55dab4eb1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.980 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.978+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37866/0 (socket says 172.21.15.84:37866) 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4aec4d0 0x55dab4eb26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c5fe00640 1 -- 172.21.15.84:0/2806803568 learned_addr learned my addr 172.21.15.84:0/2806803568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dab4e276b0 con 0x55dab4b0d1b0 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dab4e16ae0 con 0x55dab4aec4d0 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dab4e1a8f0 con 0x55dab4ae42f0 2024-09-21T07:53:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.979+0000 7f0c65a00640 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4aec4d0 0x55dab4eb26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.980+0000 7f0c65a00640 1 -- 172.21.15.84:0/2806803568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 msgr2=0x55dab4eb2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.980+0000 7f0c65a00640 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.980+0000 7f0c65a00640 1 -- 172.21.15.84:0/2806803568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4b0d1b0 msgr2=0x55dab4eb1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.980+0000 7f0c65a00640 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4b0d1b0 0x55dab4eb1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.980+0000 7f0c65a00640 1 -- 172.21.15.84:0/2806803568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dab4de3780 con 0x55dab4aec4d0 2024-09-21T07:53:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.981+0000 7f0c65a00640 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4aec4d0 0x55dab4eb26b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800a400 tx=0x7f0c58009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5ebc20cbab1c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.984+0000 7f0c52000640 1 -- 172.21.15.84:0/2806803568 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58013790 con 0x55dab4aec4d0 2024-09-21T07:53:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.984+0000 7f0c52000640 1 -- 172.21.15.84:0/2806803568 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c58019070 con 0x55dab4aec4d0 2024-09-21T07:53:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.984+0000 7f0c52000640 1 -- 172.21.15.84:0/2806803568 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58014cb0 con 0x55dab4aec4d0 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4aec4d0 msgr2=0x55dab4eb26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4aec4d0 0x55dab4eb26b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800a400 tx=0x7f0c58009650 comp rx=0 tx=0).stop 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 shutdown_connections 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4aec4d0 0x55dab4eb26b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/2806803568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4b0d1b0 0x55dab4eb1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 >> 172.21.15.84:0/2806803568 conn(0x55dab4b01300 msgr2=0x55dab4eafb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 shutdown_connections 2024-09-21T07:53:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.985+0000 7f0c6ea85740 1 -- 172.21.15.84:0/2806803568 wait complete. 2024-09-21T07:53:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.986+0000 7f0c6ea85740 1 -- start start 2024-09-21T07:53:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.986+0000 7f0c6ea85740 1 Processor -- start 2024-09-21T07:53:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4ae42f0 0x55dab4ebd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ebd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4b0d1b0 0x55dab4ec96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dab4d4eab0 con 0x55dab4aec4d0 2024-09-21T07:53:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dab4dbd570 con 0x55dab4ae42f0 2024-09-21T07:53:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dab4ec03b0 con 0x55dab4b0d1b0 2024-09-21T07:53:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c6ea85740 10 client.0 _ll_register_callbacks cb 0x55dab4dcc100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c65000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4ae42f0 0x55dab4ebd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c65000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4ae42f0 0x55dab4ebd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55052/0 (socket says 172.21.15.84:55052) 2024-09-21T07:53:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.987+0000 7f0c65000640 1 -- 172.21.15.84:0/150308591 learned_addr learned my addr 172.21.15.84:0/150308591 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.988+0000 7f0c65a00640 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4b0d1b0 0x55dab4ec96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.988+0000 7f0c65a00640 1 -- 172.21.15.84:0/150308591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4ae42f0 msgr2=0x55dab4ebd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.988+0000 7f0c65a00640 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4ae42f0 0x55dab4ebd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.988+0000 7f0c65a00640 1 -- 172.21.15.84:0/150308591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 msgr2=0x55dab4ebd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.988+0000 7f0c65a00640 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ebd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.988+0000 7f0c65a00640 1 -- 172.21.15.84:0/150308591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dab4b78790 con 0x55dab4b0d1b0 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.989+0000 7f0c65a00640 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4b0d1b0 0x55dab4ec96a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009b80 tx=0x7f0c580146c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c50d2d23b3eb9160 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.989+0000 7f0c46a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.989+0000 7f0c46a00640 1 -- 172.21.15.84:0/150308591 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58013590 con 0x55dab4b0d1b0 2024-09-21T07:53:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.989+0000 7f0c46a00640 1 -- 172.21.15.84:0/150308591 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0c58013730 con 0x55dab4b0d1b0 2024-09-21T07:53:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.989+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c58019070 con 0x55dab4b0d1b0 2024-09-21T07:53:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.990+0000 7f0c46a00640 1 -- 172.21.15.84:0/150308591 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0c58013930 con 0x55dab4b0d1b0 2024-09-21T07:53:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.990+0000 7f0c6ea85740 10 client.26341 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.990+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dab4bf1620 con 0x55dab4b0d1b0 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.990+0000 7f0c46a00640 1 -- 172.21.15.84:0/150308591 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c58019070 con 0x55dab4b0d1b0 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.990+0000 7f0c46a00640 1 -- 172.21.15.84:0/150308591 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0c5801ea30 con 0x55dab4b0d1b0 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.991+0000 7f0c6ea85740 10 client.26341 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.991+0000 7f0c6ea85740 10 client.26341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.991+0000 7f0c6ea85740 20 client.26341 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.991+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4acbd80 0x55dab4ecf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.991+0000 7f0c6ea85740 4 client.26341 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.991+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dab4e29600 con 0x55dab4acbd80 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.991+0000 7f0c65000640 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4acbd80 0x55dab4ecf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:12.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.992+0000 7f0c46a00640 10 client.26341 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.992+0000 7f0c65000640 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4acbd80 0x55dab4ecf360 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81f4dd25de210e server_cookie=1cc6e25f9754eeec in_seq=0 out_seq=0 2024-09-21T07:53:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.992+0000 7f0c46a00640 1 -- 172.21.15.84:0/150308591 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dab4e29600 con 0x55dab4acbd80 2024-09-21T07:53:12.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.992+0000 7f0c46a00640 10 client.26341 handle_command_reply: tid=0 2024-09-21T07:53:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.993+0000 7f0c6ea85740 1 client.26341 shutdown 2024-09-21T07:53:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4b0d1b0 msgr2=0x55dab4ec96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4b0d1b0 0x55dab4ec96a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009b80 tx=0x7f0c580146c0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 shutdown_connections 2024-09-21T07:53:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4acbd80 0x55dab4ecf360 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4b0d1b0 0x55dab4ec96a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ebd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/150308591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4ae42f0 0x55dab4ebd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.996+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 >> 172.21.15.84:0/150308591 conn(0x55dab4b01300 msgr2=0x55dab4eb2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.997+0000 7f0c46a00640 0 client.26341 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.997+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 shutdown_connections 2024-09-21T07:53:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.997+0000 7f0c6ea85740 1 -- 172.21.15.84:0/150308591 wait complete. 2024-09-21T07:53:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:12.997+0000 7f0c6ea85740 20 client.26341 trim_cache size 0 max 16384 2024-09-21T07:53:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 Processor -- start 2024-09-21T07:53:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 -- start start 2024-09-21T07:53:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ec9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4eba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601c0360 con 0x55dab4aec4d0 2024-09-21T07:53:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601c1ea0 con 0x55dab4b0d1b0 2024-09-21T07:53:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.021+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601c0a30 con 0x55dab4ae42f0 2024-09-21T07:53:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.022+0000 7f0c65a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4eba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.022+0000 7f0c65a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4eba4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55062/0 (socket says 172.21.15.84:55062) 2024-09-21T07:53:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.022+0000 7f0c65a00640 1 -- 172.21.15.84:0/3812177002 learned_addr learned my addr 172.21.15.84:0/3812177002 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.022+0000 7f0c65000640 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.022+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ec9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.023+0000 7f0c65000640 1 -- 172.21.15.84:0/3812177002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 msgr2=0x55dab4eba4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.023+0000 7f0c65000640 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4eba4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.023+0000 7f0c65000640 1 -- 172.21.15.84:0/3812177002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 msgr2=0x55dab4ec9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.023+0000 7f0c65000640 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ec9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.023+0000 7f0c65000640 1 -- 172.21.15.84:0/3812177002 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dab4eb4a40 con 0x55dab4ae42f0 2024-09-21T07:53:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.023+0000 7f0c5fe00640 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ec9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.023+0000 7f0c65a00640 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4eba4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.024+0000 7f0c65000640 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb3370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009420 tx=0x7f0c540a92a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c994c93f69293b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.024+0000 7f0c51600640 1 -- 172.21.15.84:0/3812177002 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5401e040 con 0x55dab4ae42f0 2024-09-21T07:53:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.024+0000 7f0c51600640 1 -- 172.21.15.84:0/3812177002 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c540b6490 con 0x55dab4ae42f0 2024-09-21T07:53:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.024+0000 7f0c51600640 1 -- 172.21.15.84:0/3812177002 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5401e040 con 0x55dab4ae42f0 2024-09-21T07:53:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.025+0000 7f0c6ea85740 1 -- 172.21.15.84:0/3812177002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 msgr2=0x55dab4eb3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.026+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb3370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009420 tx=0x7f0c540a92a0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.026+0000 7f0c6ea85740 1 -- 172.21.15.84:0/3812177002 shutdown_connections 2024-09-21T07:53:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.026+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4eba4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.026+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ec9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.026+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/3812177002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4eb3370 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.026+0000 7f0c6ea85740 1 -- 172.21.15.84:0/3812177002 >> 172.21.15.84:0/3812177002 conn(0x55dab4b01300 msgr2=0x55dab4eb2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.027+0000 7f0c6ea85740 1 -- 172.21.15.84:0/3812177002 shutdown_connections 2024-09-21T07:53:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.027+0000 7f0c6ea85740 1 -- 172.21.15.84:0/3812177002 wait complete. 2024-09-21T07:53:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.027+0000 7f0c6ea85740 1 -- start start 2024-09-21T07:53:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.028+0000 7f0c6ea85740 1 Processor -- start 2024-09-21T07:53:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.028+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4ed1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ed25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c6ea85740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4f31dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601c17d0 con 0x55dab4aec4d0 2024-09-21T07:53:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601c1100 con 0x55dab4b0d1b0 2024-09-21T07:53:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c6ea85740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601be2e0 con 0x55dab4ae42f0 2024-09-21T07:53:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c6ea85740 10 client.0 _ll_register_callbacks cb 0x7f0c4c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c65000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4ed1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ed25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c65000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4ed1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37886/0 (socket says 172.21.15.84:37886) 2024-09-21T07:53:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c65000640 1 -- 172.21.15.84:0/1275368767 learned_addr learned my addr 172.21.15.84:0/1275368767 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.029+0000 7f0c65a00640 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4f31dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.030+0000 7f0c65000640 1 -- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 msgr2=0x55dab4f31dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.030+0000 7f0c65000640 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4f31dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.030+0000 7f0c65000640 1 -- 172.21.15.84:0/1275368767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 msgr2=0x55dab4ed25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.030+0000 7f0c65000640 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ed25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.030+0000 7f0c65000640 1 -- 172.21.15.84:0/1275368767 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dab4f32460 con 0x55dab4ae42f0 2024-09-21T07:53:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.030+0000 7f0c65a00640 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4f31dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.031+0000 7f0c65000640 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4ed1ff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c54017600 tx=0x7f0c5400bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dcad671e85fb9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.031+0000 7f0c46a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.031+0000 7f0c46a00640 1 -- 172.21.15.84:0/1275368767 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5401e070 con 0x55dab4ae42f0 2024-09-21T07:53:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.031+0000 7f0c46a00640 1 -- 172.21.15.84:0/1275368767 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0c540a8d90 con 0x55dab4ae42f0 2024-09-21T07:53:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.032+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c540b6490 con 0x55dab4ae42f0 2024-09-21T07:53:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.032+0000 7f0c46a00640 1 -- 172.21.15.84:0/1275368767 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0c540b10d0 con 0x55dab4ae42f0 2024-09-21T07:53:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.032+0000 7f0c6ea85740 10 client.26347 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.032+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dab4f39880 con 0x55dab4ae42f0 2024-09-21T07:53:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c46a00640 1 -- 172.21.15.84:0/1275368767 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c540b6490 con 0x55dab4ae42f0 2024-09-21T07:53:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c46a00640 1 -- 172.21.15.84:0/1275368767 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0c54096020 con 0x55dab4ae42f0 2024-09-21T07:53:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c6ea85740 10 client.26347 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c6ea85740 10 client.26347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c6ea85740 20 client.26347 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4aa11c0 0x55dab4f3bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c6ea85740 4 client.26347 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:53:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.033+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dab4ebfc40 con 0x55dab4aa11c0 2024-09-21T07:53:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.034+0000 7f0c5fe00640 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4aa11c0 0x55dab4f3bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.034+0000 7f0c5fe00640 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4aa11c0 0x55dab4f3bf80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c81e85a17748d17 server_cookie=dd68aec191b33dae in_seq=0 out_seq=0 2024-09-21T07:53:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.035+0000 7f0c46a00640 10 client.26347 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.055+0000 7f0c46a00640 1 -- 172.21.15.84:0/1275368767 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dab4ebfc40 con 0x55dab4aa11c0 2024-09-21T07:53:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.055+0000 7f0c46a00640 10 client.26347 handle_command_reply: tid=0 2024-09-21T07:53:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.055+0000 7f0c6ea85740 1 client.26347 shutdown 2024-09-21T07:53:13.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 msgr2=0x55dab4ed1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:13.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4ed1ff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c54017600 tx=0x7f0c5400bf90 comp rx=0 tx=0).stop 2024-09-21T07:53:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 shutdown_connections 2024-09-21T07:53:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dab4b0d1b0 0x55dab4f31dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dab4aec4d0 0x55dab4ed25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55dab4aa11c0 0x55dab4f3bf80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 --2- 172.21.15.84:0/1275368767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dab4ae42f0 0x55dab4ed1ff0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 >> 172.21.15.84:0/1275368767 conn(0x55dab4b01300 msgr2=0x55dab4eb2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.057+0000 7f0c46a00640 0 client.26347 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.058+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 shutdown_connections 2024-09-21T07:53:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.058+0000 7f0c6ea85740 1 -- 172.21.15.84:0/1275368767 wait complete. 2024-09-21T07:53:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.058+0000 7f0c6ea85740 20 client.26347 trim_cache size 0 max 16384 2024-09-21T07:53:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:53:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:53:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:53:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:53:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.059+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c480b6730 msgr2=0x7f0c480b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.059+0000 7f0c67a00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c480b6730 0x7f0c480b8c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c008000 tx=0x7f0c4c031400 comp rx=0 tx=0).stop 2024-09-21T07:53:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.059+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 msgr2=0x7f0c601991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.059+0000 7f0c67a00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 0x7f0c601991d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400b4a0 tx=0x7f0c5400b960 comp rx=0 tx=0).stop 2024-09-21T07:53:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 shutdown_connections 2024-09-21T07:53:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c480b6730 0x7f0c480b8c40 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c008000 tx=0x7f0c4c031400 comp rx=0 tx=0).stop 2024-09-21T07:53:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c601a0050 0x7f0c601a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c60109d50 0x7f0c60199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 --2- 172.21.15.84:0/4222315668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c60103ad0 0x7f0c601991d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 >> 172.21.15.84:0/4222315668 conn(0x7f0c600ff510 msgr2=0x7f0c600ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 shutdown_connections 2024-09-21T07:53:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:13.060+0000 7f0c67a00640 1 -- 172.21.15.84:0/4222315668 wait complete. 2024-09-21T07:53:13.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:13 smithi191 ceph-mon[34667]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 228 MiB/s wr, 1.31k op/s 2024-09-21T07:53:13.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:13 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3493220313' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:13.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:13 smithi084 ceph-mon[30411]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 228 MiB/s wr, 1.31k op/s 2024-09-21T07:53:13.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:13 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3493220313' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:13 smithi162 ceph-mon[34833]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 228 MiB/s wr, 1.31k op/s 2024-09-21T07:53:13.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3493220313' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:13.910 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:53:13.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:53:14.302 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T07:53:14.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T07:53:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:15.472 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:15 smithi084 ceph-mon[30411]: pgmap v458: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 232 MiB/s wr, 1.38k op/s 2024-09-21T07:53:15.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:15 smithi162 ceph-mon[34833]: pgmap v458: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 232 MiB/s wr, 1.38k op/s 2024-09-21T07:53:15.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:15 smithi191 ceph-mon[34667]: pgmap v458: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 232 MiB/s wr, 1.38k op/s 2024-09-21T07:53:16.486 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:16.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.565+0000 7f0e77200640 1 -- 172.21.15.84:0/2548659822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70116640 msgr2=0x7f0e70118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:16.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.565+0000 7f0e77200640 1 --2- 172.21.15.84:0/2548659822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70116640 0x7f0e70118b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009ca0 tx=0x7f0e6802a8d0 comp rx=0 tx=0).stop 2024-09-21T07:53:16.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.566+0000 7f0e77200640 1 -- 172.21.15.84:0/2548659822 shutdown_connections 2024-09-21T07:53:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.566+0000 7f0e77200640 1 --2- 172.21.15.84:0/2548659822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70116640 0x7f0e70118b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.566+0000 7f0e77200640 1 --2- 172.21.15.84:0/2548659822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e7010aee0 0x7f0e70115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.566+0000 7f0e77200640 1 --2- 172.21.15.84:0/2548659822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e7010a590 0x7f0e7010a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.566+0000 7f0e77200640 1 -- 172.21.15.84:0/2548659822 >> 172.21.15.84:0/2548659822 conn(0x7f0e70070ec0 msgr2=0x7f0e700712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.567+0000 7f0e77200640 1 -- 172.21.15.84:0/2548659822 shutdown_connections 2024-09-21T07:53:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.567+0000 7f0e77200640 1 -- 172.21.15.84:0/2548659822 wait complete. 2024-09-21T07:53:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.571+0000 7f0e77200640 1 Processor -- start 2024-09-21T07:53:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.571+0000 7f0e77200640 1 -- start start 2024-09-21T07:53:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e77200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e7010a590 0x7f0e70113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e77200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e7010aee0 0x7f0e70113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e77200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70116640 0x7f0e701b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e77200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010d970 con 0x7f0e7010a590 2024-09-21T07:53:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e77200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010d7f0 con 0x7f0e7010aee0 2024-09-21T07:53:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e77200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010daf0 con 0x7f0e70116640 2024-09-21T07:53:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e6f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e7010aee0 0x7f0e70113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e6f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e7010aee0 0x7f0e70113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55072/0 (socket says 172.21.15.84:55072) 2024-09-21T07:53:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.573+0000 7f0e6f400640 1 -- 172.21.15.84:0/3128100682 learned_addr learned my addr 172.21.15.84:0/3128100682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.574+0000 7f0e6fe00640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e7010a590 0x7f0e70113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.574+0000 7f0e75200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70116640 0x7f0e701b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.574+0000 7f0e6f400640 1 -- 172.21.15.84:0/3128100682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70116640 msgr2=0x7f0e701b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.574+0000 7f0e6f400640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70116640 0x7f0e701b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.574+0000 7f0e6f400640 1 -- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e7010a590 msgr2=0x7f0e70113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.574+0000 7f0e6f400640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e7010a590 0x7f0e70113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.574+0000 7f0e6f400640 1 -- 172.21.15.84:0/3128100682 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e701143f0 con 0x7f0e7010aee0 2024-09-21T07:53:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.575+0000 7f0e75200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70116640 0x7f0e701b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.575+0000 7f0e6f400640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e7010aee0 0x7f0e70113b70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000e9f0 tx=0x7f0e6000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.576+0000 7f0e6cc00640 1 -- 172.21.15.84:0/3128100682 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000ccc0 con 0x7f0e7010aee0 2024-09-21T07:53:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.576+0000 7f0e6cc00640 1 -- 172.21.15.84:0/3128100682 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e600108e0 con 0x7f0e7010aee0 2024-09-21T07:53:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.576+0000 7f0e6cc00640 1 -- 172.21.15.84:0/3128100682 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e60018860 con 0x7f0e7010aee0 2024-09-21T07:53:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.577+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e701b5730 con 0x7f0e7010aee0 2024-09-21T07:53:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.577+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701b5c20 con 0x7f0e7010aee0 2024-09-21T07:53:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.581+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e500052c0 con 0x7f0e7010aee0 2024-09-21T07:53:16.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.583+0000 7f0e6cc00640 1 -- 172.21.15.84:0/3128100682 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0e60018a00 con 0x7f0e7010aee0 2024-09-21T07:53:16.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.586+0000 7f0e6cc00640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0e540b6850 0x7f0e540b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:16.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.587+0000 7f0e6cc00640 1 -- 172.21.15.84:0/3128100682 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0e600e7c70 con 0x7f0e7010aee0 2024-09-21T07:53:16.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.589+0000 7f0e6fe00640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0e540b6850 0x7f0e540b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:16.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.591+0000 7f0e6fe00640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0e540b6850 0x7f0e540b8d60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0e70116090 tx=0x7f0e5c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:16.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:16.592+0000 7f0e6cc00640 1 -- 172.21.15.84:0/3128100682 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e600ade50 con 0x7f0e7010aee0 2024-09-21T07:53:17.181 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:17 smithi084 ceph-mon[30411]: pgmap v459: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 214 MiB/s wr, 1.30k op/s 2024-09-21T07:53:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.216+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e50005880 con 0x7f0e7010aee0 2024-09-21T07:53:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.220+0000 7f0e6cc00640 1 -- 172.21.15.84:0/3128100682 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f0e600b2230 con 0x7f0e7010aee0 2024-09-21T07:53:17.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:53:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:53:17.226 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.224+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0e540b6850 msgr2=0x7f0e540b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0e540b6850 0x7f0e540b8d60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0e70116090 tx=0x7f0e5c008040 comp rx=0 tx=0).stop 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e7010aee0 msgr2=0x7f0e70113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e7010aee0 0x7f0e70113b70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000e9f0 tx=0x7f0e6000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 shutdown_connections 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0e540b6850 0x7f0e540b8d60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70116640 0x7f0e701b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e7010aee0 0x7f0e70113b70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 --2- 172.21.15.84:0/3128100682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e7010a590 0x7f0e70113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.225+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 >> 172.21.15.84:0/3128100682 conn(0x7f0e70070ec0 msgr2=0x7f0e7011bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.226+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 shutdown_connections 2024-09-21T07:53:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.226+0000 7f0e77200640 1 -- 172.21.15.84:0/3128100682 wait complete. 2024-09-21T07:53:17.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.514+0000 7f0a7fe00640 1 -- 172.21.15.84:0/2694621931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109330 msgr2=0x7f0a80109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.514+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/2694621931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109330 0x7f0a80109740 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009860 tx=0x7f0a6802a340 comp rx=0 tx=0).stop 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.514+0000 7f0a7fe00640 1 -- 172.21.15.84:0/2694621931 shutdown_connections 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.514+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/2694621931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a80109c80 0x7f0a801104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.514+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/2694621931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109330 0x7f0a80109740 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009860 tx=0x7f0a6802a340 comp rx=0 tx=0).stop 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.514+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/2694621931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a801039f0 0x7f0a80103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.514+0000 7f0a7fe00640 1 -- 172.21.15.84:0/2694621931 >> 172.21.15.84:0/2694621931 conn(0x7f0a800ff480 msgr2=0x7f0a801018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.513+0000 7f0a7e000640 1 -- 172.21.15.84:0/2694621931 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68030850 con 0x7f0a80109330 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.517+0000 7f0a7fe00640 1 -- 172.21.15.84:0/2694621931 shutdown_connections 2024-09-21T07:53:17.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.517+0000 7f0a7fe00640 1 -- 172.21.15.84:0/2694621931 wait complete. 2024-09-21T07:53:17.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.519+0000 7f0a7fe00640 1 Processor -- start 2024-09-21T07:53:17.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.521+0000 7f0a7fe00640 1 -- start start 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.523+0000 7f0a7fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a801039f0 0x7f0a80113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.524+0000 7f0a7fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109c80 0x7f0a80113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.524+0000 7f0a7ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a801039f0 0x7f0a80113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.524+0000 7f0a7ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a801039f0 0x7f0a80113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37916/0 (socket says 172.21.15.84:37916) 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.524+0000 7f0a7ea00640 1 -- 172.21.15.84:0/1549285964 learned_addr learned my addr 172.21.15.84:0/1549285964 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.525+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8011df20 0x7f0a8011e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.525+0000 7f0a77e00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109c80 0x7f0a80113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.526+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0a80077040 con 0x7f0a8011df20 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.526+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a80076ec0 con 0x7f0a80109c80 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.526+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0a800771c0 con 0x7f0a801039f0 2024-09-21T07:53:17.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.526+0000 7f0a7ea00640 1 -- 172.21.15.84:0/1549285964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109c80 msgr2=0x7f0a80113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.528+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109c80 0x7f0a80113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.528+0000 7f0a7ea00640 1 -- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8011df20 msgr2=0x7f0a8011e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.528+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8011df20 0x7f0a8011e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.530+0000 7f0a7ea00640 1 -- 172.21.15.84:0/1549285964 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a80118d90 con 0x7f0a801039f0 2024-09-21T07:53:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.530+0000 7f0a77e00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109c80 0x7f0a80113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.531+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a801039f0 0x7f0a80113610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000d950 tx=0x7f0a7000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.531+0000 7f0a77400640 1 -- 172.21.15.84:0/1549285964 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70017070 con 0x7f0a801039f0 2024-09-21T07:53:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.531+0000 7f0a77400640 1 -- 172.21.15.84:0/1549285964 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a70009c30 con 0x7f0a801039f0 2024-09-21T07:53:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.531+0000 7f0a77400640 1 -- 172.21.15.84:0/1549285964 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000f620 con 0x7f0a801039f0 2024-09-21T07:53:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.532+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a80119020 con 0x7f0a801039f0 2024-09-21T07:53:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.532+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a801194e0 con 0x7f0a801039f0 2024-09-21T07:53:17.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:17 smithi162 ceph-mon[34833]: pgmap v459: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 214 MiB/s wr, 1.30k op/s 2024-09-21T07:53:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.546+0000 7f0a8c693740 1 Processor -- start 2024-09-21T07:53:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.546+0000 7f0a77400640 1 -- 172.21.15.84:0/1549285964 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0a7000f7c0 con 0x7f0a801039f0 2024-09-21T07:53:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.553+0000 7f0a8c693740 1 -- start start 2024-09-21T07:53:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.553+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb399510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.553+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb399a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.553+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb399f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.553+0000 7f0a8c693740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b8bb30eca0 con 0x55b8baff1840 2024-09-21T07:53:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.553+0000 7f0a8c693740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8bb2fe0d0 con 0x55b8bafd0b60 2024-09-21T07:53:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.553+0000 7f0a8c693740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b8bb301ee0 con 0x55b8bafc8980 2024-09-21T07:53:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.556+0000 7f0a7f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb399510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.556+0000 7f0a7f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb399510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52458/0 (socket says 172.21.15.84:52458) 2024-09-21T07:53:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.556+0000 7f0a77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb399f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.557+0000 7f0a7f400640 1 -- 172.21.15.84:0/437104682 learned_addr learned my addr 172.21.15.84:0/437104682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.557+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb399a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.558+0000 7f0a77400640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a640b6810 0x7f0a640b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.561+0000 7f0a7f400640 1 -- 172.21.15.84:0/437104682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 msgr2=0x55b8bb399a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.561+0000 7f0a7f400640 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb399a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.561+0000 7f0a77400640 1 -- 172.21.15.84:0/1549285964 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0a700e73c0 con 0x7f0a801039f0 2024-09-21T07:53:17.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.564+0000 7f0a7f400640 1 -- 172.21.15.84:0/437104682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 msgr2=0x55b8bb399f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.564+0000 7f0a7f400640 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb399f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.564+0000 7f0a7f400640 1 -- 172.21.15.84:0/437104682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8bb2b0400 con 0x55b8baff1840 2024-09-21T07:53:17.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.565+0000 7f0a77e00640 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb399f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:17.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.567+0000 7f0a7f400640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a640b6810 0x7f0a640b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.568+0000 7f0a7f400640 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb399510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009ed0 tx=0x7f0a7800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2857785c6f66b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.569+0000 7f0a6fe00640 1 -- 172.21.15.84:0/437104682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800c980 con 0x55b8baff1840 2024-09-21T07:53:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.569+0000 7f0a6fe00640 1 -- 172.21.15.84:0/437104682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a78018420 con 0x55b8baff1840 2024-09-21T07:53:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.569+0000 7f0a6fe00640 1 -- 172.21.15.84:0/437104682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a780175e0 con 0x55b8baff1840 2024-09-21T07:53:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.573+0000 7f0a8c693740 1 -- 172.21.15.84:0/437104682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 msgr2=0x55b8bb399510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.573+0000 7f0a8c693740 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb399510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009ed0 tx=0x7f0a7800e7c0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.574+0000 7f0a7f400640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a640b6810 0x7f0a640b8d20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0a7801d000 tx=0x7f0a7800b360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.574+0000 7f0a8c693740 1 -- 172.21.15.84:0/437104682 shutdown_connections 2024-09-21T07:53:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.575+0000 7f0a8c693740 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb399f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.575+0000 7f0a8c693740 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb399a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.575+0000 7f0a8c693740 1 --2- 172.21.15.84:0/437104682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb399510 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.575+0000 7f0a8c693740 1 -- 172.21.15.84:0/437104682 >> 172.21.15.84:0/437104682 conn(0x55b8bafe5990 msgr2=0x55b8bb397400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.576+0000 7f0a8c693740 1 -- 172.21.15.84:0/437104682 shutdown_connections 2024-09-21T07:53:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.576+0000 7f0a8c693740 1 -- 172.21.15.84:0/437104682 wait complete. 2024-09-21T07:53:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.577+0000 7f0a8c693740 1 -- start start 2024-09-21T07:53:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.578+0000 7f0a8c693740 1 Processor -- start 2024-09-21T07:53:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.579+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafc8980 0x55b8bb3a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.580+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb3a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.580+0000 7f0a7ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafc8980 0x55b8bb3a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.580+0000 7f0a7ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafc8980 0x55b8bb3a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55104/0 (socket says 172.21.15.84:55104) 2024-09-21T07:53:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.580+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb3b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.581+0000 7f0a7ea00640 1 -- 172.21.15.84:0/4074970858 learned_addr learned my addr 172.21.15.84:0/4074970858 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.581+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b8bb15f7a0 con 0x55b8baff1840 2024-09-21T07:53:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.581+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8bb2a3a10 con 0x55b8bafc8980 2024-09-21T07:53:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.581+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b8bb3a7cf0 con 0x55b8bafd0b60 2024-09-21T07:53:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.581+0000 7f0a8c693740 10 client.0 _ll_register_callbacks cb 0x55b8bb2b3be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:17.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.581+0000 7f0a77e00640 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb3a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.582+0000 7f0a77e00640 1 -- 172.21.15.84:0/4074970858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafc8980 msgr2=0x55b8bb3a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.582+0000 7f0a77e00640 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafc8980 0x55b8bb3a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.582+0000 7f0a77e00640 1 -- 172.21.15.84:0/4074970858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 msgr2=0x55b8bb3b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.582+0000 7f0a77e00640 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb3b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.583+0000 7f0a77e00640 1 -- 172.21.15.84:0/4074970858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8bb06bb90 con 0x55b8bafd0b60 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.583+0000 7f0a77e00640 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb3a5130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0a801049f0 tx=0x7f0a68004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=472a3bdbaed7ef8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.584+0000 7f0a6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.584+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4074970858 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68040070 con 0x55b8bafd0b60 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.584+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4074970858 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0a680046c0 con 0x55b8bafd0b60 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.584+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a78018420 con 0x55b8bafd0b60 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.587+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4074970858 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a68037040 con 0x55b8bafd0b60 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.588+0000 7f0a8c693740 10 client.26362 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.588+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b8bb3b3a20 con 0x55b8bafd0b60 2024-09-21T07:53:17.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.588+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4074970858 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a78018420 con 0x55b8bafd0b60 2024-09-21T07:53:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4074970858 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0a68043020 con 0x55b8bafd0b60 2024-09-21T07:53:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a8c693740 10 client.26362 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a8c693740 10 client.26362 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:53:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a8c693740 20 client.26362 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8bafb01c0 0x55b8bb3b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a8c693740 4 client.26362 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:17.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8bb310bf0 con 0x55b8bafb01c0 2024-09-21T07:53:17.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.589+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8bafb01c0 0x55b8bb3b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.591+0000 7f0a6cc00640 10 client.26362 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.591+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8bafb01c0 0x55b8bb3b7400 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdc71eac6049e99 server_cookie=7ab71467a85ee42f in_seq=0 out_seq=0 2024-09-21T07:53:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.592+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4074970858 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8bb310bf0 con 0x55b8bafb01c0 2024-09-21T07:53:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.592+0000 7f0a6cc00640 10 client.26362 handle_command_reply: tid=0 2024-09-21T07:53:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.593+0000 7f0a8c693740 1 client.26362 shutdown 2024-09-21T07:53:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.594+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 msgr2=0x55b8bb3a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.594+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb3a5130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0a801049f0 tx=0x7f0a68004610 comp rx=0 tx=0).stop 2024-09-21T07:53:17.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 shutdown_connections 2024-09-21T07:53:17.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb3b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8bafb01c0 0x55b8bb3b7400 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb3a5130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4074970858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafc8980 0x55b8bb3a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 >> 172.21.15.84:0/4074970858 conn(0x55b8bafe5990 msgr2=0x55b8bb39c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:17.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a6cc00640 0 client.26362 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:17.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 shutdown_connections 2024-09-21T07:53:17.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 1 -- 172.21.15.84:0/4074970858 wait complete. 2024-09-21T07:53:17.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.595+0000 7f0a8c693740 20 client.26362 trim_cache size 0 max 16384 2024-09-21T07:53:17.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:17 smithi191 ceph-mon[34667]: pgmap v459: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 214 MiB/s wr, 1.30k op/s 2024-09-21T07:53:17.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.670+0000 7f0a8c693740 1 Processor -- start 2024-09-21T07:53:17.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.672+0000 7f0a8c693740 1 -- start start 2024-09-21T07:53:17.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.673+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8bafc8980 0x55b8bb3a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.673+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb39ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.673+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8baff1840 0x55b8bb3b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.673+0000 7f0a8c693740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c00feb0 con 0x55b8bafc8980 2024-09-21T07:53:17.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.673+0000 7f0a8c693740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c0119f0 con 0x55b8baff1840 2024-09-21T07:53:17.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.673+0000 7f0a8c693740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c010580 con 0x55b8bafd0b60 2024-09-21T07:53:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.675+0000 7f0a7f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8baff1840 0x55b8bb3b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.675+0000 7f0a7f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8baff1840 0x55b8bb3b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55118/0 (socket says 172.21.15.84:55118) 2024-09-21T07:53:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.675+0000 7f0a7f400640 1 -- 172.21.15.84:0/2157739688 learned_addr learned my addr 172.21.15.84:0/2157739688 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:17.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.680+0000 7f0a77e00640 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb39ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.681+0000 7f0a7f400640 1 -- 172.21.15.84:0/2157739688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 msgr2=0x55b8bb39ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.681+0000 7f0a7f400640 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb39ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.681+0000 7f0a7f400640 1 -- 172.21.15.84:0/2157739688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8bafc8980 msgr2=0x55b8bb3a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.682+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8bafc8980 0x55b8bb3a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.686+0000 7f0a7f400640 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8bafc8980 0x55b8bb3a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.686+0000 7f0a7f400640 1 -- 172.21.15.84:0/2157739688 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8bb3a5eb0 con 0x55b8baff1840 2024-09-21T07:53:17.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.687+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8bafc8980 0x55b8bb3a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:17.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.688+0000 7f0a7f400640 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8baff1840 0x55b8bb3b0f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a78018040 tx=0x7f0a78022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e19af1c4808529da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:17.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.692+0000 7f0a6f400640 1 -- 172.21.15.84:0/2157739688 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78026070 con 0x55b8baff1840 2024-09-21T07:53:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.692+0000 7f0a6f400640 1 -- 172.21.15.84:0/2157739688 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a78031070 con 0x55b8baff1840 2024-09-21T07:53:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.692+0000 7f0a6f400640 1 -- 172.21.15.84:0/2157739688 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800c780 con 0x55b8baff1840 2024-09-21T07:53:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.694+0000 7f0a8c693740 1 -- 172.21.15.84:0/2157739688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8baff1840 msgr2=0x55b8bb3b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.694+0000 7f0a8c693740 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8baff1840 0x55b8bb3b0f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a78018040 tx=0x7f0a78022000 comp rx=0 tx=0).stop 2024-09-21T07:53:17.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.695+0000 7f0a8c693740 1 -- 172.21.15.84:0/2157739688 shutdown_connections 2024-09-21T07:53:17.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.695+0000 7f0a8c693740 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8baff1840 0x55b8bb3b0f40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.695+0000 7f0a8c693740 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafd0b60 0x55b8bb39ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.695+0000 7f0a8c693740 1 --2- 172.21.15.84:0/2157739688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8bafc8980 0x55b8bb3a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.695+0000 7f0a8c693740 1 -- 172.21.15.84:0/2157739688 >> 172.21.15.84:0/2157739688 conn(0x55b8bafe5990 msgr2=0x55b8bb39a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:17.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.695+0000 7f0a8c693740 1 -- 172.21.15.84:0/2157739688 shutdown_connections 2024-09-21T07:53:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.696+0000 7f0a8c693740 1 -- 172.21.15.84:0/2157739688 wait complete. 2024-09-21T07:53:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.696+0000 7f0a8c693740 1 -- start start 2024-09-21T07:53:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.697+0000 7f0a8c693740 1 Processor -- start 2024-09-21T07:53:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.699+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb41cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.699+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb41d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.699+0000 7f0a8c693740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb41d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.700+0000 7f0a77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb41d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.700+0000 7f0a77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb41d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55134/0 (socket says 172.21.15.84:55134) 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.700+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c011320 con 0x55b8baff1840 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.700+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c010c50 con 0x55b8bafd0b60 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.700+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c00de70 con 0x55b8bafc8980 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.700+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb41cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.700+0000 7f0a77e00640 1 -- 172.21.15.84:0/4026560233 learned_addr learned my addr 172.21.15.84:0/4026560233 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.702+0000 7f0a8c693740 10 client.0 _ll_register_callbacks cb 0x7f0a78009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:17.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.705+0000 7f0a77e00640 1 -- 172.21.15.84:0/4026560233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 msgr2=0x55b8bb41cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.705+0000 7f0a77e00640 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb41cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.705+0000 7f0a77e00640 1 -- 172.21.15.84:0/4026560233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 msgr2=0x55b8bb41d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:17.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.705+0000 7f0a77e00640 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb41d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:17.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.705+0000 7f0a77e00640 1 -- 172.21.15.84:0/4026560233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8bb3aaf30 con 0x55b8bafd0b60 2024-09-21T07:53:17.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.711+0000 7f0a77e00640 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb41d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a6802a8b0 tx=0x7f0a68005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e756697a17139e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:17.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.711+0000 7f0a6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:53:17.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.713+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4026560233 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68040040 con 0x55b8bafd0b60 2024-09-21T07:53:17.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.713+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a78031070 con 0x55b8bafd0b60 2024-09-21T07:53:17.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.715+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4026560233 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0a68032ae0 con 0x55b8bafd0b60 2024-09-21T07:53:17.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.716+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4026560233 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a68059050 con 0x55b8bafd0b60 2024-09-21T07:53:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.718+0000 7f0a8c693740 10 client.26348 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.719+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b8bb432f90 con 0x55b8bafd0b60 2024-09-21T07:53:17.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.722+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4026560233 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a78031070 con 0x55b8bafd0b60 2024-09-21T07:53:17.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.730+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4026560233 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0a6804d030 con 0x55b8bafd0b60 2024-09-21T07:53:17.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.730+0000 7f0a8c693740 10 client.26348 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:17.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.730+0000 7f0a8c693740 10 client.26348 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:53:17.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.730+0000 7f0a8c693740 20 client.26348 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:17.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.730+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8baf85570 0x55b8bb4357d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:17.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.731+0000 7f0a8c693740 4 client.26348 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T07:53:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.732+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8baf85570 0x55b8bb4357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:17.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.733+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x55b8bb30c6a0 con 0x55b8baf85570 2024-09-21T07:53:17.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.734+0000 7f0a7ea00640 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8baf85570 0x55b8bb4357d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c932ae6d18063cd server_cookie=2bc2c30b501bb25d in_seq=0 out_seq=0 2024-09-21T07:53:17.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:17.735+0000 7f0a6cc00640 10 client.26348 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:18.322 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:53:18.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:18 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3128100682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:18.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:18 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3128100682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:18.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:18 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3128100682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:19.222 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:19.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:19 smithi084 ceph-mon[30411]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 214 MiB/s wr, 1.34k op/s 2024-09-21T07:53:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:19 smithi162 ceph-mon[34833]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 214 MiB/s wr, 1.34k op/s 2024-09-21T07:53:19.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:19 smithi191 ceph-mon[34667]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 214 MiB/s wr, 1.34k op/s 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 -- 172.21.15.84:0/2700011778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 msgr2=0x7f96ec103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 --2- 172.21.15.84:0/2700011778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec103dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009860 tx=0x7f96dc02a340 comp rx=0 tx=0).stop 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 -- 172.21.15.84:0/2700011778 shutdown_connections 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 --2- 172.21.15.84:0/2700011778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96ec109c40 0x7f96ec110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 --2- 172.21.15.84:0/2700011778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96ec1092f0 0x7f96ec109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 --2- 172.21.15.84:0/2700011778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec103dc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 -- 172.21.15.84:0/2700011778 >> 172.21.15.84:0/2700011778 conn(0x7f96ec0ff440 msgr2=0x7f96ec101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 -- 172.21.15.84:0/2700011778 shutdown_connections 2024-09-21T07:53:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.025+0000 7f96f1800640 1 -- 172.21.15.84:0/2700011778 wait complete. 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 Processor -- start 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 -- start start 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96ec1092f0 0x7f96ec19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96ec109c40 0x7f96ec19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec113900 con 0x7f96ec1092f0 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec113780 con 0x7f96ec109c40 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f1800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec113a80 con 0x7f96ec1039b0 2024-09-21T07:53:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec19a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56160/0 (socket says 172.21.15.84:56160) 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96ebe00640 1 -- 172.21.15.84:0/4058789859 learned_addr learned my addr 172.21.15.84:0/4058789859 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96eb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96ec1092f0 0x7f96ec19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.027+0000 7f96f0e00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96ec109c40 0x7f96ec19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.028+0000 7f96f0e00640 1 -- 172.21.15.84:0/4058789859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 msgr2=0x7f96ec19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.028+0000 7f96f0e00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.028+0000 7f96f0e00640 1 -- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96ec1092f0 msgr2=0x7f96ec19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.028+0000 7f96f0e00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96ec1092f0 0x7f96ec19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.028+0000 7f96f0e00640 1 -- 172.21.15.84:0/4058789859 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec1a0280 con 0x7f96ec109c40 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.028+0000 7f96ebe00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.028+0000 7f96f0e00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96ec109c40 0x7f96ec19fb50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f96e400ef00 tx=0x7f96e400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:20.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.029+0000 7f96e8c00640 1 -- 172.21.15.84:0/4058789859 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4004b20 con 0x7f96ec109c40 2024-09-21T07:53:20.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.029+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec1a0570 con 0x7f96ec109c40 2024-09-21T07:53:20.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.029+0000 7f96e8c00640 1 -- 172.21.15.84:0/4058789859 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96e4003e20 con 0x7f96ec109c40 2024-09-21T07:53:20.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.029+0000 7f96e8c00640 1 -- 172.21.15.84:0/4058789859 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e400b570 con 0x7f96ec109c40 2024-09-21T07:53:20.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.029+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec0755f0 con 0x7f96ec109c40 2024-09-21T07:53:20.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.032+0000 7f96f9ac8740 1 Processor -- start 2024-09-21T07:53:20.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.032+0000 7f96e8c00640 1 -- 172.21.15.84:0/4058789859 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f96e401d020 con 0x7f96ec109c40 2024-09-21T07:53:20.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.032+0000 7f96f9ac8740 1 -- start start 2024-09-21T07:53:20.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f46fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46fc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f46fc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5587f4672fb0 con 0x5587f432c1b0 2024-09-21T07:53:20.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5587f46623e0 con 0x5587f4334390 2024-09-21T07:53:20.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5587f46661f0 con 0x5587f4355070 2024-09-21T07:53:20.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96eb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f46fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96eb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f46fbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56172/0 (socket says 172.21.15.84:56172) 2024-09-21T07:53:20.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96eb400640 1 -- 172.21.15.84:0/384426848 learned_addr learned my addr 172.21.15.84:0/384426848 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:20.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96eb400640 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f46fc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.033+0000 7f96ebe00640 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46fc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96eb400640 1 -- 172.21.15.84:0/384426848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 msgr2=0x5587f46fc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:20.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96eb400640 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f46fc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96eb400640 1 -- 172.21.15.84:0/384426848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 msgr2=0x5587f46fc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:20.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96eb400640 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46fc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96eb400640 1 -- 172.21.15.84:0/384426848 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587f462ccd0 con 0x5587f4355070 2024-09-21T07:53:20.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96e8c00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f96d00b6680 0x7f96d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96e8c00640 1 -- 172.21.15.84:0/4058789859 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f96e40e78f0 con 0x7f96ec109c40 2024-09-21T07:53:20.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96eb400640 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f46fbf70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009c30 tx=0x7f96d8014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e33147d5e418c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:20.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96ebe00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f96d00b6680 0x7f96d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.034+0000 7f96e1600640 1 -- 172.21.15.84:0/384426848 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8009de0 con 0x5587f4355070 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.035+0000 7f96e1600640 1 -- 172.21.15.84:0/384426848 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96d8005020 con 0x5587f4355070 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.035+0000 7f96e1600640 1 -- 172.21.15.84:0/384426848 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8004a00 con 0x5587f4355070 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.035+0000 7f96f9ac8740 1 -- 172.21.15.84:0/384426848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 msgr2=0x5587f46fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.035+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f46fbf70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009c30 tx=0x7f96d8014040 comp rx=0 tx=0).stop 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96f9ac8740 1 -- 172.21.15.84:0/384426848 shutdown_connections 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f46fc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46fc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/384426848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f46fbf70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96f9ac8740 1 -- 172.21.15.84:0/384426848 >> 172.21.15.84:0/384426848 conn(0x5587f4349460 msgr2=0x5587f46f9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96ebe00640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f96d00b6680 0x7f96d00b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5587f46fabf0 tx=0x7f96dc02c040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:20.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96f9ac8740 1 -- 172.21.15.84:0/384426848 shutdown_connections 2024-09-21T07:53:20.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.036+0000 7f96f9ac8740 1 -- 172.21.15.84:0/384426848 wait complete. 2024-09-21T07:53:20.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.037+0000 7f96f9ac8740 1 -- start start 2024-09-21T07:53:20.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.037+0000 7f96f9ac8740 1 Processor -- start 2024-09-21T07:53:20.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.037+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f432c1b0 0x5587f47107d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.037+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f4334390 0x5587f4710db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f4715dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5587f44c3700 con 0x5587f4334390 2024-09-21T07:53:20.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5587f45fd580 con 0x5587f432c1b0 2024-09-21T07:53:20.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5587f470a6f0 con 0x5587f4355070 2024-09-21T07:53:20.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96eb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f4334390 0x5587f4710db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96f9ac8740 10 client.0 _ll_register_callbacks cb 0x5587f460d470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f432c1b0 0x5587f47107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f432c1b0 0x5587f47107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57366/0 (socket says 172.21.15.84:57366) 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 -- 172.21.15.84:0/2290628965 learned_addr learned my addr 172.21.15.84:0/2290628965 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96f0e00640 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f4715dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 -- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 msgr2=0x5587f4715dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f4715dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 -- 172.21.15.84:0/2290628965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f4334390 msgr2=0x5587f4710db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f4334390 0x5587f4710db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.038+0000 7f96ebe00640 1 -- 172.21.15.84:0/2290628965 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587f43c0650 con 0x5587f432c1b0 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.039+0000 7f96ebe00640 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f432c1b0 0x5587f47107d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f96dc035040 tx=0x7f96dc02a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6970fbbb4b7c71c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.039+0000 7f96d6000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:53:20.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.039+0000 7f96d6000640 1 -- 172.21.15.84:0/2290628965 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc037040 con 0x5587f432c1b0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.039+0000 7f96d6000640 1 -- 172.21.15.84:0/2290628965 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f96dc0327f0 con 0x5587f432c1b0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.039+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587f45ffb90 con 0x5587f432c1b0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96d6000640 1 -- 172.21.15.84:0/2290628965 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96dc057050 con 0x5587f432c1b0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 10 client.26360 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5587f461a950 con 0x5587f432c1b0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96d6000640 1 -- 172.21.15.84:0/2290628965 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5587f45ffb90 con 0x5587f432c1b0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96d6000640 1 -- 172.21.15.84:0/2290628965 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f96dc003ba0 con 0x5587f432c1b0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 10 client.26360 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 10 client.26360 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 20 client.26360 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f43139f0 0x5587f47220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 4 client.26360 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.040+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587f4674f00 con 0x5587f43139f0 2024-09-21T07:53:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.041+0000 7f96eb400640 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f43139f0 0x5587f47220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.041+0000 7f96d6000640 10 client.26360 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:53:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.041+0000 7f96eb400640 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f43139f0 0x5587f47220f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=58f9ce7c8ce0c75a server_cookie=801e55fd0ec7a118 in_seq=0 out_seq=0 2024-09-21T07:53:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.042+0000 7f96d6000640 1 -- 172.21.15.84:0/2290628965 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5587f4674f00 con 0x5587f43139f0 2024-09-21T07:53:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.042+0000 7f96d6000640 10 client.26360 handle_command_reply: tid=0 2024-09-21T07:53:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.042+0000 7f96f9ac8740 1 client.26360 shutdown 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.042+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f432c1b0 msgr2=0x5587f47107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.042+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f432c1b0 0x5587f47107d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f96dc035040 tx=0x7f96dc02a340 comp rx=0 tx=0).stop 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.043+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 shutdown_connections 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.043+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f43139f0 0x5587f47220f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.043+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f4715dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.043+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f4334390 0x5587f4710db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.043+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2290628965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f432c1b0 0x5587f47107d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.043+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 >> 172.21.15.84:0/2290628965 conn(0x5587f4349460 msgr2=0x5587f46f8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.045+0000 7f96d6000640 0 client.26360 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:53:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.045+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 shutdown_connections 2024-09-21T07:53:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.045+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2290628965 wait complete. 2024-09-21T07:53:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.045+0000 7f96f9ac8740 20 client.26360 trim_cache size 0 max 16384 2024-09-21T07:53:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.072+0000 7f96f9ac8740 1 Processor -- start 2024-09-21T07:53:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.072+0000 7f96f9ac8740 1 -- start start 2024-09-21T07:53:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f4715bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f47160f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1ae980 con 0x5587f432c1b0 2024-09-21T07:53:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1b04c0 con 0x5587f4334390 2024-09-21T07:53:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1af050 con 0x5587f4355070 2024-09-21T07:53:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96eb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f4715bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96eb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f4715bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57374/0 (socket says 172.21.15.84:57374) 2024-09-21T07:53:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.073+0000 7f96eb400640 1 -- 172.21.15.84:0/2314481462 learned_addr learned my addr 172.21.15.84:0/2314481462 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.074+0000 7f96ebe00640 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.074+0000 7f96eb400640 1 -- 172.21.15.84:0/2314481462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 msgr2=0x5587f47160f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.074+0000 7f96eb400640 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f47160f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.074+0000 7f96eb400640 1 -- 172.21.15.84:0/2314481462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 msgr2=0x5587f46f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.074+0000 7f96eb400640 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46f8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.074+0000 7f96eb400640 1 -- 172.21.15.84:0/2314481462 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587f4700080 con 0x5587f4334390 2024-09-21T07:53:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.075+0000 7f96eb400640 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f4715bb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96d800cb30 tx=0x7f96d8012cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d7374c658231dce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.075+0000 7f96e0c00640 1 -- 172.21.15.84:0/2314481462 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d800ce70 con 0x5587f4334390 2024-09-21T07:53:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.075+0000 7f96e0c00640 1 -- 172.21.15.84:0/2314481462 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96d80124f0 con 0x5587f4334390 2024-09-21T07:53:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.075+0000 7f96e0c00640 1 -- 172.21.15.84:0/2314481462 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8005750 con 0x5587f4334390 2024-09-21T07:53:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.077+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2314481462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 msgr2=0x5587f4715bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.077+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f4715bb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96d800cb30 tx=0x7f96d8012cd0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.077+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2314481462 shutdown_connections 2024-09-21T07:53:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.077+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4355070 0x5587f47160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.077+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4334390 0x5587f4715bb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.077+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/2314481462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f46f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.077+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2314481462 >> 172.21.15.84:0/2314481462 conn(0x5587f4349460 msgr2=0x5587f46f8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.078+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2314481462 shutdown_connections 2024-09-21T07:53:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.078+0000 7f96f9ac8740 1 -- 172.21.15.84:0/2314481462 wait complete. 2024-09-21T07:53:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.079+0000 7f96f9ac8740 1 -- start start 2024-09-21T07:53:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.079+0000 7f96f9ac8740 1 Processor -- start 2024-09-21T07:53:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f471caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4334390 0x5587f4715fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96f9ac8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4355070 0x5587f47166b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1afdf0 con 0x5587f432c1b0 2024-09-21T07:53:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1af720 con 0x5587f4355070 2024-09-21T07:53:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96f9ac8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1ac940 con 0x5587f4334390 2024-09-21T07:53:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96f9ac8740 10 client.0 _ll_register_callbacks cb 0x7f96dc0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f471caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f471caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48140/0 (socket says 172.21.15.84:48140) 2024-09-21T07:53:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.080+0000 7f96ebe00640 1 -- 172.21.15.84:0/1202397479 learned_addr learned my addr 172.21.15.84:0/1202397479 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.081+0000 7f96ebe00640 1 -- 172.21.15.84:0/1202397479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4334390 msgr2=0x5587f4715fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.081+0000 7f96ebe00640 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4334390 0x5587f4715fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.081+0000 7f96ebe00640 1 -- 172.21.15.84:0/1202397479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4355070 msgr2=0x5587f47166b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:20.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.081+0000 7f96ebe00640 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4355070 0x5587f47166b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.081+0000 7f96ebe00640 1 -- 172.21.15.84:0/1202397479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587f471b730 con 0x5587f432c1b0 2024-09-21T07:53:20.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.082+0000 7f96ebe00640 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f471caf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0057c0 tx=0x7f96dc004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515aa5fa672483f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:20.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.082+0000 7f96d6000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.083+0000 7f96d6000640 1 -- 172.21.15.84:0/1202397479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc061020 con 0x5587f432c1b0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.083+0000 7f96d6000640 1 -- 172.21.15.84:0/1202397479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f96dc049c70 con 0x5587f432c1b0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.083+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96d80124f0 con 0x5587f432c1b0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.083+0000 7f96d6000640 1 -- 172.21.15.84:0/1202397479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96dc037040 con 0x5587f432c1b0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.084+0000 7f96f9ac8740 10 client.16320 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.084+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5587f478cc30 con 0x5587f432c1b0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.084+0000 7f96d6000640 1 -- 172.21.15.84:0/1202397479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96d80124f0 con 0x5587f432c1b0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.084+0000 7f96d6000640 1 -- 172.21.15.84:0/1202397479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f96dc0037c0 con 0x5587f432c1b0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.084+0000 7f96f9ac8740 10 client.16320 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.084+0000 7f96f9ac8740 10 client.16320 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.085+0000 7f96f9ac8740 20 client.16320 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.085+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f42e8da0 0x5587f478f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.085+0000 7f96f9ac8740 4 client.16320 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.085+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5587f46709b0 con 0x5587f42e8da0 2024-09-21T07:53:20.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.085+0000 7f96eb400640 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f42e8da0 0x5587f478f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:20.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.085+0000 7f96eb400640 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f42e8da0 0x5587f478f430 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=23cea67018e81467 server_cookie=5b3c68b9490e964e in_seq=0 out_seq=0 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.085+0000 7f96d6000640 10 client.16320 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96d6000640 1 -- 172.21.15.84:0/1202397479 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5587f46709b0 con 0x5587f42e8da0 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96d6000640 10 client.16320 handle_command_reply: tid=0 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 client.16320 shutdown 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 msgr2=0x5587f471caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f471caf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0057c0 tx=0x7f96dc004550 comp rx=0 tx=0).stop 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 shutdown_connections 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5587f42e8da0 0x5587f478f430 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f4355070 0x5587f47166b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f4334390 0x5587f4715fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 --2- 172.21.15.84:0/1202397479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f432c1b0 0x5587f471caf0 secure :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0057c0 tx=0x7f96dc004550 comp rx=0 tx=0).stop 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 >> 172.21.15.84:0/1202397479 conn(0x5587f4349460 msgr2=0x5587f46f8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.086+0000 7f96d6000640 0 client.16320 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:53:20.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.087+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 shutdown_connections 2024-09-21T07:53:20.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.087+0000 7f96f9ac8740 1 -- 172.21.15.84:0/1202397479 wait complete. 2024-09-21T07:53:20.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.087+0000 7f96f9ac8740 20 client.16320 trim_cache size 0 max 16384 2024-09-21T07:53:20.091 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f96d00b6680 msgr2=0x7f96d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f96d00b6680 0x7f96d00b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5587f46fabf0 tx=0x7f96dc02c040 comp rx=0 tx=0).stop 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96ec109c40 msgr2=0x7f96ec19fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96ec109c40 0x7f96ec19fb50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f96e400ef00 tx=0x7f96e400c740 comp rx=0 tx=0).stop 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 shutdown_connections 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f96d00b6680 0x7f96d00b8b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96ec109c40 0x7f96ec19fb50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96ec1092f0 0x7f96ec19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 --2- 172.21.15.84:0/4058789859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96ec1039b0 0x7f96ec19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 >> 172.21.15.84:0/4058789859 conn(0x7f96ec0ff440 msgr2=0x7f96ec101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.088+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 shutdown_connections 2024-09-21T07:53:20.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.089+0000 7f96f1800640 1 -- 172.21.15.84:0/4058789859 wait complete. 2024-09-21T07:53:20.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.887+0000 7f0a6cc00640 1 -- 172.21.15.84:0/4026560233 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b8bb30c6a0 con 0x55b8baf85570 2024-09-21T07:53:20.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.887+0000 7f0a6cc00640 10 client.26348 handle_command_reply: tid=0 2024-09-21T07:53:20.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.887+0000 7f0a8c693740 1 client.26348 shutdown 2024-09-21T07:53:20.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 msgr2=0x55b8bb41d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb41d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a6802a8b0 tx=0x7f0a68005730 comp rx=0 tx=0).stop 2024-09-21T07:53:20.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 shutdown_connections 2024-09-21T07:53:20.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8baff1840 0x55b8bb41d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8bafd0b60 0x55b8bb41d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8baf85570 0x55b8bb4357d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 --2- 172.21.15.84:0/4026560233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8bafc8980 0x55b8bb41cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 >> 172.21.15.84:0/4026560233 conn(0x55b8bafe5990 msgr2=0x55b8bb39a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a6cc00640 0 client.26348 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 shutdown_connections 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.888+0000 7f0a8c693740 1 -- 172.21.15.84:0/4026560233 wait complete. 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.889+0000 7f0a8c693740 20 client.26348 trim_cache size 0 max 16384 2024-09-21T07:53:20.891 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 10, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "98677c53": { 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 10, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T07:53:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:20.893 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.889+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a640b6810 msgr2=0x7f0a640b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.889+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a640b6810 0x7f0a640b8d20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0a7801d000 tx=0x7f0a7800b360 comp rx=0 tx=0).stop 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.889+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a801039f0 msgr2=0x7f0a80113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a801039f0 0x7f0a80113610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000d950 tx=0x7f0a7000de10 comp rx=0 tx=0).stop 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 shutdown_connections 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0a640b6810 0x7f0a640b8d20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8011df20 0x7f0a8011e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a80109c80 0x7f0a80113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 --2- 172.21.15.84:0/1549285964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a801039f0 0x7f0a80113610 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 >> 172.21.15.84:0/1549285964 conn(0x7f0a800ff480 msgr2=0x7f0a801018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 shutdown_connections 2024-09-21T07:53:20.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:20.890+0000 7f0a7fe00640 1 -- 172.21.15.84:0/1549285964 wait complete. 2024-09-21T07:53:21.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:21 smithi162 ceph-mon[34833]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 265 MiB/s wr, 1.79k op/s 2024-09-21T07:53:21.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:21 smithi084 ceph-mon[30411]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 265 MiB/s wr, 1.79k op/s 2024-09-21T07:53:21.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:21 smithi191 ceph-mon[34667]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 265 MiB/s wr, 1.79k op/s 2024-09-21T07:53:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:23 smithi162 ceph-mon[34833]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 264 MiB/s wr, 2.02k op/s 2024-09-21T07:53:23.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:23 smithi084 ceph-mon[30411]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 264 MiB/s wr, 2.02k op/s 2024-09-21T07:53:23.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:23 smithi191 ceph-mon[34667]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 264 MiB/s wr, 2.02k op/s 2024-09-21T07:53:23.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:53:24.522 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '98677c53', quiesce took 14.5 seconds. Will release after: 13.3 2024-09-21T07:53:24.569 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 -- 172.21.15.84:0/2431288308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f797010b6d0 msgr2=0x7f797010bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 --2- 172.21.15.84:0/2431288308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f797010b6d0 0x7f797010bae0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f795c009900 tx=0x7f795c02a410 comp rx=0 tx=0).stop 2024-09-21T07:53:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 -- 172.21.15.84:0/2431288308 shutdown_connections 2024-09-21T07:53:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 --2- 172.21.15.84:0/2431288308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f797010c020 0x7f7970112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 --2- 172.21.15.84:0/2431288308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f797010b6d0 0x7f797010bae0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 --2- 172.21.15.84:0/2431288308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7970105d90 0x7f79701061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 -- 172.21.15.84:0/2431288308 >> 172.21.15.84:0/2431288308 conn(0x7f79701017c0 msgr2=0x7f7970103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 -- 172.21.15.84:0/2431288308 shutdown_connections 2024-09-21T07:53:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.190+0000 7f7975200640 1 -- 172.21.15.84:0/2431288308 wait complete. 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.191+0000 7f7975200640 1 Processor -- start 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.191+0000 7f7975200640 1 -- start start 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f7975200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7970105d90 0x7f797019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f7975200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f797010b6d0 0x7f797019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f7975200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f797010c020 0x7f79701a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f7975200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7970115d20 con 0x7f7970105d90 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f7975200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7970115ba0 con 0x7f797010b6d0 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f7975200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7970115ea0 con 0x7f797010c020 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7970105d90 0x7f797019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7970105d90 0x7f797019c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48154/0 (socket says 172.21.15.84:48154) 2024-09-21T07:53:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 -- 172.21.15.84:0/1678742189 learned_addr learned my addr 172.21.15.84:0/1678742189 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:25.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 -- 172.21.15.84:0/1678742189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f797010c020 msgr2=0x7f79701a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f797010c020 0x7f79701a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 -- 172.21.15.84:0/1678742189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f797010b6d0 msgr2=0x7f797019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f797010b6d0 0x7f797019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.192+0000 7f796de00640 1 -- 172.21.15.84:0/1678742189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79701a2720 con 0x7f7970105d90 2024-09-21T07:53:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.193+0000 7f796de00640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7970105d90 0x7f797019c7b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f796000e9f0 tx=0x7f796000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.193+0000 7f7966a00640 1 -- 172.21.15.84:0/1678742189 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796000cd80 con 0x7f7970105d90 2024-09-21T07:53:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.193+0000 7f7966a00640 1 -- 172.21.15.84:0/1678742189 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79600054d0 con 0x7f7970105d90 2024-09-21T07:53:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.193+0000 7f7966a00640 1 -- 172.21.15.84:0/1678742189 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960010690 con 0x7f7970105d90 2024-09-21T07:53:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.193+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79701a2a10 con 0x7f7970105d90 2024-09-21T07:53:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.193+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79701a9170 con 0x7f7970105d90 2024-09-21T07:53:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.196+0000 7f797be41740 1 Processor -- start 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f797be41740 1 -- start start 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f7966a00640 1 -- 172.21.15.84:0/1678742189 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7960004e90 con 0x7f7970105d90 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f797be41740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fb5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f797be41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fb62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f797be41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f797be41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562846f2cfb0 con 0x562846bee390 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f797be41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562846f1c3e0 con 0x562846be61b0 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f797be41740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562846f201f0 con 0x562846c0f070 2024-09-21T07:53:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f796e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fb5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f796de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fb62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f796e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fb5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56212/0 (socket says 172.21.15.84:56212) 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f796e800640 1 -- 172.21.15.84:0/3141120178 learned_addr learned my addr 172.21.15.84:0/3141120178 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.197+0000 7f796d400640 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.198+0000 7f796de00640 1 -- 172.21.15.84:0/3141120178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 msgr2=0x562846fb5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.198+0000 7f796de00640 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fb5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.198+0000 7f796de00640 1 -- 172.21.15.84:0/3141120178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 msgr2=0x562846fb6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.198+0000 7f796de00640 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.198+0000 7f796de00640 1 -- 172.21.15.84:0/3141120178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562846ee6cd0 con 0x562846be61b0 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.198+0000 7f796de00640 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fb62e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79600e5320 tx=0x7f79600ebf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e8404b9a0ca22d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.198+0000 7f795b400640 1 -- 172.21.15.84:0/3141120178 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600fb070 con 0x562846be61b0 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.199+0000 7f795b400640 1 -- 172.21.15.84:0/3141120178 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79600f0c80 con 0x562846be61b0 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.199+0000 7f795b400640 1 -- 172.21.15.84:0/3141120178 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600f5600 con 0x562846be61b0 2024-09-21T07:53:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.199+0000 7f7966a00640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f79540b6700 0x7f79540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.199+0000 7f796e800640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f79540b6700 0x7f79540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.199+0000 7f7966a00640 1 -- 172.21.15.84:0/1678742189 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f79600e7f40 con 0x7f7970105d90 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 -- 172.21.15.84:0/3141120178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 msgr2=0x562846fb62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fb62e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79600e5320 tx=0x7f79600ebf50 comp rx=0 tx=0).stop 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f796e800640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f79540b6700 0x7f79540b8c10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7968009fc0 tx=0x7f796800b040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 -- 172.21.15.84:0/3141120178 shutdown_connections 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fb62e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 --2- 172.21.15.84:0/3141120178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fb5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 -- 172.21.15.84:0/3141120178 >> 172.21.15.84:0/3141120178 conn(0x562846c03460 msgr2=0x562846fb3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 -- 172.21.15.84:0/3141120178 shutdown_connections 2024-09-21T07:53:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.200+0000 7f797be41740 1 -- 172.21.15.84:0/3141120178 wait complete. 2024-09-21T07:53:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.201+0000 7f797be41740 1 -- start start 2024-09-21T07:53:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.201+0000 7f797be41740 1 Processor -- start 2024-09-21T07:53:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.201+0000 7f797be41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846be61b0 0x562846fc1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.201+0000 7f797be41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846bee390 0x562846fc1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.201+0000 7f797be41740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fcd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.201+0000 7f797be41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562846d7d700 con 0x562846be61b0 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f797be41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562846eb7580 con 0x562846bee390 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f797be41740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562846fc4580 con 0x562846c0f070 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f797be41740 10 client.0 _ll_register_callbacks cb 0x562846ec7470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846be61b0 0x562846fc1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846be61b0 0x562846fc1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48178/0 (socket says 172.21.15.84:48178) 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 -- 172.21.15.84:0/1589347430 learned_addr learned my addr 172.21.15.84:0/1589347430 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 -- 172.21.15.84:0/1589347430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 msgr2=0x562846fcd8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fcd8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 -- 172.21.15.84:0/1589347430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846bee390 msgr2=0x562846fc1a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846bee390 0x562846fc1a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 -- 172.21.15.84:0/1589347430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562846c7a650 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f796de00640 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846be61b0 0x562846fc1500 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f79600ad9b0 tx=0x7f79600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127ff30ad25b36cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.202+0000 7f794fe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f794fe00640 1 -- 172.21.15.84:0/1589347430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600aa070 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f794fe00640 1 -- 172.21.15.84:0/1589347430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f79600b71b0 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562846eb9b90 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f794fe00640 1 -- 172.21.15.84:0/1589347430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f79600e57b0 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f797be41740 10 client.16332 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562846ed4950 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f794fe00640 1 -- 172.21.15.84:0/1589347430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562846eb9b90 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.203+0000 7f794fe00640 1 -- 172.21.15.84:0/1589347430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f79600c3bd0 con 0x562846be61b0 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.204+0000 7f797be41740 10 client.16332 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.204+0000 7f797be41740 10 client.16332 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.204+0000 7f797be41740 20 client.16332 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.204+0000 7f797be41740 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846bcd9f0 0x562846fd34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.204+0000 7f797be41740 4 client.16332 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:25.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.204+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562846f2ef00 con 0x562846bcd9f0 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.204+0000 7f796d400640 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846bcd9f0 0x562846fd34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.205+0000 7f794fe00640 10 client.16332 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.205+0000 7f796d400640 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846bcd9f0 0x562846fd34f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=87431e51f1ed0ffe server_cookie=3f54add2a36dfc41 in_seq=0 out_seq=0 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.206+0000 7f794fe00640 1 -- 172.21.15.84:0/1589347430 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562846f2ef00 con 0x562846bcd9f0 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.206+0000 7f794fe00640 10 client.16332 handle_command_reply: tid=0 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 client.16332 shutdown 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846be61b0 msgr2=0x562846fc1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846be61b0 0x562846fc1500 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f79600ad9b0 tx=0x7f79600048f0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 shutdown_connections 2024-09-21T07:53:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846bcd9f0 0x562846fd34f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fcd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846bee390 0x562846fc1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 --2- 172.21.15.84:0/1589347430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846be61b0 0x562846fc1500 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 >> 172.21.15.84:0/1589347430 conn(0x562846c03460 msgr2=0x562846fb8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f794fe00640 0 client.16332 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 shutdown_connections 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 1 -- 172.21.15.84:0/1589347430 wait complete. 2024-09-21T07:53:25.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.207+0000 7f797be41740 20 client.16332 trim_cache size 0 max 16384 2024-09-21T07:53:25.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 Processor -- start 2024-09-21T07:53:25.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 -- start start 2024-09-21T07:53:25.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fbccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fc3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79701b3040 con 0x562846bee390 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79701b4b80 con 0x562846be61b0 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f797be41740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79701b3710 con 0x562846c0f070 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f796d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f796e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fc3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f796d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48182/0 (socket says 172.21.15.84:48182) 2024-09-21T07:53:25.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f796e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fc3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56234/0 (socket says 172.21.15.84:56234) 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f796d400640 1 -- 172.21.15.84:0/840452269 learned_addr learned my addr 172.21.15.84:0/840452269 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.222+0000 7f796de00640 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fbccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f796d400640 1 -- 172.21.15.84:0/840452269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 msgr2=0x562846fc3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f796d400640 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fc3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f796d400640 1 -- 172.21.15.84:0/840452269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 msgr2=0x562846fbccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f796d400640 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fbccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f796d400640 1 -- 172.21.15.84:0/840452269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562846fbfa00 con 0x562846bee390 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f796d400640 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb95c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f795c005f70 tx=0x7f795c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675d2e730fb5f883 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f795aa00640 1 -- 172.21.15.84:0/840452269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c035040 con 0x562846bee390 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f795aa00640 1 -- 172.21.15.84:0/840452269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f795c0314a0 con 0x562846bee390 2024-09-21T07:53:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.223+0000 7f795aa00640 1 -- 172.21.15.84:0/840452269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c003850 con 0x562846bee390 2024-09-21T07:53:25.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.224+0000 7f797be41740 1 -- 172.21.15.84:0/840452269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 msgr2=0x562846fb95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.224+0000 7f797be41740 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb95c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f795c005f70 tx=0x7f795c031400 comp rx=0 tx=0).stop 2024-09-21T07:53:25.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.224+0000 7f797be41740 1 -- 172.21.15.84:0/840452269 shutdown_connections 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.224+0000 7f797be41740 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fc3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.224+0000 7f797be41740 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fb95c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.224+0000 7f797be41740 1 --2- 172.21.15.84:0/840452269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fbccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.224+0000 7f797be41740 1 -- 172.21.15.84:0/840452269 >> 172.21.15.84:0/840452269 conn(0x562846c03460 msgr2=0x562846fc2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.225+0000 7f797be41740 1 -- 172.21.15.84:0/840452269 shutdown_connections 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.225+0000 7f797be41740 1 -- 172.21.15.84:0/840452269 wait complete. 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.225+0000 7f797be41740 1 -- start start 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.225+0000 7f797be41740 1 Processor -- start 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f797be41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fd4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f797be41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fd4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f797be41740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fd5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f797be41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79701b44b0 con 0x562846bee390 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f797be41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79701b3de0 con 0x562846be61b0 2024-09-21T07:53:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f797be41740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79701b1000 con 0x562846c0f070 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f797be41740 10 client.0 _ll_register_callbacks cb 0x7f7968009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f796d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fd4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f796d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fd4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48190/0 (socket says 172.21.15.84:48190) 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f796d400640 1 -- 172.21.15.84:0/1614234297 learned_addr learned my addr 172.21.15.84:0/1614234297 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f796de00640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fd4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.226+0000 7f796e800640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fd5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796d400640 1 -- 172.21.15.84:0/1614234297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 msgr2=0x562846fd5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796d400640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fd5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796d400640 1 -- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 msgr2=0x562846fd4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796d400640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fd4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796d400640 1 -- 172.21.15.84:0/1614234297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56284703cd70 con 0x562846bee390 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796e800640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fd5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796de00640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fd4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f796d400640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fd4b40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f795c006010 tx=0x7f795c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bf45f9221c5eac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f794fe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f794fe00640 1 -- 172.21.15.84:0/1614234297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c04f070 con 0x562846bee390 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f794fe00640 1 -- 172.21.15.84:0/1614234297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f795c031650 con 0x562846bee390 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.227+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f795c0314a0 con 0x562846bee390 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f794fe00640 1 -- 172.21.15.84:0/1614234297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f795c05b050 con 0x562846bee390 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 10 client.16338 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56284703dfd0 con 0x562846bee390 2024-09-21T07:53:25.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f794fe00640 1 -- 172.21.15.84:0/1614234297 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f795c0314a0 con 0x562846bee390 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f794fe00640 1 -- 172.21.15.84:0/1614234297 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f795c04b420 con 0x562846bee390 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 10 client.16338 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 10 client.16338 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 20 client.16338 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846ba2da0 0x5628470406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 4 client.16338 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.228+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562846fc1e70 con 0x562846ba2da0 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.229+0000 7f796de00640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846ba2da0 0x5628470406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.230+0000 7f796de00640 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846ba2da0 0x5628470406e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d1dc61e36fcf1e04 server_cookie=85f82ba4b8142003 in_seq=0 out_seq=0 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.230+0000 7f794fe00640 10 client.16338 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f794fe00640 1 -- 172.21.15.84:0/1614234297 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562846fc1e70 con 0x562846ba2da0 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f794fe00640 10 client.16338 handle_command_reply: tid=0 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 client.16338 shutdown 2024-09-21T07:53:25.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 msgr2=0x562846fd4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fd4b40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f795c006010 tx=0x7f795c009680 comp rx=0 tx=0).stop 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 shutdown_connections 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x562846ba2da0 0x5628470406e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562846c0f070 0x562846fd5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562846bee390 0x562846fd4b40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 --2- 172.21.15.84:0/1614234297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562846be61b0 0x562846fd4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 >> 172.21.15.84:0/1614234297 conn(0x562846c03460 msgr2=0x562846fb9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f794fe00640 0 client.16338 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 shutdown_connections 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.231+0000 7f797be41740 1 -- 172.21.15.84:0/1614234297 wait complete. 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f797be41740 20 client.16338 trim_cache size 0 max 16384 2024-09-21T07:53:25.235 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:53:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f79540b6700 msgr2=0x7f79540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f79540b6700 0x7f79540b8c10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7968009fc0 tx=0x7f796800b040 comp rx=0 tx=0).stop 2024-09-21T07:53:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7970105d90 msgr2=0x7f797019c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7970105d90 0x7f797019c7b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f796000e9f0 tx=0x7f796000edf0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 shutdown_connections 2024-09-21T07:53:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f79540b6700 0x7f79540b8c10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f797010c020 0x7f79701a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f797010b6d0 0x7f797019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 --2- 172.21.15.84:0/1678742189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7970105d90 0x7f797019c7b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 >> 172.21.15.84:0/1678742189 conn(0x7f79701017c0 msgr2=0x7f7970108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.232+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 shutdown_connections 2024-09-21T07:53:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:25.233+0000 7f7975200640 1 -- 172.21.15.84:0/1678742189 wait complete. 2024-09-21T07:53:25.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:25 smithi084 ceph-mon[30411]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 246 MiB/s wr, 2.00k op/s 2024-09-21T07:53:25.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:25 smithi162 ceph-mon[34833]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 246 MiB/s wr, 2.00k op/s 2024-09-21T07:53:25.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:25 smithi191 ceph-mon[34667]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 246 MiB/s wr, 2.00k op/s 2024-09-21T07:53:26.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.265+0000 7fb4dde00640 1 -- 172.21.15.84:0/913027167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 msgr2=0x7fb4d8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.265+0000 7fb4dde00640 1 --2- 172.21.15.84:0/913027167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d8109650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009900 tx=0x7fb4c402a410 comp rx=0 tx=0).stop 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.265+0000 7fb4dde00640 1 -- 172.21.15.84:0/913027167 shutdown_connections 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.265+0000 7fb4dde00640 1 --2- 172.21.15.84:0/913027167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d8109b90 0x7fb4d81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.265+0000 7fb4dde00640 1 --2- 172.21.15.84:0/913027167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d8109650 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.265+0000 7fb4dde00640 1 --2- 172.21.15.84:0/913027167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d8103910 0x7fb4d8103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.265+0000 7fb4dde00640 1 -- 172.21.15.84:0/913027167 >> 172.21.15.84:0/913027167 conn(0x7fb4d80ff330 msgr2=0x7fb4d8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.266+0000 7fb4dde00640 1 -- 172.21.15.84:0/913027167 shutdown_connections 2024-09-21T07:53:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.266+0000 7fb4dde00640 1 -- 172.21.15.84:0/913027167 wait complete. 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 Processor -- start 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 -- start start 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d8103910 0x7fb4d819c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d8109b90 0x7fb4d81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d8113850 con 0x7fb4d8109240 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81136d0 con 0x7fb4d8109b90 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.267+0000 7fb4dde00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81139d0 con 0x7fb4d8103910 2024-09-21T07:53:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d819ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48196/0 (socket says 172.21.15.84:48196) 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 -- 172.21.15.84:0/247774311 learned_addr learned my addr 172.21.15.84:0/247774311 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4dca00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d8103910 0x7fb4d819c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4dd400640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d8109b90 0x7fb4d81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 -- 172.21.15.84:0/247774311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d8103910 msgr2=0x7fb4d819c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d8103910 0x7fb4d819c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 -- 172.21.15.84:0/247774311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d8109b90 msgr2=0x7fb4d81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d8109b90 0x7fb4d81a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4d7e00640 1 -- 172.21.15.84:0/247774311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d81a23c0 con 0x7fb4d8109240 2024-09-21T07:53:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.268+0000 7fb4dca00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d8103910 0x7fb4d819c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.269+0000 7fb4d7e00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d819ca30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb4c402a930 tx=0x7fb4c4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.269+0000 7fb4d5600640 1 -- 172.21.15.84:0/247774311 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c403f030 con 0x7fb4d8109240 2024-09-21T07:53:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.269+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d81a2650 con 0x7fb4d8109240 2024-09-21T07:53:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.269+0000 7fb4d5600640 1 -- 172.21.15.84:0/247774311 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4c4004490 con 0x7fb4d8109240 2024-09-21T07:53:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.269+0000 7fb4d5600640 1 -- 172.21.15.84:0/247774311 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4035070 con 0x7fb4d8109240 2024-09-21T07:53:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.269+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d81a8e40 con 0x7fb4d8109240 2024-09-21T07:53:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.273+0000 7fb4d5600640 1 -- 172.21.15.84:0/247774311 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb4c4042030 con 0x7fb4d8109240 2024-09-21T07:53:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 Processor -- start 2024-09-21T07:53:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 -- start start 2024-09-21T07:53:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e445fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e4460350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4460890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4d5600640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb4c00b6680 0x7fb4c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d8e43d56b0 con 0x55d8e409a4d0 2024-09-21T07:53:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d8e43c4ae0 con 0x55d8e40922f0 2024-09-21T07:53:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.274+0000 7fb4e6477740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d8e43c88f0 con 0x55d8e40bb1b0 2024-09-21T07:53:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4d5600640 1 -- 172.21.15.84:0/247774311 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb4c4107db0 con 0x7fb4d8109240 2024-09-21T07:53:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4460890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4d7e00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb4c00b6680 0x7fb4c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4460890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48202/0 (socket says 172.21.15.84:48202) 2024-09-21T07:53:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 -- 172.21.15.84:0/3358243594 learned_addr learned my addr 172.21.15.84:0/3358243594 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e445fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dca00640 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e4460350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 -- 172.21.15.84:0/3358243594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 msgr2=0x55d8e445fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e445fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 -- 172.21.15.84:0/3358243594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 msgr2=0x55d8e4460350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e4460350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dd400640 1 -- 172.21.15.84:0/3358243594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e4391780 con 0x55d8e409a4d0 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.275+0000 7fb4dca00640 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e4460350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.276+0000 7fb4d7e00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb4c00b6680 0x7fb4c00b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40c9f10 tx=0x7fb4c4009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.276+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4460890 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0005f40 tx=0x7fb4d0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d8f388f757e2c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.276+0000 7fb4c9c00640 1 -- 172.21.15.84:0/3358243594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0011070 con 0x55d8e409a4d0 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.276+0000 7fb4c9c00640 1 -- 172.21.15.84:0/3358243594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d0003e20 con 0x55d8e409a4d0 2024-09-21T07:53:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.276+0000 7fb4c9c00640 1 -- 172.21.15.84:0/3358243594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0004050 con 0x55d8e409a4d0 2024-09-21T07:53:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.277+0000 7fb4e6477740 1 -- 172.21.15.84:0/3358243594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 msgr2=0x55d8e4460890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.277+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4460890 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0005f40 tx=0x7fb4d0009b80 comp rx=0 tx=0).stop 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.278+0000 7fb4e6477740 1 -- 172.21.15.84:0/3358243594 shutdown_connections 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.278+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4460890 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.278+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e4460350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.278+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3358243594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e445fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.278+0000 7fb4e6477740 1 -- 172.21.15.84:0/3358243594 >> 172.21.15.84:0/3358243594 conn(0x55d8e40af300 msgr2=0x55d8e445dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.278+0000 7fb4e6477740 1 -- 172.21.15.84:0/3358243594 shutdown_connections 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.278+0000 7fb4e6477740 1 -- 172.21.15.84:0/3358243594 wait complete. 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.279+0000 7fb4e6477740 1 -- start start 2024-09-21T07:53:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.279+0000 7fb4e6477740 1 Processor -- start 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e446b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e409a4d0 0x55d8e446b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40bb1b0 0x55d8e446beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4e6477740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d8e42fcab0 con 0x55d8e40bb1b0 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4e6477740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d8e436b570 con 0x55d8e40922f0 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4e6477740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d8e446e590 con 0x55d8e409a4d0 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4e6477740 10 client.0 _ll_register_callbacks cb 0x55d8e437a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40bb1b0 0x55d8e446beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40bb1b0 0x55d8e446beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48204/0 (socket says 172.21.15.84:48204) 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4dd400640 1 -- 172.21.15.84:0/3359822133 learned_addr learned my addr 172.21.15.84:0/3359822133 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4dca00640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e409a4d0 0x55d8e446b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.280+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e446b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4dca00640 1 -- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 msgr2=0x55d8e446b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4dca00640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e446b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4dca00640 1 -- 172.21.15.84:0/3359822133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40bb1b0 msgr2=0x55d8e446beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4dca00640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40bb1b0 0x55d8e446beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4dca00640 1 -- 172.21.15.84:0/3359822133 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e4126790 con 0x55d8e409a4d0 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40bb1b0 0x55d8e446beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4dca00640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e409a4d0 0x55d8e446b950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc013980 tx=0x7fb4cc013e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf4825bcd62e04be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4be000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4be000640 1 -- 172.21.15.84:0/3359822133 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc011d50 con 0x55d8e409a4d0 2024-09-21T07:53:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4d0003e20 con 0x55d8e409a4d0 2024-09-21T07:53:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.281+0000 7fb4be000640 1 -- 172.21.15.84:0/3359822133 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb4cc005020 con 0x55d8e409a4d0 2024-09-21T07:53:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4be000640 1 -- 172.21.15.84:0/3359822133 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb4cc026050 con 0x55d8e409a4d0 2024-09-21T07:53:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 10 client.26404 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8e419f620 con 0x55d8e409a4d0 2024-09-21T07:53:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4be000640 1 -- 172.21.15.84:0/3359822133 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d0003e20 con 0x55d8e409a4d0 2024-09-21T07:53:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4be000640 1 -- 172.21.15.84:0/3359822133 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb4cc01b410 con 0x55d8e409a4d0 2024-09-21T07:53:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 10 client.26404 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 10 client.26404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 20 client.26404 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e4079d80 0x55d8e447d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 4 client.26404 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.282+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8e43d7600 con 0x55d8e4079d80 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.283+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e4079d80 0x55d8e447d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.283+0000 7fb4dd400640 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e4079d80 0x55d8e447d680 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89ccaff39337532 server_cookie=81c842fb7e2c5fde in_seq=0 out_seq=0 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.283+0000 7fb4be000640 10 client.26404 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.284+0000 7fb4be000640 1 -- 172.21.15.84:0/3359822133 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8e43d7600 con 0x55d8e4079d80 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.284+0000 7fb4be000640 10 client.26404 handle_command_reply: tid=0 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.284+0000 7fb4e6477740 1 client.26404 shutdown 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e409a4d0 msgr2=0x55d8e446b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e409a4d0 0x55d8e446b950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc013980 tx=0x7fb4cc013e40 comp rx=0 tx=0).stop 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 shutdown_connections 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40bb1b0 0x55d8e446beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e4079d80 0x55d8e447d680 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e409a4d0 0x55d8e446b950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 --2- 172.21.15.84:0/3359822133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40922f0 0x55d8e446b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4be000640 0 client.26404 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 >> 172.21.15.84:0/3359822133 conn(0x55d8e40af300 msgr2=0x55d8e4460e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 shutdown_connections 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 1 -- 172.21.15.84:0/3359822133 wait complete. 2024-09-21T07:53:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.285+0000 7fb4e6477740 20 client.26404 trim_cache size 0 max 16384 2024-09-21T07:53:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 Processor -- start 2024-09-21T07:53:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 -- start start 2024-09-21T07:53:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40922f0 0x55d8e446d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e409a4d0 0x55d8e446b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e446be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81b2d40 con 0x55d8e40922f0 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81b4880 con 0x55d8e409a4d0 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4e6477740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81b3410 con 0x55d8e40bb1b0 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40922f0 0x55d8e446d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.302+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40922f0 0x55d8e446d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48218/0 (socket says 172.21.15.84:48218) 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 -- 172.21.15.84:0/646494572 learned_addr learned my addr 172.21.15.84:0/646494572 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dca00640 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e409a4d0 0x55d8e446b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e446be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 -- 172.21.15.84:0/646494572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 msgr2=0x55d8e446be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e446be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 -- 172.21.15.84:0/646494572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e409a4d0 msgr2=0x55d8e446b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e409a4d0 0x55d8e446b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 -- 172.21.15.84:0/646494572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e446dd60 con 0x55d8e40922f0 2024-09-21T07:53:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.303+0000 7fb4dd400640 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40922f0 0x55d8e446d040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0002210 tx=0x7fb4d0011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53bed0e8da4bf60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.304+0000 7fb4c9200640 1 -- 172.21.15.84:0/646494572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d001f920 con 0x55d8e40922f0 2024-09-21T07:53:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.304+0000 7fb4c9200640 1 -- 172.21.15.84:0/646494572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d0005070 con 0x55d8e40922f0 2024-09-21T07:53:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.304+0000 7fb4c9200640 1 -- 172.21.15.84:0/646494572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d002d690 con 0x55d8e40922f0 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 -- 172.21.15.84:0/646494572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40922f0 msgr2=0x55d8e446d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40922f0 0x55d8e446d040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0002210 tx=0x7fb4d0011440 comp rx=0 tx=0).stop 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 -- 172.21.15.84:0/646494572 shutdown_connections 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40bb1b0 0x55d8e446be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e409a4d0 0x55d8e446b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 --2- 172.21.15.84:0/646494572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e40922f0 0x55d8e446d040 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 -- 172.21.15.84:0/646494572 >> 172.21.15.84:0/646494572 conn(0x55d8e40af300 msgr2=0x55d8e446c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 -- 172.21.15.84:0/646494572 shutdown_connections 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.305+0000 7fb4e6477740 1 -- 172.21.15.84:0/646494572 wait complete. 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.306+0000 7fb4e6477740 1 -- start start 2024-09-21T07:53:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.306+0000 7fb4e6477740 1 Processor -- start 2024-09-21T07:53:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40922f0 0x55d8e4471270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4471810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4e6477740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40bb1b0 0x55d8e44e0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4e6477740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81b41b0 con 0x55d8e409a4d0 2024-09-21T07:53:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4e6477740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81b3ae0 con 0x55d8e40bb1b0 2024-09-21T07:53:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4e6477740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d81b0d00 con 0x55d8e40922f0 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4e6477740 10 client.0 _ll_register_callbacks cb 0x7fb4cc009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4471810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4471810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48224/0 (socket says 172.21.15.84:48224) 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 -- 172.21.15.84:0/1230405501 learned_addr learned my addr 172.21.15.84:0/1230405501 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dd400640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40bb1b0 0x55d8e44e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dd400640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40922f0 0x55d8e4471270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 -- 172.21.15.84:0/1230405501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40922f0 msgr2=0x55d8e4471270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40922f0 0x55d8e4471270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 -- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40bb1b0 msgr2=0x55d8e44e0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40bb1b0 0x55d8e44e0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dca00640 1 -- 172.21.15.84:0/1230405501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e44e06d0 con 0x55d8e409a4d0 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.307+0000 7fb4dd400640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40bb1b0 0x55d8e44e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4dca00640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4471810 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc01b9f0 tx=0x7fb4cc011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec4c89f778f0130 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4be000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4be000640 1 -- 172.21.15.84:0/1230405501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc01bc70 con 0x55d8e409a4d0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4be000640 1 -- 172.21.15.84:0/1230405501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb4cc005040 con 0x55d8e409a4d0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4d0005070 con 0x55d8e409a4d0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4be000640 1 -- 172.21.15.84:0/1230405501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb4cc039050 con 0x55d8e409a4d0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4e6477740 10 client.16356 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.308+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8e44e7b20 con 0x55d8e409a4d0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4be000640 1 -- 172.21.15.84:0/1230405501 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d0005070 con 0x55d8e409a4d0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4be000640 1 -- 172.21.15.84:0/1230405501 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb4cc0049d0 con 0x55d8e409a4d0 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4e6477740 10 client.16356 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4e6477740 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4e6477740 20 client.16356 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4e6477740 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e404f1c0 0x55d8e44ea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4e6477740 4 client.16356 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:53:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8e43d30b0 con 0x55d8e404f1c0 2024-09-21T07:53:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.309+0000 7fb4dd400640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e404f1c0 0x55d8e44ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.310+0000 7fb4dd400640 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e404f1c0 0x55d8e44ea390 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15ae3e98ee66bb1e server_cookie=761d8bf4432a5394 in_seq=0 out_seq=0 2024-09-21T07:53:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.310+0000 7fb4be000640 10 client.16356 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4be000640 1 -- 172.21.15.84:0/1230405501 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8e43d30b0 con 0x55d8e404f1c0 2024-09-21T07:53:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4be000640 10 client.16356 handle_command_reply: tid=0 2024-09-21T07:53:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 client.16356 shutdown 2024-09-21T07:53:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 msgr2=0x55d8e4471810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4471810 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc01b9f0 tx=0x7fb4cc011d50 comp rx=0 tx=0).stop 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 shutdown_connections 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d8e40bb1b0 0x55d8e44e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8e409a4d0 0x55d8e4471810 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d8e404f1c0 0x55d8e44ea390 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 --2- 172.21.15.84:0/1230405501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e40922f0 0x55d8e4471270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4be000640 0 client.16356 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 >> 172.21.15.84:0/1230405501 conn(0x55d8e40af300 msgr2=0x55d8e445c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 shutdown_connections 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 1 -- 172.21.15.84:0/1230405501 wait complete. 2024-09-21T07:53:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.324+0000 7fb4e6477740 20 client.16356 trim_cache size 0 max 16384 2024-09-21T07:53:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:53:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:53:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:53:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:53:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.325+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb4c00b6680 msgr2=0x7fb4c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb4c00b6680 0x7fb4c00b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40c9f10 tx=0x7fb4c4009260 comp rx=0 tx=0).stop 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 msgr2=0x7fb4d819ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d819ca30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb4c402a930 tx=0x7fb4c4031a20 comp rx=0 tx=0).stop 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 shutdown_connections 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb4c00b6680 0x7fb4c00b8b90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d8109b90 0x7fb4d81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4d8109240 0x7fb4d819ca30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 --2- 172.21.15.84:0/247774311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d8103910 0x7fb4d819c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 >> 172.21.15.84:0/247774311 conn(0x7fb4d80ff330 msgr2=0x7fb4d810e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 shutdown_connections 2024-09-21T07:53:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:26.326+0000 7fb4dde00640 1 -- 172.21.15.84:0/247774311 wait complete. 2024-09-21T07:53:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:27.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 -- 172.21.15.84:0/3050758558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490078290 msgr2=0x7f4490114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 --2- 172.21.15.84:0/3050758558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490078290 0x7f4490114210 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f447c009900 tx=0x7f447c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 -- 172.21.15.84:0/3050758558 shutdown_connections 2024-09-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 --2- 172.21.15.84:0/3050758558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4490114750 0x7f4490116b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 --2- 172.21.15.84:0/3050758558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490078290 0x7f4490114210 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 --2- 172.21.15.84:0/3050758558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490077940 0x7f4490077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 -- 172.21.15.84:0/3050758558 >> 172.21.15.84:0/3050758558 conn(0x7f44901017c0 msgr2=0x7f4490103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 -- 172.21.15.84:0/3050758558 shutdown_connections 2024-09-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.048+0000 7f4497600640 1 -- 172.21.15.84:0/3050758558 wait complete. 2024-09-21T07:53:27.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.049+0000 7f4497600640 1 Processor -- start 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.049+0000 7f4497600640 1 -- start start 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4497600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490077940 0x7f44901a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4497600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490078290 0x7f44901a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4497600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4490114750 0x7f44901a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4497600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f449011a0e0 con 0x7f4490077940 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4497600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4490119f60 con 0x7f4490078290 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4497600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f449011a260 con 0x7f4490114750 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4494c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490077940 0x7f44901a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4494c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490077940 0x7f44901a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48228/0 (socket says 172.21.15.84:48228) 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4494c00640 1 -- 172.21.15.84:0/3389524738 learned_addr learned my addr 172.21.15.84:0/3389524738 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f448fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490078290 0x7f44901a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.050+0000 7f4495600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4490114750 0x7f44901a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f4494c00640 1 -- 172.21.15.84:0/3389524738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4490114750 msgr2=0x7f44901a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f4494c00640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4490114750 0x7f44901a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f4494c00640 1 -- 172.21.15.84:0/3389524738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490078290 msgr2=0x7f44901a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f4494c00640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490078290 0x7f44901a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f4494c00640 1 -- 172.21.15.84:0/3389524738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44901a6a20 con 0x7f4490077940 2024-09-21T07:53:27.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f4494c00640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490077940 0x7f44901a0ab0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f448000d770 tx=0x7f448000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f448d600640 1 -- 172.21.15.84:0/3389524738 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480017070 con 0x7f4490077940 2024-09-21T07:53:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f448d600640 1 -- 172.21.15.84:0/3389524738 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44800054d0 con 0x7f4490077940 2024-09-21T07:53:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44901a6d10 con 0x7f4490077940 2024-09-21T07:53:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.051+0000 7f448d600640 1 -- 172.21.15.84:0/3389524738 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480004c30 con 0x7f4490077940 2024-09-21T07:53:27.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.052+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44901ad470 con 0x7f4490077940 2024-09-21T07:53:27.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 Processor -- start 2024-09-21T07:53:27.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 -- start start 2024-09-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f448d600640 1 -- 172.21.15.84:0/3389524738 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4480004e10 con 0x7f4490077940 2024-09-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f72da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306ba31b0 0x562306f732e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f73820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562306ee9fb0 con 0x562306bab390 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562306ed93e0 con 0x562306bcc070 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.055+0000 7f449e271740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562306edd1f0 con 0x562306ba31b0 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f73820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f73820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48240/0 (socket says 172.21.15.84:48240) 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 -- 172.21.15.84:0/1506780242 learned_addr learned my addr 172.21.15.84:0/1506780242 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f4494c00640 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306ba31b0 0x562306f732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f4495600640 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f72da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 -- 172.21.15.84:0/1506780242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306ba31b0 msgr2=0x562306f732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306ba31b0 0x562306f732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 -- 172.21.15.84:0/1506780242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 msgr2=0x562306f72da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f72da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 -- 172.21.15.84:0/1506780242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562306ea3cd0 con 0x562306bab390 2024-09-21T07:53:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f4495600640 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f72da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.056+0000 7f448fe00640 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f73820 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f447c005ab0 tx=0x7f447c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3c8ba322f7870e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.057+0000 7f4485c00640 1 -- 172.21.15.84:0/1506780242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c035040 con 0x562306bab390 2024-09-21T07:53:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.057+0000 7f4485c00640 1 -- 172.21.15.84:0/1506780242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447c0054f0 con 0x562306bab390 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.057+0000 7f4485c00640 1 -- 172.21.15.84:0/1506780242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c0035f0 con 0x562306bab390 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.057+0000 7f448d600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f44740b6700 0x7f44740b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f448d600640 1 -- 172.21.15.84:0/3389524738 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f44800e74d0 con 0x7f4490077940 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f4495600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f44740b6700 0x7f44740b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 -- 172.21.15.84:0/1506780242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 msgr2=0x562306f73820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f73820 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f447c005ab0 tx=0x7f447c004170 comp rx=0 tx=0).stop 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 -- 172.21.15.84:0/1506780242 shutdown_connections 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f73820 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306ba31b0 0x562306f732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 --2- 172.21.15.84:0/1506780242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f72da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 -- 172.21.15.84:0/1506780242 >> 172.21.15.84:0/1506780242 conn(0x562306bc0460 msgr2=0x562306f70c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 -- 172.21.15.84:0/1506780242 shutdown_connections 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f449e271740 1 -- 172.21.15.84:0/1506780242 wait complete. 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.058+0000 7f4495600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f44740b6700 0x7f44740b8c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4488005fd0 tx=0x7f4488009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.059+0000 7f449e271740 1 -- start start 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.059+0000 7f449e271740 1 Processor -- start 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.059+0000 7f449e271740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306ba31b0 0x562306f7e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.059+0000 7f449e271740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f7ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.059+0000 7f449e271740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f8a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f449e271740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562306d3a700 con 0x562306ba31b0 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f449e271740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562306e74580 con 0x562306bcc070 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f449e271740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562306f81520 con 0x562306bab390 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f449e271740 10 client.0 _ll_register_callbacks cb 0x562306e84470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f4494c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306ba31b0 0x562306f7e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f448fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f7ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f4494c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306ba31b0 0x562306f7e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48242/0 (socket says 172.21.15.84:48242) 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f448fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f7ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:56314/0 (socket says 172.21.15.84:56314) 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f4494c00640 1 -- 172.21.15.84:0/1454849123 learned_addr learned my addr 172.21.15.84:0/1454849123 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f4495600640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f8a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f448fe00640 1 -- 172.21.15.84:0/1454849123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 msgr2=0x562306f8a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f448fe00640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f8a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f448fe00640 1 -- 172.21.15.84:0/1454849123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306ba31b0 msgr2=0x562306f7e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f448fe00640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306ba31b0 0x562306f7e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f448fe00640 1 -- 172.21.15.84:0/1454849123 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562306c37650 con 0x562306bab390 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f4494c00640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306ba31b0 0x562306f7e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.060+0000 7f4495600640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f8a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:27.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.061+0000 7f448fe00640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f7ea50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f447c02a910 tx=0x7f447c009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32b7282e62a95c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.061+0000 7f447a000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.061+0000 7f447a000640 1 -- 172.21.15.84:0/1454849123 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c035070 con 0x562306bab390 2024-09-21T07:53:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.061+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562306e76b90 con 0x562306bab390 2024-09-21T07:53:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.061+0000 7f447a000640 1 -- 172.21.15.84:0/1454849123 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f447c0037f0 con 0x562306bab390 2024-09-21T07:53:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.061+0000 7f447a000640 1 -- 172.21.15.84:0/1454849123 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f447c0039f0 con 0x562306bab390 2024-09-21T07:53:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.061+0000 7f449e271740 10 client.26422 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562306e91950 con 0x562306bab390 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f447a000640 1 -- 172.21.15.84:0/1454849123 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562306e76b90 con 0x562306bab390 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f447a000640 1 -- 172.21.15.84:0/1454849123 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f447c005470 con 0x562306bab390 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f449e271740 10 client.26422 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f449e271740 10 client.26422 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f449e271740 20 client.26422 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f449e271740 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b8a9f0 0x562306f90420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f449e271740 4 client.26422 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.062+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562306eebf00 con 0x562306b8a9f0 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.063+0000 7f4494c00640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b8a9f0 0x562306f90420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.063+0000 7f4494c00640 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b8a9f0 0x562306f90420 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8df8d4755ee3e96 server_cookie=7eb2fc4136d439a4 in_seq=0 out_seq=0 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.063+0000 7f447a000640 10 client.26422 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f447a000640 1 -- 172.21.15.84:0/1454849123 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562306eebf00 con 0x562306b8a9f0 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f447a000640 10 client.26422 handle_command_reply: tid=0 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 client.26422 shutdown 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 msgr2=0x562306f7ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f7ea50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f447c02a910 tx=0x7f447c009610 comp rx=0 tx=0).stop 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 shutdown_connections 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b8a9f0 0x562306f90420 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306bcc070 0x562306f8a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f447a000640 0 client.26422 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f7ea50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 --2- 172.21.15.84:0/1454849123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306ba31b0 0x562306f7e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.064+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 >> 172.21.15.84:0/1454849123 conn(0x562306bc0460 msgr2=0x562306f75f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.065+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 shutdown_connections 2024-09-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.065+0000 7f449e271740 1 -- 172.21.15.84:0/1454849123 wait complete. 2024-09-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.065+0000 7f449e271740 20 client.26422 trim_cache size 0 max 16384 2024-09-21T07:53:27.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.078+0000 7f449e271740 1 Processor -- start 2024-09-21T07:53:27.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f449e271740 1 -- start start 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f449e271740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f80140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f449e271740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f7b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f449e271740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bcc070 0x562306f7bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f449e271740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f44901b7280 con 0x562306bab390 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f449e271740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44901b8dc0 con 0x562306ba31b0 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f449e271740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f44901b7950 con 0x562306bcc070 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f448fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f7b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f448fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f7b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48244/0 (socket says 172.21.15.84:48244) 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f448fe00640 1 -- 172.21.15.84:0/1232593776 learned_addr learned my addr 172.21.15.84:0/1232593776 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.079+0000 7f4495600640 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bcc070 0x562306f7bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f448fe00640 1 -- 172.21.15.84:0/1232593776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bcc070 msgr2=0x562306f7bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:27.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f448fe00640 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bcc070 0x562306f7bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f448fe00640 1 -- 172.21.15.84:0/1232593776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 msgr2=0x562306f80140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f448fe00640 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f80140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f448fe00640 1 -- 172.21.15.84:0/1232593776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562306f75090 con 0x562306bab390 2024-09-21T07:53:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f4495600640 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bcc070 0x562306f7bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:27.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f448fe00640 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f7b700 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f447c005940 tx=0x7f447c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2594009d994b716 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f4485200640 1 -- 172.21.15.84:0/1232593776 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c05d070 con 0x562306bab390 2024-09-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f4485200640 1 -- 172.21.15.84:0/1232593776 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447c04a070 con 0x562306bab390 2024-09-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.080+0000 7f4485200640 1 -- 172.21.15.84:0/1232593776 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c035040 con 0x562306bab390 2024-09-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 -- 172.21.15.84:0/1232593776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 msgr2=0x562306f7b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f7b700 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f447c005940 tx=0x7f447c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 -- 172.21.15.84:0/1232593776 shutdown_connections 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bcc070 0x562306f7bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bab390 0x562306f7b700 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 --2- 172.21.15.84:0/1232593776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f80140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 -- 172.21.15.84:0/1232593776 >> 172.21.15.84:0/1232593776 conn(0x562306bc0460 msgr2=0x562306f7fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 -- 172.21.15.84:0/1232593776 shutdown_connections 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.081+0000 7f449e271740 1 -- 172.21.15.84:0/1232593776 wait complete. 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.082+0000 7f449e271740 1 -- start start 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.082+0000 7f449e271740 1 Processor -- start 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f449e271740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f93c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f449e271740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f91120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f449e271740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bcc070 0x562306f91680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f449e271740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f44901b86f0 con 0x562306bcc070 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f449e271740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44901b8020 con 0x562306ba31b0 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f449e271740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f44901b5240 con 0x562306bab390 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f449e271740 10 client.0 _ll_register_callbacks cb 0x7f447c005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f4495600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bcc070 0x562306f91680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f4495600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bcc070 0x562306f91680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48248/0 (socket says 172.21.15.84:48248) 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f4495600640 1 -- 172.21.15.84:0/2111527574 learned_addr learned my addr 172.21.15.84:0/2111527574 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f448fe00640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f91120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.083+0000 7f4494c00640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f93c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f4495600640 1 -- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 msgr2=0x562306f91120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f4495600640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f91120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f4495600640 1 -- 172.21.15.84:0/2111527574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 msgr2=0x562306f93c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f4495600640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f93c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f4495600640 1 -- 172.21.15.84:0/2111527574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562306f91e10 con 0x562306bcc070 2024-09-21T07:53:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f448fe00640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f91120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f4494c00640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f93c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f4495600640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bcc070 0x562306f91680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4488012e30 tx=0x7f4488004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab1bd4e0b4302f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f447a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f447a000640 1 -- 172.21.15.84:0/2111527574 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448801f860 con 0x562306bcc070 2024-09-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f447c04a070 con 0x562306bcc070 2024-09-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f447a000640 1 -- 172.21.15.84:0/2111527574 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f448801fa00 con 0x562306bcc070 2024-09-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.084+0000 7f447a000640 1 -- 172.21.15.84:0/2111527574 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f448801fc00 con 0x562306bcc070 2024-09-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 10 client.16374 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562306ffabb0 con 0x562306bcc070 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f447a000640 1 -- 172.21.15.84:0/2111527574 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447c04a070 con 0x562306bcc070 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f447a000640 1 -- 172.21.15.84:0/2111527574 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4488028070 con 0x562306bcc070 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 10 client.16374 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 10 client.16374 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 20 client.16374 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b5fda0 0x562306ffd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 4 client.16374 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.085+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562306ee79b0 con 0x562306b5fda0 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.086+0000 7f4494c00640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b5fda0 0x562306ffd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.086+0000 7f4494c00640 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b5fda0 0x562306ffd3a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=769a6db3cec893ef server_cookie=1b8d91d2e88b7de8 in_seq=0 out_seq=0 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.086+0000 7f447a000640 10 client.16374 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f447a000640 1 -- 172.21.15.84:0/2111527574 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562306ee79b0 con 0x562306b5fda0 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f447a000640 10 client.16374 handle_command_reply: tid=0 2024-09-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 client.16374 shutdown 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bcc070 msgr2=0x562306f91680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bcc070 0x562306f91680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4488012e30 tx=0x7f4488004a40 comp rx=0 tx=0).stop 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 shutdown_connections 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562306b5fda0 0x562306ffd3a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562306bcc070 0x562306f91680 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562306bab390 0x562306f91120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 --2- 172.21.15.84:0/2111527574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562306ba31b0 0x562306f93c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f447a000640 0 client.16374 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 >> 172.21.15.84:0/2111527574 conn(0x562306bc0460 msgr2=0x562306f80380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 shutdown_connections 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 1 -- 172.21.15.84:0/2111527574 wait complete. 2024-09-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.087+0000 7f449e271740 20 client.16374 trim_cache size 0 max 16384 2024-09-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f44740b6700 msgr2=0x7f44740b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f44740b6700 0x7f44740b8c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4488005fd0 tx=0x7f4488009500 comp rx=0 tx=0).stop 2024-09-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490077940 msgr2=0x7f44901a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490077940 0x7f44901a0ab0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f448000d770 tx=0x7f448000dc30 comp rx=0 tx=0).stop 2024-09-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 shutdown_connections 2024-09-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f44740b6700 0x7f44740b8c10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4490114750 0x7f44901a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490078290 0x7f44901a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 --2- 172.21.15.84:0/3389524738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4490077940 0x7f44901a0ab0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 >> 172.21.15.84:0/3389524738 conn(0x7f44901017c0 msgr2=0x7f4490116770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 shutdown_connections 2024-09-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:27.088+0000 7f4497600640 1 -- 172.21.15.84:0/3389524738 wait complete. 2024-09-21T07:53:27.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:27 smithi084 ceph-mon[30411]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 211 MiB/s wr, 1.78k op/s 2024-09-21T07:53:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:27 smithi162 ceph-mon[34833]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 211 MiB/s wr, 1.78k op/s 2024-09-21T07:53:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:27 smithi191 ceph-mon[34667]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 211 MiB/s wr, 1.78k op/s 2024-09-21T07:53:28.267 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:53:28.635 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.226+0000 7f4204600640 1 -- 172.21.15.84:0/1795271319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc10de30 msgr2=0x7f41fc110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.226+0000 7f4204600640 1 --2- 172.21.15.84:0/1795271319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc10de30 0x7f41fc110320 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009ca0 tx=0x7f41f402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.226+0000 7f4204600640 1 -- 172.21.15.84:0/1795271319 shutdown_connections 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.226+0000 7f4204600640 1 --2- 172.21.15.84:0/1795271319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc10de30 0x7f41fc110320 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.226+0000 7f4204600640 1 --2- 172.21.15.84:0/1795271319 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41fc105320 0x7f41fc10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.226+0000 7f4204600640 1 --2- 172.21.15.84:0/1795271319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41fc1049d0 0x7f41fc104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.226+0000 7f4204600640 1 -- 172.21.15.84:0/1795271319 >> 172.21.15.84:0/1795271319 conn(0x7f41fc079740 msgr2=0x7f41fc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.227+0000 7f4204600640 1 -- 172.21.15.84:0/1795271319 shutdown_connections 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.227+0000 7f4204600640 1 -- 172.21.15.84:0/1795271319 wait complete. 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 Processor -- start 2024-09-21T07:53:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 -- start start 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc1049d0 0x7f41fc102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41fc105320 0x7f41fc102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41fc10de30 0x7f41fc103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc113ae0 con 0x7f41fc1049d0 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc113960 con 0x7f41fc10de30 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4204600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc113c60 con 0x7f41fc105320 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4201c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc1049d0 0x7f41fc102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4201c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc1049d0 0x7f41fc102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35704/0 (socket says 172.21.15.84:35704) 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4201c00640 1 -- 172.21.15.84:0/2333063710 learned_addr learned my addr 172.21.15.84:0/2333063710 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.228+0000 7f4201200640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41fc105320 0x7f41fc102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f4201c00640 1 -- 172.21.15.84:0/2333063710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41fc105320 msgr2=0x7f41fc102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f4201c00640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41fc105320 0x7f41fc102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f4201c00640 1 -- 172.21.15.84:0/2333063710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41fc10de30 msgr2=0x7f41fc103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f4201c00640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41fc10de30 0x7f41fc103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f4201c00640 1 -- 172.21.15.84:0/2333063710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc1a86a0 con 0x7f41fc1049d0 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f4201c00640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc1049d0 0x7f41fc102710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f41f000e9c0 tx=0x7f41f000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f41fa000640 1 -- 172.21.15.84:0/2333063710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f000ccc0 con 0x7f41fc1049d0 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f41fa000640 1 -- 172.21.15.84:0/2333063710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41f00035f0 con 0x7f41fc1049d0 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc1a8990 con 0x7f41fc1049d0 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.229+0000 7f41fa000640 1 -- 172.21.15.84:0/2333063710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f000ce60 con 0x7f41fc1049d0 2024-09-21T07:53:29.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.230+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc1a8ed0 con 0x7f41fc1049d0 2024-09-21T07:53:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.233+0000 7f420b24e740 1 Processor -- start 2024-09-21T07:53:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.233+0000 7f420b24e740 1 -- start start 2024-09-21T07:53:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.233+0000 7f41fa000640 1 -- 172.21.15.84:0/2333063710 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f41f00037a0 con 0x7f41fc1049d0 2024-09-21T07:53:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f420b24e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf430f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f420b24e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f420b24e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d29390 0x55cf430f1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f420b24e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cf43067fb0 con 0x55cf42d29390 2024-09-21T07:53:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f420b24e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cf430573e0 con 0x55cf42d4a070 2024-09-21T07:53:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f420b24e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55cf4305b1f0 con 0x55cf42d211b0 2024-09-21T07:53:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d29390 0x55cf430f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d29390 0x55cf430f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35706/0 (socket says 172.21.15.84:35706) 2024-09-21T07:53:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 -- 172.21.15.84:0/528873334 learned_addr learned my addr 172.21.15.84:0/528873334 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201c00640 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4202600640 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf430f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 -- 172.21.15.84:0/528873334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 msgr2=0x55cf430f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 -- 172.21.15.84:0/528873334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 msgr2=0x55cf430f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf430f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.234+0000 7f4201200640 1 -- 172.21.15.84:0/528873334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf43021cd0 con 0x55cf42d29390 2024-09-21T07:53:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.235+0000 7f4201200640 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d29390 0x55cf430f1820 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f41e800ac30 tx=0x7f41e800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7839f0fc674a897 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.235+0000 7f41eea00640 1 -- 172.21.15.84:0/528873334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e801d070 con 0x55cf42d29390 2024-09-21T07:53:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.235+0000 7f41eea00640 1 -- 172.21.15.84:0/528873334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e8018af0 con 0x55cf42d29390 2024-09-21T07:53:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.235+0000 7f41eea00640 1 -- 172.21.15.84:0/528873334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8010b20 con 0x55cf42d29390 2024-09-21T07:53:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f41fa000640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41e40b6680 0x7f41e40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 -- 172.21.15.84:0/528873334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d29390 msgr2=0x55cf430f1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d29390 0x55cf430f1820 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f41e800ac30 tx=0x7f41e800f790 comp rx=0 tx=0).stop 2024-09-21T07:53:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f41fa000640 1 -- 172.21.15.84:0/2333063710 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f41f00e7f10 con 0x7f41fc1049d0 2024-09-21T07:53:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 -- 172.21.15.84:0/528873334 shutdown_connections 2024-09-21T07:53:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d29390 0x55cf430f1820 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f4202600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41e40b6680 0x7f41e40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 --2- 172.21.15.84:0/528873334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf430f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 -- 172.21.15.84:0/528873334 >> 172.21.15.84:0/528873334 conn(0x55cf42d3e460 msgr2=0x55cf430eec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 -- 172.21.15.84:0/528873334 shutdown_connections 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.236+0000 7f420b24e740 1 -- 172.21.15.84:0/528873334 wait complete. 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.237+0000 7f420b24e740 1 -- start start 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.237+0000 7f4202600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41e40b6680 0x7f41e40b8b90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f41f4004af0 tx=0x7f41f4005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.237+0000 7f420b24e740 1 Processor -- start 2024-09-21T07:53:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f420b24e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf430fc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f420b24e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d29390 0x55cf430fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f420b24e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf43108870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f420b24e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cf42eb8700 con 0x55cf42d211b0 2024-09-21T07:53:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f420b24e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cf42ff2580 con 0x55cf42d4a070 2024-09-21T07:53:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f420b24e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55cf430ff580 con 0x55cf42d29390 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f420b24e740 10 client.0 _ll_register_callbacks cb 0x55cf43002470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf430fc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf430fc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35722/0 (socket says 172.21.15.84:35722) 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 -- 172.21.15.84:0/2441653534 learned_addr learned my addr 172.21.15.84:0/2441653534 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201200640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d29390 0x55cf430fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4202600640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf43108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 -- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d29390 msgr2=0x55cf430fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d29390 0x55cf430fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 -- 172.21.15.84:0/2441653534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 msgr2=0x55cf43108870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf43108870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4201c00640 1 -- 172.21.15.84:0/2441653534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf42db5650 con 0x55cf42d211b0 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.238+0000 7f4202600640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf43108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f4201c00640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf430fc540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f41f00aac60 tx=0x7f41f00e5860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a929441b0467b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f41e3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f41e3400640 1 -- 172.21.15.84:0/2441653534 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f00ad7c0 con 0x55cf42d211b0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f41e3400640 1 -- 172.21.15.84:0/2441653534 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f41f00eb020 con 0x55cf42d211b0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cf42ff4b90 con 0x55cf42d211b0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f41e3400640 1 -- 172.21.15.84:0/2441653534 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f41f00a9160 con 0x55cf42d211b0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f420b24e740 10 client.16386 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf4300f950 con 0x55cf42d211b0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.239+0000 7f41e3400640 1 -- 172.21.15.84:0/2441653534 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41f0097080 con 0x55cf42d211b0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f41e3400640 1 -- 172.21.15.84:0/2441653534 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f41f00ac6c0 con 0x55cf42d211b0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f420b24e740 10 client.16386 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f420b24e740 10 client.16386 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f420b24e740 20 client.16386 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f420b24e740 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42d089f0 0x55cf4310e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f420b24e740 4 client.16386 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf43069f00 con 0x55cf42d089f0 2024-09-21T07:53:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.240+0000 7f4201200640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42d089f0 0x55cf4310e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.241+0000 7f4201200640 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42d089f0 0x55cf4310e760 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed7b5b0f4544c511 server_cookie=3c3d4a8ac6dd6e45 in_seq=0 out_seq=0 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.241+0000 7f41e3400640 10 client.16386 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f41e3400640 1 -- 172.21.15.84:0/2441653534 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf43069f00 con 0x55cf42d089f0 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f41e3400640 10 client.16386 handle_command_reply: tid=0 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 client.16386 shutdown 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 msgr2=0x55cf430fc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf430fc540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f41f00aac60 tx=0x7f41f00e5860 comp rx=0 tx=0).stop 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 shutdown_connections 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42d089f0 0x55cf4310e760 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d4a070 0x55cf43108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d29390 0x55cf430fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 --2- 172.21.15.84:0/2441653534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf430fc540 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 >> 172.21.15.84:0/2441653534 conn(0x55cf42d3e460 msgr2=0x55cf430f3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f41e3400640 0 client.16386 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:53:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 shutdown_connections 2024-09-21T07:53:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 1 -- 172.21.15.84:0/2441653534 wait complete. 2024-09-21T07:53:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.242+0000 7f420b24e740 20 client.16386 trim_cache size 0 max 16384 2024-09-21T07:53:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.256+0000 7f420b24e740 1 Processor -- start 2024-09-21T07:53:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.256+0000 7f420b24e740 1 -- start start 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f420b24e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430fca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f420b24e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf430f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f420b24e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d4a070 0x55cf430f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f420b24e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc1b2f30 con 0x55cf42d4a070 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f420b24e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc1b4a70 con 0x55cf42d29390 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f420b24e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc1b3600 con 0x55cf42d211b0 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f4202600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d4a070 0x55cf430f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f4202600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d4a070 0x55cf430f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35724/0 (socket says 172.21.15.84:35724) 2024-09-21T07:53:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f4202600640 1 -- 172.21.15.84:0/4107345274 learned_addr learned my addr 172.21.15.84:0/4107345274 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f4201c00640 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430fca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.257+0000 7f4201200640 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf430f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f4202600640 1 -- 172.21.15.84:0/4107345274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 msgr2=0x55cf430fca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f4202600640 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430fca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f4202600640 1 -- 172.21.15.84:0/4107345274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 msgr2=0x55cf430f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f4202600640 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf430f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f4202600640 1 -- 172.21.15.84:0/4107345274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf430fd3c0 con 0x55cf42d4a070 2024-09-21T07:53:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f4202600640 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d4a070 0x55cf430f43e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f41f4035000 tx=0x7f41f403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c10b90a0b9a2b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f41ee000640 1 -- 172.21.15.84:0/4107345274 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40318e0 con 0x55cf42d4a070 2024-09-21T07:53:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f41ee000640 1 -- 172.21.15.84:0/4107345274 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41f4036040 con 0x55cf42d4a070 2024-09-21T07:53:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.258+0000 7f41ee000640 1 -- 172.21.15.84:0/4107345274 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f402f850 con 0x55cf42d4a070 2024-09-21T07:53:29.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 -- 172.21.15.84:0/4107345274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d4a070 msgr2=0x55cf430f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d4a070 0x55cf430f43e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f41f4035000 tx=0x7f41f403f000 comp rx=0 tx=0).stop 2024-09-21T07:53:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 -- 172.21.15.84:0/4107345274 shutdown_connections 2024-09-21T07:53:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d4a070 0x55cf430f43e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf430f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 --2- 172.21.15.84:0/4107345274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d211b0 0x55cf430fca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 -- 172.21.15.84:0/4107345274 >> 172.21.15.84:0/4107345274 conn(0x55cf42d3e460 msgr2=0x55cf430fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 -- 172.21.15.84:0/4107345274 shutdown_connections 2024-09-21T07:53:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.259+0000 7f420b24e740 1 -- 172.21.15.84:0/4107345274 wait complete. 2024-09-21T07:53:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 -- start start 2024-09-21T07:53:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 Processor -- start 2024-09-21T07:53:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf431009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf43100f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d4a070 0x55cf431014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc1b43a0 con 0x55cf42d211b0 2024-09-21T07:53:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc1b3cd0 con 0x55cf42d29390 2024-09-21T07:53:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc1b0ef0 con 0x55cf42d4a070 2024-09-21T07:53:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.260+0000 7f420b24e740 10 client.0 _ll_register_callbacks cb 0x7f41f0003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf431009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf431009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35730/0 (socket says 172.21.15.84:35730) 2024-09-21T07:53:29.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 -- 172.21.15.84:0/3898452674 learned_addr learned my addr 172.21.15.84:0/3898452674 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:29.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201200640 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf43100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4202600640 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d4a070 0x55cf431014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 -- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d4a070 msgr2=0x55cf431014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d4a070 0x55cf431014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 -- 172.21.15.84:0/3898452674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 msgr2=0x55cf43100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:29.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf43100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 -- 172.21.15.84:0/3898452674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf43178340 con 0x55cf42d211b0 2024-09-21T07:53:29.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f4201c00640 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf431009f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f41f0003e40 tx=0x7f41f00eb7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd9957e3866bb67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:29.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.261+0000 7f41e3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:29.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f41e3400640 1 -- 172.21.15.84:0/3898452674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f00ad160 con 0x55cf42d211b0 2024-09-21T07:53:29.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f41e3400640 1 -- 172.21.15.84:0/3898452674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f41f00c3da0 con 0x55cf42d211b0 2024-09-21T07:53:29.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41f4036040 con 0x55cf42d211b0 2024-09-21T07:53:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f41e3400640 1 -- 172.21.15.84:0/3898452674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f41f00ad340 con 0x55cf42d211b0 2024-09-21T07:53:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f420b24e740 10 client.16392 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf431795c0 con 0x55cf42d211b0 2024-09-21T07:53:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f41e3400640 1 -- 172.21.15.84:0/3898452674 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41f4036040 con 0x55cf42d211b0 2024-09-21T07:53:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.262+0000 7f41e3400640 1 -- 172.21.15.84:0/3898452674 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f41f00eb070 con 0x55cf42d211b0 2024-09-21T07:53:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f420b24e740 10 client.16392 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f420b24e740 10 client.16392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:53:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f420b24e740 20 client.16392 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f420b24e740 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42cddda0 0x55cf4317bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f420b24e740 4 client.16392 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:53:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cf430659b0 con 0x55cf42cddda0 2024-09-21T07:53:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f4201200640 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42cddda0 0x55cf4317bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f4201200640 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42cddda0 0x55cf4317bd60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9aa86555e08ab70b server_cookie=f5a2a986bdc8e41f in_seq=0 out_seq=0 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.263+0000 7f41e3400640 10 client.16392 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f41e3400640 1 -- 172.21.15.84:0/3898452674 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cf430659b0 con 0x55cf42cddda0 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f41e3400640 10 client.16392 handle_command_reply: tid=0 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 client.16392 shutdown 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 msgr2=0x55cf431009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf431009f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f41f0003e40 tx=0x7f41f00eb7d0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 shutdown_connections 2024-09-21T07:53:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55cf42cddda0 0x55cf4317bd60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cf42d4a070 0x55cf431014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cf42d29390 0x55cf43100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 --2- 172.21.15.84:0/3898452674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cf42d211b0 0x55cf431009f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 >> 172.21.15.84:0/3898452674 conn(0x55cf42d3e460 msgr2=0x55cf430f3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f41e3400640 0 client.16392 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:53:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 shutdown_connections 2024-09-21T07:53:29.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 1 -- 172.21.15.84:0/3898452674 wait complete. 2024-09-21T07:53:29.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.264+0000 7f420b24e740 20 client.16392 trim_cache size 0 max 16384 2024-09-21T07:53:29.277 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41e40b6680 msgr2=0x7f41e40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41e40b6680 0x7f41e40b8b90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f41f4004af0 tx=0x7f41f4005d80 comp rx=0 tx=0).stop 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc1049d0 msgr2=0x7f41fc102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc1049d0 0x7f41fc102710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f41f000e9c0 tx=0x7f41f000edc0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 shutdown_connections 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f41e40b6680 0x7f41e40b8b90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41fc10de30 0x7f41fc103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41fc105320 0x7f41fc102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 --2- 172.21.15.84:0/2333063710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41fc1049d0 0x7f41fc102710 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 >> 172.21.15.84:0/2333063710 conn(0x7f41fc079740 msgr2=0x7f41fc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 shutdown_connections 2024-09-21T07:53:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:29.265+0000 7f4204600640 1 -- 172.21.15.84:0/2333063710 wait complete. 2024-09-21T07:53:29.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:29 smithi084 ceph-mon[30411]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 185 MiB/s wr, 1.59k op/s 2024-09-21T07:53:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:29 smithi162 ceph-mon[34833]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 185 MiB/s wr, 1.59k op/s 2024-09-21T07:53:29.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:29 smithi191 ceph-mon[34667]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 185 MiB/s wr, 1.59k op/s 2024-09-21T07:53:30.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:53:30.539 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:31.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.169+0000 7f762fe00640 1 -- 172.21.15.84:0/3571913512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 msgr2=0x7f7630105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.169+0000 7f762fe00640 1 --2- 172.21.15.84:0/3571913512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f7630105fc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7620009900 tx=0x7f762002a410 comp rx=0 tx=0).stop 2024-09-21T07:53:31.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.170+0000 7f762fe00640 1 -- 172.21.15.84:0/3571913512 shutdown_connections 2024-09-21T07:53:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.170+0000 7f762fe00640 1 --2- 172.21.15.84:0/3571913512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f763010be40 0x7f7630112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.170+0000 7f762fe00640 1 --2- 172.21.15.84:0/3571913512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763010b4f0 0x7f763010b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.170+0000 7f762fe00640 1 --2- 172.21.15.84:0/3571913512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f7630105fc0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.170+0000 7f762fe00640 1 -- 172.21.15.84:0/3571913512 >> 172.21.15.84:0/3571913512 conn(0x7f7630101680 msgr2=0x7f7630103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.170+0000 7f762fe00640 1 -- 172.21.15.84:0/3571913512 shutdown_connections 2024-09-21T07:53:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.170+0000 7f762fe00640 1 -- 172.21.15.84:0/3571913512 wait complete. 2024-09-21T07:53:31.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 Processor -- start 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 -- start start 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f763019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763010b4f0 0x7f763019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f763010be40 0x7f76301a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7630115b50 con 0x7f7630105bb0 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76301159d0 con 0x7f763010b4f0 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.171+0000 7f762fe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7630115cd0 con 0x7f763010be40 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f762ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f763019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f762ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f763019c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35750/0 (socket says 172.21.15.84:35750) 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f762ea00640 1 -- 172.21.15.84:0/3910002328 learned_addr learned my addr 172.21.15.84:0/3910002328 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f7626000640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763010b4f0 0x7f763019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f762f400640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f763010be40 0x7f76301a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f7626000640 1 -- 172.21.15.84:0/3910002328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f763010be40 msgr2=0x7f76301a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f7626000640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f763010be40 0x7f76301a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f7626000640 1 -- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 msgr2=0x7f763019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f7626000640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f763019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.172+0000 7f7626000640 1 -- 172.21.15.84:0/3910002328 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76301a24b0 con 0x7f763010b4f0 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.173+0000 7f7626000640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763010b4f0 0x7f763019cae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7618005fd0 tx=0x7f761800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.173+0000 7f762ea00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f763019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.173+0000 7f7634a00640 1 -- 172.21.15.84:0/3910002328 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618009c00 con 0x7f763010b4f0 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.173+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76301a27a0 con 0x7f763010b4f0 2024-09-21T07:53:31.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.173+0000 7f7634a00640 1 -- 172.21.15.84:0/3910002328 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7618009da0 con 0x7f763010b4f0 2024-09-21T07:53:31.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.173+0000 7f7634a00640 1 -- 172.21.15.84:0/3910002328 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618003e20 con 0x7f763010b4f0 2024-09-21T07:53:31.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.173+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76301a8f00 con 0x7f763010b4f0 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 Processor -- start 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 -- start start 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc922cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc922d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc922d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55adc91a3fb0 con 0x55adc8e86070 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55adc91933e0 con 0x55adc8e5d1b0 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.176+0000 7f763ca77740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55adc91971f0 con 0x55adc8e65390 2024-09-21T07:53:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc922cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc922cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35754/0 (socket says 172.21.15.84:35754) 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 -- 172.21.15.84:0/1560756201 learned_addr learned my addr 172.21.15.84:0/1560756201 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762ea00640 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc922d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f7634a00640 1 -- 172.21.15.84:0/3910002328 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f76180035f0 con 0x7f763010b4f0 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 -- 172.21.15.84:0/1560756201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 msgr2=0x55adc922d9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc922d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 -- 172.21.15.84:0/1560756201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 msgr2=0x55adc922d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc922d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762f400640 1 -- 172.21.15.84:0/1560756201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc915dcd0 con 0x55adc8e86070 2024-09-21T07:53:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.177+0000 7f762ea00640 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc922d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.178+0000 7f762f400640 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc922cf70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7628009f50 tx=0x7f76280118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8abb47bbf06d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.178+0000 7f761fe00640 1 -- 172.21.15.84:0/1560756201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628004d20 con 0x55adc8e86070 2024-09-21T07:53:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.178+0000 7f761fe00640 1 -- 172.21.15.84:0/1560756201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7628004050 con 0x55adc8e86070 2024-09-21T07:53:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.178+0000 7f761fe00640 1 -- 172.21.15.84:0/1560756201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628005280 con 0x55adc8e86070 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 -- 172.21.15.84:0/1560756201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 msgr2=0x55adc922cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc922cf70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7628009f50 tx=0x7f76280118d0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f7634a00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76140b6680 0x7f76140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 -- 172.21.15.84:0/1560756201 shutdown_connections 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f7634a00640 1 -- 172.21.15.84:0/3910002328 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f76180e7360 con 0x7f763010b4f0 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc922d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc922d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 --2- 172.21.15.84:0/1560756201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc922cf70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 -- 172.21.15.84:0/1560756201 >> 172.21.15.84:0/1560756201 conn(0x55adc8e7a460 msgr2=0x55adc922ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f762f400640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76140b6680 0x7f76140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 -- 172.21.15.84:0/1560756201 shutdown_connections 2024-09-21T07:53:31.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.179+0000 7f763ca77740 1 -- 172.21.15.84:0/1560756201 wait complete. 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.180+0000 7f762f400640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76140b6680 0x7f76140b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f76280048f0 tx=0x7f7628004950 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.180+0000 7f763ca77740 1 -- start start 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.180+0000 7f763ca77740 1 Processor -- start 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f763ca77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9238710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f763ca77740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc9238c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f763ca77740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9244ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f763ca77740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55adc8ff4700 con 0x55adc8e86070 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f763ca77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55adc912e580 con 0x55adc8e5d1b0 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f763ca77740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55adc923b750 con 0x55adc8e65390 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f763ca77740 10 client.0 _ll_register_callbacks cb 0x55adc913e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f7626000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc9238c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f7626000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc9238c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35246/0 (socket says 172.21.15.84:35246) 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f7626000640 1 -- 172.21.15.84:0/3989348329 learned_addr learned my addr 172.21.15.84:0/3989348329 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.181+0000 7f762ea00640 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9238710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f7626000640 1 -- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 msgr2=0x55adc9238710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:31.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f7626000640 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9238710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f7626000640 1 -- 172.21.15.84:0/3989348329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 msgr2=0x55adc9244ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:31.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f7626000640 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9244ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f7626000640 1 -- 172.21.15.84:0/3989348329 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc8ef1650 con 0x55adc8e65390 2024-09-21T07:53:31.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f7626000640 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc9238c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7618000c00 tx=0x7f76180a9670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e53ca7fa4da76f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:31.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f761cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:31.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f761cc00640 1 -- 172.21.15.84:0/3989348329 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76180af070 con 0x55adc8e65390 2024-09-21T07:53:31.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55adc9130b90 con 0x55adc8e65390 2024-09-21T07:53:31.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.182+0000 7f761cc00640 1 -- 172.21.15.84:0/3989348329 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f76180a8840 con 0x55adc8e65390 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f761cc00640 1 -- 172.21.15.84:0/3989348329 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7618020070 con 0x55adc8e65390 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 10 client.26452 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55adc914b950 con 0x55adc8e65390 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f761cc00640 1 -- 172.21.15.84:0/3989348329 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55adc9130b90 con 0x55adc8e65390 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f761cc00640 1 -- 172.21.15.84:0/3989348329 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7618098080 con 0x55adc8e65390 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 10 client.26452 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 10 client.26452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 20 client.26452 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e449f0 0x55adc924a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 4 client.26452 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.183+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adc91a5f00 con 0x55adc8e449f0 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.184+0000 7f762ea00640 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e449f0 0x55adc924a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.184+0000 7f762ea00640 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e449f0 0x55adc924a8a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9ac57aebcd6460 server_cookie=bfe63f114ad70197 in_seq=0 out_seq=0 2024-09-21T07:53:31.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.184+0000 7f761cc00640 10 client.26452 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:31.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f761cc00640 1 -- 172.21.15.84:0/3989348329 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55adc91a5f00 con 0x55adc8e449f0 2024-09-21T07:53:31.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f761cc00640 10 client.26452 handle_command_reply: tid=0 2024-09-21T07:53:31.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 client.26452 shutdown 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 msgr2=0x55adc9238c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc9238c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7618000c00 tx=0x7f76180a9670 comp rx=0 tx=0).stop 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 shutdown_connections 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9244ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e449f0 0x55adc924a8a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc9238c50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 --2- 172.21.15.84:0/3989348329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9238710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f761cc00640 0 client.26452 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.185+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 >> 172.21.15.84:0/3989348329 conn(0x55adc8e7a460 msgr2=0x55adc9230100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.186+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 shutdown_connections 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.186+0000 7f763ca77740 1 -- 172.21.15.84:0/3989348329 wait complete. 2024-09-21T07:53:31.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.186+0000 7f763ca77740 20 client.26452 trim_cache size 0 max 16384 2024-09-21T07:53:31.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.199+0000 7f763ca77740 1 Processor -- start 2024-09-21T07:53:31.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.199+0000 7f763ca77740 1 -- start start 2024-09-21T07:53:31.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f763ca77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9229d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f763ca77740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc92449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f763ca77740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9235900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f763ca77740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f760c00fcf0 con 0x55adc8e86070 2024-09-21T07:53:31.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f763ca77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f760c011830 con 0x55adc8e5d1b0 2024-09-21T07:53:31.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f763ca77740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f760c0103c0 con 0x55adc8e65390 2024-09-21T07:53:31.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f762f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9235900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f762ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9229d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f762f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9235900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35768/0 (socket says 172.21.15.84:35768) 2024-09-21T07:53:31.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f762f400640 1 -- 172.21.15.84:0/366369033 learned_addr learned my addr 172.21.15.84:0/366369033 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.200+0000 7f7626000640 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc92449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f762ea00640 1 -- 172.21.15.84:0/366369033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 msgr2=0x55adc92449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f762ea00640 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc92449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f762ea00640 1 -- 172.21.15.84:0/366369033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 msgr2=0x55adc9235900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f762ea00640 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9235900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f762ea00640 1 -- 172.21.15.84:0/366369033 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc922f260 con 0x55adc8e5d1b0 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f7626000640 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc92449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f762ea00640 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9229d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7620000c00 tx=0x7f76200039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b488206dd7f7840 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f761f400640 1 -- 172.21.15.84:0/366369033 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620035040 con 0x55adc8e5d1b0 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f761f400640 1 -- 172.21.15.84:0/366369033 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7620003d40 con 0x55adc8e5d1b0 2024-09-21T07:53:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.201+0000 7f761f400640 1 -- 172.21.15.84:0/366369033 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620004c70 con 0x55adc8e5d1b0 2024-09-21T07:53:31.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 -- 172.21.15.84:0/366369033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 msgr2=0x55adc9229d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9229d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7620000c00 tx=0x7f76200039d0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 -- 172.21.15.84:0/366369033 shutdown_connections 2024-09-21T07:53:31.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e86070 0x55adc9235900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e65390 0x55adc92449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 --2- 172.21.15.84:0/366369033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9229d10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 -- 172.21.15.84:0/366369033 >> 172.21.15.84:0/366369033 conn(0x55adc8e7a460 msgr2=0x55adc9229600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 -- 172.21.15.84:0/366369033 shutdown_connections 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.202+0000 7f763ca77740 1 -- 172.21.15.84:0/366369033 wait complete. 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 -- start start 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 Processor -- start 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9240fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e65390 0x55adc923fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e86070 0x55adc9240000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f760c011160 con 0x55adc8e65390 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f760c010a90 con 0x55adc8e5d1b0 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.203+0000 7f763ca77740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f760c00dcb0 con 0x55adc8e86070 2024-09-21T07:53:31.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f763ca77740 10 client.0 _ll_register_callbacks cb 0x7f7618005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e65390 0x55adc923fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e65390 0x55adc923fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35784/0 (socket says 172.21.15.84:35784) 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 -- 172.21.15.84:0/3626274883 learned_addr learned my addr 172.21.15.84:0/3626274883 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f762ea00640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9240fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f762f400640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e86070 0x55adc9240000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 -- 172.21.15.84:0/3626274883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e86070 msgr2=0x55adc9240000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e86070 0x55adc9240000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 -- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 msgr2=0x55adc9240fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9240fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f7626000640 1 -- 172.21.15.84:0/3626274883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc9240540 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.204+0000 7f762f400640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e86070 0x55adc9240000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f7626000640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e65390 0x55adc923fac0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7618012040 tx=0x7f76180d4510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faa009205703884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f761cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f761cc00640 1 -- 172.21.15.84:0/3626274883 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618014030 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f761cc00640 1 -- 172.21.15.84:0/3626274883 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f76180a8a50 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7620003d40 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f761cc00640 1 -- 172.21.15.84:0/3626274883 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76180af040 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f763ca77740 10 client.16407 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55adc92b5f60 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.205+0000 7f761cc00640 1 -- 172.21.15.84:0/3626274883 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7620003d40 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f761cc00640 1 -- 172.21.15.84:0/3626274883 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f761805c160 con 0x55adc8e65390 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f763ca77740 10 client.16407 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f763ca77740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f763ca77740 20 client.16407 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f763ca77740 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e19da0 0x55adc92b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:31.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f763ca77740 4 client.16407 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:53:31.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55adc91a19b0 con 0x55adc8e19da0 2024-09-21T07:53:31.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f762ea00640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e19da0 0x55adc92b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f762ea00640 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e19da0 0x55adc92b86d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae0b4513939db1da server_cookie=795ec22e12c37009 in_seq=0 out_seq=0 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.206+0000 7f761cc00640 10 client.16407 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f761cc00640 1 -- 172.21.15.84:0/3626274883 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55adc91a19b0 con 0x55adc8e19da0 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f761cc00640 10 client.16407 handle_command_reply: tid=0 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 client.16407 shutdown 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e65390 msgr2=0x55adc923fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e65390 0x55adc923fac0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7618012040 tx=0x7f76180d4510 comp rx=0 tx=0).stop 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 shutdown_connections 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55adc8e19da0 0x55adc92b86d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55adc8e86070 0x55adc9240000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55adc8e65390 0x55adc923fac0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 --2- 172.21.15.84:0/3626274883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55adc8e5d1b0 0x55adc9240fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 >> 172.21.15.84:0/3626274883 conn(0x55adc8e7a460 msgr2=0x55adc9239bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f761cc00640 0 client.16407 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 shutdown_connections 2024-09-21T07:53:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 1 -- 172.21.15.84:0/3626274883 wait complete. 2024-09-21T07:53:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.207+0000 7f763ca77740 20 client.16407 trim_cache size 0 max 16384 2024-09-21T07:53:31.213 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:53:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76140b6680 msgr2=0x7f76140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76140b6680 0x7f76140b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f76280048f0 tx=0x7f7628004950 comp rx=0 tx=0).stop 2024-09-21T07:53:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763010b4f0 msgr2=0x7f763019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763010b4f0 0x7f763019cae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7618005fd0 tx=0x7f761800dde0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 shutdown_connections 2024-09-21T07:53:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76140b6680 0x7f76140b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f763010be40 0x7f76301a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763010b4f0 0x7f763019cae0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 --2- 172.21.15.84:0/3910002328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7630105bb0 0x7f763019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 >> 172.21.15.84:0/3910002328 conn(0x7f7630101680 msgr2=0x7f763010ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:31.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.208+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 shutdown_connections 2024-09-21T07:53:31.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:31.209+0000 7f762fe00640 1 -- 172.21.15.84:0/3910002328 wait complete. 2024-09-21T07:53:31.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:31 smithi084 ceph-mon[30411]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 158 MiB/s wr, 1.40k op/s 2024-09-21T07:53:31.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:31 smithi162 ceph-mon[34833]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 158 MiB/s wr, 1.40k op/s 2024-09-21T07:53:31.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:31 smithi191 ceph-mon[34667]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 158 MiB/s wr, 1.40k op/s 2024-09-21T07:53:33.123 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:53:33.123 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:53:33.458 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:33 smithi084 ceph-mon[30411]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 MiB/s wr, 827 op/s 2024-09-21T07:53:33.504 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:33.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:33 smithi162 ceph-mon[34833]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 MiB/s wr, 827 op/s 2024-09-21T07:53:33.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:33 smithi191 ceph-mon[34667]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 MiB/s wr, 827 op/s 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 -- 172.21.15.84:0/3341279892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c076100 msgr2=0x7f084c10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 --2- 172.21.15.84:0/3341279892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c076100 0x7f084c10f9d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0838009900 tx=0x7f083802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 -- 172.21.15.84:0/3341279892 shutdown_connections 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 --2- 172.21.15.84:0/3341279892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f084c10ff10 0x7f084c112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 --2- 172.21.15.84:0/3341279892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c076100 0x7f084c10f9d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 --2- 172.21.15.84:0/3341279892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f084c0757b0 0x7f084c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 -- 172.21.15.84:0/3341279892 >> 172.21.15.84:0/3341279892 conn(0x7f084c0ff440 msgr2=0x7f084c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 -- 172.21.15.84:0/3341279892 shutdown_connections 2024-09-21T07:53:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.159+0000 7f084be00640 1 -- 172.21.15.84:0/3341279892 wait complete. 2024-09-21T07:53:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 Processor -- start 2024-09-21T07:53:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 -- start start 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c0757b0 0x7f084c19c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f084c076100 0x7f084c19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f084c10ff10 0x7f084c1a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f084c115ad0 con 0x7f084c0757b0 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f084c115950 con 0x7f084c10ff10 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084be00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f084c115c50 con 0x7f084c076100 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c0757b0 0x7f084c19c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.161+0000 7f084aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c0757b0 0x7f084c19c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35802/0 (socket says 172.21.15.84:35802) 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084aa00640 1 -- 172.21.15.84:0/1897021388 learned_addr learned my addr 172.21.15.84:0/1897021388 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084a000640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f084c076100 0x7f084c19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084b400640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f084c10ff10 0x7f084c1a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084aa00640 1 -- 172.21.15.84:0/1897021388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f084c076100 msgr2=0x7f084c19ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084aa00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f084c076100 0x7f084c19ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084aa00640 1 -- 172.21.15.84:0/1897021388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f084c10ff10 msgr2=0x7f084c1a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084aa00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f084c10ff10 0x7f084c1a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084aa00640 1 -- 172.21.15.84:0/1897021388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c1a2430 con 0x7f084c0757b0 2024-09-21T07:53:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.162+0000 7f084aa00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c0757b0 0x7f084c19c4c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f083c00e9f0 tx=0x7f083c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.163+0000 7f0843400640 1 -- 172.21.15.84:0/1897021388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c00cd80 con 0x7f084c0757b0 2024-09-21T07:53:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.163+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084c1a2720 con 0x7f084c0757b0 2024-09-21T07:53:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.163+0000 7f0843400640 1 -- 172.21.15.84:0/1897021388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f083c0108e0 con 0x7f084c0757b0 2024-09-21T07:53:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.163+0000 7f0843400640 1 -- 172.21.15.84:0/1897021388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c018980 con 0x7f084c0757b0 2024-09-21T07:53:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.163+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084c1a8e80 con 0x7f084c0757b0 2024-09-21T07:53:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 Processor -- start 2024-09-21T07:53:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 -- start start 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605da9eef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f0843400640 1 -- 172.21.15.84:0/1897021388 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f083c018b20 con 0x7f084c0757b0 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da626670 0x5605da9ef980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5605da964e90 con 0x5605da647350 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5605da9542c0 con 0x5605da626670 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.168+0000 7f08581f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5605da9580d0 con 0x5605da61e490 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605da9eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605da9eef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35808/0 (socket says 172.21.15.84:35808) 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084b400640 1 -- 172.21.15.84:0/2987438568 learned_addr learned my addr 172.21.15.84:0/2987438568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084aa00640 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084a000640 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da626670 0x5605da9ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084aa00640 1 -- 172.21.15.84:0/2987438568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da626670 msgr2=0x5605da9ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084aa00640 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da626670 0x5605da9ef980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.169+0000 7f084aa00640 1 -- 172.21.15.84:0/2987438568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 msgr2=0x5605da9eef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.170+0000 7f084aa00640 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605da9eef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.170+0000 7f084aa00640 1 -- 172.21.15.84:0/2987438568 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605da6b2930 con 0x5605da61e490 2024-09-21T07:53:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.170+0000 7f084b400640 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605da9eef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.170+0000 7f084aa00640 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ef440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f083c0e50e0 tx=0x7f083c0f07c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47b83505fe8ed17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.170+0000 7f0837400640 1 -- 172.21.15.84:0/2987438568 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0ee880 con 0x5605da61e490 2024-09-21T07:53:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.170+0000 7f0837400640 1 -- 172.21.15.84:0/2987438568 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f083c0ed3d0 con 0x5605da61e490 2024-09-21T07:53:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.170+0000 7f0837400640 1 -- 172.21.15.84:0/2987438568 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0f8640 con 0x5605da61e490 2024-09-21T07:53:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.171+0000 7f0843400640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f08300b6700 0x7f08300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.171+0000 7f08581f2740 1 -- 172.21.15.84:0/2987438568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 msgr2=0x5605da9ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.171+0000 7f08581f2740 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ef440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f083c0e50e0 tx=0x7f083c0f07c0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.171+0000 7f084b400640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f08300b6700 0x7f08300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.171+0000 7f0843400640 1 -- 172.21.15.84:0/1897021388 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f083c0e7d00 con 0x7f084c0757b0 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 -- 172.21.15.84:0/2987438568 shutdown_connections 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da626670 0x5605da9ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ef440 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 --2- 172.21.15.84:0/2987438568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605da9eef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 -- 172.21.15.84:0/2987438568 >> 172.21.15.84:0/2987438568 conn(0x5605da63b740 msgr2=0x5605da9ecdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 -- 172.21.15.84:0/2987438568 shutdown_connections 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 -- 172.21.15.84:0/2987438568 wait complete. 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f084b400640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f08300b6700 0x7f08300b8c10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0844005f40 tx=0x7f0844009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.172+0000 7f08581f2740 1 -- start start 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 1 Processor -- start 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da61e490 0x5605da9fab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605daa06a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5605da7b5890 con 0x5605da647350 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5605da8ef160 con 0x5605da61e490 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5605da9fd6e0 con 0x5605da626670 2024-09-21T07:53:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.173+0000 7f08581f2740 10 client.0 _ll_register_callbacks cb 0x5605da90ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605daa06a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35294/0 (socket says 172.21.15.84:35294) 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084a000640 1 -- 172.21.15.84:0/3054304631 learned_addr learned my addr 172.21.15.84:0/3054304631 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da61e490 0x5605da9fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084b400640 1 -- 172.21.15.84:0/3054304631 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 msgr2=0x5605da9fb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084b400640 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9fb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084b400640 1 -- 172.21.15.84:0/3054304631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da61e490 msgr2=0x5605da9fab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084b400640 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da61e490 0x5605da9fab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.174+0000 7f084b400640 1 -- 172.21.15.84:0/3054304631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605daa06ff0 con 0x5605da647350 2024-09-21T07:53:34.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f084b400640 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605daa06a00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0844005f10 tx=0x7f0844004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce3b4695f248248 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f082be00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f082be00640 1 -- 172.21.15.84:0/3054304631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844011dd0 con 0x5605da647350 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f083c0ed3d0 con 0x5605da647350 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f082be00640 1 -- 172.21.15.84:0/3054304631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0844020420 con 0x5605da647350 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f082be00640 1 -- 172.21.15.84:0/3054304631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0844031050 con 0x5605da647350 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f08581f2740 10 client.16419 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605daa099b0 con 0x5605da647350 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.175+0000 7f082be00640 1 -- 172.21.15.84:0/3054304631 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f083c0ed3d0 con 0x5605da647350 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f082be00640 1 -- 172.21.15.84:0/3054304631 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f084400f040 con 0x5605da647350 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f08581f2740 10 client.16419 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f08581f2740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f08581f2740 20 client.16419 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:34.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f08581f2740 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da605cd0 0x5605daa0ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f08581f2740 4 client.16419 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:34.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605da966de0 con 0x5605da605cd0 2024-09-21T07:53:34.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.176+0000 7f084aa00640 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da605cd0 0x5605daa0ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.177+0000 7f084aa00640 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da605cd0 0x5605daa0ce10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7d43dfe1f16a55b server_cookie=e82bec191686ca83 in_seq=0 out_seq=0 2024-09-21T07:53:34.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.177+0000 7f082be00640 10 client.16419 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f082be00640 1 -- 172.21.15.84:0/3054304631 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605da966de0 con 0x5605da605cd0 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f082be00640 10 client.16419 handle_command_reply: tid=0 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 client.16419 shutdown 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 msgr2=0x5605daa06a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605daa06a00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0844005f10 tx=0x7f0844004a40 comp rx=0 tx=0).stop 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 shutdown_connections 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da647350 0x5605daa06a00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da605cd0 0x5605daa0ce10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 --2- 172.21.15.84:0/3054304631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da61e490 0x5605da9fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 >> 172.21.15.84:0/3054304631 conn(0x5605da63b740 msgr2=0x5605da9f20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f082be00640 0 client.16419 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 shutdown_connections 2024-09-21T07:53:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 1 -- 172.21.15.84:0/3054304631 wait complete. 2024-09-21T07:53:34.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.178+0000 7f08581f2740 20 client.16419 trim_cache size 0 max 16384 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 Processor -- start 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 -- start start 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9f4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da626670 0x5605da9ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1ae9b0 con 0x5605da626670 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1b04f0 con 0x5605da63b740 2024-09-21T07:53:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f08581f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1af080 con 0x5605da61e490 2024-09-21T07:53:34.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.197+0000 7f084b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da626670 0x5605da9ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da626670 0x5605da9ec8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35814/0 (socket says 172.21.15.84:35814) 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084b400640 1 -- 172.21.15.84:0/1120387554 learned_addr learned my addr 172.21.15.84:0/1120387554 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084aa00640 1 -- 172.21.15.84:0/1120387554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 msgr2=0x5605da9ec3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084aa00640 1 --2- 172.21.15.84:0/1120387554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ec3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084aa00640 1 -- 172.21.15.84:0/1120387554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da626670 msgr2=0x5605da9ec8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084aa00640 1 --2- 172.21.15.84:0/1120387554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da626670 0x5605da9ec8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084aa00640 1 -- 172.21.15.84:0/1120387554 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605da9f9880 con 0x5605da63b740 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f084aa00640 1 --2- 172.21.15.84:0/1120387554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9f4720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f083c00e9c0 tx=0x7f083c0edce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe46946c9e5e8578 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.198+0000 7f0836a00640 1 -- 172.21.15.84:0/1120387554 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0a9730 con 0x5605da63b740 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.199+0000 7f0836a00640 1 -- 172.21.15.84:0/1120387554 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f083c0ad3a0 con 0x5605da63b740 2024-09-21T07:53:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.199+0000 7f0836a00640 1 -- 172.21.15.84:0/1120387554 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0ad000 con 0x5605da63b740 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 -- 172.21.15.84:0/1120387554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 msgr2=0x5605da9f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 --2- 172.21.15.84:0/1120387554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9f4720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f083c00e9c0 tx=0x7f083c0edce0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 -- 172.21.15.84:0/1120387554 shutdown_connections 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 --2- 172.21.15.84:0/1120387554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da626670 0x5605da9ec8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 --2- 172.21.15.84:0/1120387554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da61e490 0x5605da9ec3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 --2- 172.21.15.84:0/1120387554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9f4720 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 -- 172.21.15.84:0/1120387554 >> 172.21.15.84:0/1120387554 conn(0x5605da9f5310 msgr2=0x5605da9f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 -- 172.21.15.84:0/1120387554 shutdown_connections 2024-09-21T07:53:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.200+0000 7f08581f2740 1 -- 172.21.15.84:0/1120387554 wait complete. 2024-09-21T07:53:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 -- start start 2024-09-21T07:53:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 Processor -- start 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da61e490 0x5605daa03010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1afe20 con 0x5605da61e490 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1af750 con 0x5605da63b740 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1ac9b0 con 0x5605da626670 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.201+0000 7f08581f2740 10 client.0 _ll_register_callbacks cb 0x7f0844009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da61e490 0x5605daa03010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da61e490 0x5605daa03010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35826/0 (socket says 172.21.15.84:35826) 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 -- 172.21.15.84:0/311386589 learned_addr learned my addr 172.21.15.84:0/311386589 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084a000640 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084b400640 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 -- 172.21.15.84:0/311386589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 msgr2=0x5605da9ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 -- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 msgr2=0x5605da9ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.202+0000 7f084aa00640 1 -- 172.21.15.84:0/311386589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605daa00080 con 0x5605da61e490 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f084aa00640 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da61e490 0x5605daa03010 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f083c0aab00 tx=0x7f083c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734a39f4cf1ede53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f082be00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f082be00640 1 -- 172.21.15.84:0/311386589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0ad1e0 con 0x5605da61e490 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f082be00640 1 -- 172.21.15.84:0/311386589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f083c0a9b00 con 0x5605da61e490 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f083c0ad3a0 con 0x5605da61e490 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f082be00640 1 -- 172.21.15.84:0/311386589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f083c0ad660 con 0x5605da61e490 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f08581f2740 10 client.16425 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.203+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605daa78620 con 0x5605da61e490 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f082be00640 1 -- 172.21.15.84:0/311386589 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f083c0ad3a0 con 0x5605da61e490 2024-09-21T07:53:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f082be00640 1 -- 172.21.15.84:0/311386589 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f083c0f7070 con 0x5605da61e490 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f08581f2740 10 client.16425 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f08581f2740 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f08581f2740 20 client.16425 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f08581f2740 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da647350 0x5605daa7a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f08581f2740 4 client.16425 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5605da962890 con 0x5605da647350 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.204+0000 7f084a000640 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da647350 0x5605daa7a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.205+0000 7f082be00640 10 client.16425 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.205+0000 7f084a000640 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da647350 0x5605daa7a900 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc7810686b5b987 server_cookie=f91b3d3b7238f75b in_seq=0 out_seq=0 2024-09-21T07:53:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f082be00640 1 -- 172.21.15.84:0/311386589 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5605da962890 con 0x5605da647350 2024-09-21T07:53:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f082be00640 10 client.16425 handle_command_reply: tid=0 2024-09-21T07:53:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 client.16425 shutdown 2024-09-21T07:53:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da61e490 msgr2=0x5605daa03010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da61e490 0x5605daa03010 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f083c0aab00 tx=0x7f083c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 shutdown_connections 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605da63b740 0x5605da9ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605da647350 0x5605daa7a900 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605da626670 0x5605da9ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 --2- 172.21.15.84:0/311386589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605da61e490 0x5605daa03010 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f082be00640 0 client.16425 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 >> 172.21.15.84:0/311386589 conn(0x5605da9f5310 msgr2=0x5605da9eff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.207+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 shutdown_connections 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.208+0000 7f08581f2740 1 -- 172.21.15.84:0/311386589 wait complete. 2024-09-21T07:53:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.208+0000 7f08581f2740 20 client.16425 trim_cache size 0 max 16384 2024-09-21T07:53:34.211 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:53:34.211 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:53:34.211 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "a783bb27-9ab3-4381-8718-e55ea81ab33c", 2024-09-21T07:53:34.211 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:53:34.211 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.208+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f08300b6700 msgr2=0x7f08300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.208+0000 7f084be00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f08300b6700 0x7f08300b8c10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0844005f40 tx=0x7f0844009600 comp rx=0 tx=0).stop 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.208+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c0757b0 msgr2=0x7f084c19c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.208+0000 7f084be00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c0757b0 0x7f084c19c4c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f083c00e9f0 tx=0x7f083c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 shutdown_connections 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f08300b6700 0x7f08300b8c10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f084c10ff10 0x7f084c1a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f084c076100 0x7f084c19ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 --2- 172.21.15.84:0/1897021388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f084c0757b0 0x7f084c19c4c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 >> 172.21.15.84:0/1897021388 conn(0x7f084c0ff440 msgr2=0x7f084c107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 shutdown_connections 2024-09-21T07:53:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:34.209+0000 7f084be00640 1 -- 172.21.15.84:0/1897021388 wait complete. 2024-09-21T07:53:35.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:53:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:35 smithi084 ceph-mon[30411]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 21 MiB/s wr, 234 op/s 2024-09-21T07:53:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:35 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:53:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:35 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:35 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:53:35.345 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:35 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:35.484 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:35.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:35 smithi162 ceph-mon[34833]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 21 MiB/s wr, 234 op/s 2024-09-21T07:53:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:35 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:53:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:35 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:35 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:53:35.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:35 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:35.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:35 smithi191 ceph-mon[34667]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 21 MiB/s wr, 234 op/s 2024-09-21T07:53:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:35 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:53:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:35 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:35 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:53:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:35 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 -- 172.21.15.84:0/2661944861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf88105300 msgr2=0x7faf8810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 --2- 172.21.15.84:0/2661944861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf88105300 0x7faf8810d850 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faf74009900 tx=0x7faf7402a410 comp rx=0 tx=0).stop 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 -- 172.21.15.84:0/2661944861 shutdown_connections 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 --2- 172.21.15.84:0/2661944861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8810de10 0x7faf88110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 --2- 172.21.15.84:0/2661944861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf88105300 0x7faf8810d850 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 --2- 172.21.15.84:0/2661944861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf881049b0 0x7faf88104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 -- 172.21.15.84:0/2661944861 >> 172.21.15.84:0/2661944861 conn(0x7faf88079760 msgr2=0x7faf88079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 -- 172.21.15.84:0/2661944861 shutdown_connections 2024-09-21T07:53:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.093+0000 7faf8e200640 1 -- 172.21.15.84:0/2661944861 wait complete. 2024-09-21T07:53:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.094+0000 7faf8e200640 1 Processor -- start 2024-09-21T07:53:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.095+0000 7faf8e200640 1 -- start start 2024-09-21T07:53:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.095+0000 7faf8e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf881049b0 0x7faf881026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.095+0000 7faf8e200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88105300 0x7faf88102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.095+0000 7faf8e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8810de10 0x7faf88103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.095+0000 7faf8e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf88113ac0 con 0x7faf8810de10 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.095+0000 7faf8e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf88113940 con 0x7faf881049b0 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.095+0000 7faf8e200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf88113c40 con 0x7faf88105300 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8810de10 0x7faf88103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8810de10 0x7faf88103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35846/0 (socket says 172.21.15.84:35846) 2024-09-21T07:53:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 -- 172.21.15.84:0/2205977044 learned_addr learned my addr 172.21.15.84:0/2205977044 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87400640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf881049b0 0x7faf881026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 -- 172.21.15.84:0/2205977044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88105300 msgr2=0x7faf88102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88105300 0x7faf88102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 -- 172.21.15.84:0/2205977044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf881049b0 msgr2=0x7faf881026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf881049b0 0x7faf881026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 -- 172.21.15.84:0/2205977044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf881a8730 con 0x7faf8810de10 2024-09-21T07:53:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87400640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf881049b0 0x7faf881026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.096+0000 7faf87e00640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8810de10 0x7faf88103170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faf8000eb10 tx=0x7faf8000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.097+0000 7faf7fe00640 1 -- 172.21.15.84:0/2205977044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80004b20 con 0x7faf8810de10 2024-09-21T07:53:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.097+0000 7faf7fe00640 1 -- 172.21.15.84:0/2205977044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf80004cc0 con 0x7faf8810de10 2024-09-21T07:53:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.097+0000 7faf7fe00640 1 -- 172.21.15.84:0/2205977044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80010670 con 0x7faf8810de10 2024-09-21T07:53:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.097+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf881a8a20 con 0x7faf8810de10 2024-09-21T07:53:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.097+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf881a8f10 con 0x7faf8810de10 2024-09-21T07:53:36.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.100+0000 7faf94e54740 1 Processor -- start 2024-09-21T07:53:36.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.100+0000 7faf7fe00640 1 -- 172.21.15.84:0/2205977044 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7faf80005020 con 0x7faf8810de10 2024-09-21T07:53:36.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf94e54740 1 -- start start 2024-09-21T07:53:36.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf94e54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56323f070 0x55e5635e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf94e54740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf94e54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf94e54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e56355cf70 con 0x55e56323f070 2024-09-21T07:53:36.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf94e54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e56354c3a0 con 0x55e56321e390 2024-09-21T07:53:36.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf94e54740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e5635501b0 con 0x55e5632161b0 2024-09-21T07:53:36.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf86a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56323f070 0x55e5635e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf87400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf87400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35364/0 (socket says 172.21.15.84:35364) 2024-09-21T07:53:36.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.101+0000 7faf87400640 1 -- 172.21.15.84:0/2189820271 learned_addr learned my addr 172.21.15.84:0/2189820271 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:36.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf86a00640 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf87400640 1 -- 172.21.15.84:0/2189820271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 msgr2=0x55e5635e67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf87400640 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635e67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf87400640 1 -- 172.21.15.84:0/2189820271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56323f070 msgr2=0x55e5635e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf87400640 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56323f070 0x55e5635e5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf87400640 1 -- 172.21.15.84:0/2189820271 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e563516c90 con 0x55e5632161b0 2024-09-21T07:53:36.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf86a00640 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635e67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:36.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.102+0000 7faf87400640 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635e62a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf78009c20 tx=0x7faf78010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f4f52ece45e03bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.103+0000 7faf73e00640 1 -- 172.21.15.84:0/2189820271 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78004030 con 0x55e5632161b0 2024-09-21T07:53:36.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.103+0000 7faf7fe00640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faf6c0b6700 0x7faf6c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.103+0000 7faf73e00640 1 -- 172.21.15.84:0/2189820271 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf780035f0 con 0x55e5632161b0 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.103+0000 7faf73e00640 1 -- 172.21.15.84:0/2189820271 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf780126b0 con 0x55e5632161b0 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.103+0000 7faf7fe00640 1 -- 172.21.15.84:0/2205977044 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7faf800e8150 con 0x7faf8810de10 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.103+0000 7faf86a00640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faf6c0b6700 0x7faf6c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 -- 172.21.15.84:0/2189820271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 msgr2=0x55e5635e62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf86a00640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faf6c0b6700 0x7faf6c0b8c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf74009230 tx=0x7faf74000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635e62a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf78009c20 tx=0x7faf78010740 comp rx=0 tx=0).stop 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 -- 172.21.15.84:0/2189820271 shutdown_connections 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635e67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635e62a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 --2- 172.21.15.84:0/2189820271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56323f070 0x55e5635e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 -- 172.21.15.84:0/2189820271 >> 172.21.15.84:0/2189820271 conn(0x55e563233460 msgr2=0x55e5635e3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 -- 172.21.15.84:0/2189820271 shutdown_connections 2024-09-21T07:53:36.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 -- 172.21.15.84:0/2189820271 wait complete. 2024-09-21T07:53:36.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.104+0000 7faf94e54740 1 -- start start 2024-09-21T07:53:36.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 1 Processor -- start 2024-09-21T07:53:36.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635f1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56321e390 0x55e5635f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56323f070 0x55e5635fd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e5633ad700 con 0x55e56321e390 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e5634e7540 con 0x55e56323f070 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e5635f4540 con 0x55e5632161b0 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf94e54740 10 client.0 _ll_register_callbacks cb 0x55e5634f7430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.105+0000 7faf86a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56321e390 0x55e5635f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56321e390 0x55e5635f1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35860/0 (socket says 172.21.15.84:35860) 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 -- 172.21.15.84:0/276880916 learned_addr learned my addr 172.21.15.84:0/276880916 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 -- 172.21.15.84:0/276880916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 msgr2=0x55e5635f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 -- 172.21.15.84:0/276880916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56323f070 msgr2=0x55e5635fd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56323f070 0x55e5635fd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 -- 172.21.15.84:0/276880916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5632aa650 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf86a00640 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56321e390 0x55e5635f1a50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7faf74004650 tx=0x7faf74031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe50b0044d6905cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.106+0000 7faf70c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf70c00640 1 -- 172.21.15.84:0/276880916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7404e020 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e5634e9b50 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf70c00640 1 -- 172.21.15.84:0/276880916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7faf740046c0 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf70c00640 1 -- 172.21.15.84:0/276880916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf74059050 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf94e54740 10 client.16437 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e563504910 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf70c00640 1 -- 172.21.15.84:0/276880916 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e5634e9b50 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.107+0000 7faf70c00640 1 -- 172.21.15.84:0/276880916 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faf7403a040 con 0x55e56321e390 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.108+0000 7faf94e54740 10 client.16437 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.108+0000 7faf94e54740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.108+0000 7faf94e54740 20 client.16437 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:36.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.108+0000 7faf94e54740 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631fd9f0 0x55e563603930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.108+0000 7faf94e54740 4 client.16437 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:36.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.108+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e56355eec0 con 0x55e5631fd9f0 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.108+0000 7faf87400640 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631fd9f0 0x55e563603930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.109+0000 7faf87400640 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631fd9f0 0x55e563603930 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ded8ad3d4b65649 server_cookie=5aef7b5cd55ba3c2 in_seq=0 out_seq=0 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.109+0000 7faf70c00640 10 client.16437 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.109+0000 7faf70c00640 1 -- 172.21.15.84:0/276880916 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e56355eec0 con 0x55e5631fd9f0 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.109+0000 7faf70c00640 10 client.16437 handle_command_reply: tid=0 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 client.16437 shutdown 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56321e390 msgr2=0x55e5635f1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56321e390 0x55e5635f1a50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7faf74004650 tx=0x7faf74031400 comp rx=0 tx=0).stop 2024-09-21T07:53:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 shutdown_connections 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56323f070 0x55e5635fd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e56321e390 0x55e5635f1a50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631fd9f0 0x55e563603930 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 --2- 172.21.15.84:0/276880916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e5632161b0 0x55e5635f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 >> 172.21.15.84:0/276880916 conn(0x55e563233460 msgr2=0x55e5635e8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf70c00640 0 client.16437 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 shutdown_connections 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 1 -- 172.21.15.84:0/276880916 wait complete. 2024-09-21T07:53:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.110+0000 7faf94e54740 20 client.16437 trim_cache size 0 max 16384 2024-09-21T07:53:36.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 Processor -- start 2024-09-21T07:53:36.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 -- start start 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635e9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635ee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635eec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf881b2f40 con 0x55e5632161b0 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf881b4a80 con 0x55e56321e390 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf94e54740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf881b3610 con 0x55e56323f070 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf87400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635e9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf87400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635e9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35870/0 (socket says 172.21.15.84:35870) 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf87400640 1 -- 172.21.15.84:0/451409649 learned_addr learned my addr 172.21.15.84:0/451409649 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.129+0000 7faf86a00640 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87e00640 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87400640 1 -- 172.21.15.84:0/451409649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 msgr2=0x55e5635eec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87400640 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635eec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87400640 1 -- 172.21.15.84:0/451409649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 msgr2=0x55e5635ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87400640 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87400640 1 -- 172.21.15.84:0/451409649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5635f3b10 con 0x55e5632161b0 2024-09-21T07:53:36.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87e00640 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:36.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf86a00640 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:36.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf87400640 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635e9570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55e5635e49e0 tx=0x7faf78009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e7f9f227f9290d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf73400640 1 -- 172.21.15.84:0/451409649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78009730 con 0x55e5632161b0 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf73400640 1 -- 172.21.15.84:0/451409649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf780055a0 con 0x55e5632161b0 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.130+0000 7faf73400640 1 -- 172.21.15.84:0/451409649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78003af0 con 0x55e5632161b0 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 -- 172.21.15.84:0/451409649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 msgr2=0x55e5635e9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635e9570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55e5635e49e0 tx=0x7faf78009b20 comp rx=0 tx=0).stop 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 -- 172.21.15.84:0/451409649 shutdown_connections 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 --2- 172.21.15.84:0/451409649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635e9570 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 -- 172.21.15.84:0/451409649 >> 172.21.15.84:0/451409649 conn(0x55e563233460 msgr2=0x55e5635e8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 -- 172.21.15.84:0/451409649 shutdown_connections 2024-09-21T07:53:36.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.131+0000 7faf94e54740 1 -- 172.21.15.84:0/451409649 wait complete. 2024-09-21T07:53:36.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.132+0000 7faf94e54740 1 -- start start 2024-09-21T07:53:36.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.132+0000 7faf94e54740 1 Processor -- start 2024-09-21T07:53:36.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.132+0000 7faf94e54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf94e54740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635f5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf94e54740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf94e54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf881b43b0 con 0x55e5632161b0 2024-09-21T07:53:36.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf94e54740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf881b3ce0 con 0x55e56321e390 2024-09-21T07:53:36.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf94e54740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf881b0f00 con 0x55e56323f070 2024-09-21T07:53:36.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf94e54740 10 client.0 _ll_register_callbacks cb 0x7faf74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635f9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35876/0 (socket says 172.21.15.84:35876) 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 -- 172.21.15.84:0/3786832324 learned_addr learned my addr 172.21.15.84:0/3786832324 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87e00640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf86a00640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 -- 172.21.15.84:0/3786832324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 msgr2=0x55e5635f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 -- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 msgr2=0x55e5635f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf87400640 1 -- 172.21.15.84:0/3786832324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5635f5eb0 con 0x55e5632161b0 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.133+0000 7faf86a00640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf87400640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635f9e60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf78010780 tx=0x7faf78003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c4fa702f1b7e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf70c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:36.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf70c00640 1 -- 172.21.15.84:0/3786832324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7802b040 con 0x55e5632161b0 2024-09-21T07:53:36.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf70c00640 1 -- 172.21.15.84:0/3786832324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7faf780052c0 con 0x55e5632161b0 2024-09-21T07:53:36.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf780055a0 con 0x55e5632161b0 2024-09-21T07:53:36.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf70c00640 1 -- 172.21.15.84:0/3786832324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf7803e050 con 0x55e5632161b0 2024-09-21T07:53:36.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf94e54740 10 client.16443 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:36.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.134+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e56366e110 con 0x55e5632161b0 2024-09-21T07:53:36.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf70c00640 1 -- 172.21.15.84:0/3786832324 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf780055a0 con 0x55e5632161b0 2024-09-21T07:53:36.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf70c00640 1 -- 172.21.15.84:0/3786832324 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faf7800f040 con 0x55e5632161b0 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf94e54740 10 client.16443 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf94e54740 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf94e54740 20 client.16443 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf94e54740 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631d2da0 0x55e563670720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf94e54740 4 client.16443 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.135+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e56355a970 con 0x55e5631d2da0 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.136+0000 7faf86a00640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631d2da0 0x55e563670720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.136+0000 7faf86a00640 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631d2da0 0x55e563670720 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd64a65d4056a58 server_cookie=686f1ad18ad8a86d in_seq=0 out_seq=0 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.136+0000 7faf70c00640 10 client.16443 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf70c00640 1 -- 172.21.15.84:0/3786832324 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55e56355a970 con 0x55e5631d2da0 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf70c00640 10 client.16443 handle_command_reply: tid=0 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 client.16443 shutdown 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 msgr2=0x55e5635f9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635f9e60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf78010780 tx=0x7faf78003680 comp rx=0 tx=0).stop 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 shutdown_connections 2024-09-21T07:53:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e5631d2da0 0x55e563670720 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e56323f070 0x55e5635f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e56321e390 0x55e5635f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 --2- 172.21.15.84:0/3786832324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e5632161b0 0x55e5635f9e60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf70c00640 0 client.16443 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 >> 172.21.15.84:0/3786832324 conn(0x55e563233460 msgr2=0x55e5635f29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 shutdown_connections 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 1 -- 172.21.15.84:0/3786832324 wait complete. 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.137+0000 7faf94e54740 20 client.16443 trim_cache size 0 max 16384 2024-09-21T07:53:36.141 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "a783bb27-9ab3-4381-8718-e55ea81ab33c", 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:36.142 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:36.143 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:53:36.144 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:53:36.145 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:53:36.145 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:53:36.145 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:53:36.145 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:36.145 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:36.145 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:53:36.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faf6c0b6700 msgr2=0x7faf6c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faf6c0b6700 0x7faf6c0b8c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf74009230 tx=0x7faf74000bc0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8810de10 msgr2=0x7faf88103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8810de10 0x7faf88103170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faf8000eb10 tx=0x7faf8000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 shutdown_connections 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faf6c0b6700 0x7faf6c0b8c10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8810de10 0x7faf88103170 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88105300 0x7faf88102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 --2- 172.21.15.84:0/2205977044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf881049b0 0x7faf881026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.138+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 >> 172.21.15.84:0/2205977044 conn(0x7faf88079760 msgr2=0x7faf881007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.139+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 shutdown_connections 2024-09-21T07:53:36.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:36.139+0000 7faf8e200640 1 -- 172.21.15.84:0/2205977044 wait complete. 2024-09-21T07:53:37.124 INFO:tasks.cephfs.filesystem:scrub status for tag:a783bb27-9ab3-4381-8718-e55ea81ab33c - {'path': '/', 'tag': 'a783bb27-9ab3-4381-8718-e55ea81ab33c', 'options': 'recursive,force'} 2024-09-21T07:53:37.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:37 smithi162 ceph-mon[34833]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 51 op/s 2024-09-21T07:53:37.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:37 smithi084 ceph-mon[30411]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 51 op/s 2024-09-21T07:53:37.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:37 smithi191 ceph-mon[34667]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 51 op/s 2024-09-21T07:53:37.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:53:38.198 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 -- 172.21.15.84:0/1568299410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa940103b80 msgr2=0x7fa940103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 --2- 172.21.15.84:0/1568299410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa940103b80 0x7fa940103f90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa930009900 tx=0x7fa93002a410 comp rx=0 tx=0).stop 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 -- 172.21.15.84:0/1568299410 shutdown_connections 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 --2- 172.21.15.84:0/1568299410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa940109e10 0x7fa940110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 --2- 172.21.15.84:0/1568299410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9401094c0 0x7fa9401098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 --2- 172.21.15.84:0/1568299410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa940103b80 0x7fa940103f90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 -- 172.21.15.84:0/1568299410 >> 172.21.15.84:0/1568299410 conn(0x7fa9400ff5d0 msgr2=0x7fa940101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.790+0000 7fa946200640 1 -- 172.21.15.84:0/1568299410 shutdown_connections 2024-09-21T07:53:38.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.791+0000 7fa946200640 1 -- 172.21.15.84:0/1568299410 wait complete. 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 Processor -- start 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 -- start start 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940103b80 0x7fa94019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9401094c0 0x7fa94019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa940109e10 0x7fa9401a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa940113ad0 con 0x7fa9401094c0 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa940113950 con 0x7fa940103b80 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa946200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa940113c50 con 0x7fa940109e10 2024-09-21T07:53:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa936a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9401094c0 0x7fa94019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa93f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940103b80 0x7fa94019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.792+0000 7fa93f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940103b80 0x7fa94019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33322/0 (socket says 172.21.15.84:33322) 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93f400640 1 -- 172.21.15.84:0/3034085177 learned_addr learned my addr 172.21.15.84:0/3034085177 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa936a00640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9401094c0 0x7fa94019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56222/0 (socket says 172.21.15.84:56222) 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93fe00640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa940109e10 0x7fa9401a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93f400640 1 -- 172.21.15.84:0/3034085177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa940109e10 msgr2=0x7fa9401a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93f400640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa940109e10 0x7fa9401a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93f400640 1 -- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9401094c0 msgr2=0x7fa94019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93f400640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9401094c0 0x7fa94019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93f400640 1 -- 172.21.15.84:0/3034085177 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9401a2630 con 0x7fa940103b80 2024-09-21T07:53:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.793+0000 7fa93f400640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940103b80 0x7fa94019c6c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa930005940 tx=0x7fa930004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.794+0000 7fa93cc00640 1 -- 172.21.15.84:0/3034085177 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93003f030 con 0x7fa940103b80 2024-09-21T07:53:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.794+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9401a28c0 con 0x7fa940103b80 2024-09-21T07:53:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.794+0000 7fa93cc00640 1 -- 172.21.15.84:0/3034085177 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa930003aa0 con 0x7fa940103b80 2024-09-21T07:53:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.794+0000 7fa93cc00640 1 -- 172.21.15.84:0/3034085177 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa930035070 con 0x7fa940103b80 2024-09-21T07:53:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.794+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9401a9080 con 0x7fa940103b80 2024-09-21T07:53:38.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.795+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa940103f90 con 0x7fa940103b80 2024-09-21T07:53:38.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.797+0000 7fa93cc00640 1 -- 172.21.15.84:0/3034085177 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa930042030 con 0x7fa940103b80 2024-09-21T07:53:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.799+0000 7fa93cc00640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9240b6680 0x7fa9240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.799+0000 7fa93cc00640 1 -- 172.21.15.84:0/3034085177 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa9301083e0 con 0x7fa940103b80 2024-09-21T07:53:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.799+0000 7fa936a00640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9240b6680 0x7fa9240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.800+0000 7fa936a00640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9240b6680 0x7fa9240b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa94006b2f0 tx=0x7fa928009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:38.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:38.801+0000 7fa93cc00640 1 -- 172.21.15.84:0/3034085177 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9300d29a0 con 0x7fa940103b80 2024-09-21T07:53:39.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.024+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9401a92b0 con 0x7fa940103b80 2024-09-21T07:53:39.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.025+0000 7fa93cc00640 1 -- 172.21.15.84:0/3034085177 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fa9300d78e0 con 0x7fa940103b80 2024-09-21T07:53:39.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:53:39.027 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:53:39.027 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:53:39.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9240b6680 msgr2=0x7fa9240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9240b6680 0x7fa9240b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa94006b2f0 tx=0x7fa928009500 comp rx=0 tx=0).stop 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940103b80 msgr2=0x7fa94019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940103b80 0x7fa94019c6c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa930005940 tx=0x7fa930004270 comp rx=0 tx=0).stop 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 shutdown_connections 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9240b6680 0x7fa9240b8b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa940109e10 0x7fa9401a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9401094c0 0x7fa94019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 --2- 172.21.15.84:0/3034085177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940103b80 0x7fa94019c6c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.027+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 >> 172.21.15.84:0/3034085177 conn(0x7fa9400ff5d0 msgr2=0x7fa940108bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.028+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 shutdown_connections 2024-09-21T07:53:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:39.028+0000 7fa946200640 1 -- 172.21.15.84:0/3034085177 wait complete. 2024-09-21T07:53:39.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:39 smithi084 ceph-mon[30411]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-09-21T07:53:39.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:39 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3034085177' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 -- 172.21.15.84:0/1355926785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0194105b10 msgr2=0x7f0194105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 --2- 172.21.15.84:0/1355926785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0194105b10 0x7f0194105f20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0184009900 tx=0x7f018402a410 comp rx=0 tx=0).stop 2024-09-21T07:53:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 -- 172.21.15.84:0/1355926785 shutdown_connections 2024-09-21T07:53:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 --2- 172.21.15.84:0/1355926785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019410bd90 0x7f01941125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 --2- 172.21.15.84:0/1355926785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f019410b440 0x7f019410b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 --2- 172.21.15.84:0/1355926785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0194105b10 0x7f0194105f20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 -- 172.21.15.84:0/1355926785 >> 172.21.15.84:0/1355926785 conn(0x7f0194101550 msgr2=0x7f01941039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 -- 172.21.15.84:0/1355926785 shutdown_connections 2024-09-21T07:53:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.516+0000 7f0198a00640 1 -- 172.21.15.84:0/1355926785 wait complete. 2024-09-21T07:53:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.517+0000 7f0198a00640 1 Processor -- start 2024-09-21T07:53:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.517+0000 7f0198a00640 1 -- start start 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0198a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0194105b10 0x7f019419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0198a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019410b440 0x7f019419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0198a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f019410bd90 0x7f01941a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0198a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0194115b60 con 0x7f019410bd90 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0198a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01941159e0 con 0x7f019410b440 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0198a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0194115ce0 con 0x7f0194105b10 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f019410bd90 0x7f01941a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0194105b10 0x7f019419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f019410bd90 0x7f01941a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56240/0 (socket says 172.21.15.84:56240) 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0194105b10 0x7f019419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33262/0 (socket says 172.21.15.84:33262) 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 -- 172.21.15.84:0/1592552195 learned_addr learned my addr 172.21.15.84:0/1592552195 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f018aa00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019410b440 0x7f019419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 -- 172.21.15.84:0/1592552195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0194105b10 msgr2=0x7f019419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0194105b10 0x7f019419c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 -- 172.21.15.84:0/1592552195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019410b440 msgr2=0x7f019419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019410b440 0x7f019419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f0193e00640 1 -- 172.21.15.84:0/1592552195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01941a2530 con 0x7f019410bd90 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.518+0000 7f018aa00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019410b440 0x7f019419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.519+0000 7f0193e00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f019410bd90 0x7f01941a1e30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b970 tx=0x7f018c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.519+0000 7f0190c00640 1 -- 172.21.15.84:0/1592552195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c019070 con 0x7f019410bd90 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.519+0000 7f0190c00640 1 -- 172.21.15.84:0/1592552195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f018c014440 con 0x7f019410bd90 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.519+0000 7f0190c00640 1 -- 172.21.15.84:0/1592552195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c0075d0 con 0x7f019410bd90 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.519+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01941a2820 con 0x7f019410bd90 2024-09-21T07:53:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.519+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01941a8fb0 con 0x7f019410bd90 2024-09-21T07:53:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.522+0000 7f01a10b3740 1 Processor -- start 2024-09-21T07:53:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.522+0000 7f0190c00640 1 -- 172.21.15.84:0/1592552195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f018c01c070 con 0x7f019410bd90 2024-09-21T07:53:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f01a10b3740 1 -- start start 2024-09-21T07:53:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d37e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e85196a2f0 0x55e851d38350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851d38890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f01a10b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e851cad6b0 con 0x55e8519931b0 2024-09-21T07:53:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f01a10b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e851c9cae0 con 0x55e8519724d0 2024-09-21T07:53:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f01a10b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e851ca08f0 con 0x55e85196a2f0 2024-09-21T07:53:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f018aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d37e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f018aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d37e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56256/0 (socket says 172.21.15.84:56256) 2024-09-21T07:53:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f0193400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e85196a2f0 0x55e851d38350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.523+0000 7f018aa00640 1 -- 172.21.15.84:0/3341177262 learned_addr learned my addr 172.21.15.84:0/3341177262 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0193400640 1 -- 172.21.15.84:0/3341177262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 msgr2=0x55e851d38890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0193400640 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851d38890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0193400640 1 -- 172.21.15.84:0/3341177262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 msgr2=0x55e851d37e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0193400640 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d37e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0193400640 1 -- 172.21.15.84:0/3341177262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e851c69780 con 0x55e85196a2f0 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f018aa00640 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d37e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0193400640 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e85196a2f0 0x55e851d38350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f018402a930 tx=0x7f0184005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=391271e4ef9dd909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0190c00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01780b6680 0x7f01780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0190c00640 1 -- 172.21.15.84:0/1592552195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f018c0e6f50 con 0x7f019410bd90 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0183e00640 1 -- 172.21.15.84:0/3341177262 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184035040 con 0x55e85196a2f0 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f018aa00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01780b6680 0x7f01780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0183e00640 1 -- 172.21.15.84:0/3341177262 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01840047a0 con 0x55e85196a2f0 2024-09-21T07:53:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.524+0000 7f0183e00640 1 -- 172.21.15.84:0/3341177262 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184003850 con 0x55e85196a2f0 2024-09-21T07:53:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 -- 172.21.15.84:0/3341177262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e85196a2f0 msgr2=0x55e851d38350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f018aa00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01780b6680 0x7f01780b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f017c006e10 tx=0x7f017c0073c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e85196a2f0 0x55e851d38350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f018402a930 tx=0x7f0184005fd0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 -- 172.21.15.84:0/3341177262 shutdown_connections 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851d38890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e85196a2f0 0x55e851d38350 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3341177262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d37e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 -- 172.21.15.84:0/3341177262 >> 172.21.15.84:0/3341177262 conn(0x55e851987300 msgr2=0x55e851d35d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 -- 172.21.15.84:0/3341177262 shutdown_connections 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.525+0000 7f01a10b3740 1 -- 172.21.15.84:0/3341177262 wait complete. 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.526+0000 7f01a10b3740 1 -- start start 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.526+0000 7f01a10b3740 1 Processor -- start 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851d43470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851d439b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d4f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f01a10b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e851bd4ab0 con 0x55e85196a2f0 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f01a10b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e851c43570 con 0x55e8519724d0 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f01a10b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e851d46530 con 0x55e8519931b0 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f01a10b3740 10 client.0 _ll_register_callbacks cb 0x55e851c52100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851d43470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851d43470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56272/0 (socket says 172.21.15.84:56272) 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 -- 172.21.15.84:0/2165040895 learned_addr learned my addr 172.21.15.84:0/2165040895 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f018aa00640 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851d439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193e00640 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d4f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 -- 172.21.15.84:0/2165040895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 msgr2=0x55e851d4f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d4f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 -- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 msgr2=0x55e851d439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851d439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.527+0000 7f0193400640 1 -- 172.21.15.84:0/2165040895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8519fe790 con 0x55e85196a2f0 2024-09-21T07:53:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f0193400640 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851d43470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0184031440 tx=0x7f0184004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb49eefcd8ae4f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f0180c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f0180c00640 1 -- 172.21.15.84:0/2165040895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184052060 con 0x55e85196a2f0 2024-09-21T07:53:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01840047a0 con 0x55e85196a2f0 2024-09-21T07:53:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f0180c00640 1 -- 172.21.15.84:0/2165040895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0184004f60 con 0x55e85196a2f0 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f0180c00640 1 -- 172.21.15.84:0/2165040895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0184035070 con 0x55e85196a2f0 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f01a10b3740 10 client.16461 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e851a77620 con 0x55e85196a2f0 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.528+0000 7f0180c00640 1 -- 172.21.15.84:0/2165040895 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01840047a0 con 0x55e85196a2f0 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f0180c00640 1 -- 172.21.15.84:0/2165040895 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0184003d40 con 0x55e85196a2f0 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f01a10b3740 10 client.16461 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f01a10b3740 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f01a10b3740 20 client.16461 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f01a10b3740 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e851951d80 0x55e851d55390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f01a10b3740 4 client.16461 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e851caf600 con 0x55e851951d80 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.529+0000 7f018aa00640 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e851951d80 0x55e851d55390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.530+0000 7f018aa00640 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e851951d80 0x55e851d55390 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2dd7b1b6a0821a5 server_cookie=1ed0c2293bb3bdc2 in_seq=0 out_seq=0 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.530+0000 7f0180c00640 10 client.16461 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f0180c00640 1 -- 172.21.15.84:0/2165040895 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e851caf600 con 0x55e851951d80 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f0180c00640 10 client.16461 handle_command_reply: tid=0 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 client.16461 shutdown 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 msgr2=0x55e851d43470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851d43470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0184031440 tx=0x7f0184004b60 comp rx=0 tx=0).stop 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 shutdown_connections 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e851951d80 0x55e851d55390 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d4f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851d439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f0180c00640 0 client.16461 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 --2- 172.21.15.84:0/2165040895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851d43470 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 >> 172.21.15.84:0/2165040895 conn(0x55e851987300 msgr2=0x55e851d38e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 shutdown_connections 2024-09-21T07:53:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.531+0000 7f01a10b3740 1 -- 172.21.15.84:0/2165040895 wait complete. 2024-09-21T07:53:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.532+0000 7f01a10b3740 20 client.16461 trim_cache size 0 max 16384 2024-09-21T07:53:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.546+0000 7f01a10b3740 1 Processor -- start 2024-09-21T07:53:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f01a10b3740 1 -- start start 2024-09-21T07:53:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85196a2f0 0x55e851d39550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519724d0 0x55e851d4f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d40640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f01a10b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01941b2de0 con 0x55e8519931b0 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f01a10b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01941b4920 con 0x55e85196a2f0 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f01a10b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01941b34b0 con 0x55e8519724d0 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f0193e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d40640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f0193e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d40640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56286/0 (socket says 172.21.15.84:56286) 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f0193e00640 1 -- 172.21.15.84:0/1021869102 learned_addr learned my addr 172.21.15.84:0/1021869102 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f018aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519724d0 0x55e851d4f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f0193400640 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85196a2f0 0x55e851d39550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f0193e00640 1 -- 172.21.15.84:0/1021869102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519724d0 msgr2=0x55e851d4f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.547+0000 7f0193e00640 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519724d0 0x55e851d4f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0193e00640 1 -- 172.21.15.84:0/1021869102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85196a2f0 msgr2=0x55e851d39550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0193e00640 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85196a2f0 0x55e851d39550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0193e00640 1 -- 172.21.15.84:0/1021869102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e851d41950 con 0x55e8519931b0 2024-09-21T07:53:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0193400640 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85196a2f0 0x55e851d39550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:53:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f018aa00640 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519724d0 0x55e851d4f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0193e00640 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d40640 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f018c0e43d0 tx=0x7f018c094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f075736b1c06e6b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:39 smithi162 ceph-mon[34833]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-09-21T07:53:39.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:39 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3034085177' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0183400640 1 -- 172.21.15.84:0/1021869102 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c0b1070 con 0x55e8519931b0 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0183400640 1 -- 172.21.15.84:0/1021869102 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f018c0ac630 con 0x55e8519931b0 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.548+0000 7f0183400640 1 -- 172.21.15.84:0/1021869102 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c0e45f0 con 0x55e8519931b0 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 -- 172.21.15.84:0/1021869102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 msgr2=0x55e851d40640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d40640 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f018c0e43d0 tx=0x7f018c094040 comp rx=0 tx=0).stop 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 -- 172.21.15.84:0/1021869102 shutdown_connections 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e8519931b0 0x55e851d40640 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519724d0 0x55e851d4f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 --2- 172.21.15.84:0/1021869102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e85196a2f0 0x55e851d39550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 -- 172.21.15.84:0/1021869102 >> 172.21.15.84:0/1021869102 conn(0x55e851987300 msgr2=0x55e851d38e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 -- 172.21.15.84:0/1021869102 shutdown_connections 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 -- 172.21.15.84:0/1021869102 wait complete. 2024-09-21T07:53:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.549+0000 7f01a10b3740 1 -- start start 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 1 Processor -- start 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851db6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851db73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d57c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01941b4250 con 0x55e85196a2f0 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01941b3b80 con 0x55e8519724d0 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01941b0da0 con 0x55e8519931b0 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f01a10b3740 10 client.0 _ll_register_callbacks cb 0x7f017c007220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f0193400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851db6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f0193400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851db6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56290/0 (socket says 172.21.15.84:56290) 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f018aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851db73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f0193400640 1 -- 172.21.15.84:0/3014765734 learned_addr learned my addr 172.21.15.84:0/3014765734 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.550+0000 7f0193e00640 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d57c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0193400640 1 -- 172.21.15.84:0/3014765734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 msgr2=0x55e851d57c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0193400640 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d57c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0193400640 1 -- 172.21.15.84:0/3014765734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 msgr2=0x55e851db73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0193400640 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851db73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0193400640 1 -- 172.21.15.84:0/3014765734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e851d58370 con 0x55e85196a2f0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0193400640 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851db6de0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0184009900 tx=0x7f0184005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b96c3337f8b924 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0180c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0180c00640 1 -- 172.21.15.84:0/3014765734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184052040 con 0x55e85196a2f0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0180c00640 1 -- 172.21.15.84:0/3014765734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0184031cc0 con 0x55e85196a2f0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f018c0ac630 con 0x55e85196a2f0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f0180c00640 1 -- 172.21.15.84:0/3014765734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01840047a0 con 0x55e85196a2f0 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f01a10b3740 10 client.16467 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.551+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e851dbf670 con 0x55e85196a2f0 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f0180c00640 1 -- 172.21.15.84:0/3014765734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f018c0ac630 con 0x55e85196a2f0 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f0180c00640 1 -- 172.21.15.84:0/3014765734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f01840037b0 con 0x55e85196a2f0 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f01a10b3740 10 client.16467 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f01a10b3740 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f01a10b3740 20 client.16467 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e8519271c0 0x55e851dc1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f01a10b3740 4 client.16467 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e851cab0b0 con 0x55e8519271c0 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.552+0000 7f018aa00640 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e8519271c0 0x55e851dc1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.553+0000 7f018aa00640 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e8519271c0 0x55e851dc1c30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a86f6cb5b4f2ed7 server_cookie=4b7974bcf7da4d0 in_seq=0 out_seq=0 2024-09-21T07:53:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.553+0000 7f0180c00640 10 client.16467 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f0180c00640 1 -- 172.21.15.84:0/3014765734 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e851cab0b0 con 0x55e8519271c0 2024-09-21T07:53:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f0180c00640 10 client.16467 handle_command_reply: tid=0 2024-09-21T07:53:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 client.16467 shutdown 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 msgr2=0x55e851db6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851db6de0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0184009900 tx=0x7f0184005a70 comp rx=0 tx=0).stop 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 shutdown_connections 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e8519271c0 0x55e851dc1c30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e8519931b0 0x55e851d57c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e8519724d0 0x55e851db73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f0180c00640 0 client.16467 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 --2- 172.21.15.84:0/3014765734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e85196a2f0 0x55e851db6de0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 >> 172.21.15.84:0/3014765734 conn(0x55e851987300 msgr2=0x55e851d38e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 shutdown_connections 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.563+0000 7f01a10b3740 1 -- 172.21.15.84:0/3014765734 wait complete. 2024-09-21T07:53:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f01a10b3740 20 client.16467 trim_cache size 0 max 16384 2024-09-21T07:53:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:53:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:53:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:53:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:53:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01780b6680 msgr2=0x7f01780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01780b6680 0x7f01780b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f017c006e10 tx=0x7f017c0073c0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f019410bd90 msgr2=0x7f01941a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f019410bd90 0x7f01941a1e30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b970 tx=0x7f018c00be30 comp rx=0 tx=0).stop 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 shutdown_connections 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01780b6680 0x7f01780b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f019410bd90 0x7f01941a1e30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019410b440 0x7f019419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 --2- 172.21.15.84:0/1592552195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0194105b10 0x7f019419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.564+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 >> 172.21.15.84:0/1592552195 conn(0x7f0194101550 msgr2=0x7f0194103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.565+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 shutdown_connections 2024-09-21T07:53:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:39.565+0000 7f0198a00640 1 -- 172.21.15.84:0/1592552195 wait complete. 2024-09-21T07:53:39.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:39 smithi191 ceph-mon[34667]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-09-21T07:53:39.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:39 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3034085177' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:39.864 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 98677c53 --release --await' 2024-09-21T07:53:39.865 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 98677c53 --release --await 2024-09-21T07:53:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:40.551 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:40 smithi084 ceph-mon[30411]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 16 op/s 2024-09-21T07:53:40.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:40 smithi162 ceph-mon[34833]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 16 op/s 2024-09-21T07:53:40.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:40 smithi191 ceph-mon[34667]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 16 op/s 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 -- 172.21.15.84:0/3539092940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8241100f0 msgr2=0x7fa824112530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 --2- 172.21.15.84:0/3539092940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8241100f0 0x7fa824112530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009ca0 tx=0x7fa81c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 -- 172.21.15.84:0/3539092940 shutdown_connections 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 --2- 172.21.15.84:0/3539092940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8241100f0 0x7fa824112530 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 --2- 172.21.15.84:0/3539092940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa824076100 0x7fa82410fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 --2- 172.21.15.84:0/3539092940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8240757b0 0x7fa824075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 -- 172.21.15.84:0/3539092940 >> 172.21.15.84:0/3539092940 conn(0x7fa8240ff600 msgr2=0x7fa824101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 -- 172.21.15.84:0/3539092940 shutdown_connections 2024-09-21T07:53:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.846+0000 7fa82bc00640 1 -- 172.21.15.84:0/3539092940 wait complete. 2024-09-21T07:53:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.847+0000 7fa82bc00640 1 Processor -- start 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.847+0000 7fa82bc00640 1 -- start start 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa82bc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8240757b0 0x7fa82419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa82bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa824076100 0x7fa82419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa82bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8241100f0 0x7fa8241a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa82bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa824115cf0 con 0x7fa824076100 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa82bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa824115b70 con 0x7fa8241100f0 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa82bc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa824115e70 con 0x7fa8240757b0 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa81be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa824076100 0x7fa82419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa81be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa824076100 0x7fa82419cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56308/0 (socket says 172.21.15.84:56308) 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa81be00640 1 -- 172.21.15.84:0/251646963 learned_addr learned my addr 172.21.15.84:0/251646963 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa829c00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8241100f0 0x7fa8241a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.848+0000 7fa829200640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8240757b0 0x7fa82419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa81be00640 1 -- 172.21.15.84:0/251646963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8240757b0 msgr2=0x7fa82419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa81be00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8240757b0 0x7fa82419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa81be00640 1 -- 172.21.15.84:0/251646963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8241100f0 msgr2=0x7fa8241a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa81be00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8241100f0 0x7fa8241a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa81be00640 1 -- 172.21.15.84:0/251646963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8241a25b0 con 0x7fa824076100 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa81be00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa824076100 0x7fa82419cbe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00d770 tx=0x7fa80c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa822000640 1 -- 172.21.15.84:0/251646963 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c017070 con 0x7fa824076100 2024-09-21T07:53:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa822000640 1 -- 172.21.15.84:0/251646963 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa80c009c30 con 0x7fa824076100 2024-09-21T07:53:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa822000640 1 -- 172.21.15.84:0/251646963 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c003cc0 con 0x7fa824076100 2024-09-21T07:53:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8241a28a0 con 0x7fa824076100 2024-09-21T07:53:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.849+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8241a9000 con 0x7fa824076100 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 Processor -- start 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 -- start start 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa822000640 1 -- 172.21.15.84:0/251646963 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa80c003e60 con 0x7fa824076100 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564f8562d290 con 0x564f852e6660 2024-09-21T07:53:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f8561c6c0 con 0x564f852ee840 2024-09-21T07:53:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.853+0000 7fa8327f5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564f856204d0 con 0x564f8530f520 2024-09-21T07:53:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa81be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56310/0 (socket says 172.21.15.84:56310) 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 -- 172.21.15.84:0/4100163194 learned_addr learned my addr 172.21.15.84:0/4100163194 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829c00640 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 -- 172.21.15.84:0/4100163194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 msgr2=0x564f856b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 -- 172.21.15.84:0/4100163194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 msgr2=0x564f856b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.854+0000 7fa829200640 1 -- 172.21.15.84:0/4100163194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f855a9460 con 0x564f852e6660 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.855+0000 7fa829200640 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856b6700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa814009c90 tx=0x7fa8140117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382c74cafc9e6099 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.855+0000 7fa81a000640 1 -- 172.21.15.84:0/4100163194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814012450 con 0x564f852e6660 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.855+0000 7fa81a000640 1 -- 172.21.15.84:0/4100163194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa814012aa0 con 0x564f852e6660 2024-09-21T07:53:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.855+0000 7fa81a000640 1 -- 172.21.15.84:0/4100163194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81400fb40 con 0x564f852e6660 2024-09-21T07:53:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.855+0000 7fa822000640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8080b6700 0x7fa8080b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.855+0000 7fa822000640 1 -- 172.21.15.84:0/251646963 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa80c0e73c0 con 0x7fa824076100 2024-09-21T07:53:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.855+0000 7fa829c00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8080b6700 0x7fa8080b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 -- 172.21.15.84:0/4100163194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 msgr2=0x564f856b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856b6700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa814009c90 tx=0x7fa8140117b0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 -- 172.21.15.84:0/4100163194 shutdown_connections 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856b6700 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 --2- 172.21.15.84:0/4100163194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 -- 172.21.15.84:0/4100163194 >> 172.21.15.84:0/4100163194 conn(0x564f85303910 msgr2=0x564f856b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa8327f5740 1 -- 172.21.15.84:0/4100163194 shutdown_connections 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.856+0000 7fa829c00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8080b6700 0x7fa8080b8c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa81c006010 tx=0x7fa81c005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.857+0000 7fa8327f5740 1 -- 172.21.15.84:0/4100163194 wait complete. 2024-09-21T07:53:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.857+0000 7fa8327f5740 1 -- start start 2024-09-21T07:53:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.857+0000 7fa8327f5740 1 Processor -- start 2024-09-21T07:53:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa8327f5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564f8547dbb0 con 0x564f852e6660 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa8327f5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f855b76c0 con 0x564f852ee840 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa8327f5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564f856c49a0 con 0x564f8530f520 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa8327f5740 10 client.0 _ll_register_callbacks cb 0x564f855d2490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa829200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa829200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56316/0 (socket says 172.21.15.84:56316) 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa829200640 1 -- 172.21.15.84:0/2646054711 learned_addr learned my addr 172.21.15.84:0/2646054711 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa81be00640 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.858+0000 7fa829c00640 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa829200640 1 -- 172.21.15.84:0/2646054711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 msgr2=0x564f856cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa829200640 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa829200640 1 -- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 msgr2=0x564f856c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:40.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa829200640 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa829200640 1 -- 172.21.15.84:0/2646054711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8537ab00 con 0x564f852e6660 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa829200640 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856c1db0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa81400f480 tx=0x7fa814009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d570c77e6b76d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa812a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa812a00640 1 -- 172.21.15.84:0/2646054711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814029030 con 0x564f852e6660 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa812a00640 1 -- 172.21.15.84:0/2646054711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa814020040 con 0x564f852e6660 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.859+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa814012aa0 con 0x564f852e6660 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa812a00640 1 -- 172.21.15.84:0/2646054711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa814033050 con 0x564f852e6660 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa8327f5740 10 client.16479 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564f853f1960 con 0x564f852e6660 2024-09-21T07:53:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa812a00640 1 -- 172.21.15.84:0/2646054711 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa814012aa0 con 0x564f852e6660 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa812a00640 1 -- 172.21.15.84:0/2646054711 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa814005040 con 0x564f852e6660 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa8327f5740 10 client.16479 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa8327f5740 10 client.16479 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.860+0000 7fa8327f5740 20 client.16479 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.861+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852cdea0 0x564f856d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.861+0000 7fa8327f5740 4 client.16479 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.861+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f8562f1e0 con 0x564f852cdea0 2024-09-21T07:53:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.861+0000 7fa81be00640 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852cdea0 0x564f856d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.862+0000 7fa81be00640 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852cdea0 0x564f856d3c50 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4eff6085846e2de server_cookie=42ac5bd978d6734 in_seq=0 out_seq=0 2024-09-21T07:53:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.862+0000 7fa812a00640 10 client.16479 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa812a00640 1 -- 172.21.15.84:0/2646054711 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f8562f1e0 con 0x564f852cdea0 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa812a00640 10 client.16479 handle_command_reply: tid=0 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 client.16479 shutdown 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 msgr2=0x564f856c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856c1db0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa81400f480 tx=0x7fa814009fb0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 shutdown_connections 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852cdea0 0x564f856d3c50 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f8530f520 0x564f856cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852ee840 0x564f856c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2646054711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856c1db0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 >> 172.21.15.84:0/2646054711 conn(0x564f85303910 msgr2=0x564f856b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa812a00640 0 client.16479 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.863+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 shutdown_connections 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.864+0000 7fa8327f5740 1 -- 172.21.15.84:0/2646054711 wait complete. 2024-09-21T07:53:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.864+0000 7fa8327f5740 20 client.16479 trim_cache size 0 max 16384 2024-09-21T07:53:40.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.881+0000 7fa8327f5740 1 Processor -- start 2024-09-21T07:53:40.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.881+0000 7fa8327f5740 1 -- start start 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856bb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 0x564f856b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f8530f520 0x564f856b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa8327f5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241b2f90 con 0x564f852e6660 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa8327f5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241b4ad0 con 0x564f8530f520 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa8327f5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241b3660 con 0x564f852ee840 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856bb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856bb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56320/0 (socket says 172.21.15.84:56320) 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 -- 172.21.15.84:0/1921541118 learned_addr learned my addr 172.21.15.84:0/1921541118 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:40.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 -- 172.21.15.84:0/1921541118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 msgr2=0x564f856b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 --2- 172.21.15.84:0/1921541118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 0x564f856b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 -- 172.21.15.84:0/1921541118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f8530f520 msgr2=0x564f856b3ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 --2- 172.21.15.84:0/1921541118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f8530f520 0x564f856b3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 -- 172.21.15.84:0/1921541118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f856c2470 con 0x564f852e6660 2024-09-21T07:53:40.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.882+0000 7fa829200640 1 --2- 172.21.15.84:0/1921541118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856bb9e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8140055b0 tx=0x7fa814009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ac9b9979ba951 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.883+0000 7fa819600640 1 -- 172.21.15.84:0/1921541118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814029030 con 0x564f852e6660 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.883+0000 7fa819600640 1 -- 172.21.15.84:0/1921541118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa81400f6a0 con 0x564f852e6660 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.883+0000 7fa819600640 1 -- 172.21.15.84:0/1921541118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814012aa0 con 0x564f852e6660 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.883+0000 7fa8327f5740 1 -- 172.21.15.84:0/1921541118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 msgr2=0x564f856bb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.883+0000 7fa8327f5740 1 --2- 172.21.15.84:0/1921541118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856bb9e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8140055b0 tx=0x7fa814009260 comp rx=0 tx=0).stop 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 -- 172.21.15.84:0/1921541118 shutdown_connections 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 --2- 172.21.15.84:0/1921541118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f8530f520 0x564f856b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 --2- 172.21.15.84:0/1921541118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 0x564f856b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 --2- 172.21.15.84:0/1921541118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f852e6660 0x564f856bb9e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 -- 172.21.15.84:0/1921541118 >> 172.21.15.84:0/1921541118 conn(0x564f85303910 msgr2=0x564f856bb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 -- 172.21.15.84:0/1921541118 shutdown_connections 2024-09-21T07:53:40.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 -- 172.21.15.84:0/1921541118 wait complete. 2024-09-21T07:53:40.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.884+0000 7fa8327f5740 1 -- start start 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 1 Processor -- start 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852e6660 0x564f856d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 0x564f856d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f8530f520 0x564f856d5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241b4400 con 0x564f8530f520 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241b3d30 con 0x564f852e6660 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241b0f50 con 0x564f852ee840 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa8327f5740 10 client.0 _ll_register_callbacks cb 0x7fa80c0ead40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa829c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f8530f520 0x564f856d5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa829c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f8530f520 0x564f856d5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56328/0 (socket says 172.21.15.84:56328) 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.885+0000 7fa829c00640 1 -- 172.21.15.84:0/2814445681 learned_addr learned my addr 172.21.15.84:0/2814445681 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa829c00640 1 -- 172.21.15.84:0/2814445681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 msgr2=0x564f856d51e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:40.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa829c00640 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 0x564f856d51e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa829c00640 1 -- 172.21.15.84:0/2814445681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852e6660 msgr2=0x564f856d4ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:53:40.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa829c00640 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852e6660 0x564f856d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa829c00640 1 -- 172.21.15.84:0/2814445681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8573d400 con 0x564f8530f520 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa829c00640 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f8530f520 0x564f856d5720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02aeb0 tx=0x7fa81c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8631baf63d38925 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa812a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa812a00640 1 -- 172.21.15.84:0/2814445681 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c02f610 con 0x564f8530f520 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa812a00640 1 -- 172.21.15.84:0/2814445681 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa81c042030 con 0x564f8530f520 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.886+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa81400f6a0 con 0x564f8530f520 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa812a00640 1 -- 172.21.15.84:0/2814445681 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa81c02f7b0 con 0x564f8530f520 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 10 client.16485 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564f8573e6f0 con 0x564f8530f520 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa812a00640 1 -- 172.21.15.84:0/2814445681 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa81400f6a0 con 0x564f8530f520 2024-09-21T07:53:40.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa812a00640 1 -- 172.21.15.84:0/2814445681 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa81c030c50 con 0x564f8530f520 2024-09-21T07:53:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 10 client.16485 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 10 client.16485 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:53:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 20 client.16485 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852a3250 0x564f85740f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 4 client.16485 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "98677c53", "release": true, "await": true}] 2024-09-21T07:53:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.887+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "98677c53", "release": true, "await": true}) -- 0x564f8562ac90 con 0x564f852a3250 2024-09-21T07:53:40.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.889+0000 7fa829200640 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852a3250 0x564f85740f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:40.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.891+0000 7fa829200640 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852a3250 0x564f85740f50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec93597e49671d39 server_cookie=231555228ebbeac2 in_seq=0 out_seq=0 2024-09-21T07:53:40.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.891+0000 7fa812a00640 10 client.16485 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:40.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa812a00640 1 -- 172.21.15.84:0/2814445681 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564f8562ac90 con 0x564f852a3250 2024-09-21T07:53:40.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa812a00640 10 client.16485 handle_command_reply: tid=0 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 client.16485 shutdown 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f8530f520 msgr2=0x564f856d5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f8530f520 0x564f856d5720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02aeb0 tx=0x7fa81c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 shutdown_connections 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f8530f520 0x564f856d5720 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564f852a3250 0x564f85740f50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f852ee840 0x564f856d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 --2- 172.21.15.84:0/2814445681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f852e6660 0x564f856d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 >> 172.21.15.84:0/2814445681 conn(0x564f85303910 msgr2=0x564f856b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.904+0000 7fa812a00640 0 client.16485 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.905+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 shutdown_connections 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.905+0000 7fa8327f5740 1 -- 172.21.15.84:0/2814445681 wait complete. 2024-09-21T07:53:40.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.905+0000 7fa8327f5740 20 client.16485 trim_cache size 0 max 16384 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 12, 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "98677c53": { 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 12, 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:53:40.908 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:40.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:40.910 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:53:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.905+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8080b6700 msgr2=0x7fa8080b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.905+0000 7fa82bc00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8080b6700 0x7fa8080b8c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa81c006010 tx=0x7fa81c005d80 comp rx=0 tx=0).stop 2024-09-21T07:53:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.905+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa824076100 msgr2=0x7fa82419cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.905+0000 7fa82bc00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa824076100 0x7fa82419cbe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00d770 tx=0x7fa80c00dc30 comp rx=0 tx=0).stop 2024-09-21T07:53:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 shutdown_connections 2024-09-21T07:53:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa8080b6700 0x7fa8080b8c10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8241100f0 0x7fa8241a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa824076100 0x7fa82419cbe0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 --2- 172.21.15.84:0/251646963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8240757b0 0x7fa82419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 >> 172.21.15.84:0/251646963 conn(0x7fa8240ff600 msgr2=0x7fa824107bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 shutdown_connections 2024-09-21T07:53:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:40.906+0000 7fa82bc00640 1 -- 172.21.15.84:0/251646963 wait complete. 2024-09-21T07:53:41.954 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '98677c53', total seconds elapsed: 31.9 2024-09-21T07:53:41.955 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T07:53:41.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:53:43.130 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:43 smithi162 ceph-mon[34833]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-21T07:53:43.565 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:43 smithi084 ceph-mon[30411]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-21T07:53:43.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:43 smithi191 ceph-mon[34667]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-21T07:53:44.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:44 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:53:44.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:44 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:53:44.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:44 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:53:45.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:45 smithi162 ceph-mon[34833]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 12 MiB/s wr, 146 op/s 2024-09-21T07:53:45.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:45 smithi084 ceph-mon[30411]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 12 MiB/s wr, 146 op/s 2024-09-21T07:53:45.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:45 smithi191 ceph-mon[34667]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 12 MiB/s wr, 146 op/s 2024-09-21T07:53:47.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:47 smithi162 ceph-mon[34833]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 37 MiB/s wr, 392 op/s 2024-09-21T07:53:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:47 smithi084 ceph-mon[30411]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 37 MiB/s wr, 392 op/s 2024-09-21T07:53:47.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:47 smithi191 ceph-mon[34667]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 37 MiB/s wr, 392 op/s 2024-09-21T07:53:49.496 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:49 smithi084 ceph-mon[30411]: pgmap v475: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 54 MiB/s wr, 547 op/s 2024-09-21T07:53:49.496 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:49 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:49.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:49 smithi162 ceph-mon[34833]: pgmap v475: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 54 MiB/s wr, 547 op/s 2024-09-21T07:53:49.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:49 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:49.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:49 smithi191 ceph-mon[34667]: pgmap v475: 129 pgs: 129 active+clean; 11 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 54 MiB/s wr, 547 op/s 2024-09-21T07:53:49.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:49 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.792+0000 7fc49d800640 1 -- 172.21.15.84:0/1136908003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49811cba0 msgr2=0x7fc49811efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.792+0000 7fc49d800640 1 --2- 172.21.15.84:0/1136908003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49811cba0 0x7fc49811efc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc484009860 tx=0x7fc48402a360 comp rx=0 tx=0).stop 2024-09-21T07:53:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.793+0000 7fc49d800640 1 -- 172.21.15.84:0/1136908003 shutdown_connections 2024-09-21T07:53:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.793+0000 7fc49d800640 1 --2- 172.21.15.84:0/1136908003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49811cba0 0x7fc49811efc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.793+0000 7fc49d800640 1 --2- 172.21.15.84:0/1136908003 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc49810dbf0 0x7fc49810e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.793+0000 7fc49d800640 1 --2- 172.21.15.84:0/1136908003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc498111cd0 0x7fc49810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.793+0000 7fc49d800640 1 -- 172.21.15.84:0/1136908003 >> 172.21.15.84:0/1136908003 conn(0x7fc49806e9f0 msgr2=0x7fc49806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.796+0000 7fc49d800640 1 -- 172.21.15.84:0/1136908003 shutdown_connections 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.797+0000 7fc49d800640 1 -- 172.21.15.84:0/1136908003 wait complete. 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.802+0000 7fc49d800640 1 Processor -- start 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.806+0000 7fc49d800640 1 -- start start 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.806+0000 7fc49d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc49810dbf0 0x7fc4981a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.806+0000 7fc49d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc498111cd0 0x7fc4981a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.809+0000 7fc49d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc49811cba0 0x7fc4981ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.809+0000 7fc49d800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981226c0 con 0x7fc49811cba0 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.809+0000 7fc49d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc498122540 con 0x7fc498111cd0 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.809+0000 7fc49d800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc498122840 con 0x7fc49810dbf0 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.809+0000 7fc49ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc49811cba0 0x7fc4981ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.809+0000 7fc497400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc498111cd0 0x7fc4981a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.810+0000 7fc497400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc498111cd0 0x7fc4981a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35232/0 (socket says 172.21.15.84:35232) 2024-09-21T07:53:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.810+0000 7fc497400640 1 -- 172.21.15.84:0/1387512468 learned_addr learned my addr 172.21.15.84:0/1387512468 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.810+0000 7fc497e00640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc49810dbf0 0x7fc4981a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.811+0000 7fc497e00640 1 -- 172.21.15.84:0/1387512468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc498111cd0 msgr2=0x7fc4981a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.811+0000 7fc497e00640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc498111cd0 0x7fc4981a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.811+0000 7fc497e00640 1 -- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc49811cba0 msgr2=0x7fc4981ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.811+0000 7fc497e00640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc49811cba0 0x7fc4981ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.811+0000 7fc497e00640 1 -- 172.21.15.84:0/1387512468 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4981af010 con 0x7fc49810dbf0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.811+0000 7fc497400640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc498111cd0 0x7fc4981a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.812+0000 7fc497e00640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc49810dbf0 0x7fc4981a90d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc49000eaa0 tx=0x7fc49000eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.812+0000 7fc494c00640 1 -- 172.21.15.84:0/1387512468 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49000cd50 con 0x7fc49810dbf0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.812+0000 7fc494c00640 1 -- 172.21.15.84:0/1387512468 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc490011920 con 0x7fc49810dbf0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.812+0000 7fc494c00640 1 -- 172.21.15.84:0/1387512468 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49001a960 con 0x7fc49810dbf0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.814+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4981af300 con 0x7fc49810dbf0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.814+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc498112380 con 0x7fc49810dbf0 2024-09-21T07:53:50.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.818+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4780052c0 con 0x7fc49810dbf0 2024-09-21T07:53:50.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.832+0000 7fc494c00640 1 -- 172.21.15.84:0/1387512468 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc490011470 con 0x7fc49810dbf0 2024-09-21T07:53:50.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.848+0000 7fc494c00640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc47c0b6730 0x7fc47c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:50.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.849+0000 7fc497400640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc47c0b6730 0x7fc47c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:50.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.849+0000 7fc494c00640 1 -- 172.21.15.84:0/1387512468 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc4900e7fd0 con 0x7fc49810dbf0 2024-09-21T07:53:50.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.849+0000 7fc494c00640 1 -- 172.21.15.84:0/1387512468 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc490016030 con 0x7fc49810dbf0 2024-09-21T07:53:50.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:49.850+0000 7fc497400640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc47c0b6730 0x7fc47c0b8c40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc49810fdb0 tx=0x7fc488009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.288+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4780055b0 con 0x7fc49810dbf0 2024-09-21T07:53:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.289+0000 7fc494c00640 1 -- 172.21.15.84:0/1387512468 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fc4900ae230 con 0x7fc49810dbf0 2024-09-21T07:53:50.292 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:53:50.293 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:53:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:53:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc47c0b6730 msgr2=0x7fc47c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc47c0b6730 0x7fc47c0b8c40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc49810fdb0 tx=0x7fc488009260 comp rx=0 tx=0).stop 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc49810dbf0 msgr2=0x7fc4981a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc49810dbf0 0x7fc4981a90d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc49000eaa0 tx=0x7fc49000eea0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 shutdown_connections 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc47c0b6730 0x7fc47c0b8c40 secure :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc49810fdb0 tx=0x7fc488009260 comp rx=0 tx=0).stop 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc49811cba0 0x7fc4981ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc498111cd0 0x7fc4981a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 --2- 172.21.15.84:0/1387512468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc49810dbf0 0x7fc4981a90d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.292+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 >> 172.21.15.84:0/1387512468 conn(0x7fc49806e9f0 msgr2=0x7fc498110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.293+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 shutdown_connections 2024-09-21T07:53:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:50.293+0000 7fc49d800640 1 -- 172.21.15.84:0/1387512468 wait complete. 2024-09-21T07:53:50.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:50.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:50.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:53:50.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:50.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:50.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:53:50.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:50.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:50.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:53:51.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:51 smithi162 ceph-mon[34833]: pgmap v476: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 94 MiB/s wr, 874 op/s 2024-09-21T07:53:51.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:51 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1387512468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:51.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:51 smithi084 ceph-mon[30411]: pgmap v476: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 94 MiB/s wr, 874 op/s 2024-09-21T07:53:51.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:51 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1387512468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:51.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:51 smithi191 ceph-mon[34667]: pgmap v476: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 94 MiB/s wr, 874 op/s 2024-09-21T07:53:51.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:51 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1387512468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:53:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.899+0000 7ff405400640 1 -- 172.21.15.84:0/2156466573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010fa10 msgr2=0x7ff40010fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.899+0000 7ff405400640 1 --2- 172.21.15.84:0/2156466573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010fa10 0x7ff40010fe20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009ca0 tx=0x7ff3f002a8e0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.900+0000 7ff405400640 1 -- 172.21.15.84:0/2156466573 shutdown_connections 2024-09-21T07:53:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.900+0000 7ff405400640 1 --2- 172.21.15.84:0/2156466573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff400110360 0x7ff400116b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.900+0000 7ff405400640 1 --2- 172.21.15.84:0/2156466573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010fa10 0x7ff40010fe20 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009ca0 tx=0x7ff3f002a8e0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.900+0000 7ff405400640 1 --2- 172.21.15.84:0/2156466573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff40010a0e0 0x7ff40010a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.900+0000 7ff405400640 1 -- 172.21.15.84:0/2156466573 >> 172.21.15.84:0/2156466573 conn(0x7ff400079630 msgr2=0x7ff4001081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.900+0000 7ff405400640 1 -- 172.21.15.84:0/2156466573 shutdown_connections 2024-09-21T07:53:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.900+0000 7ff405400640 1 -- 172.21.15.84:0/2156466573 wait complete. 2024-09-21T07:53:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.901+0000 7ff405400640 1 Processor -- start 2024-09-21T07:53:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.904+0000 7ff405400640 1 -- start start 2024-09-21T07:53:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.905+0000 7ff405400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010a0e0 0x7ff4001a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.905+0000 7ff405400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff400110360 0x7ff4001a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.905+0000 7ff405400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4001a64e0 0x7ff4001a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.905+0000 7ff405400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff40011a110 con 0x7ff400110360 2024-09-21T07:53:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.905+0000 7ff405400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff400119f90 con 0x7ff40010a0e0 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.905+0000 7ff405400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff40011a290 con 0x7ff4001a64e0 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.907+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010a0e0 0x7ff4001a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.907+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010a0e0 0x7ff4001a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35250/0 (socket says 172.21.15.84:35250) 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.907+0000 7ff3fe800640 1 -- 172.21.15.84:0/297278140 learned_addr learned my addr 172.21.15.84:0/297278140 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.907+0000 7ff3ff200640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4001a64e0 0x7ff4001a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.908+0000 7ff3ff200640 1 -- 172.21.15.84:0/297278140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010a0e0 msgr2=0x7ff4001a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.908+0000 7ff3ff200640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010a0e0 0x7ff4001a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.908+0000 7ff3ff200640 1 -- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff400110360 msgr2=0x7ff4001a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.908+0000 7ff3ff200640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff400110360 0x7ff4001a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.908+0000 7ff3ff200640 1 -- 172.21.15.84:0/297278140 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4001a70c0 con 0x7ff4001a64e0 2024-09-21T07:53:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.908+0000 7ff3ff200640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4001a64e0 0x7ff4001a68f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800b3e0 tx=0x7ff3f800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.909+0000 7ff3f7e00640 1 -- 172.21.15.84:0/297278140 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8015020 con 0x7ff4001a64e0 2024-09-21T07:53:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.909+0000 7ff3f7e00640 1 -- 172.21.15.84:0/297278140 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3f8011ce0 con 0x7ff4001a64e0 2024-09-21T07:53:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.909+0000 7ff3f7e00640 1 -- 172.21.15.84:0/297278140 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8010e20 con 0x7ff4001a64e0 2024-09-21T07:53:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.912+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40007bc10 con 0x7ff4001a64e0 2024-09-21T07:53:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.912+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40007c0e0 con 0x7ff4001a64e0 2024-09-21T07:53:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.918+0000 7ff40c466740 1 Processor -- start 2024-09-21T07:53:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.922+0000 7ff40c466740 1 -- start start 2024-09-21T07:53:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.922+0000 7ff3f7e00640 1 -- 172.21.15.84:0/297278140 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff3f8018020 con 0x7ff4001a64e0 2024-09-21T07:53:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.925+0000 7ff3f7e00640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e40b6880 0x7ff3e40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.925+0000 7ff3f7e00640 1 -- 172.21.15.84:0/297278140 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff3f80e7030 con 0x7ff4001a64e0 2024-09-21T07:53:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.926+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e40b6880 0x7ff3e40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.926+0000 7ff40c466740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.926+0000 7ff40c466740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8863fd2f0 0x55b8867cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.926+0000 7ff40c466740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.926+0000 7ff40c466740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b8867406b0 con 0x55b8863fd2f0 2024-09-21T07:53:52.929 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.926+0000 7ff40c466740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b88672fae0 con 0x55b8864054d0 2024-09-21T07:53:52.929 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.926+0000 7ff40c466740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b8867338f0 con 0x55b8864261b0 2024-09-21T07:53:52.929 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.927+0000 7ff3f5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8863fd2f0 0x55b8867cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.930 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.928+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.930 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.928+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:43526/0 (socket says 172.21.15.84:43526) 2024-09-21T07:53:52.930 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.928+0000 7ff3fe800640 1 -- 172.21.15.84:0/2286050424 learned_addr learned my addr 172.21.15.84:0/2286050424 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:52.930 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.928+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8863fd2f0 0x55b8867cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40632/0 (socket says 172.21.15.84:40632) 2024-09-21T07:53:52.930 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.928+0000 7ff3ff200640 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.929+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e40b6880 0x7ff3e40b8d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff400108c10 tx=0x7ff3f0000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.929+0000 7ff3ff200640 1 -- 172.21.15.84:0/2286050424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 msgr2=0x55b8867cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.929+0000 7ff3ff200640 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.929+0000 7ff3ff200640 1 -- 172.21.15.84:0/2286050424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8863fd2f0 msgr2=0x55b8867cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.929+0000 7ff3ff200640 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8863fd2f0 0x55b8867cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.929+0000 7ff3ff200640 1 -- 172.21.15.84:0/2286050424 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8866fc780 con 0x55b8864054d0 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.929+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8863fd2f0 0x55b8867cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.930+0000 7ff3ff200640 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867cb6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80e43e0 tx=0x7ff3f80ac340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=965d1f9f1e1be6bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.931+0000 7ff3ef400640 1 -- 172.21.15.84:0/2286050424 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80b15f0 con 0x55b8864054d0 2024-09-21T07:53:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.931+0000 7ff3ef400640 1 -- 172.21.15.84:0/2286050424 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3f80afe50 con 0x55b8864054d0 2024-09-21T07:53:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.933+0000 7ff3ef400640 1 -- 172.21.15.84:0/2286050424 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80abd70 con 0x55b8864054d0 2024-09-21T07:53:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 -- 172.21.15.84:0/2286050424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 msgr2=0x55b8867cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867cb6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80e43e0 tx=0x7ff3f80ac340 comp rx=0 tx=0).stop 2024-09-21T07:53:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 -- 172.21.15.84:0/2286050424 shutdown_connections 2024-09-21T07:53:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867cb6b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8863fd2f0 0x55b8867cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 --2- 172.21.15.84:0/2286050424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 -- 172.21.15.84:0/2286050424 >> 172.21.15.84:0/2286050424 conn(0x55b88641a300 msgr2=0x55b8867c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 -- 172.21.15.84:0/2286050424 shutdown_connections 2024-09-21T07:53:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.934+0000 7ff40c466740 1 -- 172.21.15.84:0/2286050424 wait complete. 2024-09-21T07:53:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 -- start start 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 Processor -- start 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8863fd2f0 0x55b8867d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b886667ab0 con 0x55b8864054d0 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8866d6570 con 0x55b8863fd2f0 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.935+0000 7ff40c466740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b8867d9280 con 0x55b8864261b0 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.936+0000 7ff40c466740 10 client.0 _ll_register_callbacks cb 0x55b8866e5100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.936+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8863fd2f0 0x55b8867d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.936+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8863fd2f0 0x55b8867d61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35274/0 (socket says 172.21.15.84:35274) 2024-09-21T07:53:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.936+0000 7ff3fe800640 1 -- 172.21.15.84:0/3585012810 learned_addr learned my addr 172.21.15.84:0/3585012810 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.936+0000 7ff3ff200640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.936+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.937+0000 7ff3fe800640 1 -- 172.21.15.84:0/3585012810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 msgr2=0x55b8867d6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.937+0000 7ff3fe800640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867d6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.937+0000 7ff3fe800640 1 -- 172.21.15.84:0/3585012810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 msgr2=0x55b8867d6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.937+0000 7ff3fe800640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.937+0000 7ff3fe800640 1 -- 172.21.15.84:0/3585012810 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b886491790 con 0x55b8863fd2f0 2024-09-21T07:53:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.938+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.942+0000 7ff3fe800640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8863fd2f0 0x55b8867d61f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8006d90 tx=0x7ff3e8010960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2e07f53961053e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.942+0000 7ff3e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:53:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.943+0000 7ff3e3e00640 1 -- 172.21.15.84:0/3585012810 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8018070 con 0x55b8863fd2f0 2024-09-21T07:53:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.943+0000 7ff3e3e00640 1 -- 172.21.15.84:0/3585012810 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff3e8014640 con 0x55b8863fd2f0 2024-09-21T07:53:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.944+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3f80afe50 con 0x55b8863fd2f0 2024-09-21T07:53:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.947+0000 7ff3e3e00640 1 -- 172.21.15.84:0/3585012810 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3e8022050 con 0x55b8863fd2f0 2024-09-21T07:53:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.947+0000 7ff40c466740 10 client.26507 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.947+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b88650a620 con 0x55b8863fd2f0 2024-09-21T07:53:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.950+0000 7ff3e3e00640 1 -- 172.21.15.84:0/3585012810 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3f80afe50 con 0x55b8863fd2f0 2024-09-21T07:53:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.950+0000 7ff3e3e00640 1 -- 172.21.15.84:0/3585012810 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff3e801db40 con 0x55b8863fd2f0 2024-09-21T07:53:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.950+0000 7ff40c466740 10 client.26507 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.950+0000 7ff40c466740 10 client.26507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.951+0000 7ff40c466740 20 client.26507 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.951+0000 7ff40c466740 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863e4d80 0x55b8867e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.951+0000 7ff40c466740 4 client.26507 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.951+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b886742600 con 0x55b8863e4d80 2024-09-21T07:53:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.951+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863e4d80 0x55b8867e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.952+0000 7ff3e3e00640 10 client.26507 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.953+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863e4d80 0x55b8867e83e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ffc523a9d05c195 server_cookie=192bdcd138ad6488 in_seq=0 out_seq=0 2024-09-21T07:53:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.954+0000 7ff3e3e00640 1 -- 172.21.15.84:0/3585012810 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b886742600 con 0x55b8863e4d80 2024-09-21T07:53:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.954+0000 7ff3e3e00640 10 client.26507 handle_command_reply: tid=0 2024-09-21T07:53:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.954+0000 7ff40c466740 1 client.26507 shutdown 2024-09-21T07:53:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.955+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8863fd2f0 msgr2=0x55b8867d61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.955+0000 7ff40c466740 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8863fd2f0 0x55b8867d61f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8006d90 tx=0x7ff3e8010960 comp rx=0 tx=0).stop 2024-09-21T07:53:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 shutdown_connections 2024-09-21T07:53:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863e4d80 0x55b8867e83e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8864261b0 0x55b8867d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff3e3e00640 0 client.26507 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 --2- 172.21.15.84:0/3585012810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8863fd2f0 0x55b8867d61f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 >> 172.21.15.84:0/3585012810 conn(0x55b88641a300 msgr2=0x55b8867cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 shutdown_connections 2024-09-21T07:53:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.956+0000 7ff40c466740 1 -- 172.21.15.84:0/3585012810 wait complete. 2024-09-21T07:53:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.957+0000 7ff40c466740 20 client.26507 trim_cache size 0 max 16384 2024-09-21T07:53:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.989+0000 7ff40c466740 1 Processor -- start 2024-09-21T07:53:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.989+0000 7ff40c466740 1 -- start start 2024-09-21T07:53:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.990+0000 7ff40c466740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.990+0000 7ff40c466740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.990+0000 7ff40c466740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864261b0 0x55b8867edba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.990+0000 7ff40c466740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4001c02f0 con 0x55b8864054d0 2024-09-21T07:53:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.990+0000 7ff40c466740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4001c1e30 con 0x55b8864261b0 2024-09-21T07:53:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.990+0000 7ff40c466740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff4001c09c0 con 0x55b8863fd2f0 2024-09-21T07:53:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.991+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.992+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:43554/0 (socket says 172.21.15.84:43554) 2024-09-21T07:53:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.991+0000 7ff3ff200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864261b0 0x55b8867edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.991+0000 7ff3f5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.992+0000 7ff3f5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40648/0 (socket says 172.21.15.84:40648) 2024-09-21T07:53:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.992+0000 7ff3f5e00640 1 -- 172.21.15.84:0/2804844666 learned_addr learned my addr 172.21.15.84:0/2804844666 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.993+0000 7ff3fe800640 1 -- 172.21.15.84:0/2804844666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864261b0 msgr2=0x55b8867edba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.993+0000 7ff3fe800640 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864261b0 0x55b8867edba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.993+0000 7ff3fe800640 1 -- 172.21.15.84:0/2804844666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 msgr2=0x55b8867d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.993+0000 7ff3fe800640 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.994+0000 7ff3fe800640 1 -- 172.21.15.84:0/2804844666 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8867d8b60 con 0x55b8863fd2f0 2024-09-21T07:53:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.994+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.994+0000 7ff3ff200640 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864261b0 0x55b8867edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:53:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.995+0000 7ff3fe800640 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867c7aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8000c00 tx=0x7ff3e8004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59196508c00c3198 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.995+0000 7ff3eea00640 1 -- 172.21.15.84:0/2804844666 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8018040 con 0x55b8863fd2f0 2024-09-21T07:53:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.996+0000 7ff3eea00640 1 -- 172.21.15.84:0/2804844666 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e8012e10 con 0x55b8863fd2f0 2024-09-21T07:53:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.996+0000 7ff3eea00640 1 -- 172.21.15.84:0/2804844666 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8014d40 con 0x55b8863fd2f0 2024-09-21T07:53:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.998+0000 7ff40c466740 1 -- 172.21.15.84:0/2804844666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 msgr2=0x55b8867c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:52.998+0000 7ff40c466740 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867c7aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8000c00 tx=0x7ff3e8004640 comp rx=0 tx=0).stop 2024-09-21T07:53:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.008+0000 7ff40c466740 1 -- 172.21.15.84:0/2804844666 shutdown_connections 2024-09-21T07:53:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.008+0000 7ff40c466740 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864261b0 0x55b8867edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.008+0000 7ff40c466740 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864054d0 0x55b8867d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.008+0000 7ff40c466740 1 --2- 172.21.15.84:0/2804844666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867c7aa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.008+0000 7ff40c466740 1 -- 172.21.15.84:0/2804844666 >> 172.21.15.84:0/2804844666 conn(0x55b88641a300 msgr2=0x55b8867d7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.020+0000 7ff40c466740 1 -- 172.21.15.84:0/2804844666 shutdown_connections 2024-09-21T07:53:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.023+0000 7ff40c466740 1 -- 172.21.15.84:0/2804844666 wait complete. 2024-09-21T07:53:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.024+0000 7ff40c466740 1 -- start start 2024-09-21T07:53:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.024+0000 7ff40c466740 1 Processor -- start 2024-09-21T07:53:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.025+0000 7ff40c466740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.025+0000 7ff40c466740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867dcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.025+0000 7ff40c466740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864261b0 0x55b8867dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff3fe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867dc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:43566/0 (socket says 172.21.15.84:43566) 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff3f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867dcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff3f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867dcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35294/0 (socket says 172.21.15.84:35294) 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff3f5e00640 1 -- 172.21.15.84:0/2632536916 learned_addr learned my addr 172.21.15.84:0/2632536916 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4001c1760 con 0x55b8864261b0 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4001c1090 con 0x55b8864054d0 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.026+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff400084050 con 0x55b8863fd2f0 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.027+0000 7ff40c466740 10 client.0 _ll_register_callbacks cb 0x7ff3e80075a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.027+0000 7ff3f5e00640 1 -- 172.21.15.84:0/2632536916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 msgr2=0x55b8867dc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.027+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867dc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.027+0000 7ff3f5e00640 1 -- 172.21.15.84:0/2632536916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864261b0 msgr2=0x55b8867dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.027+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864261b0 0x55b8867dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.027+0000 7ff3f5e00640 1 -- 172.21.15.84:0/2632536916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b886851de0 con 0x55b8864054d0 2024-09-21T07:53:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.028+0000 7ff3e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:53:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.028+0000 7ff3f5e00640 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867dcac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009ca0 tx=0x7ff3f0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d68387ead095f775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.028+0000 7ff3e3e00640 1 -- 172.21.15.84:0/2632536916 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0004450 con 0x55b8864054d0 2024-09-21T07:53:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.028+0000 7ff3e3e00640 1 -- 172.21.15.84:0/2632536916 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff3f00045f0 con 0x55b8864054d0 2024-09-21T07:53:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.028+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e8012e10 con 0x55b8864054d0 2024-09-21T07:53:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.029+0000 7ff3e3e00640 1 -- 172.21.15.84:0/2632536916 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3f00047f0 con 0x55b8864054d0 2024-09-21T07:53:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.029+0000 7ff40c466740 10 client.26513 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.029+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b886853060 con 0x55b8864054d0 2024-09-21T07:53:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.029+0000 7ff3e3e00640 1 -- 172.21.15.84:0/2632536916 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e8012e10 con 0x55b8864054d0 2024-09-21T07:53:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.031+0000 7ff3e3e00640 1 -- 172.21.15.84:0/2632536916 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff3f0056020 con 0x55b8864054d0 2024-09-21T07:53:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.031+0000 7ff40c466740 10 client.26513 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.031+0000 7ff40c466740 10 client.26513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:53:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.031+0000 7ff40c466740 20 client.26513 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.031+0000 7ff40c466740 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863ba1c0 0x55b886855900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.031+0000 7ff40c466740 4 client.26513 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:53:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.031+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b88673e0b0 con 0x55b8863ba1c0 2024-09-21T07:53:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.038+0000 7ff3fe800640 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863ba1c0 0x55b886855900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.040+0000 7ff3fe800640 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863ba1c0 0x55b886855900 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7499f0b7faaf7d09 server_cookie=bbae4a4d7069f09b in_seq=0 out_seq=0 2024-09-21T07:53:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.042+0000 7ff3e3e00640 10 client.26513 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:53.067 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T07:53:53.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T07:53:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.354+0000 7ff3e3e00640 1 -- 172.21.15.84:0/2632536916 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b88673e0b0 con 0x55b8863ba1c0 2024-09-21T07:53:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.354+0000 7ff3e3e00640 10 client.26513 handle_command_reply: tid=0 2024-09-21T07:53:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.355+0000 7ff40c466740 1 client.26513 shutdown 2024-09-21T07:53:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.355+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 msgr2=0x55b8867dcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.355+0000 7ff40c466740 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867dcac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009ca0 tx=0x7ff3f0005fd0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.355+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 shutdown_connections 2024-09-21T07:53:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.355+0000 7ff40c466740 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8864261b0 0x55b8867dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.355+0000 7ff40c466740 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8864054d0 0x55b8867dcac0 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009ca0 tx=0x7ff3f0005fd0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.356+0000 7ff40c466740 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8863ba1c0 0x55b886855900 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.356+0000 7ff40c466740 1 --2- 172.21.15.84:0/2632536916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8863fd2f0 0x55b8867dc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.356+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 >> 172.21.15.84:0/2632536916 conn(0x55b88641a300 msgr2=0x55b8867cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.356+0000 7ff3e3e00640 0 client.26513 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.356+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 shutdown_connections 2024-09-21T07:53:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.357+0000 7ff40c466740 1 -- 172.21.15.84:0/2632536916 wait complete. 2024-09-21T07:53:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.358+0000 7ff40c466740 20 client.26513 trim_cache size 0 max 16384 2024-09-21T07:53:53.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:53:53.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:53:53.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:53:53.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e40b6880 msgr2=0x7ff3e40b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e40b6880 0x7ff3e40b8d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff400108c10 tx=0x7ff3f0000f40 comp rx=0 tx=0).stop 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4001a64e0 msgr2=0x7ff4001a68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4001a64e0 0x7ff4001a68f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800b3e0 tx=0x7ff3f800b8a0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 shutdown_connections 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3e40b6880 0x7ff3e40b8d90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4001a64e0 0x7ff4001a68f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff400110360 0x7ff4001a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 --2- 172.21.15.84:0/297278140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40010a0e0 0x7ff4001a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 >> 172.21.15.84:0/297278140 conn(0x7ff400079630 msgr2=0x7ff400079e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.368+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 shutdown_connections 2024-09-21T07:53:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:53:53.369+0000 7ff405400640 1 -- 172.21.15.84:0/297278140 wait complete. 2024-09-21T07:53:53.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:53 smithi162 ceph-mon[34833]: pgmap v477: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 143 MiB/s wr, 1.24k op/s 2024-09-21T07:53:53.567 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:53 smithi084 ceph-mon[30411]: pgmap v477: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 143 MiB/s wr, 1.24k op/s 2024-09-21T07:53:53.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:53 smithi191 ceph-mon[34667]: pgmap v477: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 143 MiB/s wr, 1.24k op/s 2024-09-21T07:53:54.163 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:53:55.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 -- 172.21.15.84:0/1590850424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc1049d0 msgr2=0x7f21dc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 --2- 172.21.15.84:0/1590850424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc1049d0 0x7f21dc104de0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009900 tx=0x7f21c402a420 comp rx=0 tx=0).stop 2024-09-21T07:53:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 -- 172.21.15.84:0/1590850424 shutdown_connections 2024-09-21T07:53:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 --2- 172.21.15.84:0/1590850424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21dc10de30 0x7f21dc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 --2- 172.21.15.84:0/1590850424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc105320 0x7f21dc10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 --2- 172.21.15.84:0/1590850424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc1049d0 0x7f21dc104de0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 -- 172.21.15.84:0/1590850424 >> 172.21.15.84:0/1590850424 conn(0x7f21dc079760 msgr2=0x7f21dc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.452+0000 7f21e3800640 1 -- 172.21.15.84:0/1590850424 shutdown_connections 2024-09-21T07:53:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.453+0000 7f21e3800640 1 -- 172.21.15.84:0/1590850424 wait complete. 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.454+0000 7f21e3800640 1 Processor -- start 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.455+0000 7f21e3800640 1 -- start start 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.455+0000 7f21e3800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc1049d0 0x7f21dc1059e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.455+0000 7f21e3800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21dc105320 0x7f21dc105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.455+0000 7f21e3800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc10de30 0x7f21dc10b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.455+0000 7f21e3800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc06d6e0 con 0x7f21dc1049d0 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.455+0000 7f21e3800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc06d560 con 0x7f21dc10de30 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.455+0000 7f21e3800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc06d860 con 0x7f21dc105320 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.456+0000 7f21e1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc10de30 0x7f21dc10b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.456+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21dc105320 0x7f21dc105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.458+0000 7f21e1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc10de30 0x7f21dc10b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35324/0 (socket says 172.21.15.84:35324) 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.458+0000 7f21e1800640 1 -- 172.21.15.84:0/998415818 learned_addr learned my addr 172.21.15.84:0/998415818 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.458+0000 7f21e1800640 1 -- 172.21.15.84:0/998415818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21dc105320 msgr2=0x7f21dc105f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.458+0000 7f21e1800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21dc105320 0x7f21dc105f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.458+0000 7f21e1800640 1 -- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc1049d0 msgr2=0x7f21dc1059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.458+0000 7f21e1800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc1049d0 0x7f21dc1059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.458+0000 7f21e1800640 1 -- 172.21.15.84:0/998415818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21dc10b820 con 0x7f21dc10de30 2024-09-21T07:53:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.459+0000 7f21e1800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc10de30 0x7f21dc10b1e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f21d400cce0 tx=0x7f21d400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.461+0000 7f21da000640 1 -- 172.21.15.84:0/998415818 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d400f450 con 0x7f21dc10de30 2024-09-21T07:53:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.462+0000 7f21da000640 1 -- 172.21.15.84:0/998415818 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d400faa0 con 0x7f21dc10de30 2024-09-21T07:53:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.462+0000 7f21da000640 1 -- 172.21.15.84:0/998415818 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4018af0 con 0x7f21dc10de30 2024-09-21T07:53:55.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.463+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21dc10bb10 con 0x7f21dc10de30 2024-09-21T07:53:55.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.464+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21dc10c350 con 0x7f21dc10de30 2024-09-21T07:53:55.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.508+0000 7f21da000640 1 -- 172.21.15.84:0/998415818 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f21d400fc50 con 0x7f21dc10de30 2024-09-21T07:53:55.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.508+0000 7f21ea3f7740 1 Processor -- start 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.509+0000 7f21ea3f7740 1 -- start start 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.510+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc50350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.510+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc50890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.510+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc50dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.510+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5645fdbc5ca0 con 0x5645fd87f980 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.510+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5645fdbb50d0 con 0x5645fd887b60 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.510+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5645fdbb8ee0 con 0x5645fd8a8840 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.511+0000 7f21da000640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21c00b6880 0x7f21c00b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.512+0000 7f21da000640 1 -- 172.21.15.84:0/998415818 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f21d40e8310 con 0x7f21dc10de30 2024-09-21T07:53:55.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.513+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc50350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.513+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc50350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:43598/0 (socket says 172.21.15.84:43598) 2024-09-21T07:53:55.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.513+0000 7f21d3e00640 1 -- 172.21.15.84:0/2757224084 learned_addr learned my addr 172.21.15.84:0/2757224084 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:55.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.514+0000 7f21d3e00640 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc50dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.514+0000 7f21d3e00640 1 -- 172.21.15.84:0/2757224084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 msgr2=0x5645fdc50dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:55.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.516+0000 7f21e0e00640 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc50890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.516+0000 7f21d3e00640 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc50dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.516+0000 7f21d3e00640 1 -- 172.21.15.84:0/2757224084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 msgr2=0x5645fdc50890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:55.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.518+0000 7f21d3e00640 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc50890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.519+0000 7f21d3e00640 1 -- 172.21.15.84:0/2757224084 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645fdb67400 con 0x5645fd8a8840 2024-09-21T07:53:55.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.520+0000 7f21d3e00640 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc50350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009ef0 tx=0x7f21cc009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37b00167299cf3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:55.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.522+0000 7f21e0e00640 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc50890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:55.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.525+0000 7f21e1800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21c00b6880 0x7f21c00b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.528+0000 7f21d2000640 1 -- 172.21.15.84:0/2757224084 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc017610 con 0x5645fd8a8840 2024-09-21T07:53:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.528+0000 7f21d2000640 1 -- 172.21.15.84:0/2757224084 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21cc01c070 con 0x5645fd8a8840 2024-09-21T07:53:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.528+0000 7f21d2000640 1 -- 172.21.15.84:0/2757224084 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc015ae0 con 0x5645fd8a8840 2024-09-21T07:53:55.536 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:55 smithi084 ceph-mon[30411]: pgmap v478: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 177 MiB/s wr, 1.45k op/s 2024-09-21T07:53:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.538+0000 7f21ea3f7740 1 -- 172.21.15.84:0/2757224084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 msgr2=0x5645fdc50350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.538+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc50350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009ef0 tx=0x7f21cc009560 comp rx=0 tx=0).stop 2024-09-21T07:53:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.539+0000 7f21ea3f7740 1 -- 172.21.15.84:0/2757224084 shutdown_connections 2024-09-21T07:53:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.539+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc50dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.539+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc50890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.540+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/2757224084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc50350 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.540+0000 7f21ea3f7740 1 -- 172.21.15.84:0/2757224084 >> 172.21.15.84:0/2757224084 conn(0x5645fd89c990 msgr2=0x5645fdc4e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.541+0000 7f21ea3f7740 1 -- 172.21.15.84:0/2757224084 shutdown_connections 2024-09-21T07:53:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.541+0000 7f21ea3f7740 1 -- 172.21.15.84:0/2757224084 wait complete. 2024-09-21T07:53:55.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.543+0000 7f21ea3f7740 1 -- start start 2024-09-21T07:53:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.544+0000 7f21ea3f7740 1 Processor -- start 2024-09-21T07:53:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.546+0000 7f21e1800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21c00b6880 0x7f21c00b8d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f21d40e5750 tx=0x7f21d4007340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.547+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:55 smithi162 ceph-mon[34833]: pgmap v478: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 177 MiB/s wr, 1.45k op/s 2024-09-21T07:53:55.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.549+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd887b60 0x5645fdc5c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.549+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd8a8840 0x5645fdc67e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.550+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5645fda167a0 con 0x5645fd8a8840 2024-09-21T07:53:55.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.550+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5645fdb5aa10 con 0x5645fd87f980 2024-09-21T07:53:55.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.550+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5645fdc5eb30 con 0x5645fd887b60 2024-09-21T07:53:55.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.550+0000 7f21ea3f7740 10 client.0 _ll_register_callbacks cb 0x5645fdb6abe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:55.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.551+0000 7f21e0e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd887b60 0x5645fdc5c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.551+0000 7f21e0e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd887b60 0x5645fdc5c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:43612/0 (socket says 172.21.15.84:43612) 2024-09-21T07:53:55.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.551+0000 7f21e0e00640 1 -- 172.21.15.84:0/44335932 learned_addr learned my addr 172.21.15.84:0/44335932 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.553+0000 7f21d3e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd8a8840 0x5645fdc67e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.553+0000 7f21e0e00640 1 -- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 msgr2=0x5645fdc5bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.553+0000 7f21d3e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.553+0000 7f21e0e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.553+0000 7f21e0e00640 1 -- 172.21.15.84:0/44335932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd8a8840 msgr2=0x5645fdc67e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.553+0000 7f21e0e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd8a8840 0x5645fdc67e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.553+0000 7f21e0e00640 1 -- 172.21.15.84:0/44335932 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645fd922b90 con 0x5645fd887b60 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.554+0000 7f21d3e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.554+0000 7f21e0e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd887b60 0x5645fdc5c070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f21dc06bc60 tx=0x7f21c40044a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d253808906ecaad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.554+0000 7f21caa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:53:55.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.555+0000 7f21caa00640 1 -- 172.21.15.84:0/44335932 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c403f070 con 0x5645fd887b60 2024-09-21T07:53:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.555+0000 7f21caa00640 1 -- 172.21.15.84:0/44335932 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f21c4005450 con 0x5645fd887b60 2024-09-21T07:53:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.555+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21cc01c070 con 0x5645fd887b60 2024-09-21T07:53:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.556+0000 7f21caa00640 1 -- 172.21.15.84:0/44335932 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f21c4049050 con 0x5645fd887b60 2024-09-21T07:53:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.556+0000 7f21ea3f7740 10 client.26548 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.556+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5645fdc6a8b0 con 0x5645fd887b60 2024-09-21T07:53:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.559+0000 7f21caa00640 1 -- 172.21.15.84:0/44335932 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21cc01c070 con 0x5645fd887b60 2024-09-21T07:53:55.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.560+0000 7f21caa00640 1 -- 172.21.15.84:0/44335932 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f21c4003860 con 0x5645fd887b60 2024-09-21T07:53:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.564+0000 7f21ea3f7740 10 client.26548 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.564+0000 7f21ea3f7740 10 client.26548 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:53:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.564+0000 7f21ea3f7740 20 client.26548 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.564+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd8671c0 0x5645fdc6ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.564+0000 7f21ea3f7740 4 client.26548 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:53:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.564+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645fdbc7bf0 con 0x5645fd8671c0 2024-09-21T07:53:55.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.565+0000 7f21d3e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd8671c0 0x5645fdc6ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.566+0000 7f21d3e00640 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd8671c0 0x5645fdc6ddd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca64c617128267be server_cookie=6938fd2614055329 in_seq=0 out_seq=0 2024-09-21T07:53:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.566+0000 7f21caa00640 10 client.26548 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:55.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.567+0000 7f21caa00640 1 -- 172.21.15.84:0/44335932 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645fdbc7bf0 con 0x5645fd8671c0 2024-09-21T07:53:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.567+0000 7f21caa00640 10 client.26548 handle_command_reply: tid=0 2024-09-21T07:53:55.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.567+0000 7f21ea3f7740 1 client.26548 shutdown 2024-09-21T07:53:55.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd887b60 msgr2=0x5645fdc5c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd887b60 0x5645fdc5c070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f21dc06bc60 tx=0x7f21c40044a0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 shutdown_connections 2024-09-21T07:53:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd8a8840 0x5645fdc67e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd8671c0 0x5645fdc6ddd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd887b60 0x5645fdc5c070 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/44335932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21caa00640 0 client.26548 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:55.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.568+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 >> 172.21.15.84:0/44335932 conn(0x5645fd89c990 msgr2=0x5645fdc534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:55.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.570+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 shutdown_connections 2024-09-21T07:53:55.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.570+0000 7f21ea3f7740 1 -- 172.21.15.84:0/44335932 wait complete. 2024-09-21T07:53:55.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.578+0000 7f21ea3f7740 20 client.26548 trim_cache size 0 max 16384 2024-09-21T07:53:55.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.620+0000 7f21ea3f7740 1 Processor -- start 2024-09-21T07:53:55.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.624+0000 7f21ea3f7740 1 -- start start 2024-09-21T07:53:55.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.624+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.624+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd887b60 0x5645fdc5a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.624+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc67d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.624+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc1bfbe0 con 0x5645fd887b60 2024-09-21T07:53:55.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.624+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc1c1720 con 0x5645fd87f980 2024-09-21T07:53:55.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.624+0000 7f21ea3f7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc1c02b0 con 0x5645fd8a8840 2024-09-21T07:53:55.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.625+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.625+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35346/0 (socket says 172.21.15.84:35346) 2024-09-21T07:53:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.625+0000 7f21d3e00640 1 -- 172.21.15.84:0/3591594337 learned_addr learned my addr 172.21.15.84:0/3591594337 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.625+0000 7f21d3e00640 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc67d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.625+0000 7f21d3e00640 1 -- 172.21.15.84:0/3591594337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 msgr2=0x5645fdc67d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.625+0000 7f21d3e00640 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc67d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.625+0000 7f21d3e00640 1 -- 172.21.15.84:0/3591594337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd887b60 msgr2=0x5645fdc5a3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:53:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.626+0000 7f21d3e00640 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd887b60 0x5645fdc5a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.626+0000 7f21d3e00640 1 -- 172.21.15.84:0/3591594337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645fdc49c50 con 0x5645fd87f980 2024-09-21T07:53:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.626+0000 7f21d3e00640 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5d6c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f21cc015450 tx=0x7f21cc008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36cf387961cd3b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.627+0000 7f21d1600640 1 -- 172.21.15.84:0/3591594337 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0159e0 con 0x5645fd87f980 2024-09-21T07:53:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.627+0000 7f21d1600640 1 -- 172.21.15.84:0/3591594337 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21cc01c050 con 0x5645fd87f980 2024-09-21T07:53:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.627+0000 7f21d1600640 1 -- 172.21.15.84:0/3591594337 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc022c80 con 0x5645fd87f980 2024-09-21T07:53:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.628+0000 7f21ea3f7740 1 -- 172.21.15.84:0/3591594337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 msgr2=0x5645fdc5d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.628+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5d6c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f21cc015450 tx=0x7f21cc008040 comp rx=0 tx=0).stop 2024-09-21T07:53:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.628+0000 7f21ea3f7740 1 -- 172.21.15.84:0/3591594337 shutdown_connections 2024-09-21T07:53:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.628+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc67d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.628+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd887b60 0x5645fdc5a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.628+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/3591594337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd87f980 0x5645fdc5d6c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.628+0000 7f21ea3f7740 1 -- 172.21.15.84:0/3591594337 >> 172.21.15.84:0/3591594337 conn(0x5645fd89c990 msgr2=0x5645fdc51d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:55.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.629+0000 7f21ea3f7740 1 -- 172.21.15.84:0/3591594337 shutdown_connections 2024-09-21T07:53:55.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.629+0000 7f21ea3f7740 1 -- 172.21.15.84:0/3591594337 wait complete. 2024-09-21T07:53:55.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.629+0000 7f21ea3f7740 1 -- start start 2024-09-21T07:53:55.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.630+0000 7f21ea3f7740 1 Processor -- start 2024-09-21T07:53:55.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.632+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc64280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.632+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21ea3f7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc60d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21e0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21e0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35358/0 (socket says 172.21.15.84:35358) 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21e0e00640 1 -- 172.21.15.84:0/339085888 learned_addr learned my addr 172.21.15.84:0/339085888 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc1c1050 con 0x5645fd87f980 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc1c0980 con 0x5645fd887b60 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc1bdba0 con 0x5645fd8a8840 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.633+0000 7f21ea3f7740 10 client.0 _ll_register_callbacks cb 0x7f21c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.634+0000 7f21e0e00640 1 -- 172.21.15.84:0/339085888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 msgr2=0x5645fdc60d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.634+0000 7f21d3e00640 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc60d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.634+0000 7f21e0e00640 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc60d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.634+0000 7f21e0e00640 1 -- 172.21.15.84:0/339085888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 msgr2=0x5645fdc64280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.635+0000 7f21e0e00640 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc64280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.635+0000 7f21e0e00640 1 -- 172.21.15.84:0/339085888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645fdc61260 con 0x5645fd887b60 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.635+0000 7f21d3e00640 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc60d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.635+0000 7f21e0e00640 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc607e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f21c4001eb0 tx=0x7f21c4003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2616e277388105c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.635+0000 7f21caa00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.636+0000 7f21caa00640 1 -- 172.21.15.84:0/339085888 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c403f070 con 0x5645fd887b60 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.636+0000 7f21caa00640 1 -- 172.21.15.84:0/339085888 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f21c4031700 con 0x5645fd887b60 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.636+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21cc01c050 con 0x5645fd887b60 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.638+0000 7f21caa00640 1 -- 172.21.15.84:0/339085888 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f21c405c050 con 0x5645fd887b60 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.638+0000 7f21ea3f7740 10 client.26528 fetch_fsmap learned FSMap version 29 2024-09-21T07:53:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.638+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5645fdcd9430 con 0x5645fd887b60 2024-09-21T07:53:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.638+0000 7f21caa00640 1 -- 172.21.15.84:0/339085888 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21cc01c050 con 0x5645fd887b60 2024-09-21T07:53:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21caa00640 1 -- 172.21.15.84:0/339085888 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f21c40046c0 con 0x5645fd887b60 2024-09-21T07:53:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21ea3f7740 10 client.26528 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:53:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21ea3f7740 10 client.26528 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:53:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21ea3f7740 20 client.26528 populate_metadata read hostname 'smithi084' 2024-09-21T07:53:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd83c570 0x5645fdcdbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:53:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21ea3f7740 4 client.26528 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T07:53:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x5645fdbc36a0 con 0x5645fd83c570 2024-09-21T07:53:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.639+0000 7f21d3e00640 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd83c570 0x5645fdcdbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:53:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.640+0000 7f21d3e00640 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd83c570 0x5645fdcdbce0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e894be71d876e203 server_cookie=f2db08bcc8cd08e1 in_seq=0 out_seq=0 2024-09-21T07:53:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.640+0000 7f21caa00640 10 client.26528 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:55.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:55 smithi191 ceph-mon[34667]: pgmap v478: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 177 MiB/s wr, 1.45k op/s 2024-09-21T07:53:55.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.694+0000 7f21caa00640 1 -- 172.21.15.84:0/339085888 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5645fdbc36a0 con 0x5645fd83c570 2024-09-21T07:53:55.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.694+0000 7f21caa00640 10 client.26528 handle_command_reply: tid=0 2024-09-21T07:53:55.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.694+0000 7f21ea3f7740 1 client.26528 shutdown 2024-09-21T07:53:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 msgr2=0x5645fdc607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc607e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f21c4001eb0 tx=0x7f21c4003820 comp rx=0 tx=0).stop 2024-09-21T07:53:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 shutdown_connections 2024-09-21T07:53:55.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5645fd83c570 0x5645fdcdbce0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5645fd8a8840 0x5645fdc60d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645fd887b60 0x5645fdc607e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 --2- 172.21.15.84:0/339085888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5645fd87f980 0x5645fdc64280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 >> 172.21.15.84:0/339085888 conn(0x5645fd89c990 msgr2=0x5645fdc51d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.695+0000 7f21caa00640 0 client.26528 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:53:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.696+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 shutdown_connections 2024-09-21T07:53:55.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.696+0000 7f21ea3f7740 1 -- 172.21.15.84:0/339085888 wait complete. 2024-09-21T07:53:55.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.696+0000 7f21ea3f7740 20 client.26528 trim_cache size 0 max 16384 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 14, 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "5bd86e96": { 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 14, 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:53:55.704 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:55.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21c00b6880 msgr2=0x7f21c00b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21c00b6880 0x7f21c00b8d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f21d40e5750 tx=0x7f21d4007340 comp rx=0 tx=0).stop 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc10de30 msgr2=0x7f21dc10b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc10de30 0x7f21dc10b1e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f21d400cce0 tx=0x7f21d400a620 comp rx=0 tx=0).stop 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 shutdown_connections 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21c00b6880 0x7f21c00b8d90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21dc10de30 0x7f21dc10b1e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21dc105320 0x7f21dc105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 --2- 172.21.15.84:0/998415818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc1049d0 0x7f21dc1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:53:55.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 >> 172.21.15.84:0/998415818 conn(0x7f21dc079760 msgr2=0x7f21dc0742c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:53:55.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 shutdown_connections 2024-09-21T07:53:55.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:53:55.701+0000 7f21e3800640 1 -- 172.21.15.84:0/998415818 wait complete. 2024-09-21T07:53:56.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:56 smithi084 ceph-mon[30411]: pgmap v479: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 204 MiB/s wr, 1.57k op/s 2024-09-21T07:53:56.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:56 smithi191 ceph-mon[34667]: pgmap v479: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 204 MiB/s wr, 1.57k op/s 2024-09-21T07:53:56.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:56 smithi162 ceph-mon[34833]: pgmap v479: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 204 MiB/s wr, 1.57k op/s 2024-09-21T07:53:59.479 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5bd86e96', quiesce took 17.5 seconds. Will release after: 10.3 2024-09-21T07:53:59.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:53:59 smithi162 ceph-mon[34833]: pgmap v480: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 204 MiB/s wr, 1.47k op/s 2024-09-21T07:53:59.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:53:59 smithi084 ceph-mon[30411]: pgmap v480: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 204 MiB/s wr, 1.47k op/s 2024-09-21T07:53:59.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:53:59 smithi191 ceph-mon[34667]: pgmap v480: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 204 MiB/s wr, 1.47k op/s 2024-09-21T07:54:01.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:01 smithi162 ceph-mon[34833]: pgmap v481: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 227 MiB/s wr, 1.54k op/s 2024-09-21T07:54:01.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:01 smithi084 ceph-mon[30411]: pgmap v481: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 227 MiB/s wr, 1.54k op/s 2024-09-21T07:54:01.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:01 smithi191 ceph-mon[34667]: pgmap v481: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 227 MiB/s wr, 1.54k op/s 2024-09-21T07:54:03.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:03 smithi162 ceph-mon[34833]: pgmap v482: 129 pgs: 129 active+clean; 14 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 250 MiB/s wr, 1.62k op/s 2024-09-21T07:54:03.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:03 smithi084 ceph-mon[30411]: pgmap v482: 129 pgs: 129 active+clean; 14 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 250 MiB/s wr, 1.62k op/s 2024-09-21T07:54:03.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:03 smithi191 ceph-mon[34667]: pgmap v482: 129 pgs: 129 active+clean; 14 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 250 MiB/s wr, 1.62k op/s 2024-09-21T07:54:05.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:05 smithi162 ceph-mon[34833]: pgmap v483: 129 pgs: 129 active+clean; 14 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 239 MiB/s wr, 1.51k op/s 2024-09-21T07:54:05.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:05 smithi084 ceph-mon[30411]: pgmap v483: 129 pgs: 129 active+clean; 14 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 239 MiB/s wr, 1.51k op/s 2024-09-21T07:54:05.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:05 smithi191 ceph-mon[34667]: pgmap v483: 129 pgs: 129 active+clean; 14 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 239 MiB/s wr, 1.51k op/s 2024-09-21T07:54:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 -- 172.21.15.84:0/1378015583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4103920 msgr2=0x7f3cf4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1378015583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4103920 0x7f3cf4103d30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009900 tx=0x7f3ce402a410 comp rx=0 tx=0).stop 2024-09-21T07:54:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 -- 172.21.15.84:0/1378015583 shutdown_connections 2024-09-21T07:54:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1378015583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf4109ba0 0x7f3cf41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1378015583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf4109250 0x7f3cf4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1378015583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4103920 0x7f3cf4103d30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 -- 172.21.15.84:0/1378015583 >> 172.21.15.84:0/1378015583 conn(0x7f3cf40ff320 msgr2=0x7f3cf4101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 -- 172.21.15.84:0/1378015583 shutdown_connections 2024-09-21T07:54:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.609+0000 7f3cf3200640 1 -- 172.21.15.84:0/1378015583 wait complete. 2024-09-21T07:54:06.613 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 Processor -- start 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 -- start start 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf4103920 0x7f3cf419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4109250 0x7f3cf419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf4109ba0 0x7f3cf419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41138b0 con 0x7f3cf4109250 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf4113730 con 0x7f3cf4103920 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.610+0000 7f3cf3200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf4113a30 con 0x7f3cf4109ba0 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4109250 0x7f3cf419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4109250 0x7f3cf419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38432/0 (socket says 172.21.15.84:38432) 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 -- 172.21.15.84:0/1727575313 learned_addr learned my addr 172.21.15.84:0/1727575313 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf4103920 0x7f3cf419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf2800640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf4109ba0 0x7f3cf419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 -- 172.21.15.84:0/1727575313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf4109ba0 msgr2=0x7f3cf419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf4109ba0 0x7f3cf419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 -- 172.21.15.84:0/1727575313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf4103920 msgr2=0x7f3cf419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf4103920 0x7f3cf419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 -- 172.21.15.84:0/1727575313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf41a02a0 con 0x7f3cf4109250 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.611+0000 7f3cf1400640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4109250 0x7f3cf419a910 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000e9f0 tx=0x7f3ce000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.612+0000 7f3ceaa00640 1 -- 172.21.15.84:0/1727575313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000ccc0 con 0x7f3cf4109250 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.612+0000 7f3ceaa00640 1 -- 172.21.15.84:0/1727575313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce00108e0 con 0x7f3cf4109250 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.612+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf41a0590 con 0x7f3cf4109250 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.612+0000 7f3ceaa00640 1 -- 172.21.15.84:0/1727575313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0018860 con 0x7f3cf4109250 2024-09-21T07:54:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.612+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf41a6d20 con 0x7f3cf4109250 2024-09-21T07:54:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 Processor -- start 2024-09-21T07:54:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 -- start start 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d266f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d266f9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d266f9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d2666e6b0 con 0x564d263541b0 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d2665dae0 con 0x564d2632b2f0 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.615+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564d266618f0 con 0x564d263334d0 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d266f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d266f8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38448/0 (socket says 172.21.15.84:38448) 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 -- 172.21.15.84:0/1245083551 learned_addr learned my addr 172.21.15.84:0/1245083551 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d266f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3ceaa00640 1 -- 172.21.15.84:0/1727575313 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3ce0010430 con 0x7f3cf4109250 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 -- 172.21.15.84:0/1245083551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 msgr2=0x564d266f9890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d266f9890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 -- 172.21.15.84:0/1245083551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 msgr2=0x564d266f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d266f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 -- 172.21.15.84:0/1245083551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2662a780 con 0x564d263541b0 2024-09-21T07:54:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d266f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.616+0000 7f3cf2800640 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d266f8e10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009fa0 tx=0x7f3cec010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f048f94e4caf04cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.617+0000 7f3cdf400640 1 -- 172.21.15.84:0/1245083551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec016070 con 0x564d263541b0 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.617+0000 7f3cdf400640 1 -- 172.21.15.84:0/1245083551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cec004d20 con 0x564d263541b0 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.617+0000 7f3cdf400640 1 -- 172.21.15.84:0/1245083551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec012850 con 0x564d263541b0 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.617+0000 7f3ceaa00640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3cd80b6700 0x7f3cd80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1245083551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 msgr2=0x564d266f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d266f8e10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009fa0 tx=0x7f3cec010800 comp rx=0 tx=0).stop 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1245083551 shutdown_connections 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d266f9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d266f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1245083551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d266f8e10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1245083551 >> 172.21.15.84:0/1245083551 conn(0x564d26348300 msgr2=0x564d266f6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3ceaa00640 1 -- 172.21.15.84:0/1727575313 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3ce00e7ca0 con 0x7f3cf4109250 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3cd80b6700 0x7f3cd80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1245083551 shutdown_connections 2024-09-21T07:54:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.618+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1245083551 wait complete. 2024-09-21T07:54:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 -- start start 2024-09-21T07:54:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3cd80b6700 0x7f3cd80b8c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4005ab0 tx=0x7f3ce4005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 Processor -- start 2024-09-21T07:54:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d2632b2f0 0x564d26708860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263334d0 0x564d26708da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d26714ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d26595ab0 con 0x564d263541b0 2024-09-21T07:54:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564d26604570 con 0x564d263334d0 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564d2670b970 con 0x564d2632b2f0 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.619+0000 7f3cfffd1740 10 client.0 _ll_register_callbacks cb 0x564d26613100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d26714ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263334d0 0x564d26708da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d2632b2f0 0x564d26708860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d26714ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38458/0 (socket says 172.21.15.84:38458) 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263334d0 0x564d26708da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47426/0 (socket says 172.21.15.84:47426) 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 -- 172.21.15.84:0/958368525 learned_addr learned my addr 172.21.15.84:0/958368525 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d2632b2f0 0x564d26708860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:44446/0 (socket says 172.21.15.84:44446) 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 -- 172.21.15.84:0/958368525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d2632b2f0 msgr2=0x564d26708860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d2632b2f0 0x564d26708860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 -- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263334d0 msgr2=0x564d26708da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263334d0 0x564d26708da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 -- 172.21.15.84:0/958368525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d263bf790 con 0x564d263541b0 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf1400640 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263334d0 0x564d26708da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cf2800640 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d26714ca0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3cec012490 tx=0x7f3cec004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6e5228abf126db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.620+0000 7f3cd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cd3e00640 1 -- 172.21.15.84:0/958368525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec016070 con 0x564d263541b0 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cec004d20 con 0x564d263541b0 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cd3e00640 1 -- 172.21.15.84:0/958368525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3cec005570 con 0x564d263541b0 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cd3e00640 1 -- 172.21.15.84:0/958368525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3cec02f050 con 0x564d263541b0 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 10 client.16512 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d26438620 con 0x564d263541b0 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cd3e00640 1 -- 172.21.15.84:0/958368525 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cec004d20 con 0x564d263541b0 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cd3e00640 1 -- 172.21.15.84:0/958368525 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3cec00f040 con 0x564d263541b0 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 10 client.16512 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 10 client.16512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 20 client.16512 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d26312d80 0x564d2671a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 4 client.16512 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.621+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d26670600 con 0x564d26312d80 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.622+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d26312d80 0x564d2671a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.622+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d26312d80 0x564d2671a8a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92b0bbce57335734 server_cookie=b0175e84dc222343 in_seq=0 out_seq=0 2024-09-21T07:54:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.622+0000 7f3cd3e00640 10 client.16512 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.623+0000 7f3cd3e00640 1 -- 172.21.15.84:0/958368525 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d26670600 con 0x564d26312d80 2024-09-21T07:54:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.623+0000 7f3cd3e00640 10 client.16512 handle_command_reply: tid=0 2024-09-21T07:54:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 client.16512 shutdown 2024-09-21T07:54:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 msgr2=0x564d26714ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d26714ca0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3cec012490 tx=0x7f3cec004c50 comp rx=0 tx=0).stop 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 shutdown_connections 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d26714ca0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263334d0 0x564d26708da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d26312d80 0x564d2671a8a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/958368525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d2632b2f0 0x564d26708860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cd3e00640 0 client.16512 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 >> 172.21.15.84:0/958368525 conn(0x564d26348300 msgr2=0x564d266fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 shutdown_connections 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 1 -- 172.21.15.84:0/958368525 wait complete. 2024-09-21T07:54:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.624+0000 7f3cfffd1740 20 client.16512 trim_cache size 0 max 16384 2024-09-21T07:54:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.639+0000 7f3cfffd1740 1 Processor -- start 2024-09-21T07:54:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.639+0000 7f3cfffd1740 1 -- start start 2024-09-21T07:54:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.639+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d2632b2f0 0x564d266f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.639+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d26714c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263541b0 0x564d2670a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41aea60 con 0x564d2632b2f0 2024-09-21T07:54:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41b05a0 con 0x564d263541b0 2024-09-21T07:54:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41af130 con 0x564d263334d0 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d2632b2f0 0x564d266f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d26714c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d2632b2f0 0x564d266f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38466/0 (socket says 172.21.15.84:38466) 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1e00640 1 -- 172.21.15.84:0/1246768505 learned_addr learned my addr 172.21.15.84:0/1246768505 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf2800640 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263541b0 0x564d2670a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1400640 1 -- 172.21.15.84:0/1246768505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263541b0 msgr2=0x564d2670a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1400640 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263541b0 0x564d2670a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1400640 1 -- 172.21.15.84:0/1246768505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d2632b2f0 msgr2=0x564d266f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.640+0000 7f3cf1400640 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d2632b2f0 0x564d266f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.641+0000 7f3cf1400640 1 -- 172.21.15.84:0/1246768505 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d266fad50 con 0x564d263334d0 2024-09-21T07:54:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.641+0000 7f3cf2800640 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263541b0 0x564d2670a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.641+0000 7f3cf1400640 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d26714c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00e5080 tx=0x7f3ce00096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38add711578707 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.641+0000 7f3cdea00640 1 -- 172.21.15.84:0/1246768505 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00e5500 con 0x564d263334d0 2024-09-21T07:54:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.641+0000 7f3cdea00640 1 -- 172.21.15.84:0/1246768505 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce00b2260 con 0x564d263334d0 2024-09-21T07:54:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.641+0000 7f3cdea00640 1 -- 172.21.15.84:0/1246768505 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00b3650 con 0x564d263334d0 2024-09-21T07:54:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1246768505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 msgr2=0x564d26714c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d26714c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00e5080 tx=0x7f3ce00096a0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1246768505 shutdown_connections 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d263541b0 0x564d2670a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d26714c10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/1246768505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d2632b2f0 0x564d266f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1246768505 >> 172.21.15.84:0/1246768505 conn(0x564d26348300 msgr2=0x564d26709d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1246768505 shutdown_connections 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 -- 172.21.15.84:0/1246768505 wait complete. 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.642+0000 7f3cfffd1740 1 -- start start 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 1 Processor -- start 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d2671b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d2671b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d2677bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41afed0 con 0x564d263541b0 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41af800 con 0x564d2632b2f0 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41aca20 con 0x564d263334d0 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cfffd1740 10 client.0 _ll_register_callbacks cb 0x7f3ce4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cf2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d2677bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cf2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d2677bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38480/0 (socket says 172.21.15.84:38480) 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cf2800640 1 -- 172.21.15.84:0/263489797 learned_addr learned my addr 172.21.15.84:0/263489797 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d2671b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.643+0000 7f3cf1400640 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d2671b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cf2800640 1 -- 172.21.15.84:0/263489797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 msgr2=0x564d2671b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cf2800640 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d2671b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cf2800640 1 -- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 msgr2=0x564d2671b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cf2800640 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d2671b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cf2800640 1 -- 172.21.15.84:0/263489797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2677c670 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cf2800640 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d2677bfd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3cec024630 tx=0x7f3cec009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5759a4361f28d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cd3e00640 1 -- 172.21.15.84:0/263489797 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec016070 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cd3e00640 1 -- 172.21.15.84:0/263489797 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3cec005570 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.644+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ce00b2260 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cd3e00640 1 -- 172.21.15.84:0/263489797 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3cec009600 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 10 client.16518 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d26784b70 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cd3e00640 1 -- 172.21.15.84:0/263489797 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce00b2260 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cd3e00640 1 -- 172.21.15.84:0/263489797 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3cec012a30 con 0x564d263541b0 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 10 client.16518 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 10 client.16518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 20 client.16518 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d262e81c0 0x564d267872d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 4 client.16518 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:54:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d2666c0b0 con 0x564d262e81c0 2024-09-21T07:54:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.645+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d262e81c0 0x564d267872d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.646+0000 7f3cd3e00640 10 client.16518 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.646+0000 7f3cf1e00640 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d262e81c0 0x564d267872d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c1c1d23a332488 server_cookie=fa7bc02a3b1f1edb in_seq=0 out_seq=0 2024-09-21T07:54:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cd3e00640 1 -- 172.21.15.84:0/263489797 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d2666c0b0 con 0x564d262e81c0 2024-09-21T07:54:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cd3e00640 10 client.16518 handle_command_reply: tid=0 2024-09-21T07:54:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 client.16518 shutdown 2024-09-21T07:54:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 msgr2=0x564d2677bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d2677bfd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3cec024630 tx=0x7f3cec009c60 comp rx=0 tx=0).stop 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 shutdown_connections 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d263541b0 0x564d2677bfd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564d262e81c0 0x564d267872d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564d263334d0 0x564d2671b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 --2- 172.21.15.84:0/263489797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564d2632b2f0 0x564d2671b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cd3e00640 0 client.16518 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 >> 172.21.15.84:0/263489797 conn(0x564d26348300 msgr2=0x564d266f5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 shutdown_connections 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 1 -- 172.21.15.84:0/263489797 wait complete. 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.658+0000 7f3cfffd1740 20 client.16518 trim_cache size 0 max 16384 2024-09-21T07:54:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:54:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:54:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:54:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:54:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3cd80b6700 msgr2=0x7f3cd80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3cd80b6700 0x7f3cd80b8c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4005ab0 tx=0x7f3ce4005a20 comp rx=0 tx=0).stop 2024-09-21T07:54:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4109250 msgr2=0x7f3cf419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4109250 0x7f3cf419a910 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000e9f0 tx=0x7f3ce000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 shutdown_connections 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3cd80b6700 0x7f3cd80b8c10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cf4109ba0 0x7f3cf419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf4109250 0x7f3cf419a910 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 --2- 172.21.15.84:0/1727575313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf4103920 0x7f3cf419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 >> 172.21.15.84:0/1727575313 conn(0x7f3cf40ff320 msgr2=0x7f3cf4108890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 shutdown_connections 2024-09-21T07:54:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:06.659+0000 7f3cf3200640 1 -- 172.21.15.84:0/1727575313 wait complete. 2024-09-21T07:54:07.125 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:54:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:07.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:07 smithi162 ceph-mon[34833]: pgmap v484: 129 pgs: 129 active+clean; 15 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 236 MiB/s wr, 1.48k op/s 2024-09-21T07:54:07.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:07 smithi084 ceph-mon[30411]: pgmap v484: 129 pgs: 129 active+clean; 15 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 236 MiB/s wr, 1.48k op/s 2024-09-21T07:54:07.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:07 smithi191 ceph-mon[34667]: pgmap v484: 129 pgs: 129 active+clean; 15 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 236 MiB/s wr, 1.48k op/s 2024-09-21T07:54:08.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.084+0000 7f2bbca00640 1 -- 172.21.15.84:0/4107827098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb810be40 msgr2=0x7f2bb8112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.084+0000 7f2bbca00640 1 --2- 172.21.15.84:0/4107827098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb810be40 0x7f2bb8112670 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009ca0 tx=0x7f2bb002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.084+0000 7f2bbca00640 1 -- 172.21.15.84:0/4107827098 shutdown_connections 2024-09-21T07:54:08.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.084+0000 7f2bbca00640 1 --2- 172.21.15.84:0/4107827098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb810be40 0x7f2bb8112670 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.084+0000 7f2bbca00640 1 --2- 172.21.15.84:0/4107827098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2bb810b4f0 0x7f2bb810b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.084+0000 7f2bbca00640 1 --2- 172.21.15.84:0/4107827098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb8105bb0 0x7f2bb8105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.084+0000 7f2bbca00640 1 -- 172.21.15.84:0/4107827098 >> 172.21.15.84:0/4107827098 conn(0x7f2bb8101680 msgr2=0x7f2bb8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:08.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.085+0000 7f2bbca00640 1 -- 172.21.15.84:0/4107827098 shutdown_connections 2024-09-21T07:54:08.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.085+0000 7f2bbca00640 1 -- 172.21.15.84:0/4107827098 wait complete. 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 Processor -- start 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 -- start start 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8105bb0 0x7f2bb819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb810b4f0 0x7f2bb819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2bb810be40 0x7f2bb81a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8115b00 con 0x7f2bb8105bb0 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8115980 con 0x7f2bb810b4f0 2024-09-21T07:54:08.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bbca00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8115c80 con 0x7f2bb810be40 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.086+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8105bb0 0x7f2bb819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8105bb0 0x7f2bb819c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46116/0 (socket says 172.21.15.84:46116) 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 -- 172.21.15.84:0/1848845463 learned_addr learned my addr 172.21.15.84:0/1848845463 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb810b4f0 0x7f2bb819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7e00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2bb810be40 0x7f2bb81a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 -- 172.21.15.84:0/1848845463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2bb810be40 msgr2=0x7f2bb81a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2bb810be40 0x7f2bb81a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 -- 172.21.15.84:0/1848845463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb810b4f0 msgr2=0x7f2bb819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb810b4f0 0x7f2bb819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 -- 172.21.15.84:0/1848845463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb81a2420 con 0x7f2bb8105bb0 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7e00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2bb810be40 0x7f2bb81a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb810b4f0 0x7f2bb819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.087+0000 7f2bb7400640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8105bb0 0x7f2bb819c4b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800d950 tx=0x7f2ba800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.088+0000 7f2bafe00640 1 -- 172.21.15.84:0/1848845463 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8017030 con 0x7f2bb8105bb0 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.088+0000 7f2bafe00640 1 -- 172.21.15.84:0/1848845463 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ba8004020 con 0x7f2bb8105bb0 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.088+0000 7f2bafe00640 1 -- 172.21.15.84:0/1848845463 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80047a0 con 0x7f2bb8105bb0 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.088+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb81a2710 con 0x7f2bb8105bb0 2024-09-21T07:54:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.088+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb81a8e70 con 0x7f2bb8105bb0 2024-09-21T07:54:08.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.091+0000 7f2bc4c2c740 1 Processor -- start 2024-09-21T07:54:08.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.091+0000 7f2bc4c2c740 1 -- start start 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bafe00640 1 -- 172.21.15.84:0/1848845463 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2ba8009a30 con 0x7f2bb8105bb0 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c59cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a6588a1b0 0x560a65c5a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c5a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560a65bd0f70 con 0x560a6588a1b0 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560a65bc03a0 con 0x560a658b3070 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560a65bc41b0 con 0x560a65892390 2024-09-21T07:54:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a6588a1b0 0x560a65c5a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bb7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a6588a1b0 0x560a65c5a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46128/0 (socket says 172.21.15.84:46128) 2024-09-21T07:54:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bb7400640 1 -- 172.21.15.84:0/1387545791 learned_addr learned my addr 172.21.15.84:0/1387545791 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c5a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.092+0000 7f2bb7e00640 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c59cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2bb6a00640 1 -- 172.21.15.84:0/1387545791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 msgr2=0x560a65c59cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c59cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2bb6a00640 1 -- 172.21.15.84:0/1387545791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a6588a1b0 msgr2=0x560a65c5a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a6588a1b0 0x560a65c5a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2bb6a00640 1 -- 172.21.15.84:0/1387545791 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a65b8ac90 con 0x560a65892390 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2bb7400640 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a6588a1b0 0x560a65c5a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c5a770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2bb806c630 tx=0x7f2ba40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22cf57fca9f64b7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2ba3e00640 1 -- 172.21.15.84:0/1387545791 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40040f0 con 0x560a65892390 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2ba3e00640 1 -- 172.21.15.84:0/1387545791 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ba40054d0 con 0x560a65892390 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.093+0000 7f2ba3e00640 1 -- 172.21.15.84:0/1387545791 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4004c80 con 0x560a65892390 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bafe00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2b9c0b6700 0x7f2b9c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bafe00640 1 -- 172.21.15.84:0/1848845463 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2ba80e7430 con 0x7f2bb8105bb0 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bb7e00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2b9c0b6700 0x7f2b9c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/1387545791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 msgr2=0x560a65c5a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c5a770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2bb806c630 tx=0x7f2ba40118d0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/1387545791 shutdown_connections 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c5a770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a6588a1b0 0x560a65c5a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/1387545791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c59cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.094+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/1387545791 >> 172.21.15.84:0/1387545791 conn(0x560a658a7460 msgr2=0x560a65c57b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.095+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/1387545791 shutdown_connections 2024-09-21T07:54:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.095+0000 7f2bb7e00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2b9c0b6700 0x7f2b9c0b8c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0006010 tx=0x7f2bb0032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.095+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/1387545791 wait complete. 2024-09-21T07:54:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.095+0000 7f2bc4c2c740 1 -- start start 2024-09-21T07:54:08.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.095+0000 7f2bc4c2c740 1 Processor -- start 2024-09-21T07:54:08.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c65810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c65d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a658b3070 0x560a65c71820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560a65a21700 con 0x560a65892390 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560a65b5b540 con 0x560a6588a1b0 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560a65c684d0 con 0x560a658b3070 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bc4c2c740 10 client.0 _ll_register_callbacks cb 0x560a65b6b430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bb6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c65d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bb7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a658b3070 0x560a65c71820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bb6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c65d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46142/0 (socket says 172.21.15.84:46142) 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bb6a00640 1 -- 172.21.15.84:0/549007253 learned_addr learned my addr 172.21.15.84:0/549007253 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.096+0000 7f2bb7400640 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c65810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2bb6a00640 1 -- 172.21.15.84:0/549007253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a658b3070 msgr2=0x560a65c71820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a658b3070 0x560a65c71820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2bb6a00640 1 -- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 msgr2=0x560a65c65810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c65810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2bb6a00640 1 -- 172.21.15.84:0/549007253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6591e650 con 0x560a65892390 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2bb7400640 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c65810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c65d50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2ba401b040 tx=0x7f2ba40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947ad57e46c3d5ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.097+0000 7f2ba0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2ba0c00640 1 -- 172.21.15.84:0/549007253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4028070 con 0x560a65892390 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2ba0c00640 1 -- 172.21.15.84:0/549007253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2ba4016040 con 0x560a65892390 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a65b5db50 con 0x560a65892390 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2ba0c00640 1 -- 172.21.15.84:0/549007253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ba4034050 con 0x560a65892390 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2bc4c2c740 10 client.16530 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560a65b78910 con 0x560a65892390 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2ba0c00640 1 -- 172.21.15.84:0/549007253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560a65b5db50 con 0x560a65892390 2024-09-21T07:54:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.098+0000 7f2ba0c00640 1 -- 172.21.15.84:0/549007253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ba400ebd0 con 0x560a65892390 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.099+0000 7f2bc4c2c740 10 client.16530 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.099+0000 7f2bc4c2c740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.099+0000 7f2bc4c2c740 20 client.16530 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.099+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a658719f0 0x560a65c77640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.099+0000 7f2bc4c2c740 4 client.16530 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.099+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a65bd2ec0 con 0x560a658719f0 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.099+0000 7f2bb7400640 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a658719f0 0x560a65c77640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.100+0000 7f2bb7400640 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a658719f0 0x560a65c77640 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1131414f2ca8a11f server_cookie=979a67fc55daab8a in_seq=0 out_seq=0 2024-09-21T07:54:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.100+0000 7f2ba0c00640 10 client.16530 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.100+0000 7f2ba0c00640 1 -- 172.21.15.84:0/549007253 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a65bd2ec0 con 0x560a658719f0 2024-09-21T07:54:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.100+0000 7f2ba0c00640 10 client.16530 handle_command_reply: tid=0 2024-09-21T07:54:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.100+0000 7f2bc4c2c740 1 client.16530 shutdown 2024-09-21T07:54:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 msgr2=0x560a65c65d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c65d50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2ba401b040 tx=0x7f2ba40038a0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 shutdown_connections 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a658719f0 0x560a65c77640 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a658b3070 0x560a65c71820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c65d50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/549007253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c65810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 >> 172.21.15.84:0/549007253 conn(0x560a658a7460 msgr2=0x560a65c5ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2ba0c00640 0 client.16530 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 shutdown_connections 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/549007253 wait complete. 2024-09-21T07:54:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.101+0000 7f2bc4c2c740 20 client.16530 trim_cache size 0 max 16384 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 Processor -- start 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 -- start start 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c67240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c71720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a658b3070 0x560a65c71c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb81b2cb0 con 0x560a658b3070 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb81b47f0 con 0x560a6588a1b0 2024-09-21T07:54:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb81b3380 con 0x560a65892390 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.119+0000 7f2bb7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a658b3070 0x560a65c71c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a658b3070 0x560a65c71c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46156/0 (socket says 172.21.15.84:46156) 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb7e00640 1 -- 172.21.15.84:0/3247958448 learned_addr learned my addr 172.21.15.84:0/3247958448 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c71720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb7400640 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c67240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb6a00640 1 -- 172.21.15.84:0/3247958448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 msgr2=0x560a65c67240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c67240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb6a00640 1 -- 172.21.15.84:0/3247958448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a658b3070 msgr2=0x560a65c71c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a658b3070 0x560a65c71c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb6a00640 1 -- 172.21.15.84:0/3247958448 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a65c5c930 con 0x560a65892390 2024-09-21T07:54:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.120+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c71720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009ed0 tx=0x7f2ba4005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35653c883d79d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2ba3400640 1 -- 172.21.15.84:0/3247958448 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4031070 con 0x560a65892390 2024-09-21T07:54:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2ba3400640 1 -- 172.21.15.84:0/3247958448 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ba40054e0 con 0x560a65892390 2024-09-21T07:54:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2ba3400640 1 -- 172.21.15.84:0/3247958448 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4028070 con 0x560a65892390 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/3247958448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 msgr2=0x560a65c71720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c71720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009ed0 tx=0x7f2ba4005f10 comp rx=0 tx=0).stop 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/3247958448 shutdown_connections 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a658b3070 0x560a65c71c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a65892390 0x560a65c71720 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/3247958448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a6588a1b0 0x560a65c67240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.121+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/3247958448 >> 172.21.15.84:0/3247958448 conn(0x560a658a7460 msgr2=0x560a65c66b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.122+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/3247958448 shutdown_connections 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.122+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/3247958448 wait complete. 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.122+0000 7f2bc4c2c740 1 -- start start 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.122+0000 7f2bc4c2c740 1 Processor -- start 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a6588a1b0 0x560a65c6dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c6e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bc4c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c594f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb81b4120 con 0x560a65892390 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb81b3a50 con 0x560a658b3070 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bc4c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb81b0c70 con 0x560a6588a1b0 2024-09-21T07:54:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bc4c2c740 10 client.0 _ll_register_callbacks cb 0x7f2ba4009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c6e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c6e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46172/0 (socket says 172.21.15.84:46172) 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb6a00640 1 -- 172.21.15.84:0/2087729847 learned_addr learned my addr 172.21.15.84:0/2087729847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb7400640 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a6588a1b0 0x560a65c6dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb7e00640 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb7400640 1 -- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 msgr2=0x560a65c594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb7400640 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb7400640 1 -- 172.21.15.84:0/2087729847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 msgr2=0x560a65c6e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb7400640 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c6e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.123+0000 7f2bb7400640 1 -- 172.21.15.84:0/2087729847 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a65c59c80 con 0x560a6588a1b0 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2bb7400640 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a6588a1b0 0x560a65c6dac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80aa1c0 tx=0x7f2ba80d0040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2df2a1a675120 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2ba0c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2ba0c00640 1 -- 172.21.15.84:0/2087729847 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80acd20 con 0x560a6588a1b0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2ba0c00640 1 -- 172.21.15.84:0/2087729847 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2ba80a91c0 con 0x560a6588a1b0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ba40054e0 con 0x560a6588a1b0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2ba0c00640 1 -- 172.21.15.84:0/2087729847 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ba80ac6c0 con 0x560a6588a1b0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2bc4c2c740 10 client.26584 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.124+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560a65c6d1e0 con 0x560a6588a1b0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2ba0c00640 1 -- 172.21.15.84:0/2087729847 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ba40054e0 con 0x560a6588a1b0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2ba0c00640 1 -- 172.21.15.84:0/2087729847 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ba80e4ad0 con 0x560a6588a1b0 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2bc4c2c740 10 client.26584 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2bc4c2c740 10 client.26584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2bc4c2c740 20 client.26584 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a65846da0 0x560a65ce4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2bc4c2c740 4 client.26584 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:54:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560a65bce970 con 0x560a65846da0 2024-09-21T07:54:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.125+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a65846da0 0x560a65ce4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2bb6a00640 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a65846da0 0x560a65ce4160 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12eacf3c1febf066 server_cookie=d585b9aea6af6373 in_seq=0 out_seq=0 2024-09-21T07:54:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2ba0c00640 10 client.26584 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2ba0c00640 1 -- 172.21.15.84:0/2087729847 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x560a65bce970 con 0x560a65846da0 2024-09-21T07:54:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2ba0c00640 10 client.26584 handle_command_reply: tid=0 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2bc4c2c740 1 client.26584 shutdown 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a6588a1b0 msgr2=0x560a65c6dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a6588a1b0 0x560a65c6dac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80aa1c0 tx=0x7f2ba80d0040 comp rx=0 tx=0).stop 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 shutdown_connections 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a658b3070 0x560a65c594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.126+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a65892390 0x560a65c6e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.127+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560a65846da0 0x560a65ce4160 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.127+0000 7f2bc4c2c740 1 --2- 172.21.15.84:0/2087729847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560a6588a1b0 0x560a65c6dac0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.127+0000 7f2ba0c00640 0 client.26584 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.127+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 >> 172.21.15.84:0/2087729847 conn(0x560a658a7460 msgr2=0x560a65c5ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.127+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 shutdown_connections 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.127+0000 7f2bc4c2c740 1 -- 172.21.15.84:0/2087729847 wait complete. 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.127+0000 7f2bc4c2c740 20 client.26584 trim_cache size 0 max 16384 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:54:08.134 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:08.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:08.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:08.137 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2b9c0b6700 msgr2=0x7f2b9c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2b9c0b6700 0x7f2b9c0b8c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0006010 tx=0x7f2bb0032ed0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8105bb0 msgr2=0x7f2bb819c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8105bb0 0x7f2bb819c4b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800d950 tx=0x7f2ba800de10 comp rx=0 tx=0).stop 2024-09-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 shutdown_connections 2024-09-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2b9c0b6700 0x7f2b9c0b8c10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2bb810be40 0x7f2bb81a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb810b4f0 0x7f2bb819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 --2- 172.21.15.84:0/1848845463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8105bb0 0x7f2bb819c4b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 >> 172.21.15.84:0/1848845463 conn(0x7f2bb8101680 msgr2=0x7f2bb810ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 shutdown_connections 2024-09-21T07:54:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:08.128+0000 7f2bbca00640 1 -- 172.21.15.84:0/1848845463 wait complete. 2024-09-21T07:54:08.632 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:08 smithi084 ceph-mon[30411]: pgmap v485: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 211 MiB/s wr, 1.32k op/s 2024-09-21T07:54:08.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:08 smithi191 ceph-mon[34667]: pgmap v485: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 211 MiB/s wr, 1.32k op/s 2024-09-21T07:54:08.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:08 smithi162 ceph-mon[34833]: pgmap v485: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 211 MiB/s wr, 1.32k op/s 2024-09-21T07:54:09.113 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:54:09.113 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:54:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:09.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:54:10.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.317+0000 7fcd73200640 1 -- 172.21.15.84:0/2762088101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c103b90 msgr2=0x7fcd6c103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.317+0000 7fcd73200640 1 --2- 172.21.15.84:0/2762088101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c103b90 0x7fcd6c103fa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009ca0 tx=0x7fcd5c02a8e0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.318+0000 7fcd73200640 1 -- 172.21.15.84:0/2762088101 shutdown_connections 2024-09-21T07:54:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.318+0000 7fcd73200640 1 --2- 172.21.15.84:0/2762088101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd6c109e20 0x7fcd6c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.318+0000 7fcd73200640 1 --2- 172.21.15.84:0/2762088101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c1094d0 0x7fcd6c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.318+0000 7fcd73200640 1 --2- 172.21.15.84:0/2762088101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c103b90 0x7fcd6c103fa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.318+0000 7fcd73200640 1 -- 172.21.15.84:0/2762088101 >> 172.21.15.84:0/2762088101 conn(0x7fcd6c0ff600 msgr2=0x7fcd6c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:10.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.321+0000 7fcd73200640 1 -- 172.21.15.84:0/2762088101 shutdown_connections 2024-09-21T07:54:10.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.321+0000 7fcd73200640 1 -- 172.21.15.84:0/2762088101 wait complete. 2024-09-21T07:54:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.323+0000 7fcd73200640 1 Processor -- start 2024-09-21T07:54:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.324+0000 7fcd73200640 1 -- start start 2024-09-21T07:54:10.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.324+0000 7fcd73200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd6c103b90 0x7fcd6c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:10.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.324+0000 7fcd73200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c1094d0 0x7fcd6c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:10.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.324+0000 7fcd73200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c109e20 0x7fcd6c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:10.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.324+0000 7fcd73200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c113bb0 con 0x7fcd6c1094d0 2024-09-21T07:54:10.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.324+0000 7fcd73200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c113a30 con 0x7fcd6c103b90 2024-09-21T07:54:10.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.324+0000 7fcd73200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c113d30 con 0x7fcd6c109e20 2024-09-21T07:54:10.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c109e20 0x7fcd6c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:10.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c109e20 0x7fcd6c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46506/0 (socket says 172.21.15.84:46506) 2024-09-21T07:54:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 -- 172.21.15.84:0/2291979404 learned_addr learned my addr 172.21.15.84:0/2291979404 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd63400640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c1094d0 0x7fcd6c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd6be00640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd6c103b90 0x7fcd6c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 -- 172.21.15.84:0/2291979404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd6c103b90 msgr2=0x7fcd6c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd6c103b90 0x7fcd6c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 -- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c1094d0 msgr2=0x7fcd6c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c1094d0 0x7fcd6c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.325+0000 7fcd71200640 1 -- 172.21.15.84:0/2291979404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c1a0490 con 0x7fcd6c109e20 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.327+0000 7fcd71200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c109e20 0x7fcd6c19fd60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400b3f0 tx=0x7fcd6400b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.327+0000 7fcd69600640 1 -- 172.21.15.84:0/2291979404 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64015020 con 0x7fcd6c109e20 2024-09-21T07:54:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.327+0000 7fcd69600640 1 -- 172.21.15.84:0/2291979404 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd64011ce0 con 0x7fcd6c109e20 2024-09-21T07:54:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.327+0000 7fcd69600640 1 -- 172.21.15.84:0/2291979404 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64010e20 con 0x7fcd6c109e20 2024-09-21T07:54:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.327+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c1a0780 con 0x7fcd6c109e20 2024-09-21T07:54:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.328+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c0755f0 con 0x7fcd6c109e20 2024-09-21T07:54:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.329+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6c103fa0 con 0x7fcd6c109e20 2024-09-21T07:54:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.332+0000 7fcd69600640 1 -- 172.21.15.84:0/2291979404 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fcd64018020 con 0x7fcd6c109e20 2024-09-21T07:54:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.334+0000 7fcd69600640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd500b67d0 0x7fcd500b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.335+0000 7fcd69600640 1 -- 172.21.15.84:0/2291979404 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fcd640e7770 con 0x7fcd6c109e20 2024-09-21T07:54:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.335+0000 7fcd6be00640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd500b67d0 0x7fcd500b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.335+0000 7fcd69600640 1 -- 172.21.15.84:0/2291979404 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd6401f020 con 0x7fcd6c109e20 2024-09-21T07:54:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.336+0000 7fcd6be00640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd500b67d0 0x7fcd500b8ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c031fd0 tx=0x7fcd5c009780 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:10.561 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.787+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd6c19b650 con 0x7fcd6c109e20 2024-09-21T07:54:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.790+0000 7fcd69600640 1 -- 172.21.15.84:0/2291979404 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fcd640ad9d0 con 0x7fcd6c109e20 2024-09-21T07:54:10.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:54:10.798 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:54:10.798 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:54:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd500b67d0 msgr2=0x7fcd500b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd500b67d0 0x7fcd500b8ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c031fd0 tx=0x7fcd5c009780 comp rx=0 tx=0).stop 2024-09-21T07:54:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c109e20 msgr2=0x7fcd6c19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c109e20 0x7fcd6c19fd60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400b3f0 tx=0x7fcd6400b8b0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 shutdown_connections 2024-09-21T07:54:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcd500b67d0 0x7fcd500b8ce0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd6c109e20 0x7fcd6c19fd60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c1094d0 0x7fcd6c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 --2- 172.21.15.84:0/2291979404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd6c103b90 0x7fcd6c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.803+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 >> 172.21.15.84:0/2291979404 conn(0x7fcd6c0ff600 msgr2=0x7fcd6c108b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.804+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 shutdown_connections 2024-09-21T07:54:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:10.804+0000 7fcd73200640 1 -- 172.21.15.84:0/2291979404 wait complete. 2024-09-21T07:54:11.311 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:11 smithi084 ceph-mon[30411]: pgmap v486: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 189 MiB/s wr, 1.19k op/s 2024-09-21T07:54:11.311 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:11 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2291979404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:54:11.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:11 smithi162 ceph-mon[34833]: pgmap v486: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 189 MiB/s wr, 1.19k op/s 2024-09-21T07:54:11.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:11 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2291979404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:54:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.593+0000 7fc83ea00640 1 -- 172.21.15.84:0/2089493377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83810a3c0 msgr2=0x7fc83810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.594+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2089493377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83810a3c0 0x7fc83810a7d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc828009900 tx=0x7fc82802a410 comp rx=0 tx=0).stop 2024-09-21T07:54:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.594+0000 7fc83ea00640 1 -- 172.21.15.84:0/2089493377 shutdown_connections 2024-09-21T07:54:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.594+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2089493377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc838118900 0x7fc83811ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.594+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2089493377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc83810ad10 0x7fc8381183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.594+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2089493377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83810a3c0 0x7fc83810a7d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.594+0000 7fc83ea00640 1 -- 172.21.15.84:0/2089493377 >> 172.21.15.84:0/2089493377 conn(0x7fc838070ec0 msgr2=0x7fc8380712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.594+0000 7fc83ea00640 1 -- 172.21.15.84:0/2089493377 shutdown_connections 2024-09-21T07:54:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.595+0000 7fc83ea00640 1 -- 172.21.15.84:0/2089493377 wait complete. 2024-09-21T07:54:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.596+0000 7fc83ea00640 1 Processor -- start 2024-09-21T07:54:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.596+0000 7fc83ea00640 1 -- start start 2024-09-21T07:54:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.597+0000 7fc83ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc83810a3c0 0x7fc838111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.597+0000 7fc83ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc83810ad10 0x7fc83810e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.597+0000 7fc83ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc838118900 0x7fc83810e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.597+0000 7fc83ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc83811e530 con 0x7fc83810a3c0 2024-09-21T07:54:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.597+0000 7fc83ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc83811e3b0 con 0x7fc838118900 2024-09-21T07:54:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.597+0000 7fc83ea00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc83811e6b0 con 0x7fc83810ad10 2024-09-21T07:54:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.598+0000 7fc837e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc83810a3c0 0x7fc838111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.598+0000 7fc837e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc83810a3c0 0x7fc838111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46214/0 (socket says 172.21.15.84:46214) 2024-09-21T07:54:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.598+0000 7fc837e00640 1 -- 172.21.15.84:0/2186982748 learned_addr learned my addr 172.21.15.84:0/2186982748 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.598+0000 7fc837400640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc83810ad10 0x7fc83810e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.598+0000 7fc83ca00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc838118900 0x7fc83810e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.598+0000 7fc837400640 1 -- 172.21.15.84:0/2186982748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc838118900 msgr2=0x7fc83810e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.599+0000 7fc837400640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc838118900 0x7fc83810e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.599+0000 7fc837400640 1 -- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc83810a3c0 msgr2=0x7fc838111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.599+0000 7fc837400640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc83810a3c0 0x7fc838111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.599+0000 7fc837400640 1 -- 172.21.15.84:0/2186982748 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381a4c10 con 0x7fc83810ad10 2024-09-21T07:54:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.599+0000 7fc837e00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc83810a3c0 0x7fc838111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.599+0000 7fc83ca00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc838118900 0x7fc83810e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.599+0000 7fc837400640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc83810ad10 0x7fc83810e090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc83806c970 tx=0x7fc82400cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.600+0000 7fc834c00640 1 -- 172.21.15.84:0/2186982748 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824007bb0 con 0x7fc83810ad10 2024-09-21T07:54:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.600+0000 7fc834c00640 1 -- 172.21.15.84:0/2186982748 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc824007d50 con 0x7fc83810ad10 2024-09-21T07:54:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.600+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8381a4f00 con 0x7fc83810ad10 2024-09-21T07:54:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.600+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8381a5440 con 0x7fc83810ad10 2024-09-21T07:54:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.600+0000 7fc834c00640 1 -- 172.21.15.84:0/2186982748 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8240186f0 con 0x7fc83810ad10 2024-09-21T07:54:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.602+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8180052c0 con 0x7fc83810ad10 2024-09-21T07:54:11.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.608+0000 7fc834c00640 1 -- 172.21.15.84:0/2186982748 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc8240189b0 con 0x7fc83810ad10 2024-09-21T07:54:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.610+0000 7fc834c00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc81c0b67d0 0x7fc81c0b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.611+0000 7fc834c00640 1 -- 172.21.15.84:0/2186982748 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc8240e7d20 con 0x7fc83810ad10 2024-09-21T07:54:11.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.611+0000 7fc834c00640 1 -- 172.21.15.84:0/2186982748 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc824014030 con 0x7fc83810ad10 2024-09-21T07:54:11.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.612+0000 7fc837e00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc81c0b67d0 0x7fc81c0b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:11.613+0000 7fc837e00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc81c0b67d0 0x7fc81c0b8ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc8280096c0 tx=0x7fc8280046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:11.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:11 smithi191 ceph-mon[34667]: pgmap v486: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 189 MiB/s wr, 1.19k op/s 2024-09-21T07:54:11.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:11 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2291979404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:54:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.084+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8180055b0 con 0x7fc83810ad10 2024-09-21T07:54:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.085+0000 7fc834c00640 1 -- 172.21.15.84:0/2186982748 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fc8240ae040 con 0x7fc83810ad10 2024-09-21T07:54:12.088 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:54:12.088 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:54:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:54:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc81c0b67d0 msgr2=0x7fc81c0b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc81c0b67d0 0x7fc81c0b8ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc8280096c0 tx=0x7fc8280046c0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc83810ad10 msgr2=0x7fc83810e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc83810ad10 0x7fc83810e090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc83806c970 tx=0x7fc82400cdd0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 shutdown_connections 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc81c0b67d0 0x7fc81c0b8ce0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc838118900 0x7fc83810e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc83810ad10 0x7fc83810e090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 --2- 172.21.15.84:0/2186982748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc83810a3c0 0x7fc838111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.089+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 >> 172.21.15.84:0/2186982748 conn(0x7fc838070ec0 msgr2=0x7fc838118e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.090+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 shutdown_connections 2024-09-21T07:54:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:12.090+0000 7fc83ea00640 1 -- 172.21.15.84:0/2186982748 wait complete. 2024-09-21T07:54:12.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:54:12.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:12 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2186982748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:54:12.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:12 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2186982748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:54:12.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:12 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2186982748' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:54:13.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:13 smithi162 ceph-mon[34833]: pgmap v487: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 167 MiB/s wr, 1.11k op/s 2024-09-21T07:54:13.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:13 smithi084 ceph-mon[30411]: pgmap v487: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 167 MiB/s wr, 1.11k op/s 2024-09-21T07:54:13.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:13 smithi191 ceph-mon[34667]: pgmap v487: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 167 MiB/s wr, 1.11k op/s 2024-09-21T07:54:13.991 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 5bd86e96 --release --await' 2024-09-21T07:54:13.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 5bd86e96 --release --await 2024-09-21T07:54:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 -- 172.21.15.84:0/3138764414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4116640 msgr2=0x7ffbc4118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 --2- 172.21.15.84:0/3138764414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4116640 0x7ffbc4118b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009ca0 tx=0x7ffbc002a8d0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 -- 172.21.15.84:0/3138764414 shutdown_connections 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 --2- 172.21.15.84:0/3138764414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4116640 0x7ffbc4118b50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 --2- 172.21.15.84:0/3138764414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbc410aee0 0x7ffbc4115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 --2- 172.21.15.84:0/3138764414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbc410a590 0x7ffbc410a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 -- 172.21.15.84:0/3138764414 >> 172.21.15.84:0/3138764414 conn(0x7ffbc4070ec0 msgr2=0x7ffbc40712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.287+0000 7ffbcc800640 1 -- 172.21.15.84:0/3138764414 shutdown_connections 2024-09-21T07:54:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.288+0000 7ffbcc800640 1 -- 172.21.15.84:0/3138764414 wait complete. 2024-09-21T07:54:15.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.292+0000 7ffbcc800640 1 Processor -- start 2024-09-21T07:54:15.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.293+0000 7ffbcc800640 1 -- start start 2024-09-21T07:54:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.294+0000 7ffbcc800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc410a590 0x7ffbc41a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.294+0000 7ffbcc800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbc410aee0 0x7ffbc41a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.297+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc410a590 0x7ffbc41a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.297+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc410a590 0x7ffbc41a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35308/0 (socket says 172.21.15.84:35308) 2024-09-21T07:54:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.297+0000 7ffbc9e00640 1 -- 172.21.15.84:0/2293423839 learned_addr learned my addr 172.21.15.84:0/2293423839 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.298+0000 7ffbcc800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbc4116640 0x7ffbc41a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.298+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc411c370 con 0x7ffbc410aee0 2024-09-21T07:54:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.298+0000 7ffbca800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbc4116640 0x7ffbc41a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.298+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc411c1f0 con 0x7ffbc410a590 2024-09-21T07:54:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.298+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc411c4f0 con 0x7ffbc4116640 2024-09-21T07:54:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.299+0000 7ffbca800640 1 -- 172.21.15.84:0/2293423839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc410a590 msgr2=0x7ffbc41a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.299+0000 7ffbca800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc410a590 0x7ffbc41a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.300+0000 7ffbca800640 1 -- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbc410aee0 msgr2=0x7ffbc41a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.300+0000 7ffbca800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbc410aee0 0x7ffbc41a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.300+0000 7ffbca800640 1 -- 172.21.15.84:0/2293423839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc41a8890 con 0x7ffbc4116640 2024-09-21T07:54:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.300+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc410a590 0x7ffbc41a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.301+0000 7ffbca800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbc4116640 0x7ffbc41a82d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009bf0 tx=0x7ffbc0003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.302+0000 7ffbbea00640 1 -- 172.21.15.84:0/2293423839 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0004240 con 0x7ffbc4116640 2024-09-21T07:54:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.302+0000 7ffbbea00640 1 -- 172.21.15.84:0/2293423839 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbc00305d0 con 0x7ffbc4116640 2024-09-21T07:54:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.303+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc41a8ac0 con 0x7ffbc4116640 2024-09-21T07:54:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.304+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc41a90d0 con 0x7ffbc4116640 2024-09-21T07:54:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.304+0000 7ffbbea00640 1 -- 172.21.15.84:0/2293423839 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc003b650 con 0x7ffbc4116640 2024-09-21T07:54:15.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.312+0000 7ffbd3415740 1 Processor -- start 2024-09-21T07:54:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.325+0000 7ffbbea00640 1 -- 172.21.15.84:0/2293423839 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ffbc0030780 con 0x7ffbc4116640 2024-09-21T07:54:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.326+0000 7ffbd3415740 1 -- start start 2024-09-21T07:54:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.326+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 0x5634758dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.326+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.326+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.326+0000 7ffbd3415740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563475856fb0 con 0x563475539070 2024-09-21T07:54:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.326+0000 7ffbd3415740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5634758463e0 con 0x5634755101b0 2024-09-21T07:54:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.326+0000 7ffbd3415740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56347584a1f0 con 0x563475518390 2024-09-21T07:54:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.328+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.328+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.328+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758e02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35310/0 (socket says 172.21.15.84:35310) 2024-09-21T07:54:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.328+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46554/0 (socket says 172.21.15.84:46554) 2024-09-21T07:54:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.329+0000 7ffbc9e00640 1 -- 172.21.15.84:0/871153306 learned_addr learned my addr 172.21.15.84:0/871153306 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.329+0000 7ffbbea00640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffbac0b6660 0x7ffbac0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.329+0000 7ffbbea00640 1 -- 172.21.15.84:0/2293423839 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ffbc0108ca0 con 0x7ffbc4116640 2024-09-21T07:54:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.330+0000 7ffbc9e00640 1 -- 172.21.15.84:0/871153306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 msgr2=0x5634758e0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.330+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/871153306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.330+0000 7ffbc9e00640 1 -- 172.21.15.84:0/871153306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 msgr2=0x5634758dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.330+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/871153306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 0x5634758dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.330+0000 7ffbc9e00640 1 -- 172.21.15.84:0/871153306 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563475810cd0 con 0x5634755101b0 2024-09-21T07:54:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.330+0000 7ffbca800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffbac0b6660 0x7ffbac0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.332+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/871153306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758e02e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8010580 tx=0x7ffbb8010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8738d5f72c1867f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.335+0000 7ffbb3000640 1 -- 172.21.15.84:0/871153306 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800e830 con 0x5634755101b0 2024-09-21T07:54:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.335+0000 7ffbb3000640 1 -- 172.21.15.84:0/871153306 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb800ee80 con 0x5634755101b0 2024-09-21T07:54:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.335+0000 7ffbb3000640 1 -- 172.21.15.84:0/871153306 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb801b430 con 0x5634755101b0 2024-09-21T07:54:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.337+0000 7ffbca800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffbac0b6660 0x7ffbac0b8b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffbc01060e0 tx=0x7ffbc002a8d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.338+0000 7ffbd3415740 1 -- 172.21.15.84:0/871153306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 msgr2=0x5634758e02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.338+0000 7ffbd3415740 1 --2- 172.21.15.84:0/871153306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758e02e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8010580 tx=0x7ffbb8010a40 comp rx=0 tx=0).stop 2024-09-21T07:54:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.338+0000 7ffbd3415740 1 -- 172.21.15.84:0/871153306 shutdown_connections 2024-09-21T07:54:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.338+0000 7ffbd3415740 1 --2- 172.21.15.84:0/871153306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.338+0000 7ffbd3415740 1 --2- 172.21.15.84:0/871153306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758e02e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.338+0000 7ffbd3415740 1 --2- 172.21.15.84:0/871153306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 0x5634758dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.338+0000 7ffbd3415740 1 -- 172.21.15.84:0/871153306 >> 172.21.15.84:0/871153306 conn(0x56347552d460 msgr2=0x5634758ddc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.341+0000 7ffbd3415740 1 -- 172.21.15.84:0/871153306 shutdown_connections 2024-09-21T07:54:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.341+0000 7ffbd3415740 1 -- 172.21.15.84:0/871153306 wait complete. 2024-09-21T07:54:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.343+0000 7ffbd3415740 1 -- start start 2024-09-21T07:54:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.344+0000 7ffbd3415740 1 Processor -- start 2024-09-21T07:54:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.345+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634755101b0 0x5634758ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.346+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563475518390 0x5634758ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:15 smithi084 ceph-mon[30411]: pgmap v488: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 139 MiB/s wr, 951 op/s 2024-09-21T07:54:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.346+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x5634758f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.346+0000 7ffbd3415740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5634756a7700 con 0x5634755101b0 2024-09-21T07:54:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.346+0000 7ffbd3415740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5634757e1580 con 0x563475518390 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.346+0000 7ffbd3415740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5634758e6450 con 0x563475539070 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.346+0000 7ffbd3415740 10 client.0 _ll_register_callbacks cb 0x5634757f1470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.348+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x5634758f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.348+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x5634758f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46558/0 (socket says 172.21.15.84:46558) 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.348+0000 7ffbc9400640 1 -- 172.21.15.84:0/4091697568 learned_addr learned my addr 172.21.15.84:0/4091697568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.349+0000 7ffbc9400640 1 -- 172.21.15.84:0/4091697568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563475518390 msgr2=0x5634758ec2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.349+0000 7ffbc9400640 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563475518390 0x5634758ec2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.349+0000 7ffbc9400640 1 -- 172.21.15.84:0/4091697568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634755101b0 msgr2=0x5634758ebce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.349+0000 7ffbc9400640 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634755101b0 0x5634758ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.349+0000 7ffbc9400640 1 -- 172.21.15.84:0/4091697568 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634755a4650 con 0x563475539070 2024-09-21T07:54:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.351+0000 7ffbc9400640 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x5634758f12e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400da00 tx=0x7ffbb400dec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50788bf3f277a9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.352+0000 7ffba7400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.356+0000 7ffba7400640 1 -- 172.21.15.84:0/4091697568 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb401b060 con 0x563475539070 2024-09-21T07:54:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.356+0000 7ffba7400640 1 -- 172.21.15.84:0/4091697568 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ffbb4009d40 con 0x563475539070 2024-09-21T07:54:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.356+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634757e3b90 con 0x563475539070 2024-09-21T07:54:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.356+0000 7ffba7400640 1 -- 172.21.15.84:0/4091697568 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffbb4007bc0 con 0x563475539070 2024-09-21T07:54:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.356+0000 7ffbd3415740 10 client.26605 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.356+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634757fe950 con 0x563475539070 2024-09-21T07:54:15.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.359+0000 7ffba7400640 1 -- 172.21.15.84:0/4091697568 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5634757e3b90 con 0x563475539070 2024-09-21T07:54:15.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.359+0000 7ffba7400640 1 -- 172.21.15.84:0/4091697568 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffbb40060d0 con 0x563475539070 2024-09-21T07:54:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.359+0000 7ffbd3415740 10 client.26605 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.359+0000 7ffbd3415740 10 client.26605 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:54:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.359+0000 7ffbd3415740 20 client.26605 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.360+0000 7ffbd3415740 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634754f79f0 0x56347590eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.360+0000 7ffbd3415740 4 client.26605 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.360+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563475858f00 con 0x5634754f79f0 2024-09-21T07:54:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.360+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634754f79f0 0x56347590eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.363+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634754f79f0 0x56347590eb00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a718ba7df4b0bfe server_cookie=9f8b7b097e49dc71 in_seq=0 out_seq=0 2024-09-21T07:54:15.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.363+0000 7ffba7400640 10 client.26605 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:54:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.365+0000 7ffba7400640 1 -- 172.21.15.84:0/4091697568 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563475858f00 con 0x5634754f79f0 2024-09-21T07:54:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.365+0000 7ffba7400640 10 client.26605 handle_command_reply: tid=0 2024-09-21T07:54:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.365+0000 7ffbd3415740 1 client.26605 shutdown 2024-09-21T07:54:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.365+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 msgr2=0x5634758f12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.365+0000 7ffbd3415740 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x5634758f12e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400da00 tx=0x7ffbb400dec0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.366+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 shutdown_connections 2024-09-21T07:54:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.366+0000 7ffbd3415740 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634754f79f0 0x56347590eb00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.366+0000 7ffbd3415740 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x5634758f12e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.366+0000 7ffbd3415740 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563475518390 0x5634758ec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.366+0000 7ffbd3415740 1 --2- 172.21.15.84:0/4091697568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634755101b0 0x5634758ebce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.366+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 >> 172.21.15.84:0/4091697568 conn(0x56347552d460 msgr2=0x5634758e2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.366+0000 7ffba7400640 0 client.26605 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:54:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.367+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 shutdown_connections 2024-09-21T07:54:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.367+0000 7ffbd3415740 1 -- 172.21.15.84:0/4091697568 wait complete. 2024-09-21T07:54:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.367+0000 7ffbd3415740 20 client.26605 trim_cache size 0 max 16384 2024-09-21T07:54:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.391+0000 7ffbd3415740 1 Processor -- start 2024-09-21T07:54:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.391+0000 7ffbd3415740 1 -- start start 2024-09-21T07:54:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758d8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 0x5634758e9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbd3415740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41b71b0 con 0x563475539070 2024-09-21T07:54:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbd3415740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41b8cf0 con 0x5634755101b0 2024-09-21T07:54:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbd3415740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41b7880 con 0x563475518390 2024-09-21T07:54:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758d8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758d8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35334/0 (socket says 172.21.15.84:35334) 2024-09-21T07:54:15.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbc9400640 1 -- 172.21.15.84:0/3517455501 learned_addr learned my addr 172.21.15.84:0/3517455501 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:15.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbc9400640 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 0x5634758e9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.392+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46562/0 (socket says 172.21.15.84:46562) 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.393+0000 7ffbc9400640 1 -- 172.21.15.84:0/3517455501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 msgr2=0x5634758e8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.393+0000 7ffbc9400640 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.393+0000 7ffbc9400640 1 -- 172.21.15.84:0/3517455501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 msgr2=0x5634758e9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.393+0000 7ffbc9400640 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 0x5634758e9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.393+0000 7ffbc9400640 1 -- 172.21.15.84:0/3517455501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634758ec050 con 0x5634755101b0 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.393+0000 7ffbc9400640 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758d8c30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40145f0 tx=0x7ffbb400dec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2235800f43ff57b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.393+0000 7ffbb2600640 1 -- 172.21.15.84:0/3517455501 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4007bc0 con 0x5634755101b0 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.394+0000 7ffbb2600640 1 -- 172.21.15.84:0/3517455501 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb4009000 con 0x5634755101b0 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.394+0000 7ffbb2600640 1 -- 172.21.15.84:0/3517455501 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40063f0 con 0x5634755101b0 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.394+0000 7ffbd3415740 1 -- 172.21.15.84:0/3517455501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 msgr2=0x5634758d8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.394+0000 7ffbd3415740 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758d8c30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40145f0 tx=0x7ffbb400dec0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.395+0000 7ffbd3415740 1 -- 172.21.15.84:0/3517455501 shutdown_connections 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.395+0000 7ffbd3415740 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563475539070 0x5634758e9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.395+0000 7ffbd3415740 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.395+0000 7ffbd3415740 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634758d8c30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.395+0000 7ffbd3415740 1 -- 172.21.15.84:0/3517455501 >> 172.21.15.84:0/3517455501 conn(0x56347552d460 msgr2=0x5634758ea360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.395+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/3517455501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475518390 0x5634758e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.396+0000 7ffbd3415740 1 -- 172.21.15.84:0/3517455501 shutdown_connections 2024-09-21T07:54:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.397+0000 7ffbd3415740 1 -- 172.21.15.84:0/3517455501 wait complete. 2024-09-21T07:54:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.397+0000 7ffbd3415740 1 -- start start 2024-09-21T07:54:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.397+0000 7ffbd3415740 1 Processor -- start 2024-09-21T07:54:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.398+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634759121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.398+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x56347590f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.398+0000 7ffbd3415740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634754ccda0 0x56347590fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.398+0000 7ffbd3415740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41b8620 con 0x5634754ccda0 2024-09-21T07:54:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.398+0000 7ffbd3415740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41b7f50 con 0x5634755101b0 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.398+0000 7ffbd3415740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41b5130 con 0x563475539070 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x56347590f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x56347590f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46574/0 (socket says 172.21.15.84:46574) 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9e00640 1 -- 172.21.15.84:0/1778413845 learned_addr learned my addr 172.21.15.84:0/1778413845 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbd3415740 10 client.0 _ll_register_callbacks cb 0x7ffbb400d640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9400640 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634759121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9e00640 1 -- 172.21.15.84:0/1778413845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 msgr2=0x5634759121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634759121d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9e00640 1 -- 172.21.15.84:0/1778413845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634754ccda0 msgr2=0x56347590fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.399+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634754ccda0 0x56347590fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.400+0000 7ffbc9e00640 1 -- 172.21.15.84:0/1778413845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563475910320 con 0x563475539070 2024-09-21T07:54:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.400+0000 7ffbc9400640 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634759121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.400+0000 7ffbc9e00640 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x56347590f6f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8011b50 tx=0x7ffbb8011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1958d2f447a073d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.400+0000 7ffba7400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.400+0000 7ffba7400640 1 -- 172.21.15.84:0/1778413845 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8031060 con 0x563475539070 2024-09-21T07:54:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.400+0000 7ffba7400640 1 -- 172.21.15.84:0/1778413845 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ffbb8011850 con 0x563475539070 2024-09-21T07:54:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.400+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb4009000 con 0x563475539070 2024-09-21T07:54:15.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.401+0000 7ffba7400640 1 -- 172.21.15.84:0/1778413845 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffbb80050c0 con 0x563475539070 2024-09-21T07:54:15.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.401+0000 7ffbd3415740 10 client.26611 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:15.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.401+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634759791d0 con 0x563475539070 2024-09-21T07:54:15.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.401+0000 7ffba7400640 1 -- 172.21.15.84:0/1778413845 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb4009000 con 0x563475539070 2024-09-21T07:54:15.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.402+0000 7ffba7400640 1 -- 172.21.15.84:0/1778413845 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffbb802b030 con 0x563475539070 2024-09-21T07:54:15.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.402+0000 7ffbd3415740 10 client.26611 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.402+0000 7ffbd3415740 10 client.26611 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:54:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.402+0000 7ffbd3415740 20 client.26611 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.403+0000 7ffbd3415740 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634759795d0 0x56347597b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.403+0000 7ffbd3415740 4 client.26611 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:54:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.403+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634758549b0 con 0x5634759795d0 2024-09-21T07:54:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.403+0000 7ffbc9400640 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634759795d0 0x56347597b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:15.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.403+0000 7ffbc9400640 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634759795d0 0x56347597b9f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=96ad844658dab5fb server_cookie=42c097295906f7eb in_seq=0 out_seq=0 2024-09-21T07:54:15.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.403+0000 7ffba7400640 10 client.26611 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:54:15.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.404+0000 7ffba7400640 1 -- 172.21.15.84:0/1778413845 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634758549b0 con 0x5634759795d0 2024-09-21T07:54:15.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.404+0000 7ffba7400640 10 client.26611 handle_command_reply: tid=0 2024-09-21T07:54:15.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.404+0000 7ffbd3415740 1 client.26611 shutdown 2024-09-21T07:54:15.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.404+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 msgr2=0x56347590f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.404+0000 7ffbd3415740 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x56347590f6f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8011b50 tx=0x7ffbb8011ae0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 shutdown_connections 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5634759795d0 0x56347597b9f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634754ccda0 0x56347590fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563475539070 0x56347590f6f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 --2- 172.21.15.84:0/1778413845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634755101b0 0x5634759121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 >> 172.21.15.84:0/1778413845 conn(0x56347552d460 msgr2=0x5634758e8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffba7400640 0 client.26611 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:54:15.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 shutdown_connections 2024-09-21T07:54:15.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 1 -- 172.21.15.84:0/1778413845 wait complete. 2024-09-21T07:54:15.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.405+0000 7ffbd3415740 20 client.26611 trim_cache size 0 max 16384 2024-09-21T07:54:15.408 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffbac0b6660 msgr2=0x7ffbac0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffbac0b6660 0x7ffbac0b8b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffbc01060e0 tx=0x7ffbc002a8d0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbc4116640 msgr2=0x7ffbc41a82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbc4116640 0x7ffbc41a82d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009bf0 tx=0x7ffbc0003ce0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 shutdown_connections 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffbac0b6660 0x7ffbac0b8b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbc4116640 0x7ffbc41a82d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbc410aee0 0x7ffbc41a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 --2- 172.21.15.84:0/2293423839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc410a590 0x7ffbc41a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.406+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 >> 172.21.15.84:0/2293423839 conn(0x7ffbc4070ec0 msgr2=0x7ffbc410df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.407+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 shutdown_connections 2024-09-21T07:54:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:15.407+0000 7ffbcc800640 1 -- 172.21.15.84:0/2293423839 wait complete. 2024-09-21T07:54:15.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:15 smithi162 ceph-mon[34833]: pgmap v488: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 139 MiB/s wr, 951 op/s 2024-09-21T07:54:15.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:15 smithi191 ceph-mon[34667]: pgmap v488: 129 pgs: 129 active+clean; 15 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 139 MiB/s wr, 951 op/s 2024-09-21T07:54:16.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.226+0000 7ff665800640 1 -- 172.21.15.84:0/4041838492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff660105db0 msgr2=0x7ff6601061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.226+0000 7ff665800640 1 --2- 172.21.15.84:0/4041838492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff660105db0 0x7ff6601061c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff650009900 tx=0x7ff65002a440 comp rx=0 tx=0).stop 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.226+0000 7ff665800640 1 -- 172.21.15.84:0/4041838492 shutdown_connections 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.226+0000 7ff665800640 1 --2- 172.21.15.84:0/4041838492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010c040 0x7ff660112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.226+0000 7ff665800640 1 --2- 172.21.15.84:0/4041838492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff66010b6f0 0x7ff66010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.226+0000 7ff665800640 1 --2- 172.21.15.84:0/4041838492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff660105db0 0x7ff6601061c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.226+0000 7ff665800640 1 -- 172.21.15.84:0/4041838492 >> 172.21.15.84:0/4041838492 conn(0x7ff6601017e0 msgr2=0x7ff660103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.227+0000 7ff665800640 1 -- 172.21.15.84:0/4041838492 shutdown_connections 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.227+0000 7ff665800640 1 -- 172.21.15.84:0/4041838492 wait complete. 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.228+0000 7ff665800640 1 Processor -- start 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.228+0000 7ff665800640 1 -- start start 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff665800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff660105db0 0x7ff66007b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff665800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010b6f0 0x7ff660077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff665800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff66010c040 0x7ff660077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff665800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff66006d6e0 con 0x7ff66010b6f0 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff665800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff66006d560 con 0x7ff660105db0 2024-09-21T07:54:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff665800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff66006d860 con 0x7ff66010c040 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff65e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010b6f0 0x7ff660077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff65e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010b6f0 0x7ff660077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46304/0 (socket says 172.21.15.84:46304) 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.229+0000 7ff65e000640 1 -- 172.21.15.84:0/3690901565 learned_addr learned my addr 172.21.15.84:0/3690901565 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.230+0000 7ff65ea00640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff660105db0 0x7ff66007b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.230+0000 7ff65f400640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff66010c040 0x7ff660077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.230+0000 7ff65e000640 1 -- 172.21.15.84:0/3690901565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff66010c040 msgr2=0x7ff660077e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.230+0000 7ff65e000640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff66010c040 0x7ff660077e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.230+0000 7ff65e000640 1 -- 172.21.15.84:0/3690901565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff660105db0 msgr2=0x7ff66007b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.230+0000 7ff65e000640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff660105db0 0x7ff66007b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.230+0000 7ff65e000640 1 -- 172.21.15.84:0/3690901565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff660078420 con 0x7ff66010b6f0 2024-09-21T07:54:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.232+0000 7ff65e000640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010b6f0 0x7ff660077920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00b450 tx=0x7ff64c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.233+0000 7ff657400640 1 -- 172.21.15.84:0/3690901565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c015020 con 0x7ff66010b6f0 2024-09-21T07:54:16.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.233+0000 7ff657400640 1 -- 172.21.15.84:0/3690901565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64c011d40 con 0x7ff66010b6f0 2024-09-21T07:54:16.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.233+0000 7ff657400640 1 -- 172.21.15.84:0/3690901565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c010e40 con 0x7ff66010b6f0 2024-09-21T07:54:16.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.234+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff660078710 con 0x7ff66010b6f0 2024-09-21T07:54:16.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.234+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6601b5cc0 con 0x7ff66010b6f0 2024-09-21T07:54:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.242+0000 7ff66c429740 1 Processor -- start 2024-09-21T07:54:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.243+0000 7ff66c429740 1 -- start start 2024-09-21T07:54:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff66c429740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b1f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff66c429740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd674f660 0x561fd6b1f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff66c429740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6757840 0x561fd6b1fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff66c429740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561fd6a96290 con 0x561fd6778520 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff66c429740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561fd6a856c0 con 0x561fd674f660 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff66c429740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561fd6a894d0 con 0x561fd6757840 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff657400640 1 -- 172.21.15.84:0/3690901565 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff64c018020 con 0x7ff66010b6f0 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff65e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6757840 0x561fd6b1fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff65e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6757840 0x561fd6b1fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46606/0 (socket says 172.21.15.84:46606) 2024-09-21T07:54:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.244+0000 7ff65e000640 1 -- 172.21.15.84:0/440889499 learned_addr learned my addr 172.21.15.84:0/440889499 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.245+0000 7ff65ea00640 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd674f660 0x561fd6b1f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.245+0000 7ff65e000640 1 -- 172.21.15.84:0/440889499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd674f660 msgr2=0x561fd6b1f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.245+0000 7ff65e000640 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd674f660 0x561fd6b1f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.245+0000 7ff65e000640 1 -- 172.21.15.84:0/440889499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 msgr2=0x561fd6b1f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.245+0000 7ff65e000640 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b1f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.245+0000 7ff65e000640 1 -- 172.21.15.84:0/440889499 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd6a12460 con 0x561fd6757840 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.245+0000 7ff65e000640 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6757840 0x561fd6b1fc40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0e46c0 tx=0x7ff64c0ef9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff7ae801be7b948 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.246+0000 7ff64be00640 1 -- 172.21.15.84:0/440889499 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0fb070 con 0x561fd6757840 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.246+0000 7ff64be00640 1 -- 172.21.15.84:0/440889499 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64c0e94e0 con 0x561fd6757840 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.246+0000 7ff64be00640 1 -- 172.21.15.84:0/440889499 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0f39e0 con 0x561fd6757840 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.246+0000 7ff657400640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6440b6730 0x7ff6440b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.247+0000 7ff657400640 1 -- 172.21.15.84:0/3690901565 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff64c0e7360 con 0x7ff66010b6f0 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.247+0000 7ff66c429740 1 -- 172.21.15.84:0/440889499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6757840 msgr2=0x561fd6b1fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.247+0000 7ff66c429740 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6757840 0x561fd6b1fc40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0e46c0 tx=0x7ff64c0ef9f0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.249+0000 7ff65f400640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6440b6730 0x7ff6440b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.249+0000 7ff66c429740 1 -- 172.21.15.84:0/440889499 shutdown_connections 2024-09-21T07:54:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.249+0000 7ff66c429740 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6757840 0x561fd6b1fc40 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0e46c0 tx=0x7ff64c0ef9f0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.249+0000 7ff66c429740 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd674f660 0x561fd6b1f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.249+0000 7ff66c429740 1 --2- 172.21.15.84:0/440889499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b1f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.249+0000 7ff66c429740 1 -- 172.21.15.84:0/440889499 >> 172.21.15.84:0/440889499 conn(0x561fd676c910 msgr2=0x561fd6b1d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.255+0000 7ff65f400640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6440b6730 0x7ff6440b8c40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff658004a80 tx=0x7ff65800a2b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.256+0000 7ff66c429740 1 -- 172.21.15.84:0/440889499 shutdown_connections 2024-09-21T07:54:16.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.256+0000 7ff66c429740 1 -- 172.21.15.84:0/440889499 wait complete. 2024-09-21T07:54:16.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.257+0000 7ff66c429740 1 -- start start 2024-09-21T07:54:16.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.257+0000 7ff66c429740 1 Processor -- start 2024-09-21T07:54:16.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.258+0000 7ff66c429740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd674f660 0x561fd6b2af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.258+0000 7ff66c429740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6778520 0x561fd6b2b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.258+0000 7ff66c429740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b30c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.258+0000 7ff66c429740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561fd68e6bb0 con 0x561fd674f660 2024-09-21T07:54:16.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.258+0000 7ff66c429740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561fd6a206c0 con 0x561fd6736ea0 2024-09-21T07:54:16.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.258+0000 7ff66c429740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561fd6b2d9a0 con 0x561fd6778520 2024-09-21T07:54:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.258+0000 7ff66c429740 10 client.0 _ll_register_callbacks cb 0x561fd6a3b490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.259+0000 7ff65f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b30c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.259+0000 7ff65f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b30c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35372/0 (socket says 172.21.15.84:35372) 2024-09-21T07:54:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.259+0000 7ff65f400640 1 -- 172.21.15.84:0/2981241079 learned_addr learned my addr 172.21.15.84:0/2981241079 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.259+0000 7ff65e000640 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6778520 0x561fd6b2b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.260+0000 7ff65f400640 1 -- 172.21.15.84:0/2981241079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6778520 msgr2=0x561fd6b2b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:16.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.260+0000 7ff65f400640 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6778520 0x561fd6b2b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.260+0000 7ff65f400640 1 -- 172.21.15.84:0/2981241079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd674f660 msgr2=0x561fd6b2af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:16.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.260+0000 7ff65f400640 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd674f660 0x561fd6b2af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.260+0000 7ff65f400640 1 -- 172.21.15.84:0/2981241079 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd67e3b00 con 0x561fd6736ea0 2024-09-21T07:54:16.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.261+0000 7ff648c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:54:16.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.261+0000 7ff65f400640 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b30c60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff65800afd0 tx=0x7ff658004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b726f02d5e2b7eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.262+0000 7ff648c00640 1 -- 172.21.15.84:0/2981241079 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658021070 con 0x561fd6736ea0 2024-09-21T07:54:16.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.262+0000 7ff648c00640 1 -- 172.21.15.84:0/2981241079 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff65800fd50 con 0x561fd6736ea0 2024-09-21T07:54:16.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.262+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff64c0e94e0 con 0x561fd6736ea0 2024-09-21T07:54:16.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.263+0000 7ff648c00640 1 -- 172.21.15.84:0/2981241079 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff65802b050 con 0x561fd6736ea0 2024-09-21T07:54:16.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.263+0000 7ff66c429740 10 client.26588 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:16.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.263+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561fd685a960 con 0x561fd6736ea0 2024-09-21T07:54:16.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.263+0000 7ff648c00640 1 -- 172.21.15.84:0/2981241079 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64c0e94e0 con 0x561fd6736ea0 2024-09-21T07:54:16.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.265+0000 7ff648c00640 1 -- 172.21.15.84:0/2981241079 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff65801d450 con 0x561fd6736ea0 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.266+0000 7ff66c429740 10 client.26588 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.266+0000 7ff66c429740 10 client.26588 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.266+0000 7ff66c429740 20 client.26588 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.266+0000 7ff66c429740 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd670c250 0x561fd6b3d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.266+0000 7ff66c429740 4 client.26588 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.266+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fd6a981e0 con 0x561fd670c250 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.266+0000 7ff65ea00640 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd670c250 0x561fd6b3d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.268+0000 7ff648c00640 10 client.26588 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.268+0000 7ff65ea00640 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd670c250 0x561fd6b3d300 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f46e4ec31bbdfd server_cookie=87c633f02be12a30 in_seq=0 out_seq=0 2024-09-21T07:54:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.269+0000 7ff648c00640 1 -- 172.21.15.84:0/2981241079 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561fd6a981e0 con 0x561fd670c250 2024-09-21T07:54:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.269+0000 7ff648c00640 10 client.26588 handle_command_reply: tid=0 2024-09-21T07:54:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.269+0000 7ff66c429740 1 client.26588 shutdown 2024-09-21T07:54:16.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.270+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 msgr2=0x561fd6b30c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.275+0000 7ff66c429740 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b30c60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff65800afd0 tx=0x7ff658004ab0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.276+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 shutdown_connections 2024-09-21T07:54:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.277+0000 7ff66c429740 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b30c60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.277+0000 7ff66c429740 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd670c250 0x561fd6b3d300 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.277+0000 7ff648c00640 0 client.26588 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:16.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.277+0000 7ff66c429740 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd6778520 0x561fd6b2b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.277+0000 7ff66c429740 1 --2- 172.21.15.84:0/2981241079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd674f660 0x561fd6b2af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.277+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 >> 172.21.15.84:0/2981241079 conn(0x561fd676c910 msgr2=0x561fd6b223a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.278+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 shutdown_connections 2024-09-21T07:54:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.279+0000 7ff66c429740 1 -- 172.21.15.84:0/2981241079 wait complete. 2024-09-21T07:54:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.280+0000 7ff66c429740 20 client.26588 trim_cache size 0 max 16384 2024-09-21T07:54:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.315+0000 7ff66c429740 1 Processor -- start 2024-09-21T07:54:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.316+0000 7ff66c429740 1 -- start start 2024-09-21T07:54:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.316+0000 7ff66c429740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b1bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.316+0000 7ff66c429740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b37a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.316+0000 7ff66c429740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b30bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.316+0000 7ff66c429740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6601bfd90 con 0x561fd6778520 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.316+0000 7ff66c429740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6601c18d0 con 0x561fd6736ea0 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.316+0000 7ff66c429740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6601c0460 con 0x561fd674f660 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b30bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b30bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46336/0 (socket says 172.21.15.84:46336) 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 -- 172.21.15.84:0/1657959481 learned_addr learned my addr 172.21.15.84:0/1657959481 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 -- 172.21.15.84:0/1657959481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 msgr2=0x561fd6b37a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65e000640 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b37a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b37a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 -- 172.21.15.84:0/1657959481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 msgr2=0x561fd6b1bd60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b1bd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.317+0000 7ff65f400640 1 -- 172.21.15.84:0/1657959481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd6b2b820 con 0x561fd6778520 2024-09-21T07:54:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.318+0000 7ff65f400640 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b30bd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff65800f790 tx=0x7ff65801ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdde83603fcdbd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.318+0000 7ff64b400640 1 -- 172.21.15.84:0/1657959481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65802b050 con 0x561fd6778520 2024-09-21T07:54:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.319+0000 7ff64b400640 1 -- 172.21.15.84:0/1657959481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64c0e94e0 con 0x561fd6778520 2024-09-21T07:54:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.319+0000 7ff64b400640 1 -- 172.21.15.84:0/1657959481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65801da90 con 0x561fd6778520 2024-09-21T07:54:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.319+0000 7ff66c429740 1 -- 172.21.15.84:0/1657959481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 msgr2=0x561fd6b30bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.319+0000 7ff66c429740 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b30bd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff65800f790 tx=0x7ff65801ddd0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.320+0000 7ff66c429740 1 -- 172.21.15.84:0/1657959481 shutdown_connections 2024-09-21T07:54:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.320+0000 7ff66c429740 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6778520 0x561fd6b30bd0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.320+0000 7ff66c429740 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b37a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.320+0000 7ff66c429740 1 --2- 172.21.15.84:0/1657959481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6736ea0 0x561fd6b1bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.320+0000 7ff66c429740 1 -- 172.21.15.84:0/1657959481 >> 172.21.15.84:0/1657959481 conn(0x561fd676c910 msgr2=0x561fd6b1b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.321+0000 7ff66c429740 1 -- 172.21.15.84:0/1657959481 shutdown_connections 2024-09-21T07:54:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.321+0000 7ff66c429740 1 -- 172.21.15.84:0/1657959481 wait complete. 2024-09-21T07:54:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.321+0000 7ff66c429740 1 -- start start 2024-09-21T07:54:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.321+0000 7ff66c429740 1 Processor -- start 2024-09-21T07:54:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.322+0000 7ff66c429740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6736ea0 0x561fd6b31000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.322+0000 7ff66c429740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b31540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.322+0000 7ff66c429740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6778520 0x561fd6b31a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.322+0000 7ff66c429740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6601c1200 con 0x561fd6736ea0 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.322+0000 7ff66c429740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6601c0b30 con 0x561fd6778520 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.322+0000 7ff66c429740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6601bdd10 con 0x561fd674f660 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.322+0000 7ff66c429740 10 client.0 _ll_register_callbacks cb 0x7ff658014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.323+0000 7ff65e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b31540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.323+0000 7ff65e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b31540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46640/0 (socket says 172.21.15.84:46640) 2024-09-21T07:54:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.323+0000 7ff65e000640 1 -- 172.21.15.84:0/534381038 learned_addr learned my addr 172.21.15.84:0/534381038 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.323+0000 7ff65ea00640 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6736ea0 0x561fd6b31000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.323+0000 7ff65f400640 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6778520 0x561fd6b31a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.324+0000 7ff65e000640 1 -- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6778520 msgr2=0x561fd6b31a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.324+0000 7ff65e000640 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6778520 0x561fd6b31a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.324+0000 7ff65e000640 1 -- 172.21.15.84:0/534381038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6736ea0 msgr2=0x561fd6b31000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.324+0000 7ff65e000640 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6736ea0 0x561fd6b31000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.324+0000 7ff65e000640 1 -- 172.21.15.84:0/534381038 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd6b367e0 con 0x561fd674f660 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.324+0000 7ff65e000640 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b31540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00be10 tx=0x7ff64c0f34a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab98017de2b6a5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.324+0000 7ff648c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.325+0000 7ff648c00640 1 -- 172.21.15.84:0/534381038 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0a94d0 con 0x561fd674f660 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.325+0000 7ff648c00640 1 -- 172.21.15.84:0/534381038 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7ff64c0ef150 con 0x561fd674f660 2024-09-21T07:54:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.325+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff64c0e94e0 con 0x561fd674f660 2024-09-21T07:54:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.325+0000 7ff648c00640 1 -- 172.21.15.84:0/534381038 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff64c0f3300 con 0x561fd674f660 2024-09-21T07:54:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.325+0000 7ff66c429740 10 client.26626 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.325+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561fd6ba8000 con 0x561fd674f660 2024-09-21T07:54:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.325+0000 7ff648c00640 1 -- 172.21.15.84:0/534381038 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64c0e94e0 con 0x561fd674f660 2024-09-21T07:54:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.327+0000 7ff648c00640 1 -- 172.21.15.84:0/534381038 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff64c0b4ce0 con 0x561fd674f660 2024-09-21T07:54:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.327+0000 7ff66c429740 10 client.26626 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.327+0000 7ff66c429740 10 client.26626 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:54:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.327+0000 7ff66c429740 20 client.26626 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.327+0000 7ff66c429740 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd6ba8290 0x561fd6baa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.327+0000 7ff66c429740 4 client.26626 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5bd86e96", "release": true, "await": true}] 2024-09-21T07:54:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.327+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5bd86e96", "release": true, "await": true}) -- 0x561fd6a93c90 con 0x561fd6ba8290 2024-09-21T07:54:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.328+0000 7ff65ea00640 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd6ba8290 0x561fd6baa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.328+0000 7ff65ea00640 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd6ba8290 0x561fd6baa6b0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ce8096a77e58dc5 server_cookie=db919f0efc80190c in_seq=0 out_seq=0 2024-09-21T07:54:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.329+0000 7ff648c00640 10 client.26626 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.333+0000 7ff648c00640 1 -- 172.21.15.84:0/534381038 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561fd6a93c90 con 0x561fd6ba8290 2024-09-21T07:54:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.333+0000 7ff648c00640 10 client.26626 handle_command_reply: tid=0 2024-09-21T07:54:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.333+0000 7ff66c429740 1 client.26626 shutdown 2024-09-21T07:54:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 msgr2=0x561fd6b31540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b31540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00be10 tx=0x7ff64c0f34a0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 shutdown_connections 2024-09-21T07:54:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561fd6778520 0x561fd6b31a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561fd6ba8290 0x561fd6baa6b0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561fd674f660 0x561fd6b31540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 --2- 172.21.15.84:0/534381038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fd6736ea0 0x561fd6b31000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff648c00640 0 client.26626 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.334+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 >> 172.21.15.84:0/534381038 conn(0x561fd676c910 msgr2=0x561fd6b201d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.335+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 shutdown_connections 2024-09-21T07:54:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.336+0000 7ff66c429740 1 -- 172.21.15.84:0/534381038 wait complete. 2024-09-21T07:54:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.336+0000 7ff66c429740 20 client.26626 trim_cache size 0 max 16384 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 16, 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "5bd86e96": { 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 16, 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:54:16.339 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:16.340 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:16.341 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:54:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.337+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6440b6730 msgr2=0x7ff6440b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.337+0000 7ff665800640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6440b6730 0x7ff6440b8c40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff658004a80 tx=0x7ff65800a2b0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.337+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010b6f0 msgr2=0x7ff660077920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.337+0000 7ff665800640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010b6f0 0x7ff660077920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00b450 tx=0x7ff64c00b910 comp rx=0 tx=0).stop 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.338+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 shutdown_connections 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.338+0000 7ff665800640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6440b6730 0x7ff6440b8c40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.338+0000 7ff665800640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff66010c040 0x7ff660077e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.338+0000 7ff665800640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66010b6f0 0x7ff660077920 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.338+0000 7ff665800640 1 --2- 172.21.15.84:0/3690901565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff660105db0 0x7ff66007b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.338+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 >> 172.21.15.84:0/3690901565 conn(0x7ff6601017e0 msgr2=0x7ff66010ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.339+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 shutdown_connections 2024-09-21T07:54:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:16.340+0000 7ff665800640 1 -- 172.21.15.84:0/3690901565 wait complete. 2024-09-21T07:54:16.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:54:17.275 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:17 smithi084 ceph-mon[30411]: pgmap v489: 129 pgs: 129 active+clean; 16 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 136 MiB/s wr, 927 op/s 2024-09-21T07:54:17.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:17 smithi162 ceph-mon[34833]: pgmap v489: 129 pgs: 129 active+clean; 16 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 136 MiB/s wr, 927 op/s 2024-09-21T07:54:17.575 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5bd86e96', total seconds elapsed: 35.6 2024-09-21T07:54:17.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:17 smithi191 ceph-mon[34667]: pgmap v489: 129 pgs: 129 active+clean; 16 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 136 MiB/s wr, 927 op/s 2024-09-21T07:54:17.819 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:18.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:18 smithi084 ceph-mon[30411]: pgmap v490: 129 pgs: 129 active+clean; 16 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 132 MiB/s wr, 886 op/s 2024-09-21T07:54:18.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:18 smithi191 ceph-mon[34667]: pgmap v490: 129 pgs: 129 active+clean; 16 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 132 MiB/s wr, 886 op/s 2024-09-21T07:54:18.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:18 smithi162 ceph-mon[34833]: pgmap v490: 129 pgs: 129 active+clean; 16 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 132 MiB/s wr, 886 op/s 2024-09-21T07:54:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.023+0000 7f72a5400640 1 -- 172.21.15.84:0/1850749272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72a01029e0 msgr2=0x7f72a0102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.023+0000 7f72a5400640 1 --2- 172.21.15.84:0/1850749272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72a01029e0 0x7f72a0102df0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7298009860 tx=0x7f729802a340 comp rx=0 tx=0).stop 2024-09-21T07:54:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.024+0000 7f72a5400640 1 -- 172.21.15.84:0/1850749272 shutdown_connections 2024-09-21T07:54:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.024+0000 7f72a5400640 1 --2- 172.21.15.84:0/1850749272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72a0108c60 0x7f72a010f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.024+0000 7f72a5400640 1 --2- 172.21.15.84:0/1850749272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a0108310 0x7f72a0108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.024+0000 7f72a5400640 1 --2- 172.21.15.84:0/1850749272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72a01029e0 0x7f72a0102df0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.024+0000 7f72a5400640 1 -- 172.21.15.84:0/1850749272 >> 172.21.15.84:0/1850749272 conn(0x7f72a00fe3c0 msgr2=0x7f72a0100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.025+0000 7f72a5400640 1 -- 172.21.15.84:0/1850749272 shutdown_connections 2024-09-21T07:54:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.025+0000 7f72a5400640 1 -- 172.21.15.84:0/1850749272 wait complete. 2024-09-21T07:54:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.026+0000 7f72a5400640 1 Processor -- start 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.027+0000 7f72a5400640 1 -- start start 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.027+0000 7f72a5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a01029e0 0x7f72a010ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.027+0000 7f72a5400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72a0108310 0x7f72a010cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.027+0000 7f72a5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72a0108c60 0x7f72a010d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.027+0000 7f72a5400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01117f0 con 0x7f72a0108c60 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.027+0000 7f72a5400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0111670 con 0x7f72a01029e0 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.027+0000 7f72a5400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0111970 con 0x7f72a0108310 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a01029e0 0x7f72a010ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a01029e0 0x7f72a010ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59860/0 (socket says 172.21.15.84:59860) 2024-09-21T07:54:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 -- 172.21.15.84:0/844623964 learned_addr learned my addr 172.21.15.84:0/844623964 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 -- 172.21.15.84:0/844623964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72a0108310 msgr2=0x7f72a010cf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72a0108310 0x7f72a010cf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 -- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72a0108c60 msgr2=0x7f72a010d4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72a0108c60 0x7f72a010d4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.028+0000 7f729e800640 1 -- 172.21.15.84:0/844623964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a0116480 con 0x7f72a01029e0 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.029+0000 7f729e800640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a01029e0 0x7f72a010ca40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f729802a8b0 tx=0x7f7298032d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.029+0000 7f7297400640 1 -- 172.21.15.84:0/844623964 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298042070 con 0x7f72a01029e0 2024-09-21T07:54:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.029+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a0116710 con 0x7f72a01029e0 2024-09-21T07:54:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.029+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a0116c50 con 0x7f72a01029e0 2024-09-21T07:54:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.029+0000 7f7297400640 1 -- 172.21.15.84:0/844623964 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72980328f0 con 0x7f72a01029e0 2024-09-21T07:54:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.029+0000 7f7297400640 1 -- 172.21.15.84:0/844623964 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298037040 con 0x7f72a01029e0 2024-09-21T07:54:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.037+0000 7f7297400640 1 -- 172.21.15.84:0/844623964 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7298005070 con 0x7f72a01029e0 2024-09-21T07:54:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.037+0000 7f72ac5f2740 1 Processor -- start 2024-09-21T07:54:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.039+0000 7f72ac5f2740 1 -- start start 2024-09-21T07:54:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.039+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 0x562c59a3bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.040+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a3c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.040+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.040+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562c599b16b0 con 0x562c596971b0 2024-09-21T07:54:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.040+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c599a0ae0 con 0x562c596764d0 2024-09-21T07:54:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.040+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562c599a48f0 con 0x562c5966e2f0 2024-09-21T07:54:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f7297400640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72800b66b0 0x7f72800b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a3c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a3c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49818/0 (socket says 172.21.15.84:49818) 2024-09-21T07:54:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 -- 172.21.15.84:0/3362717578 learned_addr learned my addr 172.21.15.84:0/3362717578 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f7297400640 1 -- 172.21.15.84:0/844623964 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f72981070d0 con 0x7f72a01029e0 2024-09-21T07:54:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 -- 172.21.15.84:0/3362717578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 msgr2=0x562c59a3c6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:54:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 --2- 172.21.15.84:0/3362717578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a3c6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 -- 172.21.15.84:0/3362717578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 msgr2=0x562c59a3bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 --2- 172.21.15.84:0/3362717578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 0x562c59a3bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.041+0000 7f729e800640 1 -- 172.21.15.84:0/3362717578 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5996d780 con 0x562c5966e2f0 2024-09-21T07:54:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.042+0000 7f729e800640 1 --2- 172.21.15.84:0/3362717578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a3c170 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7298104460 tx=0x7f7298030560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16f5ce886bbde629 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.043+0000 7f729f200640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72800b66b0 0x7f72800b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.043+0000 7f728f400640 1 -- 172.21.15.84:0/3362717578 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72980cc540 con 0x562c5966e2f0 2024-09-21T07:54:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.043+0000 7f728f400640 1 -- 172.21.15.84:0/3362717578 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7298104970 con 0x562c5966e2f0 2024-09-21T07:54:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.043+0000 7f728f400640 1 -- 172.21.15.84:0/3362717578 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72980d16d0 con 0x562c5966e2f0 2024-09-21T07:54:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.045+0000 7f72ac5f2740 1 -- 172.21.15.84:0/3362717578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 msgr2=0x562c59a3c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.045+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/3362717578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a3c170 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7298104460 tx=0x7f7298030560 comp rx=0 tx=0).stop 2024-09-21T07:54:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.047+0000 7f72ac5f2740 1 -- 172.21.15.84:0/3362717578 shutdown_connections 2024-09-21T07:54:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.047+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/3362717578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a3c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.047+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/3362717578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a3c170 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.047+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/3362717578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 0x562c59a3bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.047+0000 7f72ac5f2740 1 -- 172.21.15.84:0/3362717578 >> 172.21.15.84:0/3362717578 conn(0x562c5968b300 msgr2=0x562c59a39b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.048+0000 7f72ac5f2740 1 -- 172.21.15.84:0/3362717578 shutdown_connections 2024-09-21T07:54:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.048+0000 7f72ac5f2740 1 -- 172.21.15.84:0/3362717578 wait complete. 2024-09-21T07:54:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.050+0000 7f729f200640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72800b66b0 0x7f72800b8bc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7290009460 tx=0x7f72900093d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.050+0000 7f72ac5f2740 1 -- start start 2024-09-21T07:54:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.051+0000 7f72ac5f2740 1 Processor -- start 2024-09-21T07:54:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.052+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c5966e2f0 0x562c59a47240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.052+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a47780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.052+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c596971b0 0x562c59a47ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.052+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562c598d8ab0 con 0x562c5966e2f0 2024-09-21T07:54:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.052+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c59947570 con 0x562c596764d0 2024-09-21T07:54:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.052+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562c599a48f0 con 0x562c596971b0 2024-09-21T07:54:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.052+0000 7f72ac5f2740 10 client.0 _ll_register_callbacks cb 0x562c59956100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.054+0000 7f729f200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c596971b0 0x562c59a47ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.054+0000 7f729f200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c596971b0 0x562c59a47ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49832/0 (socket says 172.21.15.84:49832) 2024-09-21T07:54:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.054+0000 7f729f200640 1 -- 172.21.15.84:0/1425785764 learned_addr learned my addr 172.21.15.84:0/1425785764 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.054+0000 7f729de00640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a47780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.055+0000 7f729e800640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c5966e2f0 0x562c59a47240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.055+0000 7f729f200640 1 -- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 msgr2=0x562c59a47780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.056+0000 7f729f200640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a47780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.056+0000 7f729f200640 1 -- 172.21.15.84:0/1425785764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c5966e2f0 msgr2=0x562c59a47240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.056+0000 7f729f200640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c5966e2f0 0x562c59a47240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.056+0000 7f729f200640 1 -- 172.21.15.84:0/1425785764 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c59702790 con 0x562c596971b0 2024-09-21T07:54:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.056+0000 7f729de00640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a47780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.056+0000 7f729f200640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c596971b0 0x562c59a47ce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7290010460 tx=0x7f7290005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=262fb5cc73d2dd15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.056+0000 7f7287e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.057+0000 7f7287e00640 1 -- 172.21.15.84:0/1425785764 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729001a8d0 con 0x562c596971b0 2024-09-21T07:54:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.057+0000 7f7287e00640 1 -- 172.21.15.84:0/1425785764 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f729001aa70 con 0x562c596971b0 2024-09-21T07:54:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.057+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7298104970 con 0x562c596971b0 2024-09-21T07:54:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.058+0000 7f7287e00640 1 -- 172.21.15.84:0/1425785764 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f729001ac70 con 0x562c596971b0 2024-09-21T07:54:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.058+0000 7f72ac5f2740 10 client.26635 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.058+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c5977b620 con 0x562c596971b0 2024-09-21T07:54:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.059+0000 7f7287e00640 1 -- 172.21.15.84:0/1425785764 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7298104970 con 0x562c596971b0 2024-09-21T07:54:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.064+0000 7f7287e00640 1 -- 172.21.15.84:0/1425785764 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7290017030 con 0x562c596971b0 2024-09-21T07:54:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.064+0000 7f72ac5f2740 10 client.26635 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.064+0000 7f72ac5f2740 10 client.26635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.064+0000 7f72ac5f2740 20 client.26635 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.064+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c59655d80 0x562c59a6a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.064+0000 7f72ac5f2740 4 client.26635 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.064+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c599b3600 con 0x562c59655d80 2024-09-21T07:54:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.066+0000 7f729e800640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c59655d80 0x562c59a6a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.073+0000 7f7287e00640 10 client.26635 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.073+0000 7f729e800640 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c59655d80 0x562c59a6a220 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32686b75012ca5d3 server_cookie=128591f5344ce478 in_seq=0 out_seq=0 2024-09-21T07:54:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.074+0000 7f7287e00640 1 -- 172.21.15.84:0/1425785764 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c599b3600 con 0x562c59655d80 2024-09-21T07:54:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.075+0000 7f7287e00640 10 client.26635 handle_command_reply: tid=0 2024-09-21T07:54:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.075+0000 7f72ac5f2740 1 client.26635 shutdown 2024-09-21T07:54:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.076+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c596971b0 msgr2=0x562c59a47ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.076+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c596971b0 0x562c59a47ce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7290010460 tx=0x7f7290005f90 comp rx=0 tx=0).stop 2024-09-21T07:54:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.077+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 shutdown_connections 2024-09-21T07:54:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.077+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c59655d80 0x562c59a6a220 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.077+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c596971b0 0x562c59a47ce0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.077+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a47780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.077+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/1425785764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c5966e2f0 0x562c59a47240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.077+0000 7f7287e00640 0 client.26635 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.077+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 >> 172.21.15.84:0/1425785764 conn(0x562c5968b300 msgr2=0x562c59a3cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.078+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 shutdown_connections 2024-09-21T07:54:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.079+0000 7f72ac5f2740 1 -- 172.21.15.84:0/1425785764 wait complete. 2024-09-21T07:54:20.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.079+0000 7f72ac5f2740 20 client.26635 trim_cache size 0 max 16384 2024-09-21T07:54:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.123+0000 7f72ac5f2740 1 Processor -- start 2024-09-21T07:54:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.124+0000 7f72ac5f2740 1 -- start start 2024-09-21T07:54:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.125+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a44d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.125+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596764d0 0x562c59a387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.125+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596971b0 0x562c59a47720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.125+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f727c00fdf0 con 0x562c596764d0 2024-09-21T07:54:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.125+0000 7f729f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596971b0 0x562c59a47720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.126+0000 7f729f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596971b0 0x562c59a47720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59894/0 (socket says 172.21.15.84:59894) 2024-09-21T07:54:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.126+0000 7f729f200640 1 -- 172.21.15.84:0/2211000557 learned_addr learned my addr 172.21.15.84:0/2211000557 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.126+0000 7f72ac5f2740 1 -- 172.21.15.84:0/2211000557 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f727c011930 con 0x562c596971b0 2024-09-21T07:54:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.126+0000 7f72ac5f2740 1 -- 172.21.15.84:0/2211000557 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f727c0104c0 con 0x562c5966e2f0 2024-09-21T07:54:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.126+0000 7f729e800640 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a44d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.126+0000 7f729de00640 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596764d0 0x562c59a387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.127+0000 7f729f200640 1 -- 172.21.15.84:0/2211000557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 msgr2=0x562c59a44d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.127+0000 7f729f200640 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a44d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.127+0000 7f729f200640 1 -- 172.21.15.84:0/2211000557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596764d0 msgr2=0x562c59a387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.127+0000 7f729f200640 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596764d0 0x562c59a387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.127+0000 7f729f200640 1 -- 172.21.15.84:0/2211000557 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c59a6a5d0 con 0x562c596971b0 2024-09-21T07:54:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.127+0000 7f729e800640 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a44d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.128+0000 7f729f200640 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596971b0 0x562c59a47720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7290003c70 tx=0x7f7290005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=547a7ddf19d2dcb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.128+0000 7f728ea00640 1 -- 172.21.15.84:0/2211000557 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729001ae10 con 0x562c596971b0 2024-09-21T07:54:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.129+0000 7f728ea00640 1 -- 172.21.15.84:0/2211000557 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7290036070 con 0x562c596971b0 2024-09-21T07:54:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.129+0000 7f728ea00640 1 -- 172.21.15.84:0/2211000557 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72900249d0 con 0x562c596971b0 2024-09-21T07:54:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.131+0000 7f72ac5f2740 1 -- 172.21.15.84:0/2211000557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596971b0 msgr2=0x562c59a47720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.131+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596971b0 0x562c59a47720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7290003c70 tx=0x7f7290005dc0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.132+0000 7f72ac5f2740 1 -- 172.21.15.84:0/2211000557 shutdown_connections 2024-09-21T07:54:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.132+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596971b0 0x562c59a47720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.132+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596764d0 0x562c59a387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.132+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/2211000557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a44d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.132+0000 7f72ac5f2740 1 -- 172.21.15.84:0/2211000557 >> 172.21.15.84:0/2211000557 conn(0x562c5968b300 msgr2=0x562c59a380e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.135+0000 7f72ac5f2740 1 -- 172.21.15.84:0/2211000557 shutdown_connections 2024-09-21T07:54:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.135+0000 7f72ac5f2740 1 -- 172.21.15.84:0/2211000557 wait complete. 2024-09-21T07:54:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.136+0000 7f72ac5f2740 1 -- start start 2024-09-21T07:54:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.136+0000 7f72ac5f2740 1 Processor -- start 2024-09-21T07:54:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.139+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a41da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.139+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a42380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.139+0000 7f72ac5f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 0x562c59accc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.140+0000 7f729de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a42380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.140+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f727c011260 con 0x562c596971b0 2024-09-21T07:54:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.140+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f727c010b90 con 0x562c596764d0 2024-09-21T07:54:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.140+0000 7f72ac5f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f727c00ddb0 con 0x562c5966e2f0 2024-09-21T07:54:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.140+0000 7f72ac5f2740 10 client.0 _ll_register_callbacks cb 0x7f72900098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.141+0000 7f729f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 0x562c59accc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.141+0000 7f729e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a41da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.142+0000 7f729de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a42380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59900/0 (socket says 172.21.15.84:59900) 2024-09-21T07:54:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.143+0000 7f729e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a41da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49850/0 (socket says 172.21.15.84:49850) 2024-09-21T07:54:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.143+0000 7f729e800640 1 -- 172.21.15.84:0/4200790858 learned_addr learned my addr 172.21.15.84:0/4200790858 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.143+0000 7f729e800640 1 -- 172.21.15.84:0/4200790858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 msgr2=0x562c59a42380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.143+0000 7f729e800640 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a42380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.143+0000 7f729e800640 1 -- 172.21.15.84:0/4200790858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 msgr2=0x562c59accc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.143+0000 7f729e800640 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 0x562c59accc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.144+0000 7f729e800640 1 -- 172.21.15.84:0/4200790858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c59acd2c0 con 0x562c5966e2f0 2024-09-21T07:54:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.144+0000 7f7287e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.144+0000 7f729e800640 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a41da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7298009980 tx=0x7f729802a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=644eb6eb465cd010 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.145+0000 7f7287e00640 1 -- 172.21.15.84:0/4200790858 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72980cc360 con 0x562c5966e2f0 2024-09-21T07:54:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.146+0000 7f7287e00640 1 -- 172.21.15.84:0/4200790858 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7298104770 con 0x562c5966e2f0 2024-09-21T07:54:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.148+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7290036070 con 0x562c5966e2f0 2024-09-21T07:54:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.148+0000 7f7287e00640 1 -- 172.21.15.84:0/4200790858 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7298104970 con 0x562c5966e2f0 2024-09-21T07:54:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.148+0000 7f72ac5f2740 10 client.26641 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.149+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562c59ad46b0 con 0x562c5966e2f0 2024-09-21T07:54:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.150+0000 7f7287e00640 1 -- 172.21.15.84:0/4200790858 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7290036070 con 0x562c5966e2f0 2024-09-21T07:54:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.153+0000 7f7287e00640 1 -- 172.21.15.84:0/4200790858 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f72980c8070 con 0x562c5966e2f0 2024-09-21T07:54:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.153+0000 7f72ac5f2740 10 client.26641 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.153+0000 7f72ac5f2740 10 client.26641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.153+0000 7f72ac5f2740 20 client.26641 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.153+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c5962b1c0 0x562c59ad6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.153+0000 7f72ac5f2740 4 client.26641 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:54:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.153+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c599af0b0 con 0x562c5962b1c0 2024-09-21T07:54:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.157+0000 7f729de00640 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c5962b1c0 0x562c59ad6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.158+0000 7f7287e00640 10 client.26641 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:20.158+0000 7f729de00640 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c5962b1c0 0x562c59ad6c80 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7666f5c0e9ba19e server_cookie=65c6ec88368ba7f4 in_seq=0 out_seq=0 2024-09-21T07:54:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.288+0000 7f7287e00640 1 -- 172.21.15.84:0/4200790858 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c599af0b0 con 0x562c5962b1c0 2024-09-21T07:54:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.288+0000 7f7287e00640 10 client.26641 handle_command_reply: tid=0 2024-09-21T07:54:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.289+0000 7f72ac5f2740 1 client.26641 shutdown 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 msgr2=0x562c59a41da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a41da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7298009980 tx=0x7f729802a340 comp rx=0 tx=0).stop 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 shutdown_connections 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562c596971b0 0x562c59accc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c596764d0 0x562c59a42380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562c5962b1c0 0x562c59ad6c80 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 --2- 172.21.15.84:0/4200790858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562c5966e2f0 0x562c59a41da0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 >> 172.21.15.84:0/4200790858 conn(0x562c5968b300 msgr2=0x562c59a39320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.292+0000 7f7287e00640 0 client.26641 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.293+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 shutdown_connections 2024-09-21T07:54:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.293+0000 7f72ac5f2740 1 -- 172.21.15.84:0/4200790858 wait complete. 2024-09-21T07:54:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.293+0000 7f72ac5f2740 20 client.26641 trim_cache size 0 max 16384 2024-09-21T07:54:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:54:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:54:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:54:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:54:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.297+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72800b66b0 msgr2=0x7f72800b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72800b66b0 0x7f72800b8bc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7290009460 tx=0x7f72900093d0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a01029e0 msgr2=0x7f72a010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a01029e0 0x7f72a010ca40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f729802a8b0 tx=0x7f7298032d20 comp rx=0 tx=0).stop 2024-09-21T07:54:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 shutdown_connections 2024-09-21T07:54:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72800b66b0 0x7f72800b8bc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72a0108c60 0x7f72a010d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72a0108310 0x7f72a010cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 --2- 172.21.15.84:0/844623964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72a01029e0 0x7f72a010ca40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.298+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 >> 172.21.15.84:0/844623964 conn(0x7f72a00fe3c0 msgr2=0x7f72a0106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.299+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 shutdown_connections 2024-09-21T07:54:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:21.299+0000 7f72a5400640 1 -- 172.21.15.84:0/844623964 wait complete. 2024-09-21T07:54:21.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:21 smithi162 ceph-mon[34833]: pgmap v491: 129 pgs: 129 active+clean; 16 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 143 MiB/s wr, 979 op/s 2024-09-21T07:54:21.579 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:21 smithi084 ceph-mon[30411]: pgmap v491: 129 pgs: 129 active+clean; 16 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 143 MiB/s wr, 979 op/s 2024-09-21T07:54:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.601+0000 7f0229a00640 1 -- 172.21.15.84:0/3322132870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0224102f00 msgr2=0x7f0224107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.601+0000 7f0229a00640 1 --2- 172.21.15.84:0/3322132870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0224102f00 0x7f0224107430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0210009860 tx=0x7f021002a340 comp rx=0 tx=0).stop 2024-09-21T07:54:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.603+0000 7f0229a00640 1 -- 172.21.15.84:0/3322132870 shutdown_connections 2024-09-21T07:54:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.603+0000 7f0229a00640 1 --2- 172.21.15.84:0/3322132870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02241079f0 0x7f0224107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.603+0000 7f0229a00640 1 --2- 172.21.15.84:0/3322132870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0224102f00 0x7f0224107430 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.603+0000 7f0229a00640 1 --2- 172.21.15.84:0/3322132870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241025b0 0x7f02241029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.603+0000 7f0229a00640 1 -- 172.21.15.84:0/3322132870 >> 172.21.15.84:0/3322132870 conn(0x7f02240fe2c0 msgr2=0x7f0224100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.604+0000 7f0229a00640 1 -- 172.21.15.84:0/3322132870 shutdown_connections 2024-09-21T07:54:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.604+0000 7f0229a00640 1 -- 172.21.15.84:0/3322132870 wait complete. 2024-09-21T07:54:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.606+0000 7f0229a00640 1 Processor -- start 2024-09-21T07:54:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.606+0000 7f0229a00640 1 -- start start 2024-09-21T07:54:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.607+0000 7f0229a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02241025b0 0x7f02241a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.608+0000 7f0229a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0224102f00 0x7f02241a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.608+0000 7f0223e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02241025b0 0x7f02241a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.608+0000 7f0223e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02241025b0 0x7f02241a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49870/0 (socket says 172.21.15.84:49870) 2024-09-21T07:54:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.608+0000 7f0229a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241079f0 0x7f02241a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.608+0000 7f0229a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0224119ee0 con 0x7f0224102f00 2024-09-21T07:54:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.608+0000 7f0229a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0224119d60 con 0x7f02241079f0 2024-09-21T07:54:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.608+0000 7f0229a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f022411a060 con 0x7f02241025b0 2024-09-21T07:54:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241079f0 0x7f02241a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241079f0 0x7f02241a6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59918/0 (socket says 172.21.15.84:59918) 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 -- 172.21.15.84:0/4010982766 learned_addr learned my addr 172.21.15.84:0/4010982766 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0223400640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0224102f00 0x7f02241a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 -- 172.21.15.84:0/4010982766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02241025b0 msgr2=0x7f02241a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02241025b0 0x7f02241a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 -- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0224102f00 msgr2=0x7f02241a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0224102f00 0x7f02241a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.609+0000 7f0229000640 1 -- 172.21.15.84:0/4010982766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02241a68a0 con 0x7f02241079f0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.610+0000 7f0223e00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02241025b0 0x7f02241a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.610+0000 7f0229000640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241079f0 0x7f02241a6170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f021c00eb10 tx=0x7f021c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.611+0000 7f0220c00640 1 -- 172.21.15.84:0/4010982766 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c004b20 con 0x7f02241079f0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.611+0000 7f0220c00640 1 -- 172.21.15.84:0/4010982766 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f021c004cc0 con 0x7f02241079f0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.611+0000 7f0220c00640 1 -- 172.21.15.84:0/4010982766 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c010670 con 0x7f02241079f0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.613+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02241a6b90 con 0x7f02241079f0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.613+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02241ad2f0 con 0x7f02241079f0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.619+0000 7f0220c00640 1 -- 172.21.15.84:0/4010982766 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f021c005000 con 0x7f02241079f0 2024-09-21T07:54:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.619+0000 7f0231bd7740 1 Processor -- start 2024-09-21T07:54:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.621+0000 7f0220c00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02080b6880 0x7f02080b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.621+0000 7f0231bd7740 1 -- start start 2024-09-21T07:54:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.621+0000 7f0220c00640 1 -- 172.21.15.84:0/4010982766 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f021c0e8170 con 0x7f02241079f0 2024-09-21T07:54:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.622+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a70e070 0x55599aab4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.622+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aab54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.622+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aab59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.622+0000 7f0223400640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02080b6880 0x7f02080b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.622+0000 7f0229000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aab59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.622+0000 7f0229000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aab59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59924/0 (socket says 172.21.15.84:59924) 2024-09-21T07:54:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.622+0000 7f0223400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aab54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.623+0000 7f0223400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aab54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49872/0 (socket says 172.21.15.84:49872) 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.623+0000 7f0223400640 1 -- 172.21.15.84:0/3396524476 learned_addr learned my addr 172.21.15.84:0/3396524476 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.623+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55599aa2bfb0 con 0x55599a70e070 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.623+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55599aa1b3e0 con 0x55599a6ed390 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.623+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55599aa1f1f0 con 0x55599a6e51b0 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.623+0000 7f0223e00640 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a70e070 0x55599aab4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.624+0000 7f0229000640 1 -- 172.21.15.84:0/3396524476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 msgr2=0x55599aab54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.624+0000 7f0229000640 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aab54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.624+0000 7f0229000640 1 -- 172.21.15.84:0/3396524476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a70e070 msgr2=0x55599aab4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.624+0000 7f0229000640 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a70e070 0x55599aab4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.624+0000 7f0229000640 1 -- 172.21.15.84:0/3396524476 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55599a9e5cd0 con 0x55599a6ed390 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.624+0000 7f0223e00640 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a70e070 0x55599aab4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.625+0000 7f0229000640 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aab59f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f021c0e5550 tx=0x7f021c0a9bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f879e33a329d008 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.625+0000 7f0223400640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02080b6880 0x7f02080b8d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f021002a930 tx=0x7f0210030f80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.625+0000 7f0219600640 1 -- 172.21.15.84:0/3396524476 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c0e59d0 con 0x55599a6ed390 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.625+0000 7f0219600640 1 -- 172.21.15.84:0/3396524476 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f021c0ad760 con 0x55599a6ed390 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.625+0000 7f0219600640 1 -- 172.21.15.84:0/3396524476 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c0b21d0 con 0x55599a6ed390 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.626+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 msgr2=0x55599aab59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.626+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aab59f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f021c0e5550 tx=0x7f021c0a9bb0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.627+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 shutdown_connections 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.627+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aab59f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.627+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aab54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.627+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3396524476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a70e070 0x55599aab4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.627+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 >> 172.21.15.84:0/3396524476 conn(0x55599a702460 msgr2=0x55599aab2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.627+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 shutdown_connections 2024-09-21T07:54:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.628+0000 7f0231bd7740 1 -- 172.21.15.84:0/3396524476 wait complete. 2024-09-21T07:54:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.629+0000 7f0231bd7740 1 -- start start 2024-09-21T07:54:21.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.630+0000 7f0231bd7740 1 Processor -- start 2024-09-21T07:54:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.632+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.632+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599aac0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.632+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a70e070 0x55599aacca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.632+0000 7f0231bd7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55599a87c700 con 0x55599a6ed390 2024-09-21T07:54:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.632+0000 7f0231bd7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55599a9b6580 con 0x55599a70e070 2024-09-21T07:54:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.632+0000 7f0231bd7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55599aac3750 con 0x55599a6e51b0 2024-09-21T07:54:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.632+0000 7f0223e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.633+0000 7f0223e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49888/0 (socket says 172.21.15.84:49888) 2024-09-21T07:54:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.633+0000 7f0223e00640 1 -- 172.21.15.84:0/3644744839 learned_addr learned my addr 172.21.15.84:0/3644744839 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.633+0000 7f0231bd7740 10 client.0 _ll_register_callbacks cb 0x55599a9c6470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.634+0000 7f0229000640 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a70e070 0x55599aacca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.634+0000 7f0223400640 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599aac0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.635+0000 7f0223e00640 1 -- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a70e070 msgr2=0x55599aacca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.635+0000 7f0223e00640 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a70e070 0x55599aacca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.635+0000 7f0223e00640 1 -- 172.21.15.84:0/3644744839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 msgr2=0x55599aac0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.635+0000 7f0223e00640 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599aac0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.635+0000 7f0223e00640 1 -- 172.21.15.84:0/3644744839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55599a779650 con 0x55599a6e51b0 2024-09-21T07:54:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.636+0000 7f0223e00640 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac06b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0214011690 tx=0x7f0214011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73a5d9d0cc68a849 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.636+0000 7f020e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.636+0000 7f020e000640 1 -- 172.21.15.84:0/3644744839 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021401f060 con 0x55599a6e51b0 2024-09-21T07:54:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.637+0000 7f020e000640 1 -- 172.21.15.84:0/3644744839 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f021400f8e0 con 0x55599a6e51b0 2024-09-21T07:54:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.637+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55599a9b8b90 con 0x55599a6e51b0 2024-09-21T07:54:21.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.638+0000 7f020e000640 1 -- 172.21.15.84:0/3644744839 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0214026050 con 0x55599a6e51b0 2024-09-21T07:54:21.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.638+0000 7f0231bd7740 10 client.26650 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.638+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55599a9d3950 con 0x55599a6e51b0 2024-09-21T07:54:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.640+0000 7f020e000640 1 -- 172.21.15.84:0/3644744839 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55599a9b8b90 con 0x55599a6e51b0 2024-09-21T07:54:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.640+0000 7f020e000640 1 -- 172.21.15.84:0/3644744839 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0214012cc0 con 0x55599a6e51b0 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.643+0000 7f0231bd7740 10 client.26650 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.643+0000 7f0231bd7740 10 client.26650 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.643+0000 7f0231bd7740 20 client.26650 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.643+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a6cc9f0 0x55599aad2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.643+0000 7f0231bd7740 4 client.26650 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.643+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55599aa2df00 con 0x55599a6cc9f0 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.647+0000 7f0223400640 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a6cc9f0 0x55599aad2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.651+0000 7f0223400640 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a6cc9f0 0x55599aad2800 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=73244163d5f2d142 server_cookie=e7043fd673e8f69b in_seq=0 out_seq=0 2024-09-21T07:54:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.651+0000 7f020e000640 10 client.26650 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:54:21.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:21 smithi191 ceph-mon[34667]: pgmap v491: 129 pgs: 129 active+clean; 16 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 143 MiB/s wr, 979 op/s 2024-09-21T07:54:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.652+0000 7f020e000640 1 -- 172.21.15.84:0/3644744839 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55599aa2df00 con 0x55599a6cc9f0 2024-09-21T07:54:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.653+0000 7f020e000640 10 client.26650 handle_command_reply: tid=0 2024-09-21T07:54:21.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.655+0000 7f0231bd7740 1 client.26650 shutdown 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.661+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 msgr2=0x55599aac06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.661+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac06b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0214011690 tx=0x7f0214011b50 comp rx=0 tx=0).stop 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.662+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 shutdown_connections 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.662+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a6cc9f0 0x55599aad2800 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.662+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a70e070 0x55599aacca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.662+0000 7f020e000640 0 client.26650 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.662+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599aac0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.662+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3644744839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac06b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.662+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 >> 172.21.15.84:0/3644744839 conn(0x55599a702460 msgr2=0x55599aab1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.665+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 shutdown_connections 2024-09-21T07:54:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.665+0000 7f0231bd7740 1 -- 172.21.15.84:0/3644744839 wait complete. 2024-09-21T07:54:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.665+0000 7f0231bd7740 20 client.26650 trim_cache size 0 max 16384 2024-09-21T07:54:21.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.725+0000 7f0231bd7740 1 Processor -- start 2024-09-21T07:54:21.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.725+0000 7f0231bd7740 1 -- start start 2024-09-21T07:54:21.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.726+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6cc9f0 0x55599aac0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.726+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aacc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.726+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aacce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.727+0000 7f0231bd7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02241b7260 con 0x55599a6cc9f0 2024-09-21T07:54:21.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.727+0000 7f0223e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6cc9f0 0x55599aac0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.727+0000 7f0231bd7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02241b8da0 con 0x55599a6ed390 2024-09-21T07:54:21.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.727+0000 7f0231bd7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02241b7930 con 0x55599a6e51b0 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.734+0000 7f0229000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aacce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.734+0000 7f0229000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aacce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:59930/0 (socket says 172.21.15.84:59930) 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.734+0000 7f0229000640 1 -- 172.21.15.84:0/695818301 learned_addr learned my addr 172.21.15.84:0/695818301 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.735+0000 7f0229000640 1 -- 172.21.15.84:0/695818301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 msgr2=0x55599aacc940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.735+0000 7f0229000640 1 --2- 172.21.15.84:0/695818301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aacc940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.735+0000 7f0229000640 1 -- 172.21.15.84:0/695818301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6cc9f0 msgr2=0x55599aac0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.735+0000 7f0229000640 1 --2- 172.21.15.84:0/695818301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6cc9f0 0x55599aac0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.735+0000 7f0229000640 1 -- 172.21.15.84:0/695818301 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55599aab7260 con 0x55599a6ed390 2024-09-21T07:54:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.736+0000 7f0229000640 1 --2- 172.21.15.84:0/695818301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aacce80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f021c0057a0 tx=0x7f021c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b38f550dbff7856c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.738+0000 7f0218c00640 1 -- 172.21.15.84:0/695818301 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c0d5220 con 0x55599a6ed390 2024-09-21T07:54:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.738+0000 7f0218c00640 1 -- 172.21.15.84:0/695818301 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f021c0ad760 con 0x55599a6ed390 2024-09-21T07:54:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.739+0000 7f0218c00640 1 -- 172.21.15.84:0/695818301 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c0d5220 con 0x55599a6ed390 2024-09-21T07:54:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.742+0000 7f0231bd7740 1 -- 172.21.15.84:0/695818301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 msgr2=0x55599aacce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.742+0000 7f0231bd7740 1 --2- 172.21.15.84:0/695818301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aacce80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f021c0057a0 tx=0x7f021c004ab0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.743+0000 7f0231bd7740 1 -- 172.21.15.84:0/695818301 shutdown_connections 2024-09-21T07:54:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.743+0000 7f0231bd7740 1 --2- 172.21.15.84:0/695818301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6ed390 0x55599aacce80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.743+0000 7f0231bd7740 1 --2- 172.21.15.84:0/695818301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aacc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.744+0000 7f0231bd7740 1 --2- 172.21.15.84:0/695818301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6cc9f0 0x55599aac0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.744+0000 7f0231bd7740 1 -- 172.21.15.84:0/695818301 >> 172.21.15.84:0/695818301 conn(0x55599a702460 msgr2=0x55599aac0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.745+0000 7f0231bd7740 1 -- 172.21.15.84:0/695818301 shutdown_connections 2024-09-21T07:54:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.746+0000 7f0231bd7740 1 -- 172.21.15.84:0/695818301 wait complete. 2024-09-21T07:54:21.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.747+0000 7f0231bd7740 1 -- start start 2024-09-21T07:54:21.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.747+0000 7f0231bd7740 1 Processor -- start 2024-09-21T07:54:21.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.758+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6cc9f0 0x55599aac5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.758+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.758+0000 7f0231bd7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599ab362f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.760+0000 7f0229000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599ab362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.760+0000 7f0229000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599ab362f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46268/0 (socket says 172.21.15.84:46268) 2024-09-21T07:54:21.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.761+0000 7f0229000640 1 -- 172.21.15.84:0/3636627035 learned_addr learned my addr 172.21.15.84:0/3636627035 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:21.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.761+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02241b86d0 con 0x55599a6ed390 2024-09-21T07:54:21.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.762+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02241b8000 con 0x55599a6cc9f0 2024-09-21T07:54:21.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.762+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02241b5220 con 0x55599a6e51b0 2024-09-21T07:54:21.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.763+0000 7f0231bd7740 10 client.0 _ll_register_callbacks cb 0x7f0214009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:21.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.761+0000 7f0223e00640 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6cc9f0 0x55599aac5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.764+0000 7f0223400640 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.766+0000 7f0223400640 1 -- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6cc9f0 msgr2=0x55599aac5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:21.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.766+0000 7f0223400640 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6cc9f0 0x55599aac5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.766+0000 7f0223400640 1 -- 172.21.15.84:0/3636627035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 msgr2=0x55599ab362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:21.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.766+0000 7f0223400640 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599ab362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.767+0000 7f0223400640 1 -- 172.21.15.84:0/3636627035 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55599ab36960 con 0x55599a6e51b0 2024-09-21T07:54:21.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.768+0000 7f0223400640 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac5a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0210030420 tx=0x7f021002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b684ef74cbb701 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:21.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.768+0000 7f020e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:21.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.770+0000 7f020e000640 1 -- 172.21.15.84:0/3636627035 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210037040 con 0x55599a6e51b0 2024-09-21T07:54:21.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.770+0000 7f020e000640 1 -- 172.21.15.84:0/3636627035 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f0210005030 con 0x55599a6e51b0 2024-09-21T07:54:21.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.770+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f021c0ad760 con 0x55599a6e51b0 2024-09-21T07:54:21.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.771+0000 7f020e000640 1 -- 172.21.15.84:0/3636627035 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0210061050 con 0x55599a6e51b0 2024-09-21T07:54:21.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.771+0000 7f0231bd7740 10 client.26653 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:21.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.771+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55599ab3dd90 con 0x55599a6e51b0 2024-09-21T07:54:21.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.772+0000 7f020e000640 1 -- 172.21.15.84:0/3636627035 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f021c0ad760 con 0x55599a6e51b0 2024-09-21T07:54:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.775+0000 7f020e000640 1 -- 172.21.15.84:0/3636627035 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f02100046c0 con 0x55599a6e51b0 2024-09-21T07:54:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.775+0000 7f0231bd7740 10 client.26653 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.775+0000 7f0231bd7740 10 client.26653 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:54:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.775+0000 7f0231bd7740 20 client.26653 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.775+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a70e070 0x55599ab404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.775+0000 7f0231bd7740 4 client.26653 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:54:21.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.775+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55599aa299b0 con 0x55599a70e070 2024-09-21T07:54:21.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.776+0000 7f0223e00640 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a70e070 0x55599ab404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:21.784 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:54:21.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.777+0000 7f0223e00640 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a70e070 0x55599ab404d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ab57c14e6f4bc923 server_cookie=c254a1647b106c60 in_seq=0 out_seq=0 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.777+0000 7f020e000640 10 client.26653 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.778+0000 7f020e000640 1 -- 172.21.15.84:0/3636627035 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55599aa299b0 con 0x55599a70e070 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.778+0000 7f020e000640 10 client.26653 handle_command_reply: tid=0 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.778+0000 7f0231bd7740 1 client.26653 shutdown 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.779+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 msgr2=0x55599aac5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.779+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac5a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0210030420 tx=0x7f021002a340 comp rx=0 tx=0).stop 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.780+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 shutdown_connections 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.781+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55599a70e070 0x55599ab404d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.781+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55599a6ed390 0x55599ab362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.781+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55599a6e51b0 0x55599aac5a50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.781+0000 7f020e000640 0 client.26653 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.781+0000 7f0231bd7740 1 --2- 172.21.15.84:0/3636627035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55599a6cc9f0 0x55599aac5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.781+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 >> 172.21.15.84:0/3636627035 conn(0x55599a702460 msgr2=0x55599aab5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.781+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 shutdown_connections 2024-09-21T07:54:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.782+0000 7f0231bd7740 1 -- 172.21.15.84:0/3636627035 wait complete. 2024-09-21T07:54:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.782+0000 7f0231bd7740 20 client.26653 trim_cache size 0 max 16384 2024-09-21T07:54:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.783+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02080b6880 msgr2=0x7f02080b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.783+0000 7f0229a00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02080b6880 0x7f02080b8d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f021002a930 tx=0x7f0210030f80 comp rx=0 tx=0).stop 2024-09-21T07:54:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.783+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241079f0 msgr2=0x7f02241a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.783+0000 7f0229a00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241079f0 0x7f02241a6170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f021c00eb10 tx=0x7f021c00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 shutdown_connections 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02080b6880 0x7f02080b8d90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02241079f0 0x7f02241a6170 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0224102f00 0x7f02241a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 --2- 172.21.15.84:0/4010982766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02241025b0 0x7f02241a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 >> 172.21.15.84:0/4010982766 conn(0x7f02240fe2c0 msgr2=0x7f0224105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 shutdown_connections 2024-09-21T07:54:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:21.784+0000 7f0229a00640 1 -- 172.21.15.84:0/4010982766 wait complete. 2024-09-21T07:54:23.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:23 smithi162 ceph-mon[34833]: pgmap v492: 129 pgs: 129 active+clean; 17 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 175 MiB/s wr, 1.32k op/s 2024-09-21T07:54:23.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:23 smithi084 ceph-mon[30411]: pgmap v492: 129 pgs: 129 active+clean; 17 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 175 MiB/s wr, 1.32k op/s 2024-09-21T07:54:23.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:23 smithi191 ceph-mon[34667]: pgmap v492: 129 pgs: 129 active+clean; 17 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 175 MiB/s wr, 1.32k op/s 2024-09-21T07:54:25.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:25 smithi162 ceph-mon[34833]: pgmap v493: 129 pgs: 129 active+clean; 17 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 186 MiB/s wr, 1.41k op/s 2024-09-21T07:54:25.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:25 smithi084 ceph-mon[30411]: pgmap v493: 129 pgs: 129 active+clean; 17 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 186 MiB/s wr, 1.41k op/s 2024-09-21T07:54:25.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:25 smithi191 ceph-mon[34667]: pgmap v493: 129 pgs: 129 active+clean; 17 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 186 MiB/s wr, 1.41k op/s 2024-09-21T07:54:27.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:27 smithi162 ceph-mon[34833]: pgmap v494: 129 pgs: 129 active+clean; 17 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 177 MiB/s wr, 1.40k op/s 2024-09-21T07:54:27.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:27 smithi084 ceph-mon[30411]: pgmap v494: 129 pgs: 129 active+clean; 17 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 177 MiB/s wr, 1.40k op/s 2024-09-21T07:54:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:27 smithi191 ceph-mon[34667]: pgmap v494: 129 pgs: 129 active+clean; 17 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 177 MiB/s wr, 1.40k op/s 2024-09-21T07:54:28.003 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:54:28.882 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:29.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:29 smithi084 ceph-mon[30411]: pgmap v495: 129 pgs: 129 active+clean; 17 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 169 MiB/s wr, 1.39k op/s 2024-09-21T07:54:29.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:29 smithi162 ceph-mon[34833]: pgmap v495: 129 pgs: 129 active+clean; 17 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 169 MiB/s wr, 1.39k op/s 2024-09-21T07:54:29.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:29 smithi191 ceph-mon[34667]: pgmap v495: 129 pgs: 129 active+clean; 17 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 169 MiB/s wr, 1.39k op/s 2024-09-21T07:54:30.498 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:30 smithi084 ceph-mon[30411]: pgmap v496: 129 pgs: 129 active+clean; 18 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 172 MiB/s wr, 1.50k op/s 2024-09-21T07:54:30.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:30 smithi191 ceph-mon[34667]: pgmap v496: 129 pgs: 129 active+clean; 18 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 172 MiB/s wr, 1.50k op/s 2024-09-21T07:54:30.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:30 smithi162 ceph-mon[34833]: pgmap v496: 129 pgs: 129 active+clean; 18 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 172 MiB/s wr, 1.50k op/s 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.883+0000 7f38b9c00640 1 -- 172.21.15.84:0/2134143853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b4075750 msgr2=0x7f38b4075b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.883+0000 7f38b9c00640 1 --2- 172.21.15.84:0/2134143853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b4075750 0x7f38b4075b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009900 tx=0x7f38a002a420 comp rx=0 tx=0).stop 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.884+0000 7f38b9c00640 1 -- 172.21.15.84:0/2134143853 shutdown_connections 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.884+0000 7f38b9c00640 1 --2- 172.21.15.84:0/2134143853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38b4110150 0x7f38b4112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.884+0000 7f38b9c00640 1 --2- 172.21.15.84:0/2134143853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b40760a0 0x7f38b410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.884+0000 7f38b9c00640 1 --2- 172.21.15.84:0/2134143853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b4075750 0x7f38b4075b60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.884+0000 7f38b9c00640 1 -- 172.21.15.84:0/2134143853 >> 172.21.15.84:0/2134143853 conn(0x7f38b40ff5e0 msgr2=0x7f38b4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.886+0000 7f38b9c00640 1 -- 172.21.15.84:0/2134143853 shutdown_connections 2024-09-21T07:54:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.886+0000 7f38b9c00640 1 -- 172.21.15.84:0/2134143853 wait complete. 2024-09-21T07:54:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.889+0000 7f38b9c00640 1 Processor -- start 2024-09-21T07:54:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.890+0000 7f38b9c00640 1 -- start start 2024-09-21T07:54:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.890+0000 7f38b9c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38b4075750 0x7f38b410f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.890+0000 7f38b9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40760a0 0x7f38b410db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.890+0000 7f38b9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4110150 0x7f38b410e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.890+0000 7f38b9c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4103b30 con 0x7f38b4110150 2024-09-21T07:54:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.890+0000 7f38b9c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41039b0 con 0x7f38b40760a0 2024-09-21T07:54:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.890+0000 7f38b9c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4103cb0 con 0x7f38b4075750 2024-09-21T07:54:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.891+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38b4075750 0x7f38b410f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.891+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38b4075750 0x7f38b410f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34580/0 (socket says 172.21.15.84:34580) 2024-09-21T07:54:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.891+0000 7f38b2a00640 1 -- 172.21.15.84:0/215953987 learned_addr learned my addr 172.21.15.84:0/215953987 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.891+0000 7f38b2000640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40760a0 0x7f38b410db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.892+0000 7f38b3400640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4110150 0x7f38b410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.893+0000 7f38b2000640 1 -- 172.21.15.84:0/215953987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38b4075750 msgr2=0x7f38b410f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.893+0000 7f38b2000640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38b4075750 0x7f38b410f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.893+0000 7f38b2000640 1 -- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4110150 msgr2=0x7f38b410e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.893+0000 7f38b2000640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4110150 0x7f38b410e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.893+0000 7f38b2000640 1 -- 172.21.15.84:0/215953987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b410e780 con 0x7f38b40760a0 2024-09-21T07:54:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.894+0000 7f38b2000640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40760a0 0x7f38b410db60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f38b40777d0 tx=0x7f38a400db30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.894+0000 7f38ab400640 1 -- 172.21.15.84:0/215953987 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4017070 con 0x7f38b40760a0 2024-09-21T07:54:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.894+0000 7f38ab400640 1 -- 172.21.15.84:0/215953987 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38a4009820 con 0x7f38b40760a0 2024-09-21T07:54:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.895+0000 7f38ab400640 1 -- 172.21.15.84:0/215953987 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4004b90 con 0x7f38b40760a0 2024-09-21T07:54:30.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.900+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b41acf10 con 0x7f38b40760a0 2024-09-21T07:54:30.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.900+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b41ad2b0 con 0x7f38b40760a0 2024-09-21T07:54:30.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.912+0000 7f38c07d9740 1 Processor -- start 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.912+0000 7f38c07d9740 1 -- start start 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.916+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3d5070 0x555efd77bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.916+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3ac1b0 0x555efd77c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.916+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3b4390 0x555efd77c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.916+0000 7f38c07d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555efd6f2fb0 con 0x555efd3d5070 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.916+0000 7f38c07d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555efd6e23e0 con 0x555efd3ac1b0 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.916+0000 7f38c07d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555efd6e61f0 con 0x555efd3b4390 2024-09-21T07:54:30.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.917+0000 7f38ab400640 1 -- 172.21.15.84:0/215953987 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f38a4004d30 con 0x7f38b40760a0 2024-09-21T07:54:30.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.917+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3ac1b0 0x555efd77c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.918+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3ac1b0 0x555efd77c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48890/0 (socket says 172.21.15.84:48890) 2024-09-21T07:54:30.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.918+0000 7f38b2a00640 1 -- 172.21.15.84:0/3073301109 learned_addr learned my addr 172.21.15.84:0/3073301109 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.918+0000 7f38b2000640 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3b4390 0x555efd77c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.919+0000 7f38b2a00640 1 -- 172.21.15.84:0/3073301109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3b4390 msgr2=0x555efd77c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.919+0000 7f38b2a00640 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3b4390 0x555efd77c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.919+0000 7f38b2a00640 1 -- 172.21.15.84:0/3073301109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3d5070 msgr2=0x555efd77bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.919+0000 7f38b2a00640 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3d5070 0x555efd77bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.919+0000 7f38b2a00640 1 -- 172.21.15.84:0/3073301109 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555efd6accd0 con 0x555efd3ac1b0 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.919+0000 7f38b2000640 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3b4390 0x555efd77c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.920+0000 7f38b2a00640 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3ac1b0 0x555efd77c320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f38a00096c0 tx=0x7f38a0003670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a7d1d2c6e19fa40 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.920+0000 7f389fe00640 1 -- 172.21.15.84:0/3073301109 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0031440 con 0x555efd3ac1b0 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.923+0000 7f389fe00640 1 -- 172.21.15.84:0/3073301109 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38a0031a90 con 0x555efd3ac1b0 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.923+0000 7f389fe00640 1 -- 172.21.15.84:0/3073301109 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a003d990 con 0x555efd3ac1b0 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.924+0000 7f38ab400640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38980b6850 0x7f38980b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.924+0000 7f38c07d9740 1 -- 172.21.15.84:0/3073301109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3ac1b0 msgr2=0x555efd77c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.924+0000 7f38c07d9740 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3ac1b0 0x555efd77c320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f38a00096c0 tx=0x7f38a0003670 comp rx=0 tx=0).stop 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.925+0000 7f38ab400640 1 -- 172.21.15.84:0/215953987 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f38a40e74e0 con 0x7f38b40760a0 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.926+0000 7f38c07d9740 1 -- 172.21.15.84:0/3073301109 shutdown_connections 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.926+0000 7f38c07d9740 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3b4390 0x555efd77c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.926+0000 7f38c07d9740 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3ac1b0 0x555efd77c320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.926+0000 7f38c07d9740 1 --2- 172.21.15.84:0/3073301109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3d5070 0x555efd77bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.926+0000 7f38c07d9740 1 -- 172.21.15.84:0/3073301109 >> 172.21.15.84:0/3073301109 conn(0x555efd3c9460 msgr2=0x555efd779cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.926+0000 7f38c07d9740 1 -- 172.21.15.84:0/3073301109 shutdown_connections 2024-09-21T07:54:30.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.927+0000 7f38b3400640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38980b6850 0x7f38980b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.928+0000 7f38c07d9740 1 -- 172.21.15.84:0/3073301109 wait complete. 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.929+0000 7f38c07d9740 1 -- start start 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.929+0000 7f38c07d9740 1 Processor -- start 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd787610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd787b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38c07d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555efd543700 con 0x555efd3ac1b0 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38c07d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555efd67d580 con 0x555efd3b4390 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38c07d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555efd78a560 con 0x555efd3d5070 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd787610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd787610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36702/0 (socket says 172.21.15.84:36702) 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38b2a00640 1 -- 172.21.15.84:0/814026613 learned_addr learned my addr 172.21.15.84:0/814026613 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:30.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.930+0000 7f38b3400640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.931+0000 7f38b2000640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd787b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.931+0000 7f38b3400640 1 -- 172.21.15.84:0/814026613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 msgr2=0x555efd787b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.931+0000 7f38b3400640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd787b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.931+0000 7f38b3400640 1 -- 172.21.15.84:0/814026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 msgr2=0x555efd787610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.931+0000 7f38b3400640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd787610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.931+0000 7f38b3400640 1 -- 172.21.15.84:0/814026613 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555efd440650 con 0x555efd3d5070 2024-09-21T07:54:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.931+0000 7f38b2a00640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd787610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.934+0000 7f38b3400640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00fca0 tx=0x7f38ac00e780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45a3b5dbe76331fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.934+0000 7f38b3400640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38980b6850 0x7f38980b8d60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f38ac005fd0 tx=0x7f38ac004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.934+0000 7f389cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:30.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.934+0000 7f38c07d9740 10 client.0 _ll_register_callbacks cb 0x555efd68d470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.934+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555efd67fb90 con 0x555efd3d5070 2024-09-21T07:54:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.934+0000 7f389cc00640 1 -- 172.21.15.84:0/814026613 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac003970 con 0x555efd3d5070 2024-09-21T07:54:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.935+0000 7f389cc00640 1 -- 172.21.15.84:0/814026613 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f38ac00fd90 con 0x555efd3d5070 2024-09-21T07:54:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.935+0000 7f389cc00640 1 -- 172.21.15.84:0/814026613 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f38ac003970 con 0x555efd3d5070 2024-09-21T07:54:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.935+0000 7f38c07d9740 10 client.26665 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:30.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.935+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555efd69a950 con 0x555efd3d5070 2024-09-21T07:54:30.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.936+0000 7f389cc00640 1 -- 172.21.15.84:0/814026613 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f38ac004b20 con 0x555efd3d5070 2024-09-21T07:54:30.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.937+0000 7f38c07d9740 10 client.26665 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:30.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.937+0000 7f38c07d9740 10 client.26665 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:54:30.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.937+0000 7f38c07d9740 20 client.26665 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:30.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.937+0000 7f38c07d9740 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd3939f0 0x555efd7aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.937+0000 7f38c07d9740 4 client.26665 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:30.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.937+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555efd6f4f00 con 0x555efd3939f0 2024-09-21T07:54:30.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.938+0000 7f38b2a00640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd3939f0 0x555efd7aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.940+0000 7f38b2a00640 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd3939f0 0x555efd7aa4a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ccfeafef95c32fb server_cookie=9bfced3d0485362e in_seq=0 out_seq=0 2024-09-21T07:54:30.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.940+0000 7f389cc00640 10 client.26665 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:54:30.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.941+0000 7f389cc00640 1 -- 172.21.15.84:0/814026613 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555efd6f4f00 con 0x555efd3939f0 2024-09-21T07:54:30.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.941+0000 7f389cc00640 10 client.26665 handle_command_reply: tid=0 2024-09-21T07:54:30.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.941+0000 7f38c07d9740 1 client.26665 shutdown 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 msgr2=0x555efd7a4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00fca0 tx=0x7f38ac00e780 comp rx=0 tx=0).stop 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 shutdown_connections 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd3939f0 0x555efd7aa4a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4890 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd787b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 --2- 172.21.15.84:0/814026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd787610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 >> 172.21.15.84:0/814026613 conn(0x555efd3c9460 msgr2=0x555efd77efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:30.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.942+0000 7f389cc00640 0 client.26665 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:54:30.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.943+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 shutdown_connections 2024-09-21T07:54:30.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.943+0000 7f38c07d9740 1 -- 172.21.15.84:0/814026613 wait complete. 2024-09-21T07:54:30.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.943+0000 7f38c07d9740 20 client.26665 trim_cache size 0 max 16384 2024-09-21T07:54:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.972+0000 7f38c07d9740 1 Processor -- start 2024-09-21T07:54:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.972+0000 7f38c07d9740 1 -- start start 2024-09-21T07:54:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd786500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd789240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38c07d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41aec30 con 0x555efd3ac1b0 2024-09-21T07:54:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38c07d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b0770 con 0x555efd3b4390 2024-09-21T07:54:30.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38c07d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41af300 con 0x555efd3d5070 2024-09-21T07:54:30.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38b3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38b3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34592/0 (socket says 172.21.15.84:34592) 2024-09-21T07:54:30.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.973+0000 7f38b3400640 1 -- 172.21.15.84:0/1363960071 learned_addr learned my addr 172.21.15.84:0/1363960071 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:30.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.974+0000 7f38b2000640 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd789240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.974+0000 7f38b2a00640 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd786500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.975+0000 7f38b3400640 1 -- 172.21.15.84:0/1363960071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 msgr2=0x555efd789240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.975+0000 7f38b3400640 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd789240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.975+0000 7f38b3400640 1 -- 172.21.15.84:0/1363960071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 msgr2=0x555efd786500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.975+0000 7f38b3400640 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd786500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.975+0000 7f38b3400640 1 -- 172.21.15.84:0/1363960071 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555efd77e300 con 0x555efd3d5070 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.975+0000 7f38b3400640 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38ac011e80 tx=0x7f38ac015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd353e81b0640af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.975+0000 7f389f400640 1 -- 172.21.15.84:0/1363960071 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac003970 con 0x555efd3d5070 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.976+0000 7f389f400640 1 -- 172.21.15.84:0/1363960071 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ac037070 con 0x555efd3d5070 2024-09-21T07:54:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.976+0000 7f389f400640 1 -- 172.21.15.84:0/1363960071 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac028430 con 0x555efd3d5070 2024-09-21T07:54:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.978+0000 7f38c07d9740 1 -- 172.21.15.84:0/1363960071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 msgr2=0x555efd7a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.978+0000 7f38c07d9740 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38ac011e80 tx=0x7f38ac015000 comp rx=0 tx=0).stop 2024-09-21T07:54:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.978+0000 7f38c07d9740 1 -- 172.21.15.84:0/1363960071 shutdown_connections 2024-09-21T07:54:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.979+0000 7f38c07d9740 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd7a4810 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.979+0000 7f38c07d9740 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd789240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.979+0000 7f38c07d9740 1 --2- 172.21.15.84:0/1363960071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd786500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.979+0000 7f38c07d9740 1 -- 172.21.15.84:0/1363960071 >> 172.21.15.84:0/1363960071 conn(0x555efd3c9460 msgr2=0x555efd788b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.981+0000 7f38c07d9740 1 -- 172.21.15.84:0/1363960071 shutdown_connections 2024-09-21T07:54:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.981+0000 7f38c07d9740 1 -- 172.21.15.84:0/1363960071 wait complete. 2024-09-21T07:54:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.982+0000 7f38c07d9740 1 -- start start 2024-09-21T07:54:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.982+0000 7f38c07d9740 1 Processor -- start 2024-09-21T07:54:30.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.987+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd80e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.988+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd80e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.988+0000 7f38c07d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd79d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.988+0000 7f38b2000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd80e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.988+0000 7f38b2000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd80e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48922/0 (socket says 172.21.15.84:48922) 2024-09-21T07:54:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38c07d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41b00a0 con 0x555efd3ac1b0 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38c07d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41af9d0 con 0x555efd3b4390 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38c07d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38b410ee60 con 0x555efd3d5070 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38c07d9740 10 client.0 _ll_register_callbacks cb 0x7f38ac00f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd79d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd79d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34606/0 (socket says 172.21.15.84:34606) 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 -- 172.21.15.84:0/2939635558 learned_addr learned my addr 172.21.15.84:0/2939635558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 -- 172.21.15.84:0/2939635558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 msgr2=0x555efd80e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd80e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 -- 172.21.15.84:0/2939635558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 msgr2=0x555efd80e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd80e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.989+0000 7f38b3400640 1 -- 172.21.15.84:0/2939635558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555efd79d7f0 con 0x555efd3d5070 2024-09-21T07:54:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.991+0000 7f38b3400640 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd79d080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00f900 tx=0x7f38ac004dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4714db6638844a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.991+0000 7f389cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.992+0000 7f389cc00640 1 -- 172.21.15.84:0/2939635558 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac040070 con 0x555efd3d5070 2024-09-21T07:54:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.992+0000 7f389cc00640 1 -- 172.21.15.84:0/2939635558 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f38ac005390 con 0x555efd3d5070 2024-09-21T07:54:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.992+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38ac037070 con 0x555efd3d5070 2024-09-21T07:54:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.993+0000 7f389cc00640 1 -- 172.21.15.84:0/2939635558 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f38ac04a050 con 0x555efd3d5070 2024-09-21T07:54:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.993+0000 7f38c07d9740 10 client.26671 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.993+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555efd8159d0 con 0x555efd3d5070 2024-09-21T07:54:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.993+0000 7f389cc00640 1 -- 172.21.15.84:0/2939635558 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ac037070 con 0x555efd3d5070 2024-09-21T07:54:30.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.995+0000 7f389cc00640 1 -- 172.21.15.84:0/2939635558 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f38ac045440 con 0x555efd3d5070 2024-09-21T07:54:30.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.995+0000 7f38c07d9740 10 client.26671 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:30.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.995+0000 7f38c07d9740 10 client.26671 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:54:30.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.995+0000 7f38c07d9740 20 client.26671 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.995+0000 7f38c07d9740 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd368da0 0x555efd8180e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.995+0000 7f38c07d9740 4 client.26671 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:54:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.995+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555efd77a020 con 0x555efd368da0 2024-09-21T07:54:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.996+0000 7f38b2a00640 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd368da0 0x555efd8180e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.997+0000 7f389cc00640 10 client.26671 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:54:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.997+0000 7f38b2a00640 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd368da0 0x555efd8180e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e65bd89d1668b2cf server_cookie=67c579da0c7179b4 in_seq=0 out_seq=0 2024-09-21T07:54:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.998+0000 7f389cc00640 1 -- 172.21.15.84:0/2939635558 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555efd77a020 con 0x555efd368da0 2024-09-21T07:54:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.998+0000 7f389cc00640 10 client.26671 handle_command_reply: tid=0 2024-09-21T07:54:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.998+0000 7f38c07d9740 1 client.26671 shutdown 2024-09-21T07:54:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.999+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 msgr2=0x555efd79d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:30.999+0000 7f38c07d9740 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd79d080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00f900 tx=0x7f38ac004dd0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.000+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 shutdown_connections 2024-09-21T07:54:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.000+0000 7f38c07d9740 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555efd368da0 0x555efd8180e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.000+0000 7f38c07d9740 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555efd3d5070 0x555efd79d080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.000+0000 7f38c07d9740 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555efd3b4390 0x555efd80e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.000+0000 7f38c07d9740 1 --2- 172.21.15.84:0/2939635558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555efd3ac1b0 0x555efd80e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.000+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 >> 172.21.15.84:0/2939635558 conn(0x555efd3c9460 msgr2=0x555efd77ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.001+0000 7f389cc00640 0 client.26671 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:54:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.001+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 shutdown_connections 2024-09-21T07:54:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.002+0000 7f38c07d9740 1 -- 172.21.15.84:0/2939635558 wait complete. 2024-09-21T07:54:31.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.002+0000 7f38c07d9740 20 client.26671 trim_cache size 0 max 16384 2024-09-21T07:54:31.005 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:54:31.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.003+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38980b6850 msgr2=0x7f38980b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.003+0000 7f38b9c00640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38980b6850 0x7f38980b8d60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f38ac005fd0 tx=0x7f38ac004a40 comp rx=0 tx=0).stop 2024-09-21T07:54:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.003+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40760a0 msgr2=0x7f38b410db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.003+0000 7f38b9c00640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40760a0 0x7f38b410db60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f38b40777d0 tx=0x7f38a400db30 comp rx=0 tx=0).stop 2024-09-21T07:54:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 shutdown_connections 2024-09-21T07:54:31.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f38980b6850 0x7f38980b8d60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4110150 0x7f38b410e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40760a0 0x7f38b410db60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 --2- 172.21.15.84:0/215953987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38b4075750 0x7f38b410f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 >> 172.21.15.84:0/215953987 conn(0x7f38b40ff5e0 msgr2=0x7f38b4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 shutdown_connections 2024-09-21T07:54:31.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:31.004+0000 7f38b9c00640 1 -- 172.21.15.84:0/215953987 wait complete. 2024-09-21T07:54:33.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:33 smithi162 ceph-mon[34833]: pgmap v497: 129 pgs: 129 active+clean; 18 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 197 MiB/s wr, 1.72k op/s 2024-09-21T07:54:33.571 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:33 smithi084 ceph-mon[30411]: pgmap v497: 129 pgs: 129 active+clean; 18 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 197 MiB/s wr, 1.72k op/s 2024-09-21T07:54:33.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:33 smithi191 ceph-mon[34667]: pgmap v497: 129 pgs: 129 active+clean; 18 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 197 MiB/s wr, 1.72k op/s 2024-09-21T07:54:34.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:54:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.836+0000 7fc57a000640 1 -- 172.21.15.84:0/2885975205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410d390 msgr2=0x7fc574116e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.836+0000 7fc57a000640 1 --2- 172.21.15.84:0/2885975205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410d390 0x7fc574116e00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc5640074e0 tx=0x7fc56402b080 comp rx=0 tx=0).stop 2024-09-21T07:54:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.845+0000 7fc57a000640 1 -- 172.21.15.84:0/2885975205 shutdown_connections 2024-09-21T07:54:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.845+0000 7fc57a000640 1 --2- 172.21.15.84:0/2885975205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410d390 0x7fc574116e00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.845+0000 7fc57a000640 1 --2- 172.21.15.84:0/2885975205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc57410ca40 0x7fc57410ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.845+0000 7fc57a000640 1 --2- 172.21.15.84:0/2885975205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410a660 0x7fc57410aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.846+0000 7fc57a000640 1 -- 172.21.15.84:0/2885975205 >> 172.21.15.84:0/2885975205 conn(0x7fc574070c00 msgr2=0x7fc574071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.846+0000 7fc57a000640 1 -- 172.21.15.84:0/2885975205 shutdown_connections 2024-09-21T07:54:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.851+0000 7fc57a000640 1 -- 172.21.15.84:0/2885975205 wait complete. 2024-09-21T07:54:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.852+0000 7fc57a000640 1 Processor -- start 2024-09-21T07:54:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.854+0000 7fc57a000640 1 -- start start 2024-09-21T07:54:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.854+0000 7fc57a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410a660 0x7fc5741a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.854+0000 7fc57a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc57410ca40 0x7fc5741a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.855+0000 7fc57a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410d390 0x7fc5741a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.855+0000 7fc573e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc57410ca40 0x7fc5741a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.855+0000 7fc57a000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc574119ee0 con 0x7fc57410d390 2024-09-21T07:54:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.855+0000 7fc57a000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc574119d60 con 0x7fc57410a660 2024-09-21T07:54:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.855+0000 7fc57a000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc57411a060 con 0x7fc57410ca40 2024-09-21T07:54:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.857+0000 7fc579600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410d390 0x7fc5741a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.857+0000 7fc579600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410d390 0x7fc5741a0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36732/0 (socket says 172.21.15.84:36732) 2024-09-21T07:54:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.857+0000 7fc579600640 1 -- 172.21.15.84:0/712244770 learned_addr learned my addr 172.21.15.84:0/712244770 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.859+0000 7fc578c00640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410a660 0x7fc5741a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.859+0000 7fc579600640 1 -- 172.21.15.84:0/712244770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc57410ca40 msgr2=0x7fc5741a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.859+0000 7fc579600640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc57410ca40 0x7fc5741a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.859+0000 7fc579600640 1 -- 172.21.15.84:0/712244770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410a660 msgr2=0x7fc5741a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.859+0000 7fc579600640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410a660 0x7fc5741a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.859+0000 7fc579600640 1 -- 172.21.15.84:0/712244770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5741a1480 con 0x7fc57410d390 2024-09-21T07:54:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.860+0000 7fc579600640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410d390 0x7fc5741a0c60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc5640057c0 tx=0x7fc56402bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.867+0000 7fc571600640 1 -- 172.21.15.84:0/712244770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56402bdd0 con 0x7fc57410d390 2024-09-21T07:54:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.867+0000 7fc571600640 1 -- 172.21.15.84:0/712244770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc564041070 con 0x7fc57410d390 2024-09-21T07:54:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.867+0000 7fc571600640 1 -- 172.21.15.84:0/712244770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5640087c0 con 0x7fc57410d390 2024-09-21T07:54:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.869+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5741b54c0 con 0x7fc57410d390 2024-09-21T07:54:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.869+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5741b5930 con 0x7fc57410d390 2024-09-21T07:54:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.876+0000 7fc58268d740 1 Processor -- start 2024-09-21T07:54:34.895 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.892+0000 7fc571600640 1 -- 172.21.15.84:0/712244770 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc56400a2e0 con 0x7fc57410d390 2024-09-21T07:54:34.895 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.893+0000 7fc58268d740 1 -- start start 2024-09-21T07:54:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.894+0000 7fc58268d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e428f1b0 0x5566e4633e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.897+0000 7fc58268d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e42662f0 0x5566e4634350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.897+0000 7fc58268d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e4634890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.897+0000 7fc58268d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5566e45a96b0 con 0x5566e426e4d0 2024-09-21T07:54:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.897+0000 7fc58268d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5566e4598ae0 con 0x5566e42662f0 2024-09-21T07:54:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.897+0000 7fc58268d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5566e459c8f0 con 0x5566e428f1b0 2024-09-21T07:54:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.899+0000 7fc573e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e4634890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.899+0000 7fc573e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e4634890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36748/0 (socket says 172.21.15.84:36748) 2024-09-21T07:54:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.900+0000 7fc578c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e42662f0 0x5566e4634350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.901+0000 7fc578c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e42662f0 0x5566e4634350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48952/0 (socket says 172.21.15.84:48952) 2024-09-21T07:54:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.901+0000 7fc578c00640 1 -- 172.21.15.84:0/29362844 learned_addr learned my addr 172.21.15.84:0/29362844 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.901+0000 7fc573e00640 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e428f1b0 0x5566e4633e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.902+0000 7fc578c00640 1 -- 172.21.15.84:0/29362844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e428f1b0 msgr2=0x5566e4633e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.902+0000 7fc578c00640 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e428f1b0 0x5566e4633e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.902+0000 7fc578c00640 1 -- 172.21.15.84:0/29362844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 msgr2=0x5566e4634890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.902+0000 7fc578c00640 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e4634890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.902+0000 7fc578c00640 1 -- 172.21.15.84:0/29362844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e4565780 con 0x5566e42662f0 2024-09-21T07:54:34.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.904+0000 7fc573e00640 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e428f1b0 0x5566e4633e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.908+0000 7fc578c00640 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e42662f0 0x5566e4634350 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009fd0 tx=0x7fc56c00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=948548b122bbfa0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.915+0000 7fc569c00640 1 -- 172.21.15.84:0/29362844 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c01a070 con 0x5566e42662f0 2024-09-21T07:54:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.917+0000 7fc569c00640 1 -- 172.21.15.84:0/29362844 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc56c00aaa0 con 0x5566e42662f0 2024-09-21T07:54:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.917+0000 7fc569c00640 1 -- 172.21.15.84:0/29362844 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c015c30 con 0x5566e42662f0 2024-09-21T07:54:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.918+0000 7fc571600640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5580b6800 0x7fc5580b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.918+0000 7fc571600640 1 -- 172.21.15.84:0/712244770 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc564106c70 con 0x7fc57410d390 2024-09-21T07:54:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.919+0000 7fc573e00640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5580b6800 0x7fc5580b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.928+0000 7fc58268d740 1 -- 172.21.15.84:0/29362844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e42662f0 msgr2=0x5566e4634350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.928+0000 7fc58268d740 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e42662f0 0x5566e4634350 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009fd0 tx=0x7fc56c00c890 comp rx=0 tx=0).stop 2024-09-21T07:54:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.923+0000 7fc573e00640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5580b6800 0x7fc5580b8d10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc57406a980 tx=0x7fc560009610 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.928+0000 7fc58268d740 1 -- 172.21.15.84:0/29362844 shutdown_connections 2024-09-21T07:54:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.928+0000 7fc58268d740 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e4634890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.928+0000 7fc58268d740 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e42662f0 0x5566e4634350 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.928+0000 7fc58268d740 1 --2- 172.21.15.84:0/29362844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e428f1b0 0x5566e4633e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.928+0000 7fc58268d740 1 -- 172.21.15.84:0/29362844 >> 172.21.15.84:0/29362844 conn(0x5566e4283300 msgr2=0x5566e4631d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.932+0000 7fc58268d740 1 -- 172.21.15.84:0/29362844 shutdown_connections 2024-09-21T07:54:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.938+0000 7fc58268d740 1 -- 172.21.15.84:0/29362844 wait complete. 2024-09-21T07:54:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.939+0000 7fc58268d740 1 -- start start 2024-09-21T07:54:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.939+0000 7fc58268d740 1 Processor -- start 2024-09-21T07:54:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.943+0000 7fc58268d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e463f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.943+0000 7fc58268d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e428f1b0 0x5566e463fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.946+0000 7fc573e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e428f1b0 0x5566e463fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.946+0000 7fc573e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e428f1b0 0x5566e463fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48960/0 (socket says 172.21.15.84:48960) 2024-09-21T07:54:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.947+0000 7fc58268d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e424dd80 0x5566e464b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.947+0000 7fc58268d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5566e44d0ab0 con 0x5566e424dd80 2024-09-21T07:54:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.947+0000 7fc58268d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5566e453f570 con 0x5566e428f1b0 2024-09-21T07:54:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.947+0000 7fc58268d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5566e4642590 con 0x5566e426e4d0 2024-09-21T07:54:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.947+0000 7fc58268d740 10 client.0 _ll_register_callbacks cb 0x5566e454e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.947+0000 7fc573e00640 1 -- 172.21.15.84:0/2294202309 learned_addr learned my addr 172.21.15.84:0/2294202309 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.948+0000 7fc578c00640 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e463f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.951+0000 7fc573e00640 1 -- 172.21.15.84:0/2294202309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 msgr2=0x5566e463f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.951+0000 7fc573e00640 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e463f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.951+0000 7fc573e00640 1 -- 172.21.15.84:0/2294202309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e424dd80 msgr2=0x5566e464b930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:54:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.951+0000 7fc573e00640 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e424dd80 0x5566e464b930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.951+0000 7fc573e00640 1 -- 172.21.15.84:0/2294202309 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e42fa790 con 0x5566e428f1b0 2024-09-21T07:54:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.952+0000 7fc573e00640 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e428f1b0 0x5566e463fa90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc560012be0 tx=0x7fc560004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7743a8801905346 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.952+0000 7fc55e000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:54:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.952+0000 7fc55e000640 1 -- 172.21.15.84:0/2294202309 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560010d70 con 0x5566e428f1b0 2024-09-21T07:54:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.953+0000 7fc55e000640 1 -- 172.21.15.84:0/2294202309 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc5600203f0 con 0x5566e428f1b0 2024-09-21T07:54:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.957+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56c00aaa0 con 0x5566e428f1b0 2024-09-21T07:54:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.958+0000 7fc55e000640 1 -- 172.21.15.84:0/2294202309 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc5600205f0 con 0x5566e428f1b0 2024-09-21T07:54:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.960+0000 7fc58268d740 10 client.26654 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.960+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566e4373620 con 0x5566e428f1b0 2024-09-21T07:54:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.961+0000 7fc55e000640 1 -- 172.21.15.84:0/2294202309 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc560020c40 con 0x5566e428f1b0 2024-09-21T07:54:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.961+0000 7fc55e000640 1 -- 172.21.15.84:0/2294202309 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc56000f040 con 0x5566e428f1b0 2024-09-21T07:54:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.961+0000 7fc58268d740 10 client.26654 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.962+0000 7fc58268d740 10 client.26654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.962+0000 7fc58268d740 20 client.26654 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.962+0000 7fc58268d740 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e42231c0 0x5566e46516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.962+0000 7fc58268d740 4 client.26654 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.962+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc56c00aaa0 con 0x5566e42231c0 2024-09-21T07:54:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.963+0000 7fc578c00640 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e42231c0 0x5566e46516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:34.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.965+0000 7fc578c00640 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e42231c0 0x5566e46516d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b147ca12fb4c3be server_cookie=40744ca2a4d6972f in_seq=0 out_seq=0 2024-09-21T07:54:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.965+0000 7fc55e000640 10 client.26654 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.968+0000 7fc55e000640 1 -- 172.21.15.84:0/2294202309 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc56c00aaa0 con 0x5566e42231c0 2024-09-21T07:54:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.968+0000 7fc55e000640 10 client.26654 handle_command_reply: tid=0 2024-09-21T07:54:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.968+0000 7fc58268d740 1 client.26654 shutdown 2024-09-21T07:54:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.971+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e428f1b0 msgr2=0x5566e463fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.971+0000 7fc58268d740 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e428f1b0 0x5566e463fa90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc560012be0 tx=0x7fc560004730 comp rx=0 tx=0).stop 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.973+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 shutdown_connections 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.973+0000 7fc58268d740 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e424dd80 0x5566e464b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.973+0000 7fc58268d740 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e428f1b0 0x5566e463fa90 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc560012be0 tx=0x7fc560004730 comp rx=0 tx=0).stop 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.973+0000 7fc58268d740 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e42231c0 0x5566e46516d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.973+0000 7fc58268d740 1 --2- 172.21.15.84:0/2294202309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e463f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.973+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 >> 172.21.15.84:0/2294202309 conn(0x5566e4283300 msgr2=0x5566e4634e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.973+0000 7fc55e000640 0 client.26654 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.974+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 shutdown_connections 2024-09-21T07:54:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.974+0000 7fc58268d740 1 -- 172.21.15.84:0/2294202309 wait complete. 2024-09-21T07:54:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:34.974+0000 7fc58268d740 20 client.26654 trim_cache size 0 max 16384 2024-09-21T07:54:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.025+0000 7fc58268d740 1 Processor -- start 2024-09-21T07:54:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.030+0000 7fc58268d740 1 -- start start 2024-09-21T07:54:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.031+0000 7fc58268d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e424dd80 0x5566e46395e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.031+0000 7fc58268d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e464b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.031+0000 7fc58268d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e464bd70 0x5566e4631370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.033+0000 7fc579600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e464bd70 0x5566e4631370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.033+0000 7fc58268d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741bfa90 con 0x5566e426e4d0 2024-09-21T07:54:35.037 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.033+0000 7fc579600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e464bd70 0x5566e4631370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48974/0 (socket says 172.21.15.84:48974) 2024-09-21T07:54:35.037 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.033+0000 7fc579600640 1 -- 172.21.15.84:0/3448253605 learned_addr learned my addr 172.21.15.84:0/3448253605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.033+0000 7fc58268d740 1 -- 172.21.15.84:0/3448253605 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741c15d0 con 0x5566e464bd70 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.033+0000 7fc58268d740 1 -- 172.21.15.84:0/3448253605 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741c0160 con 0x5566e424dd80 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.034+0000 7fc579600640 1 -- 172.21.15.84:0/3448253605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e424dd80 msgr2=0x5566e46395e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.034+0000 7fc579600640 1 --2- 172.21.15.84:0/3448253605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e424dd80 0x5566e46395e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.034+0000 7fc579600640 1 -- 172.21.15.84:0/3448253605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 msgr2=0x5566e464b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.034+0000 7fc579600640 1 --2- 172.21.15.84:0/3448253605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e464b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.035+0000 7fc579600640 1 -- 172.21.15.84:0/3448253605 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e463e770 con 0x5566e464bd70 2024-09-21T07:54:35.038 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.035+0000 7fc579600640 1 --2- 172.21.15.84:0/3448253605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e464bd70 0x5566e4631370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5640c9970 tx=0x7fc564005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=427a5e41d59c0e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.036+0000 7fc569200640 1 -- 172.21.15.84:0/3448253605 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5640cc2a0 con 0x5566e464bd70 2024-09-21T07:54:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.038+0000 7fc569200640 1 -- 172.21.15.84:0/3448253605 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5640cce90 con 0x5566e464bd70 2024-09-21T07:54:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.038+0000 7fc569200640 1 -- 172.21.15.84:0/3448253605 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5640cc2a0 con 0x5566e464bd70 2024-09-21T07:54:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.039+0000 7fc58268d740 1 -- 172.21.15.84:0/3448253605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e464bd70 msgr2=0x5566e4631370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.039+0000 7fc58268d740 1 --2- 172.21.15.84:0/3448253605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e464bd70 0x5566e4631370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5640c9970 tx=0x7fc564005fd0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.039+0000 7fc58268d740 1 -- 172.21.15.84:0/3448253605 shutdown_connections 2024-09-21T07:54:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.040+0000 7fc58268d740 1 --2- 172.21.15.84:0/3448253605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e464bd70 0x5566e4631370 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.040+0000 7fc58268d740 1 --2- 172.21.15.84:0/3448253605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e426e4d0 0x5566e464b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.040+0000 7fc58268d740 1 --2- 172.21.15.84:0/3448253605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e424dd80 0x5566e46395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.040+0000 7fc58268d740 1 -- 172.21.15.84:0/3448253605 >> 172.21.15.84:0/3448253605 conn(0x5566e4283300 msgr2=0x5566e4638ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.041+0000 7fc58268d740 1 -- 172.21.15.84:0/3448253605 shutdown_connections 2024-09-21T07:54:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.041+0000 7fc58268d740 1 -- 172.21.15.84:0/3448253605 wait complete. 2024-09-21T07:54:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.044+0000 7fc58268d740 1 -- start start 2024-09-21T07:54:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.045+0000 7fc58268d740 1 Processor -- start 2024-09-21T07:54:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.047+0000 7fc58268d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e424dd80 0x5566e4643a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.049+0000 7fc58268d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e4643fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.050+0000 7fc578c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e424dd80 0x5566e4643a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.050+0000 7fc578c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e424dd80 0x5566e4643a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48988/0 (socket says 172.21.15.84:48988) 2024-09-21T07:54:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.052+0000 7fc578c00640 1 -- 172.21.15.84:0/416157747 learned_addr learned my addr 172.21.15.84:0/416157747 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.052+0000 7fc58268d740 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e464bd70 0x5566e46444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.052+0000 7fc573e00640 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e4643fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.054+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741c0f00 con 0x5566e464bd70 2024-09-21T07:54:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.054+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741c0830 con 0x5566e424dd80 2024-09-21T07:54:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.054+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc5741bda50 con 0x5566e426e4d0 2024-09-21T07:54:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.054+0000 7fc58268d740 10 client.0 _ll_register_callbacks cb 0x7fc560009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.055+0000 7fc573e00640 1 -- 172.21.15.84:0/416157747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e424dd80 msgr2=0x5566e4643a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.055+0000 7fc573e00640 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e424dd80 0x5566e4643a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.055+0000 7fc573e00640 1 -- 172.21.15.84:0/416157747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e464bd70 msgr2=0x5566e46444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.055+0000 7fc573e00640 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e464bd70 0x5566e46444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.055+0000 7fc573e00640 1 -- 172.21.15.84:0/416157747 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e46bb2b0 con 0x5566e426e4d0 2024-09-21T07:54:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.056+0000 7fc573e00640 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e4643fb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc56001b000 tx=0x7fc560032650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cf1727e0b6243d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.056+0000 7fc55e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.056+0000 7fc55e000640 1 -- 172.21.15.84:0/416157747 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560012790 con 0x5566e426e4d0 2024-09-21T07:54:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.057+0000 7fc55e000640 1 -- 172.21.15.84:0/416157747 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fc560005250 con 0x5566e426e4d0 2024-09-21T07:54:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.057+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5640cce90 con 0x5566e426e4d0 2024-09-21T07:54:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.057+0000 7fc55e000640 1 -- 172.21.15.84:0/416157747 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc560005490 con 0x5566e426e4d0 2024-09-21T07:54:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.058+0000 7fc58268d740 10 client.26680 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.058+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566e46bc4e0 con 0x5566e426e4d0 2024-09-21T07:54:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc55e000640 1 -- 172.21.15.84:0/416157747 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5640cce90 con 0x5566e426e4d0 2024-09-21T07:54:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc55e000640 1 -- 172.21.15.84:0/416157747 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc560010c40 con 0x5566e426e4d0 2024-09-21T07:54:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc58268d740 10 client.26680 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc58268d740 10 client.26680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc58268d740 20 client.26680 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc58268d740 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e46bcc20 0x5566e46bf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc58268d740 4 client.26680 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:54:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.061+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5566e45ab600 con 0x5566e46bcc20 2024-09-21T07:54:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.065+0000 7fc578c00640 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e46bcc20 0x5566e46bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.068+0000 7fc55e000640 10 client.26680 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.068+0000 7fc578c00640 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e46bcc20 0x5566e46bf040 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2746371048a457e server_cookie=f05eb433f19a7bba in_seq=0 out_seq=0 2024-09-21T07:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.350+0000 7fc55e000640 1 -- 172.21.15.84:0/416157747 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5566e45ab600 con 0x5566e46bcc20 2024-09-21T07:54:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.350+0000 7fc55e000640 10 client.26680 handle_command_reply: tid=0 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.351+0000 7fc58268d740 1 client.26680 shutdown 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 msgr2=0x5566e4643fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e4643fb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc56001b000 tx=0x7fc560032650 comp rx=0 tx=0).stop 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 shutdown_connections 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566e464bd70 0x5566e46444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5566e46bcc20 0x5566e46bf040 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5566e426e4d0 0x5566e4643fb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 --2- 172.21.15.84:0/416157747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566e424dd80 0x5566e4643a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.352+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 >> 172.21.15.84:0/416157747 conn(0x5566e4283300 msgr2=0x5566e4634df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.353+0000 7fc55e000640 0 client.26680 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.355+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 shutdown_connections 2024-09-21T07:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.355+0000 7fc58268d740 1 -- 172.21.15.84:0/416157747 wait complete. 2024-09-21T07:54:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.356+0000 7fc58268d740 20 client.26680 trim_cache size 0 max 16384 2024-09-21T07:54:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:54:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:54:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:54:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:54:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.357+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5580b6800 msgr2=0x7fc5580b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.357+0000 7fc57a000640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5580b6800 0x7fc5580b8d10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc57406a980 tx=0x7fc560009610 comp rx=0 tx=0).stop 2024-09-21T07:54:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.358+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410d390 msgr2=0x7fc5741a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.358+0000 7fc57a000640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410d390 0x7fc5741a0c60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc5640057c0 tx=0x7fc56402bbf0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.358+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 shutdown_connections 2024-09-21T07:54:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.358+0000 7fc57a000640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5580b6800 0x7fc5580b8d10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.359+0000 7fc57a000640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc57410d390 0x7fc5741a0c60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.359+0000 7fc57a000640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc57410ca40 0x7fc5741a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.360+0000 7fc57a000640 1 --2- 172.21.15.84:0/712244770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc57410a660 0x7fc5741a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.360+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 >> 172.21.15.84:0/712244770 conn(0x7fc574070c00 msgr2=0x7fc57410fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.360+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 shutdown_connections 2024-09-21T07:54:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:35.361+0000 7fc57a000640 1 -- 172.21.15.84:0/712244770 wait complete. 2024-09-21T07:54:35.426 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:35.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:35 smithi162 ceph-mon[34833]: pgmap v498: 129 pgs: 129 active+clean; 19 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 190 MiB/s wr, 1.60k op/s 2024-09-21T07:54:35.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:35 smithi084 ceph-mon[30411]: pgmap v498: 129 pgs: 129 active+clean; 19 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 190 MiB/s wr, 1.60k op/s 2024-09-21T07:54:35.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:35 smithi191 ceph-mon[34667]: pgmap v498: 129 pgs: 129 active+clean; 19 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 190 MiB/s wr, 1.60k op/s 2024-09-21T07:54:36.621 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:36 smithi084 ceph-mon[30411]: pgmap v499: 129 pgs: 129 active+clean; 19 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 191 MiB/s wr, 1.52k op/s 2024-09-21T07:54:36.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:36 smithi191 ceph-mon[34667]: pgmap v499: 129 pgs: 129 active+clean; 19 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 191 MiB/s wr, 1.52k op/s 2024-09-21T07:54:36.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:36 smithi162 ceph-mon[34833]: pgmap v499: 129 pgs: 129 active+clean; 19 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 191 MiB/s wr, 1.52k op/s 2024-09-21T07:54:38.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.032+0000 7f6dc5600640 1 -- 172.21.15.84:0/2905455450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc0110440 msgr2=0x7f6dc0116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.032+0000 7f6dc5600640 1 --2- 172.21.15.84:0/2905455450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc0110440 0x7f6dc0116c70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009be0 tx=0x7f6db802a6d0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.035+0000 7f6dc5600640 1 -- 172.21.15.84:0/2905455450 shutdown_connections 2024-09-21T07:54:38.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.035+0000 7f6dc5600640 1 --2- 172.21.15.84:0/2905455450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc0110440 0x7f6dc0116c70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.035+0000 7f6dc5600640 1 --2- 172.21.15.84:0/2905455450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc010faf0 0x7f6dc010ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.035+0000 7f6dc5600640 1 --2- 172.21.15.84:0/2905455450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc010a1b0 0x7f6dc010a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.035+0000 7f6dc5600640 1 -- 172.21.15.84:0/2905455450 >> 172.21.15.84:0/2905455450 conn(0x7f6dc00780e0 msgr2=0x7f6dc01081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:38.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.036+0000 7f6dc5600640 1 -- 172.21.15.84:0/2905455450 shutdown_connections 2024-09-21T07:54:38.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.036+0000 7f6dc5600640 1 -- 172.21.15.84:0/2905455450 wait complete. 2024-09-21T07:54:38.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.038+0000 7f6dc5600640 1 Processor -- start 2024-09-21T07:54:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.041+0000 7f6dc5600640 1 -- start start 2024-09-21T07:54:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.041+0000 7f6dc5600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc010a1b0 0x7f6dc01a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.041+0000 7f6dc5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc010faf0 0x7f6dc01a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.041+0000 7f6dc5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc0110440 0x7f6dc01a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.041+0000 7f6dc5600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc011a0f0 con 0x7f6dc010faf0 2024-09-21T07:54:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.042+0000 7f6dc5600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0119f70 con 0x7f6dc0110440 2024-09-21T07:54:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.042+0000 7f6dc5600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc011a270 con 0x7f6dc010a1b0 2024-09-21T07:54:38.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.043+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc010a1b0 0x7f6dc01a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.043+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc010a1b0 0x7f6dc01a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55940/0 (socket says 172.21.15.84:55940) 2024-09-21T07:54:38.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.043+0000 7f6dbea00640 1 -- 172.21.15.84:0/282024737 learned_addr learned my addr 172.21.15.84:0/282024737 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:38.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.044+0000 7f6db7e00640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc010faf0 0x7f6dc01a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.045+0000 7f6dbf400640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc0110440 0x7f6dc01a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.046+0000 7f6dbea00640 1 -- 172.21.15.84:0/282024737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc0110440 msgr2=0x7f6dc01a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.046+0000 7f6dbea00640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc0110440 0x7f6dc01a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.048+0000 7f6dbea00640 1 -- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc010faf0 msgr2=0x7f6dc01a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.048+0000 7f6dbea00640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc010faf0 0x7f6dc01a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.048+0000 7f6dbea00640 1 -- 172.21.15.84:0/282024737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc01a69a0 con 0x7f6dc010a1b0 2024-09-21T07:54:38.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.049+0000 7f6db7e00640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc010faf0 0x7f6dc01a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:38.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.049+0000 7f6dbf400640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc0110440 0x7f6dc01a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.052+0000 7f6dbea00640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc010a1b0 0x7f6dc01a0a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6db000ea90 tx=0x7f6db000ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.052+0000 7f6db7400640 1 -- 172.21.15.84:0/282024737 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db000ce40 con 0x7f6dc010a1b0 2024-09-21T07:54:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.052+0000 7f6db7400640 1 -- 172.21.15.84:0/282024737 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db00035f0 con 0x7f6dc010a1b0 2024-09-21T07:54:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.052+0000 7f6db7400640 1 -- 172.21.15.84:0/282024737 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0010690 con 0x7f6dc010a1b0 2024-09-21T07:54:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.053+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc01a6c90 con 0x7f6dc010a1b0 2024-09-21T07:54:38.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.055+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc007bc10 con 0x7f6dc010a1b0 2024-09-21T07:54:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.063+0000 7f6db7400640 1 -- 172.21.15.84:0/282024737 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f6db00108f0 con 0x7f6dc010a1b0 2024-09-21T07:54:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.066+0000 7f6db7400640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6da40b6700 0x7f6da40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.066+0000 7f6dcc2b4740 1 Processor -- start 2024-09-21T07:54:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.067+0000 7f6db7400640 1 -- 172.21.15.84:0/282024737 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6db00e8df0 con 0x7f6dc010a1b0 2024-09-21T07:54:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.068+0000 7f6dcc2b4740 1 -- start start 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.068+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x562406517da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.068+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x5624065182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.068+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406518820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.068+0000 7f6dcc2b4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56240648efb0 con 0x562406171070 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.068+0000 7f6dcc2b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56240647e3e0 con 0x562406150390 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.068+0000 7f6dcc2b4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5624064821f0 con 0x5624061481b0 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.069+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x562406517da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.069+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x562406517da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42650/0 (socket says 172.21.15.84:42650) 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.069+0000 7f6dbea00640 1 -- 172.21.15.84:0/2340231296 learned_addr learned my addr 172.21.15.84:0/2340231296 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.070+0000 7f6dbf400640 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406518820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.070+0000 7f6dbf400640 1 -- 172.21.15.84:0/2340231296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 msgr2=0x5624065182e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:54:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.070+0000 7f6dbf400640 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x5624065182e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.070+0000 7f6dbf400640 1 -- 172.21.15.84:0/2340231296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 msgr2=0x562406517da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.070+0000 7f6dbf400640 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x562406517da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.070+0000 7f6db7e00640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6da40b6700 0x7f6da40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.070+0000 7f6dbf400640 1 -- 172.21.15.84:0/2340231296 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562406448cd0 con 0x562406150390 2024-09-21T07:54:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.072+0000 7f6dbf400640 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406518820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6db8006010 tx=0x7f6db8030640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117856d42137e8da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.073+0000 7f6daf400640 1 -- 172.21.15.84:0/2340231296 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8041020 con 0x562406150390 2024-09-21T07:54:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.073+0000 7f6daf400640 1 -- 172.21.15.84:0/2340231296 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db8037040 con 0x562406150390 2024-09-21T07:54:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.073+0000 7f6daf400640 1 -- 172.21.15.84:0/2340231296 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8036070 con 0x562406150390 2024-09-21T07:54:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.074+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2340231296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 msgr2=0x562406518820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.074+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406518820 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6db8006010 tx=0x7f6db8030640 comp rx=0 tx=0).stop 2024-09-21T07:54:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.075+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2340231296 shutdown_connections 2024-09-21T07:54:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.075+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406518820 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.075+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x5624065182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.075+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2340231296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x562406517da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.075+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2340231296 >> 172.21.15.84:0/2340231296 conn(0x562406165460 msgr2=0x562406515c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:38.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.077+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2340231296 shutdown_connections 2024-09-21T07:54:38.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.077+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2340231296 wait complete. 2024-09-21T07:54:38.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.078+0000 7f6dcc2b4740 1 -- start start 2024-09-21T07:54:38.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.078+0000 7f6dcc2b4740 1 Processor -- start 2024-09-21T07:54:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.080+0000 7f6db7e00640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6da40b6700 0x7f6da40b8c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x562406516a20 tx=0x7f6da8009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:38.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.080+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406523540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.080+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406150390 0x562406523a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.080+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406171070 0x562406540820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.081+0000 7f6dbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406171070 0x562406540820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.081+0000 7f6dbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406171070 0x562406540820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36254/0 (socket says 172.21.15.84:36254) 2024-09-21T07:54:38.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.081+0000 7f6dbf400640 1 -- 172.21.15.84:0/4013490070 learned_addr learned my addr 172.21.15.84:0/4013490070 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:38.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.081+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5624062df700 con 0x562406150390 2024-09-21T07:54:38.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.081+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562406419580 con 0x562406171070 2024-09-21T07:54:38.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.081+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562406537530 con 0x5624061481b0 2024-09-21T07:54:38.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.081+0000 7f6dbea00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406523540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.082+0000 7f6dcc2b4740 10 client.0 _ll_register_callbacks cb 0x562406429470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:38.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.082+0000 7f6db7e00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406150390 0x562406523a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.083+0000 7f6db7e00640 1 -- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 msgr2=0x562406523540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.083+0000 7f6db7e00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406523540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.083+0000 7f6db7e00640 1 -- 172.21.15.84:0/4013490070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406171070 msgr2=0x562406540820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.083+0000 7f6db7e00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406171070 0x562406540820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.083+0000 7f6db7e00640 1 -- 172.21.15.84:0/4013490070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624061dc650 con 0x562406150390 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.083+0000 7f6db7e00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406150390 0x562406523a80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6dc006c790 tx=0x7f6da80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dc53613e5e75d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.083+0000 7f6da3e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:54:38.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.085+0000 7f6da3e00640 1 -- 172.21.15.84:0/4013490070 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8004230 con 0x562406150390 2024-09-21T07:54:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.085+0000 7f6da3e00640 1 -- 172.21.15.84:0/4013490070 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6da80043d0 con 0x562406150390 2024-09-21T07:54:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.085+0000 7f6dbf400640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406171070 0x562406540820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.085+0000 7f6dbea00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406523540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.085+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56240641bb90 con 0x562406150390 2024-09-21T07:54:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.086+0000 7f6da3e00640 1 -- 172.21.15.84:0/4013490070 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6da802e050 con 0x562406150390 2024-09-21T07:54:38.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.086+0000 7f6dcc2b4740 10 client.16602 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.086+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562406436950 con 0x562406150390 2024-09-21T07:54:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.087+0000 7f6da3e00640 1 -- 172.21.15.84:0/4013490070 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56240641bb90 con 0x562406150390 2024-09-21T07:54:38.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.087+0000 7f6da3e00640 1 -- 172.21.15.84:0/4013490070 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6da800f040 con 0x562406150390 2024-09-21T07:54:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.088+0000 7f6dcc2b4740 10 client.16602 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.088+0000 7f6dcc2b4740 10 client.16602 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:54:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.088+0000 7f6dcc2b4740 20 client.16602 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.088+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56240612f9f0 0x5624065466f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.088+0000 7f6dcc2b4740 4 client.16602 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:38.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.088+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562406490f00 con 0x56240612f9f0 2024-09-21T07:54:38.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.088+0000 7f6dbea00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56240612f9f0 0x5624065466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.090+0000 7f6dbea00640 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56240612f9f0 0x5624065466f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8beabc0c90171c2d server_cookie=4c8fdb573ed44147 in_seq=0 out_seq=0 2024-09-21T07:54:38.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.090+0000 7f6da3e00640 10 client.16602 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:54:38.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.091+0000 7f6da3e00640 1 -- 172.21.15.84:0/4013490070 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562406490f00 con 0x56240612f9f0 2024-09-21T07:54:38.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.091+0000 7f6da3e00640 10 client.16602 handle_command_reply: tid=0 2024-09-21T07:54:38.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.092+0000 7f6dcc2b4740 1 client.16602 shutdown 2024-09-21T07:54:38.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406150390 msgr2=0x562406523a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406150390 0x562406523a80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6dc006c790 tx=0x7f6da80046c0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 shutdown_connections 2024-09-21T07:54:38.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56240612f9f0 0x5624065466f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406171070 0x562406540820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406150390 0x562406523a80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/4013490070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406523540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.093+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 >> 172.21.15.84:0/4013490070 conn(0x562406165460 msgr2=0x56240651af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:38.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.094+0000 7f6da3e00640 0 client.16602 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:54:38.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.094+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 shutdown_connections 2024-09-21T07:54:38.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.094+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/4013490070 wait complete. 2024-09-21T07:54:38.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.095+0000 7f6dcc2b4740 20 client.16602 trim_cache size 0 max 16384 2024-09-21T07:54:38.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.130+0000 7f6dcc2b4740 1 Processor -- start 2024-09-21T07:54:38.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.130+0000 7f6dcc2b4740 1 -- start start 2024-09-21T07:54:38.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624061481b0 0x5624065194e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406540720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562406171070 0x562406520730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dcc2b4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc006e610 con 0x5624061481b0 2024-09-21T07:54:38.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dcc2b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0070150 con 0x562406150390 2024-09-21T07:54:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dcc2b4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc006ece0 con 0x562406171070 2024-09-21T07:54:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624061481b0 0x5624065194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624061481b0 0x5624065194e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42670/0 (socket says 172.21.15.84:42670) 2024-09-21T07:54:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.132+0000 7f6dbea00640 1 -- 172.21.15.84:0/2581491163 learned_addr learned my addr 172.21.15.84:0/2581491163 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.133+0000 7f6dbf400640 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562406171070 0x562406520730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.133+0000 7f6dbea00640 1 -- 172.21.15.84:0/2581491163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562406171070 msgr2=0x562406520730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:38.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.133+0000 7f6dbea00640 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562406171070 0x562406520730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.133+0000 7f6dbea00640 1 -- 172.21.15.84:0/2581491163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 msgr2=0x562406540720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:54:38.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.133+0000 7f6dbea00640 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406540720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.133+0000 7f6dbea00640 1 -- 172.21.15.84:0/2581491163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562406516580 con 0x5624061481b0 2024-09-21T07:54:38.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.134+0000 7f6dbea00640 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624061481b0 0x5624065194e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ae850 tx=0x7f6db00ae2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8b63c5405bb421 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:38.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.135+0000 7f6daea00640 1 -- 172.21.15.84:0/2581491163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db00b8330 con 0x5624061481b0 2024-09-21T07:54:38.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.135+0000 7f6daea00640 1 -- 172.21.15.84:0/2581491163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db00b3130 con 0x5624061481b0 2024-09-21T07:54:38.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.135+0000 7f6daea00640 1 -- 172.21.15.84:0/2581491163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0010be0 con 0x5624061481b0 2024-09-21T07:54:38.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.137+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2581491163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624061481b0 msgr2=0x5624065194e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.137+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624061481b0 0x5624065194e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ae850 tx=0x7f6db00ae2f0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.138+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2581491163 shutdown_connections 2024-09-21T07:54:38.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.138+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562406171070 0x562406520730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.138+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406540720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.138+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/2581491163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624061481b0 0x5624065194e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.140+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2581491163 >> 172.21.15.84:0/2581491163 conn(0x562406165460 msgr2=0x562406518dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.141+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2581491163 shutdown_connections 2024-09-21T07:54:38.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.141+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/2581491163 wait complete. 2024-09-21T07:54:38.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.143+0000 7f6dcc2b4740 1 -- start start 2024-09-21T07:54:38.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.147+0000 7f6dcc2b4740 1 Processor -- start 2024-09-21T07:54:38.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.154+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406539070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.154+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406539650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.154+0000 7f6dcc2b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x5624065aa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.155+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406539070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.155+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406539650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.155+0000 7f6dbea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406539070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55956/0 (socket says 172.21.15.84:55956) 2024-09-21T07:54:38.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.155+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406539650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36268/0 (socket says 172.21.15.84:36268) 2024-09-21T07:54:38.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.157+0000 7f6dcc2b4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc006fa80 con 0x562406171070 2024-09-21T07:54:38.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.157+0000 7f6dbf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x5624065aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.157+0000 7f6dbf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x5624065aa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42676/0 (socket says 172.21.15.84:42676) 2024-09-21T07:54:38.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.157+0000 7f6dbf400640 1 -- 172.21.15.84:0/3019776088 learned_addr learned my addr 172.21.15.84:0/3019776088 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:38.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.157+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc006f3b0 con 0x562406150390 2024-09-21T07:54:38.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.157+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0083c10 con 0x5624061481b0 2024-09-21T07:54:38.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.157+0000 7f6dcc2b4740 10 client.0 _ll_register_callbacks cb 0x7f6da8010bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:38.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.158+0000 7f6dbf400640 1 -- 172.21.15.84:0/3019776088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 msgr2=0x562406539070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:38.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.158+0000 7f6dbf400640 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406539070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.158+0000 7f6dbf400640 1 -- 172.21.15.84:0/3019776088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 msgr2=0x562406539650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:38.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.158+0000 7f6dbf400640 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406539650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.158+0000 7f6dbf400640 1 -- 172.21.15.84:0/3019776088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624065aa6f0 con 0x562406171070 2024-09-21T07:54:38.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.158+0000 7f6db7e00640 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406539650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T07:54:38.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.160+0000 7f6dbf400640 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x5624065aa080 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6db8003ba0 tx=0x7f6db8003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb663c4edc6d9f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:38.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.160+0000 7f6da3e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:54:38.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.161+0000 7f6da3e00640 1 -- 172.21.15.84:0/3019776088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8041070 con 0x562406171070 2024-09-21T07:54:38.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.161+0000 7f6da3e00640 1 -- 172.21.15.84:0/3019776088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f6db8030b70 con 0x562406171070 2024-09-21T07:54:38.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.161+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db00b3130 con 0x562406171070 2024-09-21T07:54:38.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.162+0000 7f6da3e00640 1 -- 172.21.15.84:0/3019776088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6db8054050 con 0x562406171070 2024-09-21T07:54:38.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.162+0000 7f6dcc2b4740 10 client.16608 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:38.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.162+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624065b1a60 con 0x562406171070 2024-09-21T07:54:38.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.163+0000 7f6da3e00640 1 -- 172.21.15.84:0/3019776088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db00b3130 con 0x562406171070 2024-09-21T07:54:38.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.163+0000 7f6da3e00640 1 -- 172.21.15.84:0/3019776088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6db803d480 con 0x562406171070 2024-09-21T07:54:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.165+0000 7f6dcc2b4740 10 client.16608 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.165+0000 7f6dcc2b4740 10 client.16608 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:54:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.165+0000 7f6dcc2b4740 20 client.16608 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.165+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x562406104da0 0x5624065b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.165+0000 7f6dcc2b4740 4 client.16608 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:54:38.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.165+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56240648c9b0 con 0x562406104da0 2024-09-21T07:54:38.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.167+0000 7f6dbea00640 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x562406104da0 0x5624065b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:38.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.168+0000 7f6dbea00640 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x562406104da0 0x5624065b3da0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7931b1d2765de2e8 server_cookie=b3c97bfd92b35562 in_seq=0 out_seq=0 2024-09-21T07:54:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.169+0000 7f6da3e00640 10 client.16608 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:54:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.169+0000 7f6da3e00640 1 -- 172.21.15.84:0/3019776088 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56240648c9b0 con 0x562406104da0 2024-09-21T07:54:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.169+0000 7f6da3e00640 10 client.16608 handle_command_reply: tid=0 2024-09-21T07:54:38.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.169+0000 7f6dcc2b4740 1 client.16608 shutdown 2024-09-21T07:54:38.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.170+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 msgr2=0x5624065aa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.170+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x5624065aa080 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6db8003ba0 tx=0x7f6db8003bd0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 shutdown_connections 2024-09-21T07:54:38.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x562406104da0 0x5624065b3da0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562406171070 0x5624065aa080 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562406150390 0x562406539650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6da3e00640 0 client.16608 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:54:38.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 --2- 172.21.15.84:0/3019776088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624061481b0 0x562406539070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 >> 172.21.15.84:0/3019776088 conn(0x562406165460 msgr2=0x5624065249b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:38.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 shutdown_connections 2024-09-21T07:54:38.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.173+0000 7f6dcc2b4740 1 -- 172.21.15.84:0/3019776088 wait complete. 2024-09-21T07:54:38.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.174+0000 7f6dcc2b4740 20 client.16608 trim_cache size 0 max 16384 2024-09-21T07:54:38.176 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:54:38.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.175+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6da40b6700 msgr2=0x7f6da40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.175+0000 7f6dc5600640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6da40b6700 0x7f6da40b8c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x562406516a20 tx=0x7f6da8009260 comp rx=0 tx=0).stop 2024-09-21T07:54:38.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.176+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc010a1b0 msgr2=0x7f6dc01a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:38.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.176+0000 7f6dc5600640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc010a1b0 0x7f6dc01a0a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6db000ea90 tx=0x7f6db000ef50 comp rx=0 tx=0).stop 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 shutdown_connections 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f6da40b6700 0x7f6da40b8c10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc0110440 0x7f6dc01a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc010faf0 0x7f6dc01a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 --2- 172.21.15.84:0/282024737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dc010a1b0 0x7f6dc01a0a60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 >> 172.21.15.84:0/282024737 conn(0x7f6dc00780e0 msgr2=0x7f6dc0078760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 shutdown_connections 2024-09-21T07:54:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:38.180+0000 7f6dc5600640 1 -- 172.21.15.84:0/282024737 wait complete. 2024-09-21T07:54:39.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:39 smithi162 ceph-mon[34833]: pgmap v500: 129 pgs: 129 active+clean; 20 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 211 MiB/s wr, 1.56k op/s 2024-09-21T07:54:39.571 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:39 smithi084 ceph-mon[30411]: pgmap v500: 129 pgs: 129 active+clean; 20 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 211 MiB/s wr, 1.56k op/s 2024-09-21T07:54:39.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:39 smithi191 ceph-mon[34667]: pgmap v500: 129 pgs: 129 active+clean; 20 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 211 MiB/s wr, 1.56k op/s 2024-09-21T07:54:41.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:54:41.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:41 smithi162 ceph-mon[34833]: pgmap v501: 129 pgs: 129 active+clean; 20 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 234 MiB/s wr, 1.57k op/s 2024-09-21T07:54:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:41 smithi084 ceph-mon[30411]: pgmap v501: 129 pgs: 129 active+clean; 20 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 234 MiB/s wr, 1.57k op/s 2024-09-21T07:54:41.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:41 smithi191 ceph-mon[34667]: pgmap v501: 129 pgs: 129 active+clean; 20 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 234 MiB/s wr, 1.57k op/s 2024-09-21T07:54:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:43 smithi162 ceph-mon[34833]: pgmap v502: 129 pgs: 129 active+clean; 21 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 246 MiB/s wr, 1.49k op/s 2024-09-21T07:54:43.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:43 smithi084 ceph-mon[30411]: pgmap v502: 129 pgs: 129 active+clean; 21 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 246 MiB/s wr, 1.49k op/s 2024-09-21T07:54:43.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:43 smithi191 ceph-mon[34667]: pgmap v502: 129 pgs: 129 active+clean; 21 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 246 MiB/s wr, 1.49k op/s 2024-09-21T07:54:45.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:45 smithi162 ceph-mon[34833]: pgmap v503: 129 pgs: 129 active+clean; 21 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 271 MiB/s wr, 1.44k op/s 2024-09-21T07:54:45.563 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:45 smithi084 ceph-mon[30411]: pgmap v503: 129 pgs: 129 active+clean; 21 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 271 MiB/s wr, 1.44k op/s 2024-09-21T07:54:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.622+0000 7fadfd000640 1 -- 172.21.15.84:0/401826652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf8105110 msgr2=0x7fadf810d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.622+0000 7fadfd000640 1 --2- 172.21.15.84:0/401826652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf8105110 0x7fadf810d660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fade0009860 tx=0x7fade002a340 comp rx=0 tx=0).stop 2024-09-21T07:54:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.622+0000 7fadfd000640 1 -- 172.21.15.84:0/401826652 shutdown_connections 2024-09-21T07:54:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.622+0000 7fadfd000640 1 --2- 172.21.15.84:0/401826652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf810dc20 0x7fadf8110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.622+0000 7fadfd000640 1 --2- 172.21.15.84:0/401826652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf8105110 0x7fadf810d660 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fade0009860 tx=0x7fade002a340 comp rx=0 tx=0).stop 2024-09-21T07:54:45.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.622+0000 7fadfd000640 1 --2- 172.21.15.84:0/401826652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadf81047c0 0x7fadf8104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.622+0000 7fadfd000640 1 -- 172.21.15.84:0/401826652 >> 172.21.15.84:0/401826652 conn(0x7fadf80fe2c0 msgr2=0x7fadf8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.624+0000 7fadfd000640 1 -- 172.21.15.84:0/401826652 shutdown_connections 2024-09-21T07:54:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.624+0000 7fadfd000640 1 -- 172.21.15.84:0/401826652 wait complete. 2024-09-21T07:54:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.626+0000 7fadfd000640 1 Processor -- start 2024-09-21T07:54:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.626+0000 7fadfd000640 1 -- start start 2024-09-21T07:54:45.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.628+0000 7fadfd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadf81047c0 0x7fadf8198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.628+0000 7fadfd000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf810dc20 0x7fadf8199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.628+0000 7fadfd000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf819fdc0 0x7fadf81a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadfd000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81138d0 con 0x7fadf81047c0 2024-09-21T07:54:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadfd000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8113750 con 0x7fadf810dc20 2024-09-21T07:54:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadfd000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8113a50 con 0x7fadf819fdc0 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf819fdc0 0x7fadf81a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf819fdc0 0x7fadf81a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55978/0 (socket says 172.21.15.84:55978) 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadf7e00640 1 -- 172.21.15.84:0/513434628 learned_addr learned my addr 172.21.15.84:0/513434628 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadf7400640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadf81047c0 0x7fadf8198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.629+0000 7fadefe00640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf810dc20 0x7fadf8199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.630+0000 7fadf7e00640 1 -- 172.21.15.84:0/513434628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf810dc20 msgr2=0x7fadf8199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.630+0000 7fadf7e00640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf810dc20 0x7fadf8199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.630+0000 7fadf7e00640 1 -- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadf81047c0 msgr2=0x7fadf8198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.630+0000 7fadf7e00640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadf81047c0 0x7fadf8198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.631+0000 7fadf7e00640 1 -- 172.21.15.84:0/513434628 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf81a0710 con 0x7fadf819fdc0 2024-09-21T07:54:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.631+0000 7fadf7400640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadf81047c0 0x7fadf8198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:45.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.631+0000 7fadf7e00640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf819fdc0 0x7fadf81a01d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf000eb10 tx=0x7fadf000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:45.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.632+0000 7fadf4c00640 1 -- 172.21.15.84:0/513434628 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0004b20 con 0x7fadf819fdc0 2024-09-21T07:54:45.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.633+0000 7fadf4c00640 1 -- 172.21.15.84:0/513434628 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0004cc0 con 0x7fadf819fdc0 2024-09-21T07:54:45.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.633+0000 7fadf4c00640 1 -- 172.21.15.84:0/513434628 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0010670 con 0x7fadf819fdc0 2024-09-21T07:54:45.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.633+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf81a0a00 con 0x7fadf819fdc0 2024-09-21T07:54:45.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.633+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf81a0f10 con 0x7fadf819fdc0 2024-09-21T07:54:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.648+0000 7fae05226740 1 Processor -- start 2024-09-21T07:54:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.648+0000 7fadf4c00640 1 -- 172.21.15.84:0/513434628 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fadf0005020 con 0x7fadf819fdc0 2024-09-21T07:54:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.650+0000 7fae05226740 1 -- start start 2024-09-21T07:54:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.650+0000 7fae05226740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa767d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.650+0000 7fae05226740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa768270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.650+0000 7fae05226740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 0x556baa7687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.650+0000 7fae05226740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556baa6defb0 con 0x556baa3a0390 2024-09-21T07:54:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.650+0000 7fae05226740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556baa6ce3e0 con 0x556baa3c1070 2024-09-21T07:54:45.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.650+0000 7fae05226740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556baa6d21f0 con 0x556baa3981b0 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.651+0000 7fadefe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa767d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.651+0000 7fadefe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa767d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36288/0 (socket says 172.21.15.84:36288) 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.651+0000 7fadefe00640 1 -- 172.21.15.84:0/1397201895 learned_addr learned my addr 172.21.15.84:0/1397201895 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.651+0000 7fadefe00640 1 -- 172.21.15.84:0/1397201895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 msgr2=0x556baa768270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.651+0000 7fadefe00640 1 --2- 172.21.15.84:0/1397201895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa768270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.651+0000 7fadefe00640 1 -- 172.21.15.84:0/1397201895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 msgr2=0x556baa7687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.651+0000 7fadefe00640 1 --2- 172.21.15.84:0/1397201895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 0x556baa7687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.652+0000 7fadefe00640 1 -- 172.21.15.84:0/1397201895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556baa698cd0 con 0x556baa3c1070 2024-09-21T07:54:45.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.652+0000 7fadefe00640 1 --2- 172.21.15.84:0/1397201895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa767d30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fade00303f0 tx=0x7fade002cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ab3b9b77023491 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:45.656 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:45 smithi191 ceph-mon[34667]: pgmap v503: 129 pgs: 129 active+clean; 21 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 271 MiB/s wr, 1.44k op/s 2024-09-21T07:54:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.652+0000 7fadecc00640 1 -- 172.21.15.84:0/1397201895 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0037040 con 0x556baa3c1070 2024-09-21T07:54:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.653+0000 7fadecc00640 1 -- 172.21.15.84:0/1397201895 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade002cd90 con 0x556baa3c1070 2024-09-21T07:54:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.653+0000 7fadecc00640 1 -- 172.21.15.84:0/1397201895 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0003dd0 con 0x556baa3c1070 2024-09-21T07:54:45.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.654+0000 7fadf4c00640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faddc0b67b0 0x7faddc0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.656+0000 7fadf7400640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faddc0b67b0 0x7faddc0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.658+0000 7fadf4c00640 1 -- 172.21.15.84:0/513434628 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fadf00e8020 con 0x7fadf819fdc0 2024-09-21T07:54:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.658+0000 7fadf7400640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faddc0b67b0 0x7faddc0b8cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fade8005dc0 tx=0x7fade8005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:45.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.658+0000 7fae05226740 1 -- 172.21.15.84:0/1397201895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 msgr2=0x556baa767d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.658+0000 7fae05226740 1 --2- 172.21.15.84:0/1397201895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa767d30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fade00303f0 tx=0x7fade002cca0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.660+0000 7fae05226740 1 -- 172.21.15.84:0/1397201895 shutdown_connections 2024-09-21T07:54:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.660+0000 7fae05226740 1 --2- 172.21.15.84:0/1397201895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 0x556baa7687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.660+0000 7fae05226740 1 --2- 172.21.15.84:0/1397201895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa768270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.660+0000 7fae05226740 1 --2- 172.21.15.84:0/1397201895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa767d30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.660+0000 7fae05226740 1 -- 172.21.15.84:0/1397201895 >> 172.21.15.84:0/1397201895 conn(0x556baa3b5460 msgr2=0x556baa765bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:45.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.660+0000 7fae05226740 1 -- 172.21.15.84:0/1397201895 shutdown_connections 2024-09-21T07:54:45.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.660+0000 7fae05226740 1 -- 172.21.15.84:0/1397201895 wait complete. 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.661+0000 7fae05226740 1 -- start start 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.661+0000 7fae05226740 1 Processor -- start 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.662+0000 7fae05226740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa7738f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.662+0000 7fae05226740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa773e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.662+0000 7fae05226740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fadf7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa7738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fae05226740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556baa52f700 con 0x556baa3981b0 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fae05226740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556baa669580 con 0x556baa3a0390 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fadefe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa773e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fadefe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa773e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36290/0 (socket says 172.21.15.84:36290) 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fadefe00640 1 -- 172.21.15.84:0/997530803 learned_addr learned my addr 172.21.15.84:0/997530803 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:45.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556baa7764b0 con 0x556baa3c1070 2024-09-21T07:54:45.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fadf7e00640 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.664+0000 7fadefe00640 1 -- 172.21.15.84:0/997530803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 msgr2=0x556baa77f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:45.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.664+0000 7fadefe00640 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.664+0000 7fadefe00640 1 -- 172.21.15.84:0/997530803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 msgr2=0x556baa7738f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.664+0000 7fadefe00640 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa7738f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.664+0000 7fadefe00640 1 -- 172.21.15.84:0/997530803 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556baa42c650 con 0x556baa3a0390 2024-09-21T07:54:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.664+0000 7fadf7400640 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa7738f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:45.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.663+0000 7fae05226740 10 client.0 _ll_register_callbacks cb 0x556baa679470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.664+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556baa66bb90 con 0x556baa3a0390 2024-09-21T07:54:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.665+0000 7fade5600640 10 client.26678 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:54:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.665+0000 7fadefe00640 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa773e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fade0035040 tx=0x7fade00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97b8e80d7a5ffbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:45.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.665+0000 7fade5600640 1 -- 172.21.15.84:0/997530803 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0037040 con 0x556baa3a0390 2024-09-21T07:54:45.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.665+0000 7fade5600640 1 -- 172.21.15.84:0/997530803 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fade0043040 con 0x556baa3a0390 2024-09-21T07:54:45.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fade5600640 1 -- 172.21.15.84:0/997530803 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fade0037040 con 0x556baa3a0390 2024-09-21T07:54:45.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 10 client.26678 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:45.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556baa686950 con 0x556baa3a0390 2024-09-21T07:54:45.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fade5600640 1 -- 172.21.15.84:0/997530803 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fade0003c20 con 0x556baa3a0390 2024-09-21T07:54:45.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 10 client.26678 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:45.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 10 client.26678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:45.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 20 client.26678 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:45.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa37f9f0 0x556baa7856e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 4 client.26678 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.666+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556baa6e0f00 con 0x556baa37f9f0 2024-09-21T07:54:45.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.667+0000 7fadf7400640 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa37f9f0 0x556baa7856e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.668+0000 7fade5600640 10 client.26678 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:45.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.668+0000 7fadf7400640 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa37f9f0 0x556baa7856e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e2b1122c25c663 server_cookie=bc17d9e09365ec2b in_seq=0 out_seq=0 2024-09-21T07:54:45.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.668+0000 7fade5600640 1 -- 172.21.15.84:0/997530803 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556baa6e0f00 con 0x556baa37f9f0 2024-09-21T07:54:45.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.668+0000 7fade5600640 10 client.26678 handle_command_reply: tid=0 2024-09-21T07:54:45.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 client.26678 shutdown 2024-09-21T07:54:45.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 msgr2=0x556baa773e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa773e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fade0035040 tx=0x7fade00038a0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 shutdown_connections 2024-09-21T07:54:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa37f9f0 0x556baa7856e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fade5600640 0 client.26678 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa773e30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 --2- 172.21.15.84:0/997530803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa7738f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.669+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 >> 172.21.15.84:0/997530803 conn(0x556baa3b5460 msgr2=0x556baa76af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.670+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 shutdown_connections 2024-09-21T07:54:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.670+0000 7fae05226740 1 -- 172.21.15.84:0/997530803 wait complete. 2024-09-21T07:54:45.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.670+0000 7fae05226740 20 client.26678 trim_cache size 0 max 16384 2024-09-21T07:54:45.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.702+0000 7fae05226740 1 Processor -- start 2024-09-21T07:54:45.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.702+0000 7fae05226740 1 -- start start 2024-09-21T07:54:45.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.703+0000 7fae05226740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa764bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.703+0000 7fae05226740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa775320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.703+0000 7fae05226740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.703+0000 7fae05226740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81bffb0 con 0x556baa3981b0 2024-09-21T07:54:45.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.703+0000 7fae05226740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81c1af0 con 0x556baa3a0390 2024-09-21T07:54:45.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.703+0000 7fae05226740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81c0680 con 0x556baa3c1070 2024-09-21T07:54:45.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.704+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.704+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55996/0 (socket says 172.21.15.84:55996) 2024-09-21T07:54:45.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.704+0000 7fadf7e00640 1 -- 172.21.15.84:0/4294617948 learned_addr learned my addr 172.21.15.84:0/4294617948 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:45.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.704+0000 7fadefe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa775320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.705+0000 7fadf7400640 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa764bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.705+0000 7fadf7e00640 1 -- 172.21.15.84:0/4294617948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 msgr2=0x556baa775320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.705+0000 7fadf7e00640 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa775320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.705+0000 7fadf7e00640 1 -- 172.21.15.84:0/4294617948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 msgr2=0x556baa764bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.705+0000 7fadf7e00640 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa764bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.705+0000 7fadf7e00640 1 -- 172.21.15.84:0/4294617948 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556baa7749b0 con 0x556baa3c1070 2024-09-21T07:54:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.705+0000 7fadefe00640 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa775320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.706+0000 7fadf7e00640 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fadf00aad70 tx=0x7fadf000cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d740bb8c58d2978 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.706+0000 7fade7e00640 1 -- 172.21.15.84:0/4294617948 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00ad270 con 0x556baa3c1070 2024-09-21T07:54:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.706+0000 7fade7e00640 1 -- 172.21.15.84:0/4294617948 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf00ad610 con 0x556baa3c1070 2024-09-21T07:54:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.706+0000 7fade7e00640 1 -- 172.21.15.84:0/4294617948 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00b21c0 con 0x556baa3c1070 2024-09-21T07:54:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.709+0000 7fae05226740 1 -- 172.21.15.84:0/4294617948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 msgr2=0x556baa77f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.709+0000 7fae05226740 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f6a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fadf00aad70 tx=0x7fadf000cee0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.709+0000 7fae05226740 1 -- 172.21.15.84:0/4294617948 shutdown_connections 2024-09-21T07:54:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.709+0000 7fae05226740 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3c1070 0x556baa77f6a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.709+0000 7fae05226740 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3a0390 0x556baa775320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.709+0000 7fae05226740 1 --2- 172.21.15.84:0/4294617948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3981b0 0x556baa764bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.709+0000 7fae05226740 1 -- 172.21.15.84:0/4294617948 >> 172.21.15.84:0/4294617948 conn(0x556baa3b5460 msgr2=0x556baa774c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.710+0000 7fae05226740 1 -- 172.21.15.84:0/4294617948 shutdown_connections 2024-09-21T07:54:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.710+0000 7fae05226740 1 -- 172.21.15.84:0/4294617948 wait complete. 2024-09-21T07:54:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.711+0000 7fae05226740 1 -- start start 2024-09-21T07:54:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.711+0000 7fae05226740 1 Processor -- start 2024-09-21T07:54:45.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.712+0000 7fae05226740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa77b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.713+0000 7fae05226740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 0x556baa77bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.713+0000 7fae05226740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa7766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.714+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa7766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.714+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa7766c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36302/0 (socket says 172.21.15.84:36302) 2024-09-21T07:54:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.714+0000 7fadf7e00640 1 -- 172.21.15.84:0/2129131068 learned_addr learned my addr 172.21.15.84:0/2129131068 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.714+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81c1420 con 0x556baa3a0390 2024-09-21T07:54:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.714+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81c0d50 con 0x556baa3c1070 2024-09-21T07:54:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.714+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81bdf30 con 0x556baa3981b0 2024-09-21T07:54:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.714+0000 7fadf7400640 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa77b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.715+0000 7fadf7e00640 1 -- 172.21.15.84:0/2129131068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 msgr2=0x556baa77b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.715+0000 7fadf7e00640 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa77b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.715+0000 7fadf7e00640 1 -- 172.21.15.84:0/2129131068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 msgr2=0x556baa77bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.715+0000 7fadf7e00640 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 0x556baa77bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.715+0000 7fadf7e00640 1 -- 172.21.15.84:0/2129131068 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556baa776c00 con 0x556baa3c1070 2024-09-21T07:54:45.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.718+0000 7fae05226740 10 client.0 _ll_register_callbacks cb 0x7fade0005740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:45.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.718+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf00ad610 con 0x556baa3c1070 2024-09-21T07:54:45.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.718+0000 7fadf7400640 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa77b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:54:45.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.719+0000 7fadf7e00640 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa7766c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fadf0020000 tx=0x7fadf00b2470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0838a81b5ea481 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:45.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.719+0000 7fade5600640 10 client.26684 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:54:45.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.721+0000 7fade5600640 1 -- 172.21.15.84:0/2129131068 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00ad270 con 0x556baa3c1070 2024-09-21T07:54:45.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.722+0000 7fade5600640 1 -- 172.21.15.84:0/2129131068 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fadf00b72a0 con 0x556baa3c1070 2024-09-21T07:54:45.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.722+0000 7fade5600640 1 -- 172.21.15.84:0/2129131068 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fadf00ad270 con 0x556baa3c1070 2024-09-21T07:54:45.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.723+0000 7fae05226740 10 client.26684 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:45.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.723+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556baa7f0700 con 0x556baa3c1070 2024-09-21T07:54:45.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.725+0000 7fade5600640 1 -- 172.21.15.84:0/2129131068 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fadf00e5b50 con 0x556baa3c1070 2024-09-21T07:54:45.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.725+0000 7fae05226740 10 client.26684 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:45.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.725+0000 7fae05226740 10 client.26684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.725+0000 7fae05226740 20 client.26684 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.725+0000 7fae05226740 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa354da0 0x556baa7f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.725+0000 7fae05226740 4 client.26684 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:54:45.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.725+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556baa6dc9b0 con 0x556baa354da0 2024-09-21T07:54:45.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.730+0000 7fadf7400640 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa354da0 0x556baa7f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.732+0000 7fadf7400640 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa354da0 0x556baa7f2c70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24590e82142b6029 server_cookie=27705aa0e4db414b in_seq=0 out_seq=0 2024-09-21T07:54:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.732+0000 7fade5600640 10 client.26684 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.732+0000 7fade5600640 1 -- 172.21.15.84:0/2129131068 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556baa6dc9b0 con 0x556baa354da0 2024-09-21T07:54:45.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.732+0000 7fade5600640 10 client.26684 handle_command_reply: tid=0 2024-09-21T07:54:45.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.733+0000 7fae05226740 1 client.26684 shutdown 2024-09-21T07:54:45.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.736+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 msgr2=0x556baa7766c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.736+0000 7fae05226740 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa7766c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fadf0020000 tx=0x7fadf00b2470 comp rx=0 tx=0).stop 2024-09-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.737+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 shutdown_connections 2024-09-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.737+0000 7fae05226740 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556baa3c1070 0x556baa7766c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.737+0000 7fae05226740 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3a0390 0x556baa77bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.737+0000 7fae05226740 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x556baa354da0 0x556baa7f2c70 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.737+0000 7fae05226740 1 --2- 172.21.15.84:0/2129131068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556baa3981b0 0x556baa77b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.737+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 >> 172.21.15.84:0/2129131068 conn(0x556baa3b5460 msgr2=0x556baa764990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:45.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.738+0000 7fade5600640 0 client.26684 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:45.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.739+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 shutdown_connections 2024-09-21T07:54:45.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.739+0000 7fae05226740 1 -- 172.21.15.84:0/2129131068 wait complete. 2024-09-21T07:54:45.743 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:54:45.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.740+0000 7fae05226740 20 client.26684 trim_cache size 0 max 16384 2024-09-21T07:54:45.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.741+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faddc0b67b0 msgr2=0x7faddc0b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.741+0000 7fadfd000640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faddc0b67b0 0x7faddc0b8cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fade8005dc0 tx=0x7fade8005d50 comp rx=0 tx=0).stop 2024-09-21T07:54:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.741+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf819fdc0 msgr2=0x7fadf81a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.741+0000 7fadfd000640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf819fdc0 0x7fadf81a01d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf000eb10 tx=0x7fadf000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.742+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 shutdown_connections 2024-09-21T07:54:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.742+0000 7fadfd000640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7faddc0b67b0 0x7faddc0b8cc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.742+0000 7fadfd000640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf819fdc0 0x7fadf81a01d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.742+0000 7fadfd000640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf810dc20 0x7fadf8199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.742+0000 7fadfd000640 1 --2- 172.21.15.84:0/513434628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadf81047c0 0x7fadf8198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.742+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 >> 172.21.15.84:0/513434628 conn(0x7fadf80fe2c0 msgr2=0x7fadf8102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.743+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 shutdown_connections 2024-09-21T07:54:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:45.743+0000 7fadfd000640 1 -- 172.21.15.84:0/513434628 wait complete. 2024-09-21T07:54:47.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:47 smithi162 ceph-mon[34833]: pgmap v504: 129 pgs: 129 active+clean; 22 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 263 MiB/s wr, 1.32k op/s 2024-09-21T07:54:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:47 smithi084 ceph-mon[30411]: pgmap v504: 129 pgs: 129 active+clean; 22 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 263 MiB/s wr, 1.32k op/s 2024-09-21T07:54:47.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:47 smithi191 ceph-mon[34667]: pgmap v504: 129 pgs: 129 active+clean; 22 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 263 MiB/s wr, 1.32k op/s 2024-09-21T07:54:47.786 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:54:47.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:54:48.866 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.886+0000 7fcf6f000640 1 -- 172.21.15.84:0/1346729258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108aa0 msgr2=0x7fcf6810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.886+0000 7fcf6f000640 1 --2- 172.21.15.84:0/1346729258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108aa0 0x7fcf6810f2d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009900 tx=0x7fcf5402a420 comp rx=0 tx=0).stop 2024-09-21T07:54:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.890+0000 7fcf6f000640 1 -- 172.21.15.84:0/1346729258 shutdown_connections 2024-09-21T07:54:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.890+0000 7fcf6f000640 1 --2- 172.21.15.84:0/1346729258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108aa0 0x7fcf6810f2d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.890+0000 7fcf6f000640 1 --2- 172.21.15.84:0/1346729258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf68108150 0x7fcf68108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.890+0000 7fcf6f000640 1 --2- 172.21.15.84:0/1346729258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf68102820 0x7fcf68102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.891+0000 7fcf6f000640 1 -- 172.21.15.84:0/1346729258 >> 172.21.15.84:0/1346729258 conn(0x7fcf680fe260 msgr2=0x7fcf681006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.895+0000 7fcf6f000640 1 -- 172.21.15.84:0/1346729258 shutdown_connections 2024-09-21T07:54:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.897+0000 7fcf6f000640 1 -- 172.21.15.84:0/1346729258 wait complete. 2024-09-21T07:54:48.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.899+0000 7fcf6f000640 1 Processor -- start 2024-09-21T07:54:48.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.901+0000 7fcf6f000640 1 -- start start 2024-09-21T07:54:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.902+0000 7fcf6f000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf68102820 0x7fcf68197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf6f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108150 0x7fcf681983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf6f000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf68108aa0 0x7fcf6819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf6f000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf681127a0 con 0x7fcf68108aa0 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf6f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68112620 con 0x7fcf68108150 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf6f000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68112920 con 0x7fcf68102820 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf67400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108150 0x7fcf681983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf67400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108150 0x7fcf681983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60290/0 (socket says 172.21.15.84:60290) 2024-09-21T07:54:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.903+0000 7fcf67400640 1 -- 172.21.15.84:0/3460306489 learned_addr learned my addr 172.21.15.84:0/3460306489 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.904+0000 7fcf67400640 1 -- 172.21.15.84:0/3460306489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf68102820 msgr2=0x7fcf68197e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:54:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.904+0000 7fcf67400640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf68102820 0x7fcf68197e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.904+0000 7fcf67400640 1 -- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf68108aa0 msgr2=0x7fcf6819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.904+0000 7fcf67400640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf68108aa0 0x7fcf6819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.904+0000 7fcf67400640 1 -- 172.21.15.84:0/3460306489 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6819dcf0 con 0x7fcf68108150 2024-09-21T07:54:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.904+0000 7fcf67400640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108150 0x7fcf681983d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000b990 tx=0x7fcf6000be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.906+0000 7fcf64c00640 1 -- 172.21.15.84:0/3460306489 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60019070 con 0x7fcf68108150 2024-09-21T07:54:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.906+0000 7fcf64c00640 1 -- 172.21.15.84:0/3460306489 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf6000cba0 con 0x7fcf68108150 2024-09-21T07:54:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.906+0000 7fcf64c00640 1 -- 172.21.15.84:0/3460306489 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600125a0 con 0x7fcf68108150 2024-09-21T07:54:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.906+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6819dfe0 con 0x7fcf68108150 2024-09-21T07:54:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.906+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6819e7f0 con 0x7fcf68108150 2024-09-21T07:54:48.920 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.918+0000 7fcf76219740 1 Processor -- start 2024-09-21T07:54:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.920+0000 7fcf76219740 1 -- start start 2024-09-21T07:54:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.921+0000 7fcf76219740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a87ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.921+0000 7fcf76219740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 0x55e31a87f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.921+0000 7fcf76219740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b94d0 0x55e31a87f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.921+0000 7fcf76219740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e31a7f46b0 con 0x55e31a4b12f0 2024-09-21T07:54:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.921+0000 7fcf76219740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e31a7e3ae0 con 0x55e31a4da1b0 2024-09-21T07:54:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.921+0000 7fcf76219740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e31a7e78f0 con 0x55e31a4b94d0 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.921+0000 7fcf64c00640 1 -- 172.21.15.84:0/3460306489 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fcf6001c070 con 0x7fcf68108150 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.922+0000 7fcf67400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b94d0 0x55e31a87f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.922+0000 7fcf67400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b94d0 0x55e31a87f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36962/0 (socket says 172.21.15.84:36962) 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.923+0000 7fcf67400640 1 -- 172.21.15.84:0/1685339095 learned_addr learned my addr 172.21.15.84:0/1685339095 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.923+0000 7fcf6d000640 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a87ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.923+0000 7fcf67400640 1 -- 172.21.15.84:0/1685339095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 msgr2=0x55e31a87ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.923+0000 7fcf67400640 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a87ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.923+0000 7fcf67400640 1 -- 172.21.15.84:0/1685339095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 msgr2=0x55e31a87f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.923+0000 7fcf67400640 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 0x55e31a87f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.924+0000 7fcf64c00640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf4c0b6700 0x7fcf4c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.924+0000 7fcf67400640 1 -- 172.21.15.84:0/1685339095 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e31a7b0780 con 0x55e31a4b94d0 2024-09-21T07:54:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.925+0000 7fcf67400640 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b94d0 0x55e31a87f890 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf600ba410 tx=0x7fcf600aca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d28a04bd7c5eb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.925+0000 7fcf5d600640 1 -- 172.21.15.84:0/1685339095 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600ac660 con 0x55e31a4b94d0 2024-09-21T07:54:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.926+0000 7fcf5d600640 1 -- 172.21.15.84:0/1685339095 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf600ba440 con 0x55e31a4b94d0 2024-09-21T07:54:48.928 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.926+0000 7fcf5d600640 1 -- 172.21.15.84:0/1685339095 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600776d0 con 0x55e31a4b94d0 2024-09-21T07:54:48.929 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.925+0000 7fcf64c00640 1 -- 172.21.15.84:0/3460306489 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fcf600e6d70 con 0x7fcf68108150 2024-09-21T07:54:48.930 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.926+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf4c0b6700 0x7fcf4c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.935+0000 7fcf76219740 1 -- 172.21.15.84:0/1685339095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b94d0 msgr2=0x55e31a87f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.935+0000 7fcf76219740 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b94d0 0x55e31a87f890 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf600ba410 tx=0x7fcf600aca80 comp rx=0 tx=0).stop 2024-09-21T07:54:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.935+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf4c0b6700 0x7fcf4c0b8c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf54005940 tx=0x7fcf540058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.937+0000 7fcf76219740 1 -- 172.21.15.84:0/1685339095 shutdown_connections 2024-09-21T07:54:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.937+0000 7fcf76219740 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b94d0 0x55e31a87f890 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.937+0000 7fcf76219740 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 0x55e31a87f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.937+0000 7fcf76219740 1 --2- 172.21.15.84:0/1685339095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a87ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.937+0000 7fcf76219740 1 -- 172.21.15.84:0/1685339095 >> 172.21.15.84:0/1685339095 conn(0x55e31a4ce300 msgr2=0x55e31a87cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.937+0000 7fcf76219740 1 -- 172.21.15.84:0/1685339095 shutdown_connections 2024-09-21T07:54:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.937+0000 7fcf76219740 1 -- 172.21.15.84:0/1685339095 wait complete. 2024-09-21T07:54:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.938+0000 7fcf76219740 1 -- start start 2024-09-21T07:54:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.940+0000 7fcf76219740 1 Processor -- start 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.941+0000 7fcf76219740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 0x55e31a88a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.941+0000 7fcf76219740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4b94d0 0x55e31a88a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.941+0000 7fcf76219740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4da1b0 0x55e31a88aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.941+0000 7fcf76219740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e31a71bab0 con 0x55e31a4b12f0 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.941+0000 7fcf76219740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e31a78a570 con 0x55e31a4b94d0 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.941+0000 7fcf76219740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e31a88d590 con 0x55e31a4da1b0 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.941+0000 7fcf76219740 10 client.0 _ll_register_callbacks cb 0x55e31a799100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.942+0000 7fcf6d000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4da1b0 0x55e31a88aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.942+0000 7fcf6d000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4da1b0 0x55e31a88aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36968/0 (socket says 172.21.15.84:36968) 2024-09-21T07:54:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.942+0000 7fcf6d000640 1 -- 172.21.15.84:0/3331350328 learned_addr learned my addr 172.21.15.84:0/3331350328 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.943+0000 7fcf6d000640 1 -- 172.21.15.84:0/3331350328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4b94d0 msgr2=0x55e31a88a970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:54:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.943+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4b94d0 0x55e31a88a970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.943+0000 7fcf6d000640 1 -- 172.21.15.84:0/3331350328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 msgr2=0x55e31a88a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.943+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 0x55e31a88a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.943+0000 7fcf6d000640 1 -- 172.21.15.84:0/3331350328 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e31a545790 con 0x55e31a4da1b0 2024-09-21T07:54:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.944+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4da1b0 0x55e31a88aef0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcf54032fd0 tx=0x7fcf54031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d4cbc317c7c7cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:48.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.944+0000 7fcf52000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:48.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.947+0000 7fcf52000640 1 -- 172.21.15.84:0/3331350328 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5404c020 con 0x55e31a4da1b0 2024-09-21T07:54:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.947+0000 7fcf52000640 1 -- 172.21.15.84:0/3331350328 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fcf540046c0 con 0x55e31a4da1b0 2024-09-21T07:54:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.947+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e31a7f6600 con 0x55e31a4da1b0 2024-09-21T07:54:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.948+0000 7fcf52000640 1 -- 172.21.15.84:0/3331350328 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf54035040 con 0x55e31a4da1b0 2024-09-21T07:54:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.951+0000 7fcf76219740 10 client.26713 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.951+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e31a5be620 con 0x55e31a4da1b0 2024-09-21T07:54:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.952+0000 7fcf52000640 1 -- 172.21.15.84:0/3331350328 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e31a7f6600 con 0x55e31a4da1b0 2024-09-21T07:54:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.956+0000 7fcf52000640 1 -- 172.21.15.84:0/3331350328 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcf54059020 con 0x55e31a4da1b0 2024-09-21T07:54:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.956+0000 7fcf76219740 10 client.26713 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.957+0000 7fcf76219740 10 client.26713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.957+0000 7fcf76219740 20 client.26713 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.957+0000 7fcf76219740 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a498d80 0x55e31a89c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.957+0000 7fcf76219740 4 client.26713 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.957+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e31a7f20b0 con 0x55e31a498d80 2024-09-21T07:54:48.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.958+0000 7fcf67e00640 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a498d80 0x55e31a89c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.961+0000 7fcf52000640 10 client.26713 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.962+0000 7fcf67e00640 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a498d80 0x55e31a89c770 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f2996a54a22c59 server_cookie=4ddcd5f503538e49 in_seq=0 out_seq=0 2024-09-21T07:54:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.963+0000 7fcf52000640 1 -- 172.21.15.84:0/3331350328 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e31a7f20b0 con 0x55e31a498d80 2024-09-21T07:54:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.963+0000 7fcf52000640 10 client.26713 handle_command_reply: tid=0 2024-09-21T07:54:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.964+0000 7fcf76219740 1 client.26713 shutdown 2024-09-21T07:54:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.964+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4da1b0 msgr2=0x55e31a88aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:48.966 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.964+0000 7fcf76219740 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4da1b0 0x55e31a88aef0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcf54032fd0 tx=0x7fcf54031400 comp rx=0 tx=0).stop 2024-09-21T07:54:48.968 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.966+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 shutdown_connections 2024-09-21T07:54:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.966+0000 7fcf76219740 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a498d80 0x55e31a89c770 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.966+0000 7fcf76219740 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4da1b0 0x55e31a88aef0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.966+0000 7fcf76219740 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4b94d0 0x55e31a88a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.966+0000 7fcf76219740 1 --2- 172.21.15.84:0/3331350328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b12f0 0x55e31a88a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.966+0000 7fcf52000640 0 client.26713 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.966+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 >> 172.21.15.84:0/3331350328 conn(0x55e31a4ce300 msgr2=0x55e31a87fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.969+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 shutdown_connections 2024-09-21T07:54:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.970+0000 7fcf76219740 1 -- 172.21.15.84:0/3331350328 wait complete. 2024-09-21T07:54:48.972 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:48.970+0000 7fcf76219740 20 client.26713 trim_cache size 0 max 16384 2024-09-21T07:54:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.027+0000 7fcf76219740 1 Processor -- start 2024-09-21T07:54:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.031+0000 7fcf76219740 1 -- start start 2024-09-21T07:54:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.032+0000 7fcf76219740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a87ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.032+0000 7fcf76219740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a887600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.032+0000 7fcf76219740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a887b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.032+0000 7fcf76219740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4800fea0 con 0x55e31a4b94d0 2024-09-21T07:54:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.032+0000 7fcf76219740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf480119e0 con 0x55e31a4da1b0 2024-09-21T07:54:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.032+0000 7fcf76219740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48010570 con 0x55e31a4b12f0 2024-09-21T07:54:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.033+0000 7fcf6d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a887b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.033+0000 7fcf6d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a887b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60328/0 (socket says 172.21.15.84:60328) 2024-09-21T07:54:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.033+0000 7fcf6d000640 1 -- 172.21.15.84:0/3529888388 learned_addr learned my addr 172.21.15.84:0/3529888388 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.034+0000 7fcf67400640 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a887600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.035+0000 7fcf67e00640 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a87ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.035+0000 7fcf6d000640 1 -- 172.21.15.84:0/3529888388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 msgr2=0x55e31a87ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.038+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a87ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.038+0000 7fcf6d000640 1 -- 172.21.15.84:0/3529888388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 msgr2=0x55e31a887600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.038+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a887600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.038+0000 7fcf6d000640 1 -- 172.21.15.84:0/3529888388 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e31a877000 con 0x55e31a4da1b0 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.038+0000 7fcf67e00640 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a87ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.038+0000 7fcf6d000640 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a887b40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf5402a940 tx=0x7fcf5402aaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38d119fcecbeb7b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.039+0000 7fcf5cc00640 1 -- 172.21.15.84:0/3529888388 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54060070 con 0x55e31a4da1b0 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.039+0000 7fcf5cc00640 1 -- 172.21.15.84:0/3529888388 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf5405e070 con 0x55e31a4da1b0 2024-09-21T07:54:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.039+0000 7fcf5cc00640 1 -- 172.21.15.84:0/3529888388 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5404c040 con 0x55e31a4da1b0 2024-09-21T07:54:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.040+0000 7fcf76219740 1 -- 172.21.15.84:0/3529888388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 msgr2=0x55e31a887b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.040+0000 7fcf76219740 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a887b40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf5402a940 tx=0x7fcf5402aaa0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.043 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.041+0000 7fcf67400640 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a887600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.046+0000 7fcf76219740 1 -- 172.21.15.84:0/3529888388 shutdown_connections 2024-09-21T07:54:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.046+0000 7fcf76219740 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a887b40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.046+0000 7fcf76219740 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a887600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.046+0000 7fcf76219740 1 --2- 172.21.15.84:0/3529888388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a87ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.046+0000 7fcf76219740 1 -- 172.21.15.84:0/3529888388 >> 172.21.15.84:0/3529888388 conn(0x55e31a4ce300 msgr2=0x55e31a87b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.054+0000 7fcf76219740 1 -- 172.21.15.84:0/3529888388 shutdown_connections 2024-09-21T07:54:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.055+0000 7fcf76219740 1 -- 172.21.15.84:0/3529888388 wait complete. 2024-09-21T07:54:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.056+0000 7fcf76219740 1 -- start start 2024-09-21T07:54:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.056+0000 7fcf76219740 1 Processor -- start 2024-09-21T07:54:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.057+0000 7fcf76219740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a8930b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.057+0000 7fcf76219740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a890570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.058+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a8930b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.058+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a8930b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36978/0 (socket says 172.21.15.84:36978) 2024-09-21T07:54:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.058+0000 7fcf67e00640 1 -- 172.21.15.84:0/1417301837 learned_addr learned my addr 172.21.15.84:0/1417301837 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.058+0000 7fcf67400640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a890570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.058+0000 7fcf76219740 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a890b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.059+0000 7fcf6d000640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a890b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.059+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48011310 con 0x55e31a4b94d0 2024-09-21T07:54:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.059+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48010c40 con 0x55e31a4da1b0 2024-09-21T07:54:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.061+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4800de60 con 0x55e31a4b12f0 2024-09-21T07:54:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.061+0000 7fcf76219740 10 client.0 _ll_register_callbacks cb 0x7fcf54040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.062+0000 7fcf6d000640 1 -- 172.21.15.84:0/1417301837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 msgr2=0x55e31a8930b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.062+0000 7fcf6d000640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a8930b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.062+0000 7fcf6d000640 1 -- 172.21.15.84:0/1417301837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 msgr2=0x55e31a890570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.062+0000 7fcf6d000640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a890570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.063+0000 7fcf6d000640 1 -- 172.21.15.84:0/1417301837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e31a8912c0 con 0x55e31a4da1b0 2024-09-21T07:54:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.063+0000 7fcf67e00640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a8930b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.063+0000 7fcf6d000640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a890b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcf54048b60 tx=0x7fcf540486a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b429dffd81bc3dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.063+0000 7fcf52000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:54:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.065+0000 7fcf52000640 1 -- 172.21.15.84:0/1417301837 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5406a030 con 0x55e31a4da1b0 2024-09-21T07:54:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.066+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf5405e070 con 0x55e31a4da1b0 2024-09-21T07:54:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.066+0000 7fcf52000640 1 -- 172.21.15.84:0/1417301837 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fcf5403c630 con 0x55e31a4da1b0 2024-09-21T07:54:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.066+0000 7fcf52000640 1 -- 172.21.15.84:0/1417301837 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf54074050 con 0x55e31a4da1b0 2024-09-21T07:54:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.067+0000 7fcf76219740 10 client.26699 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.067+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e31a907150 con 0x55e31a4da1b0 2024-09-21T07:54:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf52000640 1 -- 172.21.15.84:0/1417301837 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf5405e070 con 0x55e31a4da1b0 2024-09-21T07:54:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf52000640 1 -- 172.21.15.84:0/1417301837 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcf54059030 con 0x55e31a4da1b0 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf76219740 10 client.26699 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf76219740 10 client.26699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf76219740 20 client.26699 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf76219740 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a46e1c0 0x55e31a9097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf76219740 4 client.26699 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.068+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e31a88cda0 con 0x55e31a46e1c0 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.069+0000 7fcf67e00640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a46e1c0 0x55e31a9097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.069+0000 7fcf67e00640 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a46e1c0 0x55e31a9097f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec4a3d464ae7052 server_cookie=ee59adafc9d10b80 in_seq=0 out_seq=0 2024-09-21T07:54:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.069+0000 7fcf52000640 10 client.26699 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf52000640 1 -- 172.21.15.84:0/1417301837 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e31a88cda0 con 0x55e31a46e1c0 2024-09-21T07:54:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf52000640 10 client.26699 handle_command_reply: tid=0 2024-09-21T07:54:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 client.26699 shutdown 2024-09-21T07:54:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 msgr2=0x55e31a890b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a890b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcf54048b60 tx=0x7fcf540486a0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 shutdown_connections 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e31a4da1b0 0x55e31a890b30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e31a4b94d0 0x55e31a890570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e31a46e1c0 0x55e31a9097f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.177+0000 7fcf76219740 1 --2- 172.21.15.84:0/1417301837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e31a4b12f0 0x55e31a8930b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.178+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 >> 172.21.15.84:0/1417301837 conn(0x55e31a4ce300 msgr2=0x55e31a8957d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.178+0000 7fcf52000640 0 client.26699 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.178+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 shutdown_connections 2024-09-21T07:54:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.178+0000 7fcf76219740 1 -- 172.21.15.84:0/1417301837 wait complete. 2024-09-21T07:54:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.179+0000 7fcf76219740 20 client.26699 trim_cache size 0 max 16384 2024-09-21T07:54:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:54:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:54:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:54:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.180+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf4c0b6700 msgr2=0x7fcf4c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.180+0000 7fcf6f000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf4c0b6700 0x7fcf4c0b8c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf54005940 tx=0x7fcf540058d0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.180+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108150 msgr2=0x7fcf681983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.180+0000 7fcf6f000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108150 0x7fcf681983d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000b990 tx=0x7fcf6000be50 comp rx=0 tx=0).stop 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 shutdown_connections 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf4c0b6700 0x7fcf4c0b8c10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf68108aa0 0x7fcf6819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf68108150 0x7fcf681983d0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000b990 tx=0x7fcf6000be50 comp rx=0 tx=0).stop 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 --2- 172.21.15.84:0/3460306489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf68102820 0x7fcf68197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 >> 172.21.15.84:0/3460306489 conn(0x7fcf680fe260 msgr2=0x7fcf6806ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 shutdown_connections 2024-09-21T07:54:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:54:49.181+0000 7fcf6f000640 1 -- 172.21.15.84:0/3460306489 wait complete. 2024-09-21T07:54:49.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:49 smithi084 ceph-mon[30411]: pgmap v505: 129 pgs: 129 active+clean; 22 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 281 MiB/s wr, 1.48k op/s 2024-09-21T07:54:49.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:49 smithi191 ceph-mon[34667]: pgmap v505: 129 pgs: 129 active+clean; 22 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 281 MiB/s wr, 1.48k op/s 2024-09-21T07:54:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:49 smithi162 ceph-mon[34833]: pgmap v505: 129 pgs: 129 active+clean; 22 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 281 MiB/s wr, 1.48k op/s 2024-09-21T07:54:50.350 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:50 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:50.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:50 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:50.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:50 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:51.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.065+0000 7f68ca600640 1 -- 172.21.15.84:0/1828813008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c4118900 msgr2=0x7f68c411ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.065+0000 7f68ca600640 1 --2- 172.21.15.84:0/1828813008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c4118900 0x7f68c411ad20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009c10 tx=0x7f68bc02a700 comp rx=0 tx=0).stop 2024-09-21T07:54:51.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.078+0000 7f68ca600640 1 -- 172.21.15.84:0/1828813008 shutdown_connections 2024-09-21T07:54:51.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.078+0000 7f68ca600640 1 --2- 172.21.15.84:0/1828813008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c4118900 0x7f68c411ad20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.078+0000 7f68ca600640 1 --2- 172.21.15.84:0/1828813008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c410cfd0 0x7f68c41183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.078+0000 7f68ca600640 1 --2- 172.21.15.84:0/1828813008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68c410c680 0x7f68c410ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.078+0000 7f68ca600640 1 -- 172.21.15.84:0/1828813008 >> 172.21.15.84:0/1828813008 conn(0x7f68c406e9f0 msgr2=0x7f68c406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:51.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.081+0000 7f68ca600640 1 -- 172.21.15.84:0/1828813008 shutdown_connections 2024-09-21T07:54:51.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.081+0000 7f68ca600640 1 -- 172.21.15.84:0/1828813008 wait complete. 2024-09-21T07:54:51.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.083+0000 7f68ca600640 1 Processor -- start 2024-09-21T07:54:51.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.085+0000 7f68ca600640 1 -- start start 2024-09-21T07:54:51.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.086+0000 7f68ca600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68c410c680 0x7f68c4111db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.087+0000 7f68ca600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c410cfd0 0x7f68c410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.088+0000 7f68ca600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c4118900 0x7f68c410e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.087+0000 7f68c9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68c410c680 0x7f68c4111db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.088+0000 7f68c9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68c410c680 0x7f68c4111db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36996/0 (socket says 172.21.15.84:36996) 2024-09-21T07:54:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.088+0000 7f68c9200640 1 -- 172.21.15.84:0/1215117914 learned_addr learned my addr 172.21.15.84:0/1215117914 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.089+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f68c411e2c0 con 0x7f68c4118900 2024-09-21T07:54:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.089+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68c411e140 con 0x7f68c410cfd0 2024-09-21T07:54:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.089+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68c411e440 con 0x7f68c410c680 2024-09-21T07:54:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.089+0000 7f68c3e00640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c410cfd0 0x7f68c410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.090+0000 7f68c9c00640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c4118900 0x7f68c410e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.092+0000 7f68c9c00640 1 -- 172.21.15.84:0/1215117914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68c410c680 msgr2=0x7f68c4111db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.093+0000 7f68c9c00640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68c410c680 0x7f68c4111db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.093+0000 7f68c9c00640 1 -- 172.21.15.84:0/1215117914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c410cfd0 msgr2=0x7f68c410e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.093+0000 7f68c9c00640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c410cfd0 0x7f68c410e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.094+0000 7f68c9c00640 1 -- 172.21.15.84:0/1215117914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41b5260 con 0x7f68c4118900 2024-09-21T07:54:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.095+0000 7f68c9c00640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c4118900 0x7f68c410e7b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f68bc034040 tx=0x7f68bc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.096+0000 7f68c1600640 1 -- 172.21.15.84:0/1215117914 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc041020 con 0x7f68c4118900 2024-09-21T07:54:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.096+0000 7f68c1600640 1 -- 172.21.15.84:0/1215117914 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68bc0318f0 con 0x7f68c4118900 2024-09-21T07:54:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.096+0000 7f68c1600640 1 -- 172.21.15.84:0/1215117914 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc036040 con 0x7f68c4118900 2024-09-21T07:54:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.096+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c41b5430 con 0x7f68c4118900 2024-09-21T07:54:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.096+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c41b58f0 con 0x7f68c4118900 2024-09-21T07:54:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.103+0000 7f68d27c2740 1 Processor -- start 2024-09-21T07:54:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.104+0000 7f68c1600640 1 -- 172.21.15.84:0/1215117914 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f68bc044020 con 0x7f68c4118900 2024-09-21T07:54:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.106+0000 7f68d27c2740 1 -- start start 2024-09-21T07:54:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.107+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e729586f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.107+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291b6490 0x55e729587440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.107+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e729587980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.107+0000 7f68d27c2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e7294fce90 con 0x55e7291b6490 2024-09-21T07:54:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.107+0000 7f68d27c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e7294ec2c0 con 0x55e7291be670 2024-09-21T07:54:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.107+0000 7f68d27c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e7294f00d0 con 0x55e7291df350 2024-09-21T07:54:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.108+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e729586f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.108+0000 7f68c9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291b6490 0x55e729587440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.108+0000 7f68c9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291b6490 0x55e729587440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47990/0 (socket says 172.21.15.84:47990) 2024-09-21T07:54:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.108+0000 7f68c9200640 1 -- 172.21.15.84:0/3334834099 learned_addr learned my addr 172.21.15.84:0/3334834099 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.108+0000 7f68c3e00640 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e729587980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.110+0000 7f68c9200640 1 -- 172.21.15.84:0/3334834099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 msgr2=0x55e729586f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.110+0000 7f68c9200640 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e729586f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.110+0000 7f68c9200640 1 -- 172.21.15.84:0/3334834099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 msgr2=0x55e729587980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.110+0000 7f68c9200640 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e729587980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.110+0000 7f68c9200640 1 -- 172.21.15.84:0/3334834099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72924a930 con 0x55e7291b6490 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.110+0000 7f68c3e00640 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e729587980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.111+0000 7f68c9200640 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291b6490 0x55e729587440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009d70 tx=0x7f68b0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9f6db08f37b9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.112+0000 7f68ba000640 1 -- 172.21.15.84:0/3334834099 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b001e070 con 0x55e7291b6490 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.112+0000 7f68ba000640 1 -- 172.21.15.84:0/3334834099 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68b0019ae0 con 0x55e7291b6490 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.112+0000 7f68ba000640 1 -- 172.21.15.84:0/3334834099 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b001e070 con 0x55e7291b6490 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.113+0000 7f68c1600640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f68a80b6780 0x7f68a80b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.113+0000 7f68c1600640 1 -- 172.21.15.84:0/1215117914 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f68bc1085a0 con 0x7f68c4118900 2024-09-21T07:54:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.114+0000 7f68c3e00640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f68a80b6780 0x7f68a80b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.116+0000 7f68d27c2740 1 -- 172.21.15.84:0/3334834099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291b6490 msgr2=0x55e729587440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.116+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291b6490 0x55e729587440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009d70 tx=0x7f68b0011810 comp rx=0 tx=0).stop 2024-09-21T07:54:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.117+0000 7f68c3e00640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f68a80b6780 0x7f68a80b8c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f68c411af30 tx=0x7f68b4009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.118+0000 7f68d27c2740 1 -- 172.21.15.84:0/3334834099 shutdown_connections 2024-09-21T07:54:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.118+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e729587980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.118+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291b6490 0x55e729587440 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.118+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3334834099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e729586f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.118+0000 7f68d27c2740 1 -- 172.21.15.84:0/3334834099 >> 172.21.15.84:0/3334834099 conn(0x55e7291d3740 msgr2=0x55e729584df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.119+0000 7f68d27c2740 1 -- 172.21.15.84:0/3334834099 shutdown_connections 2024-09-21T07:54:51.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.119+0000 7f68d27c2740 1 -- 172.21.15.84:0/3334834099 wait complete. 2024-09-21T07:54:51.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.120+0000 7f68d27c2740 1 -- start start 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.121+0000 7f68d27c2740 1 Processor -- start 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.122+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291b6490 0x55e729592a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.122+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729592fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.122+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e72959ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.122+0000 7f68d27c2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e72934d890 con 0x55e7291be670 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.122+0000 7f68d27c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e729487160 con 0x55e7291b6490 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.122+0000 7f68d27c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e7295956e0 con 0x55e7291df350 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e72959ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e72959ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37018/0 (socket says 172.21.15.84:37018) 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 -- 172.21.15.84:0/3286121982 learned_addr learned my addr 172.21.15.84:0/3286121982 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9200640 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291b6490 0x55e729592a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 -- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291b6490 msgr2=0x55e729592a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291b6490 0x55e729592a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 -- 172.21.15.84:0/3286121982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 msgr2=0x55e729592fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c3e00640 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729592fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729592fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.123+0000 7f68c9c00640 1 -- 172.21.15.84:0/3286121982 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72959ef40 con 0x55e7291df350 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.124+0000 7f68c9c00640 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e72959ea00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ca650 tx=0x7f68bc0d7910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb5040fb36764887 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.124+0000 7f68d27c2740 10 client.0 _ll_register_callbacks cb 0x55e7294a3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.124+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b0019ae0 con 0x55e7291df350 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.125+0000 7f68aea00640 10 client.26731 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.125+0000 7f68aea00640 1 -- 172.21.15.84:0/3286121982 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0cd4e0 con 0x55e7291df350 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.125+0000 7f68aea00640 1 -- 172.21.15.84:0/3286121982 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f68bc0c99d0 con 0x55e7291df350 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.125+0000 7f68aea00640 1 -- 172.21.15.84:0/3286121982 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68bc0cdb90 con 0x55e7291df350 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.125+0000 7f68d27c2740 10 client.26731 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.125+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e7295a14f0 con 0x55e7291df350 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.126+0000 7f68aea00640 1 -- 172.21.15.84:0/3286121982 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f68bc0309b0 con 0x55e7291df350 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.126+0000 7f68d27c2740 10 client.26731 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:51.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.126+0000 7f68d27c2740 10 client.26731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.126+0000 7f68d27c2740 20 client.26731 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.126+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e72919dcd0 0x55e7295a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.126+0000 7f68d27c2740 4 client.26731 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.126+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7294fede0 con 0x55e72919dcd0 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.127+0000 7f68c9200640 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e72919dcd0 0x55e7295a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.128+0000 7f68c9200640 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e72919dcd0 0x55e7295a4b60 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff4369b748b26f1 server_cookie=bb91f9306ab8a71c in_seq=0 out_seq=0 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.128+0000 7f68aea00640 10 client.26731 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68aea00640 1 -- 172.21.15.84:0/3286121982 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e7294fede0 con 0x55e72919dcd0 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68aea00640 10 client.26731 handle_command_reply: tid=0 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 client.26731 shutdown 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 msgr2=0x55e72959ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e72959ea00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ca650 tx=0x7f68bc0d7910 comp rx=0 tx=0).stop 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 shutdown_connections 2024-09-21T07:54:51.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e72919dcd0 0x55e7295a4b60 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291df350 0x55e72959ea00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729592fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 --2- 172.21.15.84:0/3286121982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291b6490 0x55e729592a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 >> 172.21.15.84:0/3286121982 conn(0x55e7291d3740 msgr2=0x55e72958a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:51.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.129+0000 7f68aea00640 0 client.26731 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:51.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.130+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 shutdown_connections 2024-09-21T07:54:51.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.130+0000 7f68d27c2740 1 -- 172.21.15.84:0/3286121982 wait complete. 2024-09-21T07:54:51.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.135+0000 7f68d27c2740 20 client.26731 trim_cache size 0 max 16384 2024-09-21T07:54:51.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.256+0000 7f68d27c2740 1 Processor -- start 2024-09-21T07:54:51.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.256+0000 7f68d27c2740 1 -- start start 2024-09-21T07:54:51.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.258+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e72958a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.258+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e72958a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.258+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291df350 0x55e729584540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.258+0000 7f68d27c2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f68c407f340 con 0x55e7291df350 2024-09-21T07:54:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.258+0000 7f68d27c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4080e80 con 0x55e7291be670 2024-09-21T07:54:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.258+0000 7f68d27c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68c407fa10 con 0x55e7291b6490 2024-09-21T07:54:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.260+0000 7f68c9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e72958a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.261+0000 7f68c9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e72958a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37034/0 (socket says 172.21.15.84:37034) 2024-09-21T07:54:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.261+0000 7f68c9200640 1 -- 172.21.15.84:0/961340919 learned_addr learned my addr 172.21.15.84:0/961340919 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.261+0000 7f68c9c00640 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291df350 0x55e729584540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.261+0000 7f68c3e00640 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e72958a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.263+0000 7f68c9200640 1 -- 172.21.15.84:0/961340919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 msgr2=0x55e72958a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.263+0000 7f68c9200640 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e72958a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.263+0000 7f68c9200640 1 -- 172.21.15.84:0/961340919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291df350 msgr2=0x55e729584540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.263+0000 7f68c9200640 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291df350 0x55e729584540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.263+0000 7f68c9200640 1 -- 172.21.15.84:0/961340919 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7295891f0 con 0x55e7291b6490 2024-09-21T07:54:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.267+0000 7f68c9200640 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e72958a000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009d70 tx=0x7f68b000e670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741fe57ce3a90c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.269+0000 7f68b9600640 1 -- 172.21.15.84:0/961340919 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0031070 con 0x55e7291b6490 2024-09-21T07:54:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.270+0000 7f68b9600640 1 -- 172.21.15.84:0/961340919 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e7294fede0 con 0x55e7291b6490 2024-09-21T07:54:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.270+0000 7f68b9600640 1 -- 172.21.15.84:0/961340919 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b001e040 con 0x55e7291b6490 2024-09-21T07:54:51.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.272+0000 7f68d27c2740 1 -- 172.21.15.84:0/961340919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 msgr2=0x55e72958a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.272+0000 7f68d27c2740 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e72958a000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009d70 tx=0x7f68b000e670 comp rx=0 tx=0).stop 2024-09-21T07:54:51.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.274+0000 7f68d27c2740 1 -- 172.21.15.84:0/961340919 shutdown_connections 2024-09-21T07:54:51.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.274+0000 7f68d27c2740 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291df350 0x55e729584540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.274+0000 7f68d27c2740 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291be670 0x55e72958a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.274+0000 7f68d27c2740 1 --2- 172.21.15.84:0/961340919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e72958a000 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.274+0000 7f68d27c2740 1 -- 172.21.15.84:0/961340919 >> 172.21.15.84:0/961340919 conn(0x55e7291d3740 msgr2=0x55e7295910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:51.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.275+0000 7f68d27c2740 1 -- 172.21.15.84:0/961340919 shutdown_connections 2024-09-21T07:54:51.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.276+0000 7f68d27c2740 1 -- 172.21.15.84:0/961340919 wait complete. 2024-09-21T07:54:51.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.278+0000 7f68d27c2740 1 -- start start 2024-09-21T07:54:51.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.280+0000 7f68d27c2740 1 Processor -- start 2024-09-21T07:54:51.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.283+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e729597470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.284+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729597a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.284+0000 7f68d27c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291df350 0x55e729619670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.285+0000 7f68c9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e729597470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.285+0000 7f68c9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e729597470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37040/0 (socket says 172.21.15.84:37040) 2024-09-21T07:54:51.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.286+0000 7f68d27c2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40807b0 con 0x55e7291be670 2024-09-21T07:54:51.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.286+0000 7f68d27c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40800e0 con 0x55e7291df350 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.286+0000 7f68d27c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68c407d300 con 0x55e7291b6490 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.287+0000 7f68d27c2740 10 client.0 _ll_register_callbacks cb 0x7f68bc105e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.287+0000 7f68c9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291df350 0x55e729619670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.287+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729597a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.287+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729597a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48004/0 (socket says 172.21.15.84:48004) 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.287+0000 7f68c3e00640 1 -- 172.21.15.84:0/85505155 learned_addr learned my addr 172.21.15.84:0/85505155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.289+0000 7f68c3e00640 1 -- 172.21.15.84:0/85505155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 msgr2=0x55e729597470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:51.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.289+0000 7f68c3e00640 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e729597470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.290+0000 7f68c3e00640 1 -- 172.21.15.84:0/85505155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291df350 msgr2=0x55e729619670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:51.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.290+0000 7f68c3e00640 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291df350 0x55e729619670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.290+0000 7f68c3e00640 1 -- 172.21.15.84:0/85505155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e729619ce0 con 0x55e7291be670 2024-09-21T07:54:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.291+0000 7f68c3e00640 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729597a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f68c406c910 tx=0x7f68b4009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c0c39f9bd6e348 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.291+0000 7f68aea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:54:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.293+0000 7f68aea00640 1 -- 172.21.15.84:0/85505155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b402f060 con 0x55e7291be670 2024-09-21T07:54:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.293+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7294fede0 con 0x55e7291be670 2024-09-21T07:54:51.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.293+0000 7f68aea00640 1 -- 172.21.15.84:0/85505155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f68b401f650 con 0x55e7291be670 2024-09-21T07:54:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.294+0000 7f68aea00640 1 -- 172.21.15.84:0/85505155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68b401f850 con 0x55e7291be670 2024-09-21T07:54:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.294+0000 7f68d27c2740 10 client.16638 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.295+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e729621170 con 0x55e7291be670 2024-09-21T07:54:51.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68aea00640 1 -- 172.21.15.84:0/85505155 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e7294fede0 con 0x55e7291be670 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68aea00640 1 -- 172.21.15.84:0/85505155 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f68b401c040 con 0x55e7291be670 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68d27c2740 10 client.16638 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68d27c2740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68d27c2740 20 client.16638 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68d27c2740 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e729173080 0x55e729623890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68d27c2740 4 client.16638 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.297+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e7294fa890 con 0x55e729173080 2024-09-21T07:54:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.298+0000 7f68c9200640 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e729173080 0x55e729623890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.298+0000 7f68c9200640 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e729173080 0x55e729623890 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d31e41970252a3b1 server_cookie=746da661c3d7fe00 in_seq=0 out_seq=0 2024-09-21T07:54:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.299+0000 7f68aea00640 10 client.16638 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:51.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.300+0000 7f68aea00640 1 -- 172.21.15.84:0/85505155 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e7294fa890 con 0x55e729173080 2024-09-21T07:54:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.301+0000 7f68aea00640 10 client.16638 handle_command_reply: tid=0 2024-09-21T07:54:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.301+0000 7f68d27c2740 1 client.16638 shutdown 2024-09-21T07:54:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.304+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 msgr2=0x55e729597a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.304+0000 7f68d27c2740 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729597a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f68c406c910 tx=0x7f68b4009680 comp rx=0 tx=0).stop 2024-09-21T07:54:51.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.305+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 shutdown_connections 2024-09-21T07:54:51.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.305+0000 7f68d27c2740 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e7291df350 0x55e729619670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.305+0000 7f68d27c2740 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7291be670 0x55e729597a10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.305+0000 7f68d27c2740 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55e729173080 0x55e729623890 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.305+0000 7f68d27c2740 1 --2- 172.21.15.84:0/85505155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e7291b6490 0x55e729597470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.305+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 >> 172.21.15.84:0/85505155 conn(0x55e7291d3740 msgr2=0x55e729587f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:51.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.305+0000 7f68aea00640 0 client.16638 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:51.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.306+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 shutdown_connections 2024-09-21T07:54:51.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.306+0000 7f68d27c2740 1 -- 172.21.15.84:0/85505155 wait complete. 2024-09-21T07:54:51.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.309+0000 7f68d27c2740 20 client.16638 trim_cache size 0 max 16384 2024-09-21T07:54:51.313 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:54:51.313 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "f92178bd-4b3c-49f6-be89-e65981d080d0", 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f68a80b6780 msgr2=0x7f68a80b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f68a80b6780 0x7f68a80b8c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f68c411af30 tx=0x7f68b4009260 comp rx=0 tx=0).stop 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c4118900 msgr2=0x7f68c410e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c4118900 0x7f68c410e7b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f68bc034040 tx=0x7f68bc003ba0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 shutdown_connections 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f68a80b6780 0x7f68a80b8c90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c4118900 0x7f68c410e7b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c410cfd0 0x7f68c410e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 --2- 172.21.15.84:0/1215117914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68c410c680 0x7f68c4111db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:51.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 >> 172.21.15.84:0/1215117914 conn(0x7f68c406e9f0 msgr2=0x7f68c4118eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:51.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.310+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 shutdown_connections 2024-09-21T07:54:51.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:51.311+0000 7f68ca600640 1 -- 172.21.15.84:0/1215117914 wait complete. 2024-09-21T07:54:51.354 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:51 smithi084 ceph-mon[30411]: pgmap v506: 129 pgs: 129 active+clean; 22 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 296 MiB/s wr, 1.60k op/s 2024-09-21T07:54:51.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:51 smithi191 ceph-mon[34667]: pgmap v506: 129 pgs: 129 active+clean; 22 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 296 MiB/s wr, 1.60k op/s 2024-09-21T07:54:51.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:51 smithi162 ceph-mon[34833]: pgmap v506: 129 pgs: 129 active+clean; 22 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 296 MiB/s wr, 1.60k op/s 2024-09-21T07:54:52.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:52 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:54:52.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:52 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:54:52.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:52 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:54:52.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:52.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:52.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:54:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:52 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:54:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:52 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:54:52.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:52 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:54:52.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:52.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:52.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:54:52.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:52 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:54:52.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:52 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:54:52.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:52 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:54:52.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:52.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:52.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:54:53.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:53 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:54:53.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:53 smithi191 ceph-mon[34667]: pgmap v507: 129 pgs: 129 active+clean; 23 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 276 MiB/s wr, 1.57k op/s 2024-09-21T07:54:53.798 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:53 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:54:53.798 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:53 smithi084 ceph-mon[30411]: pgmap v507: 129 pgs: 129 active+clean; 23 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 276 MiB/s wr, 1.57k op/s 2024-09-21T07:54:53.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:53 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:54:53.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:53 smithi162 ceph-mon[34833]: pgmap v507: 129 pgs: 129 active+clean; 23 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 276 MiB/s wr, 1.57k op/s 2024-09-21T07:54:53.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:54:54.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:54 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:54:54.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:54 smithi191 ceph-mon[34667]: pgmap v508: 129 pgs: 129 active+clean; 23 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 281 MiB/s wr, 1.72k op/s 2024-09-21T07:54:54.663 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:54.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:54 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:54:54.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:54 smithi162 ceph-mon[34833]: pgmap v508: 129 pgs: 129 active+clean; 23 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 281 MiB/s wr, 1.72k op/s 2024-09-21T07:54:54.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:54 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:54:54.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:54 smithi084 ceph-mon[30411]: pgmap v508: 129 pgs: 129 active+clean; 23 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 281 MiB/s wr, 1.72k op/s 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.960+0000 7f762c000640 1 -- 172.21.15.84:0/3047081276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762411cc30 msgr2=0x7f762411f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.960+0000 7f762c000640 1 --2- 172.21.15.84:0/3047081276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762411cc30 0x7f762411f140 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f761c009ca0 tx=0x7f761c02a8d0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.961+0000 7f762c000640 1 -- 172.21.15.84:0/3047081276 shutdown_connections 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.961+0000 7f762c000640 1 --2- 172.21.15.84:0/3047081276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762411cc30 0x7f762411f140 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.961+0000 7f762c000640 1 --2- 172.21.15.84:0/3047081276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f762410a9e0 0x7f762410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.961+0000 7f762c000640 1 --2- 172.21.15.84:0/3047081276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7624111f40 0x7f762410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.961+0000 7f762c000640 1 -- 172.21.15.84:0/3047081276 >> 172.21.15.84:0/3047081276 conn(0x7f7624070ec0 msgr2=0x7f76240712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.962+0000 7f762c000640 1 -- 172.21.15.84:0/3047081276 shutdown_connections 2024-09-21T07:54:55.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.962+0000 7f762c000640 1 -- 172.21.15.84:0/3047081276 wait complete. 2024-09-21T07:54:55.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.964+0000 7f762c000640 1 Processor -- start 2024-09-21T07:54:55.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.965+0000 7f762c000640 1 -- start start 2024-09-21T07:54:55.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.967+0000 7f762c000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762410a9e0 0x7f762411a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:55.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.967+0000 7f762c000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7624111f40 0x7f76241136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:55.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.967+0000 7f762c000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f762411cc30 0x7f7624113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:55.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.967+0000 7f762c000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7624122930 con 0x7f7624111f40 2024-09-21T07:54:55.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.968+0000 7f762c000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76241227b0 con 0x7f762411cc30 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.968+0000 7f762c000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7624122ab0 con 0x7f762410a9e0 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.968+0000 7f762a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f762411cc30 0x7f7624113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.968+0000 7f762a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f762411cc30 0x7f7624113c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60416/0 (socket says 172.21.15.84:60416) 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.968+0000 7f762a000640 1 -- 172.21.15.84:0/3855210583 learned_addr learned my addr 172.21.15.84:0/3855210583 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.968+0000 7f7628c00640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7624111f40 0x7f76241136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.969+0000 7f762a000640 1 -- 172.21.15.84:0/3855210583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762410a9e0 msgr2=0x7f762411a3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.969+0000 7f762a000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762410a9e0 0x7f762411a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.969+0000 7f762a000640 1 -- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7624111f40 msgr2=0x7f76241136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.969+0000 7f762a000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7624111f40 0x7f76241136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.969+0000 7f762a000640 1 -- 172.21.15.84:0/3855210583 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7624114460 con 0x7f762411cc30 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.969+0000 7f7628c00640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7624111f40 0x7f76241136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.970+0000 7f762a000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f762411cc30 0x7f7624113c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f761c031aa0 tx=0x7f761c003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.970+0000 7f7622000640 1 -- 172.21.15.84:0/3855210583 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c003c90 con 0x7f762411cc30 2024-09-21T07:54:55.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.970+0000 7f7622000640 1 -- 172.21.15.84:0/3855210583 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f761c003e30 con 0x7f762411cc30 2024-09-21T07:54:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.971+0000 7f7622000640 1 -- 172.21.15.84:0/3855210583 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c02fcc0 con 0x7f762411cc30 2024-09-21T07:54:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.971+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76241190c0 con 0x7f762411cc30 2024-09-21T07:54:55.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.971+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76241195b0 con 0x7f762411cc30 2024-09-21T07:54:55.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.975+0000 7f7632c2c740 1 Processor -- start 2024-09-21T07:54:55.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.979+0000 7f7622000640 1 -- 172.21.15.84:0/3855210583 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f761c0305d0 con 0x7f762411cc30 2024-09-21T07:54:55.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.979+0000 7f7632c2c740 1 -- start start 2024-09-21T07:54:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.983+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 0x55d3f239ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.983+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f239b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.983+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f239b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.983+0000 7f7632c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d3f2311f70 con 0x55d3f1fd3390 2024-09-21T07:54:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.983+0000 7f7632c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d3f23013a0 con 0x55d3f1fcb1b0 2024-09-21T07:54:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.983+0000 7f7632c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d3f23051b0 con 0x55d3f1ff4070 2024-09-21T07:54:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.984+0000 7f7628c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f239b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.984+0000 7f7628c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f239b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48040/0 (socket says 172.21.15.84:48040) 2024-09-21T07:54:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.985+0000 7f7628c00640 1 -- 172.21.15.84:0/1379527655 learned_addr learned my addr 172.21.15.84:0/1379527655 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.986+0000 7f7629600640 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f239b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.986+0000 7f7628c00640 1 -- 172.21.15.84:0/1379527655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 msgr2=0x55d3f239ab60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:54:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.986+0000 7f7628c00640 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 0x55d3f239ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.986+0000 7f7628c00640 1 -- 172.21.15.84:0/1379527655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 msgr2=0x55d3f239b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:55.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.987+0000 7f7628c00640 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f239b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.988+0000 7f7628c00640 1 -- 172.21.15.84:0/1379527655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f22cbc90 con 0x55d3f1fd3390 2024-09-21T07:54:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.989+0000 7f7622000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f760c0b67b0 0x7f760c0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.990+0000 7f7622000640 1 -- 172.21.15.84:0/3855210583 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f761c109200 con 0x7f762411cc30 2024-09-21T07:54:55.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.990+0000 7f7629600640 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f239b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:54:55.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.991+0000 7f7628c00640 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f239b5e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7618008d80 tx=0x7f761800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6c89609faec81d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.992+0000 7f7629600640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f760c0b67b0 0x7f760c0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.992+0000 7f7616600640 1 -- 172.21.15.84:0/1379527655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618014070 con 0x55d3f1fd3390 2024-09-21T07:54:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.993+0000 7f7616600640 1 -- 172.21.15.84:0/1379527655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f761800ee30 con 0x55d3f1fd3390 2024-09-21T07:54:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.993+0000 7f7616600640 1 -- 172.21.15.84:0/1379527655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618010690 con 0x55d3f1fd3390 2024-09-21T07:54:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.995+0000 7f7629600640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f760c0b67b0 0x7f760c0b8cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55d3f23997e0 tx=0x7f7610008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.996+0000 7f7632c2c740 1 -- 172.21.15.84:0/1379527655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 msgr2=0x55d3f239b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.996+0000 7f7632c2c740 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f239b5e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7618008d80 tx=0x7f761800e720 comp rx=0 tx=0).stop 2024-09-21T07:54:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.997+0000 7f7632c2c740 1 -- 172.21.15.84:0/1379527655 shutdown_connections 2024-09-21T07:54:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.997+0000 7f7632c2c740 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f239b5e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.997+0000 7f7632c2c740 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f239b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.997+0000 7f7632c2c740 1 --2- 172.21.15.84:0/1379527655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 0x55d3f239ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.997+0000 7f7632c2c740 1 -- 172.21.15.84:0/1379527655 >> 172.21.15.84:0/1379527655 conn(0x55d3f1fe8460 msgr2=0x55d3f2398a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.998+0000 7f7632c2c740 1 -- 172.21.15.84:0/1379527655 shutdown_connections 2024-09-21T07:54:56.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:55.999+0000 7f7632c2c740 1 -- 172.21.15.84:0/1379527655 wait complete. 2024-09-21T07:54:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.000+0000 7f7632c2c740 1 -- start start 2024-09-21T07:54:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.000+0000 7f7632c2c740 1 Processor -- start 2024-09-21T07:54:56.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f23a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 0x55d3f23b2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7632c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d3f2162700 con 0x55d3f1fd3390 2024-09-21T07:54:56.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7632c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d3f229c540 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7632c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d3f23a9390 con 0x55d3f1ff4070 2024-09-21T07:54:56.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7632c2c740 10 client.0 _ll_register_callbacks cb 0x55d3f22ac430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:56.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7629600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7629600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23a67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60434/0 (socket says 172.21.15.84:60434) 2024-09-21T07:54:56.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.001+0000 7f7629600640 1 -- 172.21.15.84:0/4174700459 learned_addr learned my addr 172.21.15.84:0/4174700459 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:56.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.002+0000 7f762a000640 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 0x55d3f23b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.002+0000 7f7629600640 1 -- 172.21.15.84:0/4174700459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 msgr2=0x55d3f23b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.002+0000 7f7629600640 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 0x55d3f23b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.002+0000 7f7629600640 1 -- 172.21.15.84:0/4174700459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 msgr2=0x55d3f23a6d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.002+0000 7f7629600640 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f23a6d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.002+0000 7f7629600640 1 -- 172.21.15.84:0/4174700459 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f205f650 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.003+0000 7f7629600640 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23a67a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f761000ce00 tx=0x7f7610004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0c30a21e6941ced server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.003+0000 7f760aa00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.003+0000 7f760aa00640 1 -- 172.21.15.84:0/4174700459 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610023060 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.003+0000 7f760aa00640 1 -- 172.21.15.84:0/4174700459 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f761001e600 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.005+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3f229eb50 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.006+0000 7f760aa00640 1 -- 172.21.15.84:0/4174700459 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f761000ae60 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.006+0000 7f7632c2c740 10 client.26720 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:56.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.006+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d3f22b9910 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.007+0000 7f760aa00640 1 -- 172.21.15.84:0/4174700459 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d3f229eb50 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.008+0000 7f760aa00640 1 -- 172.21.15.84:0/4174700459 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7610013a20 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.008+0000 7f7632c2c740 10 client.26720 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.008+0000 7f7632c2c740 10 client.26720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.008+0000 7f7632c2c740 20 client.26720 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.008+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1fb29f0 0x55d3f23b8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.008+0000 7f7632c2c740 4 client.26720 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:54:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.008+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3f2313ec0 con 0x55d3f1fb29f0 2024-09-21T07:54:56.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.009+0000 7f7628c00640 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1fb29f0 0x55d3f23b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.010+0000 7f7628c00640 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1fb29f0 0x55d3f23b8730 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae9da7ac26623c05 server_cookie=968e5ff460444027 in_seq=0 out_seq=0 2024-09-21T07:54:56.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.010+0000 7f760aa00640 10 client.26720 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:56.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.012+0000 7f760aa00640 1 -- 172.21.15.84:0/4174700459 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3f2313ec0 con 0x55d3f1fb29f0 2024-09-21T07:54:56.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.012+0000 7f760aa00640 10 client.26720 handle_command_reply: tid=0 2024-09-21T07:54:56.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.012+0000 7f7632c2c740 1 client.26720 shutdown 2024-09-21T07:54:56.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 msgr2=0x55d3f23a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23a67a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f761000ce00 tx=0x7f7610004750 comp rx=0 tx=0).stop 2024-09-21T07:54:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 shutdown_connections 2024-09-21T07:54:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1fb29f0 0x55d3f23b8730 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1ff4070 0x55d3f23b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1fd3390 0x55d3f23a6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4174700459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23a67a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 >> 172.21.15.84:0/4174700459 conn(0x55d3f1fe8460 msgr2=0x55d3f239dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.013+0000 7f760aa00640 0 client.26720 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.014+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 shutdown_connections 2024-09-21T07:54:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.014+0000 7f7632c2c740 1 -- 172.21.15.84:0/4174700459 wait complete. 2024-09-21T07:54:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.017+0000 7f7632c2c740 20 client.26720 trim_cache size 0 max 16384 2024-09-21T07:54:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.084+0000 7f7632c2c740 1 Processor -- start 2024-09-21T07:54:56.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.087+0000 7f7632c2c740 1 -- start start 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.087+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.087+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fd3390 0x55d3f23b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.087+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 0x55d3f23a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.087+0000 7f7632c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76241c8430 con 0x55d3f1ff4070 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.087+0000 7f7632c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76241c9f70 con 0x55d3f1fd3390 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.087+0000 7f7632c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76241c8b00 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.088+0000 7f7629600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.088+0000 7f7629600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37070/0 (socket says 172.21.15.84:37070) 2024-09-21T07:54:56.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.088+0000 7f7628c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fd3390 0x55d3f23b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.088+0000 7f7629600640 1 -- 172.21.15.84:0/2515858633 learned_addr learned my addr 172.21.15.84:0/2515858633 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:56.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.089+0000 7f7629600640 1 -- 172.21.15.84:0/2515858633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fd3390 msgr2=0x55d3f23b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:56.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.089+0000 7f7629600640 1 --2- 172.21.15.84:0/2515858633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fd3390 0x55d3f23b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.089+0000 7f7629600640 1 -- 172.21.15.84:0/2515858633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 msgr2=0x55d3f23a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:56.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.089+0000 7f7629600640 1 --2- 172.21.15.84:0/2515858633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 0x55d3f23a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.089+0000 7f7629600640 1 -- 172.21.15.84:0/2515858633 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f23a8ce0 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.089+0000 7f7629600640 1 --2- 172.21.15.84:0/2515858633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23b2580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f761000c5c0 tx=0x7f76100275b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2aa20b8b3eea349 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:56.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.090+0000 7f7615c00640 1 -- 172.21.15.84:0/2515858633 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761002d080 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.090+0000 7f7615c00640 1 -- 172.21.15.84:0/2515858633 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7610027820 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.090+0000 7f7615c00640 1 -- 172.21.15.84:0/2515858633 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761000ae60 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.092+0000 7f7632c2c740 1 -- 172.21.15.84:0/2515858633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fcb1b0 msgr2=0x55d3f23b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:56.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.092+0000 7f7632c2c740 1 --2- 172.21.15.84:0/2515858633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23b2580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f761000c5c0 tx=0x7f76100275b0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.092+0000 7f7632c2c740 1 -- 172.21.15.84:0/2515858633 shutdown_connections 2024-09-21T07:54:56.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.092+0000 7f7632c2c740 1 --2- 172.21.15.84:0/2515858633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 0x55d3f23a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.092+0000 7f7632c2c740 1 --2- 172.21.15.84:0/2515858633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fd3390 0x55d3f23b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.092+0000 7f7632c2c740 1 --2- 172.21.15.84:0/2515858633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23b2580 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.092+0000 7f7632c2c740 1 -- 172.21.15.84:0/2515858633 >> 172.21.15.84:0/2515858633 conn(0x55d3f1fe8460 msgr2=0x55d3f23a16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.093+0000 7f7632c2c740 1 -- 172.21.15.84:0/2515858633 shutdown_connections 2024-09-21T07:54:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.093+0000 7f7632c2c740 1 -- 172.21.15.84:0/2515858633 wait complete. 2024-09-21T07:54:56.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.094+0000 7f7632c2c740 1 -- start start 2024-09-21T07:54:56.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.095+0000 7f7632c2c740 1 Processor -- start 2024-09-21T07:54:56.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.096+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.097+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fd3390 0x55d3f23aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.097+0000 7f7632c2c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 0x55d3f23ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.097+0000 7f7632c2c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76241c98a0 con 0x55d3f1ff4070 2024-09-21T07:54:56.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.098+0000 7f7632c2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76241c91d0 con 0x55d3f1fcb1b0 2024-09-21T07:54:56.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.098+0000 7f7628c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fd3390 0x55d3f23aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.098+0000 7f7632c2c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76241c63b0 con 0x55d3f1fd3390 2024-09-21T07:54:56.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.098+0000 7f7632c2c740 10 client.0 _ll_register_callbacks cb 0x7f761000cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:54:56.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.098+0000 7f7629600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.099+0000 7f7629600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60446/0 (socket says 172.21.15.84:60446) 2024-09-21T07:54:56.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.099+0000 7f7629600640 1 -- 172.21.15.84:0/4214865229 learned_addr learned my addr 172.21.15.84:0/4214865229 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:54:56.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.099+0000 7f762a000640 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 0x55d3f23ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.100+0000 7f7628c00640 1 -- 172.21.15.84:0/4214865229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 msgr2=0x55d3f23aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:56.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.100+0000 7f7628c00640 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.104+0000 7f7628c00640 1 -- 172.21.15.84:0/4214865229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 msgr2=0x55d3f23ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:54:56.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.104+0000 7f7628c00640 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 0x55d3f23ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.104+0000 7f7628c00640 1 -- 172.21.15.84:0/4214865229 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f24221a0 con 0x55d3f1fd3390 2024-09-21T07:54:56.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.107+0000 7f7628c00640 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fd3390 0x55d3f23aabf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d3f23b8e60 tx=0x7f7618004d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7b9df7b9919856f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:54:56.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.107+0000 7f760aa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:54:56.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.108+0000 7f760aa00640 1 -- 172.21.15.84:0/4214865229 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618014070 con 0x55d3f1fd3390 2024-09-21T07:54:56.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.108+0000 7f760aa00640 1 -- 172.21.15.84:0/4214865229 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7618004880 con 0x55d3f1fd3390 2024-09-21T07:54:56.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.108+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7610027820 con 0x55d3f1fd3390 2024-09-21T07:54:56.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.112+0000 7f760aa00640 1 -- 172.21.15.84:0/4214865229 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7618004030 con 0x55d3f1fd3390 2024-09-21T07:54:56.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.112+0000 7f7632c2c740 10 client.26749 fetch_fsmap learned FSMap version 29 2024-09-21T07:54:56.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.112+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d3f2423430 con 0x55d3f1fd3390 2024-09-21T07:54:56.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f760aa00640 1 -- 172.21.15.84:0/4214865229 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7610027820 con 0x55d3f1fd3390 2024-09-21T07:54:56.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f760aa00640 1 -- 172.21.15.84:0/4214865229 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f76180035f0 con 0x55d3f1fd3390 2024-09-21T07:54:56.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f7632c2c740 10 client.26749 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:54:56.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f7632c2c740 10 client.26749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:54:56.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f7632c2c740 20 client.26749 populate_metadata read hostname 'smithi084' 2024-09-21T07:54:56.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1f87da0 0x55d3f24259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:54:56.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f7632c2c740 4 client.26749 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:54:56.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.116+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d3f230f970 con 0x55d3f1f87da0 2024-09-21T07:54:56.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.118+0000 7f7629600640 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1f87da0 0x55d3f24259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:54:56.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.120+0000 7f7629600640 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1f87da0 0x55d3f24259c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dd46bc4528e1b25 server_cookie=1334cc0e11ae7b66 in_seq=0 out_seq=0 2024-09-21T07:54:56.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.124+0000 7f760aa00640 10 client.26749 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:56.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.124+0000 7f760aa00640 1 -- 172.21.15.84:0/4214865229 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55d3f230f970 con 0x55d3f1f87da0 2024-09-21T07:54:56.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.124+0000 7f760aa00640 10 client.26749 handle_command_reply: tid=0 2024-09-21T07:54:56.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.124+0000 7f7632c2c740 1 client.26749 shutdown 2024-09-21T07:54:56.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.124+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fd3390 msgr2=0x55d3f23aabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:56.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.124+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fd3390 0x55d3f23aabf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d3f23b8e60 tx=0x7f7618004d40 comp rx=0 tx=0).stop 2024-09-21T07:54:56.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.125+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 shutdown_connections 2024-09-21T07:54:56.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.125+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3f1ff4070 0x55d3f23ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.125+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d3f1f87da0 0x55d3f24259c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.125+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d3f1fd3390 0x55d3f23aabf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.125+0000 7f7632c2c740 1 --2- 172.21.15.84:0/4214865229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3f1fcb1b0 0x55d3f23aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.125+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 >> 172.21.15.84:0/4214865229 conn(0x55d3f1fe8460 msgr2=0x55d3f239bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:56.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.125+0000 7f760aa00640 0 client.26749 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:54:56.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.131+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 shutdown_connections 2024-09-21T07:54:56.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.131+0000 7f7632c2c740 1 -- 172.21.15.84:0/4214865229 wait complete. 2024-09-21T07:54:56.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.131+0000 7f7632c2c740 20 client.26749 trim_cache size 0 max 16384 2024-09-21T07:54:56.135 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:54:56.135 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:54:56.135 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:54:56.135 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:54:56.135 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T07:54:56.135 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T07:54:56.135 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:56.136 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:56.137 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:54:56.138 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:54:56.139 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:54:56.139 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:54:56.139 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:54:56.139 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:54:56.139 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:56.139 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:54:56.139 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:54:56.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.135+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f760c0b67b0 msgr2=0x7f760c0b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.135+0000 7f762c000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f760c0b67b0 0x7f760c0b8cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55d3f23997e0 tx=0x7f7610008040 comp rx=0 tx=0).stop 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.135+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f762411cc30 msgr2=0x7f7624113c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.135+0000 7f762c000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f762411cc30 0x7f7624113c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f761c031aa0 tx=0x7f761c003970 comp rx=0 tx=0).stop 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.136+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 shutdown_connections 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.136+0000 7f762c000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f760c0b67b0 0x7f760c0b8cc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.136+0000 7f762c000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f762411cc30 0x7f7624113c40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.136+0000 7f762c000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7624111f40 0x7f76241136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.136+0000 7f762c000640 1 --2- 172.21.15.84:0/3855210583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762410a9e0 0x7f762411a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.136+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 >> 172.21.15.84:0/3855210583 conn(0x7f7624070ec0 msgr2=0x7f762411e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.138+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 shutdown_connections 2024-09-21T07:54:56.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:54:56.138+0000 7f762c000640 1 -- 172.21.15.84:0/3855210583 wait complete. 2024-09-21T07:54:57.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:57 smithi162 ceph-mon[34833]: pgmap v509: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 222 MiB/s wr, 1.48k op/s 2024-09-21T07:54:57.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:57 smithi084 ceph-mon[30411]: pgmap v509: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 222 MiB/s wr, 1.48k op/s 2024-09-21T07:54:57.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:57 smithi191 ceph-mon[34667]: pgmap v509: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 222 MiB/s wr, 1.48k op/s 2024-09-21T07:54:58.076 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:54:58.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:54:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:54:59.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:54:59 smithi084 ceph-mon[30411]: pgmap v510: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 237 MiB/s wr, 1.65k op/s 2024-09-21T07:54:59.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:54:59 smithi191 ceph-mon[34667]: pgmap v510: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 237 MiB/s wr, 1.65k op/s 2024-09-21T07:54:59.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:54:59 smithi162 ceph-mon[34833]: pgmap v510: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 237 MiB/s wr, 1.65k op/s 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 -- 172.21.15.84:0/1604683252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 msgr2=0x7f22100a2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 --2- 172.21.15.84:0/1604683252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f22100a2bc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2204009900 tx=0x7f220402a420 comp rx=0 tx=0).stop 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 -- 172.21.15.84:0/1604683252 shutdown_connections 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 --2- 172.21.15.84:0/1604683252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f22100a2bc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 --2- 172.21.15.84:0/1604683252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221009ba40 0x7f221009be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 --2- 172.21.15.84:0/1604683252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2210096100 0x7f2210096510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 -- 172.21.15.84:0/1604683252 >> 172.21.15.84:0/1604683252 conn(0x7f2210091b50 msgr2=0x7f2210093fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.672+0000 7f221d600640 1 -- 172.21.15.84:0/1604683252 shutdown_connections 2024-09-21T07:55:00.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.673+0000 7f221d600640 1 -- 172.21.15.84:0/1604683252 wait complete. 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.674+0000 7f221d600640 1 Processor -- start 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.674+0000 7f221d600640 1 -- start start 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.675+0000 7f221d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2210096100 0x7f221013b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.675+0000 7f221d600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221009ba40 0x7f221013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.675+0000 7f221d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f2210140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.675+0000 7f221d600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22100b4ea0 con 0x7f2210096100 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.675+0000 7f221d600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22100b4d20 con 0x7f221009c390 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.675+0000 7f221d600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22100b5020 con 0x7f221009ba40 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.676+0000 7f2216000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221009ba40 0x7f221013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.676+0000 7f2217400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f2210140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:00.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.676+0000 7f2217400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f2210140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39942/0 (socket says 172.21.15.84:39942) 2024-09-21T07:55:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.676+0000 7f2217400640 1 -- 172.21.15.84:0/2394018565 learned_addr learned my addr 172.21.15.84:0/2394018565 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.676+0000 7f2216a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2210096100 0x7f221013b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.677+0000 7f2217400640 1 -- 172.21.15.84:0/2394018565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221009ba40 msgr2=0x7f221013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.677+0000 7f2217400640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221009ba40 0x7f221013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.677+0000 7f2217400640 1 -- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2210096100 msgr2=0x7f221013b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.677+0000 7f2217400640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2210096100 0x7f221013b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.677+0000 7f2217400640 1 -- 172.21.15.84:0/2394018565 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22101415f0 con 0x7f221009c390 2024-09-21T07:55:00.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.679+0000 7f2217400640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f2210140ec0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2204005ab0 tx=0x7f2204030640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:00.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.682+0000 7f220f400640 1 -- 172.21.15.84:0/2394018565 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220403f070 con 0x7f221009c390 2024-09-21T07:55:00.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.683+0000 7f220f400640 1 -- 172.21.15.84:0/2394018565 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2204004440 con 0x7f221009c390 2024-09-21T07:55:00.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.683+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2210141880 con 0x7f221009c390 2024-09-21T07:55:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.683+0000 7f220f400640 1 -- 172.21.15.84:0/2394018565 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204035070 con 0x7f221009c390 2024-09-21T07:55:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.683+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2210148040 con 0x7f221009c390 2024-09-21T07:55:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.689+0000 7f220f400640 1 -- 172.21.15.84:0/2394018565 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2204042070 con 0x7f221009c390 2024-09-21T07:55:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.690+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2210097380 con 0x7f221009c390 2024-09-21T07:55:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.691+0000 7f220f400640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21fc0b6730 0x7f21fc0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.695+0000 7f2216a00640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21fc0b6730 0x7f21fc0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.695+0000 7f220f400640 1 -- 172.21.15.84:0/2394018565 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2204030d80 con 0x7f221009c390 2024-09-21T07:55:00.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.697+0000 7f2216a00640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21fc0b6730 0x7f21fc0b8c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2218069050 tx=0x7f221806e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:00.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:00.701+0000 7f220f400640 1 -- 172.21.15.84:0/2394018565 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22040ce990 con 0x7f221009c390 2024-09-21T07:55:01.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.216+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2210002340 con 0x7f221009c390 2024-09-21T07:55:01.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.217+0000 7f220f400640 1 -- 172.21.15.84:0/2394018565 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f22040d2d70 con 0x7f221009c390 2024-09-21T07:55:01.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:55:01.219 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:55:01.220 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:55:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.220+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21fc0b6730 msgr2=0x7f21fc0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21fc0b6730 0x7f21fc0b8c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2218069050 tx=0x7f221806e040 comp rx=0 tx=0).stop 2024-09-21T07:55:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 msgr2=0x7f2210140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f2210140ec0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2204005ab0 tx=0x7f2204030640 comp rx=0 tx=0).stop 2024-09-21T07:55:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 shutdown_connections 2024-09-21T07:55:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21fc0b6730 0x7f21fc0b8c40 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2218069050 tx=0x7f221806e040 comp rx=0 tx=0).stop 2024-09-21T07:55:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221009c390 0x7f2210140ec0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221009ba40 0x7f221013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 --2- 172.21.15.84:0/2394018565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2210096100 0x7f221013b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 >> 172.21.15.84:0/2394018565 conn(0x7f2210091b50 msgr2=0x7f221009af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.221+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 shutdown_connections 2024-09-21T07:55:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:01.222+0000 7f221d600640 1 -- 172.21.15.84:0/2394018565 wait complete. 2024-09-21T07:55:01.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:01 smithi084 ceph-mon[30411]: pgmap v511: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 241 MiB/s wr, 1.64k op/s 2024-09-21T07:55:01.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:01 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2394018565' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:55:01.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:01 smithi191 ceph-mon[34667]: pgmap v511: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 241 MiB/s wr, 1.64k op/s 2024-09-21T07:55:01.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:01 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2394018565' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:55:01.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:01 smithi162 ceph-mon[34833]: pgmap v511: 129 pgs: 129 active+clean; 23 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 241 MiB/s wr, 1.64k op/s 2024-09-21T07:55:01.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:01 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2394018565' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:55:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.536+0000 7fe346a00640 1 -- 172.21.15.84:0/3304306582 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330004cf0 con 0x7fe34810ca40 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.536+0000 7fe34dc00640 1 -- 172.21.15.84:0/3304306582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 msgr2=0x7fe34810ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.536+0000 7fe34dc00640 1 --2- 172.21.15.84:0/3304306582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 0x7fe34810ce50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe3300074e0 tx=0x7fe33002b080 comp rx=0 tx=0).stop 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.537+0000 7fe34dc00640 1 -- 172.21.15.84:0/3304306582 shutdown_connections 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.537+0000 7fe34dc00640 1 --2- 172.21.15.84:0/3304306582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe34810d390 0x7fe348116e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.537+0000 7fe34dc00640 1 --2- 172.21.15.84:0/3304306582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 0x7fe34810ce50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.537+0000 7fe34dc00640 1 --2- 172.21.15.84:0/3304306582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe34810a660 0x7fe34810aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.537+0000 7fe34dc00640 1 -- 172.21.15.84:0/3304306582 >> 172.21.15.84:0/3304306582 conn(0x7fe348070c00 msgr2=0x7fe348071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.537+0000 7fe34dc00640 1 -- 172.21.15.84:0/3304306582 shutdown_connections 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.537+0000 7fe34dc00640 1 -- 172.21.15.84:0/3304306582 wait complete. 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.538+0000 7fe34dc00640 1 Processor -- start 2024-09-21T07:55:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.539+0000 7fe34dc00640 1 -- start start 2024-09-21T07:55:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.540+0000 7fe34dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe34810a660 0x7fe3481a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.541+0000 7fe34dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 0x7fe3481a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.542+0000 7fe34dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe34810d390 0x7fe3481a8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.543+0000 7fe34d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe34810d390 0x7fe3481a8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.543+0000 7fe347400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 0x7fe3481a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.544+0000 7fe347400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 0x7fe3481a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39962/0 (socket says 172.21.15.84:39962) 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.544+0000 7fe34dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe34811c0d0 con 0x7fe34810d390 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.544+0000 7fe34dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe34811bf50 con 0x7fe34810ca40 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.544+0000 7fe34dc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe34811c250 con 0x7fe34810a660 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.544+0000 7fe34d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe34810d390 0x7fe3481a8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49964/0 (socket says 172.21.15.84:49964) 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.544+0000 7fe34d200640 1 -- 172.21.15.84:0/4272734508 learned_addr learned my addr 172.21.15.84:0/4272734508 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.544+0000 7fe347e00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe34810a660 0x7fe3481a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.545+0000 7fe347e00640 1 -- 172.21.15.84:0/4272734508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 msgr2=0x7fe3481a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.545+0000 7fe347e00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 0x7fe3481a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.545+0000 7fe347e00640 1 -- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe34810d390 msgr2=0x7fe3481a8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.545+0000 7fe347e00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe34810d390 0x7fe3481a8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.545+0000 7fe347e00640 1 -- 172.21.15.84:0/4272734508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3481a8b40 con 0x7fe34810a660 2024-09-21T07:55:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.546+0000 7fe347e00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe34810a660 0x7fe3481a15a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe33800e9f0 tx=0x7fe33800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.546+0000 7fe344c00640 1 -- 172.21.15.84:0/4272734508 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33800ccc0 con 0x7fe34810a660 2024-09-21T07:55:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.546+0000 7fe344c00640 1 -- 172.21.15.84:0/4272734508 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3380108e0 con 0x7fe34810a660 2024-09-21T07:55:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.547+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3481a8e30 con 0x7fe34810a660 2024-09-21T07:55:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.547+0000 7fe344c00640 1 -- 172.21.15.84:0/4272734508 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338018880 con 0x7fe34810a660 2024-09-21T07:55:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.547+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3481a93d0 con 0x7fe34810a660 2024-09-21T07:55:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.554+0000 7fe344c00640 1 -- 172.21.15.84:0/4272734508 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe338018a20 con 0x7fe34810a660 2024-09-21T07:55:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.556+0000 7fe3561ea740 1 Processor -- start 2024-09-21T07:55:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.556+0000 7fe3561ea740 1 -- start start 2024-09-21T07:55:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.557+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202c1a1b0 0x55c202fbee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.557+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf12f0 0x55c202fbf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.557+0000 7fe344c00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe32c0b6700 0x7fe32c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202bf94d0 0x55c202fbf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe3561ea740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c202f346b0 con 0x55c202c1a1b0 2024-09-21T07:55:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe3561ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c202f23ae0 con 0x55c202bf12f0 2024-09-21T07:55:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe3561ea740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c202f278f0 con 0x55c202bf94d0 2024-09-21T07:55:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe344c00640 1 -- 172.21.15.84:0/4272734508 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe3380e7e60 con 0x7fe34810a660 2024-09-21T07:55:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe347e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf12f0 0x55c202fbf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe347e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf12f0 0x55c202fbf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39964/0 (socket says 172.21.15.84:39964) 2024-09-21T07:55:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.558+0000 7fe347e00640 1 -- 172.21.15.84:0/3634386823 learned_addr learned my addr 172.21.15.84:0/3634386823 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.559+0000 7fe347e00640 1 -- 172.21.15.84:0/3634386823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202bf94d0 msgr2=0x55c202fbf890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.559+0000 7fe347e00640 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202bf94d0 0x55c202fbf890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.559+0000 7fe347e00640 1 -- 172.21.15.84:0/3634386823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202c1a1b0 msgr2=0x55c202fbee10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.560+0000 7fe34d200640 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202c1a1b0 0x55c202fbee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.560+0000 7fe347e00640 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202c1a1b0 0x55c202fbee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.560+0000 7fe347e00640 1 -- 172.21.15.84:0/3634386823 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c202ef0780 con 0x55c202bf12f0 2024-09-21T07:55:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.560+0000 7fe347e00640 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf12f0 0x55c202fbf350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe3380adda0 tx=0x7fe3380add10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38cb777988f4732d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.560+0000 7fe33d600640 1 -- 172.21.15.84:0/3634386823 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380b7830 con 0x55c202bf12f0 2024-09-21T07:55:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.561+0000 7fe33d600640 1 -- 172.21.15.84:0/3634386823 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3380aa080 con 0x55c202bf12f0 2024-09-21T07:55:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.561+0000 7fe33d600640 1 -- 172.21.15.84:0/3634386823 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380ad2d0 con 0x55c202bf12f0 2024-09-21T07:55:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe3561ea740 1 -- 172.21.15.84:0/3634386823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf12f0 msgr2=0x55c202fbf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe3561ea740 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf12f0 0x55c202fbf350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe3380adda0 tx=0x7fe3380add10 comp rx=0 tx=0).stop 2024-09-21T07:55:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe347400640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe32c0b6700 0x7fe32c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe3561ea740 1 -- 172.21.15.84:0/3634386823 shutdown_connections 2024-09-21T07:55:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe3561ea740 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202bf94d0 0x55c202fbf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe3561ea740 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf12f0 0x55c202fbf350 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe3561ea740 1 --2- 172.21.15.84:0/3634386823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202c1a1b0 0x55c202fbee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.562+0000 7fe3561ea740 1 -- 172.21.15.84:0/3634386823 >> 172.21.15.84:0/3634386823 conn(0x55c202c0e300 msgr2=0x55c202fbcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.564+0000 7fe3561ea740 1 -- 172.21.15.84:0/3634386823 shutdown_connections 2024-09-21T07:55:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.564+0000 7fe3561ea740 1 -- 172.21.15.84:0/3634386823 wait complete. 2024-09-21T07:55:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.565+0000 7fe3561ea740 1 -- start start 2024-09-21T07:55:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.568+0000 7fe3561ea740 1 Processor -- start 2024-09-21T07:55:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.569+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf12f0 0x55c202fca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.569+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fcaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.569+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fd6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.569+0000 7fe3561ea740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c202e5bab0 con 0x55c202bf12f0 2024-09-21T07:55:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.569+0000 7fe3561ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c202eca570 con 0x55c202bf94d0 2024-09-21T07:55:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.569+0000 7fe3561ea740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c202fcd530 con 0x55c202c1a1b0 2024-09-21T07:55:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.569+0000 7fe3561ea740 10 client.0 _ll_register_callbacks cb 0x55c202ed9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.570+0000 7fe347400640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe32c0b6700 0x7fe32c0b8c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe33002b670 tx=0x7fe33002d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.570+0000 7fe347400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fcaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.570+0000 7fe347400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fcaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39970/0 (socket says 172.21.15.84:39970) 2024-09-21T07:55:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.570+0000 7fe347400640 1 -- 172.21.15.84:0/1805317069 learned_addr learned my addr 172.21.15.84:0/1805317069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.573+0000 7fe34d200640 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fd6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.573+0000 7fe347e00640 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf12f0 0x55c202fca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.574+0000 7fe347e00640 1 -- 172.21.15.84:0/1805317069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 msgr2=0x55c202fd6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.574+0000 7fe347e00640 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fd6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.574+0000 7fe347e00640 1 -- 172.21.15.84:0/1805317069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 msgr2=0x55c202fcaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.574+0000 7fe347e00640 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fcaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.574+0000 7fe347e00640 1 -- 172.21.15.84:0/1805317069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c202c85790 con 0x55c202bf12f0 2024-09-21T07:55:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.576+0000 7fe347e00640 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf12f0 0x55c202fca520 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe3380aa3e0 tx=0x7fe338010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62023570f5fdb0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.576+0000 7fe336000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:55:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.577+0000 7fe336000640 1 -- 172.21.15.84:0/1805317069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380b7830 con 0x55c202bf12f0 2024-09-21T07:55:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.577+0000 7fe336000640 1 -- 172.21.15.84:0/1805317069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe338010430 con 0x55c202bf12f0 2024-09-21T07:55:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.578+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3380aa080 con 0x55c202bf12f0 2024-09-21T07:55:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.578+0000 7fe336000640 1 -- 172.21.15.84:0/1805317069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe338010630 con 0x55c202bf12f0 2024-09-21T07:55:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.580+0000 7fe3561ea740 10 client.16656 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.580+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c202cfe620 con 0x55c202bf12f0 2024-09-21T07:55:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.581+0000 7fe336000640 1 -- 172.21.15.84:0/1805317069 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3380aa080 con 0x55c202bf12f0 2024-09-21T07:55:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.582+0000 7fe336000640 1 -- 172.21.15.84:0/1805317069 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe3380a9760 con 0x55c202bf12f0 2024-09-21T07:55:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.583+0000 7fe3561ea740 10 client.16656 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.583+0000 7fe3561ea740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.583+0000 7fe3561ea740 20 client.16656 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.583+0000 7fe3561ea740 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c202bd8d80 0x55c202fdc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.583+0000 7fe3561ea740 4 client.16656 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.583+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c202f36600 con 0x55c202bd8d80 2024-09-21T07:55:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.583+0000 7fe347400640 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c202bd8d80 0x55c202fdc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.585+0000 7fe347400640 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c202bd8d80 0x55c202fdc430 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7699a0fee5ccc89c server_cookie=1dbb5ebff9a603a6 in_seq=0 out_seq=0 2024-09-21T07:55:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.585+0000 7fe336000640 10 client.16656 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:02.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.587+0000 7fe336000640 1 -- 172.21.15.84:0/1805317069 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c202f36600 con 0x55c202bd8d80 2024-09-21T07:55:02.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.587+0000 7fe336000640 10 client.16656 handle_command_reply: tid=0 2024-09-21T07:55:02.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.587+0000 7fe3561ea740 1 client.16656 shutdown 2024-09-21T07:55:02.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf12f0 msgr2=0x55c202fca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf12f0 0x55c202fca520 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe3380aa3e0 tx=0x7fe338010cc0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 shutdown_connections 2024-09-21T07:55:02.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c202bd8d80 0x55c202fdc430 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fd6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fcaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 --2- 172.21.15.84:0/1805317069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf12f0 0x55c202fca520 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 >> 172.21.15.84:0/1805317069 conn(0x55c202c0e300 msgr2=0x55c202fbfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.590+0000 7fe336000640 0 client.16656 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.591+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 shutdown_connections 2024-09-21T07:55:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.591+0000 7fe3561ea740 1 -- 172.21.15.84:0/1805317069 wait complete. 2024-09-21T07:55:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.591+0000 7fe3561ea740 20 client.16656 trim_cache size 0 max 16384 2024-09-21T07:55:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.625+0000 7fe3561ea740 1 Processor -- start 2024-09-21T07:55:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe3561ea740 1 -- start start 2024-09-21T07:55:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fc5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fcc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bae1c0 0x55c202fd6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe3561ea740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481c8250 con 0x55c202bae1c0 2024-09-21T07:55:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe3561ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481c9d90 con 0x55c202bf94d0 2024-09-21T07:55:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe3561ea740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481c8920 con 0x55c202c1a1b0 2024-09-21T07:55:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.626+0000 7fe347400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fcc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fc5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fc5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39978/0 (socket says 172.21.15.84:39978) 2024-09-21T07:55:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 -- 172.21.15.84:0/2688345026 learned_addr learned my addr 172.21.15.84:0/2688345026 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe34d200640 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bae1c0 0x55c202fd6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 -- 172.21.15.84:0/2688345026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 msgr2=0x55c202fcc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fcc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 -- 172.21.15.84:0/2688345026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bae1c0 msgr2=0x55c202fd6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bae1c0 0x55c202fd6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 -- 172.21.15.84:0/2688345026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c202fc49a0 con 0x55c202bf94d0 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347400640 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fcc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.627+0000 7fe347e00640 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fc5c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe3380acb30 tx=0x7fe33800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d656b25e526d162 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.628+0000 7fe33cc00640 1 -- 172.21.15.84:0/2688345026 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380b7830 con 0x55c202bf94d0 2024-09-21T07:55:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.628+0000 7fe33cc00640 1 -- 172.21.15.84:0/2688345026 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3380d5310 con 0x55c202bf94d0 2024-09-21T07:55:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.628+0000 7fe33cc00640 1 -- 172.21.15.84:0/2688345026 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380b3a80 con 0x55c202bf94d0 2024-09-21T07:55:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 -- 172.21.15.84:0/2688345026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 msgr2=0x55c202fc5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fc5c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe3380acb30 tx=0x7fe33800cef0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 -- 172.21.15.84:0/2688345026 shutdown_connections 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bae1c0 0x55c202fd6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c202fcc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 --2- 172.21.15.84:0/2688345026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bf94d0 0x55c202fc5c90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 -- 172.21.15.84:0/2688345026 >> 172.21.15.84:0/2688345026 conn(0x55c202c0e300 msgr2=0x55c202fcba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 -- 172.21.15.84:0/2688345026 shutdown_connections 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.630+0000 7fe3561ea740 1 -- 172.21.15.84:0/2688345026 wait complete. 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.631+0000 7fe3561ea740 1 -- start start 2024-09-21T07:55:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.631+0000 7fe3561ea740 1 Processor -- start 2024-09-21T07:55:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.633+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bae1c0 0x55c202fdcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.633+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf94d0 0x55c202fdd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.633+0000 7fe3561ea740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c20303dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.633+0000 7fe3561ea740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481c96c0 con 0x55c202bf94d0 2024-09-21T07:55:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.633+0000 7fe3561ea740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481c8ff0 con 0x55c202bae1c0 2024-09-21T07:55:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.633+0000 7fe3561ea740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481c6210 con 0x55c202c1a1b0 2024-09-21T07:55:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.633+0000 7fe3561ea740 10 client.0 _ll_register_callbacks cb 0x7fe3380ad580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe34d200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c20303dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bae1c0 0x55c202fdcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bae1c0 0x55c202fdcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:39994/0 (socket says 172.21.15.84:39994) 2024-09-21T07:55:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 -- 172.21.15.84:0/446816511 learned_addr learned my addr 172.21.15.84:0/446816511 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe34d200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c20303dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52816/0 (socket says 172.21.15.84:52816) 2024-09-21T07:55:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347400640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf94d0 0x55c202fdd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 -- 172.21.15.84:0/446816511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 msgr2=0x55c20303dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c20303dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 -- 172.21.15.84:0/446816511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf94d0 msgr2=0x55c202fdd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf94d0 0x55c202fdd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe347e00640 1 -- 172.21.15.84:0/446816511 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c20303e270 con 0x55c202bae1c0 2024-09-21T07:55:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.634+0000 7fe34d200640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c20303dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.635+0000 7fe347400640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf94d0 0x55c202fdd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.635+0000 7fe347e00640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bae1c0 0x55c202fdcf90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3380aa3e0 tx=0x7fe338009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdef71406e2f59c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.635+0000 7fe336000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.635+0000 7fe336000640 1 -- 172.21.15.84:0/446816511 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380aa1f0 con 0x55c202bae1c0 2024-09-21T07:55:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.635+0000 7fe336000640 1 -- 172.21.15.84:0/446816511 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe3380b3c90 con 0x55c202bae1c0 2024-09-21T07:55:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.636+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3380d5310 con 0x55c202bae1c0 2024-09-21T07:55:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.636+0000 7fe336000640 1 -- 172.21.15.84:0/446816511 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe3380b7830 con 0x55c202bae1c0 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.636+0000 7fe3561ea740 10 client.26750 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.636+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c20303e270 con 0x55c202bae1c0 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe336000640 1 -- 172.21.15.84:0/446816511 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3380d5310 con 0x55c202bae1c0 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe336000640 1 -- 172.21.15.84:0/446816511 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe3380b22e0 con 0x55c202bae1c0 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe3561ea740 10 client.26750 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe3561ea740 10 client.26750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe3561ea740 20 client.26750 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe3561ea740 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c203046970 0x55c203048d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe3561ea740 4 client.26750 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.637+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c202f320b0 con 0x55c203046970 2024-09-21T07:55:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.638+0000 7fe347400640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c203046970 0x55c203048d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.638+0000 7fe347400640 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c203046970 0x55c203048d90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29503a37feffc10 server_cookie=d98f583dbd9aab93 in_seq=0 out_seq=0 2024-09-21T07:55:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.638+0000 7fe336000640 10 client.26750 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:02.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.671+0000 7fe336000640 1 -- 172.21.15.84:0/446816511 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c202f320b0 con 0x55c203046970 2024-09-21T07:55:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.671+0000 7fe336000640 10 client.26750 handle_command_reply: tid=0 2024-09-21T07:55:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.671+0000 7fe3561ea740 1 client.26750 shutdown 2024-09-21T07:55:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bae1c0 msgr2=0x55c202fdcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bae1c0 0x55c202fdcf90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3380aa3e0 tx=0x7fe338009700 comp rx=0 tx=0).stop 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 shutdown_connections 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c203046970 0x55c203048d90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c202c1a1b0 0x55c20303dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c202bf94d0 0x55c202fdd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 --2- 172.21.15.84:0/446816511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c202bae1c0 0x55c202fdcf90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 >> 172.21.15.84:0/446816511 conn(0x55c202c0e300 msgr2=0x55c202fcb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe336000640 0 client.26750 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 shutdown_connections 2024-09-21T07:55:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.672+0000 7fe3561ea740 1 -- 172.21.15.84:0/446816511 wait complete. 2024-09-21T07:55:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.675+0000 7fe3561ea740 20 client.26750 trim_cache size 0 max 16384 2024-09-21T07:55:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:55:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:55:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:55:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:55:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.678+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe32c0b6700 msgr2=0x7fe32c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.678+0000 7fe34dc00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe32c0b6700 0x7fe32c0b8c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe33002b670 tx=0x7fe33002d040 comp rx=0 tx=0).stop 2024-09-21T07:55:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.678+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe34810a660 msgr2=0x7fe3481a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.678+0000 7fe34dc00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe34810a660 0x7fe3481a15a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe33800e9f0 tx=0x7fe33800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.679+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 shutdown_connections 2024-09-21T07:55:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.679+0000 7fe34dc00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe32c0b6700 0x7fe32c0b8c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.679+0000 7fe34dc00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe34810d390 0x7fe3481a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.679+0000 7fe34dc00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe34810ca40 0x7fe3481a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.679+0000 7fe34dc00640 1 --2- 172.21.15.84:0/4272734508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe34810a660 0x7fe3481a15a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.679+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 >> 172.21.15.84:0/4272734508 conn(0x7fe348070c00 msgr2=0x7fe34810db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.680+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 shutdown_connections 2024-09-21T07:55:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:02.680+0000 7fe34dc00640 1 -- 172.21.15.84:0/4272734508 wait complete. 2024-09-21T07:55:03.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:03 smithi191 ceph-mon[34667]: pgmap v512: 129 pgs: 129 active+clean; 24 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 210 MiB/s wr, 1.41k op/s 2024-09-21T07:55:03.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:03 smithi162 ceph-mon[34833]: pgmap v512: 129 pgs: 129 active+clean; 24 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 210 MiB/s wr, 1.41k op/s 2024-09-21T07:55:03.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:03 smithi084 ceph-mon[30411]: pgmap v512: 129 pgs: 129 active+clean; 24 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 210 MiB/s wr, 1.41k op/s 2024-09-21T07:55:04.204 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:55:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:05.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:05 smithi084 ceph-mon[30411]: pgmap v513: 129 pgs: 129 active+clean; 24 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 35 KiB/s rd, 246 MiB/s wr, 1.47k op/s 2024-09-21T07:55:05.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:05 smithi191 ceph-mon[34667]: pgmap v513: 129 pgs: 129 active+clean; 24 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 35 KiB/s rd, 246 MiB/s wr, 1.47k op/s 2024-09-21T07:55:05.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:05 smithi162 ceph-mon[34833]: pgmap v513: 129 pgs: 129 active+clean; 24 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 35 KiB/s rd, 246 MiB/s wr, 1.47k op/s 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.782+0000 7fe89ee00640 1 -- 172.21.15.84:0/1360827781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe898111cd0 msgr2=0x7fe89810d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.782+0000 7fe89ee00640 1 --2- 172.21.15.84:0/1360827781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe898111cd0 0x7fe89810d6b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009900 tx=0x7fe88c02a440 comp rx=0 tx=0).stop 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.783+0000 7fe89ee00640 1 -- 172.21.15.84:0/1360827781 shutdown_connections 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.783+0000 7fe89ee00640 1 --2- 172.21.15.84:0/1360827781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe89811cba0 0x7fe89811efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.783+0000 7fe89ee00640 1 --2- 172.21.15.84:0/1360827781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe89810dbf0 0x7fe89810e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.783+0000 7fe89ee00640 1 --2- 172.21.15.84:0/1360827781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe898111cd0 0x7fe89810d6b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.783+0000 7fe89ee00640 1 -- 172.21.15.84:0/1360827781 >> 172.21.15.84:0/1360827781 conn(0x7fe89806e9f0 msgr2=0x7fe89806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.783+0000 7fe89ee00640 1 -- 172.21.15.84:0/1360827781 shutdown_connections 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.784+0000 7fe89ee00640 1 -- 172.21.15.84:0/1360827781 wait complete. 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.787+0000 7fe89ee00640 1 Processor -- start 2024-09-21T07:55:07.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.787+0000 7fe89ee00640 1 -- start start 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.787+0000 7fe89ee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89810dbf0 0x7fe8981a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.787+0000 7fe89ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe898111cd0 0x7fe8981a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.787+0000 7fe89ee00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe89811cba0 0x7fe8981aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.787+0000 7fe89ee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981227b0 con 0x7fe89810dbf0 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.788+0000 7fe89ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe898122630 con 0x7fe898111cd0 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.788+0000 7fe89ee00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe898122930 con 0x7fe89811cba0 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.788+0000 7fe89da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89810dbf0 0x7fe8981a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.788+0000 7fe89e400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe89811cba0 0x7fe8981aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.788+0000 7fe89e400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe89811cba0 0x7fe8981aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52832/0 (socket says 172.21.15.84:52832) 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.788+0000 7fe89e400640 1 -- 172.21.15.84:0/817815854 learned_addr learned my addr 172.21.15.84:0/817815854 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.789+0000 7fe89d000640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe898111cd0 0x7fe8981a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.789+0000 7fe89d000640 1 -- 172.21.15.84:0/817815854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe89811cba0 msgr2=0x7fe8981aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.789+0000 7fe89d000640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe89811cba0 0x7fe8981aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.789+0000 7fe89d000640 1 -- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89810dbf0 msgr2=0x7fe8981a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.789+0000 7fe89d000640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89810dbf0 0x7fe8981a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.789+0000 7fe89d000640 1 -- 172.21.15.84:0/817815854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8981af100 con 0x7fe898111cd0 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.790+0000 7fe89d000640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe898111cd0 0x7fe8981a9760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e9c0 tx=0x7fe88400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.792+0000 7fe896000640 1 -- 172.21.15.84:0/817815854 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88400ccc0 con 0x7fe898111cd0 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.792+0000 7fe896000640 1 -- 172.21.15.84:0/817815854 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe88400ce60 con 0x7fe898111cd0 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.792+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8981af3f0 con 0x7fe898111cd0 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.792+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe898112380 con 0x7fe898111cd0 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.792+0000 7fe896000640 1 -- 172.21.15.84:0/817815854 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840187a0 con 0x7fe898111cd0 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.802+0000 7fe8a7068740 1 Processor -- start 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.803+0000 7fe8a7068740 1 -- start start 2024-09-21T07:55:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19ec070 0x5624a1d92f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe896000640 1 -- 172.21.15.84:0/817815854 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe884018940 con 0x7fe898111cd0 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19cb390 0x5624a1d939f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe8a7068740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5624a1d09fb0 con 0x5624a19cb390 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe8a7068740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5624a1cf93e0 con 0x5624a19c31b0 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe8a7068740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5624a1cfd1f0 con 0x5624a19ec070 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe89e400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19ec070 0x5624a1d92f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe89e400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19ec070 0x5624a1d92f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52838/0 (socket says 172.21.15.84:52838) 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.804+0000 7fe89e400640 1 -- 172.21.15.84:0/3345551567 learned_addr learned my addr 172.21.15.84:0/3345551567 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.805+0000 7fe89da00640 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.805+0000 7fe89e400640 1 -- 172.21.15.84:0/3345551567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 msgr2=0x5624a1d934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.805+0000 7fe89e400640 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d934b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.805+0000 7fe89e400640 1 -- 172.21.15.84:0/3345551567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19cb390 msgr2=0x5624a1d939f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.806+0000 7fe89d000640 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19cb390 0x5624a1d939f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.806+0000 7fe89e400640 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19cb390 0x5624a1d939f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.806+0000 7fe89e400640 1 -- 172.21.15.84:0/3345551567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a1cc3cd0 con 0x5624a19ec070 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.808+0000 7fe89e400640 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19ec070 0x5624a1d92f70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe89000e270 tx=0x7fe890009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=138947dd65757438 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.812+0000 7fe88aa00640 1 -- 172.21.15.84:0/3345551567 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890018020 con 0x5624a19ec070 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.812+0000 7fe88aa00640 1 -- 172.21.15.84:0/3345551567 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe890014d40 con 0x5624a19ec070 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.812+0000 7fe88aa00640 1 -- 172.21.15.84:0/3345551567 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890013cf0 con 0x5624a19ec070 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.812+0000 7fe896000640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe8800b6880 0x7fe8800b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.813+0000 7fe896000640 1 -- 172.21.15.84:0/817815854 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe8840e7b60 con 0x7fe898111cd0 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.813+0000 7fe8a7068740 1 -- 172.21.15.84:0/3345551567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19ec070 msgr2=0x5624a1d92f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.813+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19ec070 0x5624a1d92f70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe89000e270 tx=0x7fe890009710 comp rx=0 tx=0).stop 2024-09-21T07:55:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.814+0000 7fe8a7068740 1 -- 172.21.15.84:0/3345551567 shutdown_connections 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.814+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19cb390 0x5624a1d939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.814+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d934b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.814+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3345551567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19ec070 0x5624a1d92f70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.814+0000 7fe8a7068740 1 -- 172.21.15.84:0/3345551567 >> 172.21.15.84:0/3345551567 conn(0x5624a19e0460 msgr2=0x5624a1d90e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.815+0000 7fe89da00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe8800b6880 0x7fe8800b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.818+0000 7fe8a7068740 1 -- 172.21.15.84:0/3345551567 shutdown_connections 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.818+0000 7fe89da00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe8800b6880 0x7fe8800b8d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe88c006010 tx=0x7fe88c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.819+0000 7fe8a7068740 1 -- 172.21.15.84:0/3345551567 wait complete. 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.820+0000 7fe8a7068740 1 -- start start 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.821+0000 7fe8a7068740 1 Processor -- start 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.823+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1d9e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.823+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1d9ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.823+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1daaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.823+0000 7fe8a7068740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5624a1b5a700 con 0x5624a19ec070 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.823+0000 7fe8a7068740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5624a1c94580 con 0x5624a19cb390 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.823+0000 7fe8a7068740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5624a1da1750 con 0x5624a19c31b0 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.823+0000 7fe8a7068740 10 client.0 _ll_register_callbacks cb 0x5624a1ca4470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.824+0000 7fe89da00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1d9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.824+0000 7fe89d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1d9ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.824+0000 7fe89da00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1d9e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52846/0 (socket says 172.21.15.84:52846) 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.824+0000 7fe89da00640 1 -- 172.21.15.84:0/2559634398 learned_addr learned my addr 172.21.15.84:0/2559634398 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.825+0000 7fe89e400640 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1daaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.826+0000 7fe89e400640 1 -- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 msgr2=0x5624a1d9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.826+0000 7fe89e400640 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1d9e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.826+0000 7fe89e400640 1 -- 172.21.15.84:0/2559634398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 msgr2=0x5624a1d9ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.826+0000 7fe89e400640 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1d9ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.826+0000 7fe89e400640 1 -- 172.21.15.84:0/2559634398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a1a57650 con 0x5624a19ec070 2024-09-21T07:55:07.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.826+0000 7fe89da00640 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1d9e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.827+0000 7fe89e400640 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1daaaa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe890009490 tx=0x7fe890013c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e4bf1bcdedfbef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.827+0000 7fe87f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.828+0000 7fe87f400640 1 -- 172.21.15.84:0/2559634398 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890009da0 con 0x5624a19ec070 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.828+0000 7fe87f400640 1 -- 172.21.15.84:0/2559634398 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe890014690 con 0x5624a19ec070 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.829+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5624a1c96b90 con 0x5624a19ec070 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.829+0000 7fe87f400640 1 -- 172.21.15.84:0/2559634398 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8900148d0 con 0x5624a19ec070 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.829+0000 7fe8a7068740 10 client.16668 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.830+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624a1cb1950 con 0x5624a19ec070 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.830+0000 7fe87f400640 1 -- 172.21.15.84:0/2559634398 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5624a1c96b90 con 0x5624a19ec070 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.834+0000 7fe87f400640 1 -- 172.21.15.84:0/2559634398 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe890030c40 con 0x5624a19ec070 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.834+0000 7fe8a7068740 10 client.16668 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.834+0000 7fe8a7068740 10 client.16668 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:55:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.834+0000 7fe8a7068740 20 client.16668 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.834+0000 7fe8a7068740 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a19aa9f0 0x5624a1db0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.834+0000 7fe8a7068740 4 client.16668 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.834+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624a1d0bf00 con 0x5624a19aa9f0 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.835+0000 7fe89da00640 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a19aa9f0 0x5624a1db0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.837+0000 7fe87f400640 10 client.16668 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.838+0000 7fe89da00640 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a19aa9f0 0x5624a1db0650 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=41e45e40683f48af server_cookie=5cfe424cfd6df73e in_seq=0 out_seq=0 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.839+0000 7fe87f400640 1 -- 172.21.15.84:0/2559634398 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624a1d0bf00 con 0x5624a19aa9f0 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.839+0000 7fe87f400640 10 client.16668 handle_command_reply: tid=0 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.839+0000 7fe8a7068740 1 client.16668 shutdown 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 msgr2=0x5624a1daaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1daaaa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe890009490 tx=0x7fe890013c20 comp rx=0 tx=0).stop 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 shutdown_connections 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a19aa9f0 0x5624a1db0650 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1daaaa0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1d9ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 --2- 172.21.15.84:0/2559634398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1d9e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.840+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 >> 172.21.15.84:0/2559634398 conn(0x5624a19e0460 msgr2=0x5624a1d96100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.841+0000 7fe87f400640 0 client.16668 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.841+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 shutdown_connections 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.842+0000 7fe8a7068740 1 -- 172.21.15.84:0/2559634398 wait complete. 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.843+0000 7fe8a7068740 20 client.16668 trim_cache size 0 max 16384 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.869+0000 7fe8a7068740 1 Processor -- start 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.869+0000 7fe8a7068740 1 -- start start 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d94660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19cb390 0x5624a1d90610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1d90b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe8a7068740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe87800ffc0 con 0x5624a19ec070 2024-09-21T07:55:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe8a7068740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe878011b00 con 0x5624a19c31b0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe8a7068740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe878010690 con 0x5624a19cb390 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe89da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d94660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe89da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d94660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:40022/0 (socket says 172.21.15.84:40022) 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe89da00640 1 -- 172.21.15.84:0/1054563225 learned_addr learned my addr 172.21.15.84:0/1054563225 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.870+0000 7fe89d000640 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19cb390 0x5624a1d90610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.871+0000 7fe89da00640 1 -- 172.21.15.84:0/1054563225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19cb390 msgr2=0x5624a1d90610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.871+0000 7fe89da00640 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19cb390 0x5624a1d90610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.871+0000 7fe89da00640 1 -- 172.21.15.84:0/1054563225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 msgr2=0x5624a1d90b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.871+0000 7fe89e400640 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1d90b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.872+0000 7fe89da00640 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1d90b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.872+0000 7fe89da00640 1 -- 172.21.15.84:0/1054563225 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a1d9f940 con 0x5624a19c31b0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.872+0000 7fe89e400640 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1d90b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.872+0000 7fe89da00640 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d94660 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe88c033040 tx=0x7fe88c045000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351c78ccec0c8c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.872+0000 7fe88a000640 1 -- 172.21.15.84:0/1054563225 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c031d80 con 0x5624a19c31b0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.872+0000 7fe88a000640 1 -- 172.21.15.84:0/1054563225 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe88c056920 con 0x5624a19c31b0 2024-09-21T07:55:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.872+0000 7fe88a000640 1 -- 172.21.15.84:0/1054563225 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c04a950 con 0x5624a19c31b0 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 -- 172.21.15.84:0/1054563225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 msgr2=0x5624a1d94660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d94660 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe88c033040 tx=0x7fe88c045000 comp rx=0 tx=0).stop 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 -- 172.21.15.84:0/1054563225 shutdown_connections 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1d90b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19cb390 0x5624a1d90610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 --2- 172.21.15.84:0/1054563225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19c31b0 0x5624a1d94660 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 -- 172.21.15.84:0/1054563225 >> 172.21.15.84:0/1054563225 conn(0x5624a19e0460 msgr2=0x5624a1d93f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 -- 172.21.15.84:0/1054563225 shutdown_connections 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.874+0000 7fe8a7068740 1 -- 172.21.15.84:0/1054563225 wait complete. 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.875+0000 7fe8a7068740 1 -- start start 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.875+0000 7fe8a7068740 1 Processor -- start 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.876+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1da3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.876+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1da36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.876+0000 7fe8a7068740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1e19ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.876+0000 7fe8a7068740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe878011430 con 0x5624a19ec070 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.876+0000 7fe8a7068740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe878010d60 con 0x5624a19cb390 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.876+0000 7fe8a7068740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe87800df40 con 0x5624a19c31b0 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.876+0000 7fe8a7068740 10 client.0 _ll_register_callbacks cb 0x7fe890009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.877+0000 7fe89da00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1da3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.877+0000 7fe89da00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1da3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:52856/0 (socket says 172.21.15.84:52856) 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.877+0000 7fe89da00640 1 -- 172.21.15.84:0/3279101424 learned_addr learned my addr 172.21.15.84:0/3279101424 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.877+0000 7fe89d000640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1da36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.878+0000 7fe89e400640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1e19ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.878+0000 7fe89da00640 1 -- 172.21.15.84:0/3279101424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 msgr2=0x5624a1da36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.878+0000 7fe89da00640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1da36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.878+0000 7fe89da00640 1 -- 172.21.15.84:0/3279101424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 msgr2=0x5624a1e19ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.878+0000 7fe89da00640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1e19ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.878+0000 7fe89da00640 1 -- 172.21.15.84:0/3279101424 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a1e1a470 con 0x5624a19c31b0 2024-09-21T07:55:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.879+0000 7fe89e400640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1e19ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.879+0000 7fe89da00640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1da3170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe88c031850 tx=0x7fe88c031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2592df7904d02dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.879+0000 7fe87f400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.880+0000 7fe87f400640 1 -- 172.21.15.84:0/3279101424 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c0565b0 con 0x5624a19c31b0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.880+0000 7fe87f400640 1 -- 172.21.15.84:0/3279101424 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe88c056ad0 con 0x5624a19c31b0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.880+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe88c056920 con 0x5624a19c31b0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.880+0000 7fe87f400640 1 -- 172.21.15.84:0/3279101424 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe88c056750 con 0x5624a19c31b0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.880+0000 7fe8a7068740 10 client.26785 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.880+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624a1e1b660 con 0x5624a19c31b0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe87f400640 1 -- 172.21.15.84:0/3279101424 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe88c056920 con 0x5624a19c31b0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe87f400640 1 -- 172.21.15.84:0/3279101424 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe88c0715b0 con 0x5624a19c31b0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe8a7068740 10 client.26785 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe8a7068740 10 client.26785 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe8a7068740 20 client.26785 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a197fda0 0x5624a1e1dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe8a7068740 4 client.26785 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.881+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624a1d079b0 con 0x5624a197fda0 2024-09-21T07:55:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.882+0000 7fe89d000640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a197fda0 0x5624a1e1dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.882+0000 7fe89d000640 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a197fda0 0x5624a1e1dda0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8cacbe7d0f6b216 server_cookie=74d06bc56b66f7a8 in_seq=0 out_seq=0 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.882+0000 7fe87f400640 10 client.26785 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe87f400640 1 -- 172.21.15.84:0/3279101424 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624a1d079b0 con 0x5624a197fda0 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe87f400640 10 client.26785 handle_command_reply: tid=0 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 client.26785 shutdown 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 msgr2=0x5624a1da3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1da3170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe88c031850 tx=0x7fe88c031ee0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 shutdown_connections 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5624a197fda0 0x5624a1e1dda0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5624a19ec070 0x5624a1e19ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5624a19cb390 0x5624a1da36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 --2- 172.21.15.84:0/3279101424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5624a19c31b0 0x5624a1da3170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 >> 172.21.15.84:0/3279101424 conn(0x5624a19e0460 msgr2=0x5624a1d9fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe87f400640 0 client.26785 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 shutdown_connections 2024-09-21T07:55:07.275 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.883+0000 7fe8a7068740 1 -- 172.21.15.84:0/3279101424 wait complete. 2024-09-21T07:55:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe8a7068740 20 client.26785 trim_cache size 0 max 16384 2024-09-21T07:55:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe8800b6880 msgr2=0x7fe8800b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe8800b6880 0x7fe8800b8d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe88c006010 tx=0x7fe88c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe898111cd0 msgr2=0x7fe8981a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe898111cd0 0x7fe8981a9760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e9c0 tx=0x7fe88400ee80 comp rx=0 tx=0).stop 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 shutdown_connections 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe8800b6880 0x7fe8800b8d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe89811cba0 0x7fe8981aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe898111cd0 0x7fe8981a9760 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.884+0000 7fe89ee00640 1 --2- 172.21.15.84:0/817815854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89810dbf0 0x7fe8981a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.885+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 >> 172.21.15.84:0/817815854 conn(0x7fe89806e9f0 msgr2=0x7fe89810f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.885+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 shutdown_connections 2024-09-21T07:55:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:06.885+0000 7fe89ee00640 1 -- 172.21.15.84:0/817815854 wait complete. 2024-09-21T07:55:07.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:07 smithi084 ceph-mon[30411]: pgmap v514: 129 pgs: 129 active+clean; 24 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 48 KiB/s rd, 224 MiB/s wr, 1.20k op/s 2024-09-21T07:55:07.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:07 smithi191 ceph-mon[34667]: pgmap v514: 129 pgs: 129 active+clean; 24 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 48 KiB/s rd, 224 MiB/s wr, 1.20k op/s 2024-09-21T07:55:07.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:07 smithi162 ceph-mon[34833]: pgmap v514: 129 pgs: 129 active+clean; 24 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 48 KiB/s rd, 224 MiB/s wr, 1.20k op/s 2024-09-21T07:55:08.924 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:55:09.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:09 smithi191 ceph-mon[34667]: pgmap v515: 129 pgs: 129 active+clean; 25 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 37 KiB/s rd, 251 MiB/s wr, 1.18k op/s 2024-09-21T07:55:09.687 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:09.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:09 smithi162 ceph-mon[34833]: pgmap v515: 129 pgs: 129 active+clean; 25 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 37 KiB/s rd, 251 MiB/s wr, 1.18k op/s 2024-09-21T07:55:09.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:09 smithi084 ceph-mon[30411]: pgmap v515: 129 pgs: 129 active+clean; 25 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 37 KiB/s rd, 251 MiB/s wr, 1.18k op/s 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 -- 172.21.15.84:0/838861312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac1100d0 msgr2=0x7f5bac112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 --2- 172.21.15.84:0/838861312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac1100d0 0x7f5bac112510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009be0 tx=0x7f5ba402a6c0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 -- 172.21.15.84:0/838861312 shutdown_connections 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 --2- 172.21.15.84:0/838861312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac1100d0 0x7f5bac112510 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 --2- 172.21.15.84:0/838861312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bac076100 0x7f5bac10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 --2- 172.21.15.84:0/838861312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac0757b0 0x7f5bac075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 -- 172.21.15.84:0/838861312 >> 172.21.15.84:0/838861312 conn(0x7f5bac0ff5e0 msgr2=0x7f5bac101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:10.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.620+0000 7f5bb2200640 1 -- 172.21.15.84:0/838861312 shutdown_connections 2024-09-21T07:55:10.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.621+0000 7f5bb2200640 1 -- 172.21.15.84:0/838861312 wait complete. 2024-09-21T07:55:10.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.622+0000 7f5bb2200640 1 Processor -- start 2024-09-21T07:55:10.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.622+0000 7f5bb2200640 1 -- start start 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5bb2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bac0757b0 0x7f5bac10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5bb2200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac076100 0x7f5bac10e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5bb2200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac1100d0 0x7f5bac10e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5bb2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac103e80 con 0x7f5bac0757b0 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5bb2200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac103d00 con 0x7f5bac1100d0 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5bb2200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac104000 con 0x7f5bac076100 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac076100 0x7f5bac10e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5babe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac1100d0 0x7f5bac10e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac076100 0x7f5bac10e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46546/0 (socket says 172.21.15.84:46546) 2024-09-21T07:55:10.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5babe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac1100d0 0x7f5bac10e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48674/0 (socket says 172.21.15.84:48674) 2024-09-21T07:55:10.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5ba2a00640 1 -- 172.21.15.84:0/2367281980 learned_addr learned my addr 172.21.15.84:0/2367281980 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:10.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5babe00640 1 -- 172.21.15.84:0/2367281980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac076100 msgr2=0x7f5bac10e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.624+0000 7f5babe00640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac076100 0x7f5bac10e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.625+0000 7f5babe00640 1 -- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bac0757b0 msgr2=0x7f5bac10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.625+0000 7f5babe00640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bac0757b0 0x7f5bac10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.625+0000 7f5babe00640 1 -- 172.21.15.84:0/2367281980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac1acb90 con 0x7f5bac1100d0 2024-09-21T07:55:10.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.625+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac076100 0x7f5bac10e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:10.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.625+0000 7f5babe00640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac1100d0 0x7f5bac10e9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4034040 tx=0x7f5ba4003cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.625+0000 7f5ba8c00640 1 -- 172.21.15.84:0/2367281980 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4040020 con 0x7f5bac1100d0 2024-09-21T07:55:10.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.626+0000 7f5ba8c00640 1 -- 172.21.15.84:0/2367281980 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ba4030970 con 0x7f5bac1100d0 2024-09-21T07:55:10.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.626+0000 7f5ba8c00640 1 -- 172.21.15.84:0/2367281980 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4036040 con 0x7f5bac1100d0 2024-09-21T07:55:10.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.626+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac1ace20 con 0x7f5bac1100d0 2024-09-21T07:55:10.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.626+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac1ad300 con 0x7f5bac1100d0 2024-09-21T07:55:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.630+0000 7f5bb8ec3740 1 Processor -- start 2024-09-21T07:55:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.633+0000 7f5ba8c00640 1 -- 172.21.15.84:0/2367281980 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5ba4043020 con 0x7f5bac1100d0 2024-09-21T07:55:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.633+0000 7f5bb8ec3740 1 -- start start 2024-09-21T07:55:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.635+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec836ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.635+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec8370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.635+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec837620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.635+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556bec7adfb0 con 0x556bec46f390 2024-09-21T07:55:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.635+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556bec79d3e0 con 0x556bec490070 2024-09-21T07:55:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.635+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556bec7a11f0 con 0x556bec4671b0 2024-09-21T07:55:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.635+0000 7f5ba8c00640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5b900b6730 0x7f5b900b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5ba8c00640 1 -- 172.21.15.84:0/2367281980 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5ba4108500 con 0x7f5bac1100d0 2024-09-21T07:55:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec836ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5babe00640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5b900b6730 0x7f5b900b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5bab400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec8370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec836ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48684/0 (socket says 172.21.15.84:48684) 2024-09-21T07:55:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5ba2a00640 1 -- 172.21.15.84:0/1359083359 learned_addr learned my addr 172.21.15.84:0/1359083359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5bab400640 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec8370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46552/0 (socket says 172.21.15.84:46552) 2024-09-21T07:55:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.636+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec837620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.637+0000 7f5ba2a00640 1 -- 172.21.15.84:0/1359083359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 msgr2=0x556bec8370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:10.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.637+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec8370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.637+0000 7f5ba2a00640 1 -- 172.21.15.84:0/1359083359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 msgr2=0x556bec837620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:10.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.637+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec837620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.637+0000 7f5ba2a00640 1 -- 172.21.15.84:0/1359083359 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bec767cd0 con 0x556bec490070 2024-09-21T07:55:10.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.637+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec836ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b94015b30 tx=0x7f5b94009980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db7d897cafa826c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.638+0000 7f5b9be00640 1 -- 172.21.15.84:0/1359083359 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400e8a0 con 0x556bec490070 2024-09-21T07:55:10.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.638+0000 7f5b9be00640 1 -- 172.21.15.84:0/1359083359 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b9401d070 con 0x556bec490070 2024-09-21T07:55:10.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.638+0000 7f5b9be00640 1 -- 172.21.15.84:0/1359083359 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400e8a0 con 0x556bec490070 2024-09-21T07:55:10.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.641+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/1359083359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 msgr2=0x556bec836ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.641+0000 7f5babe00640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5b900b6730 0x7f5b900b8c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40cdfb0 tx=0x7f5ba40093a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.641+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec836ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b94015b30 tx=0x7f5b94009980 comp rx=0 tx=0).stop 2024-09-21T07:55:10.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.642+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/1359083359 shutdown_connections 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.642+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec837620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.642+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec8370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.642+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/1359083359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec836ba0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.642+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/1359083359 >> 172.21.15.84:0/1359083359 conn(0x556bec484460 msgr2=0x556bec834a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.643+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/1359083359 shutdown_connections 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.643+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/1359083359 wait complete. 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.643+0000 7f5bb8ec3740 1 -- start start 2024-09-21T07:55:10.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 1 Processor -- start 2024-09-21T07:55:10.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec842790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec842d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec84e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556bec5fe700 con 0x556bec490070 2024-09-21T07:55:10.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556bec738580 con 0x556bec46f390 2024-09-21T07:55:10.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556bec845320 con 0x556bec4671b0 2024-09-21T07:55:10.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.644+0000 7f5bb8ec3740 10 client.0 _ll_register_callbacks cb 0x556bec748470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec842d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec842d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48698/0 (socket says 172.21.15.84:48698) 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 -- 172.21.15.84:0/167215444 learned_addr learned my addr 172.21.15.84:0/167215444 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 -- 172.21.15.84:0/167215444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 msgr2=0x556bec842790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec842790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 -- 172.21.15.84:0/167215444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 msgr2=0x556bec84e640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec84e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.645+0000 7f5bab400640 1 -- 172.21.15.84:0/167215444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bec4fb650 con 0x556bec46f390 2024-09-21T07:55:10.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5bab400640 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec842d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0116c0 tx=0x7f5b9c011b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85ee277b950df11f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5b98c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5b98c00640 1 -- 172.21.15.84:0/167215444 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00f920 con 0x556bec46f390 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556bec73ab90 con 0x556bec46f390 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5b98c00640 1 -- 172.21.15.84:0/167215444 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5b9c00fac0 con 0x556bec46f390 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5b98c00640 1 -- 172.21.15.84:0/167215444 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5b9c00fcc0 con 0x556bec46f390 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5bb8ec3740 10 client.26777 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.646+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556bec755950 con 0x556bec46f390 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.647+0000 7f5b98c00640 1 -- 172.21.15.84:0/167215444 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556bec73ab90 con 0x556bec46f390 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.647+0000 7f5b98c00640 1 -- 172.21.15.84:0/167215444 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5b9c018070 con 0x556bec46f390 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.647+0000 7f5bb8ec3740 10 client.26777 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.647+0000 7f5bb8ec3740 10 client.26777 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.648+0000 7f5bb8ec3740 20 client.26777 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:10.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.648+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec44e9f0 0x556bec8548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.648+0000 7f5bb8ec3740 4 client.26777 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:10.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.648+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bec7aff00 con 0x556bec44e9f0 2024-09-21T07:55:10.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.648+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec44e9f0 0x556bec8548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.649+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec44e9f0 0x556bec8548a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=179404338eefeb39 server_cookie=92249dbc7b4f6f70 in_seq=0 out_seq=0 2024-09-21T07:55:10.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.649+0000 7f5b98c00640 10 client.26777 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:10.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.650+0000 7f5b98c00640 1 -- 172.21.15.84:0/167215444 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bec7aff00 con 0x556bec44e9f0 2024-09-21T07:55:10.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.650+0000 7f5b98c00640 10 client.26777 handle_command_reply: tid=0 2024-09-21T07:55:10.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.650+0000 7f5bb8ec3740 1 client.26777 shutdown 2024-09-21T07:55:10.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.650+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 msgr2=0x556bec842d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.650+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec842d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0116c0 tx=0x7f5b9c011b80 comp rx=0 tx=0).stop 2024-09-21T07:55:10.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 shutdown_connections 2024-09-21T07:55:10.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec44e9f0 0x556bec8548a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec84e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec842d10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5b98c00640 0 client.26777 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:10.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/167215444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec842790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 >> 172.21.15.84:0/167215444 conn(0x556bec484460 msgr2=0x556bec839d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:10.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.651+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 shutdown_connections 2024-09-21T07:55:10.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.652+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/167215444 wait complete. 2024-09-21T07:55:10.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.652+0000 7f5bb8ec3740 20 client.26777 trim_cache size 0 max 16384 2024-09-21T07:55:10.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.679+0000 7f5bb8ec3740 1 Processor -- start 2024-09-21T07:55:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.680+0000 7f5bb8ec3740 1 -- start start 2024-09-21T07:55:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.680+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec83c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.680+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec834040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.680+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec834580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.680+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac1b7440 con 0x556bec46f390 2024-09-21T07:55:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.680+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac1b8f80 con 0x556bec490070 2024-09-21T07:55:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.680+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac1b7b10 con 0x556bec4671b0 2024-09-21T07:55:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.681+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec83c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.681+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec83c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46568/0 (socket says 172.21.15.84:46568) 2024-09-21T07:55:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.681+0000 7f5ba2a00640 1 -- 172.21.15.84:0/4200318812 learned_addr learned my addr 172.21.15.84:0/4200318812 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.681+0000 7f5bab400640 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec834040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.681+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec834580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.682+0000 7f5ba2a00640 1 -- 172.21.15.84:0/4200318812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 msgr2=0x556bec834580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.682+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec834580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.682+0000 7f5ba2a00640 1 -- 172.21.15.84:0/4200318812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 msgr2=0x556bec834040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.682+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec834040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.682+0000 7f5ba2a00640 1 -- 172.21.15.84:0/4200318812 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bec838e90 con 0x556bec4671b0 2024-09-21T07:55:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.682+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec83c3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400e660 tx=0x7f5b94018800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9de2e41ebe543b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.683+0000 7f5b9b400640 1 -- 172.21.15.84:0/4200318812 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94018d00 con 0x556bec4671b0 2024-09-21T07:55:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.683+0000 7f5b9b400640 1 -- 172.21.15.84:0/4200318812 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b94030070 con 0x556bec4671b0 2024-09-21T07:55:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.683+0000 7f5b9b400640 1 -- 172.21.15.84:0/4200318812 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9402b6c0 con 0x556bec4671b0 2024-09-21T07:55:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.684+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4200318812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 msgr2=0x556bec83c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.684+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec83c3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400e660 tx=0x7f5b94018800 comp rx=0 tx=0).stop 2024-09-21T07:55:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.684+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4200318812 shutdown_connections 2024-09-21T07:55:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.684+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec490070 0x556bec834580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.684+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec46f390 0x556bec834040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.684+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4200318812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec83c3c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.684+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4200318812 >> 172.21.15.84:0/4200318812 conn(0x556bec484460 msgr2=0x556bec83bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.685+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4200318812 shutdown_connections 2024-09-21T07:55:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.685+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4200318812 wait complete. 2024-09-21T07:55:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.686+0000 7f5bb8ec3740 1 -- start start 2024-09-21T07:55:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.686+0000 7f5bb8ec3740 1 Processor -- start 2024-09-21T07:55:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.687+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec84a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec84ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec84a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5bb8ec3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec8b8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac1b88b0 con 0x556bec490070 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac1b81e0 con 0x556bec46f390 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5ba2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec84a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46576/0 (socket says 172.21.15.84:46576) 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5bb8ec3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac1b5400 con 0x556bec4671b0 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5ba2a00640 1 -- 172.21.15.84:0/4238879206 learned_addr learned my addr 172.21.15.84:0/4238879206 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5bb8ec3740 10 client.0 _ll_register_callbacks cb 0x7f5b9c009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.689+0000 7f5bab400640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec84ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.690+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec8b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.691+0000 7f5bab400640 1 -- 172.21.15.84:0/4238879206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 msgr2=0x556bec84a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:10.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.691+0000 7f5bab400640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec84a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.691+0000 7f5bab400640 1 -- 172.21.15.84:0/4238879206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 msgr2=0x556bec8b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:10.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.691+0000 7f5bab400640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec8b8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.691+0000 7f5bab400640 1 -- 172.21.15.84:0/4238879206 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bec8b8c50 con 0x556bec46f390 2024-09-21T07:55:10.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.692+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec8b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:10.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.692+0000 7f5bab400640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec84ab60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006010 tx=0x7f5b9c00fbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dfe45edc94a67cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:10.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.692+0000 7f5b98c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:10.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.692+0000 7f5b98c00640 1 -- 172.21.15.84:0/4238879206 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c004590 con 0x556bec46f390 2024-09-21T07:55:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.692+0000 7f5b98c00640 1 -- 172.21.15.84:0/4238879206 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f5b9c0035f0 con 0x556bec46f390 2024-09-21T07:55:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.693+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b94030070 con 0x556bec46f390 2024-09-21T07:55:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.693+0000 7f5b98c00640 1 -- 172.21.15.84:0/4238879206 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5b9c048050 con 0x556bec46f390 2024-09-21T07:55:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.693+0000 7f5bb8ec3740 10 client.26783 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.693+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556bec8d09b0 con 0x556bec46f390 2024-09-21T07:55:10.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.693+0000 7f5b98c00640 1 -- 172.21.15.84:0/4238879206 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b94030070 con 0x556bec46f390 2024-09-21T07:55:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5b98c00640 1 -- 172.21.15.84:0/4238879206 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5b9c018040 con 0x556bec46f390 2024-09-21T07:55:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5bb8ec3740 10 client.26783 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5bb8ec3740 10 client.26783 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:55:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5bb8ec3740 20 client.26783 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec423da0 0x556bec8d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5bb8ec3740 4 client.26783 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:10.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556bec7ab9b0 con 0x556bec423da0 2024-09-21T07:55:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.694+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec423da0 0x556bec8d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.695+0000 7f5b98c00640 10 client.26783 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.695+0000 7f5ba2a00640 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec423da0 0x556bec8d31f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b62f063cb9cbccb3 server_cookie=6db3e3c0438cce45 in_seq=0 out_seq=0 2024-09-21T07:55:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.695+0000 7f5b98c00640 1 -- 172.21.15.84:0/4238879206 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556bec7ab9b0 con 0x556bec423da0 2024-09-21T07:55:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.695+0000 7f5b98c00640 10 client.26783 handle_command_reply: tid=0 2024-09-21T07:55:10.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.695+0000 7f5bb8ec3740 1 client.26783 shutdown 2024-09-21T07:55:10.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 msgr2=0x556bec84ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec84ab60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006010 tx=0x7f5b9c00fbd0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 shutdown_connections 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x556bec423da0 0x556bec8d31f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556bec490070 0x556bec8b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556bec46f390 0x556bec84ab60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 --2- 172.21.15.84:0/4238879206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556bec4671b0 0x556bec84a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 >> 172.21.15.84:0/4238879206 conn(0x556bec484460 msgr2=0x556bec837bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5b98c00640 0 client.26783 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.696+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 shutdown_connections 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.697+0000 7f5bb8ec3740 1 -- 172.21.15.84:0/4238879206 wait complete. 2024-09-21T07:55:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.697+0000 7f5bb8ec3740 20 client.26783 trim_cache size 0 max 16384 2024-09-21T07:55:10.700 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:10.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.698+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5b900b6730 msgr2=0x7f5b900b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.698+0000 7f5bb2200640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5b900b6730 0x7f5b900b8c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40cdfb0 tx=0x7f5ba40093a0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.698+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac1100d0 msgr2=0x7f5bac10e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.698+0000 7f5bb2200640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac1100d0 0x7f5bac10e9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4034040 tx=0x7f5ba4003cc0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.699+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 shutdown_connections 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.699+0000 7f5bb2200640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5b900b6730 0x7f5b900b8c40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.699+0000 7f5bb2200640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bac1100d0 0x7f5bac10e9c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.699+0000 7f5bb2200640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bac076100 0x7f5bac10e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.699+0000 7f5bb2200640 1 --2- 172.21.15.84:0/2367281980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bac0757b0 0x7f5bac10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.699+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 >> 172.21.15.84:0/2367281980 conn(0x7f5bac0ff5e0 msgr2=0x7f5bac106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.700+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 shutdown_connections 2024-09-21T07:55:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:10.700+0000 7f5bb2200640 1 -- 172.21.15.84:0/2367281980 wait complete. 2024-09-21T07:55:11.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:11 smithi084 ceph-mon[30411]: pgmap v516: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 52 KiB/s rd, 272 MiB/s wr, 1.12k op/s 2024-09-21T07:55:11.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:55:11.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:11 smithi191 ceph-mon[34667]: pgmap v516: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 52 KiB/s rd, 272 MiB/s wr, 1.12k op/s 2024-09-21T07:55:11.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:11 smithi162 ceph-mon[34833]: pgmap v516: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 52 KiB/s rd, 272 MiB/s wr, 1.12k op/s 2024-09-21T07:55:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:13.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:13 smithi191 ceph-mon[34667]: pgmap v517: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 40 KiB/s rd, 249 MiB/s wr, 998 op/s 2024-09-21T07:55:13.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:13 smithi084 ceph-mon[30411]: pgmap v517: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 40 KiB/s rd, 249 MiB/s wr, 998 op/s 2024-09-21T07:55:13.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:13 smithi162 ceph-mon[34833]: pgmap v517: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 40 KiB/s rd, 249 MiB/s wr, 998 op/s 2024-09-21T07:55:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.926+0000 7f4786e00640 1 -- 172.21.15.84:0/539392276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478011cc30 msgr2=0x7f478011f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.926+0000 7f4786e00640 1 --2- 172.21.15.84:0/539392276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478011cc30 0x7f478011f140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4778009900 tx=0x7f477802a440 comp rx=0 tx=0).stop 2024-09-21T07:55:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.926+0000 7f4786e00640 1 -- 172.21.15.84:0/539392276 shutdown_connections 2024-09-21T07:55:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.926+0000 7f4786e00640 1 --2- 172.21.15.84:0/539392276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f478011cc30 0x7f478011f140 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.926+0000 7f4786e00640 1 --2- 172.21.15.84:0/539392276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478010a9e0 0x7f478010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.926+0000 7f4786e00640 1 --2- 172.21.15.84:0/539392276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4780111f40 0x7f478010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.926+0000 7f4786e00640 1 -- 172.21.15.84:0/539392276 >> 172.21.15.84:0/539392276 conn(0x7f4780070ec0 msgr2=0x7f47800712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.928+0000 7f4786e00640 1 -- 172.21.15.84:0/539392276 shutdown_connections 2024-09-21T07:55:13.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.929+0000 7f4786e00640 1 -- 172.21.15.84:0/539392276 wait complete. 2024-09-21T07:55:13.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.930+0000 7f4786e00640 1 Processor -- start 2024-09-21T07:55:13.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.931+0000 7f4786e00640 1 -- start start 2024-09-21T07:55:13.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.931+0000 7f4786e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f478010a9e0 0x7f478011a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.931+0000 7f4786e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4780111f40 0x7f4780113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.931+0000 7f4786e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478011cc30 0x7f4780113cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.932+0000 7f4777400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4780111f40 0x7f4780113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.932+0000 7f4777400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4780111f40 0x7f4780113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48738/0 (socket says 172.21.15.84:48738) 2024-09-21T07:55:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.933+0000 7f4786e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f47801229b0 con 0x7f478011cc30 2024-09-21T07:55:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.933+0000 7f4786e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4780122830 con 0x7f4780111f40 2024-09-21T07:55:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.933+0000 7f4786e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4780122b30 con 0x7f478010a9e0 2024-09-21T07:55:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.933+0000 7f4784e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478011cc30 0x7f4780113cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.933+0000 7f477fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f478010a9e0 0x7f478011a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.933+0000 7f4784e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478011cc30 0x7f4780113cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44396/0 (socket says 172.21.15.84:44396) 2024-09-21T07:55:13.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.934+0000 7f4784e00640 1 -- 172.21.15.84:0/3642227593 learned_addr learned my addr 172.21.15.84:0/3642227593 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:13.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.935+0000 7f4784e00640 1 -- 172.21.15.84:0/3642227593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f478010a9e0 msgr2=0x7f478011a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:13.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.935+0000 7f4784e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f478010a9e0 0x7f478011a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.935+0000 7f4784e00640 1 -- 172.21.15.84:0/3642227593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4780111f40 msgr2=0x7f4780113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.935+0000 7f4784e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4780111f40 0x7f4780113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.935+0000 7f4784e00640 1 -- 172.21.15.84:0/3642227593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47801144f0 con 0x7f478011cc30 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.936+0000 7f4784e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478011cc30 0x7f4780113cd0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f477802a9b0 tx=0x7f4778003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.937+0000 7f477d600640 1 -- 172.21.15.84:0/3642227593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477803f070 con 0x7f478011cc30 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.937+0000 7f477d600640 1 -- 172.21.15.84:0/3642227593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4778031d60 con 0x7f478011cc30 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.937+0000 7f477d600640 1 -- 172.21.15.84:0/3642227593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778035030 con 0x7f478011cc30 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.937+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4780119110 con 0x7f478011cc30 2024-09-21T07:55:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.937+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4780119620 con 0x7f478011cc30 2024-09-21T07:55:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 Processor -- start 2024-09-21T07:55:13.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 -- start start 2024-09-21T07:55:13.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 0x55a6100edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd26390 0x55a6100ee820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a610064fb0 con 0x55a60fd47070 2024-09-21T07:55:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a6100543e0 con 0x55a60fd1e1b0 2024-09-21T07:55:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.945+0000 7f478dbce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a6100581f0 con 0x55a60fd26390 2024-09-21T07:55:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.946+0000 7f477fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.946+0000 7f477fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100ee2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48752/0 (socket says 172.21.15.84:48752) 2024-09-21T07:55:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.946+0000 7f477fe00640 1 -- 172.21.15.84:0/3962436767 learned_addr learned my addr 172.21.15.84:0/3962436767 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.947+0000 7f4777400640 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd26390 0x55a6100ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.948+0000 7f477fe00640 1 -- 172.21.15.84:0/3962436767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd26390 msgr2=0x55a6100ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.949+0000 7f477fe00640 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd26390 0x55a6100ee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.949+0000 7f477fe00640 1 -- 172.21.15.84:0/3962436767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 msgr2=0x55a6100edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.949+0000 7f477fe00640 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 0x55a6100edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.949+0000 7f477fe00640 1 -- 172.21.15.84:0/3962436767 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61001ecd0 con 0x55a60fd1e1b0 2024-09-21T07:55:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.950+0000 7f4777400640 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd26390 0x55a6100ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.952+0000 7f477fe00640 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100ee2e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f477000c450 tx=0x7f477000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c3fe3767bde1471 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.953+0000 7f477d600640 1 -- 172.21.15.84:0/3642227593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4778042070 con 0x7f478011cc30 2024-09-21T07:55:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.953+0000 7f4775600640 1 -- 172.21.15.84:0/3962436767 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477001a070 con 0x55a60fd1e1b0 2024-09-21T07:55:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.953+0000 7f4775600640 1 -- 172.21.15.84:0/3962436767 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47700078e0 con 0x55a60fd1e1b0 2024-09-21T07:55:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.953+0000 7f4775600640 1 -- 172.21.15.84:0/3962436767 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770015810 con 0x55a60fd1e1b0 2024-09-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.955+0000 7f478dbce740 1 -- 172.21.15.84:0/3962436767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 msgr2=0x55a6100ee2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.955+0000 7f478dbce740 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100ee2e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f477000c450 tx=0x7f477000c910 comp rx=0 tx=0).stop 2024-09-21T07:55:13.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.956+0000 7f478dbce740 1 -- 172.21.15.84:0/3962436767 shutdown_connections 2024-09-21T07:55:13.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.956+0000 7f478dbce740 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd26390 0x55a6100ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.957+0000 7f478dbce740 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100ee2e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.957+0000 7f478dbce740 1 --2- 172.21.15.84:0/3962436767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 0x55a6100edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.958+0000 7f477d600640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47640b6880 0x7f47640b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.958+0000 7f477d600640 1 -- 172.21.15.84:0/3642227593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4778108160 con 0x7f478011cc30 2024-09-21T07:55:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.958+0000 7f478dbce740 1 -- 172.21.15.84:0/3962436767 >> 172.21.15.84:0/3962436767 conn(0x55a60fd3b460 msgr2=0x55a6100ebc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.959+0000 7f4777400640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47640b6880 0x7f47640b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.959+0000 7f478dbce740 1 -- 172.21.15.84:0/3962436767 shutdown_connections 2024-09-21T07:55:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.960+0000 7f4777400640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47640b6880 0x7f47640b8d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47680047b0 tx=0x7f47680092a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.964+0000 7f478dbce740 1 -- 172.21.15.84:0/3962436767 wait complete. 2024-09-21T07:55:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.967+0000 7f478dbce740 1 -- start start 2024-09-21T07:55:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.968+0000 7f478dbce740 1 Processor -- start 2024-09-21T07:55:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.971+0000 7f478dbce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd1e1b0 0x55a6100f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.971+0000 7f478dbce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a6100f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.972+0000 7f478dbce740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 0x55a610105900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.973+0000 7f478dbce740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a60feb5700 con 0x55a60fd47070 2024-09-21T07:55:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.973+0000 7f478dbce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a60ffef580 con 0x55a60fd26390 2024-09-21T07:55:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.973+0000 7f478dbce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a6100fc580 con 0x55a60fd1e1b0 2024-09-21T07:55:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.973+0000 7f478dbce740 10 client.0 _ll_register_callbacks cb 0x55a60ffff470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.972+0000 7f477fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd1e1b0 0x55a6100f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.973+0000 7f477fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd1e1b0 0x55a6100f9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46620/0 (socket says 172.21.15.84:46620) 2024-09-21T07:55:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.973+0000 7f477fe00640 1 -- 172.21.15.84:0/1682529160 learned_addr learned my addr 172.21.15.84:0/1682529160 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.974+0000 7f4777400640 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a6100f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.975+0000 7f4784e00640 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 0x55a610105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.975+0000 7f477fe00640 1 -- 172.21.15.84:0/1682529160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 msgr2=0x55a6100f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.975+0000 7f477fe00640 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a6100f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.975+0000 7f477fe00640 1 -- 172.21.15.84:0/1682529160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 msgr2=0x55a610105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.975+0000 7f477fe00640 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 0x55a610105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.975+0000 7f477fe00640 1 -- 172.21.15.84:0/1682529160 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60fdb2650 con 0x55a60fd1e1b0 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.977+0000 7f477fe00640 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd1e1b0 0x55a6100f9580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4770015c20 tx=0x7f4770015c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1ad0bd6491fdc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.977+0000 7f476e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.978+0000 7f476e000640 1 -- 172.21.15.84:0/1682529160 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477001a040 con 0x55a60fd1e1b0 2024-09-21T07:55:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.978+0000 7f476e000640 1 -- 172.21.15.84:0/1682529160 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4770015d70 con 0x55a60fd1e1b0 2024-09-21T07:55:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.980+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a60fff1b90 con 0x55a60fd1e1b0 2024-09-21T07:55:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.980+0000 7f476e000640 1 -- 172.21.15.84:0/1682529160 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f477002a450 con 0x55a60fd1e1b0 2024-09-21T07:55:13.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.981+0000 7f478dbce740 10 client.26806 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:13.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.981+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a61000c950 con 0x55a60fd1e1b0 2024-09-21T07:55:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.982+0000 7f476e000640 1 -- 172.21.15.84:0/1682529160 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a60fff1b90 con 0x55a60fd1e1b0 2024-09-21T07:55:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.984+0000 7f476e000640 1 -- 172.21.15.84:0/1682529160 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f47700075f0 con 0x55a60fd1e1b0 2024-09-21T07:55:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.984+0000 7f478dbce740 10 client.26806 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.984+0000 7f478dbce740 10 client.26806 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:55:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.985+0000 7f478dbce740 20 client.26806 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.985+0000 7f478dbce740 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fd059f0 0x55a61010b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.985+0000 7f478dbce740 4 client.26806 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.985+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a610066f00 con 0x55a60fd059f0 2024-09-21T07:55:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.986+0000 7f4777400640 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fd059f0 0x55a61010b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.987+0000 7f4777400640 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fd059f0 0x55a61010b4f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ce348e227ff5842 server_cookie=bf4cf5be2e0255fc in_seq=0 out_seq=0 2024-09-21T07:55:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.987+0000 7f476e000640 10 client.26806 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:13.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.988+0000 7f476e000640 1 -- 172.21.15.84:0/1682529160 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a610066f00 con 0x55a60fd059f0 2024-09-21T07:55:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.988+0000 7f476e000640 10 client.26806 handle_command_reply: tid=0 2024-09-21T07:55:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.988+0000 7f478dbce740 1 client.26806 shutdown 2024-09-21T07:55:13.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd1e1b0 msgr2=0x55a6100f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:13.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd1e1b0 0x55a6100f9580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4770015c20 tx=0x7f4770015c50 comp rx=0 tx=0).stop 2024-09-21T07:55:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 shutdown_connections 2024-09-21T07:55:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fd059f0 0x55a61010b4f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd47070 0x55a610105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a6100f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 --2- 172.21.15.84:0/1682529160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd1e1b0 0x55a6100f9580 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.991+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 >> 172.21.15.84:0/1682529160 conn(0x55a60fd3b460 msgr2=0x55a6100f0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.992+0000 7f476e000640 0 client.26806 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.994+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 shutdown_connections 2024-09-21T07:55:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.995+0000 7f478dbce740 1 -- 172.21.15.84:0/1682529160 wait complete. 2024-09-21T07:55:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:13.995+0000 7f478dbce740 20 client.26806 trim_cache size 0 max 16384 2024-09-21T07:55:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.035+0000 7f478dbce740 1 Processor -- start 2024-09-21T07:55:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.035+0000 7f478dbce740 1 -- start start 2024-09-21T07:55:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.039+0000 7f478dbce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.039+0000 7f478dbce740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd26390 0x55a6100f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.039+0000 7f478dbce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a6100f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.040+0000 7f477fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.040+0000 7f478dbce740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f475c00fdb0 con 0x55a60fd26390 2024-09-21T07:55:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.040+0000 7f478dbce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f475c0118f0 con 0x55a60fd1e1b0 2024-09-21T07:55:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.040+0000 7f478dbce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f475c010480 con 0x55a60fd47070 2024-09-21T07:55:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.040+0000 7f477fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48772/0 (socket says 172.21.15.84:48772) 2024-09-21T07:55:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.040+0000 7f477fe00640 1 -- 172.21.15.84:0/1621567830 learned_addr learned my addr 172.21.15.84:0/1621567830 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.040+0000 7f4784e00640 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a6100f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.041+0000 7f4777400640 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd26390 0x55a6100f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.041+0000 7f4784e00640 1 -- 172.21.15.84:0/1621567830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 msgr2=0x55a6100fb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.041+0000 7f4784e00640 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100fb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.041+0000 7f4784e00640 1 -- 172.21.15.84:0/1621567830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd26390 msgr2=0x55a6100f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.041+0000 7f4784e00640 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd26390 0x55a6100f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.041+0000 7f4784e00640 1 -- 172.21.15.84:0/1621567830 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6100f0090 con 0x55a60fd47070 2024-09-21T07:55:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.042+0000 7f4784e00640 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a6100f6cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4778105540 tx=0x7f47780cdad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb8217b445bf0534 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.043+0000 7f4774c00640 1 -- 172.21.15.84:0/1621567830 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47781059c0 con 0x55a60fd47070 2024-09-21T07:55:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.043+0000 7f4774c00640 1 -- 172.21.15.84:0/1621567830 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47780cd750 con 0x55a60fd47070 2024-09-21T07:55:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.043+0000 7f4774c00640 1 -- 172.21.15.84:0/1621567830 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47780ccea0 con 0x55a60fd47070 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.044+0000 7f478dbce740 1 -- 172.21.15.84:0/1621567830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 msgr2=0x55a6100f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.044+0000 7f478dbce740 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a6100f6cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4778105540 tx=0x7f47780cdad0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.044+0000 7f478dbce740 1 -- 172.21.15.84:0/1621567830 shutdown_connections 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.044+0000 7f478dbce740 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a6100f6cb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.044+0000 7f478dbce740 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd26390 0x55a6100f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.044+0000 7f478dbce740 1 --2- 172.21.15.84:0/1621567830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd1e1b0 0x55a6100fb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.044+0000 7f478dbce740 1 -- 172.21.15.84:0/1621567830 >> 172.21.15.84:0/1621567830 conn(0x55a60fd3b460 msgr2=0x55a6100faaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.046+0000 7f478dbce740 1 -- 172.21.15.84:0/1621567830 shutdown_connections 2024-09-21T07:55:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.046+0000 7f478dbce740 1 -- 172.21.15.84:0/1621567830 wait complete. 2024-09-21T07:55:14.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.047+0000 7f478dbce740 1 -- start start 2024-09-21T07:55:14.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.049+0000 7f478dbce740 1 Processor -- start 2024-09-21T07:55:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.050+0000 7f478dbce740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd1e1b0 0x55a61010cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.050+0000 7f478dbce740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a61010d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.050+0000 7f478dbce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a61016ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.050+0000 7f478dbce740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f475c011220 con 0x55a60fd1e1b0 2024-09-21T07:55:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.050+0000 7f478dbce740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f475c010b50 con 0x55a60fd26390 2024-09-21T07:55:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.051+0000 7f478dbce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f475c00dd70 con 0x55a60fd47070 2024-09-21T07:55:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.051+0000 7f4784e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a61016ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.051+0000 7f478dbce740 10 client.0 _ll_register_callbacks cb 0x7f47700158b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.051+0000 7f4777400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a61010d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.051+0000 7f4784e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a61016ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46642/0 (socket says 172.21.15.84:46642) 2024-09-21T07:55:14.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.051+0000 7f4784e00640 1 -- 172.21.15.84:0/158994321 learned_addr learned my addr 172.21.15.84:0/158994321 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:14.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.051+0000 7f477fe00640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd1e1b0 0x55a61010cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.055+0000 7f4777400640 1 -- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 msgr2=0x55a61016ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.055+0000 7f4777400640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a61016ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.055+0000 7f4777400640 1 -- 172.21.15.84:0/158994321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd1e1b0 msgr2=0x55a61010cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.055+0000 7f4777400640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd1e1b0 0x55a61010cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.055+0000 7f4777400640 1 -- 172.21.15.84:0/158994321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61016f2b0 con 0x55a60fd26390 2024-09-21T07:55:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.055+0000 7f4784e00640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a61016ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.055+0000 7f477fe00640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd1e1b0 0x55a61010cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.056+0000 7f476e000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.056+0000 7f4777400640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a61010d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4768009fd0 tx=0x7f4768004700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efbdb20cdef5e6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.057+0000 7f476e000640 1 -- 172.21.15.84:0/158994321 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768015860 con 0x55a60fd26390 2024-09-21T07:55:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.057+0000 7f476e000640 1 -- 172.21.15.84:0/158994321 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4768015a00 con 0x55a60fd26390 2024-09-21T07:55:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.057+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47780cd750 con 0x55a60fd26390 2024-09-21T07:55:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.058+0000 7f476e000640 1 -- 172.21.15.84:0/158994321 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4768015c00 con 0x55a60fd26390 2024-09-21T07:55:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.059+0000 7f478dbce740 10 client.26801 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.059+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a610176610 con 0x55a60fd26390 2024-09-21T07:55:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.059+0000 7f476e000640 1 -- 172.21.15.84:0/158994321 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47780cd750 con 0x55a60fd26390 2024-09-21T07:55:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.060+0000 7f476e000640 1 -- 172.21.15.84:0/158994321 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f476801e040 con 0x55a60fd26390 2024-09-21T07:55:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.060+0000 7f478dbce740 10 client.26801 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.060+0000 7f478dbce740 10 client.26801 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:55:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.060+0000 7f478dbce740 20 client.26801 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.060+0000 7f478dbce740 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fcdada0 0x55a610178dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.060+0000 7f478dbce740 4 client.26801 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.060+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6100629b0 con 0x55a60fcdada0 2024-09-21T07:55:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.062+0000 7f477fe00640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fcdada0 0x55a610178dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.062+0000 7f477fe00640 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fcdada0 0x55a610178dd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe646caf6ca9104f server_cookie=c2e8868754115070 in_seq=0 out_seq=0 2024-09-21T07:55:14.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.063+0000 7f476e000640 10 client.26801 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:14.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.063+0000 7f476e000640 1 -- 172.21.15.84:0/158994321 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6100629b0 con 0x55a60fcdada0 2024-09-21T07:55:14.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.063+0000 7f476e000640 10 client.26801 handle_command_reply: tid=0 2024-09-21T07:55:14.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.063+0000 7f478dbce740 1 client.26801 shutdown 2024-09-21T07:55:14.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.065+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 msgr2=0x55a61010d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:14.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.065+0000 7f478dbce740 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a61010d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4768009fd0 tx=0x7f4768004700 comp rx=0 tx=0).stop 2024-09-21T07:55:14.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 shutdown_connections 2024-09-21T07:55:14.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55a60fcdada0 0x55a610178dd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a60fd47070 0x55a61016ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a60fd26390 0x55a61010d390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 --2- 172.21.15.84:0/158994321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a60fd1e1b0 0x55a61010cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 >> 172.21.15.84:0/158994321 conn(0x55a60fd3b460 msgr2=0x55a6100eedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:14.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f476e000640 0 client.26801 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:14.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 shutdown_connections 2024-09-21T07:55:14.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.069+0000 7f478dbce740 1 -- 172.21.15.84:0/158994321 wait complete. 2024-09-21T07:55:14.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.070+0000 7f478dbce740 20 client.26801 trim_cache size 0 max 16384 2024-09-21T07:55:14.073 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.071+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47640b6880 msgr2=0x7f47640b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.071+0000 7f4786e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47640b6880 0x7f47640b8d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47680047b0 tx=0x7f47680092a0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.071+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478011cc30 msgr2=0x7f4780113cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.071+0000 7f4786e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478011cc30 0x7f4780113cd0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f477802a9b0 tx=0x7f4778003d60 comp rx=0 tx=0).stop 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.072+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 shutdown_connections 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.072+0000 7f4786e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f47640b6880 0x7f47640b8d90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.072+0000 7f4786e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f478011cc30 0x7f4780113cd0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.072+0000 7f4786e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4780111f40 0x7f4780113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.072+0000 7f4786e00640 1 --2- 172.21.15.84:0/3642227593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f478010a9e0 0x7f478011a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:14.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.072+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 >> 172.21.15.84:0/3642227593 conn(0x7f4780070ec0 msgr2=0x7f478011e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:14.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.072+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 shutdown_connections 2024-09-21T07:55:14.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:14.073+0000 7f4786e00640 1 -- 172.21.15.84:0/3642227593 wait complete. 2024-09-21T07:55:15.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:55:15.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:15 smithi162 ceph-mon[34833]: pgmap v518: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 41 KiB/s rd, 247 MiB/s wr, 1.11k op/s 2024-09-21T07:55:15.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:15 smithi084 ceph-mon[30411]: pgmap v518: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 41 KiB/s rd, 247 MiB/s wr, 1.11k op/s 2024-09-21T07:55:15.882 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:15.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:15 smithi191 ceph-mon[34667]: pgmap v518: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 41 KiB/s rd, 247 MiB/s wr, 1.11k op/s 2024-09-21T07:55:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.170+0000 7f2dc5c00640 1 -- 172.21.15.84:0/674805062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc0105cf0 msgr2=0x7f2dc0106100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.170+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/674805062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc0105cf0 0x7f2dc0106100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009900 tx=0x7f2dac02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.170+0000 7f2dc5c00640 1 -- 172.21.15.84:0/674805062 shutdown_connections 2024-09-21T07:55:16.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.170+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/674805062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dc010bf70 0x7f2dc01127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.170+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/674805062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2dc010b620 0x7f2dc010ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.170+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/674805062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc0105cf0 0x7f2dc0106100 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.170+0000 7f2dc5c00640 1 -- 172.21.15.84:0/674805062 >> 172.21.15.84:0/674805062 conn(0x7f2dc01016f0 msgr2=0x7f2dc0103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.171+0000 7f2dc5c00640 1 -- 172.21.15.84:0/674805062 shutdown_connections 2024-09-21T07:55:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.171+0000 7f2dc5c00640 1 -- 172.21.15.84:0/674805062 wait complete. 2024-09-21T07:55:16.176 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.172+0000 7f2dc5c00640 1 Processor -- start 2024-09-21T07:55:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.174+0000 7f2dc5c00640 1 -- start start 2024-09-21T07:55:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.174+0000 7f2dc5c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dc0105cf0 0x7f2dc006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dc5c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc010b620 0x7f2dc006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dc5c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2dc010bf70 0x7f2dc0073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dc5c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc00793d0 con 0x7f2dc0105cf0 2024-09-21T07:55:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dc5c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0079250 con 0x7f2dc010b620 2024-09-21T07:55:16.177 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dc5c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0079550 con 0x7f2dc010bf70 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dbe000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc010b620 0x7f2dc006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dbe000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc010b620 0x7f2dc006d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48802/0 (socket says 172.21.15.84:48802) 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dbe000640 1 -- 172.21.15.84:0/3774669469 learned_addr learned my addr 172.21.15.84:0/3774669469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.175+0000 7f2dbf400640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2dc010bf70 0x7f2dc0073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.176+0000 7f2dbea00640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dc0105cf0 0x7f2dc006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.176+0000 7f2dbe000640 1 -- 172.21.15.84:0/3774669469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2dc010bf70 msgr2=0x7f2dc0073e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.176+0000 7f2dbe000640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2dc010bf70 0x7f2dc0073e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.176+0000 7f2dbe000640 1 -- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dc0105cf0 msgr2=0x7f2dc006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.176+0000 7f2dbe000640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dc0105cf0 0x7f2dc006cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.176+0000 7f2dbe000640 1 -- 172.21.15.84:0/3774669469 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc0074380 con 0x7f2dc010b620 2024-09-21T07:55:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.176+0000 7f2dbe000640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc010b620 0x7f2dc006d340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2db000c970 tx=0x7f2db000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.178+0000 7f2db7400640 1 -- 172.21.15.84:0/3774669469 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0007bb0 con 0x7f2dc010b620 2024-09-21T07:55:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.178+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc0074610 con 0x7f2dc010b620 2024-09-21T07:55:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.178+0000 7f2db7400640 1 -- 172.21.15.84:0/3774669469 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db0007d50 con 0x7f2dc010b620 2024-09-21T07:55:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.178+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc0074bb0 con 0x7f2dc010b620 2024-09-21T07:55:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.178+0000 7f2db7400640 1 -- 172.21.15.84:0/3774669469 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0007bb0 con 0x7f2dc010b620 2024-09-21T07:55:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.184+0000 7f2dccc84740 1 Processor -- start 2024-09-21T07:55:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.184+0000 7f2dccc84740 1 -- start start 2024-09-21T07:55:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.185+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d582dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.185+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.185+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d582e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.185+0000 7f2dccc84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5596d57a36b0 con 0x5596d54684d0 2024-09-21T07:55:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.185+0000 7f2dccc84740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5596d5792ae0 con 0x5596d54891b0 2024-09-21T07:55:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.185+0000 7f2dccc84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5596d57968f0 con 0x5596d54602f0 2024-09-21T07:55:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.185+0000 7f2dbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d582dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.186+0000 7f2dbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d582dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48810/0 (socket says 172.21.15.84:48810) 2024-09-21T07:55:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.186+0000 7f2dbf400640 1 -- 172.21.15.84:0/1872814231 learned_addr learned my addr 172.21.15.84:0/1872814231 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.186+0000 7f2dbea00640 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.188+0000 7f2dbea00640 1 -- 172.21.15.84:0/1872814231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 msgr2=0x5596d582dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.188+0000 7f2dbea00640 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d582dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.188+0000 7f2dbea00640 1 -- 172.21.15.84:0/1872814231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 msgr2=0x5596d582e6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.188+0000 7f2dbea00640 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d582e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.188+0000 7f2dbea00640 1 -- 172.21.15.84:0/1872814231 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d575f780 con 0x5596d54602f0 2024-09-21T07:55:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.189+0000 7f2dbea00640 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582e170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009850 tx=0x7f2dac004370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=373c0947301b0120 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.190+0000 7f2db7400640 1 -- 172.21.15.84:0/3774669469 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2db0004c80 con 0x7f2dc010b620 2024-09-21T07:55:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.190+0000 7f2dabe00640 1 -- 172.21.15.84:0/1872814231 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac03f070 con 0x5596d54602f0 2024-09-21T07:55:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.192+0000 7f2dabe00640 1 -- 172.21.15.84:0/1872814231 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dac0046c0 con 0x5596d54602f0 2024-09-21T07:55:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.192+0000 7f2dabe00640 1 -- 172.21.15.84:0/1872814231 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac035070 con 0x5596d54602f0 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.192+0000 7f2db7400640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2da40b69c0 0x7f2da40b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.193+0000 7f2db7400640 1 -- 172.21.15.84:0/3774669469 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2db00e7260 con 0x7f2dc010b620 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.193+0000 7f2dccc84740 1 -- 172.21.15.84:0/1872814231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 msgr2=0x5596d582e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.193+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582e170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009850 tx=0x7f2dac004370 comp rx=0 tx=0).stop 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.194+0000 7f2dccc84740 1 -- 172.21.15.84:0/1872814231 shutdown_connections 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.194+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d582e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.194+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582e170 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.194+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1872814231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d582dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.194+0000 7f2dccc84740 1 -- 172.21.15.84:0/1872814231 >> 172.21.15.84:0/1872814231 conn(0x5596d547d300 msgr2=0x5596d582bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.194+0000 7f2dccc84740 1 -- 172.21.15.84:0/1872814231 shutdown_connections 2024-09-21T07:55:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.195+0000 7f2dccc84740 1 -- 172.21.15.84:0/1872814231 wait complete. 2024-09-21T07:55:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.195+0000 7f2dbf400640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2da40b69c0 0x7f2da40b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.195+0000 7f2dccc84740 1 -- start start 2024-09-21T07:55:16.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.196+0000 7f2dccc84740 1 Processor -- start 2024-09-21T07:55:16.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.198+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d5839200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.198+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d5839740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.199+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5839c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.199+0000 7f2dccc84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5596d56caab0 con 0x5596d54684d0 2024-09-21T07:55:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.199+0000 7f2dccc84740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5596d5739570 con 0x5596d54891b0 2024-09-21T07:55:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.199+0000 7f2dccc84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5596d583c350 con 0x5596d54602f0 2024-09-21T07:55:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.199+0000 7f2dccc84740 10 client.0 _ll_register_callbacks cb 0x5596d5748100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.199+0000 7f2dbf400640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2da40b69c0 0x7f2da40b8ed0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005c10 tx=0x7f2db80097e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.200+0000 7f2dbea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d5839200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.200+0000 7f2dbea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d5839200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46674/0 (socket says 172.21.15.84:46674) 2024-09-21T07:55:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.200+0000 7f2dbea00640 1 -- 172.21.15.84:0/3668747667 learned_addr learned my addr 172.21.15.84:0/3668747667 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.200+0000 7f2dbe000640 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d5839740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.200+0000 7f2dbf400640 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5839c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.201+0000 7f2dbe000640 1 -- 172.21.15.84:0/3668747667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 msgr2=0x5596d5839200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.201+0000 7f2dbe000640 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d5839200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.201+0000 7f2dbe000640 1 -- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 msgr2=0x5596d5839c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.201+0000 7f2dbe000640 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5839c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.201+0000 7f2dbe000640 1 -- 172.21.15.84:0/3668747667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d54f4790 con 0x5596d54684d0 2024-09-21T07:55:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.203+0000 7f2dbe000640 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d5839740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2db00e4640 tx=0x7f2db00ac750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33a492d824e2446 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.203+0000 7f2da8c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:55:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.204+0000 7f2da8c00640 1 -- 172.21.15.84:0/3668747667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db00b1020 con 0x5596d54684d0 2024-09-21T07:55:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.204+0000 7f2da8c00640 1 -- 172.21.15.84:0/3668747667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2db00d02d0 con 0x5596d54684d0 2024-09-21T07:55:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.204+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dac0046c0 con 0x5596d54684d0 2024-09-21T07:55:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.205+0000 7f2da8c00640 1 -- 172.21.15.84:0/3668747667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2db001d040 con 0x5596d54684d0 2024-09-21T07:55:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.205+0000 7f2dccc84740 10 client.16701 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.205+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596d556d620 con 0x5596d54684d0 2024-09-21T07:55:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2da8c00640 1 -- 172.21.15.84:0/3668747667 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dac0046c0 con 0x5596d54684d0 2024-09-21T07:55:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2da8c00640 1 -- 172.21.15.84:0/3668747667 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2db0092b10 con 0x5596d54684d0 2024-09-21T07:55:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2dccc84740 10 client.16701 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2dccc84740 10 client.16701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2dccc84740 20 client.16701 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2dccc84740 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d5447d80 0x5596d584b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2dccc84740 4 client.16701 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.206+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596d57a5600 con 0x5596d5447d80 2024-09-21T07:55:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.207+0000 7f2dbea00640 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d5447d80 0x5596d584b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.209+0000 7f2dbea00640 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d5447d80 0x5596d584b350 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89a14df353b31a7 server_cookie=961787b36d4079e3 in_seq=0 out_seq=0 2024-09-21T07:55:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.209+0000 7f2da8c00640 10 client.16701 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.211+0000 7f2da8c00640 1 -- 172.21.15.84:0/3668747667 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596d57a5600 con 0x5596d5447d80 2024-09-21T07:55:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.211+0000 7f2da8c00640 10 client.16701 handle_command_reply: tid=0 2024-09-21T07:55:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.211+0000 7f2dccc84740 1 client.16701 shutdown 2024-09-21T07:55:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.213+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 msgr2=0x5596d5839740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.213+0000 7f2dccc84740 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d5839740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2db00e4640 tx=0x7f2db00ac750 comp rx=0 tx=0).stop 2024-09-21T07:55:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 shutdown_connections 2024-09-21T07:55:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5839c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d5839740 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d5447d80 0x5596d584b350 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 --2- 172.21.15.84:0/3668747667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d5839200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.216 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 >> 172.21.15.84:0/3668747667 conn(0x5596d547d300 msgr2=0x5596d582ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2da8c00640 0 client.16701 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 shutdown_connections 2024-09-21T07:55:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 1 -- 172.21.15.84:0/3668747667 wait complete. 2024-09-21T07:55:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.214+0000 7f2dccc84740 20 client.16701 trim_cache size 0 max 16384 2024-09-21T07:55:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.252+0000 7f2dccc84740 1 Processor -- start 2024-09-21T07:55:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.252+0000 7f2dccc84740 1 -- start start 2024-09-21T07:55:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.253+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.253+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d583b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.253+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5844ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.253+0000 7f2dccc84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2da000fd50 con 0x5596d54684d0 2024-09-21T07:55:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.253+0000 7f2dccc84740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2da0011890 con 0x5596d54891b0 2024-09-21T07:55:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.253+0000 7f2dccc84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2da0010420 con 0x5596d54602f0 2024-09-21T07:55:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.254+0000 7f2dbe000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d583b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.254+0000 7f2dbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5844ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.254+0000 7f2dbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5844ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48832/0 (socket says 172.21.15.84:48832) 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.254+0000 7f2dbf400640 1 -- 172.21.15.84:0/1902941775 learned_addr learned my addr 172.21.15.84:0/1902941775 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.254+0000 7f2dbea00640 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.255+0000 7f2dbf400640 1 -- 172.21.15.84:0/1902941775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 msgr2=0x5596d582abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.255+0000 7f2dbf400640 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.255+0000 7f2dbf400640 1 -- 172.21.15.84:0/1902941775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 msgr2=0x5596d583b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.255+0000 7f2dbf400640 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d583b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.255+0000 7f2dbf400640 1 -- 172.21.15.84:0/1902941775 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d582bf60 con 0x5596d54891b0 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.256+0000 7f2dbf400640 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5844ca0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2db801e860 tx=0x7f2db8015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb071705511315a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.256+0000 7f2dab400640 1 -- 172.21.15.84:0/1902941775 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8029470 con 0x5596d54891b0 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.256+0000 7f2dab400640 1 -- 172.21.15.84:0/1902941775 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db8029ac0 con 0x5596d54891b0 2024-09-21T07:55:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.256+0000 7f2dab400640 1 -- 172.21.15.84:0/1902941775 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db801ca90 con 0x5596d54891b0 2024-09-21T07:55:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.258+0000 7f2dccc84740 1 -- 172.21.15.84:0/1902941775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 msgr2=0x5596d5844ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.258+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5844ca0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2db801e860 tx=0x7f2db8015000 comp rx=0 tx=0).stop 2024-09-21T07:55:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.258+0000 7f2dccc84740 1 -- 172.21.15.84:0/1902941775 shutdown_connections 2024-09-21T07:55:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.259+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54891b0 0x5596d5844ca0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.259+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54684d0 0x5596d583b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.259+0000 7f2dccc84740 1 --2- 172.21.15.84:0/1902941775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54602f0 0x5596d582abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.259+0000 7f2dccc84740 1 -- 172.21.15.84:0/1902941775 >> 172.21.15.84:0/1902941775 conn(0x5596d547d300 msgr2=0x5596d5844590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.259+0000 7f2dccc84740 1 -- 172.21.15.84:0/1902941775 shutdown_connections 2024-09-21T07:55:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.259+0000 7f2dccc84740 1 -- 172.21.15.84:0/1902941775 wait complete. 2024-09-21T07:55:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.259+0000 7f2dccc84740 1 -- start start 2024-09-21T07:55:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 1 Processor -- start 2024-09-21T07:55:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54602f0 0x5596d583f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54684d0 0x5596d583fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54891b0 0x5596d5840260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2da00111c0 con 0x5596d54602f0 2024-09-21T07:55:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2da0010af0 con 0x5596d54684d0 2024-09-21T07:55:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2da000dd10 con 0x5596d54891b0 2024-09-21T07:55:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.260+0000 7f2dccc84740 10 client.0 _ll_register_callbacks cb 0x7f2db0007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.261+0000 7f2dbf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54891b0 0x5596d5840260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.261+0000 7f2dbf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54891b0 0x5596d5840260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46682/0 (socket says 172.21.15.84:46682) 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.261+0000 7f2dbf400640 1 -- 172.21.15.84:0/2915048490 learned_addr learned my addr 172.21.15.84:0/2915048490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.261+0000 7f2dbe000640 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54684d0 0x5596d583fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.261+0000 7f2dbea00640 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54602f0 0x5596d583f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.262+0000 7f2dbf400640 1 -- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54684d0 msgr2=0x5596d583fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.262+0000 7f2dbf400640 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54684d0 0x5596d583fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.262+0000 7f2dbf400640 1 -- 172.21.15.84:0/2915048490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54602f0 msgr2=0x5596d583f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.262+0000 7f2dbf400640 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54602f0 0x5596d583f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.262+0000 7f2dbf400640 1 -- 172.21.15.84:0/2915048490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d58b4ee0 con 0x5596d54891b0 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.262+0000 7f2dbf400640 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54891b0 0x5596d5840260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2db80296a0 tx=0x7f2db80296d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9266cafaebc45fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.262+0000 7f2da8c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.263+0000 7f2da8c00640 1 -- 172.21.15.84:0/2915048490 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80298f0 con 0x5596d54891b0 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.263+0000 7f2da8c00640 1 -- 172.21.15.84:0/2915048490 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f2db8025040 con 0x5596d54891b0 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.263+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2db8029ac0 con 0x5596d54891b0 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.263+0000 7f2da8c00640 1 -- 172.21.15.84:0/2915048490 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2db803d050 con 0x5596d54891b0 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.263+0000 7f2dccc84740 10 client.26827 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:16.265 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.263+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596d58b6170 con 0x5596d54891b0 2024-09-21T07:55:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.263+0000 7f2da8c00640 1 -- 172.21.15.84:0/2915048490 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db8029ac0 con 0x5596d54891b0 2024-09-21T07:55:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.264+0000 7f2da8c00640 1 -- 172.21.15.84:0/2915048490 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2db800f040 con 0x5596d54891b0 2024-09-21T07:55:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.265+0000 7f2dccc84740 10 client.26827 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:16.266 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.265+0000 7f2dccc84740 10 client.26827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.265+0000 7f2dccc84740 20 client.26827 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.265+0000 7f2dccc84740 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d541d1c0 0x5596d58b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.265+0000 7f2dccc84740 4 client.26827 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:55:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.265+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5596d57a10b0 con 0x5596d541d1c0 2024-09-21T07:55:16.267 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.265+0000 7f2dbea00640 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d541d1c0 0x5596d58b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.266+0000 7f2dbea00640 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d541d1c0 0x5596d58b8830 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d75a17575a19566 server_cookie=5e5b043859798937 in_seq=0 out_seq=0 2024-09-21T07:55:16.268 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.266+0000 7f2da8c00640 10 client.26827 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.576+0000 7f2da8c00640 1 -- 172.21.15.84:0/2915048490 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596d57a10b0 con 0x5596d541d1c0 2024-09-21T07:55:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.576+0000 7f2da8c00640 10 client.26827 handle_command_reply: tid=0 2024-09-21T07:55:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.576+0000 7f2dccc84740 1 client.26827 shutdown 2024-09-21T07:55:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.576+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54891b0 msgr2=0x5596d5840260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.576+0000 7f2dccc84740 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54891b0 0x5596d5840260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2db80296a0 tx=0x7f2db80296d0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 shutdown_connections 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5596d541d1c0 0x5596d58b8830 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596d54891b0 0x5596d5840260 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596d54684d0 0x5596d583fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 --2- 172.21.15.84:0/2915048490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d54602f0 0x5596d583f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 >> 172.21.15.84:0/2915048490 conn(0x5596d547d300 msgr2=0x5596d583ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2da8c00640 0 client.26827 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 shutdown_connections 2024-09-21T07:55:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.577+0000 7f2dccc84740 1 -- 172.21.15.84:0/2915048490 wait complete. 2024-09-21T07:55:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.578+0000 7f2dccc84740 20 client.26827 trim_cache size 0 max 16384 2024-09-21T07:55:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:55:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:55:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:55:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:55:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2da40b69c0 msgr2=0x7f2da40b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2da40b69c0 0x7f2da40b8ed0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005c10 tx=0x7f2db80097e0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc010b620 msgr2=0x7f2dc006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc010b620 0x7f2dc006d340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2db000c970 tx=0x7f2db000ce30 comp rx=0 tx=0).stop 2024-09-21T07:55:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 shutdown_connections 2024-09-21T07:55:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2da40b69c0 0x7f2da40b8ed0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2dc010bf70 0x7f2dc0073e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc010b620 0x7f2dc006d340 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 --2- 172.21.15.84:0/3774669469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2dc0105cf0 0x7f2dc006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 >> 172.21.15.84:0/3774669469 conn(0x7f2dc01016f0 msgr2=0x7f2dc0101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 shutdown_connections 2024-09-21T07:55:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:16.579+0000 7f2dc5c00640 1 -- 172.21.15.84:0/3774669469 wait complete. 2024-09-21T07:55:16.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:16 smithi162 ceph-mon[34833]: pgmap v519: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 38 KiB/s rd, 199 MiB/s wr, 1.03k op/s 2024-09-21T07:55:16.802 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:16 smithi084 ceph-mon[30411]: pgmap v519: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 38 KiB/s rd, 199 MiB/s wr, 1.03k op/s 2024-09-21T07:55:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.795+0000 7fb0a6000640 1 -- 172.21.15.84:0/3682620293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01039b0 msgr2=0x7fb0a0103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.795+0000 7fb0a6000640 1 --2- 172.21.15.84:0/3682620293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01039b0 0x7fb0a0103dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb094009900 tx=0x7fb09402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.796+0000 7fb0a6000640 1 -- 172.21.15.84:0/3682620293 shutdown_connections 2024-09-21T07:55:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.796+0000 7fb0a6000640 1 --2- 172.21.15.84:0/3682620293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a0109c40 0x7fb0a0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.796+0000 7fb0a6000640 1 --2- 172.21.15.84:0/3682620293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a01092f0 0x7fb0a0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.796+0000 7fb0a6000640 1 --2- 172.21.15.84:0/3682620293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01039b0 0x7fb0a0103dc0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb094009900 tx=0x7fb09402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.796+0000 7fb0a6000640 1 -- 172.21.15.84:0/3682620293 >> 172.21.15.84:0/3682620293 conn(0x7fb0a00ff440 msgr2=0x7fb0a0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.798+0000 7fb0a6000640 1 -- 172.21.15.84:0/3682620293 shutdown_connections 2024-09-21T07:55:16.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.800+0000 7fb0a6000640 1 -- 172.21.15.84:0/3682620293 wait complete. 2024-09-21T07:55:16.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.802+0000 7fb0a6000640 1 Processor -- start 2024-09-21T07:55:16.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.802+0000 7fb0a6000640 1 -- start start 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.803+0000 7fb0a6000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01092f0 0x7fb0a010a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.803+0000 7fb0a6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a0109c40 0x7fb0a010a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.803+0000 7fb0a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a010aea0 0x7fb0a01acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.803+0000 7fb0a6000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0113950 con 0x7fb0a010aea0 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.803+0000 7fb0a6000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01137d0 con 0x7fb0a0109c40 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.803+0000 7fb0a6000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0113ad0 con 0x7fb0a01092f0 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.803+0000 7fb0a4c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01092f0 0x7fb0a010a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb09fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a0109c40 0x7fb0a010a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a4c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01092f0 0x7fb0a010a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46688/0 (socket says 172.21.15.84:46688) 2024-09-21T07:55:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a4c00640 1 -- 172.21.15.84:0/1985450675 learned_addr learned my addr 172.21.15.84:0/1985450675 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a5600640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a010aea0 0x7fb0a01acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a4c00640 1 -- 172.21.15.84:0/1985450675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a0109c40 msgr2=0x7fb0a010a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a4c00640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a0109c40 0x7fb0a010a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a4c00640 1 -- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a010aea0 msgr2=0x7fb0a01acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a4c00640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a010aea0 0x7fb0a01acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb0a4c00640 1 -- 172.21.15.84:0/1985450675 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a01ad130 con 0x7fb0a01092f0 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.804+0000 7fb09fe00640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a0109c40 0x7fb0a010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.805+0000 7fb0a5600640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a010aea0 0x7fb0a01acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:16.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.806+0000 7fb0a4c00640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01092f0 0x7fb0a010a420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb09402a9e0 tx=0x7fb094003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.807+0000 7fb09d600640 1 -- 172.21.15.84:0/1985450675 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09403f020 con 0x7fb0a01092f0 2024-09-21T07:55:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.807+0000 7fb09d600640 1 -- 172.21.15.84:0/1985450675 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb094031d60 con 0x7fb0a01092f0 2024-09-21T07:55:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.807+0000 7fb09d600640 1 -- 172.21.15.84:0/1985450675 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094035070 con 0x7fb0a01092f0 2024-09-21T07:55:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.807+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a01ad300 con 0x7fb0a01092f0 2024-09-21T07:55:16.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.809+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a01ad760 con 0x7fb0a01092f0 2024-09-21T07:55:16.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.814+0000 7fb0ae23c740 1 Processor -- start 2024-09-21T07:55:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.814+0000 7fb0ae23c740 1 -- start start 2024-09-21T07:55:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c4e070 0x55c723ff4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c251b0 0x55c723ff54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c2d390 0x55c723ff59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c723f6bfb0 con 0x55c723c251b0 2024-09-21T07:55:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c723f5b3e0 con 0x55c723c4e070 2024-09-21T07:55:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c723f5f1f0 con 0x55c723c2d390 2024-09-21T07:55:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c4e070 0x55c723ff4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c4e070 0x55c723ff4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48856/0 (socket says 172.21.15.84:48856) 2024-09-21T07:55:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb0a5600640 1 -- 172.21.15.84:0/1526318605 learned_addr learned my addr 172.21.15.84:0/1526318605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.815+0000 7fb09d600640 1 -- 172.21.15.84:0/1985450675 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb094042020 con 0x7fb0a01092f0 2024-09-21T07:55:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.816+0000 7fb0a5600640 1 -- 172.21.15.84:0/1526318605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c2d390 msgr2=0x55c723ff59f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.817+0000 7fb0a5600640 1 --2- 172.21.15.84:0/1526318605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c2d390 0x55c723ff59f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.817+0000 7fb0a5600640 1 -- 172.21.15.84:0/1526318605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c251b0 msgr2=0x55c723ff54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.817+0000 7fb0a5600640 1 --2- 172.21.15.84:0/1526318605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c251b0 0x55c723ff54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.817+0000 7fb0a5600640 1 -- 172.21.15.84:0/1526318605 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c723f25cd0 con 0x55c723c4e070 2024-09-21T07:55:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.817+0000 7fb0a5600640 1 --2- 172.21.15.84:0/1526318605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c4e070 0x55c723ff4f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb098009f10 tx=0x7fb09800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4270478ea93a9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.818+0000 7fb091c00640 1 -- 172.21.15.84:0/1526318605 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098003b70 con 0x55c723c4e070 2024-09-21T07:55:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.818+0000 7fb091c00640 1 -- 172.21.15.84:0/1526318605 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb098003d10 con 0x55c723c4e070 2024-09-21T07:55:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.818+0000 7fb091c00640 1 -- 172.21.15.84:0/1526318605 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0980119c0 con 0x55c723c4e070 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb0ae23c740 1 -- 172.21.15.84:0/1526318605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c4e070 msgr2=0x55c723ff4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/1526318605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c4e070 0x55c723ff4f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb098009f10 tx=0x7fb09800f730 comp rx=0 tx=0).stop 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb09d600640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb0880b67d0 0x7fb0880b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb0ae23c740 1 -- 172.21.15.84:0/1526318605 shutdown_connections 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/1526318605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c2d390 0x55c723ff59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/1526318605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c251b0 0x55c723ff54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/1526318605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c4e070 0x55c723ff4f70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb0ae23c740 1 -- 172.21.15.84:0/1526318605 >> 172.21.15.84:0/1526318605 conn(0x55c723c42460 msgr2=0x55c723ff2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.820+0000 7fb09d600640 1 -- 172.21.15.84:0/1985450675 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb0941082c0 con 0x7fb0a01092f0 2024-09-21T07:55:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.821+0000 7fb0a4c00640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb0880b67d0 0x7fb0880b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.821+0000 7fb0ae23c740 1 -- 172.21.15.84:0/1526318605 shutdown_connections 2024-09-21T07:55:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.821+0000 7fb0ae23c740 1 -- 172.21.15.84:0/1526318605 wait complete. 2024-09-21T07:55:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.822+0000 7fb0ae23c740 1 -- start start 2024-09-21T07:55:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.822+0000 7fb0ae23c740 1 Processor -- start 2024-09-21T07:55:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.823+0000 7fb0a4c00640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb0880b67d0 0x7fb0880b8ce0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c723ff3bf0 tx=0x7fb09402a3f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.823+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c7240007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.823+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724000ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.824+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c72401da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.824+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c723dbc700 con 0x55c723c4e070 2024-09-21T07:55:16.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.824+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c723ef6580 con 0x55c723c2d390 2024-09-21T07:55:16.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.824+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c724014760 con 0x55c723c251b0 2024-09-21T07:55:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.824+0000 7fb0ae23c740 10 client.0 _ll_register_callbacks cb 0x55c723f06470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.825+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c7240007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.825+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c7240007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46696/0 (socket says 172.21.15.84:46696) 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.825+0000 7fb0a5600640 1 -- 172.21.15.84:0/4228865230 learned_addr learned my addr 172.21.15.84:0/4228865230 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.825+0000 7fb0a5600640 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c72401da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.825+0000 7fb09fe00640 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724000ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.826+0000 7fb0a5600640 1 -- 172.21.15.84:0/4228865230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 msgr2=0x55c724000ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.826+0000 7fb0a5600640 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724000ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.826+0000 7fb0a5600640 1 -- 172.21.15.84:0/4228865230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 msgr2=0x55c72401da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.826+0000 7fb0a5600640 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c72401da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.826+0000 7fb0a5600640 1 -- 172.21.15.84:0/4228865230 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c723cb9650 con 0x55c723c251b0 2024-09-21T07:55:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.826+0000 7fb0a5600640 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c7240007a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb098009ee0 tx=0x7fb098011620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57fb800721383984 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.826+0000 7fb086000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.827+0000 7fb086000640 1 -- 172.21.15.84:0/4228865230 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098024040 con 0x55c723c251b0 2024-09-21T07:55:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.828+0000 7fb086000640 1 -- 172.21.15.84:0/4228865230 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb098004a40 con 0x55c723c251b0 2024-09-21T07:55:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.828+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c723ef8b90 con 0x55c723c251b0 2024-09-21T07:55:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.829+0000 7fb086000640 1 -- 172.21.15.84:0/4228865230 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb09802b430 con 0x55c723c251b0 2024-09-21T07:55:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.829+0000 7fb0ae23c740 10 client.26836 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.829+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c723f13950 con 0x55c723c251b0 2024-09-21T07:55:16.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.830+0000 7fb086000640 1 -- 172.21.15.84:0/4228865230 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c723ef8b90 con 0x55c723c251b0 2024-09-21T07:55:16.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.830+0000 7fb086000640 1 -- 172.21.15.84:0/4228865230 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb098035540 con 0x55c723c251b0 2024-09-21T07:55:16.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.831+0000 7fb0ae23c740 10 client.26836 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:16.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.831+0000 7fb0ae23c740 10 client.26836 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:55:16.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.831+0000 7fb0ae23c740 20 client.26836 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:16.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.831+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723c0c9f0 0x55c724023780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.831+0000 7fb0ae23c740 4 client.26836 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:16.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.831+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c723f6df00 con 0x55c723c0c9f0 2024-09-21T07:55:16.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.832+0000 7fb09fe00640 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723c0c9f0 0x55c724023780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.833+0000 7fb09fe00640 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723c0c9f0 0x55c724023780 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43c3862aa42dd3e4 server_cookie=16086a05acb00ffd in_seq=0 out_seq=0 2024-09-21T07:55:16.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.833+0000 7fb086000640 10 client.26836 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:55:16.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.834+0000 7fb086000640 1 -- 172.21.15.84:0/4228865230 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c723f6df00 con 0x55c723c0c9f0 2024-09-21T07:55:16.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.834+0000 7fb086000640 10 client.26836 handle_command_reply: tid=0 2024-09-21T07:55:16.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.835+0000 7fb0ae23c740 1 client.26836 shutdown 2024-09-21T07:55:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.836+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 msgr2=0x55c7240007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.836+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c7240007a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb098009ee0 tx=0x7fb098011620 comp rx=0 tx=0).stop 2024-09-21T07:55:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 shutdown_connections 2024-09-21T07:55:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723c0c9f0 0x55c724023780 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c72401da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724000ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/4228865230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c7240007a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 >> 172.21.15.84:0/4228865230 conn(0x55c723c42460 msgr2=0x55c723ff8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb086000640 0 client.26836 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:55:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.837+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 shutdown_connections 2024-09-21T07:55:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.838+0000 7fb0ae23c740 1 -- 172.21.15.84:0/4228865230 wait complete. 2024-09-21T07:55:16.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.838+0000 7fb0ae23c740 20 client.26836 trim_cache size 0 max 16384 2024-09-21T07:55:16.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.865+0000 7fb0ae23c740 1 Processor -- start 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.865+0000 7fb0ae23c740 1 -- start start 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.865+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c723ff66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c72401d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c723ffda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01af160 con 0x55c723c4e070 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01b0ca0 con 0x55c723c2d390 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01af830 con 0x55c723c251b0 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c72401d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c72401d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48870/0 (socket says 172.21.15.84:48870) 2024-09-21T07:55:16.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 -- 172.21.15.84:0/3315367159 learned_addr learned my addr 172.21.15.84:0/3315367159 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb0a5600640 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c723ff66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 -- 172.21.15.84:0/3315367159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 msgr2=0x55c723ff66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c723ff66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 -- 172.21.15.84:0/3315367159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 msgr2=0x55c723ffda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c723ffda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.866+0000 7fb09fe00640 1 -- 172.21.15.84:0/3315367159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c723fff760 con 0x55c723c2d390 2024-09-21T07:55:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.867+0000 7fb09fe00640 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c72401d9f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb08c005360 tx=0x7fb08c004b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e41e18915887cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.867+0000 7fb091200640 1 -- 172.21.15.84:0/3315367159 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c005510 con 0x55c723c2d390 2024-09-21T07:55:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.868+0000 7fb091200640 1 -- 172.21.15.84:0/3315367159 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb08c011a90 con 0x55c723c2d390 2024-09-21T07:55:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.868+0000 7fb091200640 1 -- 172.21.15.84:0/3315367159 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c005510 con 0x55c723c2d390 2024-09-21T07:55:16.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.869+0000 7fb0ae23c740 1 -- 172.21.15.84:0/3315367159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 msgr2=0x55c72401d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.869+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c72401d9f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb08c005360 tx=0x7fb08c004b00 comp rx=0 tx=0).stop 2024-09-21T07:55:16.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.870+0000 7fb0ae23c740 1 -- 172.21.15.84:0/3315367159 shutdown_connections 2024-09-21T07:55:16.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.870+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c723ffda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.870+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c72401d9f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.870+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/3315367159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c723ff66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.870+0000 7fb0ae23c740 1 -- 172.21.15.84:0/3315367159 >> 172.21.15.84:0/3315367159 conn(0x55c723c42460 msgr2=0x55c723ff5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.870+0000 7fb0ae23c740 1 -- 172.21.15.84:0/3315367159 shutdown_connections 2024-09-21T07:55:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.870+0000 7fb0ae23c740 1 -- 172.21.15.84:0/3315367159 wait complete. 2024-09-21T07:55:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.871+0000 7fb0ae23c740 1 -- start start 2024-09-21T07:55:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.871+0000 7fb0ae23c740 1 Processor -- start 2024-09-21T07:55:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.872+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c724022830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.872+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724022d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.872+0000 7fb0ae23c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c7240232b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.872+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01b05d0 con 0x55c723c4e070 2024-09-21T07:55:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.872+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01aff00 con 0x55c723c2d390 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.872+0000 7fb0ae23c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01a4470 con 0x55c723c251b0 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.872+0000 7fb0ae23c740 10 client.0 _ll_register_callbacks cb 0x7fb098012a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c724022830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb09fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724022d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c724022830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46708/0 (socket says 172.21.15.84:46708) 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb0a5600640 1 -- 172.21.15.84:0/748624976 learned_addr learned my addr 172.21.15.84:0/748624976 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb0a5600640 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c7240232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb09fe00640 1 -- 172.21.15.84:0/748624976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 msgr2=0x55c724022830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb09fe00640 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c724022830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb09fe00640 1 -- 172.21.15.84:0/748624976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 msgr2=0x55c7240232b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:16.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb09fe00640 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c7240232b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.873+0000 7fb09fe00640 1 -- 172.21.15.84:0/748624976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c72408cfa0 con 0x55c723c2d390 2024-09-21T07:55:16.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.874+0000 7fb0a5600640 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c7240232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:16.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.874+0000 7fb09fe00640 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724022d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55c724029be0 tx=0x7fb08c005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e58242547f9c277b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:16.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.875+0000 7fb086000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:16.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.875+0000 7fb086000640 1 -- 172.21.15.84:0/748624976 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c005510 con 0x55c723c2d390 2024-09-21T07:55:16.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.875+0000 7fb086000640 1 -- 172.21.15.84:0/748624976 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fb08c01f040 con 0x55c723c2d390 2024-09-21T07:55:16.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.875+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb08c011a90 con 0x55c723c2d390 2024-09-21T07:55:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.876+0000 7fb086000640 1 -- 172.21.15.84:0/748624976 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb08c03a050 con 0x55c723c2d390 2024-09-21T07:55:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.876+0000 7fb0ae23c740 10 client.26837 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.876+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c72408e220 con 0x55c723c2d390 2024-09-21T07:55:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.876+0000 7fb086000640 1 -- 172.21.15.84:0/748624976 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb08c011a90 con 0x55c723c2d390 2024-09-21T07:55:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.876+0000 7fb086000640 1 -- 172.21.15.84:0/748624976 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb08c02c7b0 con 0x55c723c2d390 2024-09-21T07:55:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.877+0000 7fb0ae23c740 10 client.26837 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.877+0000 7fb0ae23c740 10 client.26837 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:55:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.877+0000 7fb0ae23c740 20 client.26837 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.877+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723be1da0 0x55c724090990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.877+0000 7fb0ae23c740 4 client.26837 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.877+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c723f699b0 con 0x55c723be1da0 2024-09-21T07:55:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.878+0000 7fb0a5600640 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723be1da0 0x55c724090990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.878+0000 7fb0a5600640 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723be1da0 0x55c724090990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e778370e6cf01542 server_cookie=dfa9aac8f973af03 in_seq=0 out_seq=0 2024-09-21T07:55:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.878+0000 7fb086000640 10 client.26837 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:55:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb086000640 1 -- 172.21.15.84:0/748624976 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c723f699b0 con 0x55c723be1da0 2024-09-21T07:55:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb086000640 10 client.26837 handle_command_reply: tid=0 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 client.26837 shutdown 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 msgr2=0x55c724022d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724022d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55c724029be0 tx=0x7fb08c005780 comp rx=0 tx=0).stop 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 shutdown_connections 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55c723be1da0 0x55c724090990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c723c4e070 0x55c7240232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c723c2d390 0x55c724022d70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 --2- 172.21.15.84:0/748624976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c723c251b0 0x55c724022830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 >> 172.21.15.84:0/748624976 conn(0x55c723c42460 msgr2=0x55c723ff2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.879+0000 7fb086000640 0 client.26837 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:55:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.880+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 shutdown_connections 2024-09-21T07:55:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.880+0000 7fb0ae23c740 1 -- 172.21.15.84:0/748624976 wait complete. 2024-09-21T07:55:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.880+0000 7fb0ae23c740 20 client.26837 trim_cache size 0 max 16384 2024-09-21T07:55:16.883 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb0880b67d0 msgr2=0x7fb0880b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb0880b67d0 0x7fb0880b8ce0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c723ff3bf0 tx=0x7fb09402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01092f0 msgr2=0x7fb0a010a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01092f0 0x7fb0a010a420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb09402a9e0 tx=0x7fb094003c80 comp rx=0 tx=0).stop 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 shutdown_connections 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb0880b67d0 0x7fb0880b8ce0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0a010aea0 0x7fb0a01acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0a0109c40 0x7fb0a010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 --2- 172.21.15.84:0/1985450675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0a01092f0 0x7fb0a010a420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 >> 172.21.15.84:0/1985450675 conn(0x7fb0a00ff440 msgr2=0x7fb0a0108a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.883+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 shutdown_connections 2024-09-21T07:55:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:16.884+0000 7fb0a6000640 1 -- 172.21.15.84:0/1985450675 wait complete. 2024-09-21T07:55:16.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:16 smithi191 ceph-mon[34667]: pgmap v519: 129 pgs: 129 active+clean; 25 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 38 KiB/s rd, 199 MiB/s wr, 1.03k op/s 2024-09-21T07:55:19.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:19 smithi162 ceph-mon[34833]: pgmap v520: 129 pgs: 129 active+clean; 25 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 24 KiB/s rd, 215 MiB/s wr, 1.31k op/s 2024-09-21T07:55:19.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:19 smithi084 ceph-mon[30411]: pgmap v520: 129 pgs: 129 active+clean; 25 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 24 KiB/s rd, 215 MiB/s wr, 1.31k op/s 2024-09-21T07:55:19.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:19 smithi191 ceph-mon[34667]: pgmap v520: 129 pgs: 129 active+clean; 25 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 24 KiB/s rd, 215 MiB/s wr, 1.31k op/s 2024-09-21T07:55:21.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:21 smithi191 ceph-mon[34667]: pgmap v521: 129 pgs: 129 active+clean; 26 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 33 KiB/s rd, 216 MiB/s wr, 1.66k op/s 2024-09-21T07:55:21.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:21 smithi162 ceph-mon[34833]: pgmap v521: 129 pgs: 129 active+clean; 26 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 33 KiB/s rd, 216 MiB/s wr, 1.66k op/s 2024-09-21T07:55:21.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:21 smithi084 ceph-mon[30411]: pgmap v521: 129 pgs: 129 active+clean; 26 GiB data, 53 GiB used, 1019 GiB / 1.0 TiB avail; 33 KiB/s rd, 216 MiB/s wr, 1.66k op/s 2024-09-21T07:55:23.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:23 smithi191 ceph-mon[34667]: pgmap v522: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 18 KiB/s rd, 191 MiB/s wr, 1.73k op/s 2024-09-21T07:55:23.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:23 smithi162 ceph-mon[34833]: pgmap v522: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 18 KiB/s rd, 191 MiB/s wr, 1.73k op/s 2024-09-21T07:55:23.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:23 smithi084 ceph-mon[30411]: pgmap v522: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 18 KiB/s rd, 191 MiB/s wr, 1.73k op/s 2024-09-21T07:55:25.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:25 smithi191 ceph-mon[34667]: pgmap v523: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 88 KiB/s rd, 204 MiB/s wr, 1.96k op/s 2024-09-21T07:55:25.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:25 smithi162 ceph-mon[34833]: pgmap v523: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 88 KiB/s rd, 204 MiB/s wr, 1.96k op/s 2024-09-21T07:55:25.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:25 smithi084 ceph-mon[30411]: pgmap v523: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 88 KiB/s rd, 204 MiB/s wr, 1.96k op/s 2024-09-21T07:55:27.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:27 smithi191 ceph-mon[34667]: pgmap v524: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 89 KiB/s rd, 202 MiB/s wr, 1.94k op/s 2024-09-21T07:55:27.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:27 smithi162 ceph-mon[34833]: pgmap v524: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 89 KiB/s rd, 202 MiB/s wr, 1.94k op/s 2024-09-21T07:55:27.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:27 smithi084 ceph-mon[30411]: pgmap v524: 129 pgs: 129 active+clean; 26 GiB data, 54 GiB used, 1018 GiB / 1.0 TiB avail; 89 KiB/s rd, 202 MiB/s wr, 1.94k op/s 2024-09-21T07:55:29.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:55:29.620 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:29 smithi084 ceph-mon[30411]: pgmap v525: 129 pgs: 129 active+clean; 26 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 83 KiB/s rd, 213 MiB/s wr, 2.04k op/s 2024-09-21T07:55:29.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:29 smithi191 ceph-mon[34667]: pgmap v525: 129 pgs: 129 active+clean; 26 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 83 KiB/s rd, 213 MiB/s wr, 2.04k op/s 2024-09-21T07:55:29.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:29 smithi162 ceph-mon[34833]: pgmap v525: 129 pgs: 129 active+clean; 26 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 83 KiB/s rd, 213 MiB/s wr, 2.04k op/s 2024-09-21T07:55:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.880+0000 7f8026200640 1 -- 172.21.15.84:0/540729956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 msgr2=0x7f8020103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.880+0000 7f8026200640 1 --2- 172.21.15.84:0/540729956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 0x7f8020103d20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8014009900 tx=0x7f801402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.880+0000 7f8026200640 1 -- 172.21.15.84:0/540729956 shutdown_connections 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.880+0000 7f8026200640 1 --2- 172.21.15.84:0/540729956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8020109b90 0x7f80201103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.880+0000 7f8026200640 1 --2- 172.21.15.84:0/540729956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8020109240 0x7f8020109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.880+0000 7f8026200640 1 --2- 172.21.15.84:0/540729956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 0x7f8020103d20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.880+0000 7f8026200640 1 -- 172.21.15.84:0/540729956 >> 172.21.15.84:0/540729956 conn(0x7f80200ff330 msgr2=0x7f8020101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.881+0000 7f8026200640 1 -- 172.21.15.84:0/540729956 shutdown_connections 2024-09-21T07:55:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.881+0000 7f8026200640 1 -- 172.21.15.84:0/540729956 wait complete. 2024-09-21T07:55:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 Processor -- start 2024-09-21T07:55:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 -- start start 2024-09-21T07:55:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 0x7f802019c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8020109240 0x7f802019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8020109b90 0x7f80201a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8020113850 con 0x7f8020103910 2024-09-21T07:55:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80201136d0 con 0x7f8020109b90 2024-09-21T07:55:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.882+0000 7f8026200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80201139d0 con 0x7f8020109240 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f8024e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 0x7f802019c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f8025800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8020109b90 0x7f80201a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f8025800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8020109b90 0x7f80201a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:49140/0 (socket says 172.21.15.84:49140) 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f8025800640 1 -- 172.21.15.84:0/2245004394 learned_addr learned my addr 172.21.15.84:0/2245004394 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f8024e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 0x7f802019c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56948/0 (socket says 172.21.15.84:56948) 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f801fe00640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8020109240 0x7f802019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f801fe00640 1 -- 172.21.15.84:0/2245004394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8020109b90 msgr2=0x7f80201a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f801fe00640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8020109b90 0x7f80201a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f801fe00640 1 -- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 msgr2=0x7f802019c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f801fe00640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 0x7f802019c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f801fe00640 1 -- 172.21.15.84:0/2245004394 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80201a24a0 con 0x7f8020109240 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.883+0000 7f801fe00640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8020109240 0x7f802019cb10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f802006c690 tx=0x7f800c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.884+0000 7f801d600640 1 -- 172.21.15.84:0/2245004394 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c00cc40 con 0x7f8020109240 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.884+0000 7f801d600640 1 -- 172.21.15.84:0/2245004394 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f800c00cde0 con 0x7f8020109240 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.884+0000 7f801d600640 1 -- 172.21.15.84:0/2245004394 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c004a00 con 0x7f8020109240 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.884+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80201a2790 con 0x7f8020109240 2024-09-21T07:55:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.884+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80201a8f20 con 0x7f8020109240 2024-09-21T07:55:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.887+0000 7f802e9c6740 1 Processor -- start 2024-09-21T07:55:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.887+0000 7f802e9c6740 1 -- start start 2024-09-21T07:55:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.888+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a194e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.888+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a195350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.888+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a195890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.888+0000 7f802e9c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c44a10a6b0 con 0x55c449dc72f0 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.888+0000 7f802e9c6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c44a0f9ae0 con 0x55c449dcf4d0 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.888+0000 7f802e9c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c44a0fd8f0 con 0x55c449df01b0 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.888+0000 7f8025800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a194e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37288/0 (socket says 172.21.15.84:37288) 2024-09-21T07:55:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 -- 172.21.15.84:0/1595960018 learned_addr learned my addr 172.21.15.84:0/1595960018 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 -- 172.21.15.84:0/1595960018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 msgr2=0x55c44a195890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 --2- 172.21.15.84:0/1595960018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a195890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 -- 172.21.15.84:0/1595960018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 msgr2=0x55c44a195350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 --2- 172.21.15.84:0/1595960018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 -- 172.21.15.84:0/1595960018 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44a0c6780 con 0x55c449df01b0 2024-09-21T07:55:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.889+0000 7f8025800640 1 --2- 172.21.15.84:0/1595960018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a194e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f80180114a0 tx=0x7f8018011960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78cbcb8f34150a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.890+0000 7f801d600640 1 -- 172.21.15.84:0/2245004394 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f800c004ba0 con 0x7f8020109240 2024-09-21T07:55:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.890+0000 7f8012000640 1 -- 172.21.15.84:0/1595960018 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018004b20 con 0x55c449df01b0 2024-09-21T07:55:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.890+0000 7f8012000640 1 -- 172.21.15.84:0/1595960018 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8018004cc0 con 0x55c449df01b0 2024-09-21T07:55:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.890+0000 7f8012000640 1 -- 172.21.15.84:0/1595960018 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018005480 con 0x55c449df01b0 2024-09-21T07:55:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.891+0000 7f802e9c6740 1 -- 172.21.15.84:0/1595960018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 msgr2=0x55c44a194e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.891+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1595960018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a194e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f80180114a0 tx=0x7f8018011960 comp rx=0 tx=0).stop 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.891+0000 7f802e9c6740 1 -- 172.21.15.84:0/1595960018 shutdown_connections 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.891+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1595960018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a195890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.891+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1595960018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.892+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1595960018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a194e10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.892+0000 7f802e9c6740 1 -- 172.21.15.84:0/1595960018 >> 172.21.15.84:0/1595960018 conn(0x55c449de4300 msgr2=0x55c44a192d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.893+0000 7f801d600640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80080b6700 0x7f80080b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.893+0000 7f801d600640 1 -- 172.21.15.84:0/2245004394 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f800c0e79d0 con 0x7f8020109240 2024-09-21T07:55:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.900+0000 7f802e9c6740 1 -- 172.21.15.84:0/1595960018 shutdown_connections 2024-09-21T07:55:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.900+0000 7f802e9c6740 1 -- 172.21.15.84:0/1595960018 wait complete. 2024-09-21T07:55:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.901+0000 7f802e9c6740 1 -- start start 2024-09-21T07:55:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.901+0000 7f802e9c6740 1 Processor -- start 2024-09-21T07:55:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.904+0000 7f8024e00640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80080b6700 0x7f80080b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.905+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dc72f0 0x55c44a1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.905+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.905+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449df01b0 0x55c44a1a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.905+0000 7f802e9c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c44a031ab0 con 0x55c449df01b0 2024-09-21T07:55:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.905+0000 7f802e9c6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c44a0a0570 con 0x55c449dc72f0 2024-09-21T07:55:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.905+0000 7f802e9c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c44a1a3590 con 0x55c449dcf4d0 2024-09-21T07:55:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.906+0000 7f802e9c6740 10 client.0 _ll_register_callbacks cb 0x55c44a0af100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.906+0000 7f801fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.906+0000 7f801fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37290/0 (socket says 172.21.15.84:37290) 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.906+0000 7f801fe00640 1 -- 172.21.15.84:0/214899516 learned_addr learned my addr 172.21.15.84:0/214899516 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.907+0000 7f8025800640 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449df01b0 0x55c44a1a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.908+0000 7f801fe00640 1 -- 172.21.15.84:0/214899516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dc72f0 msgr2=0x55c44a1a0420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.908+0000 7f801fe00640 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dc72f0 0x55c44a1a0420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.908+0000 7f801fe00640 1 -- 172.21.15.84:0/214899516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449df01b0 msgr2=0x55c44a1a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.908+0000 7f801fe00640 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449df01b0 0x55c44a1a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.908+0000 7f801fe00640 1 -- 172.21.15.84:0/214899516 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c449e5b790 con 0x55c449dcf4d0 2024-09-21T07:55:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.908+0000 7f8025800640 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449df01b0 0x55c44a1a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.909+0000 7f801fe00640 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f800c0ad440 tx=0x7f800c0a99a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cdccf3235dcd67c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.909+0000 7f8006a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.909+0000 7f8006a00640 1 -- 172.21.15.84:0/214899516 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c01c040 con 0x55c449dcf4d0 2024-09-21T07:55:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.909+0000 7f8006a00640 1 -- 172.21.15.84:0/214899516 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f800c0ac710 con 0x55c449dcf4d0 2024-09-21T07:55:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.909+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8018004cc0 con 0x55c449dcf4d0 2024-09-21T07:55:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.913+0000 7f8006a00640 1 -- 172.21.15.84:0/214899516 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f800c0acc20 con 0x55c449dcf4d0 2024-09-21T07:55:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.914+0000 7f8024e00640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80080b6700 0x7f80080b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8014031440 tx=0x7f8014005db0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.922+0000 7f802e9c6740 10 client.26854 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.922+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c449ed4620 con 0x55c449dcf4d0 2024-09-21T07:55:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.923+0000 7f8006a00640 1 -- 172.21.15.84:0/214899516 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8018004cc0 con 0x55c449dcf4d0 2024-09-21T07:55:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.925+0000 7f8006a00640 1 -- 172.21.15.84:0/214899516 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f800c0a8e00 con 0x55c449dcf4d0 2024-09-21T07:55:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.925+0000 7f802e9c6740 10 client.26854 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.925+0000 7f802e9c6740 10 client.26854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.925+0000 7f802e9c6740 20 client.26854 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.925+0000 7f802e9c6740 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449daed80 0x55c44a1bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.925+0000 7f802e9c6740 4 client.26854 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.925+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c44a10c600 con 0x55c449daed80 2024-09-21T07:55:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.927+0000 7f8024e00640 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449daed80 0x55c44a1bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.933+0000 7f8006a00640 10 client.26854 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:29.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.937+0000 7f8024e00640 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449daed80 0x55c44a1bb1a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b5ad22761ec26b server_cookie=df1b0c46551d1538 in_seq=0 out_seq=0 2024-09-21T07:55:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.938+0000 7f8006a00640 1 -- 172.21.15.84:0/214899516 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c44a10c600 con 0x55c449daed80 2024-09-21T07:55:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.938+0000 7f8006a00640 10 client.26854 handle_command_reply: tid=0 2024-09-21T07:55:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.938+0000 7f802e9c6740 1 client.26854 shutdown 2024-09-21T07:55:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.939+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449dcf4d0 msgr2=0x55c44a1a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.939+0000 7f802e9c6740 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f800c0ad440 tx=0x7f800c0a99a0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.941+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 shutdown_connections 2024-09-21T07:55:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.941+0000 7f802e9c6740 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449df01b0 0x55c44a1a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.941+0000 7f802e9c6740 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449daed80 0x55c44a1bb1a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.941+0000 7f802e9c6740 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.941+0000 7f802e9c6740 1 --2- 172.21.15.84:0/214899516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dc72f0 0x55c44a1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.941+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 >> 172.21.15.84:0/214899516 conn(0x55c449de4300 msgr2=0x55c44a195e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.941+0000 7f8006a00640 0 client.26854 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.942+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 shutdown_connections 2024-09-21T07:55:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.942+0000 7f802e9c6740 1 -- 172.21.15.84:0/214899516 wait complete. 2024-09-21T07:55:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.942+0000 7f802e9c6740 20 client.26854 trim_cache size 0 max 16384 2024-09-21T07:55:29.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.981+0000 7f802e9c6740 1 Processor -- start 2024-09-21T07:55:29.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.986+0000 7f802e9c6740 1 -- start start 2024-09-21T07:55:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.986+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a192c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.987+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.987+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.987+0000 7f802e9c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f80200726f0 con 0x55c449dc72f0 2024-09-21T07:55:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.987+0000 7f802e9c6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8020074230 con 0x55c449dcf4d0 2024-09-21T07:55:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.987+0000 7f802e9c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8020072dc0 con 0x55c449df01b0 2024-09-21T07:55:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.987+0000 7f801fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.987+0000 7f801fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:49144/0 (socket says 172.21.15.84:49144) 2024-09-21T07:55:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.988+0000 7f801fe00640 1 -- 172.21.15.84:0/2995734941 learned_addr learned my addr 172.21.15.84:0/2995734941 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.988+0000 7f8025800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.988+0000 7f8024e00640 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a192c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.989+0000 7f8025800640 1 -- 172.21.15.84:0/2995734941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 msgr2=0x55c44a1a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.989+0000 7f8025800640 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.989+0000 7f8025800640 1 -- 172.21.15.84:0/2995734941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 msgr2=0x55c44a192c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.989+0000 7f8025800640 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a192c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.989+0000 7f8025800640 1 -- 172.21.15.84:0/2995734941 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44a19e900 con 0x55c449df01b0 2024-09-21T07:55:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.989+0000 7f801fe00640 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.989+0000 7f8024e00640 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a192c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.995+0000 7f8025800640 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1a0e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8018000f80 tx=0x7f8018005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b02e31fb10f0a576 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.995+0000 7f8011600640 1 -- 172.21.15.84:0/2995734941 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018027030 con 0x55c449df01b0 2024-09-21T07:55:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.995+0000 7f8011600640 1 -- 172.21.15.84:0/2995734941 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80180049d0 con 0x55c449df01b0 2024-09-21T07:55:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.995+0000 7f8011600640 1 -- 172.21.15.84:0/2995734941 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801800f6e0 con 0x55c449df01b0 2024-09-21T07:55:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.998+0000 7f802e9c6740 1 -- 172.21.15.84:0/2995734941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 msgr2=0x55c44a1a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.998+0000 7f802e9c6740 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1a0e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8018000f80 tx=0x7f8018005bd0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.998+0000 7f802e9c6740 1 -- 172.21.15.84:0/2995734941 shutdown_connections 2024-09-21T07:55:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.998+0000 7f802e9c6740 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1a0e40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.998+0000 7f802e9c6740 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.998+0000 7f802e9c6740 1 --2- 172.21.15.84:0/2995734941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a192c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.998+0000 7f802e9c6740 1 -- 172.21.15.84:0/2995734941 >> 172.21.15.84:0/2995734941 conn(0x55c449de4300 msgr2=0x55c44a192500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.999+0000 7f802e9c6740 1 -- 172.21.15.84:0/2995734941 shutdown_connections 2024-09-21T07:55:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:29.999+0000 7f802e9c6740 1 -- 172.21.15.84:0/2995734941 wait complete. 2024-09-21T07:55:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.000+0000 7f802e9c6740 1 -- start start 2024-09-21T07:55:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.000+0000 7f802e9c6740 1 Processor -- start 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a1b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f802e9c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f802e9c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8020073b60 con 0x55c449dc72f0 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f802e9c6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8020073490 con 0x55c449dcf4d0 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f802e9c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80200706d0 con 0x55c449df01b0 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f802e9c6740 10 client.0 _ll_register_callbacks cb 0x7f800c0a9350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f8025800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f8025800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1bfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37318/0 (socket says 172.21.15.84:37318) 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.003+0000 7f8025800640 1 -- 172.21.15.84:0/1560682347 learned_addr learned my addr 172.21.15.84:0/1560682347 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.004+0000 7f801fe00640 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.004+0000 7f8025800640 1 -- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 msgr2=0x55c44a1b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.004+0000 7f8025800640 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.004+0000 7f8025800640 1 -- 172.21.15.84:0/1560682347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 msgr2=0x55c44a1b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.004+0000 7f8025800640 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a1b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.004+0000 7f8025800640 1 -- 172.21.15.84:0/1560682347 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c44a1c0270 con 0x55c449df01b0 2024-09-21T07:55:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.005+0000 7f8006a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.005+0000 7f8025800640 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1bfd30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f801801b040 tx=0x7f80180057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f137bf6cc115e613 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.006+0000 7f8006a00640 1 -- 172.21.15.84:0/1560682347 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018034060 con 0x55c449df01b0 2024-09-21T07:55:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.006+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80180049d0 con 0x55c449df01b0 2024-09-21T07:55:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.006+0000 7f8006a00640 1 -- 172.21.15.84:0/1560682347 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f801800f560 con 0x55c449df01b0 2024-09-21T07:55:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.007+0000 7f8006a00640 1 -- 172.21.15.84:0/1560682347 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f801803b050 con 0x55c449df01b0 2024-09-21T07:55:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.008+0000 7f802e9c6740 10 client.26860 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.008+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c44a2251d0 con 0x55c449df01b0 2024-09-21T07:55:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.009+0000 7f8006a00640 1 -- 172.21.15.84:0/1560682347 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80180049d0 con 0x55c449df01b0 2024-09-21T07:55:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.009+0000 7f8006a00640 1 -- 172.21.15.84:0/1560682347 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f80180236d0 con 0x55c449df01b0 2024-09-21T07:55:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.009+0000 7f802e9c6740 10 client.26860 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.009+0000 7f802e9c6740 10 client.26860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.009+0000 7f802e9c6740 20 client.26860 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.009+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449d841c0 0x55c44a2275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.010+0000 7f802e9c6740 4 client.26860 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:55:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.010+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c44a194280 con 0x55c449d841c0 2024-09-21T07:55:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.011+0000 7f8024e00640 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449d841c0 0x55c44a2275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.014+0000 7f8024e00640 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449d841c0 0x55c44a2275c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb25d9847743818d server_cookie=cbd152af07d6e26 in_seq=0 out_seq=0 2024-09-21T07:55:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.014+0000 7f8006a00640 10 client.26860 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.050+0000 7f8006a00640 1 -- 172.21.15.84:0/1560682347 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c44a194280 con 0x55c449d841c0 2024-09-21T07:55:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.050+0000 7f8006a00640 10 client.26860 handle_command_reply: tid=0 2024-09-21T07:55:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.050+0000 7f802e9c6740 1 client.26860 shutdown 2024-09-21T07:55:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.055+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 msgr2=0x55c44a1bfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.061+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1bfd30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f801801b040 tx=0x7f80180057a0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.065+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 shutdown_connections 2024-09-21T07:55:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.065+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c449d841c0 0x55c44a2275c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.065+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c449df01b0 0x55c44a1bfd30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.065+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c449dcf4d0 0x55c44a1b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.065+0000 7f8006a00640 0 client.26860 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.065+0000 7f802e9c6740 1 --2- 172.21.15.84:0/1560682347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c449dc72f0 0x55c44a1b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.065+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 >> 172.21.15.84:0/1560682347 conn(0x55c449de4300 msgr2=0x55c44a197ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:30.072 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.070+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 shutdown_connections 2024-09-21T07:55:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.074+0000 7f802e9c6740 1 -- 172.21.15.84:0/1560682347 wait complete. 2024-09-21T07:55:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.085+0000 7f802e9c6740 20 client.26860 trim_cache size 0 max 16384 2024-09-21T07:55:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:55:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:55:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:55:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:55:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.092+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80080b6700 msgr2=0x7f80080b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.093+0000 7f8026200640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80080b6700 0x7f80080b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8014031440 tx=0x7f8014005db0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.093+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8020109240 msgr2=0x7f802019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.093+0000 7f8026200640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8020109240 0x7f802019cb10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f802006c690 tx=0x7f800c00ee50 comp rx=0 tx=0).stop 2024-09-21T07:55:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.094+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 shutdown_connections 2024-09-21T07:55:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.094+0000 7f8026200640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f80080b6700 0x7f80080b8c10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.094+0000 7f8026200640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8020109b90 0x7f80201a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.095+0000 7f8026200640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8020109240 0x7f802019cb10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.095+0000 7f8026200640 1 --2- 172.21.15.84:0/2245004394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8020103910 0x7f802019c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.096+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 >> 172.21.15.84:0/2245004394 conn(0x7f80200ff330 msgr2=0x7f8020108950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.096+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 shutdown_connections 2024-09-21T07:55:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:30.097+0000 7f8026200640 1 -- 172.21.15.84:0/2245004394 wait complete. 2024-09-21T07:55:30.438 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:31.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:31 smithi191 ceph-mon[34667]: pgmap v526: 129 pgs: 129 active+clean; 27 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 118 KiB/s rd, 207 MiB/s wr, 1.94k op/s 2024-09-21T07:55:31.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:31 smithi162 ceph-mon[34833]: pgmap v526: 129 pgs: 129 active+clean; 27 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 118 KiB/s rd, 207 MiB/s wr, 1.94k op/s 2024-09-21T07:55:31.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:31 smithi084 ceph-mon[30411]: pgmap v526: 129 pgs: 129 active+clean; 27 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 118 KiB/s rd, 207 MiB/s wr, 1.94k op/s 2024-09-21T07:55:33.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:33 smithi191 ceph-mon[34667]: pgmap v527: 129 pgs: 129 active+clean; 27 GiB data, 56 GiB used, 1016 GiB / 1.0 TiB avail; 109 KiB/s rd, 212 MiB/s wr, 1.76k op/s 2024-09-21T07:55:33.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:33 smithi084 ceph-mon[30411]: pgmap v527: 129 pgs: 129 active+clean; 27 GiB data, 56 GiB used, 1016 GiB / 1.0 TiB avail; 109 KiB/s rd, 212 MiB/s wr, 1.76k op/s 2024-09-21T07:55:33.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:33 smithi162 ceph-mon[34833]: pgmap v527: 129 pgs: 129 active+clean; 27 GiB data, 56 GiB used, 1016 GiB / 1.0 TiB avail; 109 KiB/s rd, 212 MiB/s wr, 1.76k op/s 2024-09-21T07:55:34.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.044+0000 7f4decc00640 1 -- 172.21.15.84:0/1601886010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00a50e0 msgr2=0x7f4de00a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.044+0000 7f4decc00640 1 --2- 172.21.15.84:0/1601886010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00a50e0 0x7f4de00a54f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009930 tx=0x7f4dd802e890 comp rx=0 tx=0).stop 2024-09-21T07:55:34.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.058+0000 7f4decc00640 1 -- 172.21.15.84:0/1601886010 shutdown_connections 2024-09-21T07:55:34.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.058+0000 7f4decc00640 1 --2- 172.21.15.84:0/1601886010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de00ad470 0x7f4de00b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.058+0000 7f4decc00640 1 --2- 172.21.15.84:0/1601886010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00acb20 0x7f4de00acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.058+0000 7f4decc00640 1 --2- 172.21.15.84:0/1601886010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00a50e0 0x7f4de00a54f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.058+0000 7f4decc00640 1 -- 172.21.15.84:0/1601886010 >> 172.21.15.84:0/1601886010 conn(0x7f4de001cc60 msgr2=0x7f4de001d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.058+0000 7f4decc00640 1 -- 172.21.15.84:0/1601886010 shutdown_connections 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.060+0000 7f4decc00640 1 -- 172.21.15.84:0/1601886010 wait complete. 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.068+0000 7f4decc00640 1 Processor -- start 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.069+0000 7f4decc00640 1 -- start start 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.070+0000 7f4decc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de00a50e0 0x7f4de01440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.070+0000 7f4decc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00acb20 0x7f4de0144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.071+0000 7f4decc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00ad470 0x7f4de0149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.071+0000 7f4decc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00b4eb0 con 0x7f4de00a50e0 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.071+0000 7f4de5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00acb20 0x7f4de0144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.071+0000 7f4de6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00ad470 0x7f4de0149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.071+0000 7f4de6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00ad470 0x7f4de0149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37350/0 (socket says 172.21.15.84:37350) 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.071+0000 7f4de6800640 1 -- 172.21.15.84:0/1992305646 learned_addr learned my addr 172.21.15.84:0/1992305646 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.073+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00b4d30 con 0x7f4de00acb20 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.073+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00b5030 con 0x7f4de00ad470 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.073+0000 7f4de5e00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de00a50e0 0x7f4de01440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.074+0000 7f4de6800640 1 -- 172.21.15.84:0/1992305646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00acb20 msgr2=0x7f4de0144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.074+0000 7f4de6800640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00acb20 0x7f4de0144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.074+0000 7f4de6800640 1 -- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de00a50e0 msgr2=0x7f4de01440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.074+0000 7f4de6800640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de00a50e0 0x7f4de01440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.074+0000 7f4de6800640 1 -- 172.21.15.84:0/1992305646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de014a040 con 0x7f4de00ad470 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.074+0000 7f4de5400640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00acb20 0x7f4de0144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.076+0000 7f4de6800640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00ad470 0x7f4de0149910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4de8051d10 tx=0x7f4de8075720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.076+0000 7f4ddea00640 1 -- 172.21.15.84:0/1992305646 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de806be60 con 0x7f4de00ad470 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.084+0000 7f4ddea00640 1 -- 172.21.15.84:0/1992305646 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de80778e0 con 0x7f4de00ad470 2024-09-21T07:55:34.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.084+0000 7f4ddea00640 1 -- 172.21.15.84:0/1992305646 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de807f8b0 con 0x7f4de00ad470 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.085+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de014a330 con 0x7f4de00ad470 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.085+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de0150a90 con 0x7f4de00ad470 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.095+0000 7f4ddea00640 1 -- 172.21.15.84:0/1992305646 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4de8077430 con 0x7f4de00ad470 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.099+0000 7f4ddea00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4dcc0b67b0 0x7f4dcc0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.099+0000 7f4ddea00640 1 -- 172.21.15.84:0/1992305646 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4de814d670 con 0x7f4de00ad470 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.100+0000 7f4df3850740 1 Processor -- start 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.100+0000 7f4df3850740 1 -- start start 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4df3850740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8859d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4df3850740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de885a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4df3850740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de885a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4df3850740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561de87d0fb0 con 0x561de8492390 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4df3850740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561de87c03e0 con 0x561de848a1b0 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4df3850740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561de87c41f0 con 0x561de84b3070 2024-09-21T07:55:34.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4de5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de885a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4de5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de885a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:49202/0 (socket says 172.21.15.84:49202) 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4de5400640 1 -- 172.21.15.84:0/401551776 learned_addr learned my addr 172.21.15.84:0/401551776 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4de5400640 1 -- 172.21.15.84:0/401551776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 msgr2=0x561de8859d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.101+0000 7f4de5400640 1 --2- 172.21.15.84:0/401551776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8859d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.102+0000 7f4de5400640 1 -- 172.21.15.84:0/401551776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 msgr2=0x561de885a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.102+0000 7f4de5400640 1 --2- 172.21.15.84:0/401551776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de885a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.102+0000 7f4de5400640 1 -- 172.21.15.84:0/401551776 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de878acd0 con 0x561de848a1b0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.104+0000 7f4de5e00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4dcc0b67b0 0x7f4dcc0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.105+0000 7f4de5e00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4dcc0b67b0 0x7f4dcc0b8cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4dd802ee80 tx=0x7f4dd802ed90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.107+0000 7f4de5400640 1 --2- 172.21.15.84:0/401551776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de885a270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40104a0 tx=0x7f4dd4010960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74bf21438d7f52b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.108+0000 7f4dd3000640 1 -- 172.21.15.84:0/401551776 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011700 con 0x561de848a1b0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.108+0000 7f4dd3000640 1 -- 172.21.15.84:0/401551776 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dd4011d50 con 0x561de848a1b0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.108+0000 7f4dd3000640 1 -- 172.21.15.84:0/401551776 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400e430 con 0x561de848a1b0 2024-09-21T07:55:34.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.110+0000 7f4df3850740 1 -- 172.21.15.84:0/401551776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 msgr2=0x561de885a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.110+0000 7f4df3850740 1 --2- 172.21.15.84:0/401551776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de885a270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40104a0 tx=0x7f4dd4010960 comp rx=0 tx=0).stop 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.118+0000 7f4df3850740 1 -- 172.21.15.84:0/401551776 shutdown_connections 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.118+0000 7f4df3850740 1 --2- 172.21.15.84:0/401551776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de885a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.118+0000 7f4df3850740 1 --2- 172.21.15.84:0/401551776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de885a270 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.118+0000 7f4df3850740 1 --2- 172.21.15.84:0/401551776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8859d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.118+0000 7f4df3850740 1 -- 172.21.15.84:0/401551776 >> 172.21.15.84:0/401551776 conn(0x561de84a7460 msgr2=0x561de8857bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.126+0000 7f4df3850740 1 -- 172.21.15.84:0/401551776 shutdown_connections 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.126+0000 7f4df3850740 1 -- 172.21.15.84:0/401551776 wait complete. 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.127+0000 7f4df3850740 1 -- start start 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.127+0000 7f4df3850740 1 Processor -- start 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.133+0000 7f4df3850740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de848a1b0 0x561de8876980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.133+0000 7f4df3850740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de8876f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.133+0000 7f4de5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de848a1b0 0x561de8876980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.133+0000 7f4de5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de848a1b0 0x561de8876980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37370/0 (socket says 172.21.15.84:37370) 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.134+0000 7f4df3850740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de84b3070 0x561de8882830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.134+0000 7f4df3850740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561de8621700 con 0x561de8492390 2024-09-21T07:55:34.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.134+0000 7f4df3850740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561de875b580 con 0x561de84b3070 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.134+0000 7f4df3850740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561de8879470 con 0x561de848a1b0 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.134+0000 7f4de5e00640 1 -- 172.21.15.84:0/1532517362 learned_addr learned my addr 172.21.15.84:0/1532517362 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.134+0000 7f4de6800640 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de84b3070 0x561de8882830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.134+0000 7f4df3850740 10 client.0 _ll_register_callbacks cb 0x561de876b470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.135+0000 7f4de6800640 1 -- 172.21.15.84:0/1532517362 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de848a1b0 msgr2=0x561de8876980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.135+0000 7f4de6800640 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de848a1b0 0x561de8876980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.135+0000 7f4de6800640 1 -- 172.21.15.84:0/1532517362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 msgr2=0x561de8876f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.135+0000 7f4de6800640 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de8876f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.135+0000 7f4de6800640 1 -- 172.21.15.84:0/1532517362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de851e650 con 0x561de84b3070 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4de6800640 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de84b3070 0x561de8882830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4de814aa50 tx=0x7f4de8112780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c817a219eecb8740 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4dc7400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4dc7400640 1 -- 172.21.15.84:0/1532517362 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de81128c0 con 0x561de84b3070 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4dc7400640 1 -- 172.21.15.84:0/1532517362 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4de8077c90 con 0x561de84b3070 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561de875db90 con 0x561de84b3070 2024-09-21T07:55:34.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4dc7400640 1 -- 172.21.15.84:0/1532517362 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4de8077720 con 0x561de84b3070 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4df3850740 10 client.26861 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.136+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561de8778950 con 0x561de84b3070 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.137+0000 7f4dc7400640 1 -- 172.21.15.84:0/1532517362 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561de875db90 con 0x561de84b3070 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.142+0000 7f4dc7400640 1 -- 172.21.15.84:0/1532517362 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4de8087070 con 0x561de84b3070 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.145+0000 7f4df3850740 10 client.26861 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.145+0000 7f4df3850740 10 client.26861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.145+0000 7f4df3850740 20 client.26861 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.145+0000 7f4df3850740 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de84719f0 0x561de88888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.145+0000 7f4df3850740 4 client.26861 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.145+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561de87d2f00 con 0x561de84719f0 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.145+0000 7f4de5e00640 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de84719f0 0x561de88888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.147+0000 7f4dc7400640 10 client.26861 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.147+0000 7f4de5e00640 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de84719f0 0x561de88888f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7103805075ae04f0 server_cookie=1238c34750565d83 in_seq=0 out_seq=0 2024-09-21T07:55:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.148+0000 7f4dc7400640 1 -- 172.21.15.84:0/1532517362 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561de87d2f00 con 0x561de84719f0 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.148+0000 7f4dc7400640 10 client.26861 handle_command_reply: tid=0 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.148+0000 7f4df3850740 1 client.26861 shutdown 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de84b3070 msgr2=0x561de8882830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de84b3070 0x561de8882830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4de814aa50 tx=0x7f4de8112780 comp rx=0 tx=0).stop 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 shutdown_connections 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de84b3070 0x561de8882830 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de8876f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de84719f0 0x561de88888f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 --2- 172.21.15.84:0/1532517362 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de848a1b0 0x561de8876980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 >> 172.21.15.84:0/1532517362 conn(0x561de84a7460 msgr2=0x561de885b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.150+0000 7f4dc7400640 0 client.26861 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.151+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 shutdown_connections 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.151+0000 7f4df3850740 1 -- 172.21.15.84:0/1532517362 wait complete. 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.151+0000 7f4df3850740 20 client.26861 trim_cache size 0 max 16384 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.187+0000 7f4df3850740 1 Processor -- start 2024-09-21T07:55:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.187+0000 7f4df3850740 1 -- start start 2024-09-21T07:55:34.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.188+0000 7f4df3850740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de8882730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.188+0000 7f4df3850740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de8873970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.188+0000 7f4df3850740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8873eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.188+0000 7f4df3850740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0151fe0 con 0x561de8492390 2024-09-21T07:55:34.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.188+0000 7f4df3850740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0153b20 con 0x561de848a1b0 2024-09-21T07:55:34.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.188+0000 7f4df3850740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4de01526b0 con 0x561de84b3070 2024-09-21T07:55:34.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.191+0000 7f4de5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de8882730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.194+0000 7f4de5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de8882730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:49210/0 (socket says 172.21.15.84:49210) 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.194+0000 7f4de6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8873eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.194+0000 7f4de6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8873eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37376/0 (socket says 172.21.15.84:37376) 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.194+0000 7f4de6800640 1 -- 172.21.15.84:0/704132089 learned_addr learned my addr 172.21.15.84:0/704132089 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.194+0000 7f4de5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de8873970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.197+0000 7f4de6800640 1 -- 172.21.15.84:0/704132089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 msgr2=0x561de8882730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.197+0000 7f4de6800640 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de8882730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.197+0000 7f4de6800640 1 -- 172.21.15.84:0/704132089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 msgr2=0x561de8873970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.197+0000 7f4de6800640 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de8873970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.197+0000 7f4de6800640 1 -- 172.21.15.84:0/704132089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de885bc70 con 0x561de84b3070 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.198+0000 7f4de5e00640 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de8882730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.199+0000 7f4de6800640 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8873eb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4de80690c0 tx=0x7f4de80fa070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf0ef0c4ff89ccd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.200+0000 7f4dd2600640 1 -- 172.21.15.84:0/704132089 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de81128c0 con 0x561de84b3070 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.200+0000 7f4dd2600640 1 -- 172.21.15.84:0/704132089 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de8112c60 con 0x561de84b3070 2024-09-21T07:55:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.200+0000 7f4dd2600640 1 -- 172.21.15.84:0/704132089 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de81128c0 con 0x561de84b3070 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.203+0000 7f4df3850740 1 -- 172.21.15.84:0/704132089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 msgr2=0x561de8873eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.203+0000 7f4df3850740 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8873eb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4de80690c0 tx=0x7f4de80fa070 comp rx=0 tx=0).stop 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.204+0000 7f4df3850740 1 -- 172.21.15.84:0/704132089 shutdown_connections 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.204+0000 7f4df3850740 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de8873eb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.204+0000 7f4df3850740 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de8873970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.204+0000 7f4df3850740 1 --2- 172.21.15.84:0/704132089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de8882730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.204+0000 7f4df3850740 1 -- 172.21.15.84:0/704132089 >> 172.21.15.84:0/704132089 conn(0x561de84a7460 msgr2=0x561de885eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.204+0000 7f4df3850740 1 -- 172.21.15.84:0/704132089 shutdown_connections 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.204+0000 7f4df3850740 1 -- 172.21.15.84:0/704132089 wait complete. 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.208+0000 7f4df3850740 1 -- start start 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.209+0000 7f4df3850740 1 Processor -- start 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.214+0000 7f4df3850740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de887eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.214+0000 7f4df3850740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de887b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.214+0000 7f4df3850740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de887b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4df3850740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0153450 con 0x561de8492390 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4df3850740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0152d80 con 0x561de848a1b0 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4df3850740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00a61d0 con 0x561de84b3070 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4de6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de887b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4de6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de887b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37388/0 (socket says 172.21.15.84:37388) 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4de6800640 1 -- 172.21.15.84:0/3002681008 learned_addr learned my addr 172.21.15.84:0/3002681008 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4df3850740 10 client.0 _ll_register_callbacks cb 0x7f4de814aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.215+0000 7f4de5e00640 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de887eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4de6800640 1 -- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 msgr2=0x561de887eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4de6800640 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de887eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4de6800640 1 -- 172.21.15.84:0/3002681008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 msgr2=0x561de887b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4de6800640 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de887b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4de6800640 1 -- 172.21.15.84:0/3002681008 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de887c020 con 0x561de84b3070 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de8112c60 con 0x561de84b3070 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4de6800640 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de887b930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4de8069200 tx=0x7f4de8077dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ca7d17d48bda61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.216+0000 7f4dc7400640 10 client.26875 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.217+0000 7f4dc7400640 1 -- 172.21.15.84:0/3002681008 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de81128c0 con 0x561de84b3070 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.217+0000 7f4dc7400640 1 -- 172.21.15.84:0/3002681008 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4de8111e20 con 0x561de84b3070 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.217+0000 7f4dc7400640 1 -- 172.21.15.84:0/3002681008 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4de8112020 con 0x561de84b3070 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.217+0000 7f4df3850740 10 client.26875 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.217+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561de887c020 con 0x561de84b3070 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.218+0000 7f4dc7400640 1 -- 172.21.15.84:0/3002681008 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4de8087040 con 0x561de84b3070 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.218+0000 7f4df3850740 10 client.26875 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.218+0000 7f4df3850740 10 client.26875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.218+0000 7f4df3850740 20 client.26875 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.218+0000 7f4df3850740 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de8446da0 0x561de88f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.218+0000 7f4df3850740 4 client.26875 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:34.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.218+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561de87ce9b0 con 0x561de8446da0 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.219+0000 7f4de5e00640 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de8446da0 0x561de88f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.220+0000 7f4de5e00640 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de8446da0 0x561de88f62d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc9b40a7f6fa7dcf server_cookie=3b8ea03eb33b4f9a in_seq=0 out_seq=0 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.220+0000 7f4dc7400640 10 client.26875 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.220+0000 7f4dc7400640 1 -- 172.21.15.84:0/3002681008 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561de87ce9b0 con 0x561de8446da0 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.220+0000 7f4dc7400640 10 client.26875 handle_command_reply: tid=0 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.221+0000 7f4df3850740 1 client.26875 shutdown 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.221+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 msgr2=0x561de887b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.221+0000 7f4df3850740 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de887b930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4de8069200 tx=0x7f4de8077dc0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.221+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 shutdown_connections 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561de8446da0 0x561de88f62d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561de84b3070 0x561de887b930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561de8492390 0x561de887b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 1 --2- 172.21.15.84:0/3002681008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de848a1b0 0x561de887eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 >> 172.21.15.84:0/3002681008 conn(0x561de84a7460 msgr2=0x561de885ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:34.471 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4dc7400640 0 client.26875 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 shutdown_connections 2024-09-21T07:55:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 1 -- 172.21.15.84:0/3002681008 wait complete. 2024-09-21T07:55:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.222+0000 7f4df3850740 20 client.26875 trim_cache size 0 max 16384 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4dcc0b67b0 msgr2=0x7f4dcc0b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4dcc0b67b0 0x7f4dcc0b8cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4dd802ee80 tx=0x7f4dd802ed90 comp rx=0 tx=0).stop 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00ad470 msgr2=0x7f4de0149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00ad470 0x7f4de0149910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4de8051d10 tx=0x7f4de8075720 comp rx=0 tx=0).stop 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 shutdown_connections 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4dcc0b67b0 0x7f4dcc0b8cc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de00ad470 0x7f4de0149910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.225+0000 7f4decc00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de00acb20 0x7f4de0144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.226+0000 7f4decc00640 1 --2- 172.21.15.84:0/1992305646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4de00a50e0 0x7f4de01440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.226+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 >> 172.21.15.84:0/1992305646 conn(0x7f4de001cc60 msgr2=0x7f4de00a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.226+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 shutdown_connections 2024-09-21T07:55:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:34.226+0000 7f4decc00640 1 -- 172.21.15.84:0/1992305646 wait complete. 2024-09-21T07:55:35.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:35 smithi084 ceph-mon[30411]: pgmap v528: 129 pgs: 129 active+clean; 28 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 115 KiB/s rd, 227 MiB/s wr, 1.79k op/s 2024-09-21T07:55:35.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:35 smithi162 ceph-mon[34833]: pgmap v528: 129 pgs: 129 active+clean; 28 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 115 KiB/s rd, 227 MiB/s wr, 1.79k op/s 2024-09-21T07:55:35.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:35 smithi191 ceph-mon[34667]: pgmap v528: 129 pgs: 129 active+clean; 28 GiB data, 57 GiB used, 1015 GiB / 1.0 TiB avail; 115 KiB/s rd, 227 MiB/s wr, 1.79k op/s 2024-09-21T07:55:37.332 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:55:37.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:55:37.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:37 smithi162 ceph-mon[34833]: pgmap v529: 129 pgs: 129 active+clean; 28 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 46 KiB/s rd, 212 MiB/s wr, 1.54k op/s 2024-09-21T07:55:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:37 smithi084 ceph-mon[30411]: pgmap v529: 129 pgs: 129 active+clean; 28 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 46 KiB/s rd, 212 MiB/s wr, 1.54k op/s 2024-09-21T07:55:37.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:37 smithi191 ceph-mon[34667]: pgmap v529: 129 pgs: 129 active+clean; 28 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 46 KiB/s rd, 212 MiB/s wr, 1.54k op/s 2024-09-21T07:55:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:39.779 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:39 smithi084 ceph-mon[30411]: pgmap v530: 129 pgs: 129 active+clean; 28 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 46 KiB/s rd, 220 MiB/s wr, 1.55k op/s 2024-09-21T07:55:39.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:39 smithi162 ceph-mon[34833]: pgmap v530: 129 pgs: 129 active+clean; 28 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 46 KiB/s rd, 220 MiB/s wr, 1.55k op/s 2024-09-21T07:55:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:39 smithi191 ceph-mon[34667]: pgmap v530: 129 pgs: 129 active+clean; 28 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 46 KiB/s rd, 220 MiB/s wr, 1.55k op/s 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.056+0000 7f50e5800640 1 -- 172.21.15.84:0/4157767201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e01094b0 msgr2=0x7f50e01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.056+0000 7f50e5800640 1 --2- 172.21.15.84:0/4157767201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e01094b0 0x7f50e01098c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009900 tx=0x7f50cc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.057+0000 7f50e5800640 1 -- 172.21.15.84:0/4157767201 shutdown_connections 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.057+0000 7f50e5800640 1 --2- 172.21.15.84:0/4157767201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e0109e00 0x7f50e0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.057+0000 7f50e5800640 1 --2- 172.21.15.84:0/4157767201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e01094b0 0x7f50e01098c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.057+0000 7f50e5800640 1 --2- 172.21.15.84:0/4157767201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e0103b70 0x7f50e0103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.057+0000 7f50e5800640 1 -- 172.21.15.84:0/4157767201 >> 172.21.15.84:0/4157767201 conn(0x7f50e00ff5e0 msgr2=0x7f50e0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.057+0000 7f50e5800640 1 -- 172.21.15.84:0/4157767201 shutdown_connections 2024-09-21T07:55:40.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.057+0000 7f50e5800640 1 -- 172.21.15.84:0/4157767201 wait complete. 2024-09-21T07:55:40.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.058+0000 7f50e5800640 1 Processor -- start 2024-09-21T07:55:40.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.058+0000 7f50e5800640 1 -- start start 2024-09-21T07:55:40.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50e5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e0103b70 0x7f50e019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50e5800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e01094b0 0x7f50e019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50e5800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e0109e00 0x7f50e01a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50e5800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50e0113b10 con 0x7f50e0109e00 2024-09-21T07:55:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50e5800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50e0113990 con 0x7f50e0103b70 2024-09-21T07:55:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50e5800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50e0113c90 con 0x7f50e01094b0 2024-09-21T07:55:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e01094b0 0x7f50e019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e01094b0 0x7f50e019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60888/0 (socket says 172.21.15.84:60888) 2024-09-21T07:55:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50de000640 1 -- 172.21.15.84:0/503175224 learned_addr learned my addr 172.21.15.84:0/503175224 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50df400640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e0109e00 0x7f50e01a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50dea00640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e0103b70 0x7f50e019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50de000640 1 -- 172.21.15.84:0/503175224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e0103b70 msgr2=0x7f50e019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.059+0000 7f50de000640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e0103b70 0x7f50e019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.060+0000 7f50de000640 1 -- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e0109e00 msgr2=0x7f50e01a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.060+0000 7f50de000640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e0109e00 0x7f50e01a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.060+0000 7f50de000640 1 -- 172.21.15.84:0/503175224 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e01a2630 con 0x7f50e01094b0 2024-09-21T07:55:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.060+0000 7f50df400640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e0109e00 0x7f50e01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.060+0000 7f50dea00640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e0103b70 0x7f50e019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.061+0000 7f50de000640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e01094b0 0x7f50e019cc60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50cc005ab0 tx=0x7f50cc003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.061+0000 7f50d7400640 1 -- 172.21.15.84:0/503175224 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc03f070 con 0x7f50e01094b0 2024-09-21T07:55:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.061+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e01a28c0 con 0x7f50e01094b0 2024-09-21T07:55:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.061+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e010a4e0 con 0x7f50e01094b0 2024-09-21T07:55:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.061+0000 7f50d7400640 1 -- 172.21.15.84:0/503175224 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50cc031b50 con 0x7f50e01094b0 2024-09-21T07:55:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.063+0000 7f50d7400640 1 -- 172.21.15.84:0/503175224 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc035030 con 0x7f50e01094b0 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.068+0000 7f50d7400640 1 -- 172.21.15.84:0/503175224 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f50cc042070 con 0x7f50e01094b0 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 Processor -- start 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 -- start start 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516eb350 0x558051a92d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a93250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 0x558051a93790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558051a08e90 con 0x5580516c2490 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5580519f82c0 con 0x5580516ca670 2024-09-21T07:55:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.070+0000 7f50ec400740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5580519fc0d0 con 0x5580516eb350 2024-09-21T07:55:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516eb350 0x558051a92d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516eb350 0x558051a92d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60892/0 (socket says 172.21.15.84:60892) 2024-09-21T07:55:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 -- 172.21.15.84:0/2781622762 learned_addr learned my addr 172.21.15.84:0/2781622762 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 -- 172.21.15.84:0/2781622762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 msgr2=0x558051a93790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 --2- 172.21.15.84:0/2781622762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 0x558051a93790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 -- 172.21.15.84:0/2781622762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 msgr2=0x558051a93250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 --2- 172.21.15.84:0/2781622762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a93250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.071+0000 7f50df400640 1 -- 172.21.15.84:0/2781622762 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558051756930 con 0x5580516eb350 2024-09-21T07:55:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.072+0000 7f50df400640 1 --2- 172.21.15.84:0/2781622762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516eb350 0x558051a92d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50d80117e0 tx=0x7f50d8011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c6131a65096668 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.074+0000 7f50d7400640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c40b6700 0x7f50c40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.074+0000 7f50d7400640 1 -- 172.21.15.84:0/503175224 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f50cc107e60 con 0x7f50e01094b0 2024-09-21T07:55:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.074+0000 7f50cbe00640 1 -- 172.21.15.84:0/2781622762 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8011310 con 0x5580516eb350 2024-09-21T07:55:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.074+0000 7f50cbe00640 1 -- 172.21.15.84:0/2781622762 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50d8003e20 con 0x5580516eb350 2024-09-21T07:55:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.074+0000 7f50cbe00640 1 -- 172.21.15.84:0/2781622762 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8004530 con 0x5580516eb350 2024-09-21T07:55:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.076+0000 7f50ec400740 1 -- 172.21.15.84:0/2781622762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516eb350 msgr2=0x558051a92d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.076+0000 7f50ec400740 1 --2- 172.21.15.84:0/2781622762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516eb350 0x558051a92d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50d80117e0 tx=0x7f50d8011ca0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.077+0000 7f50ec400740 1 -- 172.21.15.84:0/2781622762 shutdown_connections 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.077+0000 7f50ec400740 1 --2- 172.21.15.84:0/2781622762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 0x558051a93790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.077+0000 7f50ec400740 1 --2- 172.21.15.84:0/2781622762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a93250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.077+0000 7f50ec400740 1 --2- 172.21.15.84:0/2781622762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516eb350 0x558051a92d10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.077+0000 7f50ec400740 1 -- 172.21.15.84:0/2781622762 >> 172.21.15.84:0/2781622762 conn(0x5580516df740 msgr2=0x558051a90c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.077+0000 7f50dea00640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c40b6700 0x7f50c40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.077+0000 7f50ec400740 1 -- 172.21.15.84:0/2781622762 shutdown_connections 2024-09-21T07:55:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.078+0000 7f50dea00640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c40b6700 0x7f50c40b8c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x558051a91990 tx=0x7f50d0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.078+0000 7f50ec400740 1 -- 172.21.15.84:0/2781622762 wait complete. 2024-09-21T07:55:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.079+0000 7f50ec400740 1 -- start start 2024-09-21T07:55:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.079+0000 7f50ec400740 1 Processor -- start 2024-09-21T07:55:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.081+0000 7f50ec400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a9e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.081+0000 7f50ec400740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516ca670 0x558051a9eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.081+0000 7f50ec400740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516eb350 0x558051aaa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50dea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a9e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516ca670 0x558051a9eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516ca670 0x558051a9eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60904/0 (socket says 172.21.15.84:60904) 2024-09-21T07:55:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50dea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a9e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39658/0 (socket says 172.21.15.84:39658) 2024-09-21T07:55:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50de000640 1 -- 172.21.15.84:0/2066859749 learned_addr learned my addr 172.21.15.84:0/2066859749 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50df400640 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516eb350 0x558051aaa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558051859890 con 0x5580516c2490 2024-09-21T07:55:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.082+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558051993160 con 0x5580516eb350 2024-09-21T07:55:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.083+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558051aa14f0 con 0x5580516ca670 2024-09-21T07:55:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.083+0000 7f50df400640 1 -- 172.21.15.84:0/2066859749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516ca670 msgr2=0x558051a9eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.083+0000 7f50df400640 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516ca670 0x558051a9eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.083+0000 7f50df400640 1 -- 172.21.15.84:0/2066859749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 msgr2=0x558051a9e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.084+0000 7f50df400640 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a9e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.084+0000 7f50df400640 1 -- 172.21.15.84:0/2066859749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558051aaae80 con 0x5580516eb350 2024-09-21T07:55:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.084+0000 7f50dea00640 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a9e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.084+0000 7f50df400640 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516eb350 0x558051aaa870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f50d8004110 tx=0x7f50d80113b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e79f6d1708ec0d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.085+0000 7f50c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.085+0000 7f50ec400740 10 client.0 _ll_register_callbacks cb 0x5580519afa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.085+0000 7f50c8c00640 1 -- 172.21.15.84:0/2066859749 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d800fe70 con 0x5580516eb350 2024-09-21T07:55:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.085+0000 7f50c8c00640 1 -- 172.21.15.84:0/2066859749 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f50d8004270 con 0x5580516eb350 2024-09-21T07:55:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.085+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50d8003e20 con 0x5580516eb350 2024-09-21T07:55:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.086+0000 7f50c8c00640 1 -- 172.21.15.84:0/2066859749 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50d8004470 con 0x5580516eb350 2024-09-21T07:55:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.087+0000 7f50ec400740 10 client.26873 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.087+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558051aad2a0 con 0x5580516eb350 2024-09-21T07:55:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.088+0000 7f50c8c00640 1 -- 172.21.15.84:0/2066859749 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f50d8018020 con 0x5580516eb350 2024-09-21T07:55:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.088+0000 7f50ec400740 10 client.26873 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.088+0000 7f50ec400740 10 client.26873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:40.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.088+0000 7f50ec400740 20 client.26873 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:40.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.088+0000 7f50ec400740 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516a9cd0 0x558051ab07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.088+0000 7f50ec400740 4 client.26873 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:40.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.088+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558051a0ade0 con 0x5580516a9cd0 2024-09-21T07:55:40.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.089+0000 7f50dea00640 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516a9cd0 0x558051ab07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.091+0000 7f50dea00640 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516a9cd0 0x558051ab07a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccd7a4e90fbc48f5 server_cookie=8a5144c191af3ddb in_seq=0 out_seq=0 2024-09-21T07:55:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.091+0000 7f50c8c00640 10 client.26873 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.092+0000 7f50c8c00640 1 -- 172.21.15.84:0/2066859749 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558051a0ade0 con 0x5580516a9cd0 2024-09-21T07:55:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.092+0000 7f50c8c00640 10 client.26873 handle_command_reply: tid=0 2024-09-21T07:55:40.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.092+0000 7f50ec400740 1 client.26873 shutdown 2024-09-21T07:55:40.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.093+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516eb350 msgr2=0x558051aaa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.093+0000 7f50ec400740 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516eb350 0x558051aaa870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f50d8004110 tx=0x7f50d80113b0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.094+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 shutdown_connections 2024-09-21T07:55:40.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.094+0000 7f50ec400740 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516eb350 0x558051aaa870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.094+0000 7f50ec400740 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516a9cd0 0x558051ab07a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.094+0000 7f50c8c00640 0 client.26873 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:40.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.094+0000 7f50ec400740 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516ca670 0x558051a9eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.094+0000 7f50ec400740 1 --2- 172.21.15.84:0/2066859749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516c2490 0x558051a9e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.094+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 >> 172.21.15.84:0/2066859749 conn(0x5580516df740 msgr2=0x558051a8f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:40.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.095+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 shutdown_connections 2024-09-21T07:55:40.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.095+0000 7f50ec400740 1 -- 172.21.15.84:0/2066859749 wait complete. 2024-09-21T07:55:40.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.096+0000 7f50ec400740 20 client.26873 trim_cache size 0 max 16384 2024-09-21T07:55:40.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.122+0000 7f50ec400740 1 Processor -- start 2024-09-21T07:55:40.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.122+0000 7f50ec400740 1 -- start start 2024-09-21T07:55:40.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.124+0000 7f50ec400740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516a9cd0 0x558051aaa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.124+0000 7f50ec400740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051a8f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.124+0000 7f50ec400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516ca670 0x558051a8f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.124+0000 7f50ec400740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50c000fe30 con 0x5580516ca670 2024-09-21T07:55:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.124+0000 7f50ec400740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0011970 con 0x5580516a9cd0 2024-09-21T07:55:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.124+0000 7f50ec400740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0010500 con 0x5580516c2490 2024-09-21T07:55:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.125+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051a8f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.125+0000 7f50df400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516ca670 0x558051a8f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.125+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051a8f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60910/0 (socket says 172.21.15.84:60910) 2024-09-21T07:55:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.125+0000 7f50de000640 1 -- 172.21.15.84:0/2761348833 learned_addr learned my addr 172.21.15.84:0/2761348833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.125+0000 7f50dea00640 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516a9cd0 0x558051aaa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.126+0000 7f50df400640 1 -- 172.21.15.84:0/2761348833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 msgr2=0x558051a8f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.126+0000 7f50df400640 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051a8f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.126+0000 7f50df400640 1 -- 172.21.15.84:0/2761348833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516a9cd0 msgr2=0x558051aaa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.126+0000 7f50df400640 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516a9cd0 0x558051aaa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.126+0000 7f50df400640 1 -- 172.21.15.84:0/2761348833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558051a99ff0 con 0x5580516ca670 2024-09-21T07:55:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.127+0000 7f50df400640 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516ca670 0x558051a8f7c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000f80 tx=0x7f50d801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d9ca808d94a3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.127+0000 7f50cb400640 1 -- 172.21.15.84:0/2761348833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d80041e0 con 0x5580516ca670 2024-09-21T07:55:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.127+0000 7f50cb400640 1 -- 172.21.15.84:0/2761348833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50d8003e20 con 0x5580516ca670 2024-09-21T07:55:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.128+0000 7f50cb400640 1 -- 172.21.15.84:0/2761348833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8024630 con 0x5580516ca670 2024-09-21T07:55:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.129+0000 7f50ec400740 1 -- 172.21.15.84:0/2761348833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516ca670 msgr2=0x558051a8f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.129+0000 7f50ec400740 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516ca670 0x558051a8f7c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000f80 tx=0x7f50d801d000 comp rx=0 tx=0).stop 2024-09-21T07:55:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.129+0000 7f50ec400740 1 -- 172.21.15.84:0/2761348833 shutdown_connections 2024-09-21T07:55:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.129+0000 7f50ec400740 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516ca670 0x558051a8f7c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.129+0000 7f50ec400740 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051a8f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.129+0000 7f50ec400740 1 --2- 172.21.15.84:0/2761348833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516a9cd0 0x558051aaa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.129+0000 7f50ec400740 1 -- 172.21.15.84:0/2761348833 >> 172.21.15.84:0/2761348833 conn(0x5580516df740 msgr2=0x558051ab06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.130+0000 7f50ec400740 1 -- 172.21.15.84:0/2761348833 shutdown_connections 2024-09-21T07:55:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.130+0000 7f50ec400740 1 -- 172.21.15.84:0/2761348833 wait complete. 2024-09-21T07:55:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.130+0000 7f50ec400740 1 -- start start 2024-09-21T07:55:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 1 Processor -- start 2024-09-21T07:55:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516a9cd0 0x558051aa67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051aa6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 0x558051aa1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00112a0 con 0x5580516a9cd0 2024-09-21T07:55:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0010bd0 con 0x5580516ca670 2024-09-21T07:55:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50c000ddf0 con 0x5580516c2490 2024-09-21T07:55:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.131+0000 7f50ec400740 10 client.0 _ll_register_callbacks cb 0x7f50d80116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.132+0000 7f50dea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516a9cd0 0x558051aa67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.132+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051aa6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.132+0000 7f50de000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051aa6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60914/0 (socket says 172.21.15.84:60914) 2024-09-21T07:55:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.132+0000 7f50de000640 1 -- 172.21.15.84:0/778692056 learned_addr learned my addr 172.21.15.84:0/778692056 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.132+0000 7f50de000640 1 -- 172.21.15.84:0/778692056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 msgr2=0x558051aa1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.132+0000 7f50de000640 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 0x558051aa1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.132+0000 7f50de000640 1 -- 172.21.15.84:0/778692056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516a9cd0 msgr2=0x558051aa67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.133+0000 7f50de000640 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516a9cd0 0x558051aa67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.133+0000 7f50de000640 1 -- 172.21.15.84:0/778692056 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558051aa1cd0 con 0x5580516c2490 2024-09-21T07:55:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.134+0000 7f50dea00640 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516a9cd0 0x558051aa67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.134+0000 7f50de000640 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051aa6d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50cc031440 tx=0x7f50cc02a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee6df071add55c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.134+0000 7f50c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:40.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.135+0000 7f50c8c00640 1 -- 172.21.15.84:0/778692056 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0c90b0 con 0x5580516c2490 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.135+0000 7f50c8c00640 1 -- 172.21.15.84:0/778692056 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f50cc0318a0 con 0x5580516c2490 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.135+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50d8003e20 con 0x5580516c2490 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.136+0000 7f50c8c00640 1 -- 172.21.15.84:0/778692056 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50cc1056d0 con 0x5580516c2490 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.136+0000 7f50ec400740 10 client.26893 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.136+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558051b2c940 con 0x5580516c2490 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.136+0000 7f50c8c00640 1 -- 172.21.15.84:0/778692056 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50d8003e20 con 0x5580516c2490 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.137+0000 7f50c8c00640 1 -- 172.21.15.84:0/778692056 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f50cc0c9290 con 0x5580516c2490 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.138+0000 7f50ec400740 10 client.26893 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.138+0000 7f50ec400740 10 client.26893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.138+0000 7f50ec400740 20 client.26893 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.138+0000 7f50ec400740 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516eb350 0x558051b2f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.138+0000 7f50ec400740 4 client.26893 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.138+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558051a06890 con 0x5580516eb350 2024-09-21T07:55:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.139+0000 7f50dea00640 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516eb350 0x558051b2f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:40.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.139+0000 7f50dea00640 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516eb350 0x558051b2f120 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=684625c2099caee server_cookie=1cd3a4fb229ac26c in_seq=0 out_seq=0 2024-09-21T07:55:40.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.139+0000 7f50c8c00640 10 client.26893 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.143+0000 7f50c8c00640 1 -- 172.21.15.84:0/778692056 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558051a06890 con 0x5580516eb350 2024-09-21T07:55:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.143+0000 7f50c8c00640 10 client.26893 handle_command_reply: tid=0 2024-09-21T07:55:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.143+0000 7f50ec400740 1 client.26893 shutdown 2024-09-21T07:55:40.146 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "943a50d1-7f35-4f4f-9dc0-a41c6709e811", 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 msgr2=0x558051aa6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051aa6d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50cc031440 tx=0x7f50cc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 shutdown_connections 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5580516ca670 0x558051aa1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5580516eb350 0x558051b2f120 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5580516c2490 0x558051aa6d80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 --2- 172.21.15.84:0/778692056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580516a9cd0 0x558051aa67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.144+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 >> 172.21.15.84:0/778692056 conn(0x5580516df740 msgr2=0x558051a97e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.145+0000 7f50c8c00640 0 client.26893 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:40.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.145+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 shutdown_connections 2024-09-21T07:55:40.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.145+0000 7f50ec400740 1 -- 172.21.15.84:0/778692056 wait complete. 2024-09-21T07:55:40.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.145+0000 7f50ec400740 20 client.26893 trim_cache size 0 max 16384 2024-09-21T07:55:40.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.146+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c40b6700 msgr2=0x7f50c40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.146+0000 7f50e5800640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c40b6700 0x7f50c40b8c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x558051a91990 tx=0x7f50d0005f90 comp rx=0 tx=0).stop 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.146+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e01094b0 msgr2=0x7f50e019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.146+0000 7f50e5800640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e01094b0 0x7f50e019cc60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50cc005ab0 tx=0x7f50cc003b90 comp rx=0 tx=0).stop 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 shutdown_connections 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c40b6700 0x7f50c40b8c10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50e0109e00 0x7f50e01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50e01094b0 0x7f50e019cc60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 --2- 172.21.15.84:0/503175224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e0103b70 0x7f50e019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 >> 172.21.15.84:0/503175224 conn(0x7f50e00ff5e0 msgr2=0x7f50e0108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 shutdown_connections 2024-09-21T07:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:40.147+0000 7f50e5800640 1 -- 172.21.15.84:0/503175224 wait complete. 2024-09-21T07:55:41.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:41 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:55:41.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:41 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:55:41.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:41 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:55:41.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:41 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:55:41.707 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:41 smithi191 ceph-mon[34667]: pgmap v531: 129 pgs: 129 active+clean; 29 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 54 KiB/s rd, 219 MiB/s wr, 1.44k op/s 2024-09-21T07:55:41.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:41 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:55:41.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:41 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:55:41.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:41 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:55:41.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:41 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:55:41.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:41 smithi162 ceph-mon[34833]: pgmap v531: 129 pgs: 129 active+clean; 29 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 54 KiB/s rd, 219 MiB/s wr, 1.44k op/s 2024-09-21T07:55:41.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:41 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:55:41.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:41 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:55:41.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:41 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:55:41.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:41 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:55:41.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:41 smithi084 ceph-mon[30411]: pgmap v531: 129 pgs: 129 active+clean; 29 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 54 KiB/s rd, 219 MiB/s wr, 1.44k op/s 2024-09-21T07:55:42.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:55:42.777 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:43.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:43 smithi084 ceph-mon[30411]: pgmap v532: 129 pgs: 129 active+clean; 29 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 20 KiB/s rd, 229 MiB/s wr, 1.47k op/s 2024-09-21T07:55:43.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.593+0000 7f471a200640 1 -- 172.21.15.84:0/2281351931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410a660 msgr2=0x7f471410aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.593+0000 7f471a200640 1 --2- 172.21.15.84:0/2281351931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410a660 0x7f471410aa70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4704008570 tx=0x7f470402e360 comp rx=0 tx=0).stop 2024-09-21T07:55:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.594+0000 7f471a200640 1 -- 172.21.15.84:0/2281351931 shutdown_connections 2024-09-21T07:55:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.594+0000 7f471a200640 1 --2- 172.21.15.84:0/2281351931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f471410cf70 0x7f471407b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.594+0000 7f471a200640 1 --2- 172.21.15.84:0/2281351931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f471410c620 0x7f471410ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.594+0000 7f471a200640 1 --2- 172.21.15.84:0/2281351931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410a660 0x7f471410aa70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.594+0000 7f471a200640 1 -- 172.21.15.84:0/2281351931 >> 172.21.15.84:0/2281351931 conn(0x7f4714070c00 msgr2=0x7f4714071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.594+0000 7f471a200640 1 -- 172.21.15.84:0/2281351931 shutdown_connections 2024-09-21T07:55:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.594+0000 7f471a200640 1 -- 172.21.15.84:0/2281351931 wait complete. 2024-09-21T07:55:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.595+0000 7f471a200640 1 Processor -- start 2024-09-21T07:55:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.596+0000 7f471a200640 1 -- start start 2024-09-21T07:55:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.596+0000 7f471a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f471410a660 0x7f4714080680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.596+0000 7f471a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f471410c620 0x7f4714080bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.596+0000 7f471a200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410cf70 0x7f4714081140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.596+0000 7f471a200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f471407eaf0 con 0x7f471410c620 2024-09-21T07:55:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.596+0000 7f471a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f471407e970 con 0x7f471410a660 2024-09-21T07:55:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.596+0000 7f471a200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f471407ec70 con 0x7f471410cf70 2024-09-21T07:55:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.597+0000 7f4719800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410cf70 0x7f4714081140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.597+0000 7f4719800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410cf70 0x7f4714081140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60942/0 (socket says 172.21.15.84:60942) 2024-09-21T07:55:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.597+0000 7f4719800640 1 -- 172.21.15.84:0/1185105329 learned_addr learned my addr 172.21.15.84:0/1185105329 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.597+0000 7f4718e00640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f471410a660 0x7f4714080680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4713e00640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f471410c620 0x7f4714080bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4719800640 1 -- 172.21.15.84:0/1185105329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f471410a660 msgr2=0x7f4714080680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4719800640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f471410a660 0x7f4714080680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4719800640 1 -- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f471410c620 msgr2=0x7f4714080bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4719800640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f471410c620 0x7f4714080bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4719800640 1 -- 172.21.15.84:0/1185105329 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47141bd990 con 0x7f471410cf70 2024-09-21T07:55:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4718e00640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f471410a660 0x7f4714080680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.598+0000 7f4713e00640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f471410c620 0x7f4714080bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.599+0000 7f4719800640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410cf70 0x7f4714081140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f470c00eaa0 tx=0x7f470c00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.599+0000 7f4711600640 1 -- 172.21.15.84:0/1185105329 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c00cdb0 con 0x7f471410cf70 2024-09-21T07:55:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.599+0000 7f4711600640 1 -- 172.21.15.84:0/1185105329 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470c005020 con 0x7f471410cf70 2024-09-21T07:55:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.599+0000 7f4711600640 1 -- 172.21.15.84:0/1185105329 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0116d0 con 0x7f471410cf70 2024-09-21T07:55:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.599+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141bdc80 con 0x7f471410cf70 2024-09-21T07:55:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.599+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141be150 con 0x7f471410cf70 2024-09-21T07:55:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.604+0000 7f4711600640 1 -- 172.21.15.84:0/1185105329 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f470c0051d0 con 0x7f471410cf70 2024-09-21T07:55:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.605+0000 7f472286b740 1 Processor -- start 2024-09-21T07:55:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.605+0000 7f472286b740 1 -- start start 2024-09-21T07:55:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.606+0000 7f472286b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fa2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.606+0000 7f472286b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bd52f0 0x5630f8fa3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.606+0000 7f472286b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fa3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.606+0000 7f472286b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5630f8f186b0 con 0x5630f8bfe1b0 2024-09-21T07:55:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.606+0000 7f472286b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5630f8f07ae0 con 0x5630f8bd52f0 2024-09-21T07:55:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.606+0000 7f472286b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5630f8f0b8f0 con 0x5630f8bdd4d0 2024-09-21T07:55:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.606+0000 7f4711600640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46fc0b6700 0x7f46fc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.607+0000 7f4711600640 1 -- 172.21.15.84:0/1185105329 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f470c0e7b40 con 0x7f471410cf70 2024-09-21T07:55:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.607+0000 7f4719800640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46fc0b6700 0x7f46fc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fa2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4719800640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46fc0b6700 0x7f46fc0b8c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f470c0e4fc0 tx=0x7f470c009270 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fa2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39702/0 (socket says 172.21.15.84:39702) 2024-09-21T07:55:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 -- 172.21.15.84:0/3264629775 learned_addr learned my addr 172.21.15.84:0/3264629775 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4718e00640 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bd52f0 0x5630f8fa3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fa3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 -- 172.21.15.84:0/3264629775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 msgr2=0x5630f8fa3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fa3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 -- 172.21.15.84:0/3264629775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bd52f0 msgr2=0x5630f8fa3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.609+0000 7f4713e00640 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bd52f0 0x5630f8fa3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.610+0000 7f4713e00640 1 -- 172.21.15.84:0/3264629775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f8ed4780 con 0x5630f8bfe1b0 2024-09-21T07:55:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.610+0000 7f4713e00640 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fa2e10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f470800b610 tx=0x7f4708005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6431ead00197ff25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.611+0000 7f4702000640 1 -- 172.21.15.84:0/3264629775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470800b030 con 0x5630f8bfe1b0 2024-09-21T07:55:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.611+0000 7f4702000640 1 -- 172.21.15.84:0/3264629775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470800b1d0 con 0x5630f8bfe1b0 2024-09-21T07:55:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.611+0000 7f4702000640 1 -- 172.21.15.84:0/3264629775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080047a0 con 0x5630f8bfe1b0 2024-09-21T07:55:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 -- 172.21.15.84:0/3264629775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 msgr2=0x5630f8fa2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fa2e10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f470800b610 tx=0x7f4708005f90 comp rx=0 tx=0).stop 2024-09-21T07:55:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 -- 172.21.15.84:0/3264629775 shutdown_connections 2024-09-21T07:55:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fa3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bd52f0 0x5630f8fa3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 --2- 172.21.15.84:0/3264629775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fa2e10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 -- 172.21.15.84:0/3264629775 >> 172.21.15.84:0/3264629775 conn(0x5630f8bf2300 msgr2=0x5630f8fa0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 -- 172.21.15.84:0/3264629775 shutdown_connections 2024-09-21T07:55:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.613+0000 7f472286b740 1 -- 172.21.15.84:0/3264629775 wait complete. 2024-09-21T07:55:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.614+0000 7f472286b740 1 -- start start 2024-09-21T07:55:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.614+0000 7f472286b740 1 Processor -- start 2024-09-21T07:55:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f472286b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f472286b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f472286b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fbcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f472286b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5630f8e3fab0 con 0x5630f8bfe1b0 2024-09-21T07:55:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f472286b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5630f8eae570 con 0x5630f8bdd4d0 2024-09-21T07:55:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f472286b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5630f8fb1530 con 0x5630f8bd52f0 2024-09-21T07:55:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f472286b740 10 client.0 _ll_register_callbacks cb 0x5630f8ebd100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.615+0000 7f4713e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60946/0 (socket says 172.21.15.84:60946) 2024-09-21T07:55:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 -- 172.21.15.84:0/3644573053 learned_addr learned my addr 172.21.15.84:0/3644573053 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fbcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4718e00640 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 -- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 msgr2=0x5630f8fb7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 -- 172.21.15.84:0/3644573053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 msgr2=0x5630f8fbcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fbcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.616+0000 7f4713e00640 1 -- 172.21.15.84:0/3644573053 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f8c69790 con 0x5630f8bd52f0 2024-09-21T07:55:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.619+0000 7f4713e00640 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb74d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f470800bd30 tx=0x7f47080053f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=401434e55ce9c185 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.619+0000 7f46f6a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.620+0000 7f46f6a00640 1 -- 172.21.15.84:0/3644573053 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708030060 con 0x5630f8bd52f0 2024-09-21T07:55:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.620+0000 7f46f6a00640 1 -- 172.21.15.84:0/3644573053 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f47080188b0 con 0x5630f8bd52f0 2024-09-21T07:55:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.630+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f470800b1d0 con 0x5630f8bd52f0 2024-09-21T07:55:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.630+0000 7f46f6a00640 1 -- 172.21.15.84:0/3644573053 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4708020070 con 0x5630f8bd52f0 2024-09-21T07:55:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.639+0000 7f472286b740 10 client.26905 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.639+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5630f8ce2620 con 0x5630f8bd52f0 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.642+0000 7f46f6a00640 1 -- 172.21.15.84:0/3644573053 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470800b1d0 con 0x5630f8bd52f0 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.644+0000 7f46f6a00640 1 -- 172.21.15.84:0/3644573053 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f47080038f0 con 0x5630f8bd52f0 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.644+0000 7f472286b740 10 client.26905 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.644+0000 7f472286b740 10 client.26905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.644+0000 7f472286b740 20 client.26905 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.644+0000 7f472286b740 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8bbcd80 0x5630f8fc8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.644+0000 7f472286b740 4 client.26905 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.644+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630f8f1a600 con 0x5630f8bbcd80 2024-09-21T07:55:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.646+0000 7f4718e00640 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8bbcd80 0x5630f8fc8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.656+0000 7f4718e00640 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8bbcd80 0x5630f8fc8c00 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=542e16106a9e2f37 server_cookie=282c42db430210cf in_seq=0 out_seq=0 2024-09-21T07:55:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.661+0000 7f46f6a00640 10 client.26905 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.661+0000 7f46f6a00640 1 -- 172.21.15.84:0/3644573053 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630f8f1a600 con 0x5630f8bbcd80 2024-09-21T07:55:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.661+0000 7f46f6a00640 10 client.26905 handle_command_reply: tid=0 2024-09-21T07:55:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.661+0000 7f472286b740 1 client.26905 shutdown 2024-09-21T07:55:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.665+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 msgr2=0x5630f8fb74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.665+0000 7f472286b740 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb74d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f470800bd30 tx=0x7f47080053f0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.672+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 shutdown_connections 2024-09-21T07:55:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.672+0000 7f472286b740 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8fbcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.672+0000 7f472286b740 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.672+0000 7f472286b740 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8bbcd80 0x5630f8fc8c00 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.672+0000 7f472286b740 1 --2- 172.21.15.84:0/3644573053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb74d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.672+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 >> 172.21.15.84:0/3644573053 conn(0x5630f8bf2300 msgr2=0x5630f8fa3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.672+0000 7f46f6a00640 0 client.26905 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.676+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 shutdown_connections 2024-09-21T07:55:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.678+0000 7f472286b740 1 -- 172.21.15.84:0/3644573053 wait complete. 2024-09-21T07:55:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.680+0000 7f472286b740 20 client.26905 trim_cache size 0 max 16384 2024-09-21T07:55:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 Processor -- start 2024-09-21T07:55:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 -- start start 2024-09-21T07:55:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8f9f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f47141c8370 con 0x5630f8bfe1b0 2024-09-21T07:55:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47141c9eb0 con 0x5630f8bdd4d0 2024-09-21T07:55:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.711+0000 7f472286b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f47141c8a40 con 0x5630f8bd52f0 2024-09-21T07:55:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.712+0000 7f4718e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.714+0000 7f4718e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41538/0 (socket says 172.21.15.84:41538) 2024-09-21T07:55:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.714+0000 7f4718e00640 1 -- 172.21.15.84:0/1425375888 learned_addr learned my addr 172.21.15.84:0/1425375888 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.715+0000 7f4718e00640 1 -- 172.21.15.84:0/1425375888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 msgr2=0x5630f8fb2750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.715+0000 7f4718e00640 1 --2- 172.21.15.84:0/1425375888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb2750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.715+0000 7f4718e00640 1 -- 172.21.15.84:0/1425375888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 msgr2=0x5630f8f9f360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.715+0000 7f4718e00640 1 --2- 172.21.15.84:0/1425375888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8f9f360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.715+0000 7f4718e00640 1 -- 172.21.15.84:0/1425375888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f8fa3c50 con 0x5630f8bdd4d0 2024-09-21T07:55:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.715+0000 7f4718e00640 1 --2- 172.21.15.84:0/1425375888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb0910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4704005940 tx=0x7f470402e360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1faa9652723c0d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.716+0000 7f4701600640 1 -- 172.21.15.84:0/1425375888 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470404c070 con 0x5630f8bdd4d0 2024-09-21T07:55:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.717+0000 7f4701600640 1 -- 172.21.15.84:0/1425375888 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4704004780 con 0x5630f8bdd4d0 2024-09-21T07:55:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.717+0000 7f4701600640 1 -- 172.21.15.84:0/1425375888 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704040670 con 0x5630f8bdd4d0 2024-09-21T07:55:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.721+0000 7f472286b740 1 -- 172.21.15.84:0/1425375888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 msgr2=0x5630f8fb0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.721+0000 7f472286b740 1 --2- 172.21.15.84:0/1425375888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb0910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4704005940 tx=0x7f470402e360 comp rx=0 tx=0).stop 2024-09-21T07:55:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.722+0000 7f472286b740 1 -- 172.21.15.84:0/1425375888 shutdown_connections 2024-09-21T07:55:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.722+0000 7f472286b740 1 --2- 172.21.15.84:0/1425375888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bfe1b0 0x5630f8f9f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.722+0000 7f472286b740 1 --2- 172.21.15.84:0/1425375888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bdd4d0 0x5630f8fb0910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.722+0000 7f472286b740 1 --2- 172.21.15.84:0/1425375888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bd52f0 0x5630f8fb2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.722+0000 7f472286b740 1 -- 172.21.15.84:0/1425375888 >> 172.21.15.84:0/1425375888 conn(0x5630f8bf2300 msgr2=0x5630f8fb5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.723+0000 7f472286b740 1 -- 172.21.15.84:0/1425375888 shutdown_connections 2024-09-21T07:55:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.723+0000 7f472286b740 1 -- 172.21.15.84:0/1425375888 wait complete. 2024-09-21T07:55:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.724+0000 7f472286b740 1 -- start start 2024-09-21T07:55:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.724+0000 7f472286b740 1 Processor -- start 2024-09-21T07:55:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f472286b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bd52f0 0x5630f8fc3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f472286b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fbed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f472286b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bfe1b0 0x5630f8fbf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f472286b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f47141c97e0 con 0x5630f8bd52f0 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f472286b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47141c9110 con 0x5630f8bfe1b0 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f472286b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f47141c6330 con 0x5630f8bdd4d0 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f472286b740 10 client.0 _ll_register_callbacks cb 0x7f47040083f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f4718e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fbed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f4718e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fbed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60960/0 (socket says 172.21.15.84:60960) 2024-09-21T07:55:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.725+0000 7f4718e00640 1 -- 172.21.15.84:0/2712782776 learned_addr learned my addr 172.21.15.84:0/2712782776 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.726+0000 7f4718e00640 1 -- 172.21.15.84:0/2712782776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bfe1b0 msgr2=0x5630f8fbf480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.726+0000 7f4718e00640 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bfe1b0 0x5630f8fbf480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.726+0000 7f4718e00640 1 -- 172.21.15.84:0/2712782776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bd52f0 msgr2=0x5630f8fc3850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.727+0000 7f4713e00640 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bd52f0 0x5630f8fc3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.727+0000 7f4718e00640 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bd52f0 0x5630f8fc3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.727+0000 7f4718e00640 1 -- 172.21.15.84:0/2712782776 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f9032370 con 0x5630f8bdd4d0 2024-09-21T07:55:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.727+0000 7f4713e00640 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bd52f0 0x5630f8fc3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.727+0000 7f4718e00640 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fbed70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f470402e880 tx=0x7f4704004b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e22921d26c35f6d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.727+0000 7f46f6a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.727+0000 7f46f6a00640 1 -- 172.21.15.84:0/2712782776 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470404c070 con 0x5630f8bdd4d0 2024-09-21T07:55:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.728+0000 7f46f6a00640 1 -- 172.21.15.84:0/2712782776 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f4704004f70 con 0x5630f8bdd4d0 2024-09-21T07:55:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.729+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4704004780 con 0x5630f8bdd4d0 2024-09-21T07:55:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.729+0000 7f46f6a00640 1 -- 172.21.15.84:0/2712782776 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4704005170 con 0x5630f8bdd4d0 2024-09-21T07:55:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.729+0000 7f472286b740 10 client.26908 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.729+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5630f9033510 con 0x5630f8bdd4d0 2024-09-21T07:55:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.731+0000 7f46f6a00640 1 -- 172.21.15.84:0/2712782776 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4704004780 con 0x5630f8bdd4d0 2024-09-21T07:55:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.731+0000 7f46f6a00640 1 -- 172.21.15.84:0/2712782776 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4704040410 con 0x5630f8bdd4d0 2024-09-21T07:55:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.732+0000 7f472286b740 10 client.26908 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.732+0000 7f472286b740 10 client.26908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.732+0000 7f472286b740 20 client.26908 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.732+0000 7f472286b740 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8b921c0 0x5630f9035b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.732+0000 7f472286b740 4 client.26908 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:55:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.732+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630f8f160b0 con 0x5630f8b921c0 2024-09-21T07:55:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.733+0000 7f4713e00640 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8b921c0 0x5630f9035b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.734+0000 7f46f6a00640 10 client.26908 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.736+0000 7f4713e00640 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8b921c0 0x5630f9035b60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463826e58823fd77 server_cookie=340f5426e47f00f9 in_seq=0 out_seq=0 2024-09-21T07:55:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.756+0000 7f46f6a00640 1 -- 172.21.15.84:0/2712782776 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630f8f160b0 con 0x5630f8b921c0 2024-09-21T07:55:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.756+0000 7f46f6a00640 10 client.26908 handle_command_reply: tid=0 2024-09-21T07:55:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.756+0000 7f472286b740 1 client.26908 shutdown 2024-09-21T07:55:43.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.758+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 msgr2=0x5630f8fbed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.758+0000 7f12f1200640 1 -- 172.21.15.84:0/2215001096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec114440 msgr2=0x7f12ec116910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.758+0000 7f12f1200640 1 --2- 172.21.15.84:0/2215001096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec114440 0x7f12ec116910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12e401acb0 tx=0x7f12e403b900 comp rx=0 tx=0).stop 2024-09-21T07:55:43.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f12f1200640 1 -- 172.21.15.84:0/2215001096 shutdown_connections 2024-09-21T07:55:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f472286b740 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fbed70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f470402e880 tx=0x7f4704004b20 comp rx=0 tx=0).stop 2024-09-21T07:55:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 shutdown_connections 2024-09-21T07:55:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f472286b740 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5630f8bfe1b0 0x5630f8fbf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f472286b740 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5630f8b921c0 0x5630f9035b60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f472286b740 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630f8bdd4d0 0x5630f8fbed70 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f470402e880 tx=0x7f4704004b20 comp rx=0 tx=0).stop 2024-09-21T07:55:43.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f472286b740 1 --2- 172.21.15.84:0/2712782776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5630f8bd52f0 0x5630f8fc3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f46f6a00640 0 client.26908 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 >> 172.21.15.84:0/2712782776 conn(0x5630f8bf2300 msgr2=0x5630f8fa3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.760+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 shutdown_connections 2024-09-21T07:55:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.760+0000 7f472286b740 1 -- 172.21.15.84:0/2712782776 wait complete. 2024-09-21T07:55:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.760+0000 7f472286b740 20 client.26908 trim_cache size 0 max 16384 2024-09-21T07:55:43.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f12f1200640 1 --2- 172.21.15.84:0/2215001096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec114440 0x7f12ec116910 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f12f1200640 1 --2- 172.21.15.84:0/2215001096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec075dd0 0x7f12ec0761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f12f1200640 1 --2- 172.21.15.84:0/2215001096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 0x7f12ec0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.759+0000 7f12f1200640 1 -- 172.21.15.84:0/2215001096 >> 172.21.15.84:0/2215001096 conn(0x7f12ec0ff5e0 msgr2=0x7f12ec101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.760+0000 7f12f1200640 1 -- 172.21.15.84:0/2215001096 shutdown_connections 2024-09-21T07:55:43.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.760+0000 7f12f1200640 1 -- 172.21.15.84:0/2215001096 wait complete. 2024-09-21T07:55:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:55:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:55:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:55:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:55:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.762+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46fc0b6700 msgr2=0x7f46fc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.762+0000 7f471a200640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46fc0b6700 0x7f46fc0b8c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f470c0e4fc0 tx=0x7f470c009270 comp rx=0 tx=0).stop 2024-09-21T07:55:43.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.762+0000 7f12f1200640 1 Processor -- start 2024-09-21T07:55:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.762+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410cf70 msgr2=0x7f4714081140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.762+0000 7f471a200640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410cf70 0x7f4714081140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f470c00eaa0 tx=0x7f470c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:55:43.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.762+0000 7f12f1200640 1 -- start start 2024-09-21T07:55:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 shutdown_connections 2024-09-21T07:55:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f471a200640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46fc0b6700 0x7f46fc0b8c10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f471a200640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471410cf70 0x7f4714081140 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f471a200640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f471410c620 0x7f4714080bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f471a200640 1 --2- 172.21.15.84:0/1185105329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f471410a660 0x7f4714080680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 >> 172.21.15.84:0/1185105329 conn(0x7f4714070c00 msgr2=0x7f4714071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f12f1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec075dd0 0x7f12ec113c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f12f1200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 0x7f12ec10ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f12f1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec114440 0x7f12ec110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f12f1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec10a4c0 con 0x7f12ec114440 2024-09-21T07:55:43.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f12f1200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec10a340 con 0x7f12ec075dd0 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f12f1200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec10a640 con 0x7f12ec077380 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.763+0000 7f12e9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 0x7f12ec10ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.764+0000 7f12e9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 0x7f12ec10ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60980/0 (socket says 172.21.15.84:60980) 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.764+0000 7f12e9400640 1 -- 172.21.15.84:0/1012220487 learned_addr learned my addr 172.21.15.84:0/1012220487 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.764+0000 7f12e9400640 1 -- 172.21.15.84:0/1012220487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec075dd0 msgr2=0x7f12ec113c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12e9e00640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec075dd0 0x7f12ec113c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12e9400640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec075dd0 0x7f12ec113c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12e9400640 1 -- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec114440 msgr2=0x7f12ec110520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12ea800640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec114440 0x7f12ec110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12e9400640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec114440 0x7f12ec110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12e9400640 1 -- 172.21.15.84:0/1012220487 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec110d40 con 0x7f12ec077380 2024-09-21T07:55:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12ea800640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec114440 0x7f12ec110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.766+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 shutdown_connections 2024-09-21T07:55:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:43.766+0000 7f471a200640 1 -- 172.21.15.84:0/1185105329 wait complete. 2024-09-21T07:55:43.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.765+0000 7f12e9400640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 0x7f12ec10ff30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f12d800b450 tx=0x7f12d800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.766+0000 7f12e2a00640 1 -- 172.21.15.84:0/1012220487 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8015020 con 0x7f12ec077380 2024-09-21T07:55:43.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.766+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ec1a46c0 con 0x7f12ec077380 2024-09-21T07:55:43.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.766+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ec1a4c20 con 0x7f12ec077380 2024-09-21T07:55:43.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.766+0000 7f12e2a00640 1 -- 172.21.15.84:0/1012220487 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d8011d40 con 0x7f12ec077380 2024-09-21T07:55:43.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.767+0000 7f12e2a00640 1 -- 172.21.15.84:0/1012220487 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d800f340 con 0x7f12ec077380 2024-09-21T07:55:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.773+0000 7f12e2a00640 1 -- 172.21.15.84:0/1012220487 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f12d8018020 con 0x7f12ec077380 2024-09-21T07:55:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.773+0000 7f12f7dc6740 1 Processor -- start 2024-09-21T07:55:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.773+0000 7f12f7dc6740 1 -- start start 2024-09-21T07:55:43.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.774+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a804d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.774+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a8052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.774+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.774+0000 7f12f7dc6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56125a77bf70 con 0x56125a43d390 2024-09-21T07:55:43.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.774+0000 7f12f7dc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56125a76b3a0 con 0x56125a4351b0 2024-09-21T07:55:43.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.774+0000 7f12f7dc6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56125a76f1b0 con 0x56125a45e070 2024-09-21T07:55:43.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.775+0000 7f12ea800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a804d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.775+0000 7f12e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a8052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.775+0000 7f12e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a8052a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41560/0 (socket says 172.21.15.84:41560) 2024-09-21T07:55:43.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.775+0000 7f12e9e00640 1 -- 172.21.15.84:0/3803887840 learned_addr learned my addr 172.21.15.84:0/3803887840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.775+0000 7f12e9400640 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.775+0000 7f12e2a00640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f12d00b6700 0x7f12d00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.776+0000 7f12e9e00640 1 -- 172.21.15.84:0/3803887840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 msgr2=0x56125a804d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.776+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a804d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.776+0000 7f12e9e00640 1 -- 172.21.15.84:0/3803887840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 msgr2=0x56125a8057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.776+0000 7f12e2a00640 1 -- 172.21.15.84:0/1012220487 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f12d80e7290 con 0x7f12ec077380 2024-09-21T07:55:43.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.776+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8057e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.776+0000 7f12e9e00640 1 -- 172.21.15.84:0/3803887840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125a735c90 con 0x56125a4351b0 2024-09-21T07:55:43.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.776+0000 7f12e9400640 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:43.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.777+0000 7f12ea800640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f12d00b6700 0x7f12d00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.778+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a8052a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009c50 tx=0x7f12dc010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7be025d00226256f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.779+0000 7f12ea800640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f12d00b6700 0x7f12d00b8c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12e401aa70 tx=0x7f12e401a5d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.780+0000 7f12d7400640 1 -- 172.21.15.84:0/3803887840 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc005020 con 0x56125a4351b0 2024-09-21T07:55:43.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.781+0000 7f12d7400640 1 -- 172.21.15.84:0/3803887840 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12dc0047a0 con 0x56125a4351b0 2024-09-21T07:55:43.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.781+0000 7f12d7400640 1 -- 172.21.15.84:0/3803887840 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0126b0 con 0x56125a4351b0 2024-09-21T07:55:43.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.782+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3803887840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 msgr2=0x56125a8052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.782+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a8052a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009c50 tx=0x7f12dc010740 comp rx=0 tx=0).stop 2024-09-21T07:55:43.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.783+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3803887840 shutdown_connections 2024-09-21T07:55:43.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.783+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.783+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a8052a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.783+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3803887840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a804d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.783+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3803887840 >> 172.21.15.84:0/3803887840 conn(0x56125a452460 msgr2=0x56125a802c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.784+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3803887840 shutdown_connections 2024-09-21T07:55:43.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.784+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3803887840 wait complete. 2024-09-21T07:55:43.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.785+0000 7f12f7dc6740 1 -- start start 2024-09-21T07:55:43.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.785+0000 7f12f7dc6740 1 Processor -- start 2024-09-21T07:55:43.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.786+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a4351b0 0x56125a8104a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.786+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.786+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a81c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.786+0000 7f12f7dc6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56125a5cc700 con 0x56125a43d390 2024-09-21T07:55:43.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12f7dc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56125a706540 con 0x56125a45e070 2024-09-21T07:55:43.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12f7dc6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56125a813540 con 0x56125a4351b0 2024-09-21T07:55:43.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12e9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a4351b0 0x56125a8104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12e9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a4351b0 0x56125a8104a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:32768/0 (socket says 172.21.15.84:32768) 2024-09-21T07:55:43.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12e9e00640 1 -- 172.21.15.84:0/3442178289 learned_addr learned my addr 172.21.15.84:0/3442178289 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12f7dc6740 10 client.0 _ll_register_callbacks cb 0x56125a716430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:43.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12ea800640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a81c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12e9400640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.787+0000 7f12e9e00640 1 -- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 msgr2=0x56125a81c8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:55:43.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.788+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a81c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.788+0000 7f12e9e00640 1 -- 172.21.15.84:0/3442178289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 msgr2=0x56125a8109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.788+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8109e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.788+0000 7f12e9e00640 1 -- 172.21.15.84:0/3442178289 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125a4c9650 con 0x56125a4351b0 2024-09-21T07:55:43.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.788+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a4351b0 0x56125a8104a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f12dc005940 tx=0x7f12dc009d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25c8d48eb11803 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.788+0000 7f12cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:43.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12ea800640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a81c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:43.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12e9400640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:43.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12cbe00640 1 -- 172.21.15.84:0/3442178289 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc004220 con 0x56125a4351b0 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12cbe00640 1 -- 172.21.15.84:0/3442178289 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f12dc0043c0 con 0x56125a4351b0 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56125a708b50 con 0x56125a4351b0 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12cbe00640 1 -- 172.21.15.84:0/3442178289 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12dc0046c0 con 0x56125a4351b0 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12f7dc6740 10 client.26920 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.789+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56125a723910 con 0x56125a4351b0 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12cbe00640 1 -- 172.21.15.84:0/3442178289 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56125a708b50 con 0x56125a4351b0 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12cbe00640 1 -- 172.21.15.84:0/3442178289 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f12dc00f040 con 0x56125a4351b0 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12f7dc6740 10 client.26920 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12f7dc6740 10 client.26920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:43.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12f7dc6740 20 client.26920 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:43.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a41c9f0 0x56125a822480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12f7dc6740 4 client.26920 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:43.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.790+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56125a77dec0 con 0x56125a41c9f0 2024-09-21T07:55:43.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.791+0000 7f12e9400640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a41c9f0 0x56125a822480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.791+0000 7f12cbe00640 10 client.26920 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.794+0000 7f12e9400640 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a41c9f0 0x56125a822480 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e64ddcc66a92a09 server_cookie=bd776937df5ee1b9 in_seq=0 out_seq=0 2024-09-21T07:55:43.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.795+0000 7f12cbe00640 1 -- 172.21.15.84:0/3442178289 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56125a77dec0 con 0x56125a41c9f0 2024-09-21T07:55:43.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.795+0000 7f12cbe00640 10 client.26920 handle_command_reply: tid=0 2024-09-21T07:55:43.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.795+0000 7f12f7dc6740 1 client.26920 shutdown 2024-09-21T07:55:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a4351b0 msgr2=0x56125a8104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a4351b0 0x56125a8104a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f12dc005940 tx=0x7f12dc009d40 comp rx=0 tx=0).stop 2024-09-21T07:55:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 shutdown_connections 2024-09-21T07:55:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a81c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a8109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a41c9f0 0x56125a822480 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3442178289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a4351b0 0x56125a8104a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12cbe00640 0 client.26920 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.796+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 >> 172.21.15.84:0/3442178289 conn(0x56125a452460 msgr2=0x56125a807ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.797+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 shutdown_connections 2024-09-21T07:55:43.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.797+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3442178289 wait complete. 2024-09-21T07:55:43.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.797+0000 7f12f7dc6740 20 client.26920 trim_cache size 0 max 16384 2024-09-21T07:55:43.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:43 smithi162 ceph-mon[34833]: pgmap v532: 129 pgs: 129 active+clean; 29 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 20 KiB/s rd, 229 MiB/s wr, 1.47k op/s 2024-09-21T07:55:43.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.834+0000 7f12f7dc6740 1 Processor -- start 2024-09-21T07:55:43.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.835+0000 7f12f7dc6740 1 -- start start 2024-09-21T07:55:43.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.835+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a80f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.835+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a81c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.836+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a8120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.836+0000 7f12e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a80f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.836+0000 7f12e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a80f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41572/0 (socket says 172.21.15.84:41572) 2024-09-21T07:55:43.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.836+0000 7f12e9e00640 1 -- 172.21.15.84:0/97344009 learned_addr learned my addr 172.21.15.84:0/97344009 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc00fdd0 con 0x56125a43d390 2024-09-21T07:55:43.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc011910 con 0x56125a4351b0 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0104a0 con 0x56125a45e070 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12ea800640 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a8120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12e9e00640 1 -- 172.21.15.84:0/97344009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 msgr2=0x56125a8120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12e9e00640 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a8120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12e9e00640 1 -- 172.21.15.84:0/97344009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 msgr2=0x56125a81c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12e9e00640 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a81c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.837+0000 7f12e9e00640 1 -- 172.21.15.84:0/97344009 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125a806ca0 con 0x56125a4351b0 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.838+0000 7f12e9e00640 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a80f390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0099b0 tx=0x7f12dc009aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa715bc266c201c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.838+0000 7f12d6a00640 1 -- 172.21.15.84:0/97344009 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc03d070 con 0x56125a4351b0 2024-09-21T07:55:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.838+0000 7f12d6a00640 1 -- 172.21.15.84:0/97344009 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12dc009db0 con 0x56125a4351b0 2024-09-21T07:55:43.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.838+0000 7f12d6a00640 1 -- 172.21.15.84:0/97344009 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc004b90 con 0x56125a4351b0 2024-09-21T07:55:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.841+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 msgr2=0x56125a80f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.841+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a80f390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0099b0 tx=0x7f12dc009aa0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.842+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 shutdown_connections 2024-09-21T07:55:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.842+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a45e070 0x56125a8120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.842+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a43d390 0x56125a81c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.842+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/97344009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a4351b0 0x56125a80f390 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.842+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 >> 172.21.15.84:0/97344009 conn(0x56125a452460 msgr2=0x56125a8119c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.846+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 shutdown_connections 2024-09-21T07:55:43.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.846+0000 7f12f7dc6740 1 -- 172.21.15.84:0/97344009 wait complete. 2024-09-21T07:55:43.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.846+0000 7f12f7dc6740 1 -- start start 2024-09-21T07:55:43.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.847+0000 7f12f7dc6740 1 Processor -- start 2024-09-21T07:55:43.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.851+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a4351b0 0x56125a814c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.851+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a43d390 0x56125a815210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.851+0000 7f12f7dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a88bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.852+0000 7f12ea800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a88bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.852+0000 7f12ea800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a88bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:41576/0 (socket says 172.21.15.84:41576) 2024-09-21T07:55:43.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.852+0000 7f12ea800640 1 -- 172.21.15.84:0/3711169569 learned_addr learned my addr 172.21.15.84:0/3711169569 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:43.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.853+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a4351b0 0x56125a814c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.853+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc011240 con 0x56125a4351b0 2024-09-21T07:55:43.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.853+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc010b70 con 0x56125a45e070 2024-09-21T07:55:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.853+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc00dd90 con 0x56125a43d390 2024-09-21T07:55:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.853+0000 7f12f7dc6740 10 client.0 _ll_register_callbacks cb 0x7f12dc0052e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.853+0000 7f12e9400640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a43d390 0x56125a815210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.854+0000 7f12ea800640 1 -- 172.21.15.84:0/3711169569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a43d390 msgr2=0x56125a815210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.854+0000 7f12ea800640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a43d390 0x56125a815210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.854+0000 7f12ea800640 1 -- 172.21.15.84:0/3711169569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a4351b0 msgr2=0x56125a814c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:43.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.855+0000 7f12ea800640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a4351b0 0x56125a814c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.855+0000 7f12ea800640 1 -- 172.21.15.84:0/3711169569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125a88c330 con 0x56125a45e070 2024-09-21T07:55:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.855+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a4351b0 0x56125a814c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:43.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.856+0000 7f12ea800640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a88bdf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f12e403be20 tx=0x7f12e403b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85fc8296f1d62bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.857+0000 7f12cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.857+0000 7f12cbe00640 1 -- 172.21.15.84:0/3711169569 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4045040 con 0x56125a45e070 2024-09-21T07:55:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.857+0000 7f12cbe00640 1 -- 172.21.15.84:0/3711169569 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f12e4019040 con 0x56125a45e070 2024-09-21T07:55:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.857+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12dc009db0 con 0x56125a45e070 2024-09-21T07:55:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.857+0000 7f12cbe00640 1 -- 172.21.15.84:0/3711169569 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12e4070050 con 0x56125a45e070 2024-09-21T07:55:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 10 client.26903 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:43.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56125a88d4c0 con 0x56125a45e070 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12cbe00640 1 -- 172.21.15.84:0/3711169569 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12dc009db0 con 0x56125a45e070 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12cbe00640 1 -- 172.21.15.84:0/3711169569 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f12e40554e0 con 0x56125a45e070 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 10 client.26903 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 10 client.26903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 20 client.26903 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a3f1da0 0x56125a88fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 4 client.26903 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:55:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.858+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56125a779970 con 0x56125a3f1da0 2024-09-21T07:55:43.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.859+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a3f1da0 0x56125a88fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:43.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.860+0000 7f12cbe00640 10 client.26903 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.860+0000 7f12e9e00640 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a3f1da0 0x56125a88fd00 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d942251b261f3bcb server_cookie=c4a5bb79a6db7cd in_seq=0 out_seq=0 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.860+0000 7f12cbe00640 1 -- 172.21.15.84:0/3711169569 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x56125a779970 con 0x56125a3f1da0 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.860+0000 7f12cbe00640 10 client.26903 handle_command_reply: tid=0 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.860+0000 7f12f7dc6740 1 client.26903 shutdown 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.860+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 msgr2=0x56125a88bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.860+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a88bdf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f12e403be20 tx=0x7f12e403b900 comp rx=0 tx=0).stop 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 shutdown_connections 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56125a45e070 0x56125a88bdf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56125a3f1da0 0x56125a88fd00 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56125a43d390 0x56125a815210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 --2- 172.21.15.84:0/3711169569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56125a4351b0 0x56125a814c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12cbe00640 0 client.26903 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:43.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 >> 172.21.15.84:0/3711169569 conn(0x56125a452460 msgr2=0x56125a808350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 shutdown_connections 2024-09-21T07:55:43.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 1 -- 172.21.15.84:0/3711169569 wait complete. 2024-09-21T07:55:43.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.861+0000 7f12f7dc6740 20 client.26903 trim_cache size 0 max 16384 2024-09-21T07:55:43.864 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T07:55:43.865 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:55:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:55:43.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:55:43.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:55:43.869 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:55:43.869 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:55:43.869 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:55:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.863+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f12d00b6700 msgr2=0x7f12d00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.863+0000 7f12f1200640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f12d00b6700 0x7f12d00b8c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12e401aa70 tx=0x7f12e401a5d0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.863+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 msgr2=0x7f12ec10ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.863+0000 7f12f1200640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 0x7f12ec10ff30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f12d800b450 tx=0x7f12d800b910 comp rx=0 tx=0).stop 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.864+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 shutdown_connections 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.864+0000 7f12f1200640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f12d00b6700 0x7f12d00b8c10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.864+0000 7f12f1200640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec114440 0x7f12ec110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.864+0000 7f12f1200640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12ec077380 0x7f12ec10ff30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.864+0000 7f12f1200640 1 --2- 172.21.15.84:0/1012220487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12ec075dd0 0x7f12ec113c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.864+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 >> 172.21.15.84:0/1012220487 conn(0x7f12ec0ff5e0 msgr2=0x7f12ec1035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.866+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 shutdown_connections 2024-09-21T07:55:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:43.866+0000 7f12f1200640 1 -- 172.21.15.84:0/1012220487 wait complete. 2024-09-21T07:55:43.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:43 smithi191 ceph-mon[34667]: pgmap v532: 129 pgs: 129 active+clean; 29 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 20 KiB/s rd, 229 MiB/s wr, 1.47k op/s 2024-09-21T07:55:44.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:44 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:55:44.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:44 smithi162 ceph-mon[34833]: pgmap v533: 129 pgs: 129 active+clean; 30 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 41 KiB/s rd, 228 MiB/s wr, 1.44k op/s 2024-09-21T07:55:44.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:44 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:55:44.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:44 smithi084 ceph-mon[30411]: pgmap v533: 129 pgs: 129 active+clean; 30 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 41 KiB/s rd, 228 MiB/s wr, 1.44k op/s 2024-09-21T07:55:44.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:44 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:55:44.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:44 smithi191 ceph-mon[34667]: pgmap v533: 129 pgs: 129 active+clean; 30 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 41 KiB/s rd, 228 MiB/s wr, 1.44k op/s 2024-09-21T07:55:45.803 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:55:45.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:55:46.801 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:47.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:47 smithi084 ceph-mon[30411]: pgmap v534: 129 pgs: 129 active+clean; 30 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 36 KiB/s rd, 211 MiB/s wr, 1.19k op/s 2024-09-21T07:55:47.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:47 smithi191 ceph-mon[34667]: pgmap v534: 129 pgs: 129 active+clean; 30 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 36 KiB/s rd, 211 MiB/s wr, 1.19k op/s 2024-09-21T07:55:47.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:47 smithi162 ceph-mon[34833]: pgmap v534: 129 pgs: 129 active+clean; 30 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 36 KiB/s rd, 211 MiB/s wr, 1.19k op/s 2024-09-21T07:55:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.880+0000 7f8454c00640 1 -- 172.21.15.84:0/622269034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845011cc30 msgr2=0x7f845011f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.880+0000 7f8454c00640 1 --2- 172.21.15.84:0/622269034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845011cc30 0x7f845011f140 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8448009ca0 tx=0x7f844802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.882+0000 7f8454c00640 1 -- 172.21.15.84:0/622269034 shutdown_connections 2024-09-21T07:55:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.882+0000 7f8454c00640 1 --2- 172.21.15.84:0/622269034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845011cc30 0x7f845011f140 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.882+0000 7f8454c00640 1 --2- 172.21.15.84:0/622269034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f845010a9e0 0x7f845010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.882+0000 7f8454c00640 1 --2- 172.21.15.84:0/622269034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8450111f40 0x7f845010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.882+0000 7f8454c00640 1 -- 172.21.15.84:0/622269034 >> 172.21.15.84:0/622269034 conn(0x7f8450070ec0 msgr2=0x7f84500712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.883+0000 7f8454c00640 1 -- 172.21.15.84:0/622269034 shutdown_connections 2024-09-21T07:55:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.883+0000 7f8454c00640 1 -- 172.21.15.84:0/622269034 wait complete. 2024-09-21T07:55:47.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.885+0000 7f8454c00640 1 Processor -- start 2024-09-21T07:55:47.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.886+0000 7f8454c00640 1 -- start start 2024-09-21T07:55:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.887+0000 7f8454c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845010a9e0 0x7f84501a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f8454c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8450111f40 0x7f84501a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f8454c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f845011cc30 0x7f84501aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f8454c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f84501228b0 con 0x7f845010a9e0 2024-09-21T07:55:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f8454c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8450122730 con 0x7f845011cc30 2024-09-21T07:55:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f8454c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8450122a30 con 0x7f8450111f40 2024-09-21T07:55:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f844e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f845011cc30 0x7f84501aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f844e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f845011cc30 0x7f84501aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50858/0 (socket says 172.21.15.84:50858) 2024-09-21T07:55:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.888+0000 7f844e800640 1 -- 172.21.15.84:0/369274339 learned_addr learned my addr 172.21.15.84:0/369274339 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:47.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.889+0000 7f844e800640 1 -- 172.21.15.84:0/369274339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8450111f40 msgr2=0x7f84501a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:47.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.889+0000 7f844e800640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8450111f40 0x7f84501a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.889+0000 7f844e800640 1 -- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845010a9e0 msgr2=0x7f84501a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.889+0000 7f844e800640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845010a9e0 0x7f84501a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.889+0000 7f844e800640 1 -- 172.21.15.84:0/369274339 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84501af210 con 0x7f845011cc30 2024-09-21T07:55:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.889+0000 7f844e800640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f845011cc30 0x7f84501aeae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f84480098d0 tx=0x7f84480319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.890+0000 7f8447400640 1 -- 172.21.15.84:0/369274339 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448003bf0 con 0x7f845011cc30 2024-09-21T07:55:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.890+0000 7f8447400640 1 -- 172.21.15.84:0/369274339 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8448003d90 con 0x7f845011cc30 2024-09-21T07:55:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.890+0000 7f8447400640 1 -- 172.21.15.84:0/369274339 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844802fb40 con 0x7f845011cc30 2024-09-21T07:55:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.890+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84501af4a0 con 0x7f845011cc30 2024-09-21T07:55:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.890+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84501af8d0 con 0x7f845011cc30 2024-09-21T07:55:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.892+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f845010adf0 con 0x7f845011cc30 2024-09-21T07:55:47.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.897+0000 7f8447400640 1 -- 172.21.15.84:0/369274339 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8448004610 con 0x7f845011cc30 2024-09-21T07:55:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.899+0000 7f8447400640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f84340b66b0 0x7f84340b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:47.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.899+0000 7f8447400640 1 -- 172.21.15.84:0/369274339 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8448108bc0 con 0x7f845011cc30 2024-09-21T07:55:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.900+0000 7f844de00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f84340b66b0 0x7f84340b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:47.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.900+0000 7f8447400640 1 -- 172.21.15.84:0/369274339 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84480cef00 con 0x7f845011cc30 2024-09-21T07:55:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:47.901+0000 7f844de00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f84340b66b0 0x7f84340b8bc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8440005d80 tx=0x7f8440005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:48.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.358+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84501b5d80 con 0x7f845011cc30 2024-09-21T07:55:48.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.364+0000 7f8447400640 1 -- 172.21.15.84:0/369274339 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f84480d32e0 con 0x7f845011cc30 2024-09-21T07:55:48.367 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:55:48.368 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:55:48.368 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f84340b66b0 msgr2=0x7f84340b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f84340b66b0 0x7f84340b8bc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8440005d80 tx=0x7f8440005c90 comp rx=0 tx=0).stop 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f845011cc30 msgr2=0x7f84501aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f845011cc30 0x7f84501aeae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f84480098d0 tx=0x7f84480319f0 comp rx=0 tx=0).stop 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 shutdown_connections 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f84340b66b0 0x7f84340b8bc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f845011cc30 0x7f84501aeae0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8450111f40 0x7f84501a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 --2- 172.21.15.84:0/369274339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f845010a9e0 0x7f84501a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 >> 172.21.15.84:0/369274339 conn(0x7f8450070ec0 msgr2=0x7f845011e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:48.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 shutdown_connections 2024-09-21T07:55:48.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:48.369+0000 7f8454c00640 1 -- 172.21.15.84:0/369274339 wait complete. 2024-09-21T07:55:49.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:49 smithi191 ceph-mon[34667]: pgmap v535: 129 pgs: 129 active+clean; 31 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 36 KiB/s rd, 230 MiB/s wr, 1.06k op/s 2024-09-21T07:55:49.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/369274339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:55:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:49 smithi162 ceph-mon[34833]: pgmap v535: 129 pgs: 129 active+clean; 31 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 36 KiB/s rd, 230 MiB/s wr, 1.06k op/s 2024-09-21T07:55:49.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/369274339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:55:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:49 smithi084 ceph-mon[30411]: pgmap v535: 129 pgs: 129 active+clean; 31 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 36 KiB/s rd, 230 MiB/s wr, 1.06k op/s 2024-09-21T07:55:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/369274339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:55:49.901 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:55:50.604 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:51.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:51 smithi191 ceph-mon[34667]: pgmap v536: 129 pgs: 129 active+clean; 31 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 46 KiB/s rd, 232 MiB/s wr, 850 op/s 2024-09-21T07:55:51.727 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:51 smithi084 ceph-mon[30411]: pgmap v536: 129 pgs: 129 active+clean; 31 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 46 KiB/s rd, 232 MiB/s wr, 850 op/s 2024-09-21T07:55:51.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:51 smithi162 ceph-mon[34833]: pgmap v536: 129 pgs: 129 active+clean; 31 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 46 KiB/s rd, 232 MiB/s wr, 850 op/s 2024-09-21T07:55:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.801+0000 7f9273e00640 1 -- 172.21.15.84:0/2340996567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 msgr2=0x7f927410e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.801+0000 7f9273e00640 1 --2- 172.21.15.84:0/2340996567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 0x7f927410e680 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f926c009be0 tx=0x7f926c02a710 comp rx=0 tx=0).stop 2024-09-21T07:55:51.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.803+0000 7f9273e00640 1 -- 172.21.15.84:0/2340996567 shutdown_connections 2024-09-21T07:55:51.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.803+0000 7f9273e00640 1 --2- 172.21.15.84:0/2340996567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 0x7f927410e680 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.803+0000 7f9273e00640 1 --2- 172.21.15.84:0/2340996567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 0x7f9274107910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.803+0000 7f9273e00640 1 --2- 172.21.15.84:0/2340996567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9274101bc0 0x7f9274101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.803+0000 7f9273e00640 1 -- 172.21.15.84:0/2340996567 >> 172.21.15.84:0/2340996567 conn(0x7f9274078680 msgr2=0x7f9274078ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.803+0000 7f9273e00640 1 -- 172.21.15.84:0/2340996567 shutdown_connections 2024-09-21T07:55:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.804+0000 7f9273e00640 1 -- 172.21.15.84:0/2340996567 wait complete. 2024-09-21T07:55:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.805+0000 7f9273e00640 1 Processor -- start 2024-09-21T07:55:51.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.806+0000 7f9273e00640 1 -- start start 2024-09-21T07:55:51.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.807+0000 7f9273e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9274101bc0 0x7f9274074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.807+0000 7f9273e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 0x7f927406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.808+0000 7f9273e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 0x7f927406e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.808+0000 7f9272000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 0x7f927406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.808+0000 7f9272000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 0x7f927406dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37402/0 (socket says 172.21.15.84:37402) 2024-09-21T07:55:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9272000640 1 -- 172.21.15.84:0/4292144920 learned_addr learned my addr 172.21.15.84:0/4292144920 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9274111700 con 0x7f9274107e50 2024-09-21T07:55:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9274111580 con 0x7f9274101bc0 2024-09-21T07:55:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9274111880 con 0x7f9274107500 2024-09-21T07:55:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9273400640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 0x7f927406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9272a00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9274101bc0 0x7f9274074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9272000640 1 -- 172.21.15.84:0/4292144920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9274101bc0 msgr2=0x7f9274074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9272000640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9274101bc0 0x7f9274074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9272000640 1 -- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 msgr2=0x7f927406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9272000640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 0x7f927406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.809+0000 7f9272000640 1 -- 172.21.15.84:0/4292144920 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927406ec10 con 0x7f9274107500 2024-09-21T07:55:51.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.815+0000 7f9272000640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 0x7f927406dfd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f926000b450 tx=0x7f926000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.815+0000 7f926b400640 1 -- 172.21.15.84:0/4292144920 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260015020 con 0x7f9274107500 2024-09-21T07:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.815+0000 7f926b400640 1 -- 172.21.15.84:0/4292144920 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9260011d40 con 0x7f9274107500 2024-09-21T07:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.815+0000 7f926b400640 1 -- 172.21.15.84:0/4292144920 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926000f340 con 0x7f9274107500 2024-09-21T07:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.815+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9274073970 con 0x7f9274107500 2024-09-21T07:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.816+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9274073e60 con 0x7f9274107500 2024-09-21T07:55:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.833+0000 7f92805e2740 1 Processor -- start 2024-09-21T07:55:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.833+0000 7f92805e2740 1 -- start start 2024-09-21T07:55:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f92805e2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc997c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f92805e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc995180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f92805e2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc995810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f92805e2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5648dc909fb0 con 0x5648dc5ec070 2024-09-21T07:55:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f92805e2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5648dc8f93e0 con 0x5648dc5c31b0 2024-09-21T07:55:51.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f92805e2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5648dc8fd1f0 con 0x5648dc5cb390 2024-09-21T07:55:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f9272a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc995180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f9272a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc995180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50872/0 (socket says 172.21.15.84:50872) 2024-09-21T07:55:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.834+0000 7f9272a00640 1 -- 172.21.15.84:0/3390265382 learned_addr learned my addr 172.21.15.84:0/3390265382 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f9272a00640 1 -- 172.21.15.84:0/3390265382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 msgr2=0x5648dc995810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f9272a00640 1 --2- 172.21.15.84:0/3390265382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc995810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f9272a00640 1 -- 172.21.15.84:0/3390265382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 msgr2=0x5648dc997c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f9272a00640 1 --2- 172.21.15.84:0/3390265382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc997c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f9272a00640 1 -- 172.21.15.84:0/3390265382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648dc8c3cd0 con 0x5648dc5c31b0 2024-09-21T07:55:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f9272a00640 1 --2- 172.21.15.84:0/3390265382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc995180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f926400b740 tx=0x7f926400bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbb4d23a6a0a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f925fe00640 1 -- 172.21.15.84:0/3390265382 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264003dd0 con 0x5648dc5c31b0 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.835+0000 7f926b400640 1 -- 172.21.15.84:0/4292144920 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9260018020 con 0x7f9274107500 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.836+0000 7f925fe00640 1 -- 172.21.15.84:0/3390265382 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9264015070 con 0x5648dc5c31b0 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.836+0000 7f925fe00640 1 -- 172.21.15.84:0/3390265382 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264011730 con 0x5648dc5c31b0 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.837+0000 7f92805e2740 1 -- 172.21.15.84:0/3390265382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 msgr2=0x5648dc995180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.837+0000 7f92805e2740 1 --2- 172.21.15.84:0/3390265382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc995180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f926400b740 tx=0x7f926400bc00 comp rx=0 tx=0).stop 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.838+0000 7f92805e2740 1 -- 172.21.15.84:0/3390265382 shutdown_connections 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.838+0000 7f92805e2740 1 --2- 172.21.15.84:0/3390265382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc995810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.838+0000 7f92805e2740 1 --2- 172.21.15.84:0/3390265382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc995180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.838+0000 7f92805e2740 1 --2- 172.21.15.84:0/3390265382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc997c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.838+0000 7f92805e2740 1 -- 172.21.15.84:0/3390265382 >> 172.21.15.84:0/3390265382 conn(0x5648dc5e0460 msgr2=0x5648dc993070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.839+0000 7f92805e2740 1 -- 172.21.15.84:0/3390265382 shutdown_connections 2024-09-21T07:55:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.839+0000 7f92805e2740 1 -- 172.21.15.84:0/3390265382 wait complete. 2024-09-21T07:55:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.839+0000 7f926b400640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92580b6670 0x7f92580b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.840+0000 7f926b400640 1 -- 172.21.15.84:0/4292144920 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f92600e6fb0 con 0x7f9274107500 2024-09-21T07:55:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.840+0000 7f92805e2740 1 -- start start 2024-09-21T07:55:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.841+0000 7f92805e2740 1 Processor -- start 2024-09-21T07:55:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.841+0000 7f9272a00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92580b6670 0x7f92580b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.844+0000 7f92805e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc9a5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.844+0000 7f9272a00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92580b6670 0x7f92580b8b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9264004490 tx=0x7f926401adf0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.844+0000 7f9272a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc9a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.844+0000 7f9272a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc9a5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50880/0 (socket says 172.21.15.84:50880) 2024-09-21T07:55:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.844+0000 7f9272a00640 1 -- 172.21.15.84:0/436137290 learned_addr learned my addr 172.21.15.84:0/436137290 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.845+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc99e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.845+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc99eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.845+0000 7f9272000640 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc99e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.846+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5648dc75a700 con 0x5648dc5ec070 2024-09-21T07:55:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.846+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5648dc894580 con 0x5648dc5c31b0 2024-09-21T07:55:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.846+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5648dc9a5aa0 con 0x5648dc5cb390 2024-09-21T07:55:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.847+0000 7f92805e2740 10 client.0 _ll_register_callbacks cb 0x5648dc8a4470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.847+0000 7f9273400640 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc99eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.848+0000 7f9272000640 1 -- 172.21.15.84:0/436137290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 msgr2=0x5648dc9a5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.848+0000 7f9272000640 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc9a5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.848+0000 7f9272000640 1 -- 172.21.15.84:0/436137290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 msgr2=0x5648dc99eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.848+0000 7f9272000640 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc99eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.848+0000 7f9272000640 1 -- 172.21.15.84:0/436137290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648dc657650 con 0x5648dc5cb390 2024-09-21T07:55:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.849+0000 7f9272000640 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc99e7b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f92600e4390 tx=0x7f92600b63e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e50936e9ebc71910 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.849+0000 7f925cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.849+0000 7f925cc00640 1 -- 172.21.15.84:0/436137290 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92600ac5a0 con 0x5648dc5cb390 2024-09-21T07:55:51.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.850+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648dc896b90 con 0x5648dc5cb390 2024-09-21T07:55:51.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.850+0000 7f925cc00640 1 -- 172.21.15.84:0/436137290 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f92600b11b0 con 0x5648dc5cb390 2024-09-21T07:55:51.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.850+0000 7f925cc00640 1 -- 172.21.15.84:0/436137290 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92600ad190 con 0x5648dc5cb390 2024-09-21T07:55:51.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.850+0000 7f92805e2740 10 client.26935 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:51.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.850+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648dc8b1950 con 0x5648dc5cb390 2024-09-21T07:55:51.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.851+0000 7f925cc00640 1 -- 172.21.15.84:0/436137290 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5648dc896b90 con 0x5648dc5cb390 2024-09-21T07:55:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.851+0000 7f925cc00640 1 -- 172.21.15.84:0/436137290 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9260022060 con 0x5648dc5cb390 2024-09-21T07:55:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.852+0000 7f92805e2740 10 client.26935 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.852+0000 7f92805e2740 10 client.26935 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:55:51.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.853+0000 7f92805e2740 20 client.26935 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.853+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc5aa9f0 0x5648dc9b9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.853+0000 7f92805e2740 4 client.26935 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.853+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648dc90bf00 con 0x5648dc5aa9f0 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.853+0000 7f9272a00640 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc5aa9f0 0x5648dc9b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.854+0000 7f9272a00640 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc5aa9f0 0x5648dc9b9040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ad586031d4c82374 server_cookie=7151ad138d2ebe9e in_seq=0 out_seq=0 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.854+0000 7f925cc00640 10 client.26935 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.855+0000 7f925cc00640 1 -- 172.21.15.84:0/436137290 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648dc90bf00 con 0x5648dc5aa9f0 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.855+0000 7f925cc00640 10 client.26935 handle_command_reply: tid=0 2024-09-21T07:55:51.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.855+0000 7f92805e2740 1 client.26935 shutdown 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.856+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 msgr2=0x5648dc99e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.856+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc99e7b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f92600e4390 tx=0x7f92600b63e0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.857+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 shutdown_connections 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.857+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc5aa9f0 0x5648dc9b9040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.857+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc99eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.857+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc99e7b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.857+0000 7f92805e2740 1 --2- 172.21.15.84:0/436137290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5c31b0 0x5648dc9a5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.857+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 >> 172.21.15.84:0/436137290 conn(0x5648dc5e0460 msgr2=0x5648dc996b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.857+0000 7f925cc00640 0 client.26935 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.858+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 shutdown_connections 2024-09-21T07:55:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.858+0000 7f92805e2740 1 -- 172.21.15.84:0/436137290 wait complete. 2024-09-21T07:55:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.858+0000 7f92805e2740 20 client.26935 trim_cache size 0 max 16384 2024-09-21T07:55:51.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.886+0000 7f92805e2740 1 Processor -- start 2024-09-21T07:55:51.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.886+0000 7f92805e2740 1 -- start start 2024-09-21T07:55:51.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.887+0000 7f92805e2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5c31b0 0x5648dc9a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.887+0000 7f92805e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5cb390 0x5648dc993150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.887+0000 7f92805e2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc9a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.887+0000 7f92805e2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f925400fe80 con 0x5648dc5ec070 2024-09-21T07:55:51.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.887+0000 7f92805e2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92540119c0 con 0x5648dc5cb390 2024-09-21T07:55:51.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.887+0000 7f92805e2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9254010550 con 0x5648dc5c31b0 2024-09-21T07:55:51.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5cb390 0x5648dc993150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5cb390 0x5648dc993150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50882/0 (socket says 172.21.15.84:50882) 2024-09-21T07:55:51.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 -- 172.21.15.84:0/2095225544 learned_addr learned my addr 172.21.15.84:0/2095225544 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 -- 172.21.15.84:0/2095225544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5c31b0 msgr2=0x5648dc9a3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 --2- 172.21.15.84:0/2095225544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5c31b0 0x5648dc9a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 -- 172.21.15.84:0/2095225544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 msgr2=0x5648dc9a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 --2- 172.21.15.84:0/2095225544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc9a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.888+0000 7f9272000640 1 -- 172.21.15.84:0/2095225544 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648dc9957d0 con 0x5648dc5cb390 2024-09-21T07:55:51.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.891+0000 7f9272000640 1 --2- 172.21.15.84:0/2095225544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5cb390 0x5648dc993150 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f92600a9010 tx=0x7f92600092c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bab89f8875b5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:51.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.891+0000 7f925f400640 1 -- 172.21.15.84:0/2095225544 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92600c6020 con 0x5648dc5cb390 2024-09-21T07:55:51.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.892+0000 7f925f400640 1 -- 172.21.15.84:0/2095225544 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92600ac5a0 con 0x5648dc5cb390 2024-09-21T07:55:51.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.892+0000 7f925f400640 1 -- 172.21.15.84:0/2095225544 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92600ab8a0 con 0x5648dc5cb390 2024-09-21T07:55:51.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.893+0000 7f92805e2740 1 -- 172.21.15.84:0/2095225544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5cb390 msgr2=0x5648dc993150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.893+0000 7f92805e2740 1 --2- 172.21.15.84:0/2095225544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5cb390 0x5648dc993150 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f92600a9010 tx=0x7f92600092c0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.894+0000 7f92805e2740 1 -- 172.21.15.84:0/2095225544 shutdown_connections 2024-09-21T07:55:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.894+0000 7f92805e2740 1 --2- 172.21.15.84:0/2095225544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5ec070 0x5648dc9a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.894+0000 7f92805e2740 1 --2- 172.21.15.84:0/2095225544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5cb390 0x5648dc993150 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.894+0000 7f92805e2740 1 --2- 172.21.15.84:0/2095225544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5c31b0 0x5648dc9a3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.894+0000 7f92805e2740 1 -- 172.21.15.84:0/2095225544 >> 172.21.15.84:0/2095225544 conn(0x5648dc5e0460 msgr2=0x5648dc999c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:51.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.895+0000 7f92805e2740 1 -- 172.21.15.84:0/2095225544 shutdown_connections 2024-09-21T07:55:51.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.896+0000 7f92805e2740 1 -- 172.21.15.84:0/2095225544 wait complete. 2024-09-21T07:55:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.898+0000 7f92805e2740 1 -- start start 2024-09-21T07:55:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.899+0000 7f92805e2740 1 Processor -- start 2024-09-21T07:55:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.900+0000 7f92805e2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5c31b0 0x5648dc9a2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.900+0000 7f92805e2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc9a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.900+0000 7f92805e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5ec070 0x5648dc9a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.900+0000 7f92805e2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f92540112f0 con 0x5648dc5c31b0 2024-09-21T07:55:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.900+0000 7f92805e2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9254010c20 con 0x5648dc5ec070 2024-09-21T07:55:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.900+0000 7f92805e2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f925400de40 con 0x5648dc5cb390 2024-09-21T07:55:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.900+0000 7f92805e2740 10 client.0 _ll_register_callbacks cb 0x7f92600e4840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.901+0000 7f9272000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc9a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.901+0000 7f9272000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc9a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37426/0 (socket says 172.21.15.84:37426) 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.901+0000 7f9272000640 1 -- 172.21.15.84:0/4200792658 learned_addr learned my addr 172.21.15.84:0/4200792658 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.901+0000 7f9273400640 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5ec070 0x5648dc9a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.902+0000 7f9272000640 1 -- 172.21.15.84:0/4200792658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5ec070 msgr2=0x5648dc9a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.902+0000 7f9272000640 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5ec070 0x5648dc9a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.902+0000 7f9272000640 1 -- 172.21.15.84:0/4200792658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5c31b0 msgr2=0x5648dc9a2380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.902+0000 7f9272000640 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5c31b0 0x5648dc9a2380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.902+0000 7f9272000640 1 -- 172.21.15.84:0/4200792658 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648dc9a17f0 con 0x5648dc5cb390 2024-09-21T07:55:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.902+0000 7f9272000640 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc9a0d70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f92600a84f0 tx=0x7f92600a8a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25aa4e8f896ecdea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.902+0000 7f925cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.904+0000 7f925cc00640 1 -- 172.21.15.84:0/4200792658 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92600c6070 con 0x5648dc5cb390 2024-09-21T07:55:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.904+0000 7f925cc00640 1 -- 172.21.15.84:0/4200792658 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f92600aba60 con 0x5648dc5cb390 2024-09-21T07:55:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.904+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92600ac5a0 con 0x5648dc5cb390 2024-09-21T07:55:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.905+0000 7f925cc00640 1 -- 172.21.15.84:0/4200792658 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9260086b10 con 0x5648dc5cb390 2024-09-21T07:55:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.905+0000 7f92805e2740 10 client.26938 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.905+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648dc9a17f0 con 0x5648dc5cb390 2024-09-21T07:55:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f925cc00640 1 -- 172.21.15.84:0/4200792658 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92600ac5a0 con 0x5648dc5cb390 2024-09-21T07:55:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f925cc00640 1 -- 172.21.15.84:0/4200792658 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f92600b59f0 con 0x5648dc5cb390 2024-09-21T07:55:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f92805e2740 10 client.26938 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f92805e2740 10 client.26938 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:55:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f92805e2740 20 client.26938 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f92805e2740 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc57fda0 0x5648dc9b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f92805e2740 4 client.26938 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648dc9079b0 con 0x5648dc57fda0 2024-09-21T07:55:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.906+0000 7f9272a00640 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc57fda0 0x5648dc9b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.907+0000 7f925cc00640 10 client.26938 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.908+0000 7f9272a00640 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc57fda0 0x5648dc9b3610 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a22dc58e4d7a660 server_cookie=7ee05d3efc93fb99 in_seq=0 out_seq=0 2024-09-21T07:55:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.908+0000 7f925cc00640 1 -- 172.21.15.84:0/4200792658 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648dc9079b0 con 0x5648dc57fda0 2024-09-21T07:55:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.908+0000 7f925cc00640 10 client.26938 handle_command_reply: tid=0 2024-09-21T07:55:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.908+0000 7f92805e2740 1 client.26938 shutdown 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 msgr2=0x5648dc9a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc9a0d70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f92600a84f0 tx=0x7f92600a8a30 comp rx=0 tx=0).stop 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 shutdown_connections 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x5648dc57fda0 0x5648dc9b3610 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648dc5ec070 0x5648dc9a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5648dc5cb390 0x5648dc9a0d70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 --2- 172.21.15.84:0/4200792658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5648dc5c31b0 0x5648dc9a2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f925cc00640 0 client.26938 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:55:51.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.909+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 >> 172.21.15.84:0/4200792658 conn(0x5648dc5e0460 msgr2=0x5648dc9926d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:51.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.910+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 shutdown_connections 2024-09-21T07:55:51.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.910+0000 7f92805e2740 1 -- 172.21.15.84:0/4200792658 wait complete. 2024-09-21T07:55:51.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.911+0000 7f92805e2740 20 client.26938 trim_cache size 0 max 16384 2024-09-21T07:55:51.914 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.912+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92580b6670 msgr2=0x7f92580b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.912+0000 7f9273e00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92580b6670 0x7f92580b8b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9264004490 tx=0x7f926401adf0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 msgr2=0x7f927406dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 0x7f927406dfd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f926000b450 tx=0x7f926000b910 comp rx=0 tx=0).stop 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 shutdown_connections 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f92580b6670 0x7f92580b8b80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9274107e50 0x7f927406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9274107500 0x7f927406dfd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 --2- 172.21.15.84:0/4292144920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9274101bc0 0x7f9274074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 >> 172.21.15.84:0/4292144920 conn(0x7f9274078680 msgr2=0x7f9274105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 shutdown_connections 2024-09-21T07:55:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:51.913+0000 7f9273e00640 1 -- 172.21.15.84:0/4292144920 wait complete. 2024-09-21T07:55:52.643 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:52 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:52.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:52 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:52 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:53.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:53 smithi191 ceph-mon[34667]: pgmap v537: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 37 KiB/s rd, 254 MiB/s wr, 748 op/s 2024-09-21T07:55:53.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:53 smithi084 ceph-mon[30411]: pgmap v537: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 37 KiB/s rd, 254 MiB/s wr, 748 op/s 2024-09-21T07:55:53.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:55:53.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:53 smithi162 ceph-mon[34833]: pgmap v537: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 37 KiB/s rd, 254 MiB/s wr, 748 op/s 2024-09-21T07:55:54.416 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:55.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: pgmap v538: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 45 KiB/s rd, 255 MiB/s wr, 582 op/s 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:55.770 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:55:55.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: pgmap v538: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 45 KiB/s rd, 255 MiB/s wr, 582 op/s 2024-09-21T07:55:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:55:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.895+0000 7f01ff200640 1 -- 172.21.15.84:0/82306483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0200116510 msgr2=0x7f0200118990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.895+0000 7f01ff200640 1 --2- 172.21.15.84:0/82306483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0200116510 0x7f0200118990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009900 tx=0x7f01ec02a420 comp rx=0 tx=0).stop 2024-09-21T07:55:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.895+0000 7f01ff200640 1 -- 172.21.15.84:0/82306483 shutdown_connections 2024-09-21T07:55:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.895+0000 7f01ff200640 1 --2- 172.21.15.84:0/82306483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0200116510 0x7f0200118990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.895+0000 7f01ff200640 1 --2- 172.21.15.84:0/82306483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020010af90 0x7f0200115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.895+0000 7f01ff200640 1 --2- 172.21.15.84:0/82306483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f020010a640 0x7f020010aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.895+0000 7f01ff200640 1 -- 172.21.15.84:0/82306483 >> 172.21.15.84:0/82306483 conn(0x7f020006e9f0 msgr2=0x7f020006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:55.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.899+0000 7f01ff200640 1 -- 172.21.15.84:0/82306483 shutdown_connections 2024-09-21T07:55:55.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.900+0000 7f01ff200640 1 -- 172.21.15.84:0/82306483 wait complete. 2024-09-21T07:55:55.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: pgmap v538: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 45 KiB/s rd, 255 MiB/s wr, 582 op/s 2024-09-21T07:55:55.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:55:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:55:55.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.901+0000 7f01ff200640 1 Processor -- start 2024-09-21T07:55:55.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.902+0000 7f01ff200640 1 -- start start 2024-09-21T07:55:55.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.903+0000 7f01ff200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020010a640 0x7f02001a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.903+0000 7f01ff200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020010af90 0x7f02001a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01ff200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0200116510 0x7f02001aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01fd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020010af90 0x7f02001a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01fd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020010af90 0x7f02001a52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37446/0 (socket says 172.21.15.84:37446) 2024-09-21T07:55:55.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01ff200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f020011c120 con 0x7f020010a640 2024-09-21T07:55:55.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01ff200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f020011bfa0 con 0x7f0200116510 2024-09-21T07:55:55.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01ff200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f020011c2a0 con 0x7f020010af90 2024-09-21T07:55:55.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0200116510 0x7f02001aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0200116510 0x7f02001aa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50914/0 (socket says 172.21.15.84:50914) 2024-09-21T07:55:55.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.904+0000 7f01fe800640 1 -- 172.21.15.84:0/2350945658 learned_addr learned my addr 172.21.15.84:0/2350945658 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.905+0000 7f01fd400640 1 -- 172.21.15.84:0/2350945658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0200116510 msgr2=0x7f02001aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.905+0000 7f01fd400640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0200116510 0x7f02001aa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.905+0000 7f01fde00640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020010a640 0x7f02001a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.905+0000 7f01fd400640 1 -- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020010a640 msgr2=0x7f02001a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.906+0000 7f01fd400640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020010a640 0x7f02001a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.906+0000 7f01fd400640 1 -- 172.21.15.84:0/2350945658 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02001aacc0 con 0x7f020010af90 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.906+0000 7f01fe800640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0200116510 0x7f02001aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:55.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.906+0000 7f01fde00640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020010a640 0x7f02001a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:55.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.906+0000 7f01fd400640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020010af90 0x7f02001a52f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f020006c910 tx=0x7f01f000b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.907+0000 7f01f6a00640 1 -- 172.21.15.84:0/2350945658 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0015020 con 0x7f020010af90 2024-09-21T07:55:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.907+0000 7f01f6a00640 1 -- 172.21.15.84:0/2350945658 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f0011ce0 con 0x7f020010af90 2024-09-21T07:55:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.907+0000 7f01f6a00640 1 -- 172.21.15.84:0/2350945658 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0010d80 con 0x7f020010af90 2024-09-21T07:55:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.907+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02001aafb0 con 0x7f020010af90 2024-09-21T07:55:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.908+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02001b1710 con 0x7f020010af90 2024-09-21T07:55:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.912+0000 7f020be80740 1 Processor -- start 2024-09-21T07:55:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.912+0000 7f020be80740 1 -- start start 2024-09-21T07:55:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.913+0000 7f020be80740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d541cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.913+0000 7f020be80740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d504d1b0 0x5636d541d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.913+0000 7f020be80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5055390 0x5636d541d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.913+0000 7f020be80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5636d5393fb0 con 0x5636d5055390 2024-09-21T07:55:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.913+0000 7f020be80740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5636d53833e0 con 0x5636d504d1b0 2024-09-21T07:55:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.913+0000 7f020be80740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5636d53871f0 con 0x5636d5076070 2024-09-21T07:55:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fe800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d541cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d504d1b0 0x5636d541d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d504d1b0 0x5636d541d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50918/0 (socket says 172.21.15.84:50918) 2024-09-21T07:55:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fde00640 1 -- 172.21.15.84:0/229422259 learned_addr learned my addr 172.21.15.84:0/229422259 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fe800640 1 -- 172.21.15.84:0/229422259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d504d1b0 msgr2=0x5636d541d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fe800640 1 --2- 172.21.15.84:0/229422259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d504d1b0 0x5636d541d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fe800640 1 -- 172.21.15.84:0/229422259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5055390 msgr2=0x5636d541d9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fe800640 1 --2- 172.21.15.84:0/229422259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5055390 0x5636d541d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.914+0000 7f01fe800640 1 -- 172.21.15.84:0/229422259 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d534dcd0 con 0x5636d5076070 2024-09-21T07:55:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.915+0000 7f01fe800640 1 --2- 172.21.15.84:0/229422259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d541cf70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01ec031440 tx=0x7f01ec0050f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=974f032eab7a5f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.915+0000 7f01eb400640 1 -- 172.21.15.84:0/229422259 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec035040 con 0x5636d5076070 2024-09-21T07:55:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.915+0000 7f01eb400640 1 -- 172.21.15.84:0/229422259 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01ec005520 con 0x5636d5076070 2024-09-21T07:55:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.915+0000 7f01eb400640 1 -- 172.21.15.84:0/229422259 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec003bb0 con 0x5636d5076070 2024-09-21T07:55:55.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.916+0000 7f01f6a00640 1 -- 172.21.15.84:0/2350945658 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f01f0018020 con 0x7f020010af90 2024-09-21T07:55:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.917+0000 7f020be80740 1 -- 172.21.15.84:0/229422259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 msgr2=0x5636d541cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 --2- 172.21.15.84:0/229422259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d541cf70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01ec031440 tx=0x7f01ec0050f0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 -- 172.21.15.84:0/229422259 shutdown_connections 2024-09-21T07:55:55.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 --2- 172.21.15.84:0/229422259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5055390 0x5636d541d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 --2- 172.21.15.84:0/229422259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d504d1b0 0x5636d541d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 --2- 172.21.15.84:0/229422259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d541cf70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 -- 172.21.15.84:0/229422259 >> 172.21.15.84:0/229422259 conn(0x5636d506a460 msgr2=0x5636d541ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:55.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 -- 172.21.15.84:0/229422259 shutdown_connections 2024-09-21T07:55:55.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.918+0000 7f020be80740 1 -- 172.21.15.84:0/229422259 wait complete. 2024-09-21T07:55:55.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.919+0000 7f020be80740 1 -- start start 2024-09-21T07:55:55.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.919+0000 7f01f6a00640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e40b6790 0x7f01e40b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.919+0000 7f020be80740 1 Processor -- start 2024-09-21T07:55:55.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.919+0000 7f01f6a00640 1 -- 172.21.15.84:0/2350945658 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f01f00e70c0 con 0x7f020010af90 2024-09-21T07:55:55.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.919+0000 7f01fe800640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e40b6790 0x7f01e40b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f01fe800640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e40b6790 0x7f01e40b8ca0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f01ec004570 tx=0x7f01ec005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f020be80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5430f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f020be80740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5055390 0x5636d5431450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f020be80740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5076070 0x5636d543d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f020be80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5636d51e4700 con 0x5636d504d1b0 2024-09-21T07:55:55.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f020be80740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5636d531e580 con 0x5636d5076070 2024-09-21T07:55:55.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f020be80740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5636d5433e20 con 0x5636d5055390 2024-09-21T07:55:55.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f020be80740 10 client.0 _ll_register_callbacks cb 0x5636d532e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f01fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5076070 0x5636d543d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f01fe800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5076070 0x5636d543d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50930/0 (socket says 172.21.15.84:50930) 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.921+0000 7f01fe800640 1 -- 172.21.15.84:0/3426357276 learned_addr learned my addr 172.21.15.84:0/3426357276 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01fd400640 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5055390 0x5636d5431450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01fe800640 1 -- 172.21.15.84:0/3426357276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5055390 msgr2=0x5636d5431450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01fe800640 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5055390 0x5636d5431450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01fe800640 1 -- 172.21.15.84:0/3426357276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 msgr2=0x5636d5430f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01fe800640 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5430f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01fe800640 1 -- 172.21.15.84:0/3426357276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d50e1650 con 0x5636d5076070 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01fe800640 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5076070 0x5636d543d150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f01ec040000 tx=0x7f01ec009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c3e372a607698d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01dfe00640 1 -- 172.21.15.84:0/3426357276 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec05f060 con 0x5636d5076070 2024-09-21T07:55:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.922+0000 7f01dfe00640 1 -- 172.21.15.84:0/3426357276 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f01ec0046c0 con 0x5636d5076070 2024-09-21T07:55:55.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.923+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5636d5320b90 con 0x5636d5076070 2024-09-21T07:55:55.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.923+0000 7f01dfe00640 1 -- 172.21.15.84:0/3426357276 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01ec035040 con 0x5636d5076070 2024-09-21T07:55:55.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.923+0000 7f020be80740 10 client.26939 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:55.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.923+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5636d533b950 con 0x5636d5076070 2024-09-21T07:55:55.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.923+0000 7f01dfe00640 1 -- 172.21.15.84:0/3426357276 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5636d5320b90 con 0x5636d5076070 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.925+0000 7f01dfe00640 1 -- 172.21.15.84:0/3426357276 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f01ec0048c0 con 0x5636d5076070 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.925+0000 7f020be80740 10 client.26939 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.925+0000 7f020be80740 10 client.26939 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.925+0000 7f020be80740 20 client.26939 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.925+0000 7f020be80740 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d50349f0 0x5636d5442dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.925+0000 7f020be80740 4 client.26939 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.925+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636d5395f00 con 0x5636d50349f0 2024-09-21T07:55:55.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.926+0000 7f01fde00640 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d50349f0 0x5636d5442dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.926+0000 7f01dfe00640 10 client.26939 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:55.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.926+0000 7f01fde00640 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d50349f0 0x5636d5442dd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4e6e00877612d4b7 server_cookie=ad7093ff3e4903ce in_seq=0 out_seq=0 2024-09-21T07:55:55.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f01dfe00640 1 -- 172.21.15.84:0/3426357276 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5636d5395f00 con 0x5636d50349f0 2024-09-21T07:55:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f01dfe00640 10 client.26939 handle_command_reply: tid=0 2024-09-21T07:55:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 client.26939 shutdown 2024-09-21T07:55:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5076070 msgr2=0x5636d543d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5076070 0x5636d543d150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f01ec040000 tx=0x7f01ec009260 comp rx=0 tx=0).stop 2024-09-21T07:55:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 shutdown_connections 2024-09-21T07:55:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d50349f0 0x5636d5442dd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5076070 0x5636d543d150 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5055390 0x5636d5431450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 --2- 172.21.15.84:0/3426357276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5430f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 >> 172.21.15.84:0/3426357276 conn(0x5636d506a460 msgr2=0x5636d5419600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.928+0000 7f01dfe00640 0 client.26939 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.929+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 shutdown_connections 2024-09-21T07:55:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.930+0000 7f020be80740 1 -- 172.21.15.84:0/3426357276 wait complete. 2024-09-21T07:55:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.930+0000 7f020be80740 20 client.26939 trim_cache size 0 max 16384 2024-09-21T07:55:55.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.948+0000 7f020be80740 1 Processor -- start 2024-09-21T07:55:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.948+0000 7f020be80740 1 -- start start 2024-09-21T07:55:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f020be80740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d504d1b0 0x5636d5431410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f020be80740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d541a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f020be80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5076070 0x5636d541ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f020be80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b71f0 con 0x5636d5076070 2024-09-21T07:55:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f020be80740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b8d30 con 0x5636d5055390 2024-09-21T07:55:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f020be80740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b78c0 con 0x5636d504d1b0 2024-09-21T07:55:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f01fd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d541a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f01fde00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d504d1b0 0x5636d5431410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f01fd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d541a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50946/0 (socket says 172.21.15.84:50946) 2024-09-21T07:55:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.949+0000 7f01fd400640 1 -- 172.21.15.84:0/1553282891 learned_addr learned my addr 172.21.15.84:0/1553282891 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:55.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.950+0000 7f01fe800640 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5076070 0x5636d541ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.950+0000 7f01fde00640 1 -- 172.21.15.84:0/1553282891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 msgr2=0x5636d541a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:55.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.950+0000 7f01fde00640 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d541a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.950+0000 7f01fde00640 1 -- 172.21.15.84:0/1553282891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5076070 msgr2=0x5636d541ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:55.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.950+0000 7f01fde00640 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5076070 0x5636d541ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.950+0000 7f01fde00640 1 -- 172.21.15.84:0/1553282891 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d541b3a0 con 0x5636d504d1b0 2024-09-21T07:55:55.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.951+0000 7f01fde00640 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d504d1b0 0x5636d5431410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5636d5433e50 tx=0x7f01f8009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10cac5bf9dce7abb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.951+0000 7f01eaa00640 1 -- 172.21.15.84:0/1553282891 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f801e020 con 0x5636d504d1b0 2024-09-21T07:55:55.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.951+0000 7f01eaa00640 1 -- 172.21.15.84:0/1553282891 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f8003e20 con 0x5636d504d1b0 2024-09-21T07:55:55.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.951+0000 7f01eaa00640 1 -- 172.21.15.84:0/1553282891 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8004860 con 0x5636d504d1b0 2024-09-21T07:55:55.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.953+0000 7f020be80740 1 -- 172.21.15.84:0/1553282891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d504d1b0 msgr2=0x5636d5431410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.953+0000 7f020be80740 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d504d1b0 0x5636d5431410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5636d5433e50 tx=0x7f01f8009be0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.954+0000 7f020be80740 1 -- 172.21.15.84:0/1553282891 shutdown_connections 2024-09-21T07:55:55.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.954+0000 7f020be80740 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d5076070 0x5636d541ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.954+0000 7f020be80740 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d541a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.954+0000 7f020be80740 1 --2- 172.21.15.84:0/1553282891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d504d1b0 0x5636d5431410 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.954+0000 7f020be80740 1 -- 172.21.15.84:0/1553282891 >> 172.21.15.84:0/1553282891 conn(0x5636d506a460 msgr2=0x5636d5430d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:55.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.954+0000 7f020be80740 1 -- 172.21.15.84:0/1553282891 shutdown_connections 2024-09-21T07:55:55.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.954+0000 7f020be80740 1 -- 172.21.15.84:0/1553282891 wait complete. 2024-09-21T07:55:55.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.955+0000 7f020be80740 1 -- start start 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.956+0000 7f020be80740 1 Processor -- start 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.956+0000 7f020be80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5446830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.956+0000 7f020be80740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d5443d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.956+0000 7f020be80740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d5444490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.956+0000 7f020be80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b8660 con 0x5636d504d1b0 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.956+0000 7f020be80740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b7f90 con 0x5636d5055390 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.956+0000 7f020be80740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02001b51d0 con 0x5636d5076070 2024-09-21T07:55:55.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.957+0000 7f020be80740 10 client.0 _ll_register_callbacks cb 0x7f01ec005520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.959+0000 7f01fd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d5443d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.959+0000 7f01fd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d5443d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50956/0 (socket says 172.21.15.84:50956) 2024-09-21T07:55:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.959+0000 7f01fd400640 1 -- 172.21.15.84:0/2200849531 learned_addr learned my addr 172.21.15.84:0/2200849531 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.959+0000 7f01fde00640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5446830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.960+0000 7f01fe800640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d5444490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.960+0000 7f01fe800640 1 -- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 msgr2=0x5636d5443d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.961+0000 7f01fe800640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d5443d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.961+0000 7f01fe800640 1 -- 172.21.15.84:0/2200849531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 msgr2=0x5636d5446830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.961+0000 7f01fe800640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5446830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.961+0000 7f01fe800640 1 -- 172.21.15.84:0/2200849531 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d5431950 con 0x5636d5076070 2024-09-21T07:55:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.961+0000 7f01fde00640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5446830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:55.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.961+0000 7f01fd400640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d5443d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.961+0000 7f01fe800640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d5444490 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f01ec004ea0 tx=0x7f01ec0095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2097f40b2e08423 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.962+0000 7f01dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.962+0000 7f01dfe00640 1 -- 172.21.15.84:0/2200849531 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec053020 con 0x5636d5076070 2024-09-21T07:55:55.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.962+0000 7f01dfe00640 1 -- 172.21.15.84:0/2200849531 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f01ec066020 con 0x5636d5076070 2024-09-21T07:55:55.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.963+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f8003e20 con 0x5636d5076070 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.963+0000 7f01dfe00640 1 -- 172.21.15.84:0/2200849531 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01ec070050 con 0x5636d5076070 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.964+0000 7f020be80740 10 client.26956 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.964+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5636d541eeb0 con 0x5636d5076070 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.964+0000 7f01dfe00640 1 -- 172.21.15.84:0/2200849531 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f8003e20 con 0x5636d5076070 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.964+0000 7f01dfe00640 1 -- 172.21.15.84:0/2200849531 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f01ec05a470 con 0x5636d5076070 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.964+0000 7f020be80740 10 client.26956 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.965+0000 7f020be80740 10 client.26956 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.965+0000 7f020be80740 20 client.26956 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.965+0000 7f020be80740 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d5009da0 0x5636d5426840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.965+0000 7f020be80740 4 client.26956 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.965+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636d53919b0 con 0x5636d5009da0 2024-09-21T07:55:55.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.966+0000 7f01fde00640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d5009da0 0x5636d5426840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:55.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.967+0000 7f01dfe00640 10 client.26956 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:55.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.967+0000 7f01fde00640 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d5009da0 0x5636d5426840 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b0fd3f7140ae2e0c server_cookie=1911cab659e0579f in_seq=0 out_seq=0 2024-09-21T07:55:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f01dfe00640 1 -- 172.21.15.84:0/2200849531 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636d53919b0 con 0x5636d5009da0 2024-09-21T07:55:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f01dfe00640 10 client.26956 handle_command_reply: tid=0 2024-09-21T07:55:55.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 client.26956 shutdown 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 msgr2=0x5636d5444490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d5444490 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f01ec004ea0 tx=0x7f01ec0095e0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 shutdown_connections 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5636d5009da0 0x5636d5426840 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636d5076070 0x5636d5444490 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636d5055390 0x5636d5443d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 --2- 172.21.15.84:0/2200849531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636d504d1b0 0x5636d5446830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 >> 172.21.15.84:0/2200849531 conn(0x5636d506a460 msgr2=0x5636d54220e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.968+0000 7f01dfe00640 0 client.26956 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.969+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 shutdown_connections 2024-09-21T07:55:55.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.969+0000 7f020be80740 1 -- 172.21.15.84:0/2200849531 wait complete. 2024-09-21T07:55:55.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.969+0000 7f020be80740 20 client.26956 trim_cache size 0 max 16384 2024-09-21T07:55:55.972 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e40b6790 msgr2=0x7f01e40b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e40b6790 0x7f01e40b8ca0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f01ec004570 tx=0x7f01ec005fd0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020010af90 msgr2=0x7f02001a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020010af90 0x7f02001a52f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f020006c910 tx=0x7f01f000b850 comp rx=0 tx=0).stop 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 shutdown_connections 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f01e40b6790 0x7f01e40b8ca0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0200116510 0x7f02001aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020010af90 0x7f02001a52f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 --2- 172.21.15.84:0/2350945658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f020010a640 0x7f02001a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 >> 172.21.15.84:0/2350945658 conn(0x7f020006e9f0 msgr2=0x7f0200073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.970+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 shutdown_connections 2024-09-21T07:55:55.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:55.971+0000 7f01ff200640 1 -- 172.21.15.84:0/2350945658 wait complete. 2024-09-21T07:55:56.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:56 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi084 to 176.4M 2024-09-21T07:55:56.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:56 smithi162 ceph-mon[34833]: Unable to set osd_memory_target on smithi084 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T07:55:56.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:56 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi084 to 176.4M 2024-09-21T07:55:56.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:56 smithi084 ceph-mon[30411]: Unable to set osd_memory_target on smithi084 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T07:55:56.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:56 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi084 to 176.4M 2024-09-21T07:55:56.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:56 smithi191 ceph-mon[34667]: Unable to set osd_memory_target on smithi084 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 -- 172.21.15.84:0/3549858579 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 msgr2=0x7f989410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 --2- 172.21.15.84:0/3549858579 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 0x7f989410d850 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9880009860 tx=0x7f988002a340 comp rx=0 tx=0).stop 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 -- 172.21.15.84:0/3549858579 shutdown_connections 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 --2- 172.21.15.84:0/3549858579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f989410dd90 0x7f9894110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 --2- 172.21.15.84:0/3549858579 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 0x7f989410d850 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 --2- 172.21.15.84:0/3549858579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 0x7f9894104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 -- 172.21.15.84:0/3549858579 >> 172.21.15.84:0/3549858579 conn(0x7f989407a740 msgr2=0x7f989407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 -- 172.21.15.84:0/3549858579 shutdown_connections 2024-09-21T07:55:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.092+0000 7f989b400640 1 -- 172.21.15.84:0/3549858579 wait complete. 2024-09-21T07:55:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.093+0000 7f989b400640 1 Processor -- start 2024-09-21T07:55:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.094+0000 7f989b400640 1 -- start start 2024-09-21T07:55:57.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.094+0000 7f989b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 0x7f9894104110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.094+0000 7f989b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 0x7f98941026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.094+0000 7f989b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f989410dd90 0x7f9894102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.094+0000 7f989b400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98941139d0 con 0x7f98941047e0 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.094+0000 7f989b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9894113850 con 0x7f989410dd90 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.094+0000 7f989b400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9894113b50 con 0x7f98941051c0 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 0x7f9894104110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 0x7f9894104110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53288/0 (socket says 172.21.15.84:53288) 2024-09-21T07:55:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 -- 172.21.15.84:0/1666543071 learned_addr learned my addr 172.21.15.84:0/1666543071 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9893e00640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 0x7f98941026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 -- 172.21.15.84:0/1666543071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 msgr2=0x7f98941026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 0x7f98941026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 -- 172.21.15.84:0/1666543071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f989410dd90 msgr2=0x7f9894102c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:55:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f989410dd90 0x7f9894102c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9898a00640 1 -- 172.21.15.84:0/1666543071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9894103450 con 0x7f98941047e0 2024-09-21T07:55:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.095+0000 7f9893e00640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 0x7f98941026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.096+0000 7f9898a00640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 0x7f9894104110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f988800e9f0 tx=0x7f988800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.096+0000 7f9891600640 1 -- 172.21.15.84:0/1666543071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988800cd80 con 0x7f98941047e0 2024-09-21T07:55:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.096+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989419e580 con 0x7f98941047e0 2024-09-21T07:55:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.096+0000 7f9891600640 1 -- 172.21.15.84:0/1666543071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98880108e0 con 0x7f98941047e0 2024-09-21T07:55:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.096+0000 7f9891600640 1 -- 172.21.15.84:0/1666543071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888018980 con 0x7f98941047e0 2024-09-21T07:55:57.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.096+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989419eb20 con 0x7f98941047e0 2024-09-21T07:55:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.106+0000 7f98a2427740 1 Processor -- start 2024-09-21T07:55:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.106+0000 7f9891600640 1 -- 172.21.15.84:0/1666543071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9888010430 con 0x7f98941047e0 2024-09-21T07:55:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.109+0000 7f9891600640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f987c0b6780 0x7f987c0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.109+0000 7f9891600640 1 -- 172.21.15.84:0/1666543071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f98880e7e90 con 0x7f98941047e0 2024-09-21T07:55:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.110+0000 7f9899400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f987c0b6780 0x7f987c0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.110+0000 7f98a2427740 1 -- start start 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.111+0000 7f98a2427740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681511b0 0x55b8684f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.111+0000 7f98a2427740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b8684f6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.111+0000 7f98a2427740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681304d0 0x55b8684f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.111+0000 7f98a2427740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b86846b6b0 con 0x55b8681282f0 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.111+0000 7f98a2427740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b86845aae0 con 0x55b8681511b0 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.111+0000 7f98a2427740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b86845e8f0 con 0x55b8681304d0 2024-09-21T07:55:57.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f987c0b6780 0x7f987c0b8c90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f988c005fd0 tx=0x7f988c0095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:57.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681304d0 0x55b8684f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681304d0 0x55b8684f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37512/0 (socket says 172.21.15.84:37512) 2024-09-21T07:55:57.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 -- 172.21.15.84:0/3834642144 learned_addr learned my addr 172.21.15.84:0/3834642144 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:57.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9898a00640 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681511b0 0x55b8684f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 -- 172.21.15.84:0/3834642144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681511b0 msgr2=0x55b8684f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9893e00640 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b8684f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681511b0 0x55b8684f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 -- 172.21.15.84:0/3834642144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 msgr2=0x55b8684f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b8684f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.112+0000 7f9899400640 1 -- 172.21.15.84:0/3834642144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b868427780 con 0x55b8681304d0 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.113+0000 7f9893e00640 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b8684f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.113+0000 7f9899400640 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681304d0 0x55b8684f66b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c6c0 tx=0x7f988c011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368572bb8c49d7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.113+0000 7f9885c00640 1 -- 172.21.15.84:0/3834642144 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c00cc70 con 0x55b8681304d0 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.114+0000 7f9885c00640 1 -- 172.21.15.84:0/3834642144 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c00ce10 con 0x55b8681304d0 2024-09-21T07:55:57.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.114+0000 7f9885c00640 1 -- 172.21.15.84:0/3834642144 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c023480 con 0x55b8681304d0 2024-09-21T07:55:57.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 -- 172.21.15.84:0/3834642144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681304d0 msgr2=0x55b8684f66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681304d0 0x55b8684f66b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c6c0 tx=0x7f988c011000 comp rx=0 tx=0).stop 2024-09-21T07:55:57.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 -- 172.21.15.84:0/3834642144 shutdown_connections 2024-09-21T07:55:57.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681304d0 0x55b8684f66b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b8684f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 --2- 172.21.15.84:0/3834642144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681511b0 0x55b8684f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 -- 172.21.15.84:0/3834642144 >> 172.21.15.84:0/3834642144 conn(0x55b868145300 msgr2=0x55b8684f3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:57.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 -- 172.21.15.84:0/3834642144 shutdown_connections 2024-09-21T07:55:57.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.115+0000 7f98a2427740 1 -- 172.21.15.84:0/3834642144 wait complete. 2024-09-21T07:55:57.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.116+0000 7f98a2427740 1 -- start start 2024-09-21T07:55:57.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.117+0000 7f98a2427740 1 Processor -- start 2024-09-21T07:55:57.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.117+0000 7f98a2427740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b868501320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.117+0000 7f98a2427740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868501860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.117+0000 7f98a2427740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b86850d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.118+0000 7f9893e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868501860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.118+0000 7f9893e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868501860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50978/0 (socket says 172.21.15.84:50978) 2024-09-21T07:55:57.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.118+0000 7f98a2427740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b868392ab0 con 0x55b8681282f0 2024-09-21T07:55:57.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.118+0000 7f98a2427740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b868401570 con 0x55b8681304d0 2024-09-21T07:55:57.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.118+0000 7f98a2427740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b8685043b0 con 0x55b8681511b0 2024-09-21T07:55:57.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.118+0000 7f98a2427740 10 client.0 _ll_register_callbacks cb 0x55b868410100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:57.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.119+0000 7f9899400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b86850d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.119+0000 7f9899400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b86850d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37524/0 (socket says 172.21.15.84:37524) 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.119+0000 7f9899400640 1 -- 172.21.15.84:0/3645035050 learned_addr learned my addr 172.21.15.84:0/3645035050 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.119+0000 7f9898a00640 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b868501320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.120+0000 7f9899400640 1 -- 172.21.15.84:0/3645035050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 msgr2=0x55b868501860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.120+0000 7f9899400640 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868501860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.120+0000 7f9899400640 1 -- 172.21.15.84:0/3645035050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 msgr2=0x55b868501320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.120+0000 7f9899400640 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b868501320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.120+0000 7f9899400640 1 -- 172.21.15.84:0/3645035050 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8681bc790 con 0x55b8681511b0 2024-09-21T07:55:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.120+0000 7f9898a00640 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b868501320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.121+0000 7f9899400640 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b86850d6a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f988c005760 tx=0x7f988c005af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4122f97bba0045f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.121+0000 7f987a000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.121+0000 7f987a000640 1 -- 172.21.15.84:0/3645035050 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c004d80 con 0x55b8681511b0 2024-09-21T07:55:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.121+0000 7f987a000640 1 -- 172.21.15.84:0/3645035050 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f988c005000 con 0x55b8681511b0 2024-09-21T07:55:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.122+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988c00ce10 con 0x55b8681511b0 2024-09-21T07:55:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.122+0000 7f987a000640 1 -- 172.21.15.84:0/3645035050 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f988c005200 con 0x55b8681511b0 2024-09-21T07:55:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.123+0000 7f98a2427740 10 client.26965 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.123+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b868235620 con 0x55b8681511b0 2024-09-21T07:55:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.123+0000 7f987a000640 1 -- 172.21.15.84:0/3645035050 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c00ce10 con 0x55b8681511b0 2024-09-21T07:55:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.123+0000 7f987a000640 1 -- 172.21.15.84:0/3645035050 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f988c00b040 con 0x55b8681511b0 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.124+0000 7f98a2427740 10 client.26965 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.124+0000 7f98a2427740 10 client.26965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.124+0000 7f98a2427740 20 client.26965 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.124+0000 7f98a2427740 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b86810fd80 0x55b868513280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.124+0000 7f98a2427740 4 client.26965 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.124+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b86846d600 con 0x55b86810fd80 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.124+0000 7f9898a00640 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b86810fd80 0x55b868513280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.125+0000 7f987a000640 10 client.26965 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.125+0000 7f9898a00640 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b86810fd80 0x55b868513280 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=865c196f77a5be18 server_cookie=7a78c6a634926580 in_seq=0 out_seq=0 2024-09-21T07:55:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.125+0000 7f987a000640 1 -- 172.21.15.84:0/3645035050 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b86846d600 con 0x55b86810fd80 2024-09-21T07:55:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.125+0000 7f987a000640 10 client.26965 handle_command_reply: tid=0 2024-09-21T07:55:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.126+0000 7f98a2427740 1 client.26965 shutdown 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 msgr2=0x55b86850d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b86850d6a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f988c005760 tx=0x7f988c005af0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 shutdown_connections 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b86810fd80 0x55b868513280 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b86850d6a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868501860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 --2- 172.21.15.84:0/3645035050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681282f0 0x55b868501320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f987a000640 0 client.26965 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 >> 172.21.15.84:0/3645035050 conn(0x55b868145300 msgr2=0x55b8684f6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.129+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 shutdown_connections 2024-09-21T07:55:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.130+0000 7f98a2427740 1 -- 172.21.15.84:0/3645035050 wait complete. 2024-09-21T07:55:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.130+0000 7f98a2427740 20 client.26965 trim_cache size 0 max 16384 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 Processor -- start 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 -- start start 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681282f0 0x55b8684f7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681304d0 0x55b868501800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b868502f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98941bfcf0 con 0x55b8681304d0 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98941c1830 con 0x55b8681282f0 2024-09-21T07:55:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.153+0000 7f98a2427740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f98941c03c0 con 0x55b8681511b0 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681282f0 0x55b8684f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9893e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681304d0 0x55b868501800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681282f0 0x55b8684f7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:50980/0 (socket says 172.21.15.84:50980) 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 -- 172.21.15.84:0/1790587149 learned_addr learned my addr 172.21.15.84:0/1790587149 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9899400640 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b868502f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 -- 172.21.15.84:0/1790587149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 msgr2=0x55b868502f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b868502f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 -- 172.21.15.84:0/1790587149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681304d0 msgr2=0x55b868501800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681304d0 0x55b868501800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 -- 172.21.15.84:0/1790587149 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86850e440 con 0x55b8681282f0 2024-09-21T07:55:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9893e00640 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681304d0 0x55b868501800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:55:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.154+0000 7f9898a00640 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681282f0 0x55b8684f7620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98880a9f40 tx=0x7f988800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fbd276017d43604 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.155+0000 7f9885200640 1 -- 172.21.15.84:0/1790587149 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880b2450 con 0x55b8681282f0 2024-09-21T07:55:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.155+0000 7f9885200640 1 -- 172.21.15.84:0/1790587149 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98880b7390 con 0x55b8681282f0 2024-09-21T07:55:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.155+0000 7f9885200640 1 -- 172.21.15.84:0/1790587149 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880a92c0 con 0x55b8681282f0 2024-09-21T07:55:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 -- 172.21.15.84:0/1790587149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681282f0 msgr2=0x55b8684f7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681282f0 0x55b8684f7620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98880a9f40 tx=0x7f988800c7d0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 -- 172.21.15.84:0/1790587149 shutdown_connections 2024-09-21T07:55:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681511b0 0x55b868502f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681304d0 0x55b868501800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 --2- 172.21.15.84:0/1790587149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681282f0 0x55b8684f7620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 -- 172.21.15.84:0/1790587149 >> 172.21.15.84:0/1790587149 conn(0x55b868145300 msgr2=0x55b868502840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 -- 172.21.15.84:0/1790587149 shutdown_connections 2024-09-21T07:55:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 -- 172.21.15.84:0/1790587149 wait complete. 2024-09-21T07:55:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.156+0000 7f98a2427740 1 -- start start 2024-09-21T07:55:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 1 Processor -- start 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681282f0 0x55b868516030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868516610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681511b0 0x55b868572b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98941c1160 con 0x55b8681511b0 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98941c0a90 con 0x55b8681304d0 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f98941bdd70 con 0x55b8681282f0 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f98a2427740 10 client.0 _ll_register_callbacks cb 0x7f988c00c590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f9898a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681282f0 0x55b868516030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f9898a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681282f0 0x55b868516030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37540/0 (socket says 172.21.15.84:37540) 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.157+0000 7f9898a00640 1 -- 172.21.15.84:0/798037141 learned_addr learned my addr 172.21.15.84:0/798037141 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9899400640 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681511b0 0x55b868572b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9893e00640 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868516610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9898a00640 1 -- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 msgr2=0x55b868516610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9898a00640 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868516610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9898a00640 1 -- 172.21.15.84:0/798037141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681511b0 msgr2=0x55b868572b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9898a00640 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681511b0 0x55b868572b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9898a00640 1 -- 172.21.15.84:0/798037141 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b868573200 con 0x55b8681282f0 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f9898a00640 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681282f0 0x55b868516030 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f98880aabe0 tx=0x7f98880a9fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2094cd63904bd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.158+0000 7f987a000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.159+0000 7f987a000640 1 -- 172.21.15.84:0/798037141 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880e54f0 con 0x55b8681282f0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.159+0000 7f987a000640 1 -- 172.21.15.84:0/798037141 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f98880e5690 con 0x55b8681282f0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.159+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98880b7390 con 0x55b8681282f0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.159+0000 7f987a000640 1 -- 172.21.15.84:0/798037141 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9888018b20 con 0x55b8681282f0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.159+0000 7f98a2427740 10 client.26971 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.159+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b86857d840 con 0x55b8681282f0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.159+0000 7f987a000640 1 -- 172.21.15.84:0/798037141 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98880b7390 con 0x55b8681282f0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f987a000640 1 -- 172.21.15.84:0/798037141 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f98880d2070 con 0x55b8681282f0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f98a2427740 10 client.26971 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f98a2427740 10 client.26971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f98a2427740 20 client.26971 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f98a2427740 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8680e51c0 0x55b868580030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f98a2427740 4 client.26971 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8684690b0 con 0x55b8680e51c0 2024-09-21T07:55:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.160+0000 7f9893e00640 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8680e51c0 0x55b868580030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.161+0000 7f9893e00640 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8680e51c0 0x55b868580030 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe45fec151b28d3 server_cookie=b53344491cc5df28 in_seq=0 out_seq=0 2024-09-21T07:55:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.161+0000 7f987a000640 10 client.26971 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.181+0000 7f987a000640 1 -- 172.21.15.84:0/798037141 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8684690b0 con 0x55b8680e51c0 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.181+0000 7f987a000640 10 client.26971 handle_command_reply: tid=0 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.181+0000 7f98a2427740 1 client.26971 shutdown 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.181+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681282f0 msgr2=0x55b868516030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.181+0000 7f98a2427740 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681282f0 0x55b868516030 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f98880aabe0 tx=0x7f98880a9fc0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 shutdown_connections 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8681511b0 0x55b868572b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b8681304d0 0x55b868516610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b8680e51c0 0x55b868580030 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 --2- 172.21.15.84:0/798037141 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8681282f0 0x55b868516030 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f98880aabe0 tx=0x7f98880a9fc0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 >> 172.21.15.84:0/798037141 conn(0x55b868145300 msgr2=0x55b8684f7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f987a000640 0 client.26971 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:55:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 shutdown_connections 2024-09-21T07:55:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.183+0000 7f98a2427740 1 -- 172.21.15.84:0/798037141 wait complete. 2024-09-21T07:55:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.185+0000 7f98a2427740 20 client.26971 trim_cache size 0 max 16384 2024-09-21T07:55:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:55:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:55:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:55:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:55:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f987c0b6780 msgr2=0x7f987c0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f987c0b6780 0x7f987c0b8c90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f988c005fd0 tx=0x7f988c0095c0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 msgr2=0x7f9894104110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 0x7f9894104110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f988800e9f0 tx=0x7f988800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 shutdown_connections 2024-09-21T07:55:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f987c0b6780 0x7f987c0b8c90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f989410dd90 0x7f9894102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98941051c0 0x7f98941026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 --2- 172.21.15.84:0/1666543071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98941047e0 0x7f9894104110 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.186+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 >> 172.21.15.84:0/1666543071 conn(0x7f989407a740 msgr2=0x7f98940ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.187+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 shutdown_connections 2024-09-21T07:55:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:55:57.187+0000 7f989b400640 1 -- 172.21.15.84:0/1666543071 wait complete. 2024-09-21T07:55:57.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:57 smithi084 ceph-mon[30411]: pgmap v539: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 24 KiB/s rd, 232 MiB/s wr, 427 op/s 2024-09-21T07:55:57.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:55:57.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:57 smithi162 ceph-mon[34833]: pgmap v539: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 24 KiB/s rd, 232 MiB/s wr, 427 op/s 2024-09-21T07:55:57.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:57 smithi191 ceph-mon[34667]: pgmap v539: 129 pgs: 129 active+clean; 31 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 24 KiB/s rd, 232 MiB/s wr, 427 op/s 2024-09-21T07:55:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:55:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.756+0000 7f93c1e00640 1 -- 172.21.15.84:0/1497826640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc06af90 msgr2=0x7f93bc10f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.756+0000 7f93c1e00640 1 --2- 172.21.15.84:0/1497826640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc06af90 0x7f93bc10f150 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009930 tx=0x7f93ac02a420 comp rx=0 tx=0).stop 2024-09-21T07:55:59.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:55:59 smithi084 ceph-mon[30411]: pgmap v540: 129 pgs: 129 active+clean; 32 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 24 KiB/s rd, 248 MiB/s wr, 528 op/s 2024-09-21T07:55:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.758+0000 7f93c1e00640 1 -- 172.21.15.84:0/1497826640 shutdown_connections 2024-09-21T07:55:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.758+0000 7f93c1e00640 1 --2- 172.21.15.84:0/1497826640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93bc10a900 0x7f93bc10ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.758+0000 7f93c1e00640 1 --2- 172.21.15.84:0/1497826640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc10f770 0x7f93bc10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.758+0000 7f93c1e00640 1 --2- 172.21.15.84:0/1497826640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc06af90 0x7f93bc10f150 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009930 tx=0x7f93ac02a420 comp rx=0 tx=0).stop 2024-09-21T07:55:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.758+0000 7f93c1e00640 1 -- 172.21.15.84:0/1497826640 >> 172.21.15.84:0/1497826640 conn(0x7f93bc0712f0 msgr2=0x7f93bc073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.759+0000 7f93c1e00640 1 -- 172.21.15.84:0/1497826640 shutdown_connections 2024-09-21T07:55:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.760+0000 7f93c1e00640 1 -- 172.21.15.84:0/1497826640 wait complete. 2024-09-21T07:55:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.761+0000 7f93c1e00640 1 Processor -- start 2024-09-21T07:55:59.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.762+0000 7f93c1e00640 1 -- start start 2024-09-21T07:55:59.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.762+0000 7f93c1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93bc10a900 0x7f93bc117a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.763+0000 7f93c1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc10f770 0x7f93bc114cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.763+0000 7f93c1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc115280 0x7f93bc115780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.763+0000 7f93c1e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc119d30 con 0x7f93bc10a900 2024-09-21T07:55:59.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.763+0000 7f93c1e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc119bb0 con 0x7f93bc10f770 2024-09-21T07:55:59.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.763+0000 7f93c1e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc119eb0 con 0x7f93bc115280 2024-09-21T07:55:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.764+0000 7f93baa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93bc10a900 0x7f93bc117a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.764+0000 7f93baa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93bc10a900 0x7f93bc117a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41002/0 (socket says 172.21.15.84:41002) 2024-09-21T07:55:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.764+0000 7f93baa00640 1 -- 172.21.15.84:0/855328572 learned_addr learned my addr 172.21.15.84:0/855328572 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.764+0000 7f93ba000640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc10f770 0x7f93bc114cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.764+0000 7f93bb400640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc115280 0x7f93bc115780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.765+0000 7f93ba000640 1 -- 172.21.15.84:0/855328572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc115280 msgr2=0x7f93bc115780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.765+0000 7f93ba000640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc115280 0x7f93bc115780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.765+0000 7f93ba000640 1 -- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93bc10a900 msgr2=0x7f93bc117a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.765+0000 7f93ba000640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93bc10a900 0x7f93bc117a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.765+0000 7f93ba000640 1 -- 172.21.15.84:0/855328572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc1b5920 con 0x7f93bc10f770 2024-09-21T07:55:59.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.766+0000 7f93ba000640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc10f770 0x7f93bc114cc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f93a800e9c0 tx=0x7f93a800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:59.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.767+0000 7f93c0a00640 1 -- 172.21.15.84:0/855328572 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a800ccc0 con 0x7f93bc10f770 2024-09-21T07:55:59.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.767+0000 7f93c0a00640 1 -- 172.21.15.84:0/855328572 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93a80108e0 con 0x7f93bc10f770 2024-09-21T07:55:59.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.767+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc1b5c10 con 0x7f93bc10f770 2024-09-21T07:55:59.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.767+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc1b6120 con 0x7f93bc10f770 2024-09-21T07:55:59.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.767+0000 7f93c0a00640 1 -- 172.21.15.84:0/855328572 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80187c0 con 0x7f93bc10f770 2024-09-21T07:55:59.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.773+0000 7f93c8ab7740 1 Processor -- start 2024-09-21T07:55:59.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.774+0000 7f93c8ab7740 1 -- start start 2024-09-21T07:55:59.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.775+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.775+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.776+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.776+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561c41549fb0 con 0x561c4122c070 2024-09-21T07:55:59.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.776+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561c415393e0 con 0x561c4120b390 2024-09-21T07:55:59.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.776+0000 7f93baa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.777+0000 7f93baa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39140/0 (socket says 172.21.15.84:39140) 2024-09-21T07:55:59.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.777+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c4153d1f0 con 0x561c412031b0 2024-09-21T07:55:59.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.777+0000 7f93baa00640 1 -- 172.21.15.84:0/3181562277 learned_addr learned my addr 172.21.15.84:0/3181562277 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:59.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.778+0000 7f93bb400640 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.779+0000 7f93baa00640 1 -- 172.21.15.84:0/3181562277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 msgr2=0x561c415d3820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:59.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.779+0000 7f93baa00640 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415d3820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.779+0000 7f93baa00640 1 -- 172.21.15.84:0/3181562277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 msgr2=0x561c415d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:59.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.779+0000 7f93baa00640 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.779+0000 7f93baa00640 1 -- 172.21.15.84:0/3181562277 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c41503cd0 con 0x561c412031b0 2024-09-21T07:55:59.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.780+0000 7f93baa00640 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d32e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f93ac000c00 tx=0x7f93ac0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21e886bc4a29cc6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:59.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.781+0000 7f93a7e00640 1 -- 172.21.15.84:0/3181562277 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac040070 con 0x561c412031b0 2024-09-21T07:55:59.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.781+0000 7f93a7e00640 1 -- 172.21.15.84:0/3181562277 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93ac0044b0 con 0x561c412031b0 2024-09-21T07:55:59.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.781+0000 7f93a7e00640 1 -- 172.21.15.84:0/3181562277 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac035040 con 0x561c412031b0 2024-09-21T07:55:59.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.781+0000 7f93c0a00640 1 -- 172.21.15.84:0/855328572 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f93a8010430 con 0x7f93bc10f770 2024-09-21T07:55:59.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.783+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3181562277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 msgr2=0x561c415d32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.783+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d32e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f93ac000c00 tx=0x7f93ac0040c0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.784+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3181562277 shutdown_connections 2024-09-21T07:55:59.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.784+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.784+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d32e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.784+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3181562277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.785+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3181562277 >> 172.21.15.84:0/3181562277 conn(0x561c41220460 msgr2=0x561c415d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:59.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.785+0000 7f93c0a00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f93a00b6850 0x7f93a00b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.785+0000 7f93c0a00640 1 -- 172.21.15.84:0/855328572 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f93a80e79b0 con 0x7f93bc10f770 2024-09-21T07:55:59.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.786+0000 7f93baa00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f93a00b6850 0x7f93a00b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.786+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3181562277 shutdown_connections 2024-09-21T07:55:59.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.787+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3181562277 wait complete. 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.787+0000 7f93c8ab7740 1 -- start start 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.787+0000 7f93baa00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f93a00b6850 0x7f93a00b8d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0096c0 tx=0x7f93ac005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.788+0000 7f93c8ab7740 1 Processor -- start 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.788+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c412031b0 0x561c415de540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.788+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415dea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c415ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561c4139a700 con 0x561c412031b0 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561c414d4580 con 0x561c4120b390 2024-09-21T07:55:59.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c415e1520 con 0x561c4122c070 2024-09-21T07:55:59.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93c8ab7740 10 client.0 _ll_register_callbacks cb 0x561c414e4470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:59.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93bb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c415ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93bb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c415ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39146/0 (socket says 172.21.15.84:39146) 2024-09-21T07:55:59.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.789+0000 7f93bb400640 1 -- 172.21.15.84:0/754423847 learned_addr learned my addr 172.21.15.84:0/754423847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:59.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.790+0000 7f93ba000640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.790+0000 7f93ba000640 1 -- 172.21.15.84:0/754423847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 msgr2=0x561c415ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:59.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.790+0000 7f93ba000640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c415ea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.790+0000 7f93ba000640 1 -- 172.21.15.84:0/754423847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c412031b0 msgr2=0x561c415de540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:55:59.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.791+0000 7f93baa00640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c412031b0 0x561c415de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.791+0000 7f93ba000640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c412031b0 0x561c415de540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.791+0000 7f93ba000640 1 -- 172.21.15.84:0/754423847 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c41297650 con 0x561c4120b390 2024-09-21T07:55:59.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.791+0000 7f93baa00640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c412031b0 0x561c415de540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:59.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.792+0000 7f93ba000640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415dea80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f93a80e4d90 tx=0x7f93a80b6de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225a895a4275688d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:59.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.792+0000 7f93a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:55:59.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.793+0000 7f93a4c00640 1 -- 172.21.15.84:0/754423847 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80accb0 con 0x561c4120b390 2024-09-21T07:55:59.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.793+0000 7f93a4c00640 1 -- 172.21.15.84:0/754423847 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f93a80ac210 con 0x561c4120b390 2024-09-21T07:55:59.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.794+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c414d6b90 con 0x561c4120b390 2024-09-21T07:55:59.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.794+0000 7f93a4c00640 1 -- 172.21.15.84:0/754423847 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f93a800ce60 con 0x561c4120b390 2024-09-21T07:55:59.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.795+0000 7f93c8ab7740 10 client.26969 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:59.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.795+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c414f1950 con 0x561c4120b390 2024-09-21T07:55:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.796+0000 7f93a4c00640 1 -- 172.21.15.84:0/754423847 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561c414d6b90 con 0x561c4120b390 2024-09-21T07:55:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.797+0000 7f93a4c00640 1 -- 172.21.15.84:0/754423847 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f93a80b6040 con 0x561c4120b390 2024-09-21T07:55:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.798+0000 7f93c8ab7740 10 client.26969 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.798+0000 7f93c8ab7740 10 client.26969 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:55:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.798+0000 7f93c8ab7740 20 client.26969 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:59.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.798+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411ea9f0 0x561c415f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.798+0000 7f93c8ab7740 4 client.26969 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:55:59.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.798+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c4154bf00 con 0x561c411ea9f0 2024-09-21T07:55:59.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.799+0000 7f93baa00640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411ea9f0 0x561c415f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:55:59 smithi162 ceph-mon[34833]: pgmap v540: 129 pgs: 129 active+clean; 32 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 24 KiB/s rd, 248 MiB/s wr, 528 op/s 2024-09-21T07:55:59.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.800+0000 7f93baa00640 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411ea9f0 0x561c415f0770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=435b3f7b29dd963e server_cookie=4ae5a302a8ccb9a5 in_seq=0 out_seq=0 2024-09-21T07:55:59.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.800+0000 7f93a4c00640 10 client.26969 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.801+0000 7f93a4c00640 1 -- 172.21.15.84:0/754423847 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c4154bf00 con 0x561c411ea9f0 2024-09-21T07:55:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.801+0000 7f93a4c00640 10 client.26969 handle_command_reply: tid=0 2024-09-21T07:55:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.801+0000 7f93c8ab7740 1 client.26969 shutdown 2024-09-21T07:55:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.803+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 msgr2=0x561c415dea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.803+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415dea80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f93a80e4d90 tx=0x7f93a80b6de0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 shutdown_connections 2024-09-21T07:55:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411ea9f0 0x561c415f0770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c415ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415dea80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/754423847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c412031b0 0x561c415de540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 >> 172.21.15.84:0/754423847 conn(0x561c41220460 msgr2=0x561c415d5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93a4c00640 0 client.26969 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.805+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 shutdown_connections 2024-09-21T07:55:59.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.808+0000 7f93c8ab7740 1 -- 172.21.15.84:0/754423847 wait complete. 2024-09-21T07:55:59.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.809+0000 7f93c8ab7740 20 client.26969 trim_cache size 0 max 16384 2024-09-21T07:55:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.847+0000 7f93c8ab7740 1 Processor -- start 2024-09-21T07:55:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.847+0000 7f93c8ab7740 1 -- start start 2024-09-21T07:55:59.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f939c00fc80 con 0x561c4122c070 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f939c0117c0 con 0x561c4120b390 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f939c010350 con 0x561c412031b0 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93ba000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93ba000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46248/0 (socket says 172.21.15.84:46248) 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.848+0000 7f93ba000640 1 -- 172.21.15.84:0/3591436431 learned_addr learned my addr 172.21.15.84:0/3591436431 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.849+0000 7f93bb400640 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.849+0000 7f93bb400640 1 -- 172.21.15.84:0/3591436431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 msgr2=0x561c415d65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:59.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.849+0000 7f93baa00640 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.850+0000 7f93bb400640 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.850+0000 7f93bb400640 1 -- 172.21.15.84:0/3591436431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 msgr2=0x561c415f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:59.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.850+0000 7f93bb400640 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.850+0000 7f93bb400640 1 -- 172.21.15.84:0/3591436431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c415d5090 con 0x561c4122c070 2024-09-21T07:55:59.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.850+0000 7f93ba000640 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:55:59.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.850+0000 7f93baa00640 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.851+0000 7f93bb400640 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415f64b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f93b4003c90 tx=0x7f93b4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e3024d3dce1412 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.851+0000 7f93a7400640 1 -- 172.21.15.84:0/3591436431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4021070 con 0x561c4122c070 2024-09-21T07:55:59.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.851+0000 7f93a7400640 1 -- 172.21.15.84:0/3591436431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b401cb10 con 0x561c4122c070 2024-09-21T07:55:59.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.852+0000 7f93a7400640 1 -- 172.21.15.84:0/3591436431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4010c10 con 0x561c4122c070 2024-09-21T07:55:59.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3591436431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 msgr2=0x561c415f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415f64b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f93b4003c90 tx=0x7f93b4004410 comp rx=0 tx=0).stop 2024-09-21T07:55:59.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3591436431 shutdown_connections 2024-09-21T07:55:59.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4122c070 0x561c415f64b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c4120b390 0x561c415f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/3591436431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c412031b0 0x561c415d65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3591436431 >> 172.21.15.84:0/3591436431 conn(0x561c41220460 msgr2=0x561c415d5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:59.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3591436431 shutdown_connections 2024-09-21T07:55:59.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.854+0000 7f93c8ab7740 1 -- 172.21.15.84:0/3591436431 wait complete. 2024-09-21T07:55:59.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.855+0000 7f93c8ab7740 1 -- start start 2024-09-21T07:55:59.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.855+0000 7f93c8ab7740 1 Processor -- start 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c412031b0 0x561c415e5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4120b390 0x561c415e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93c8ab7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c4165a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f939c0110f0 con 0x561c4120b390 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f939c010a20 con 0x561c412031b0 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93c8ab7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f939c00dd10 con 0x561c4122c070 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93c8ab7740 10 client.0 _ll_register_callbacks cb 0x7f93a80e5240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93bb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c4165a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93bb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c4165a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39172/0 (socket says 172.21.15.84:39172) 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.856+0000 7f93bb400640 1 -- 172.21.15.84:0/595017643 learned_addr learned my addr 172.21.15.84:0/595017643 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.857+0000 7f93bb400640 1 -- 172.21.15.84:0/595017643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c412031b0 msgr2=0x561c415e5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:59.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.857+0000 7f93bb400640 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c412031b0 0x561c415e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.857+0000 7f93bb400640 1 -- 172.21.15.84:0/595017643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4120b390 msgr2=0x561c415e5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.857+0000 7f93ba000640 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4120b390 0x561c415e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.857+0000 7f93bb400640 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4120b390 0x561c415e5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.857+0000 7f93bb400640 1 -- 172.21.15.84:0/595017643 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c4165a7f0 con 0x561c4122c070 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.857+0000 7f93ba000640 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4120b390 0x561c415e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.858+0000 7f93bb400640 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c4165a180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f93b4006010 tx=0x7f93b4005bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5101e721e3d48f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.858+0000 7f93a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:55:59.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.858+0000 7f93a4c00640 1 -- 172.21.15.84:0/595017643 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4021030 con 0x561c4122c070 2024-09-21T07:55:59.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.858+0000 7f93a4c00640 1 -- 172.21.15.84:0/595017643 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f93b40109b0 con 0x561c4122c070 2024-09-21T07:55:59.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.858+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b401cb10 con 0x561c4122c070 2024-09-21T07:55:59.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.859+0000 7f93a4c00640 1 -- 172.21.15.84:0/595017643 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f93b4010c10 con 0x561c4122c070 2024-09-21T07:55:59.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.859+0000 7f93c8ab7740 10 client.26986 fetch_fsmap learned FSMap version 29 2024-09-21T07:55:59.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.859+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561c4165b9e0 con 0x561c4122c070 2024-09-21T07:55:59.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.864+0000 7f93a4c00640 1 -- 172.21.15.84:0/595017643 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b401cb10 con 0x561c4122c070 2024-09-21T07:55:59.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.865+0000 7f93a4c00640 1 -- 172.21.15.84:0/595017643 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f93b4027070 con 0x561c4122c070 2024-09-21T07:55:59.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.867+0000 7f93c8ab7740 10 client.26986 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:55:59.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.867+0000 7f93c8ab7740 10 client.26986 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:55:59.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.867+0000 7f93c8ab7740 20 client.26986 populate_metadata read hostname 'smithi084' 2024-09-21T07:55:59.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.867+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411bfda0 0x561c4165e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:55:59.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.867+0000 7f93c8ab7740 4 client.26986 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:55:59.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.867+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c415479b0 con 0x561c411bfda0 2024-09-21T07:55:59.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.868+0000 7f93baa00640 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411bfda0 0x561c4165e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:55:59.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.869+0000 7f93baa00640 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411bfda0 0x561c4165e0b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c40e3fbdf6c397a server_cookie=b6fd688191bd42d3 in_seq=0 out_seq=0 2024-09-21T07:55:59.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.869+0000 7f93a4c00640 10 client.26986 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:59.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.869+0000 7f93a4c00640 1 -- 172.21.15.84:0/595017643 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c415479b0 con 0x561c411bfda0 2024-09-21T07:55:59.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.869+0000 7f93a4c00640 10 client.26986 handle_command_reply: tid=0 2024-09-21T07:55:59.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.869+0000 7f93c8ab7740 1 client.26986 shutdown 2024-09-21T07:55:59.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.872+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 msgr2=0x561c4165a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.872+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c4165a180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f93b4006010 tx=0x7f93b4005bf0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.872+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 shutdown_connections 2024-09-21T07:55:59.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.873+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x561c411bfda0 0x561c4165e0b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.873+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c4122c070 0x561c4165a180 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.873+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561c4120b390 0x561c415e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.873+0000 7f93a4c00640 0 client.26986 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:55:59.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.873+0000 7f93c8ab7740 1 --2- 172.21.15.84:0/595017643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561c412031b0 0x561c415e5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.873+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 >> 172.21.15.84:0/595017643 conn(0x561c41220460 msgr2=0x561c415d3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:59.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.874+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 shutdown_connections 2024-09-21T07:55:59.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.874+0000 7f93c8ab7740 1 -- 172.21.15.84:0/595017643 wait complete. 2024-09-21T07:55:59.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.875+0000 7f93c8ab7740 20 client.26986 trim_cache size 0 max 16384 2024-09-21T07:55:59.878 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:55:59.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.877+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f93a00b6850 msgr2=0x7f93a00b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.877+0000 7f93c1e00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f93a00b6850 0x7f93a00b8d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0096c0 tx=0x7f93ac005fd0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.877+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc10f770 msgr2=0x7f93bc114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:55:59.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.877+0000 7f93c1e00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc10f770 0x7f93bc114cc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f93a800e9c0 tx=0x7f93a800ee80 comp rx=0 tx=0).stop 2024-09-21T07:55:59.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.878+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 shutdown_connections 2024-09-21T07:55:59.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.878+0000 7f93c1e00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f93a00b6850 0x7f93a00b8d60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.878+0000 7f93c1e00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93bc115280 0x7f93bc115780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.878+0000 7f93c1e00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc10f770 0x7f93bc114cc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.878+0000 7f93c1e00640 1 --2- 172.21.15.84:0/855328572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93bc10a900 0x7f93bc117a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:55:59.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.878+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 >> 172.21.15.84:0/855328572 conn(0x7f93bc0712f0 msgr2=0x7f93bc10dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:55:59.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.879+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 shutdown_connections 2024-09-21T07:55:59.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:55:59.879+0000 7f93c1e00640 1 -- 172.21.15.84:0/855328572 wait complete. 2024-09-21T07:55:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:55:59 smithi191 ceph-mon[34667]: pgmap v540: 129 pgs: 129 active+clean; 32 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 24 KiB/s rd, 248 MiB/s wr, 528 op/s 2024-09-21T07:56:00.832 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T07:56:00.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:56:01.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:01 smithi162 ceph-mon[34833]: pgmap v541: 129 pgs: 129 active+clean; 32 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 49 KiB/s rd, 237 MiB/s wr, 663 op/s 2024-09-21T07:56:01.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:01 smithi084 ceph-mon[30411]: pgmap v541: 129 pgs: 129 active+clean; 32 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 49 KiB/s rd, 237 MiB/s wr, 663 op/s 2024-09-21T07:56:01.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:01 smithi191 ceph-mon[34667]: pgmap v541: 129 pgs: 129 active+clean; 32 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 49 KiB/s rd, 237 MiB/s wr, 663 op/s 2024-09-21T07:56:02.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:56:02.903 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:02.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:02 smithi191 ceph-mon[34667]: pgmap v542: 129 pgs: 129 active+clean; 32 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 47 KiB/s rd, 243 MiB/s wr, 812 op/s 2024-09-21T07:56:03.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:02 smithi162 ceph-mon[34833]: pgmap v542: 129 pgs: 129 active+clean; 32 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 47 KiB/s rd, 243 MiB/s wr, 812 op/s 2024-09-21T07:56:03.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:02 smithi084 ceph-mon[30411]: pgmap v542: 129 pgs: 129 active+clean; 32 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 47 KiB/s rd, 243 MiB/s wr, 812 op/s 2024-09-21T07:56:05.391 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:05 smithi084 ceph-mon[30411]: pgmap v543: 129 pgs: 129 active+clean; 32 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 55 KiB/s rd, 238 MiB/s wr, 934 op/s 2024-09-21T07:56:05.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:05 smithi191 ceph-mon[34667]: pgmap v543: 129 pgs: 129 active+clean; 32 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 55 KiB/s rd, 238 MiB/s wr, 934 op/s 2024-09-21T07:56:05.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:05 smithi162 ceph-mon[34833]: pgmap v543: 129 pgs: 129 active+clean; 32 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 55 KiB/s rd, 238 MiB/s wr, 934 op/s 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.122+0000 7fa4df800640 1 -- 172.21.15.84:0/2089334096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d81081b0 msgr2=0x7fa4d81085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.122+0000 7fa4df800640 1 --2- 172.21.15.84:0/2089334096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d81081b0 0x7fa4d81085c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009860 tx=0x7fa4cc02a340 comp rx=0 tx=0).stop 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.123+0000 7fa4df800640 1 -- 172.21.15.84:0/2089334096 shutdown_connections 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.123+0000 7fa4df800640 1 --2- 172.21.15.84:0/2089334096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d8108b00 0x7fa4d810f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.123+0000 7fa4df800640 1 --2- 172.21.15.84:0/2089334096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d81081b0 0x7fa4d81085c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.123+0000 7fa4df800640 1 --2- 172.21.15.84:0/2089334096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 0x7fa4d8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.123+0000 7fa4df800640 1 -- 172.21.15.84:0/2089334096 >> 172.21.15.84:0/2089334096 conn(0x7fa4d80fe2c0 msgr2=0x7fa4d8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.123+0000 7fa4df800640 1 -- 172.21.15.84:0/2089334096 shutdown_connections 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.123+0000 7fa4df800640 1 -- 172.21.15.84:0/2089334096 wait complete. 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.127+0000 7fa4df800640 1 Processor -- start 2024-09-21T07:56:05.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.127+0000 7fa4df800640 1 -- start start 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.128+0000 7fa4df800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 0x7fa4d810eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.128+0000 7fa4df800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d81081b0 0x7fa4d8109300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.128+0000 7fa4df800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d8108b00 0x7fa4d8109840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.128+0000 7fa4dce00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 0x7fa4d810eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.128+0000 7fa4dce00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 0x7fa4d810eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39176/0 (socket says 172.21.15.84:39176) 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.129+0000 7fa4df800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d806e4d0 con 0x7fa4d81081b0 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.129+0000 7fa4dd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d8108b00 0x7fa4d8109840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.129+0000 7fa4dd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d8108b00 0x7fa4d8109840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46282/0 (socket says 172.21.15.84:46282) 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.129+0000 7fa4dd800640 1 -- 172.21.15.84:0/3252004327 learned_addr learned my addr 172.21.15.84:0/3252004327 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.130+0000 7fa4d7e00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d81081b0 0x7fa4d8109300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.130+0000 7fa4df800640 1 -- 172.21.15.84:0/3252004327 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d806e350 con 0x7fa4d8108b00 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.130+0000 7fa4df800640 1 -- 172.21.15.84:0/3252004327 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d806e650 con 0x7fa4d8102870 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.132+0000 7fa4dd800640 1 -- 172.21.15.84:0/3252004327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 msgr2=0x7fa4d810eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.132+0000 7fa4dd800640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 0x7fa4d810eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.133+0000 7fa4dd800640 1 -- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d81081b0 msgr2=0x7fa4d8109300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.133+0000 7fa4dd800640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d81081b0 0x7fa4d8109300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.133+0000 7fa4dd800640 1 -- 172.21.15.84:0/3252004327 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d8109e80 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.133+0000 7fa4d7e00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d81081b0 0x7fa4d8109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.133+0000 7fa4dce00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 0x7fa4d810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.134+0000 7fa4dd800640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d8108b00 0x7fa4d8109840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d950 tx=0x7fa4c400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.134+0000 7fa4d5600640 1 -- 172.21.15.84:0/3252004327 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4017030 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.134+0000 7fa4d5600640 1 -- 172.21.15.84:0/3252004327 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c4004020 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.134+0000 7fa4d5600640 1 -- 172.21.15.84:0/3252004327 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4003b50 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.135+0000 7fa4df800640 1 -- 172.21.15.84:0/3252004327 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d81b55e0 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.135+0000 7fa4df800640 1 -- 172.21.15.84:0/3252004327 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d81b5980 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.137+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b4005290 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.142+0000 7fa4d5600640 1 -- 172.21.15.84:0/3252004327 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa4c401a070 con 0x7fa4d8108b00 2024-09-21T07:56:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.145+0000 7fa4d5600640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4c00b6700 0x7fa4c00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.147+0000 7fa4d5600640 1 -- 172.21.15.84:0/3252004327 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa4c40e6f70 con 0x7fa4d8108b00 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.147+0000 7fa4d5600640 1 -- 172.21.15.84:0/3252004327 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4c4021020 con 0x7fa4d8108b00 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.151+0000 7fa4dce00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4c00b6700 0x7fa4c00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.155+0000 7fa4dce00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4c00b6700 0x7fa4c00b8c10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa4d810ec30 tx=0x7fa4d00012b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.600+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4b4005580 con 0x7fa4d8108b00 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.601+0000 7fa4d5600640 1 -- 172.21.15.84:0/3252004327 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fa4c40ad1d0 con 0x7fa4d8108b00 2024-09-21T07:56:05.824 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.605+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4c00b6700 msgr2=0x7fa4c00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.605+0000 7fa4caa00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4c00b6700 0x7fa4c00b8c10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa4d810ec30 tx=0x7fa4d00012b0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.605+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d8108b00 msgr2=0x7fa4d8109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.605+0000 7fa4caa00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d8108b00 0x7fa4d8109840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400d950 tx=0x7fa4c400de10 comp rx=0 tx=0).stop 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 shutdown_connections 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4c00b6700 0x7fa4c00b8c10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d8108b00 0x7fa4d8109840 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d81081b0 0x7fa4d8109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 --2- 172.21.15.84:0/3252004327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4d8102870 0x7fa4d810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:05.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 >> 172.21.15.84:0/3252004327 conn(0x7fa4d80fe2c0 msgr2=0x7fa4d806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:05.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 shutdown_connections 2024-09-21T07:56:05.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:05.606+0000 7fa4caa00640 1 -- 172.21.15.84:0/3252004327 wait complete. 2024-09-21T07:56:06.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:06 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3252004327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:06.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:06 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3252004327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:06.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:06 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3252004327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:07.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:07 smithi191 ceph-mon[34667]: pgmap v544: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 48 KiB/s rd, 219 MiB/s wr, 967 op/s 2024-09-21T07:56:07.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:07 smithi162 ceph-mon[34833]: pgmap v544: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 48 KiB/s rd, 219 MiB/s wr, 967 op/s 2024-09-21T07:56:07.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:07 smithi084 ceph-mon[30411]: pgmap v544: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 48 KiB/s rd, 219 MiB/s wr, 967 op/s 2024-09-21T07:56:09.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:09 smithi191 ceph-mon[34667]: pgmap v545: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 47 KiB/s rd, 233 MiB/s wr, 1.12k op/s 2024-09-21T07:56:09.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:09 smithi162 ceph-mon[34833]: pgmap v545: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 47 KiB/s rd, 233 MiB/s wr, 1.12k op/s 2024-09-21T07:56:09.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:09 smithi084 ceph-mon[30411]: pgmap v545: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 47 KiB/s rd, 233 MiB/s wr, 1.12k op/s 2024-09-21T07:56:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:10.869 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T07:56:10.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.038+0000 7fcf1f000640 1 -- 172.21.15.84:0/1296301359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18075dd0 msgr2=0x7fcf180761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.038+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1296301359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18075dd0 0x7fcf180761e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009900 tx=0x7fcf0402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.038+0000 7fcf1f000640 1 -- 172.21.15.84:0/1296301359 shutdown_connections 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.038+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1296301359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf181141f0 0x7fcf181166c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.038+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1296301359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18075dd0 0x7fcf180761e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.038+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1296301359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf18077390 0x7fcf180757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.038+0000 7fcf1f000640 1 -- 172.21.15.84:0/1296301359 >> 172.21.15.84:0/1296301359 conn(0x7fcf180ff390 msgr2=0x7fcf181017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.039+0000 7fcf1f000640 1 -- 172.21.15.84:0/1296301359 shutdown_connections 2024-09-21T07:56:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.039+0000 7fcf1f000640 1 -- 172.21.15.84:0/1296301359 wait complete. 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 Processor -- start 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 -- start start 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf18075dd0 0x7fcf181a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18077390 0x7fcf181a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf181141f0 0x7fcf181a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18119e80 con 0x7fcf18075dd0 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18119d00 con 0x7fcf18077390 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1f000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1811a000 con 0x7fcf181141f0 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18077390 0x7fcf181a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18077390 0x7fcf181a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48152/0 (socket says 172.21.15.84:48152) 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1d200640 1 -- 172.21.15.84:0/1063911725 learned_addr learned my addr 172.21.15.84:0/1063911725 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.040+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf18075dd0 0x7fcf181a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1e600640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf181141f0 0x7fcf181a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1d200640 1 -- 172.21.15.84:0/1063911725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf181141f0 msgr2=0x7fcf181a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1d200640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf181141f0 0x7fcf181a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1d200640 1 -- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf18075dd0 msgr2=0x7fcf181a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1d200640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf18075dd0 0x7fcf181a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1d200640 1 -- 172.21.15.84:0/1063911725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf181a67d0 con 0x7fcf18077390 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf18075dd0 0x7fcf181a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf1d200640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18077390 0x7fcf181a0e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcf04005ab0 tx=0x7fcf04003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf16000640 1 -- 172.21.15.84:0/1063911725 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0403f070 con 0x7fcf18077390 2024-09-21T07:56:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf16000640 1 -- 172.21.15.84:0/1063911725 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf04031d60 con 0x7fcf18077390 2024-09-21T07:56:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.041+0000 7fcf16000640 1 -- 172.21.15.84:0/1063911725 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf04035030 con 0x7fcf18077390 2024-09-21T07:56:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.042+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf181a6a60 con 0x7fcf18077390 2024-09-21T07:56:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.042+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf181a6e10 con 0x7fcf18077390 2024-09-21T07:56:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.045+0000 7fcf16000640 1 -- 172.21.15.84:0/1063911725 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fcf04042070 con 0x7fcf18077390 2024-09-21T07:56:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.047+0000 7fcf16000640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf000b6700 0x7fcf000b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.047+0000 7fcf16000640 1 -- 172.21.15.84:0/1063911725 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fcf04108240 con 0x7fcf18077390 2024-09-21T07:56:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.047+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf000b6700 0x7fcf000b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.048+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf000b6700 0x7fcf000b8c10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009b40 tx=0x7fcf0c005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.281+0000 7fcf2767e740 1 Processor -- start 2024-09-21T07:56:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.281+0000 7fcf2767e740 1 -- start start 2024-09-21T07:56:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.281+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d413e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.281+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d414350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.281+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 0x56177d414890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.281+0000 7fcf2767e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56177d3896b0 con 0x56177d04e4d0 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf2767e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56177d378ae0 con 0x56177d0462f0 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf2767e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56177d37c8f0 con 0x56177d06f1b0 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d413e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d414350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d413e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38178/0 (socket says 172.21.15.84:38178) 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d414350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48160/0 (socket says 172.21.15.84:48160) 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3630020161 learned_addr learned my addr 172.21.15.84:0/3630020161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1d200640 1 -- 172.21.15.84:0/3630020161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 msgr2=0x56177d413e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3630020161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d413e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1d200640 1 -- 172.21.15.84:0/3630020161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 msgr2=0x56177d414890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3630020161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 0x56177d414890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.282+0000 7fcf1d200640 1 -- 172.21.15.84:0/3630020161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177d345780 con 0x56177d0462f0 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.283+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3630020161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d414350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcf041055f0 tx=0x7fcf0403b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=205c621620e640da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.283+0000 7fcf0aa00640 1 -- 172.21.15.84:0/3630020161 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf040cd830 con 0x56177d0462f0 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.283+0000 7fcf0aa00640 1 -- 172.21.15.84:0/3630020161 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf040ce420 con 0x56177d0462f0 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.283+0000 7fcf0aa00640 1 -- 172.21.15.84:0/3630020161 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf040ca100 con 0x56177d0462f0 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.284+0000 7fcf2767e740 1 -- 172.21.15.84:0/3630020161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 msgr2=0x56177d414350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.284+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3630020161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d414350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcf041055f0 tx=0x7fcf0403b920 comp rx=0 tx=0).stop 2024-09-21T07:56:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.284+0000 7fcf2767e740 1 -- 172.21.15.84:0/3630020161 shutdown_connections 2024-09-21T07:56:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.284+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3630020161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 0x56177d414890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.284+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3630020161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d414350 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.284+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3630020161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d413e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.284+0000 7fcf2767e740 1 -- 172.21.15.84:0/3630020161 >> 172.21.15.84:0/3630020161 conn(0x56177d063300 msgr2=0x56177d411d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.286+0000 7fcf2767e740 1 -- 172.21.15.84:0/3630020161 shutdown_connections 2024-09-21T07:56:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.287+0000 7fcf2767e740 1 -- 172.21.15.84:0/3630020161 wait complete. 2024-09-21T07:56:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.288+0000 7fcf2767e740 1 -- start start 2024-09-21T07:56:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.288+0000 7fcf2767e740 1 Processor -- start 2024-09-21T07:56:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.295+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d41f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.295+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d41f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d43c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf2767e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56177d2b0ab0 con 0x56177d0462f0 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf2767e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56177d31f570 con 0x56177d04e4d0 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf2767e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56177d433360 con 0x56177d06f1b0 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf2767e740 10 client.0 _ll_register_callbacks cb 0x56177d32e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf1d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d41f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf1d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d41f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48162/0 (socket says 172.21.15.84:48162) 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf1d200640 1 -- 172.21.15.84:0/1848797164 learned_addr learned my addr 172.21.15.84:0/1848797164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf1d200640 1 -- 172.21.15.84:0/1848797164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 msgr2=0x56177d43c5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf1d200640 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d43c5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.296+0000 7fcf1d200640 1 -- 172.21.15.84:0/1848797164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 msgr2=0x56177d41f490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.298+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d41f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.298+0000 7fcf1d200640 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d41f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.298+0000 7fcf1d200640 1 -- 172.21.15.84:0/1848797164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177d0da790 con 0x56177d04e4d0 2024-09-21T07:56:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.299+0000 7fcf1d200640 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d41f9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf040ca2f0 tx=0x7fcf04105ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb54290ad757df3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.299+0000 7fceff400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:56:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.300+0000 7fceff400640 1 -- 172.21.15.84:0/1848797164 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf040f5020 con 0x56177d04e4d0 2024-09-21T07:56:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.300+0000 7fceff400640 1 -- 172.21.15.84:0/1848797164 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fcf040f51c0 con 0x56177d04e4d0 2024-09-21T07:56:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.301+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf040ce420 con 0x56177d04e4d0 2024-09-21T07:56:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.302+0000 7fceff400640 1 -- 172.21.15.84:0/1848797164 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf040d2800 con 0x56177d04e4d0 2024-09-21T07:56:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.302+0000 7fcf2767e740 10 client.26990 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.302+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56177d153620 con 0x56177d04e4d0 2024-09-21T07:56:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.303+0000 7fceff400640 1 -- 172.21.15.84:0/1848797164 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf040ce420 con 0x56177d04e4d0 2024-09-21T07:56:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.303+0000 7fceff400640 1 -- 172.21.15.84:0/1848797164 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcf040d5b80 con 0x56177d04e4d0 2024-09-21T07:56:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.304+0000 7fcf2767e740 10 client.26990 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.305+0000 7fcf2767e740 10 client.26990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.305+0000 7fcf2767e740 20 client.26990 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.305+0000 7fcf2767e740 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d02dd80 0x56177d442140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.305+0000 7fcf2767e740 4 client.26990 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.305+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56177d38b600 con 0x56177d02dd80 2024-09-21T07:56:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.306+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d02dd80 0x56177d442140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.307+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d02dd80 0x56177d442140 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff0f84a2ab657dd server_cookie=c64e1875491a4cb8 in_seq=0 out_seq=0 2024-09-21T07:56:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.307+0000 7fceff400640 10 client.26990 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.307+0000 7fceff400640 1 -- 172.21.15.84:0/1848797164 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56177d38b600 con 0x56177d02dd80 2024-09-21T07:56:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.307+0000 7fceff400640 10 client.26990 handle_command_reply: tid=0 2024-09-21T07:56:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.307+0000 7fcf2767e740 1 client.26990 shutdown 2024-09-21T07:56:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 msgr2=0x56177d41f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d41f9d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf040ca2f0 tx=0x7fcf04105ad0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 shutdown_connections 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d02dd80 0x56177d442140 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d06f1b0 0x56177d43c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fceff400640 0 client.26990 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d41f9d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 --2- 172.21.15.84:0/1848797164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d41f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.308+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 >> 172.21.15.84:0/1848797164 conn(0x56177d063300 msgr2=0x56177d414e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.309+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 shutdown_connections 2024-09-21T07:56:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.310+0000 7fcf2767e740 1 -- 172.21.15.84:0/1848797164 wait complete. 2024-09-21T07:56:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.310+0000 7fcf2767e740 20 client.26990 trim_cache size 0 max 16384 2024-09-21T07:56:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.330+0000 7fcf2767e740 1 Processor -- start 2024-09-21T07:56:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf2767e740 1 -- start start 2024-09-21T07:56:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d410e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d421370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 0x56177d415550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf2767e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181ae980 con 0x56177d04e4d0 2024-09-21T07:56:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf2767e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181b04c0 con 0x56177d0462f0 2024-09-21T07:56:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf2767e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181af050 con 0x56177d02dd80 2024-09-21T07:56:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf1dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d410e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf1dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d410e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38186/0 (socket says 172.21.15.84:38186) 2024-09-21T07:56:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.331+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3735104448 learned_addr learned my addr 172.21.15.84:0/3735104448 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d421370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3735104448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 msgr2=0x56177d421370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d421370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3735104448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 msgr2=0x56177d415550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:11.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 0x56177d415550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3735104448 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177d412600 con 0x56177d02dd80 2024-09-21T07:56:11.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d410e30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009470 tx=0x7fcf0c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9374fbef7cc1551 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.332+0000 7fcf0a000640 1 -- 172.21.15.84:0/3735104448 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c004020 con 0x56177d02dd80 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.333+0000 7fcf0a000640 1 -- 172.21.15.84:0/3735104448 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf0c017040 con 0x56177d02dd80 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.333+0000 7fcf0a000640 1 -- 172.21.15.84:0/3735104448 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c020660 con 0x56177d02dd80 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 -- 172.21.15.84:0/3735104448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 msgr2=0x56177d410e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d410e30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009470 tx=0x7fcf0c014000 comp rx=0 tx=0).stop 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 -- 172.21.15.84:0/3735104448 shutdown_connections 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d04e4d0 0x56177d415550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d0462f0 0x56177d421370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3735104448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d410e30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 -- 172.21.15.84:0/3735104448 >> 172.21.15.84:0/3735104448 conn(0x56177d063300 msgr2=0x56177d414e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 -- 172.21.15.84:0/3735104448 shutdown_connections 2024-09-21T07:56:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.334+0000 7fcf2767e740 1 -- 172.21.15.84:0/3735104448 wait complete. 2024-09-21T07:56:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.335+0000 7fcf2767e740 1 -- start start 2024-09-21T07:56:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.335+0000 7fcf2767e740 1 Processor -- start 2024-09-21T07:56:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.336+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d438570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.338 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.336+0000 7fcf2767e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d438b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.338 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.336+0000 7fcf1dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d438570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.336+0000 7fcf1dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d438570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38202/0 (socket says 172.21.15.84:38202) 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.336+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3904767703 learned_addr learned my addr 172.21.15.84:0/3904767703 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d4a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181afdf0 con 0x56177d0462f0 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf181af720 con 0x56177d04e4d0 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1810f780 con 0x56177d02dd80 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf2767e740 10 client.0 _ll_register_callbacks cb 0x7fcf0c009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d438b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1e600640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d4a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 msgr2=0x56177d4a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d4a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3904767703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 msgr2=0x56177d438b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d438b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1dc00640 1 -- 172.21.15.84:0/3904767703 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177d4a24e0 con 0x56177d02dd80 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1e600640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d4a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.337+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d438b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.338+0000 7fcf1dc00640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d438570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009440 tx=0x7fcf0c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa0f86103a41ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.338+0000 7fceff400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.338+0000 7fceff400640 1 -- 172.21.15.84:0/3904767703 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c035020 con 0x56177d02dd80 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.338+0000 7fceff400640 1 -- 172.21.15.84:0/3904767703 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fcf0c003900 con 0x56177d02dd80 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.338+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf0c017040 con 0x56177d02dd80 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.339+0000 7fceff400640 1 -- 172.21.15.84:0/3904767703 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf0c003e10 con 0x56177d02dd80 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.339+0000 7fcf2767e740 10 client.27004 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.339+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56177d4acb10 con 0x56177d02dd80 2024-09-21T07:56:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.339+0000 7fceff400640 1 -- 172.21.15.84:0/3904767703 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf0c017040 con 0x56177d02dd80 2024-09-21T07:56:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.340+0000 7fceff400640 1 -- 172.21.15.84:0/3904767703 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcf0c00f040 con 0x56177d02dd80 2024-09-21T07:56:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.340+0000 7fcf2767e740 10 client.27004 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.340+0000 7fcf2767e740 10 client.27004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.340+0000 7fcf2767e740 20 client.27004 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.340+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d06f1b0 0x56177d4af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.340+0000 7fcf2767e740 4 client.27004 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:56:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.340+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56177d3870b0 con 0x56177d06f1b0 2024-09-21T07:56:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.341+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d06f1b0 0x56177d4af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.341+0000 7fcf1d200640 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d06f1b0 0x56177d4af270 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da00723abe98a629 server_cookie=65b1d933e78fd3f1 in_seq=0 out_seq=0 2024-09-21T07:56:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.341+0000 7fceff400640 10 client.27004 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.369+0000 7fceff400640 1 -- 172.21.15.84:0/3904767703 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56177d3870b0 con 0x56177d06f1b0 2024-09-21T07:56:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.369+0000 7fceff400640 10 client.27004 handle_command_reply: tid=0 2024-09-21T07:56:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.369+0000 7fcf2767e740 1 client.27004 shutdown 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 msgr2=0x56177d438570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d438570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009440 tx=0x7fcf0c00eca0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 shutdown_connections 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56177d04e4d0 0x56177d4a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56177d0462f0 0x56177d438b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56177d06f1b0 0x56177d4af270 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 --2- 172.21.15.84:0/3904767703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56177d02dd80 0x56177d438570 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 >> 172.21.15.84:0/3904767703 conn(0x56177d063300 msgr2=0x56177d4156b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fceff400640 0 client.27004 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 shutdown_connections 2024-09-21T07:56:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.370+0000 7fcf2767e740 1 -- 172.21.15.84:0/3904767703 wait complete. 2024-09-21T07:56:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.371+0000 7fcf2767e740 20 client.27004 trim_cache size 0 max 16384 2024-09-21T07:56:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:56:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:56:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:56:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:56:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf000b6700 msgr2=0x7fcf000b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf000b6700 0x7fcf000b8c10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009b40 tx=0x7fcf0c005e50 comp rx=0 tx=0).stop 2024-09-21T07:56:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18077390 msgr2=0x7fcf181a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18077390 0x7fcf181a0e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcf04005ab0 tx=0x7fcf04003c80 comp rx=0 tx=0).stop 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 shutdown_connections 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fcf000b6700 0x7fcf000b8c10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf181141f0 0x7fcf181a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf18077390 0x7fcf181a0e40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 --2- 172.21.15.84:0/1063911725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf18075dd0 0x7fcf181a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 >> 172.21.15.84:0/1063911725 conn(0x7fcf180ff390 msgr2=0x7fcf181100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 shutdown_connections 2024-09-21T07:56:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:11.373+0000 7fcf1f000640 1 -- 172.21.15.84:0/1063911725 wait complete. 2024-09-21T07:56:11.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:11 smithi191 ceph-mon[34667]: pgmap v546: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 56 KiB/s rd, 220 MiB/s wr, 1.14k op/s 2024-09-21T07:56:11.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:11 smithi084 ceph-mon[30411]: pgmap v546: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 56 KiB/s rd, 220 MiB/s wr, 1.14k op/s 2024-09-21T07:56:11.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:11 smithi162 ceph-mon[34833]: pgmap v546: 129 pgs: 129 active+clean; 33 GiB data, 68 GiB used, 1004 GiB / 1.0 TiB avail; 56 KiB/s rd, 220 MiB/s wr, 1.14k op/s 2024-09-21T07:56:13.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:13 smithi162 ceph-mon[34833]: pgmap v547: 129 pgs: 129 active+clean; 33 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 30 KiB/s rd, 228 MiB/s wr, 1.26k op/s 2024-09-21T07:56:13.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:13 smithi084 ceph-mon[30411]: pgmap v547: 129 pgs: 129 active+clean; 33 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 30 KiB/s rd, 228 MiB/s wr, 1.26k op/s 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 -- 172.21.15.84:0/600217128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc116640 msgr2=0x7f50dc118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 --2- 172.21.15.84:0/600217128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc116640 0x7f50dc118b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009be0 tx=0x7f50d402a6d0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 -- 172.21.15.84:0/600217128 shutdown_connections 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 --2- 172.21.15.84:0/600217128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc116640 0x7f50dc118b50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 --2- 172.21.15.84:0/600217128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50dc10aee0 0x7f50dc115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 --2- 172.21.15.84:0/600217128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50dc10a590 0x7f50dc10a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 -- 172.21.15.84:0/600217128 >> 172.21.15.84:0/600217128 conn(0x7f50dc070ec0 msgr2=0x7f50dc0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.825+0000 7f50e1600640 1 -- 172.21.15.84:0/600217128 shutdown_connections 2024-09-21T07:56:13.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.826+0000 7f50e1600640 1 -- 172.21.15.84:0/600217128 wait complete. 2024-09-21T07:56:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.830+0000 7f50e1600640 1 Processor -- start 2024-09-21T07:56:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.831+0000 7f50e1600640 1 -- start start 2024-09-21T07:56:13.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.834+0000 7f50e1600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50dc10a590 0x7f50dc1a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.834+0000 7f50e1600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc10aee0 0x7f50dc1a3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.835+0000 7f50daa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50dc10a590 0x7f50dc1a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.835+0000 7f50daa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50dc10a590 0x7f50dc1a2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48194/0 (socket says 172.21.15.84:48194) 2024-09-21T07:56:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.835+0000 7f50daa00640 1 -- 172.21.15.84:0/3888970469 learned_addr learned my addr 172.21.15.84:0/3888970469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.836+0000 7f50d2000640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc10aee0 0x7f50dc1a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.836+0000 7f50e1600640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50dc116640 0x7f50dc1a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.836+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc11c2c0 con 0x7f50dc10aee0 2024-09-21T07:56:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.836+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc11c140 con 0x7f50dc10a590 2024-09-21T07:56:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.836+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc11c440 con 0x7f50dc116640 2024-09-21T07:56:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.836+0000 7f50db400640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50dc116640 0x7f50dc1a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.837+0000 7f50db400640 1 -- 172.21.15.84:0/3888970469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50dc10a590 msgr2=0x7f50dc1a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.837+0000 7f50db400640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50dc10a590 0x7f50dc1a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.837+0000 7f50db400640 1 -- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc10aee0 msgr2=0x7f50dc1a3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.837+0000 7f50db400640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc10aee0 0x7f50dc1a3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.837+0000 7f50db400640 1 -- 172.21.15.84:0/3888970469 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc1a8be0 con 0x7f50dc116640 2024-09-21T07:56:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.837+0000 7f50d2000640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc10aee0 0x7f50dc1a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.838+0000 7f50db400640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50dc116640 0x7f50dc1a84b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50d4034040 tx=0x7f50d4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.838+0000 7f50d3e00640 1 -- 172.21.15.84:0/3888970469 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4040020 con 0x7f50dc116640 2024-09-21T07:56:13.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.838+0000 7f50d3e00640 1 -- 172.21.15.84:0/3888970469 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50d40318f0 con 0x7f50dc116640 2024-09-21T07:56:13.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.838+0000 7f50d3e00640 1 -- 172.21.15.84:0/3888970469 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4036040 con 0x7f50dc116640 2024-09-21T07:56:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.839+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc1a8e70 con 0x7f50dc116640 2024-09-21T07:56:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.840+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50dc1a92d0 con 0x7f50dc116640 2024-09-21T07:56:13.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.846+0000 7f50d3e00640 1 -- 172.21.15.84:0/3888970469 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f50d4043020 con 0x7f50dc116640 2024-09-21T07:56:13.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.849+0000 7f50d3e00640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c00b6780 0x7f50c00b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.849+0000 7f50d3e00640 1 -- 172.21.15.84:0/3888970469 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f50d4107f20 con 0x7f50dc116640 2024-09-21T07:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.852+0000 7f50e8237740 1 Processor -- start 2024-09-21T07:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.852+0000 7f50daa00640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c00b6780 0x7f50c00b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.853+0000 7f50e8237740 1 -- start start 2024-09-21T07:56:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.853+0000 7f50e8237740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed447fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.853+0000 7f50e8237740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44800e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.853+0000 7f50e8237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4480620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.853+0000 7f50e8237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ed43f6fb0 con 0x563ed40b8390 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.853+0000 7f50e8237740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563ed43e63e0 con 0x563ed40d9070 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.853+0000 7f50e8237740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563ed43ea1f0 con 0x563ed40b01b0 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.854+0000 7f50d2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44800e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.854+0000 7f50d2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44800e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38234/0 (socket says 172.21.15.84:38234) 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.854+0000 7f50d2000640 1 -- 172.21.15.84:0/3186832716 learned_addr learned my addr 172.21.15.84:0/3186832716 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.854+0000 7f50daa00640 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed447fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.854+0000 7f50db400640 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4480620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.854+0000 7f50d2000640 1 -- 172.21.15.84:0/3186832716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 msgr2=0x563ed447fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:13.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.855+0000 7f50d2000640 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed447fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.855+0000 7f50d2000640 1 -- 172.21.15.84:0/3186832716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 msgr2=0x563ed4480620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.855+0000 7f50d2000640 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4480620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.855+0000 7f50d2000640 1 -- 172.21.15.84:0/3186832716 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed43b0cd0 con 0x563ed40b01b0 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.855+0000 7f50daa00640 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed447fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.855+0000 7f50d2000640 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44800e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009c60 tx=0x7f50c40117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc399fa4655d27e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.855+0000 7f50daa00640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c00b6780 0x7f50c00b8c90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f50cc013780 tx=0x7f50cc0098f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.856+0000 7f50cb400640 1 -- 172.21.15.84:0/3186832716 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4012450 con 0x563ed40b01b0 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.856+0000 7f50cb400640 1 -- 172.21.15.84:0/3186832716 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c4012aa0 con 0x563ed40b01b0 2024-09-21T07:56:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.856+0000 7f50cb400640 1 -- 172.21.15.84:0/3186832716 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c400fb20 con 0x563ed40b01b0 2024-09-21T07:56:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.857+0000 7f50e8237740 1 -- 172.21.15.84:0/3186832716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 msgr2=0x563ed44800e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.857+0000 7f50e8237740 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44800e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009c60 tx=0x7f50c40117b0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.858+0000 7f50e8237740 1 -- 172.21.15.84:0/3186832716 shutdown_connections 2024-09-21T07:56:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.858+0000 7f50e8237740 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4480620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.858+0000 7f50e8237740 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44800e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.859+0000 7f50e8237740 1 --2- 172.21.15.84:0/3186832716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed447fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.859+0000 7f50e8237740 1 -- 172.21.15.84:0/3186832716 >> 172.21.15.84:0/3186832716 conn(0x563ed40cd460 msgr2=0x563ed447da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:13.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.861+0000 7f50e8237740 1 -- 172.21.15.84:0/3186832716 shutdown_connections 2024-09-21T07:56:13.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.861+0000 7f50e8237740 1 -- 172.21.15.84:0/3186832716 wait complete. 2024-09-21T07:56:13.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.864+0000 7f50e8237740 1 -- start start 2024-09-21T07:56:13.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.865+0000 7f50e8237740 1 Processor -- start 2024-09-21T07:56:13.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.866+0000 7f50e8237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b01b0 0x563ed4487680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.866+0000 7f50e8237740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b8390 0x563ed4487bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.866+0000 7f50e8237740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed449fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.866+0000 7f50e8237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ed4247700 con 0x563ed40b01b0 2024-09-21T07:56:13.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.866+0000 7f50e8237740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563ed4381580 con 0x563ed40d9070 2024-09-21T07:56:13.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.867+0000 7f50e8237740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563ed4496b10 con 0x563ed40b8390 2024-09-21T07:56:13.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.867+0000 7f50d2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b8390 0x563ed4487bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.867+0000 7f50d2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b8390 0x563ed4487bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38236/0 (socket says 172.21.15.84:38236) 2024-09-21T07:56:13.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.867+0000 7f50d2000640 1 -- 172.21.15.84:0/3958229576 learned_addr learned my addr 172.21.15.84:0/3958229576 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:13.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.867+0000 7f50db400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed449fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.868+0000 7f50e8237740 10 client.0 _ll_register_callbacks cb 0x563ed4391470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:13.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.868+0000 7f50daa00640 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b01b0 0x563ed4487680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.869+0000 7f50d2000640 1 -- 172.21.15.84:0/3958229576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 msgr2=0x563ed449fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:13.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.869+0000 7f50d2000640 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed449fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.869+0000 7f50d2000640 1 -- 172.21.15.84:0/3958229576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b01b0 msgr2=0x563ed4487680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:13.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.870+0000 7f50d2000640 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b01b0 0x563ed4487680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.870+0000 7f50d2000640 1 -- 172.21.15.84:0/3958229576 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed4144650 con 0x563ed40b8390 2024-09-21T07:56:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.873+0000 7f50daa00640 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b01b0 0x563ed4487680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:13.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.873+0000 7f50d2000640 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b8390 0x563ed4487bc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009c30 tx=0x7f50c4005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2156eb4d1dc17b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:13.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.873+0000 7f50bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:13.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.874+0000 7f50bfe00640 1 -- 172.21.15.84:0/3958229576 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c400fc30 con 0x563ed40b8390 2024-09-21T07:56:13.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.874+0000 7f50bfe00640 1 -- 172.21.15.84:0/3958229576 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f50c400fdd0 con 0x563ed40b8390 2024-09-21T07:56:13.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.874+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ed4383b90 con 0x563ed40b8390 2024-09-21T07:56:13.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.874+0000 7f50bfe00640 1 -- 172.21.15.84:0/3958229576 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50c4033050 con 0x563ed40b8390 2024-09-21T07:56:13.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.875+0000 7f50e8237740 10 client.27016 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:13.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.875+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ed439e950 con 0x563ed40b8390 2024-09-21T07:56:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.875+0000 7f50bfe00640 1 -- 172.21.15.84:0/3958229576 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563ed4383b90 con 0x563ed40b8390 2024-09-21T07:56:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.877+0000 7f50bfe00640 1 -- 172.21.15.84:0/3958229576 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f50c4004a60 con 0x563ed40b8390 2024-09-21T07:56:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.877+0000 7f50e8237740 10 client.27016 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.877+0000 7f50e8237740 10 client.27016 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:56:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.877+0000 7f50e8237740 20 client.27016 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.877+0000 7f50e8237740 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed40979f0 0x563ed44a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.877+0000 7f50e8237740 4 client.27016 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.877+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ed43f8f00 con 0x563ed40979f0 2024-09-21T07:56:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.878+0000 7f50daa00640 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed40979f0 0x563ed44a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.879+0000 7f50daa00640 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed40979f0 0x563ed44a5d60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=84908fcd4b61cbc7 server_cookie=17d6635298cc4773 in_seq=0 out_seq=0 2024-09-21T07:56:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.879+0000 7f50bfe00640 10 client.27016 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:56:13.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.880+0000 7f50bfe00640 1 -- 172.21.15.84:0/3958229576 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ed43f8f00 con 0x563ed40979f0 2024-09-21T07:56:13.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.880+0000 7f50bfe00640 10 client.27016 handle_command_reply: tid=0 2024-09-21T07:56:13.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.881+0000 7f50e8237740 1 client.27016 shutdown 2024-09-21T07:56:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b8390 msgr2=0x563ed4487bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b8390 0x563ed4487bc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009c30 tx=0x7f50c4005a00 comp rx=0 tx=0).stop 2024-09-21T07:56:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 shutdown_connections 2024-09-21T07:56:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed40979f0 0x563ed44a5d60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40d9070 0x563ed449fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b8390 0x563ed4487bc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 --2- 172.21.15.84:0/3958229576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b01b0 0x563ed4487680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 >> 172.21.15.84:0/3958229576 conn(0x563ed40cd460 msgr2=0x563ed4481590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50bfe00640 0 client.27016 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:56:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.882+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 shutdown_connections 2024-09-21T07:56:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.883+0000 7f50e8237740 1 -- 172.21.15.84:0/3958229576 wait complete. 2024-09-21T07:56:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.883+0000 7f50e8237740 20 client.27016 trim_cache size 0 max 16384 2024-09-21T07:56:13.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:13 smithi191 ceph-mon[34667]: pgmap v547: 129 pgs: 129 active+clean; 33 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 30 KiB/s rd, 228 MiB/s wr, 1.26k op/s 2024-09-21T07:56:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.913+0000 7f50e8237740 1 Processor -- start 2024-09-21T07:56:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.913+0000 7f50e8237740 1 -- start start 2024-09-21T07:56:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.914+0000 7f50e8237740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b01b0 0x563ed44786b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.914+0000 7f50e8237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4485d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.914+0000 7f50e8237740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40d9070 0x563ed4486240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.914+0000 7f50e8237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1b72d0 con 0x563ed40b8390 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.914+0000 7f50e8237740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1b8e10 con 0x563ed40b01b0 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.914+0000 7f50e8237740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1b79a0 con 0x563ed40d9070 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.914+0000 7f50db400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40d9070 0x563ed4486240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.915+0000 7f50d2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4485d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.915+0000 7f50d2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4485d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49284/0 (socket says 172.21.15.84:49284) 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.915+0000 7f50d2000640 1 -- 172.21.15.84:0/4266027842 learned_addr learned my addr 172.21.15.84:0/4266027842 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.915+0000 7f50d2000640 1 -- 172.21.15.84:0/4266027842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40d9070 msgr2=0x563ed4486240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.915+0000 7f50daa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b01b0 0x563ed44786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.916+0000 7f50d2000640 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40d9070 0x563ed4486240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.916+0000 7f50d2000640 1 -- 172.21.15.84:0/4266027842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b01b0 msgr2=0x563ed44786b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.916+0000 7f50d2000640 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b01b0 0x563ed44786b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.916+0000 7f50d2000640 1 -- 172.21.15.84:0/4266027842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ed4488740 con 0x563ed40b8390 2024-09-21T07:56:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.916+0000 7f50daa00640 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b01b0 0x563ed44786b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.916+0000 7f50db400640 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40d9070 0x563ed4486240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.917+0000 7f50d2000640 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4485d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f50c40117f0 tx=0x7f50c4004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6d5f29bb54047 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.918+0000 7f50caa00640 1 -- 172.21.15.84:0/4266027842 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c403b020 con 0x563ed40b8390 2024-09-21T07:56:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.918+0000 7f50caa00640 1 -- 172.21.15.84:0/4266027842 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c4003790 con 0x563ed40b8390 2024-09-21T07:56:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.918+0000 7f50caa00640 1 -- 172.21.15.84:0/4266027842 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c400fd20 con 0x563ed40b8390 2024-09-21T07:56:13.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.919+0000 7f50e8237740 1 -- 172.21.15.84:0/4266027842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 msgr2=0x563ed4485d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.919+0000 7f50e8237740 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4485d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f50c40117f0 tx=0x7f50c4004fa0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.920+0000 7f50e8237740 1 -- 172.21.15.84:0/4266027842 shutdown_connections 2024-09-21T07:56:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.920+0000 7f50e8237740 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40d9070 0x563ed4486240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.920+0000 7f50e8237740 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40b8390 0x563ed4485d00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.920+0000 7f50e8237740 1 --2- 172.21.15.84:0/4266027842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b01b0 0x563ed44786b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.920+0000 7f50e8237740 1 -- 172.21.15.84:0/4266027842 >> 172.21.15.84:0/4266027842 conn(0x563ed40cd460 msgr2=0x563ed4494b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.924+0000 7f50e8237740 1 -- 172.21.15.84:0/4266027842 shutdown_connections 2024-09-21T07:56:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.924+0000 7f50e8237740 1 -- 172.21.15.84:0/4266027842 wait complete. 2024-09-21T07:56:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.925+0000 7f50e8237740 1 -- start start 2024-09-21T07:56:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.925+0000 7f50e8237740 1 Processor -- start 2024-09-21T07:56:13.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.927+0000 7f50e8237740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44a9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.927+0000 7f50e8237740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b8390 0x563ed44a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.928+0000 7f50e8237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40d9070 0x563ed4509e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.928+0000 7f50db400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40d9070 0x563ed4509e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.928+0000 7f50e8237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1b8740 con 0x563ed40d9070 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.928+0000 7f50e8237740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1b8070 con 0x563ed40b8390 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.928+0000 7f50e8237740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1b5290 con 0x563ed40b01b0 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.928+0000 7f50e8237740 10 client.0 _ll_register_callbacks cb 0x7f50c40054b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.929+0000 7f50db400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40d9070 0x563ed4509e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49292/0 (socket says 172.21.15.84:49292) 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.929+0000 7f50db400640 1 -- 172.21.15.84:0/2104809800 learned_addr learned my addr 172.21.15.84:0/2104809800 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.929+0000 7f50daa00640 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.929+0000 7f50daa00640 1 -- 172.21.15.84:0/2104809800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b8390 msgr2=0x563ed44a9760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.929+0000 7f50daa00640 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b8390 0x563ed44a9760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.929+0000 7f50daa00640 1 -- 172.21.15.84:0/2104809800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40d9070 msgr2=0x563ed4509e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:13.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.930+0000 7f50daa00640 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40d9070 0x563ed4509e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.930+0000 7f50daa00640 1 -- 172.21.15.84:0/2104809800 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ed450a5f0 con 0x563ed40b01b0 2024-09-21T07:56:13.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.932+0000 7f50daa00640 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44a9220 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x563ed4496ba0 tx=0x7f50cc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7551a0b22ed58baf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:13.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.932+0000 7f50bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.932+0000 7f50bfe00640 1 -- 172.21.15.84:0/2104809800 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc010640 con 0x563ed40b01b0 2024-09-21T07:56:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.932+0000 7f50bfe00640 1 -- 172.21.15.84:0/2104809800 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f50cc0107e0 con 0x563ed40b01b0 2024-09-21T07:56:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.932+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50c4003790 con 0x563ed40b01b0 2024-09-21T07:56:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.933+0000 7f50bfe00640 1 -- 172.21.15.84:0/2104809800 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f50cc0109e0 con 0x563ed40b01b0 2024-09-21T07:56:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.933+0000 7f50e8237740 10 client.27019 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:13.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.933+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ed448ed60 con 0x563ed40b01b0 2024-09-21T07:56:13.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.934+0000 7f50bfe00640 1 -- 172.21.15.84:0/2104809800 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c4003790 con 0x563ed40b01b0 2024-09-21T07:56:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.939+0000 7f50bfe00640 1 -- 172.21.15.84:0/2104809800 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f50cc02f070 con 0x563ed40b01b0 2024-09-21T07:56:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.939+0000 7f50e8237740 10 client.27019 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.939+0000 7f50e8237740 10 client.27019 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:56:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.939+0000 7f50e8237740 20 client.27019 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.939+0000 7f50e8237740 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed406cda0 0x563ed4491500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.939+0000 7f50e8237740 4 client.27019 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:56:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.939+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ed43f49b0 con 0x563ed406cda0 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.940+0000 7f50d2000640 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed406cda0 0x563ed4491500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.940+0000 7f50d2000640 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed406cda0 0x563ed4491500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ef1c5bb2a148948 server_cookie=3774ec275ca5361a in_seq=0 out_seq=0 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.940+0000 7f50bfe00640 10 client.27019 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.941+0000 7f50bfe00640 1 -- 172.21.15.84:0/2104809800 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ed43f49b0 con 0x563ed406cda0 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.941+0000 7f50bfe00640 10 client.27019 handle_command_reply: tid=0 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.941+0000 7f50e8237740 1 client.27019 shutdown 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 msgr2=0x563ed44a9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44a9220 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x563ed4496ba0 tx=0x7f50cc005f90 comp rx=0 tx=0).stop 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 shutdown_connections 2024-09-21T07:56:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563ed406cda0 0x563ed4491500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ed40d9070 0x563ed4509e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ed40b8390 0x563ed44a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 --2- 172.21.15.84:0/2104809800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ed40b01b0 0x563ed44a9220 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50bfe00640 0 client.27019 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:56:13.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.943+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 >> 172.21.15.84:0/2104809800 conn(0x563ed40cd460 msgr2=0x563ed44858d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:13.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.946+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 shutdown_connections 2024-09-21T07:56:13.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.946+0000 7f50e8237740 1 -- 172.21.15.84:0/2104809800 wait complete. 2024-09-21T07:56:13.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.947+0000 7f50e8237740 20 client.27019 trim_cache size 0 max 16384 2024-09-21T07:56:13.949 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:56:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.948+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c00b6780 msgr2=0x7f50c00b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.948+0000 7f50e1600640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c00b6780 0x7f50c00b8c90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f50cc013780 tx=0x7f50cc0098f0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.948+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50dc116640 msgr2=0x7f50dc1a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:13.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.948+0000 7f50e1600640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50dc116640 0x7f50dc1a84b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50d4034040 tx=0x7f50d4003c10 comp rx=0 tx=0).stop 2024-09-21T07:56:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.950+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 shutdown_connections 2024-09-21T07:56:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.950+0000 7f50e1600640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f50c00b6780 0x7f50c00b8c90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.950+0000 7f50e1600640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50dc116640 0x7f50dc1a84b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.950+0000 7f50e1600640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc10aee0 0x7f50dc1a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.950+0000 7f50e1600640 1 --2- 172.21.15.84:0/3888970469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50dc10a590 0x7f50dc1a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.950+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 >> 172.21.15.84:0/3888970469 conn(0x7f50dc070ec0 msgr2=0x7f50dc0730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.951+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 shutdown_connections 2024-09-21T07:56:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:13.951+0000 7f50e1600640 1 -- 172.21.15.84:0/3888970469 wait complete. 2024-09-21T07:56:14.671 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:15.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:15 smithi162 ceph-mon[34833]: pgmap v548: 129 pgs: 129 active+clean; 33 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 46 KiB/s rd, 226 MiB/s wr, 1.39k op/s 2024-09-21T07:56:15.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:15 smithi084 ceph-mon[30411]: pgmap v548: 129 pgs: 129 active+clean; 33 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 46 KiB/s rd, 226 MiB/s wr, 1.39k op/s 2024-09-21T07:56:15.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:15 smithi191 ceph-mon[34667]: pgmap v548: 129 pgs: 129 active+clean; 33 GiB data, 69 GiB used, 1004 GiB / 1.0 TiB avail; 46 KiB/s rd, 226 MiB/s wr, 1.39k op/s 2024-09-21T07:56:17.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:56:17.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:17 smithi162 ceph-mon[34833]: pgmap v549: 129 pgs: 129 active+clean; 33 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 38 KiB/s rd, 209 MiB/s wr, 1.45k op/s 2024-09-21T07:56:17.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:17 smithi084 ceph-mon[30411]: pgmap v549: 129 pgs: 129 active+clean; 33 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 38 KiB/s rd, 209 MiB/s wr, 1.45k op/s 2024-09-21T07:56:17.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:17 smithi191 ceph-mon[34667]: pgmap v549: 129 pgs: 129 active+clean; 33 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 38 KiB/s rd, 209 MiB/s wr, 1.45k op/s 2024-09-21T07:56:19.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:19 smithi162 ceph-mon[34833]: pgmap v550: 129 pgs: 129 active+clean; 34 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 37 KiB/s rd, 212 MiB/s wr, 1.60k op/s 2024-09-21T07:56:19.813 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:19 smithi084 ceph-mon[30411]: pgmap v550: 129 pgs: 129 active+clean; 34 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 37 KiB/s rd, 212 MiB/s wr, 1.60k op/s 2024-09-21T07:56:19.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:19 smithi191 ceph-mon[34667]: pgmap v550: 129 pgs: 129 active+clean; 34 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 37 KiB/s rd, 212 MiB/s wr, 1.60k op/s 2024-09-21T07:56:21.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:21 smithi162 ceph-mon[34833]: pgmap v551: 129 pgs: 129 active+clean; 34 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 50 KiB/s rd, 208 MiB/s wr, 1.72k op/s 2024-09-21T07:56:21.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:21 smithi191 ceph-mon[34667]: pgmap v551: 129 pgs: 129 active+clean; 34 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 50 KiB/s rd, 208 MiB/s wr, 1.72k op/s 2024-09-21T07:56:21.944 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:21 smithi084 ceph-mon[30411]: pgmap v551: 129 pgs: 129 active+clean; 34 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 50 KiB/s rd, 208 MiB/s wr, 1.72k op/s 2024-09-21T07:56:22.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.644+0000 7f771b800640 1 -- 172.21.15.84:0/1905460542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7714115570 msgr2=0x7f7714117a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:22.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.644+0000 7f771b800640 1 --2- 172.21.15.84:0/1905460542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7714115570 0x7f7714117a80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f770c009ca0 tx=0x7f770c02a980 comp rx=0 tx=0).stop 2024-09-21T07:56:22.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.645+0000 7f771b800640 1 -- 172.21.15.84:0/1905460542 shutdown_connections 2024-09-21T07:56:22.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.648+0000 7f771b800640 1 --2- 172.21.15.84:0/1905460542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7714115570 0x7f7714117a80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.648+0000 7f771b800640 1 --2- 172.21.15.84:0/1905460542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f771410c940 0x7f7714114e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.648+0000 7f771b800640 1 --2- 172.21.15.84:0/1905460542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f771410bff0 0x7f771410c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.648+0000 7f771b800640 1 -- 172.21.15.84:0/1905460542 >> 172.21.15.84:0/1905460542 conn(0x7f7714070e80 msgr2=0x7f7714071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:22.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.649+0000 7f771b800640 1 -- 172.21.15.84:0/1905460542 shutdown_connections 2024-09-21T07:56:22.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.649+0000 7f771b800640 1 -- 172.21.15.84:0/1905460542 wait complete. 2024-09-21T07:56:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.652+0000 7f771b800640 1 Processor -- start 2024-09-21T07:56:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.653+0000 7f771b800640 1 -- start start 2024-09-21T07:56:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.654+0000 7f771b800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771410bff0 0x7f77141a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.654+0000 7f7718e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771410bff0 0x7f77141a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.654+0000 7f7718e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771410bff0 0x7f77141a2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46376/0 (socket says 172.21.15.84:46376) 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.654+0000 7f7718e00640 1 -- 172.21.15.84:0/1752663393 learned_addr learned my addr 172.21.15.84:0/1752663393 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.654+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f771410c940 0x7f77141a3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.655+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7714115570 0x7f77141a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.655+0000 7f7713e00640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f771410c940 0x7f77141a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.656+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f771411c300 con 0x7f7714115570 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.656+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f771411c180 con 0x7f771410bff0 2024-09-21T07:56:22.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.656+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f771411c480 con 0x7f771410c940 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.656+0000 7f7719800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7714115570 0x7f77141a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.658+0000 7f7719800640 1 -- 172.21.15.84:0/1752663393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f771410c940 msgr2=0x7f77141a3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.658+0000 7f7719800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f771410c940 0x7f77141a3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.658+0000 7f7719800640 1 -- 172.21.15.84:0/1752663393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771410bff0 msgr2=0x7f77141a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.658+0000 7f7719800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771410bff0 0x7f77141a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.658+0000 7f7719800640 1 -- 172.21.15.84:0/1752663393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77141a8c00 con 0x7f7714115570 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.659+0000 7f7713e00640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f771410c940 0x7f77141a3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:22.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.659+0000 7f7719800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7714115570 0x7f77141a84d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c030680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:22.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.665+0000 7f7711600640 1 -- 172.21.15.84:0/1752663393 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c034050 con 0x7f7714115570 2024-09-21T07:56:22.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.668+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77141a8e90 con 0x7f7714115570 2024-09-21T07:56:22.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.669+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141af650 con 0x7f7714115570 2024-09-21T07:56:22.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.668+0000 7f7711600640 1 -- 172.21.15.84:0/1752663393 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770c030b80 con 0x7f7714115570 2024-09-21T07:56:22.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.669+0000 7f7711600640 1 -- 172.21.15.84:0/1752663393 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c0427a0 con 0x7f7714115570 2024-09-21T07:56:22.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.682+0000 7f77224a3740 1 Processor -- start 2024-09-21T07:56:22.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.686+0000 7f7711600640 1 -- 172.21.15.84:0/1752663393 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f770c037020 con 0x7f7714115570 2024-09-21T07:56:22.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.687+0000 7f77224a3740 1 -- start start 2024-09-21T07:56:22.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.693+0000 7f77224a3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fa6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.694+0000 7f7713e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fa6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.694+0000 7f7713e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fa6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:46996/0 (socket says 172.21.15.84:46996) 2024-09-21T07:56:22.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.694+0000 7f7713e00640 1 -- 172.21.15.84:0/3332185772 learned_addr learned my addr 172.21.15.84:0/3332185772 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:22.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.695+0000 7f77224a3740 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fa6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.695+0000 7f77224a3740 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fa6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.695+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562eb5f1bca0 con 0x562eb5bd5980 2024-09-21T07:56:22.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.695+0000 7f7718e00640 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fa6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.696+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562eb5f0b0d0 con 0x562eb5bddb60 2024-09-21T07:56:22.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.696+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562eb5f0eee0 con 0x562eb5bfe840 2024-09-21T07:56:22.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.696+0000 7f7711600640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76fc0b6880 0x7f76fc0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.696+0000 7f7718e00640 1 -- 172.21.15.84:0/3332185772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 msgr2=0x562eb5fa6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.696+0000 7f7718e00640 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fa6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.697+0000 7f7718e00640 1 -- 172.21.15.84:0/3332185772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 msgr2=0x562eb5fa6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.697+0000 7f7718e00640 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fa6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.697+0000 7f7718e00640 1 -- 172.21.15.84:0/3332185772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb5ebd400 con 0x562eb5bd5980 2024-09-21T07:56:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.697+0000 7f7711600640 1 -- 172.21.15.84:0/1752663393 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f770c108700 con 0x7f7714115570 2024-09-21T07:56:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.697+0000 7f7719800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76fc0b6880 0x7f76fc0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.699+0000 7f7718e00640 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fa6890 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f77080058c0 tx=0x7f770800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dcc67af765163d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.704+0000 7f7706000640 1 -- 172.21.15.84:0/3332185772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708015070 con 0x562eb5bd5980 2024-09-21T07:56:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.706+0000 7f7719800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76fc0b6880 0x7f76fc0b8d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f770c0cdee0 tx=0x7f770c0d7040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.708+0000 7f7706000640 1 -- 172.21.15.84:0/3332185772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770801a910 con 0x562eb5bd5980 2024-09-21T07:56:22.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.709+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 msgr2=0x562eb5fa6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:22.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.709+0000 7f77224a3740 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fa6890 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f77080058c0 tx=0x7f770800f730 comp rx=0 tx=0).stop 2024-09-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.711+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 shutdown_connections 2024-09-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.711+0000 7f77224a3740 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fa6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.711+0000 7f77224a3740 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fa6890 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.711+0000 7f77224a3740 1 --2- 172.21.15.84:0/3332185772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fa6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.711+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 >> 172.21.15.84:0/3332185772 conn(0x562eb5bf2990 msgr2=0x562eb5fa4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.715+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 shutdown_connections 2024-09-21T07:56:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.716+0000 7f77224a3740 1 -- 172.21.15.84:0/3332185772 wait complete. 2024-09-21T07:56:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.717+0000 7f77224a3740 1 -- start start 2024-09-21T07:56:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.717+0000 7f77224a3740 1 Processor -- start 2024-09-21T07:56:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.720+0000 7f77224a3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bd5980 0x562eb5fb83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f77224a3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f77224a3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5fb1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f77224a3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562eb5d6c7a0 con 0x562eb5bfe840 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f77224a3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562eb5eb0a10 con 0x562eb5bddb60 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f77224a3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562eb5fb8eb0 con 0x562eb5bd5980 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f7713e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bd5980 0x562eb5fb83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f7713e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bd5980 0x562eb5fb83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47010/0 (socket says 172.21.15.84:47010) 2024-09-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f7713e00640 1 -- 172.21.15.84:0/65366138 learned_addr learned my addr 172.21.15.84:0/65366138 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.722+0000 7f7713e00640 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5fb1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.721+0000 7f77224a3740 10 client.0 _ll_register_callbacks cb 0x562eb5ec0be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.723+0000 7f7718e00640 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.727+0000 7f7713e00640 1 -- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 msgr2=0x562eb5fb1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.727+0000 7f7713e00640 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.727+0000 7f7713e00640 1 -- 172.21.15.84:0/65366138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 msgr2=0x562eb5fb1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.727+0000 7f7713e00640 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5fb1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.727+0000 7f7713e00640 1 -- 172.21.15.84:0/65366138 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eb5c78b90 con 0x562eb5bd5980 2024-09-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.728+0000 7f7713e00640 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bd5980 0x562eb5fb83e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7700016f30 tx=0x7f770000a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=850a064b162086b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.728+0000 7f76faa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:22.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.730+0000 7f76faa00640 1 -- 172.21.15.84:0/65366138 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77000145f0 con 0x562eb5bd5980 2024-09-21T07:56:22.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.730+0000 7f76faa00640 1 -- 172.21.15.84:0/65366138 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7700014790 con 0x562eb5bd5980 2024-09-21T07:56:22.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.730+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f770801a910 con 0x562eb5bd5980 2024-09-21T07:56:22.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.731+0000 7f76faa00640 1 -- 172.21.15.84:0/65366138 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7700014990 con 0x562eb5bd5980 2024-09-21T07:56:22.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.731+0000 7f77224a3740 10 client.27028 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:22.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.731+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562eb5fc90f0 con 0x562eb5bd5980 2024-09-21T07:56:22.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.731+0000 7f76faa00640 1 -- 172.21.15.84:0/65366138 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770801a910 con 0x562eb5bd5980 2024-09-21T07:56:22.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f76faa00640 1 -- 172.21.15.84:0/65366138 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7700015040 con 0x562eb5bd5980 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f77224a3740 10 client.27028 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f77224a3740 10 client.27028 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f77224a3740 20 client.27028 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f77224a3740 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5bbd1c0 0x562eb5fcc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f77224a3740 4 client.27028 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562eb5f1dbf0 con 0x562eb5bbd1c0 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.733+0000 7f7718e00640 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5bbd1c0 0x562eb5fcc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.734+0000 7f7718e00640 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5bbd1c0 0x562eb5fcc4c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58324309b6d6dff5 server_cookie=422b74675d253c6 in_seq=0 out_seq=0 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.734+0000 7f76faa00640 10 client.27028 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.735+0000 7f76faa00640 1 -- 172.21.15.84:0/65366138 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562eb5f1dbf0 con 0x562eb5bbd1c0 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.735+0000 7f76faa00640 10 client.27028 handle_command_reply: tid=0 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.735+0000 7f77224a3740 1 client.27028 shutdown 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.735+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bd5980 msgr2=0x562eb5fb83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.735+0000 7f77224a3740 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bd5980 0x562eb5fb83e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7700016f30 tx=0x7f770000a6f0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.737+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 shutdown_connections 2024-09-21T07:56:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.737+0000 7f77224a3740 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5fb1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.737+0000 7f77224a3740 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.737+0000 7f77224a3740 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5bbd1c0 0x562eb5fcc4c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.737+0000 7f77224a3740 1 --2- 172.21.15.84:0/65366138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bd5980 0x562eb5fb83e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.737+0000 7f76faa00640 0 client.27028 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.737+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 >> 172.21.15.84:0/65366138 conn(0x562eb5bf2990 msgr2=0x562eb5fa29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.741+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 shutdown_connections 2024-09-21T07:56:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.743+0000 7f77224a3740 1 -- 172.21.15.84:0/65366138 wait complete. 2024-09-21T07:56:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.743+0000 7f77224a3740 20 client.27028 trim_cache size 0 max 16384 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.783+0000 7f77224a3740 1 Processor -- start 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.784+0000 7f77224a3740 1 -- start start 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.784+0000 7f77224a3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bd5980 0x562eb5fa7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.784+0000 7f77224a3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bddb60 0x562eb5faea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.784+0000 7f77224a3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5faefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.784+0000 7f77224a3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76f400fc70 con 0x562eb5bfe840 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.784+0000 7f77224a3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76f40117b0 con 0x562eb5bd5980 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.784+0000 7f77224a3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4010340 con 0x562eb5bddb60 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.785+0000 7f7713e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5faefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.785+0000 7f7713e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bd5980 0x562eb5fa7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.785+0000 7f7713e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bd5980 0x562eb5fa7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46410/0 (socket says 172.21.15.84:46410) 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.785+0000 7f7713e00640 1 -- 172.21.15.84:0/1215388116 learned_addr learned my addr 172.21.15.84:0/1215388116 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.786+0000 7f7713e00640 1 -- 172.21.15.84:0/1215388116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bddb60 msgr2=0x562eb5faea80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.786+0000 7f7713e00640 1 --2- 172.21.15.84:0/1215388116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bddb60 0x562eb5faea80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.786+0000 7f7713e00640 1 -- 172.21.15.84:0/1215388116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 msgr2=0x562eb5faefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.786+0000 7f7713e00640 1 --2- 172.21.15.84:0/1215388116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5faefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.786+0000 7f7713e00640 1 -- 172.21.15.84:0/1215388116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb5f9fc50 con 0x562eb5bd5980 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.786+0000 7f7713e00640 1 --2- 172.21.15.84:0/1215388116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bd5980 0x562eb5fa7a90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f77000168a0 tx=0x7f770000aa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f6ad51d402de23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.790+0000 7f7705600640 1 -- 172.21.15.84:0/1215388116 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700011c40 con 0x562eb5bd5980 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.790+0000 7f7705600640 1 -- 172.21.15.84:0/1215388116 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770001d070 con 0x562eb5bd5980 2024-09-21T07:56:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.790+0000 7f7705600640 1 -- 172.21.15.84:0/1215388116 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700011790 con 0x562eb5bd5980 2024-09-21T07:56:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.793+0000 7f77224a3740 1 -- 172.21.15.84:0/1215388116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bd5980 msgr2=0x562eb5fa7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.793+0000 7f77224a3740 1 --2- 172.21.15.84:0/1215388116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bd5980 0x562eb5fa7a90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f77000168a0 tx=0x7f770000aa70 comp rx=0 tx=0).stop 2024-09-21T07:56:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.799+0000 7f77224a3740 1 -- 172.21.15.84:0/1215388116 shutdown_connections 2024-09-21T07:56:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.799+0000 7f77224a3740 1 --2- 172.21.15.84:0/1215388116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bfe840 0x562eb5faefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.799+0000 7f77224a3740 1 --2- 172.21.15.84:0/1215388116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bddb60 0x562eb5faea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.799+0000 7f77224a3740 1 --2- 172.21.15.84:0/1215388116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bd5980 0x562eb5fa7a90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.799+0000 7f77224a3740 1 -- 172.21.15.84:0/1215388116 >> 172.21.15.84:0/1215388116 conn(0x562eb5bf2990 msgr2=0x562eb5fa7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:22.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.800+0000 7f77224a3740 1 -- 172.21.15.84:0/1215388116 shutdown_connections 2024-09-21T07:56:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.800+0000 7f77224a3740 1 -- 172.21.15.84:0/1215388116 wait complete. 2024-09-21T07:56:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.801+0000 7f77224a3740 1 -- start start 2024-09-21T07:56:22.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.801+0000 7f77224a3740 1 Processor -- start 2024-09-21T07:56:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.809+0000 7f77224a3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fb93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.810+0000 7f77224a3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.810+0000 7f77224a3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fc4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.810+0000 7f77224a3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76f40110e0 con 0x562eb5bd5980 2024-09-21T07:56:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.810+0000 7f77224a3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4010a10 con 0x562eb5bddb60 2024-09-21T07:56:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.810+0000 7f77224a3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76f400dd00 con 0x562eb5bfe840 2024-09-21T07:56:22.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.810+0000 7f77224a3740 10 client.0 _ll_register_callbacks cb 0x7f770000ad90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:22.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.810+0000 7f7718e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7718e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46418/0 (socket says 172.21.15.84:46418) 2024-09-21T07:56:22.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7718e00640 1 -- 172.21.15.84:0/3635597827 learned_addr learned my addr 172.21.15.84:0/3635597827 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:22.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7713e00640 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fc4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7718e00640 1 -- 172.21.15.84:0/3635597827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 msgr2=0x562eb5fc4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7718e00640 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fc4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7718e00640 1 -- 172.21.15.84:0/3635597827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 msgr2=0x562eb5fb93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7718e00640 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fb93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.811+0000 7f7718e00640 1 -- 172.21.15.84:0/3635597827 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eb5fc47a0 con 0x562eb5bddb60 2024-09-21T07:56:22.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.816+0000 7f7713e00640 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fc4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:22.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.816+0000 7f76faa00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:56:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.816+0000 7f7718e00640 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb9920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x562eb5fa4fd0 tx=0x7f770800b580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f4511e26258ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.817+0000 7f76faa00640 1 -- 172.21.15.84:0/3635597827 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708030060 con 0x562eb5bddb60 2024-09-21T07:56:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.817+0000 7f76faa00640 1 -- 172.21.15.84:0/3635597827 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f7708004240 con 0x562eb5bddb60 2024-09-21T07:56:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.817+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f770001d070 con 0x562eb5bddb60 2024-09-21T07:56:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.818+0000 7f76faa00640 1 -- 172.21.15.84:0/3635597827 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7708037050 con 0x562eb5bddb60 2024-09-21T07:56:22.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.828+0000 7f77224a3740 10 client.27023 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:22.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.828+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562eb5fc5a40 con 0x562eb5bddb60 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.829+0000 7f76faa00640 1 -- 172.21.15.84:0/3635597827 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770001d070 con 0x562eb5bddb60 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.829+0000 7f76faa00640 1 -- 172.21.15.84:0/3635597827 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f770802a030 con 0x562eb5bddb60 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.829+0000 7f77224a3740 10 client.27023 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.829+0000 7f77224a3740 10 client.27023 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.829+0000 7f77224a3740 20 client.27023 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.829+0000 7f77224a3740 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5b92570 0x562eb5fc5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.830+0000 7f77224a3740 4 client.27023 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T07:56:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.830+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x562eb5f196a0 con 0x562eb5b92570 2024-09-21T07:56:22.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.834+0000 7f7713e00640 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5b92570 0x562eb5fc5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:22.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.834+0000 7f7713e00640 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5b92570 0x562eb5fc5f90 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf62df7c2b2b644 server_cookie=fb7207d488fbd4fb in_seq=0 out_seq=0 2024-09-21T07:56:22.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:22.834+0000 7f76faa00640 10 client.27023 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:23.499 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:23.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:23 smithi162 ceph-mon[34833]: pgmap v552: 129 pgs: 129 active+clean; 34 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 41 KiB/s rd, 219 MiB/s wr, 1.88k op/s 2024-09-21T07:56:23.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:23 smithi084 ceph-mon[30411]: pgmap v552: 129 pgs: 129 active+clean; 34 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 41 KiB/s rd, 219 MiB/s wr, 1.88k op/s 2024-09-21T07:56:23.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:23 smithi191 ceph-mon[34667]: pgmap v552: 129 pgs: 129 active+clean; 34 GiB data, 71 GiB used, 1002 GiB / 1.0 TiB avail; 41 KiB/s rd, 219 MiB/s wr, 1.88k op/s 2024-09-21T07:56:24.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:24 smithi162 ceph-mon[34833]: pgmap v553: 129 pgs: 129 active+clean; 34 GiB data, 71 GiB used, 1001 GiB / 1.0 TiB avail; 49 KiB/s rd, 225 MiB/s wr, 1.97k op/s 2024-09-21T07:56:24.813 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:24 smithi084 ceph-mon[30411]: pgmap v553: 129 pgs: 129 active+clean; 34 GiB data, 71 GiB used, 1001 GiB / 1.0 TiB avail; 49 KiB/s rd, 225 MiB/s wr, 1.97k op/s 2024-09-21T07:56:24.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:24 smithi191 ceph-mon[34667]: pgmap v553: 129 pgs: 129 active+clean; 34 GiB data, 71 GiB used, 1001 GiB / 1.0 TiB avail; 49 KiB/s rd, 225 MiB/s wr, 1.97k op/s 2024-09-21T07:56:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.993+0000 7f76faa00640 1 -- 172.21.15.84:0/3635597827 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562eb5f196a0 con 0x562eb5b92570 2024-09-21T07:56:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.993+0000 7f76faa00640 10 client.27023 handle_command_reply: tid=0 2024-09-21T07:56:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.993+0000 7f77224a3740 1 client.27023 shutdown 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 msgr2=0x562eb5fb9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb9920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x562eb5fa4fd0 tx=0x7f770800b580 comp rx=0 tx=0).stop 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 shutdown_connections 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562eb5b92570 0x562eb5fc5f90 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562eb5bfe840 0x562eb5fc4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562eb5bddb60 0x562eb5fb9920 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 --2- 172.21.15.84:0/3635597827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562eb5bd5980 0x562eb5fb93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.994+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 >> 172.21.15.84:0/3635597827 conn(0x562eb5bf2990 msgr2=0x562eb5fa29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.995+0000 7f76faa00640 0 client.27023 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.995+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 shutdown_connections 2024-09-21T07:56:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.996+0000 7f77224a3740 1 -- 172.21.15.84:0/3635597827 wait complete. 2024-09-21T07:56:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.996+0000 7f77224a3740 20 client.27023 trim_cache size 0 max 16384 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 18, 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "654cf922": { 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 18, 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:24.999 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 130.0, 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:25.000 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.997+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76fc0b6880 msgr2=0x7f76fc0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.997+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76fc0b6880 0x7f76fc0b8d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f770c0cdee0 tx=0x7f770c0d7040 comp rx=0 tx=0).stop 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.997+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7714115570 msgr2=0x7f77141a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.997+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7714115570 0x7f77141a84d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f770c009bf0 tx=0x7f770c030680 comp rx=0 tx=0).stop 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.998+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 shutdown_connections 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.998+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f76fc0b6880 0x7f76fc0b8d90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.998+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7714115570 0x7f77141a84d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.998+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f771410c940 0x7f77141a3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.998+0000 7f771b800640 1 --2- 172.21.15.84:0/1752663393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771410bff0 0x7f77141a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.998+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 >> 172.21.15.84:0/1752663393 conn(0x7f7714070e80 msgr2=0x7f7714116ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.998+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 shutdown_connections 2024-09-21T07:56:25.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:24.999+0000 7f771b800640 1 -- 172.21.15.84:0/1752663393 wait complete. 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.934+0000 7f193d800640 1 -- 172.21.15.84:0/1763171276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19381079f0 msgr2=0x7f1938107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.934+0000 7f193d800640 1 --2- 172.21.15.84:0/1763171276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19381079f0 0x7f1938107e60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1930009be0 tx=0x7f193002a6c0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.935+0000 7f193d800640 1 -- 172.21.15.84:0/1763171276 shutdown_connections 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.935+0000 7f193d800640 1 --2- 172.21.15.84:0/1763171276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19381079f0 0x7f1938107e60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.935+0000 7f193d800640 1 --2- 172.21.15.84:0/1763171276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1938102e80 0x7f19381073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.935+0000 7f193d800640 1 --2- 172.21.15.84:0/1763171276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1938102530 0x7f1938102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.935+0000 7f193d800640 1 -- 172.21.15.84:0/1763171276 >> 172.21.15.84:0/1763171276 conn(0x7f19380fe230 msgr2=0x7f1938100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.935+0000 7f193d800640 1 -- 172.21.15.84:0/1763171276 shutdown_connections 2024-09-21T07:56:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.935+0000 7f193d800640 1 -- 172.21.15.84:0/1763171276 wait complete. 2024-09-21T07:56:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.936+0000 7f193d800640 1 Processor -- start 2024-09-21T07:56:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.938+0000 7f193d800640 1 -- start start 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.938+0000 7f193d800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1938102530 0x7f19381a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.938+0000 7f193d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1938102e80 0x7f19381a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.938+0000 7f193d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19381079f0 0x7f19381a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f193d800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1938119e30 con 0x7f19381079f0 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f193d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1938119cb0 con 0x7f1938102e80 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1938102530 0x7f19381a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1938102530 0x7f19381a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47028/0 (socket says 172.21.15.84:47028) 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 -- 172.21.15.84:0/3908832328 learned_addr learned my addr 172.21.15.84:0/3908832328 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1938102e80 0x7f19381a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1938119fb0 con 0x7f1938102530 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f193ce00640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19381079f0 0x7f19381a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 -- 172.21.15.84:0/3908832328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1938102e80 msgr2=0x7f19381a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1938102e80 0x7f19381a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 -- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19381079f0 msgr2=0x7f19381a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19381079f0 0x7f19381a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f1937e00640 1 -- 172.21.15.84:0/3908832328 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19381a6760 con 0x7f1938102530 2024-09-21T07:56:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.939+0000 7f193ce00640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19381079f0 0x7f19381a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.940+0000 7f1937e00640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1938102530 0x7f19381a0830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9c0 tx=0x7f192800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.940+0000 7f1934c00640 1 -- 172.21.15.84:0/3908832328 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192800cde0 con 0x7f1938102530 2024-09-21T07:56:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.940+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19381a6a50 con 0x7f1938102530 2024-09-21T07:56:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.940+0000 7f1934c00640 1 -- 172.21.15.84:0/3908832328 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19280035f0 con 0x7f1938102530 2024-09-21T07:56:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.940+0000 7f1934c00640 1 -- 172.21.15.84:0/3908832328 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928010690 con 0x7f1938102530 2024-09-21T07:56:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.940+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19381ad1e0 con 0x7f1938102530 2024-09-21T07:56:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 Processor -- start 2024-09-21T07:56:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 -- start start 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02b12e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b13350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b13890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a02a886b0 con 0x557a0276e1b0 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a02a77ae0 con 0x557a027452f0 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.944+0000 7f1945e6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557a02a7b8f0 con 0x557a0274d4d0 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b13890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f193ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02b12e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b13890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47044/0 (socket says 172.21.15.84:47044) 2024-09-21T07:56:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 -- 172.21.15.84:0/1159445050 learned_addr learned my addr 172.21.15.84:0/1159445050 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 -- 172.21.15.84:0/1159445050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 msgr2=0x557a02b13350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 --2- 172.21.15.84:0/1159445050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b13350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 -- 172.21.15.84:0/1159445050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 msgr2=0x557a02b12e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 --2- 172.21.15.84:0/1159445050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02b12e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.945+0000 7f1937400640 1 -- 172.21.15.84:0/1159445050 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a02a44780 con 0x557a0274d4d0 2024-09-21T07:56:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.946+0000 7f1937400640 1 --2- 172.21.15.84:0/1159445050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b13890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1924009c50 tx=0x7f1924011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2ded5d51bd9896b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.946+0000 7f1934c00640 1 -- 172.21.15.84:0/3908832328 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f1928004000 con 0x7f1938102530 2024-09-21T07:56:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.946+0000 7f192d600640 1 -- 172.21.15.84:0/1159445050 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924004230 con 0x557a0274d4d0 2024-09-21T07:56:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.946+0000 7f192d600640 1 -- 172.21.15.84:0/1159445050 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19240043d0 con 0x557a0274d4d0 2024-09-21T07:56:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.946+0000 7f192d600640 1 -- 172.21.15.84:0/1159445050 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924004d90 con 0x557a0274d4d0 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.948+0000 7f1945e6c740 1 -- 172.21.15.84:0/1159445050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 msgr2=0x557a02b13890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.948+0000 7f1945e6c740 1 --2- 172.21.15.84:0/1159445050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b13890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1924009c50 tx=0x7f1924011810 comp rx=0 tx=0).stop 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1945e6c740 1 -- 172.21.15.84:0/1159445050 shutdown_connections 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1945e6c740 1 --2- 172.21.15.84:0/1159445050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b13890 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1945e6c740 1 --2- 172.21.15.84:0/1159445050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b13350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1945e6c740 1 --2- 172.21.15.84:0/1159445050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02b12e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1945e6c740 1 -- 172.21.15.84:0/1159445050 >> 172.21.15.84:0/1159445050 conn(0x557a02762300 msgr2=0x557a02b10d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1945e6c740 1 -- 172.21.15.84:0/1159445050 shutdown_connections 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1945e6c740 1 -- 172.21.15.84:0/1159445050 wait complete. 2024-09-21T07:56:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.949+0000 7f1934c00640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f191c0b6690 0x7f191c0b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.950+0000 7f1934c00640 1 -- 172.21.15.84:0/3908832328 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f19280e7de0 con 0x7f1938102530 2024-09-21T07:56:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.950+0000 7f1945e6c740 1 -- start start 2024-09-21T07:56:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.950+0000 7f1945e6c740 1 Processor -- start 2024-09-21T07:56:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.950+0000 7f1937400640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f191c0b6690 0x7f191c0b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.951+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a027452f0 0x557a02b1e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.951+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b1e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.951+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0276e1b0 0x557a02b1ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.951+0000 7f1945e6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a029afab0 con 0x557a027452f0 2024-09-21T07:56:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.951+0000 7f1945e6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557a02a1e570 con 0x557a0276e1b0 2024-09-21T07:56:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.951+0000 7f1945e6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557a02b21590 con 0x557a0274d4d0 2024-09-21T07:56:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.951+0000 7f1945e6c740 10 client.0 _ll_register_callbacks cb 0x557a02a2d100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.952+0000 7f1937e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a027452f0 0x557a02b1e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.952+0000 7f1937e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a027452f0 0x557a02b1e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44824/0 (socket says 172.21.15.84:44824) 2024-09-21T07:56:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.952+0000 7f1937e00640 1 -- 172.21.15.84:0/83868859 learned_addr learned my addr 172.21.15.84:0/83868859 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.952+0000 7f193ce00640 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0276e1b0 0x557a02b1ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.953+0000 7f1937400640 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b1e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.953+0000 7f1937400640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f191c0b6690 0x7f191c0b8ba0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f19240048d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.954+0000 7f1937400640 1 -- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0276e1b0 msgr2=0x557a02b1ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.954+0000 7f1937400640 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0276e1b0 0x557a02b1ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.954+0000 7f1937400640 1 -- 172.21.15.84:0/83868859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a027452f0 msgr2=0x557a02b1e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.954+0000 7f1937400640 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a027452f0 0x557a02b1e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.954+0000 7f1937400640 1 -- 172.21.15.84:0/83868859 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a027d9790 con 0x557a0274d4d0 2024-09-21T07:56:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1937400640 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b1e9a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1924009c50 tx=0x7f1924011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daff08ad4f2cbbc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1922000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1922000640 1 -- 172.21.15.84:0/83868859 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924034020 con 0x557a0274d4d0 2024-09-21T07:56:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19240043d0 con 0x557a0274d4d0 2024-09-21T07:56:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1922000640 1 -- 172.21.15.84:0/83868859 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f19240308f0 con 0x557a0274d4d0 2024-09-21T07:56:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1922000640 1 -- 172.21.15.84:0/83868859 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f192403f050 con 0x557a0274d4d0 2024-09-21T07:56:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1945e6c740 10 client.27043 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.955+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a02852620 con 0x557a0274d4d0 2024-09-21T07:56:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1922000640 1 -- 172.21.15.84:0/83868859 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19240043d0 con 0x557a0274d4d0 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1922000640 1 -- 172.21.15.84:0/83868859 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1924018070 con 0x557a0274d4d0 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1945e6c740 10 client.27043 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1945e6c740 10 client.27043 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1945e6c740 20 client.27043 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1945e6c740 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a0272cd80 0x557a02b41540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1945e6c740 4 client.27043 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.956+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a02a8a600 con 0x557a0272cd80 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.957+0000 7f1937e00640 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a0272cd80 0x557a02b41540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.957+0000 7f1937e00640 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a0272cd80 0x557a02b41540 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12652ec2182d1e99 server_cookie=9bc3763d0c03cff3 in_seq=0 out_seq=0 2024-09-21T07:56:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.957+0000 7f1922000640 10 client.27043 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.958+0000 7f1922000640 1 -- 172.21.15.84:0/83868859 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a02a8a600 con 0x557a0272cd80 2024-09-21T07:56:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.958+0000 7f1922000640 10 client.27043 handle_command_reply: tid=0 2024-09-21T07:56:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.958+0000 7f1945e6c740 1 client.27043 shutdown 2024-09-21T07:56:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.958+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 msgr2=0x557a02b1e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.958+0000 7f1945e6c740 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b1e9a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1924009c50 tx=0x7f1924011810 comp rx=0 tx=0).stop 2024-09-21T07:56:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 shutdown_connections 2024-09-21T07:56:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0276e1b0 0x557a02b1ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a0272cd80 0x557a02b41540 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0274d4d0 0x557a02b1e9a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 --2- 172.21.15.84:0/83868859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a027452f0 0x557a02b1e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 >> 172.21.15.84:0/83868859 conn(0x557a02762300 msgr2=0x557a02b13e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1922000640 0 client.27043 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 shutdown_connections 2024-09-21T07:56:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 1 -- 172.21.15.84:0/83868859 wait complete. 2024-09-21T07:56:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.959+0000 7f1945e6c740 20 client.27043 trim_cache size 0 max 16384 2024-09-21T07:56:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 Processor -- start 2024-09-21T07:56:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 -- start start 2024-09-21T07:56:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b20090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0274d4d0 0x557a02b46c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0276e1b0 0x557a02b47160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19381ae8f0 con 0x557a0274d4d0 2024-09-21T07:56:26.984 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19381b0430 con 0x557a027452f0 2024-09-21T07:56:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.982+0000 7f1945e6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f19381aefc0 con 0x557a0276e1b0 2024-09-21T07:56:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b20090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0274d4d0 0x557a02b46c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b20090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46466/0 (socket says 172.21.15.84:46466) 2024-09-21T07:56:26.985 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 -- 172.21.15.84:0/3063121101 learned_addr learned my addr 172.21.15.84:0/3063121101 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 -- 172.21.15.84:0/3063121101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0276e1b0 msgr2=0x557a02b47160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 --2- 172.21.15.84:0/3063121101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0276e1b0 0x557a02b47160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 -- 172.21.15.84:0/3063121101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0274d4d0 msgr2=0x557a02b46c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 --2- 172.21.15.84:0/3063121101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0274d4d0 0x557a02b46c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 -- 172.21.15.84:0/3063121101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0272cfb0 con 0x557a027452f0 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.983+0000 7f1937e00640 1 --2- 172.21.15.84:0/3063121101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b20090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19280ad850 tx=0x7f1928005c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8682a156ba543c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.984+0000 7f192cc00640 1 -- 172.21.15.84:0/3063121101 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280042f0 con 0x557a027452f0 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.984+0000 7f192cc00640 1 -- 172.21.15.84:0/3063121101 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19280ad3d0 con 0x557a027452f0 2024-09-21T07:56:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.984+0000 7f192cc00640 1 -- 172.21.15.84:0/3063121101 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280ad690 con 0x557a027452f0 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 -- 172.21.15.84:0/3063121101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 msgr2=0x557a02b20090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 --2- 172.21.15.84:0/3063121101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b20090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19280ad850 tx=0x7f1928005c80 comp rx=0 tx=0).stop 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 -- 172.21.15.84:0/3063121101 shutdown_connections 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 --2- 172.21.15.84:0/3063121101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a0276e1b0 0x557a02b47160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 --2- 172.21.15.84:0/3063121101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0274d4d0 0x557a02b46c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 --2- 172.21.15.84:0/3063121101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a027452f0 0x557a02b20090 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 -- 172.21.15.84:0/3063121101 >> 172.21.15.84:0/3063121101 conn(0x557a02762300 msgr2=0x557a02b1f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:26.987 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.985+0000 7f1945e6c740 1 -- 172.21.15.84:0/3063121101 shutdown_connections 2024-09-21T07:56:26.988 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.986+0000 7f1945e6c740 1 -- 172.21.15.84:0/3063121101 wait complete. 2024-09-21T07:56:26.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.987+0000 7f1945e6c740 1 -- start start 2024-09-21T07:56:26.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.987+0000 7f1945e6c740 1 Processor -- start 2024-09-21T07:56:26.989 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a027452f0 0x557a02b23b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0274d4d0 0x557a02b240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1945e6c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02ba9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1945e6c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19381afd60 con 0x557a0276e1b0 2024-09-21T07:56:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1945e6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19381af690 con 0x557a0274d4d0 2024-09-21T07:56:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1945e6c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f19381073a0 con 0x557a027452f0 2024-09-21T07:56:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1945e6c740 10 client.0 _ll_register_callbacks cb 0x7f1930034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1937400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0274d4d0 0x557a02b240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f193ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02ba9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f1937e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a027452f0 0x557a02b23b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f193ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02ba9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44850/0 (socket says 172.21.15.84:44850) 2024-09-21T07:56:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.988+0000 7f193ce00640 1 -- 172.21.15.84:0/234766172 learned_addr learned my addr 172.21.15.84:0/234766172 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f1937e00640 1 -- 172.21.15.84:0/234766172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0274d4d0 msgr2=0x557a02b240b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f1937e00640 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0274d4d0 0x557a02b240b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f1937e00640 1 -- 172.21.15.84:0/234766172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 msgr2=0x557a02ba9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f1937e00640 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02ba9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f1937e00640 1 -- 172.21.15.84:0/234766172 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a02baa360 con 0x557a027452f0 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f193ce00640 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02ba9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f1937e00640 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a027452f0 0x557a02b23b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f19280a9e90 tx=0x7f1928003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=110479a3b58a26de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.989+0000 7f1922000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1922000640 1 -- 172.21.15.84:0/234766172 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280c8060 con 0x557a027452f0 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1922000640 1 -- 172.21.15.84:0/234766172 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f19280a9b30 con 0x557a027452f0 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19280ad3d0 con 0x557a027452f0 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1922000640 1 -- 172.21.15.84:0/234766172 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f19280b72e0 con 0x557a027452f0 2024-09-21T07:56:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1945e6c740 10 client.27046 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a02bab460 con 0x557a027452f0 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1922000640 1 -- 172.21.15.84:0/234766172 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19280ad3d0 con 0x557a027452f0 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1922000640 1 -- 172.21.15.84:0/234766172 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f19280ac590 con 0x557a027452f0 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1945e6c740 10 client.27046 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1945e6c740 10 client.27046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.990+0000 7f1945e6c740 20 client.27046 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.991+0000 7f1945e6c740 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a027021c0 0x557a02badb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.991+0000 7f1945e6c740 4 client.27046 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.991+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a02a860b0 con 0x557a027021c0 2024-09-21T07:56:26.994 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.991+0000 7f1937400640 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a027021c0 0x557a02badb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:26.995 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.991+0000 7f1937400640 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a027021c0 0x557a02badb20 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9e83ed3954c361d server_cookie=89f02f23478ee226 in_seq=0 out_seq=0 2024-09-21T07:56:26.995 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:26.991+0000 7f1922000640 10 client.27046 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1922000640 1 -- 172.21.15.84:0/234766172 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a02a860b0 con 0x557a027021c0 2024-09-21T07:56:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1922000640 10 client.27046 handle_command_reply: tid=0 2024-09-21T07:56:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 client.27046 shutdown 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a027452f0 msgr2=0x557a02b23b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a027452f0 0x557a02b23b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f19280a9e90 tx=0x7f1928003cd0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 shutdown_connections 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a0276e1b0 0x557a02ba9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557a0274d4d0 0x557a02b240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557a027021c0 0x557a02badb20 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.005+0000 7f1945e6c740 1 --2- 172.21.15.84:0/234766172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a027452f0 0x557a02b23b70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.006+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 >> 172.21.15.84:0/234766172 conn(0x557a02762300 msgr2=0x557a02b13e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.006+0000 7f1922000640 0 client.27046 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.006+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 shutdown_connections 2024-09-21T07:56:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.006+0000 7f1945e6c740 1 -- 172.21.15.84:0/234766172 wait complete. 2024-09-21T07:56:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.006+0000 7f1945e6c740 20 client.27046 trim_cache size 0 max 16384 2024-09-21T07:56:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:56:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:56:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:56:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:56:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f191c0b6690 msgr2=0x7f191c0b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f191c0b6690 0x7f191c0b8ba0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f19240048d0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1938102530 msgr2=0x7f19381a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1938102530 0x7f19381a0830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9c0 tx=0x7f192800ee80 comp rx=0 tx=0).stop 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 shutdown_connections 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f191c0b6690 0x7f191c0b8ba0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19381079f0 0x7f19381a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1938102e80 0x7f19381a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 --2- 172.21.15.84:0/3908832328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1938102530 0x7f19381a0830 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.008+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 >> 172.21.15.84:0/3908832328 conn(0x7f19380fe230 msgr2=0x7f1938105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.010+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 shutdown_connections 2024-09-21T07:56:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:27.010+0000 7f193d800640 1 -- 172.21.15.84:0/3908832328 wait complete. 2024-09-21T07:56:27.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:27 smithi191 ceph-mon[34667]: pgmap v554: 129 pgs: 129 active+clean; 35 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 26 KiB/s rd, 211 MiB/s wr, 1.82k op/s 2024-09-21T07:56:27.692 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:27 smithi084 ceph-mon[30411]: pgmap v554: 129 pgs: 129 active+clean; 35 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 26 KiB/s rd, 211 MiB/s wr, 1.82k op/s 2024-09-21T07:56:27.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:27 smithi162 ceph-mon[34833]: pgmap v554: 129 pgs: 129 active+clean; 35 GiB data, 72 GiB used, 1001 GiB / 1.0 TiB avail; 26 KiB/s rd, 211 MiB/s wr, 1.82k op/s 2024-09-21T07:56:29.256 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '654cf922', quiesce took 28.4 seconds. Will release after: -18.4 2024-09-21T07:56:29.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:56:29.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:29 smithi084 ceph-mon[30411]: pgmap v555: 129 pgs: 129 active+clean; 35 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 25 KiB/s rd, 208 MiB/s wr, 1.75k op/s 2024-09-21T07:56:29.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:29 smithi191 ceph-mon[34667]: pgmap v555: 129 pgs: 129 active+clean; 35 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 25 KiB/s rd, 208 MiB/s wr, 1.75k op/s 2024-09-21T07:56:29.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.702+0000 7f9878a00640 1 -- 172.21.15.84:0/2809114247 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c031810 con 0x7f987c11cba0 2024-09-21T07:56:29.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.704+0000 7f987b200640 1 -- 172.21.15.84:0/2809114247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c11cba0 msgr2=0x7f987c11efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.704+0000 7f987b200640 1 --2- 172.21.15.84:0/2809114247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c11cba0 0x7f987c11efc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f986c009900 tx=0x7f986c02a440 comp rx=0 tx=0).stop 2024-09-21T07:56:29.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.711+0000 7f987b200640 1 -- 172.21.15.84:0/2809114247 shutdown_connections 2024-09-21T07:56:29.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.711+0000 7f987b200640 1 --2- 172.21.15.84:0/2809114247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c11cba0 0x7f987c11efc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.711+0000 7f987b200640 1 --2- 172.21.15.84:0/2809114247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f987c10dbf0 0x7f987c10e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.711+0000 7f987b200640 1 --2- 172.21.15.84:0/2809114247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f987c111cd0 0x7f987c10d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.711+0000 7f987b200640 1 -- 172.21.15.84:0/2809114247 >> 172.21.15.84:0/2809114247 conn(0x7f987c06e9f0 msgr2=0x7f987c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:29.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.712+0000 7f987b200640 1 -- 172.21.15.84:0/2809114247 shutdown_connections 2024-09-21T07:56:29.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.714+0000 7f987b200640 1 -- 172.21.15.84:0/2809114247 wait complete. 2024-09-21T07:56:29.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.716+0000 7f987b200640 1 Processor -- start 2024-09-21T07:56:29.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.717+0000 7f987b200640 1 -- start start 2024-09-21T07:56:29.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.718+0000 7f987b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f987c10dbf0 0x7f987c11b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.722+0000 7f987b200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c111cd0 0x7f987c114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.722+0000 7f987b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f987c11cba0 0x7f987c114ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.723+0000 7f9879e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f987c10dbf0 0x7f987c11b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.723+0000 7f9879e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f987c10dbf0 0x7f987c11b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46736/0 (socket says 172.21.15.84:46736) 2024-09-21T07:56:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.724+0000 7f9879400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c111cd0 0x7f987c114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.724+0000 7f9879400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c111cd0 0x7f987c114660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37534/0 (socket says 172.21.15.84:37534) 2024-09-21T07:56:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.726+0000 7f987b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f987c122810 con 0x7f987c11cba0 2024-09-21T07:56:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.726+0000 7f987b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f987c122690 con 0x7f987c10dbf0 2024-09-21T07:56:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.726+0000 7f987b200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f987c122990 con 0x7f987c111cd0 2024-09-21T07:56:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.727+0000 7f987a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f987c11cba0 0x7f987c114ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.727+0000 7f987a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f987c11cba0 0x7f987c114ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47814/0 (socket says 172.21.15.84:47814) 2024-09-21T07:56:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.727+0000 7f987a800640 1 -- 172.21.15.84:0/902538390 learned_addr learned my addr 172.21.15.84:0/902538390 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.729+0000 7f9879400640 1 -- 172.21.15.84:0/902538390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f987c10dbf0 msgr2=0x7f987c11b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.729+0000 7f9879400640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f987c10dbf0 0x7f987c11b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.729+0000 7f9879400640 1 -- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f987c11cba0 msgr2=0x7f987c114ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.729+0000 7f9879400640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f987c11cba0 0x7f987c114ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.729+0000 7f9879400640 1 -- 172.21.15.84:0/902538390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c115370 con 0x7f987c111cd0 2024-09-21T07:56:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.731+0000 7f9879400640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c111cd0 0x7f987c114660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f987c06c910 tx=0x7f986800b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.732+0000 7f9872a00640 1 -- 172.21.15.84:0/902538390 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868015020 con 0x7f987c111cd0 2024-09-21T07:56:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.732+0000 7f9872a00640 1 -- 172.21.15.84:0/902538390 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9868011ce0 con 0x7f987c111cd0 2024-09-21T07:56:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.732+0000 7f9872a00640 1 -- 172.21.15.84:0/902538390 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868010da0 con 0x7f987c111cd0 2024-09-21T07:56:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.732+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c11a000 con 0x7f987c111cd0 2024-09-21T07:56:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.732+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c11a570 con 0x7f987c111cd0 2024-09-21T07:56:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.740+0000 7f98879bb740 1 Processor -- start 2024-09-21T07:56:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.743+0000 7f98879bb740 1 -- start start 2024-09-21T07:56:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.743+0000 7f98879bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f98879bb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169aafd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f987a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f987a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46750/0 (socket says 172.21.15.84:46750) 2024-09-21T07:56:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f987a800640 1 -- 172.21.15.84:0/3229916393 learned_addr learned my addr 172.21.15.84:0/3229916393 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f98879bb740 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169aafd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56169aa73fb0 con 0x56169a735390 2024-09-21T07:56:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56169aa633e0 con 0x56169a756070 2024-09-21T07:56:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.745+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56169aa671f0 con 0x56169a72d1b0 2024-09-21T07:56:29.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.747+0000 7f9879e00640 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169aafd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.747+0000 7f987a800640 1 -- 172.21.15.84:0/3229916393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 msgr2=0x56169aafd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.747+0000 7f987a800640 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169aafd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.747+0000 7f987a800640 1 -- 172.21.15.84:0/3229916393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 msgr2=0x56169aafd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.747+0000 7f987a800640 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169aafd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.748+0000 7f987a800640 1 -- 172.21.15.84:0/3229916393 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169aa2dcd0 con 0x56169a756070 2024-09-21T07:56:29.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.748+0000 7f9879e00640 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169aafd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:29.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.750+0000 7f9872a00640 1 -- 172.21.15.84:0/902538390 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9868018020 con 0x7f987c111cd0 2024-09-21T07:56:29.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.757+0000 7f987a800640 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafcf70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f986c0043a0 tx=0x7f986c0043d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c314e29493fed505 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:29.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.758+0000 7f9867000640 1 -- 172.21.15.84:0/3229916393 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c035030 con 0x56169a756070 2024-09-21T07:56:29.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.758+0000 7f9867000640 1 -- 172.21.15.84:0/3229916393 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f986c040070 con 0x56169a756070 2024-09-21T07:56:29.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.758+0000 7f9867000640 1 -- 172.21.15.84:0/3229916393 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c045c70 con 0x56169a756070 2024-09-21T07:56:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.761+0000 7f9872a00640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98600b67b0 0x7f98600b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.762+0000 7f9872a00640 1 -- 172.21.15.84:0/902538390 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f98680e70c0 con 0x7f987c111cd0 2024-09-21T07:56:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.764+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 msgr2=0x56169aafcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.764+0000 7f98879bb740 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafcf70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f986c0043a0 tx=0x7f986c0043d0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.766+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 shutdown_connections 2024-09-21T07:56:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.766+0000 7f98879bb740 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169aafd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.766+0000 7f98879bb740 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169aafd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.766+0000 7f98879bb740 1 --2- 172.21.15.84:0/3229916393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafcf70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.767+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 >> 172.21.15.84:0/3229916393 conn(0x56169a74a460 msgr2=0x56169aafae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.767+0000 7f9879e00640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98600b67b0 0x7f98600b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.767+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 shutdown_connections 2024-09-21T07:56:29.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.768+0000 7f98879bb740 1 -- 172.21.15.84:0/3229916393 wait complete. 2024-09-21T07:56:29.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.769+0000 7f98879bb740 1 -- start start 2024-09-21T07:56:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.770+0000 7f98879bb740 1 Processor -- start 2024-09-21T07:56:29.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.773+0000 7f9879e00640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98600b67b0 0x7f98600b8cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56169aafbbf0 tx=0x7f98740096d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.773+0000 7f98879bb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169ab087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.774+0000 7f98879bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab08d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.774+0000 7f9879e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169ab087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.774+0000 7f9879e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169ab087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37558/0 (socket says 172.21.15.84:37558) 2024-09-21T07:56:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.775+0000 7f9879400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab08d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.775+0000 7f9879400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab08d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47828/0 (socket says 172.21.15.84:47828) 2024-09-21T07:56:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.775+0000 7f9879e00640 1 -- 172.21.15.84:0/1564486287 learned_addr learned my addr 172.21.15.84:0/1564486287 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:29.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.775+0000 7f98879bb740 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab149e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.776+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56169a8c4700 con 0x56169a735390 2024-09-21T07:56:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.776+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56169a9fe580 con 0x56169a756070 2024-09-21T07:56:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.777+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56169ab0b6f0 con 0x56169a72d1b0 2024-09-21T07:56:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.778+0000 7f98879bb740 10 client.0 _ll_register_callbacks cb 0x56169aa0e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.778+0000 7f9879e00640 1 -- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 msgr2=0x56169ab149e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.777+0000 7f987a800640 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.778+0000 7f9879e00640 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab149e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.778+0000 7f9879e00640 1 -- 172.21.15.84:0/1564486287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 msgr2=0x56169ab08d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.778+0000 7f9879e00640 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab08d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.779+0000 7f9879e00640 1 -- 172.21.15.84:0/1564486287 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169a7c1650 con 0x56169a72d1b0 2024-09-21T07:56:29.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.780+0000 7f987a800640 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:29.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.783+0000 7f9879e00640 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169ab087c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9874019ea0 tx=0x7f9874004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed07ba6df8a5f311 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:29.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.783+0000 7f985b400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:29.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.784+0000 7f985b400640 1 -- 172.21.15.84:0/1564486287 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874016960 con 0x56169a72d1b0 2024-09-21T07:56:29.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.784+0000 7f985b400640 1 -- 172.21.15.84:0/1564486287 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f9874016b00 con 0x56169a72d1b0 2024-09-21T07:56:29.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.784+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56169aa00b90 con 0x56169a72d1b0 2024-09-21T07:56:29.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.784+0000 7f985b400640 1 -- 172.21.15.84:0/1564486287 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9874016d00 con 0x56169a72d1b0 2024-09-21T07:56:29.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.784+0000 7f98879bb740 10 client.27055 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:29.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.784+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56169aa1b950 con 0x56169a72d1b0 2024-09-21T07:56:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.785+0000 7f985b400640 1 -- 172.21.15.84:0/1564486287 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56169aa00b90 con 0x56169a72d1b0 2024-09-21T07:56:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.788+0000 7f985b400640 1 -- 172.21.15.84:0/1564486287 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9874017410 con 0x56169a72d1b0 2024-09-21T07:56:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.788+0000 7f98879bb740 10 client.27055 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.788+0000 7f98879bb740 10 client.27055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.788+0000 7f98879bb740 20 client.27055 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.788+0000 7f98879bb740 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169a7149f0 0x56169ab1a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.788+0000 7f98879bb740 4 client.27055 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.788+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56169aa75f00 con 0x56169a7149f0 2024-09-21T07:56:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.789+0000 7f9879400640 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169a7149f0 0x56169ab1a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.792+0000 7f9879400640 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169a7149f0 0x56169ab1a840 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced256ed6b4c0dca server_cookie=d90568a1801e5248 in_seq=0 out_seq=0 2024-09-21T07:56:29.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.792+0000 7f985b400640 10 client.27055 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:29.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.795+0000 7f985b400640 1 -- 172.21.15.84:0/1564486287 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56169aa75f00 con 0x56169a7149f0 2024-09-21T07:56:29.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.795+0000 7f985b400640 10 client.27055 handle_command_reply: tid=0 2024-09-21T07:56:29.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.795+0000 7f98879bb740 1 client.27055 shutdown 2024-09-21T07:56:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 msgr2=0x56169ab087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169ab087c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9874019ea0 tx=0x7f9874004b50 comp rx=0 tx=0).stop 2024-09-21T07:56:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 shutdown_connections 2024-09-21T07:56:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab08d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169a7149f0 0x56169ab1a840 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 --2- 172.21.15.84:0/1564486287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a72d1b0 0x56169ab087c0 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9874019ea0 tx=0x7f9874004b50 comp rx=0 tx=0).stop 2024-09-21T07:56:29.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 >> 172.21.15.84:0/1564486287 conn(0x56169a74a460 msgr2=0x56169aaf9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:29.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.796+0000 7f985b400640 0 client.27055 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.797+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 shutdown_connections 2024-09-21T07:56:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.798+0000 7f98879bb740 1 -- 172.21.15.84:0/1564486287 wait complete. 2024-09-21T07:56:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.798+0000 7f98879bb740 20 client.27055 trim_cache size 0 max 16384 2024-09-21T07:56:29.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:29 smithi162 ceph-mon[34833]: pgmap v555: 129 pgs: 129 active+clean; 35 GiB data, 73 GiB used, 1000 GiB / 1.0 TiB avail; 25 KiB/s rd, 208 MiB/s wr, 1.75k op/s 2024-09-21T07:56:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.832+0000 7f98879bb740 1 Processor -- start 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.836+0000 7f98879bb740 1 -- start start 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.837+0000 7f98879bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.837+0000 7f98879bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.837+0000 7f98879bb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169aafab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.837+0000 7f98879bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f987c1b71d0 con 0x56169a735390 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.837+0000 7f98879bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f987c1dad50 con 0x56169a756070 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.837+0000 7f98879bb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f987c1b78a0 con 0x56169a6e9da0 2024-09-21T07:56:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.837+0000 7f9879400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.838+0000 7f9879400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46772/0 (socket says 172.21.15.84:46772) 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.838+0000 7f9879400640 1 -- 172.21.15.84:0/1485049928 learned_addr learned my addr 172.21.15.84:0/1485049928 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.838+0000 7f9879400640 1 -- 172.21.15.84:0/1485049928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 msgr2=0x56169aafab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.838+0000 7f9879400640 1 --2- 172.21.15.84:0/1485049928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169aafab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.838+0000 7f9879400640 1 -- 172.21.15.84:0/1485049928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 msgr2=0x56169ab0a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.838+0000 7f9879400640 1 --2- 172.21.15.84:0/1485049928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.838+0000 7f9879400640 1 -- 172.21.15.84:0/1485049928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169ab0b630 con 0x56169a756070 2024-09-21T07:56:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.840+0000 7f9879400640 1 --2- 172.21.15.84:0/1485049928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafa610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f98680a9e10 tx=0x7f98680107c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af5684d174fc5a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:29.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.840+0000 7f9866600640 1 -- 172.21.15.84:0/1485049928 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680ac6b0 con 0x56169a756070 2024-09-21T07:56:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.840+0000 7f9866600640 1 -- 172.21.15.84:0/1485049928 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98680ad2a0 con 0x56169a756070 2024-09-21T07:56:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.840+0000 7f9866600640 1 -- 172.21.15.84:0/1485049928 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680ac6b0 con 0x56169a756070 2024-09-21T07:56:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.842+0000 7f98879bb740 1 -- 172.21.15.84:0/1485049928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 msgr2=0x56169aafa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.842+0000 7f98879bb740 1 --2- 172.21.15.84:0/1485049928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafa610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f98680a9e10 tx=0x7f98680107c0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.844+0000 7f98879bb740 1 -- 172.21.15.84:0/1485049928 shutdown_connections 2024-09-21T07:56:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.844+0000 7f98879bb740 1 --2- 172.21.15.84:0/1485049928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169aafab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.844+0000 7f98879bb740 1 --2- 172.21.15.84:0/1485049928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169aafa610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.844+0000 7f98879bb740 1 --2- 172.21.15.84:0/1485049928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.844+0000 7f98879bb740 1 -- 172.21.15.84:0/1485049928 >> 172.21.15.84:0/1485049928 conn(0x56169a74a460 msgr2=0x56169ab09ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:29.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.844+0000 7f98879bb740 1 -- 172.21.15.84:0/1485049928 shutdown_connections 2024-09-21T07:56:29.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.845+0000 7f98879bb740 1 -- 172.21.15.84:0/1485049928 wait complete. 2024-09-21T07:56:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.846+0000 7f98879bb740 1 -- start start 2024-09-21T07:56:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.847+0000 7f98879bb740 1 Processor -- start 2024-09-21T07:56:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.851+0000 7f98879bb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169ab10ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.851+0000 7f98879bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.851+0000 7f98879bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab0d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.854+0000 7f98879bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f987c1b8640 con 0x56169a735390 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.854+0000 7f98879bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f987c1b7f70 con 0x56169a756070 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.854+0000 7f98879bb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f987c10e000 con 0x56169a6e9da0 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.854+0000 7f9879e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169ab10ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.854+0000 7f98879bb740 10 client.0 _ll_register_callbacks cb 0x7f9874019b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.854+0000 7f9879e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169ab10ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37568/0 (socket says 172.21.15.84:37568) 2024-09-21T07:56:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.854+0000 7f9879e00640 1 -- 172.21.15.84:0/3792665890 learned_addr learned my addr 172.21.15.84:0/3792665890 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:29.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.855+0000 7f9879400640 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.855+0000 7f987a800640 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab0d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.856+0000 7f9879400640 1 -- 172.21.15.84:0/3792665890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 msgr2=0x56169ab10ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.856+0000 7f9879400640 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169ab10ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.856+0000 7f9879400640 1 -- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 msgr2=0x56169ab0d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:29.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.856+0000 7f9879400640 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab0d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.856+0000 7f9879400640 1 -- 172.21.15.84:0/3792665890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169ab0de60 con 0x56169a735390 2024-09-21T07:56:29.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.859+0000 7f9879400640 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0d3e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9868011010 tx=0x7f98680105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861ae69607c7be76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:29.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.859+0000 7f985b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:56:29.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.860+0000 7f985b400640 1 -- 172.21.15.84:0/3792665890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680b65c0 con 0x56169a735390 2024-09-21T07:56:29.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.860+0000 7f985b400640 1 -- 172.21.15.84:0/3792665890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f98680e4720 con 0x56169a735390 2024-09-21T07:56:29.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.861+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98680ad2a0 con 0x56169a735390 2024-09-21T07:56:29.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.863+0000 7f985b400640 1 -- 172.21.15.84:0/3792665890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f98680e4920 con 0x56169a735390 2024-09-21T07:56:29.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.863+0000 7f98879bb740 10 client.16860 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:29.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.863+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56169ab85f30 con 0x56169a735390 2024-09-21T07:56:29.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.864+0000 7f985b400640 1 -- 172.21.15.84:0/3792665890 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98680ad2a0 con 0x56169a735390 2024-09-21T07:56:29.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.864+0000 7f985b400640 1 -- 172.21.15.84:0/3792665890 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f98680abe00 con 0x56169a735390 2024-09-21T07:56:29.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.864+0000 7f98879bb740 10 client.16860 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:29.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.864+0000 7f98879bb740 10 client.16860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:29.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.864+0000 7f98879bb740 20 client.16860 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:29.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.865+0000 7f98879bb740 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169ab86660 0x56169ab88a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:29.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.865+0000 7f98879bb740 4 client.16860 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:56:29.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.865+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56169aa719b0 con 0x56169ab86660 2024-09-21T07:56:29.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.869+0000 7f9879e00640 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169ab86660 0x56169ab88a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:29.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.873+0000 7f985b400640 10 client.16860 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:29.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.874+0000 7f9879e00640 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169ab86660 0x56169ab88a80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=687d12dd34d03e4e server_cookie=3ae68c6a007f945b in_seq=0 out_seq=0 2024-09-21T07:56:29.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.874+0000 7f985b400640 1 -- 172.21.15.84:0/3792665890 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56169aa719b0 con 0x56169ab86660 2024-09-21T07:56:29.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.874+0000 7f985b400640 10 client.16860 handle_command_reply: tid=0 2024-09-21T07:56:29.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.874+0000 7f98879bb740 1 client.16860 shutdown 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.874+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 msgr2=0x56169ab0d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.874+0000 7f98879bb740 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0d3e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9868011010 tx=0x7f98680105b0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.875+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 shutdown_connections 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.875+0000 7f98879bb740 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56169a756070 0x56169ab0d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.875+0000 7f98879bb740 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56169a735390 0x56169ab0d3e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.875+0000 7f98879bb740 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56169ab86660 0x56169ab88a80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.875+0000 7f98879bb740 1 --2- 172.21.15.84:0/3792665890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56169a6e9da0 0x56169ab10ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.875+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 >> 172.21.15.84:0/3792665890 conn(0x56169a74a460 msgr2=0x56169ab09b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.875+0000 7f985b400640 0 client.16860 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:29.879 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:56:29.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.876+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 shutdown_connections 2024-09-21T07:56:29.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.876+0000 7f98879bb740 1 -- 172.21.15.84:0/3792665890 wait complete. 2024-09-21T07:56:29.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.876+0000 7f98879bb740 20 client.16860 trim_cache size 0 max 16384 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98600b67b0 msgr2=0x7f98600b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98600b67b0 0x7f98600b8cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56169aafbbf0 tx=0x7f98740096d0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c111cd0 msgr2=0x7f987c114660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c111cd0 0x7f987c114660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f987c06c910 tx=0x7f986800b850 comp rx=0 tx=0).stop 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 shutdown_connections 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98600b67b0 0x7f98600b8cc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f987c11cba0 0x7f987c114ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f987c111cd0 0x7f987c114660 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 --2- 172.21.15.84:0/902538390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f987c10dbf0 0x7f987c11b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:29.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.878+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 >> 172.21.15.84:0/902538390 conn(0x7f987c06e9f0 msgr2=0x7f987c110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:29.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.880+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 shutdown_connections 2024-09-21T07:56:29.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:29.880+0000 7f987b200640 1 -- 172.21.15.84:0/902538390 wait complete. 2024-09-21T07:56:31.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:31 smithi162 ceph-mon[34833]: pgmap v556: 129 pgs: 129 active+clean; 35 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 49 KiB/s rd, 225 MiB/s wr, 1.75k op/s 2024-09-21T07:56:31.812 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:31 smithi084 ceph-mon[30411]: pgmap v556: 129 pgs: 129 active+clean; 35 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 49 KiB/s rd, 225 MiB/s wr, 1.75k op/s 2024-09-21T07:56:31.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:31 smithi191 ceph-mon[34667]: pgmap v556: 129 pgs: 129 active+clean; 35 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 49 KiB/s rd, 225 MiB/s wr, 1.75k op/s 2024-09-21T07:56:32.325 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 -- 172.21.15.84:0/3489719093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c09c720 msgr2=0x7fe31c09cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 --2- 172.21.15.84:0/3489719093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c09c720 0x7fe31c09cb30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe318009900 tx=0x7fe31802a410 comp rx=0 tx=0).stop 2024-09-21T07:56:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 -- 172.21.15.84:0/3489719093 shutdown_connections 2024-09-21T07:56:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 --2- 172.21.15.84:0/3489719093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe31c0a29b0 0x7fe31c0a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 --2- 172.21.15.84:0/3489719093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 0x7fe31c0a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 --2- 172.21.15.84:0/3489719093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c09c720 0x7fe31c09cb30 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe318009900 tx=0x7fe31802a410 comp rx=0 tx=0).stop 2024-09-21T07:56:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 -- 172.21.15.84:0/3489719093 >> 172.21.15.84:0/3489719093 conn(0x7fe31c00bc20 msgr2=0x7fe31c00c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.198+0000 7fe32ac00640 1 -- 172.21.15.84:0/3489719093 shutdown_connections 2024-09-21T07:56:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.199+0000 7fe32ac00640 1 -- 172.21.15.84:0/3489719093 wait complete. 2024-09-21T07:56:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.200+0000 7fe32ac00640 1 Processor -- start 2024-09-21T07:56:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.201+0000 7fe32ac00640 1 -- start start 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.201+0000 7fe32ac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 0x7fe31c133210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.201+0000 7fe32ac00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe31c0a29b0 0x7fe31c1337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.201+0000 7fe32ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c138990 0x7fe31c138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.201+0000 7fe32ac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0ac660 con 0x7fe31c0a2060 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.201+0000 7fe32ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0ac4e0 con 0x7fe31c138990 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.201+0000 7fe32ac00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0ac7e0 con 0x7fe31c0a29b0 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 0x7fe31c133210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 0x7fe31c133210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47860/0 (socket says 172.21.15.84:47860) 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 -- 172.21.15.84:0/1983865004 learned_addr learned my addr 172.21.15.84:0/1983865004 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe32a200640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c138990 0x7fe31c138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 -- 172.21.15.84:0/1983865004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe31c0a29b0 msgr2=0x7fe31c1337b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe31c0a29b0 0x7fe31c1337b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 -- 172.21.15.84:0/1983865004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c138990 msgr2=0x7fe31c138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c138990 0x7fe31c138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe329800640 1 -- 172.21.15.84:0/1983865004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c139570 con 0x7fe31c0a2060 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.202+0000 7fe32a200640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c138990 0x7fe31c138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.203+0000 7fe329800640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 0x7fe31c133210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe318006010 tx=0x7fe318031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.203+0000 7fe322000640 1 -- 172.21.15.84:0/1983865004 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31803f030 con 0x7fe31c0a2060 2024-09-21T07:56:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.203+0000 7fe322000640 1 -- 172.21.15.84:0/1983865004 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3180043d0 con 0x7fe31c0a2060 2024-09-21T07:56:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.203+0000 7fe322000640 1 -- 172.21.15.84:0/1983865004 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318035070 con 0x7fe31c0a2060 2024-09-21T07:56:33.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.203+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c13fb10 con 0x7fe31c0a2060 2024-09-21T07:56:33.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.204+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c13feb0 con 0x7fe31c0a2060 2024-09-21T07:56:33.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.205+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c09cb30 con 0x7fe31c0a2060 2024-09-21T07:56:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.207+0000 7fe322000640 1 -- 172.21.15.84:0/1983865004 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe318042030 con 0x7fe31c0a2060 2024-09-21T07:56:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.208+0000 7fe322000640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe30c0b6700 0x7fe30c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.209+0000 7fe322000640 1 -- 172.21.15.84:0/1983865004 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe318107a30 con 0x7fe31c0a2060 2024-09-21T07:56:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.209+0000 7fe328e00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe30c0b6700 0x7fe30c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.210+0000 7fe328e00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe30c0b6700 0x7fe30c0b8c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe31c005200 tx=0x7fe310005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.213+0000 7fe322000640 1 -- 172.21.15.84:0/1983865004 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3180cdc10 con 0x7fe31c0a2060 2024-09-21T07:56:33.365 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:56:33.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:56:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.504+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe31c134280 con 0x7fe31c0a2060 2024-09-21T07:56:33.508 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:33 smithi084 ceph-mon[30411]: pgmap v557: 129 pgs: 129 active+clean; 36 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 35 KiB/s rd, 240 MiB/s wr, 1.70k op/s 2024-09-21T07:56:33.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.510+0000 7fe322000640 1 -- 172.21.15.84:0/1983865004 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fe3180d1ff0 con 0x7fe31c0a2060 2024-09-21T07:56:33.515 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:56:33.515 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:56:33.515 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:56:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.518+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe30c0b6700 msgr2=0x7fe30c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.518+0000 7fe32ac00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe30c0b6700 0x7fe30c0b8c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe31c005200 tx=0x7fe310005f90 comp rx=0 tx=0).stop 2024-09-21T07:56:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.518+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 msgr2=0x7fe31c133210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:33.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.518+0000 7fe32ac00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 0x7fe31c133210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe318006010 tx=0x7fe318031a50 comp rx=0 tx=0).stop 2024-09-21T07:56:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.519+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 shutdown_connections 2024-09-21T07:56:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.519+0000 7fe32ac00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe30c0b6700 0x7fe30c0b8c10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.519+0000 7fe32ac00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe31c138990 0x7fe31c138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.519+0000 7fe32ac00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe31c0a29b0 0x7fe31c1337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.519+0000 7fe32ac00640 1 --2- 172.21.15.84:0/1983865004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe31c0a2060 0x7fe31c133210 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.519+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 >> 172.21.15.84:0/1983865004 conn(0x7fe31c00bc20 msgr2=0x7fe31c0a0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.520+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 shutdown_connections 2024-09-21T07:56:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:33.520+0000 7fe32ac00640 1 -- 172.21.15.84:0/1983865004 wait complete. 2024-09-21T07:56:33.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:33 smithi162 ceph-mon[34833]: pgmap v557: 129 pgs: 129 active+clean; 36 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 35 KiB/s rd, 240 MiB/s wr, 1.70k op/s 2024-09-21T07:56:33.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:33 smithi191 ceph-mon[34667]: pgmap v557: 129 pgs: 129 active+clean; 36 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 35 KiB/s rd, 240 MiB/s wr, 1.70k op/s 2024-09-21T07:56:34.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:34 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1983865004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:34.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:34 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1983865004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:34.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:34 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1983865004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:35 smithi162 ceph-mon[34833]: pgmap v558: 129 pgs: 129 active+clean; 37 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 35 KiB/s rd, 246 MiB/s wr, 1.61k op/s 2024-09-21T07:56:35.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:35 smithi084 ceph-mon[30411]: pgmap v558: 129 pgs: 129 active+clean; 37 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 35 KiB/s rd, 246 MiB/s wr, 1.61k op/s 2024-09-21T07:56:35.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:35 smithi191 ceph-mon[34667]: pgmap v558: 129 pgs: 129 active+clean; 37 GiB data, 76 GiB used, 997 GiB / 1.0 TiB avail; 35 KiB/s rd, 246 MiB/s wr, 1.61k op/s 2024-09-21T07:56:36.509 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 654cf922 --release --await' 2024-09-21T07:56:36.509 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 654cf922 --release --await 2024-09-21T07:56:36.716 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:37.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:37 smithi162 ceph-mon[34833]: pgmap v559: 129 pgs: 129 active+clean; 37 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 28 KiB/s rd, 229 MiB/s wr, 1.41k op/s 2024-09-21T07:56:37.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:37 smithi084 ceph-mon[30411]: pgmap v559: 129 pgs: 129 active+clean; 37 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 28 KiB/s rd, 229 MiB/s wr, 1.41k op/s 2024-09-21T07:56:37.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:37 smithi191 ceph-mon[34667]: pgmap v559: 129 pgs: 129 active+clean; 37 GiB data, 77 GiB used, 996 GiB / 1.0 TiB avail; 28 KiB/s rd, 229 MiB/s wr, 1.41k op/s 2024-09-21T07:56:38.310 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 -- 172.21.15.84:0/37606118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d41027a0 msgr2=0x7fe4d4102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 --2- 172.21.15.84:0/37606118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d41027a0 0x7fe4d4102bb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009860 tx=0x7fe4bc02a340 comp rx=0 tx=0).stop 2024-09-21T07:56:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 -- 172.21.15.84:0/37606118 shutdown_connections 2024-09-21T07:56:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 --2- 172.21.15.84:0/37606118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d4107be0 0x7fe4d41080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 --2- 172.21.15.84:0/37606118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4d41030f0 0x7fe4d4107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 --2- 172.21.15.84:0/37606118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d41027a0 0x7fe4d4102bb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 -- 172.21.15.84:0/37606118 >> 172.21.15.84:0/37606118 conn(0x7fe4d4079730 msgr2=0x7fe4d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:38.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 -- 172.21.15.84:0/37606118 shutdown_connections 2024-09-21T07:56:38.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.445+0000 7fe4db200640 1 -- 172.21.15.84:0/37606118 wait complete. 2024-09-21T07:56:38.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.447+0000 7fe4db200640 1 Processor -- start 2024-09-21T07:56:38.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.447+0000 7fe4db200640 1 -- start start 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4db200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d41027a0 0x7fe4d41a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4db200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4d41030f0 0x7fe4d41a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4db200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d4107be0 0x7fe4d41a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4db200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d411a0e0 con 0x7fe4d41027a0 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4db200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d4119f60 con 0x7fe4d41030f0 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4db200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d411a260 con 0x7fe4d4107be0 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d41027a0 0x7fe4d41a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4d41030f0 0x7fe4d41a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4d41030f0 0x7fe4d41a10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58314/0 (socket says 172.21.15.84:58314) 2024-09-21T07:56:38.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4cb400640 1 -- 172.21.15.84:0/2378223342 learned_addr learned my addr 172.21.15.84:0/2378223342 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:38.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.448+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d41027a0 0x7fe4d41a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55876/0 (socket says 172.21.15.84:55876) 2024-09-21T07:56:38.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.449+0000 7fe4d9200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d4107be0 0x7fe4d41a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.450+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2378223342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d4107be0 msgr2=0x7fe4d41a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.450+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d4107be0 0x7fe4d41a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.450+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2378223342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4d41030f0 msgr2=0x7fe4d41a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.450+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4d41030f0 0x7fe4d41a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.450+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2378223342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d41a6a80 con 0x7fe4d41027a0 2024-09-21T07:56:38.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.451+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d41027a0 0x7fe4d41a0b10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc035040 tx=0x7fe4bc032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:38.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.452+0000 7fe4d1600640 1 -- 172.21.15.84:0/2378223342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc042070 con 0x7fe4d41027a0 2024-09-21T07:56:38.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.452+0000 7fe4d1600640 1 -- 172.21.15.84:0/2378223342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4bc030d40 con 0x7fe4d41027a0 2024-09-21T07:56:38.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.452+0000 7fe4d1600640 1 -- 172.21.15.84:0/2378223342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc037040 con 0x7fe4d41027a0 2024-09-21T07:56:38.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.454+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d41a6d10 con 0x7fe4d41027a0 2024-09-21T07:56:38.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.454+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d41ad4d0 con 0x7fe4d41027a0 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.458+0000 7fe4d1600640 1 -- 172.21.15.84:0/2378223342 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe4bc0040e0 con 0x7fe4d41027a0 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.459+0000 7fe4e1e1b740 1 Processor -- start 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.459+0000 7fe4e1e1b740 1 -- start start 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.459+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b3c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.459+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.460+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.460+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f96b33de90 con 0x55f96b020350 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.460+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f96b32d2c0 con 0x55f96aff7490 2024-09-21T07:56:38.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.460+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f96b3310d0 con 0x55f96afff670 2024-09-21T07:56:38.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.460+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58316/0 (socket says 172.21.15.84:58316) 2024-09-21T07:56:38.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2711055660 learned_addr learned my addr 172.21.15.84:0/2711055660 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:38.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4d1600640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe4b80b67b0 0x7fe4b80b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4cb400640 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4d1600640 1 -- 172.21.15.84:0/2378223342 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe4bc106fc0 con 0x7fe4d41027a0 2024-09-21T07:56:38.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4cb400640 1 -- 172.21.15.84:0/2711055660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 msgr2=0x55f96b3c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4cb400640 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4cb400640 1 -- 172.21.15.84:0/2711055660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 msgr2=0x55f96b3c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.461+0000 7fe4cb400640 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b3c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.462+0000 7fe4cb400640 1 -- 172.21.15.84:0/2711055660 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96b08b930 con 0x55f96afff670 2024-09-21T07:56:38.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.462+0000 7fe4d9200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe4b80b67b0 0x7fe4b80b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.462+0000 7fe4cb400640 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3c8790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4005c80 tx=0x7fe4c4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1569824e2e2e2dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:38.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.463+0000 7fe4c9600640 1 -- 172.21.15.84:0/2711055660 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c401e070 con 0x55f96afff670 2024-09-21T07:56:38.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.463+0000 7fe4c9600640 1 -- 172.21.15.84:0/2711055660 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c4019ae0 con 0x55f96afff670 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.463+0000 7fe4c9600640 1 -- 172.21.15.84:0/2711055660 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c401e070 con 0x55f96afff670 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.464+0000 7fe4d9200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe4b80b67b0 0x7fe4b80b8cc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc005c40 tx=0x7fe4cc0098e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.465+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2711055660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 msgr2=0x55f96b3c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.465+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3c8790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4005c80 tx=0x7fe4c4011810 comp rx=0 tx=0).stop 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.466+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2711055660 shutdown_connections 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.466+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3c8790 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.466+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.466+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2711055660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b3c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.466+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2711055660 >> 172.21.15.84:0/2711055660 conn(0x55f96b014740 msgr2=0x55f96b3c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.466+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2711055660 shutdown_connections 2024-09-21T07:56:38.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.466+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2711055660 wait complete. 2024-09-21T07:56:38.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.468+0000 7fe4e1e1b740 1 -- start start 2024-09-21T07:56:38.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.468+0000 7fe4e1e1b740 1 Processor -- start 2024-09-21T07:56:38.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.470+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3e4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.470+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96afff670 0x55f96b3e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.470+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96b020350 0x55f96b4017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.470+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.470+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3e4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58318/0 (socket says 172.21.15.84:58318) 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.471+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2424269869 learned_addr learned my addr 172.21.15.84:0/2424269869 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.471+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f96b18e890 con 0x55f96afff670 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.471+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f96b2c8160 con 0x55f96aff7490 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.471+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f96b3e7450 con 0x55f96b020350 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.471+0000 7fe4d9200640 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96b020350 0x55f96b4017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.471+0000 7fe4e1e1b740 10 client.0 _ll_register_callbacks cb 0x55f96b2e4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.472+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2424269869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96b020350 msgr2=0x55f96b4017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.472+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96b020350 0x55f96b4017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.472+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2424269869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96afff670 msgr2=0x55f96b3e4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.472+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96afff670 0x55f96b3e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.472+0000 7fe4d3e00640 1 -- 172.21.15.84:0/2424269869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96b401d00 con 0x55f96aff7490 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.472+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3e4570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0cca30 tx=0x7fe4bc030ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc73799c30b4648 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.472+0000 7fe4c2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.473+0000 7fe4c2000640 1 -- 172.21.15.84:0/2424269869 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0c8940 con 0x55f96aff7490 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.473+0000 7fe4c2000640 1 -- 172.21.15.84:0/2424269869 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe4bc0cbd00 con 0x55f96aff7490 2024-09-21T07:56:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.473+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4c4019ae0 con 0x55f96aff7490 2024-09-21T07:56:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4c2000640 1 -- 172.21.15.84:0/2424269869 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe4bc0c8210 con 0x55f96aff7490 2024-09-21T07:56:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4e1e1b740 10 client.27068 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f96b404530 con 0x55f96aff7490 2024-09-21T07:56:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4c2000640 1 -- 172.21.15.84:0/2424269869 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c4019ae0 con 0x55f96aff7490 2024-09-21T07:56:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4c2000640 1 -- 172.21.15.84:0/2424269869 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe4bc0c83f0 con 0x55f96aff7490 2024-09-21T07:56:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4e1e1b740 10 client.27068 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4e1e1b740 10 client.27068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4e1e1b740 20 client.27068 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.479+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afdecd0 0x55f96b407a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.480+0000 7fe4e1e1b740 4 client.27068 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:38.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.480+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f96b33fde0 con 0x55f96afdecd0 2024-09-21T07:56:38.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.481+0000 7fe4cb400640 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afdecd0 0x55f96b407a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.483+0000 7fe4cb400640 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afdecd0 0x55f96b407a20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0a3646d8ba2c8b6 server_cookie=c35929af1844ee in_seq=0 out_seq=0 2024-09-21T07:56:38.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.483+0000 7fe4c2000640 10 client.27068 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.484+0000 7fe4c2000640 1 -- 172.21.15.84:0/2424269869 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f96b33fde0 con 0x55f96afdecd0 2024-09-21T07:56:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.484+0000 7fe4c2000640 10 client.27068 handle_command_reply: tid=0 2024-09-21T07:56:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.486+0000 7fe4e1e1b740 1 client.27068 shutdown 2024-09-21T07:56:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 msgr2=0x55f96b3e4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3e4570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0cca30 tx=0x7fe4bc030ef0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 shutdown_connections 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afdecd0 0x55f96b407a20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96b020350 0x55f96b4017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96afff670 0x55f96b3e4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/2424269869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96aff7490 0x55f96b3e4570 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 >> 172.21.15.84:0/2424269869 conn(0x55f96b014740 msgr2=0x55f96b3c4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.488+0000 7fe4c2000640 0 client.27068 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.489+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 shutdown_connections 2024-09-21T07:56:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.489+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/2424269869 wait complete. 2024-09-21T07:56:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.489+0000 7fe4e1e1b740 20 client.27068 trim_cache size 0 max 16384 2024-09-21T07:56:38.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 Processor -- start 2024-09-21T07:56:38.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 -- start start 2024-09-21T07:56:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96aff7490 0x55f96b401740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96b020350 0x55f96b3e1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410b310 con 0x55f96aff7490 2024-09-21T07:56:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410ce50 con 0x55f96b020350 2024-09-21T07:56:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.508+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410b9e0 con 0x55f96afff670 2024-09-21T07:56:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96aff7490 0x55f96b401740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4d9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96b020350 0x55f96b3e1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42514/0 (socket says 172.21.15.84:42514) 2024-09-21T07:56:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4d9200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96b020350 0x55f96b3e1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58330/0 (socket says 172.21.15.84:58330) 2024-09-21T07:56:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 -- 172.21.15.84:0/256358363 learned_addr learned my addr 172.21.15.84:0/256358363 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 -- 172.21.15.84:0/256358363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96b020350 msgr2=0x55f96b3e1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96b020350 0x55f96b3e1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 -- 172.21.15.84:0/256358363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96aff7490 msgr2=0x55f96b401740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96aff7490 0x55f96b401740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4cb400640 1 -- 172.21.15.84:0/256358363 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96b3c6120 con 0x55f96afff670 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.509+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96aff7490 0x55f96b401740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.510+0000 7fe4cb400640 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3e1760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55f96b3e70a0 tx=0x7fe4c400e3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83122d6b308133eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.510+0000 7fe4c8c00640 1 -- 172.21.15.84:0/256358363 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c401e040 con 0x55f96afff670 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.510+0000 7fe4c8c00640 1 -- 172.21.15.84:0/256358363 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c40035f0 con 0x55f96afff670 2024-09-21T07:56:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.510+0000 7fe4c8c00640 1 -- 172.21.15.84:0/256358363 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4009de0 con 0x55f96afff670 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.511+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/256358363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 msgr2=0x55f96b3e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.511+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3e1760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55f96b3e70a0 tx=0x7fe4c400e3b0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.511+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/256358363 shutdown_connections 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.512+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96b020350 0x55f96b3e1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.512+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96afff670 0x55f96b3e1760 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.512+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/256358363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96aff7490 0x55f96b401740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.512+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/256358363 >> 172.21.15.84:0/256358363 conn(0x55f96b014740 msgr2=0x55f96b3e2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.512+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/256358363 shutdown_connections 2024-09-21T07:56:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.512+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/256358363 wait complete. 2024-09-21T07:56:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.512+0000 7fe4e1e1b740 1 -- start start 2024-09-21T07:56:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.513+0000 7fe4e1e1b740 1 Processor -- start 2024-09-21T07:56:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.514+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96aff7490 0x55f96b3f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.514+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96afff670 0x55f96b3fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.514+0000 7fe4e1e1b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b471420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.514+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410c780 con 0x55f96b020350 2024-09-21T07:56:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.514+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d410c0b0 con 0x55f96afff670 2024-09-21T07:56:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.514+0000 7fe4e1e1b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41a1c40 con 0x55f96aff7490 2024-09-21T07:56:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.514+0000 7fe4e1e1b740 10 client.0 _ll_register_callbacks cb 0x7fe4bc0c8f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.515+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96aff7490 0x55f96b3f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.515+0000 7fe4d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96aff7490 0x55f96b3f9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42520/0 (socket says 172.21.15.84:42520) 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.515+0000 7fe4d9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b471420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4d9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b471420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55924/0 (socket says 172.21.15.84:55924) 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4d9200640 1 -- 172.21.15.84:0/1442160651 learned_addr learned my addr 172.21.15.84:0/1442160651 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4cb400640 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96afff670 0x55f96b3fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4cb400640 1 -- 172.21.15.84:0/1442160651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96aff7490 msgr2=0x55f96b3f9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4cb400640 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96aff7490 0x55f96b3f9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4cb400640 1 -- 172.21.15.84:0/1442160651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 msgr2=0x55f96b471420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:38.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4cb400640 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b471420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.516+0000 7fe4cb400640 1 -- 172.21.15.84:0/1442160651 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96b471960 con 0x55f96afff670 2024-09-21T07:56:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.517+0000 7fe4cb400640 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96afff670 0x55f96b3fa180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4000c00 tx=0x7fe4c4009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a49927d1f3ca886 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.517+0000 7fe4c2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:56:38.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.518+0000 7fe4c2000640 1 -- 172.21.15.84:0/1442160651 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c401e040 con 0x55f96afff670 2024-09-21T07:56:38.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.518+0000 7fe4c2000640 1 -- 172.21.15.84:0/1442160651 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe4c4005090 con 0x55f96afff670 2024-09-21T07:56:38.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.518+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4c40035f0 con 0x55f96afff670 2024-09-21T07:56:38.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.519+0000 7fe4c2000640 1 -- 172.21.15.84:0/1442160651 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe4c403b050 con 0x55f96afff670 2024-09-21T07:56:38.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.519+0000 7fe4e1e1b740 10 client.27074 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:38.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.519+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f96b472b30 con 0x55f96afff670 2024-09-21T07:56:38.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.519+0000 7fe4c2000640 1 -- 172.21.15.84:0/1442160651 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c40035f0 con 0x55f96afff670 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.520+0000 7fe4c2000640 1 -- 172.21.15.84:0/1442160651 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe4c400e4c0 con 0x55f96afff670 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.521+0000 7fe4e1e1b740 10 client.27074 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.521+0000 7fe4e1e1b740 10 client.27074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.521+0000 7fe4e1e1b740 20 client.27074 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.521+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afb4080 0x55f96b474f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.521+0000 7fe4e1e1b740 4 client.27074 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.521+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f96b33b890 con 0x55f96afb4080 2024-09-21T07:56:38.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.521+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afb4080 0x55f96b474f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:38.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.522+0000 7fe4d3e00640 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afb4080 0x55f96b474f60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579fd18b1c6e13a8 server_cookie=a31867c5a22ac413 in_seq=0 out_seq=0 2024-09-21T07:56:38.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.522+0000 7fe4c2000640 10 client.27074 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:38.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.523+0000 7fe4c2000640 1 -- 172.21.15.84:0/1442160651 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f96b33b890 con 0x55f96afb4080 2024-09-21T07:56:38.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.523+0000 7fe4c2000640 10 client.27074 handle_command_reply: tid=0 2024-09-21T07:56:38.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.523+0000 7fe4e1e1b740 1 client.27074 shutdown 2024-09-21T07:56:38.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96afff670 msgr2=0x55f96b3fa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96afff670 0x55f96b3fa180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4000c00 tx=0x7fe4c4009de0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 shutdown_connections 2024-09-21T07:56:38.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f96b020350 0x55f96b471420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f96afff670 0x55f96b3fa180 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f96afb4080 0x55f96b474f60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 --2- 172.21.15.84:0/1442160651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f96aff7490 0x55f96b3f9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 >> 172.21.15.84:0/1442160651 conn(0x55f96b014740 msgr2=0x55f96b3c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:38.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.524+0000 7fe4c2000640 0 client.27074 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:38.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.525+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 shutdown_connections 2024-09-21T07:56:38.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.525+0000 7fe4e1e1b740 1 -- 172.21.15.84:0/1442160651 wait complete. 2024-09-21T07:56:38.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.525+0000 7fe4e1e1b740 20 client.27074 trim_cache size 0 max 16384 2024-09-21T07:56:38.527 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:56:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:56:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "cef4fe59-34a4-44db-8667-452e2c24d686", 2024-09-21T07:56:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:56:38.527 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:56:38.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe4b80b67b0 msgr2=0x7fe4b80b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe4b80b67b0 0x7fe4b80b8cc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc005c40 tx=0x7fe4cc0098e0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d41027a0 msgr2=0x7fe4d41a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:38.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d41027a0 0x7fe4d41a0b10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc035040 tx=0x7fe4bc032d40 comp rx=0 tx=0).stop 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 shutdown_connections 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe4b80b67b0 0x7fe4b80b8cc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4d4107be0 0x7fe4d41a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4d41030f0 0x7fe4d41a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 --2- 172.21.15.84:0/2378223342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4d41027a0 0x7fe4d41a0b10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.527+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 >> 172.21.15.84:0/2378223342 conn(0x7fe4d4079730 msgr2=0x7fe4d41055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.528+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 shutdown_connections 2024-09-21T07:56:38.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:38.528+0000 7fe4db200640 1 -- 172.21.15.84:0/2378223342 wait complete. 2024-09-21T07:56:39.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:39 smithi162 ceph-mon[34833]: pgmap v560: 129 pgs: 129 active+clean; 37 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 27 KiB/s rd, 233 MiB/s wr, 1.40k op/s 2024-09-21T07:56:39.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:39 smithi084 ceph-mon[30411]: pgmap v560: 129 pgs: 129 active+clean; 37 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 27 KiB/s rd, 233 MiB/s wr, 1.40k op/s 2024-09-21T07:56:39.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:39 smithi191 ceph-mon[34667]: pgmap v560: 129 pgs: 129 active+clean; 37 GiB data, 78 GiB used, 995 GiB / 1.0 TiB avail; 27 KiB/s rd, 233 MiB/s wr, 1.40k op/s 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 -- 172.21.15.84:0/4012999276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d010b6d0 msgr2=0x7fe1d010bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/4012999276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d010b6d0 0x7fe1d010bae0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009900 tx=0x7fe1bc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 -- 172.21.15.84:0/4012999276 shutdown_connections 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/4012999276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d010c020 0x7fe1d0112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/4012999276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d010b6d0 0x7fe1d010bae0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/4012999276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d0105d90 0x7fe1d01061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 -- 172.21.15.84:0/4012999276 >> 172.21.15.84:0/4012999276 conn(0x7fe1d0101860 msgr2=0x7fe1d0103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 -- 172.21.15.84:0/4012999276 shutdown_connections 2024-09-21T07:56:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.325+0000 7fe1d4c00640 1 -- 172.21.15.84:0/4012999276 wait complete. 2024-09-21T07:56:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.327+0000 7fe1d4c00640 1 Processor -- start 2024-09-21T07:56:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.327+0000 7fe1d4c00640 1 -- start start 2024-09-21T07:56:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1d4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d0105d90 0x7fe1d019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1d4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d010b6d0 0x7fe1d019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1d4c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d010c020 0x7fe1d01a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1d4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d0115d30 con 0x7fe1d0105d90 2024-09-21T07:56:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1d4c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d0115bb0 con 0x7fe1d010b6d0 2024-09-21T07:56:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1d4c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d0115eb0 con 0x7fe1d010c020 2024-09-21T07:56:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d0105d90 0x7fe1d019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1cd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d010b6d0 0x7fe1d019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d0105d90 0x7fe1d019c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55938/0 (socket says 172.21.15.84:55938) 2024-09-21T07:56:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1cde00640 1 -- 172.21.15.84:0/1858802782 learned_addr learned my addr 172.21.15.84:0/1858802782 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.328+0000 7fe1ce800640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d010c020 0x7fe1d01a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1cd400640 1 -- 172.21.15.84:0/1858802782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d010c020 msgr2=0x7fe1d01a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d010c020 0x7fe1d01a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1cd400640 1 -- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d0105d90 msgr2=0x7fe1d019c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d0105d90 0x7fe1d019c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1cd400640 1 -- 172.21.15.84:0/1858802782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d01a2750 con 0x7fe1d010b6d0 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d0105d90 0x7fe1d019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d010b6d0 0x7fe1d019cd80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009230 tx=0x7fe1bc003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.329+0000 7fe1c6a00640 1 -- 172.21.15.84:0/1858802782 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc03f070 con 0x7fe1d010b6d0 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.330+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d01a29e0 con 0x7fe1d010b6d0 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.330+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d01a91a0 con 0x7fe1d010b6d0 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.330+0000 7fe1c6a00640 1 -- 172.21.15.84:0/1858802782 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1bc031b50 con 0x7fe1d010b6d0 2024-09-21T07:56:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.330+0000 7fe1c6a00640 1 -- 172.21.15.84:0/1858802782 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc035030 con 0x7fe1d010b6d0 2024-09-21T07:56:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 Processor -- start 2024-09-21T07:56:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 -- start start 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed451c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae975660 0x55ffaed45700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae97d840 0x55ffaed45c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ffaecbc290 con 0x55ffae99e520 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ffaecab6c0 con 0x55ffae97d840 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.333+0000 7fe1db83c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ffaecaf4d0 con 0x55ffae975660 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55948/0 (socket says 172.21.15.84:55948) 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 -- 172.21.15.84:0/3046559639 learned_addr learned my addr 172.21.15.84:0/3046559639 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1cde00640 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae975660 0x55ffaed45700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 -- 172.21.15.84:0/3046559639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae975660 msgr2=0x55ffaed45700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae975660 0x55ffaed45700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 -- 172.21.15.84:0/3046559639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae97d840 msgr2=0x55ffaed45c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae97d840 0x55ffaed45c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.334+0000 7fe1ce800640 1 -- 172.21.15.84:0/3046559639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffaec38460 con 0x55ffae99e520 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.335+0000 7fe1ce800640 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed451c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009f50 tx=0x7fe1c80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86df62914c3f3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.335+0000 7fe1bb000640 1 -- 172.21.15.84:0/3046559639 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8004d20 con 0x55ffae99e520 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.335+0000 7fe1bb000640 1 -- 172.21.15.84:0/3046559639 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c8004050 con 0x55ffae99e520 2024-09-21T07:56:40.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.335+0000 7fe1bb000640 1 -- 172.21.15.84:0/3046559639 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8005280 con 0x55ffae99e520 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.335+0000 7fe1c6a00640 1 -- 172.21.15.84:0/1858802782 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe1bc042070 con 0x7fe1d010b6d0 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.336+0000 7fe1db83c740 1 -- 172.21.15.84:0/3046559639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 msgr2=0x55ffaed451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.336+0000 7fe1db83c740 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed451c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009f50 tx=0x7fe1c80118d0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1db83c740 1 -- 172.21.15.84:0/3046559639 shutdown_connections 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1db83c740 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae97d840 0x55ffaed45c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1db83c740 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae975660 0x55ffaed45700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1db83c740 1 --2- 172.21.15.84:0/3046559639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed451c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1db83c740 1 -- 172.21.15.84:0/3046559639 >> 172.21.15.84:0/3046559639 conn(0x55ffae992910 msgr2=0x55ffaed430b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:40.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1c6a00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1b40b6700 0x7fe1b40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1c6a00640 1 -- 172.21.15.84:0/1858802782 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe1bc107d60 con 0x7fe1d010b6d0 2024-09-21T07:56:40.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1db83c740 1 -- 172.21.15.84:0/3046559639 shutdown_connections 2024-09-21T07:56:40.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.337+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1b40b6700 0x7fe1b40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.338+0000 7fe1db83c740 1 -- 172.21.15.84:0/3046559639 wait complete. 2024-09-21T07:56:40.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.338+0000 7fe1db83c740 1 -- start start 2024-09-21T07:56:40.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.338+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1b40b6700 0x7fe1b40b8c10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55ffaed43e40 tx=0x7fe1c0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.338+0000 7fe1db83c740 1 Processor -- start 2024-09-21T07:56:40.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed50d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed5cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1db83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ffaeb0cbb0 con 0x55ffae975660 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1db83c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ffaec466c0 con 0x55ffae99e520 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1db83c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ffaed539a0 con 0x55ffae97d840 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1db83c740 10 client.0 _ll_register_callbacks cb 0x55ffaec61490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed50d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed50d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55954/0 (socket says 172.21.15.84:55954) 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1cde00640 1 -- 172.21.15.84:0/1171914581 learned_addr learned my addr 172.21.15.84:0/1171914581 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.339+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1ce800640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed5cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1cde00640 1 -- 172.21.15.84:0/1171914581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 msgr2=0x55ffaed512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1cde00640 1 -- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 msgr2=0x55ffaed5cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed5cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1cde00640 1 -- 172.21.15.84:0/1171914581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffaea09b00 con 0x55ffae975660 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed50d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009f80 tx=0x7fe1c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541f94fc7a60686 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.340+0000 7fe1af400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:56:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1af400640 1 -- 172.21.15.84:0/1171914581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000f830 con 0x55ffae975660 2024-09-21T07:56:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1af400640 1 -- 172.21.15.84:0/1171914581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe1c000f9d0 con 0x55ffae975660 2024-09-21T07:56:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c8004050 con 0x55ffae975660 2024-09-21T07:56:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1af400640 1 -- 172.21.15.84:0/1171914581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1c000fbd0 con 0x55ffae975660 2024-09-21T07:56:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1db83c740 10 client.16890 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffaea80960 con 0x55ffae975660 2024-09-21T07:56:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1af400640 1 -- 172.21.15.84:0/1171914581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c8004050 con 0x55ffae975660 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.341+0000 7fe1af400640 1 -- 172.21.15.84:0/1171914581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe1c0027070 con 0x55ffae975660 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.342+0000 7fe1db83c740 10 client.16890 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.342+0000 7fe1db83c740 10 client.16890 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.342+0000 7fe1db83c740 20 client.16890 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.342+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae95cea0 0x55ffaed62e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.342+0000 7fe1db83c740 4 client.16890 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.342+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffaecbe1e0 con 0x55ffae95cea0 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.342+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae95cea0 0x55ffaed62e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.343+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae95cea0 0x55ffaed62e90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb6a05a24d8b4a70 server_cookie=21b232c66d7ea518 in_seq=0 out_seq=0 2024-09-21T07:56:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.343+0000 7fe1af400640 10 client.16890 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:40.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.343+0000 7fe1af400640 1 -- 172.21.15.84:0/1171914581 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ffaecbe1e0 con 0x55ffae95cea0 2024-09-21T07:56:40.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.343+0000 7fe1af400640 10 client.16890 handle_command_reply: tid=0 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 client.16890 shutdown 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 msgr2=0x55ffaed50d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed50d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009f80 tx=0x7fe1c0004730 comp rx=0 tx=0).stop 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 shutdown_connections 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed5cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae95cea0 0x55ffaed62e90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1171914581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed50d80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 >> 172.21.15.84:0/1171914581 conn(0x55ffae992910 msgr2=0x55ffaed48350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1af400640 0 client.16890 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 shutdown_connections 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 1 -- 172.21.15.84:0/1171914581 wait complete. 2024-09-21T07:56:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.344+0000 7fe1db83c740 20 client.16890 trim_cache size 0 max 16384 2024-09-21T07:56:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.362+0000 7fe1db83c740 1 Processor -- start 2024-09-21T07:56:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.362+0000 7fe1db83c740 1 -- start start 2024-09-21T07:56:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.362+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae975660 0x55ffaed43270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed52a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed48930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1db83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b000fde0 con 0x55ffae99e520 2024-09-21T07:56:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1db83c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0011920 con 0x55ffae975660 2024-09-21T07:56:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1db83c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b00104b0 con 0x55ffae97d840 2024-09-21T07:56:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae975660 0x55ffaed43270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed52a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1ce800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed48930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cd400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed52a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42566/0 (socket says 172.21.15.84:42566) 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae975660 0x55ffaed43270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58392/0 (socket says 172.21.15.84:58392) 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1ce800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed48930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55966/0 (socket says 172.21.15.84:55966) 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cd400640 1 -- 172.21.15.84:0/1300959322 learned_addr learned my addr 172.21.15.84:0/1300959322 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cde00640 1 -- 172.21.15.84:0/1300959322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 msgr2=0x55ffaed52a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed52a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cde00640 1 -- 172.21.15.84:0/1300959322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 msgr2=0x55ffaed48930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed48930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1ce800640 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed48930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.363+0000 7fe1cde00640 1 -- 172.21.15.84:0/1300959322 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffaed51960 con 0x55ffae975660 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.364+0000 7fe1cd400640 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed52a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.364+0000 7fe1cde00640 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae975660 0x55ffaed43270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0029590 tx=0x7fe1c00092a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62df9d1a8209a6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.364+0000 7fe1ba600640 1 -- 172.21.15.84:0/1300959322 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000fdf0 con 0x55ffae975660 2024-09-21T07:56:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.364+0000 7fe1ba600640 1 -- 172.21.15.84:0/1300959322 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c0029cb0 con 0x55ffae975660 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.364+0000 7fe1ba600640 1 -- 172.21.15.84:0/1300959322 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c001e810 con 0x55ffae975660 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 -- 172.21.15.84:0/1300959322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae975660 msgr2=0x55ffaed43270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae975660 0x55ffaed43270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0029590 tx=0x7fe1c00092a0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 -- 172.21.15.84:0/1300959322 shutdown_connections 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae99e520 0x55ffaed48930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed52a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 --2- 172.21.15.84:0/1300959322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae975660 0x55ffaed43270 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 -- 172.21.15.84:0/1300959322 >> 172.21.15.84:0/1300959322 conn(0x55ffae992910 msgr2=0x55ffaed461f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 -- 172.21.15.84:0/1300959322 shutdown_connections 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.365+0000 7fe1db83c740 1 -- 172.21.15.84:0/1300959322 wait complete. 2024-09-21T07:56:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 -- start start 2024-09-21T07:56:40.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 Processor -- start 2024-09-21T07:56:40.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed59450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed56ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed57400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0011250 con 0x55ffae975660 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0010b80 con 0x55ffae99e520 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.366+0000 7fe1db83c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b000dda0 con 0x55ffae97d840 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1db83c740 10 client.0 _ll_register_callbacks cb 0x7fe1c0009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed59450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed59450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55978/0 (socket says 172.21.15.84:55978) 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 -- 172.21.15.84:0/324766832 learned_addr learned my addr 172.21.15.84:0/324766832 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1ce800640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed57400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cd400640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed56ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 -- 172.21.15.84:0/324766832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 msgr2=0x55ffaed56ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed56ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 -- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 msgr2=0x55ffaed57400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:40.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed57400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1cde00640 1 -- 172.21.15.84:0/324766832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffaed413b0 con 0x55ffae975660 2024-09-21T07:56:40.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.367+0000 7fe1ce800640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed57400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:40.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1cde00640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed59450 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0013010 tx=0x7fe1c0029e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad1a68088ce3fce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:40.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1af400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1af400640 1 -- 172.21.15.84:0/324766832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0029a40 con 0x55ffae975660 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1af400640 1 -- 172.21.15.84:0/324766832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fe1c0018070 con 0x55ffae975660 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c0029cb0 con 0x55ffae975660 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1af400640 1 -- 172.21.15.84:0/324766832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1c0005040 con 0x55ffae975660 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1db83c740 10 client.16893 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.368+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffaedce560 con 0x55ffae975660 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1af400640 1 -- 172.21.15.84:0/324766832 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c0029cb0 con 0x55ffae975660 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1af400640 1 -- 172.21.15.84:0/324766832 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe1c0027030 con 0x55ffae975660 2024-09-21T07:56:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1db83c740 10 client.16893 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1db83c740 10 client.16893 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1db83c740 20 client.16893 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1db83c740 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae932250 0x55ffaedd0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1db83c740 4 client.16893 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "654cf922", "release": true, "await": true}] 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "654cf922", "release": true, "await": true}) -- 0x55ffaecb9c90 con 0x55ffae932250 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.369+0000 7fe1cd400640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae932250 0x55ffaedd0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.370+0000 7fe1cd400640 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae932250 0x55ffaedd0c80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ded95867a3143b24 server_cookie=e4d4cb8709aca6e2 in_seq=0 out_seq=0 2024-09-21T07:56:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.370+0000 7fe1af400640 10 client.16893 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:40.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1af400640 1 -- 172.21.15.84:0/324766832 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ffaecb9c90 con 0x55ffae932250 2024-09-21T07:56:40.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1af400640 10 client.16893 handle_command_reply: tid=0 2024-09-21T07:56:40.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 client.16893 shutdown 2024-09-21T07:56:40.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 msgr2=0x55ffaed59450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed59450 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0013010 tx=0x7fe1c0029e60 comp rx=0 tx=0).stop 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 shutdown_connections 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ffae99e520 0x55ffaed57400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ffae932250 0x55ffaedd0c80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffae97d840 0x55ffaed56ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 --2- 172.21.15.84:0/324766832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ffae975660 0x55ffaed59450 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 >> 172.21.15.84:0/324766832 conn(0x55ffae992910 msgr2=0x55ffaed4fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1af400640 0 client.16893 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.382+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 shutdown_connections 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1db83c740 1 -- 172.21.15.84:0/324766832 wait complete. 2024-09-21T07:56:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1db83c740 20 client.16893 trim_cache size 0 max 16384 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 20, 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "654cf922": { 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 20, 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:56:40.385 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 130.0, 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:40.386 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1b40b6700 msgr2=0x7fe1b40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1b40b6700 0x7fe1b40b8c10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55ffaed43e40 tx=0x7fe1c0005f90 comp rx=0 tx=0).stop 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d010b6d0 msgr2=0x7fe1d019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d010b6d0 0x7fe1d019cd80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009230 tx=0x7fe1bc003b90 comp rx=0 tx=0).stop 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 shutdown_connections 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe1b40b6700 0x7fe1b40b8c10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d010c020 0x7fe1d01a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d010b6d0 0x7fe1d019cd80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 --2- 172.21.15.84:0/1858802782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1d0105d90 0x7fe1d019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.383+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 >> 172.21.15.84:0/1858802782 conn(0x7fe1d0101860 msgr2=0x7fe1d0108cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.384+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 shutdown_connections 2024-09-21T07:56:40.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:40.384+0000 7fe1d4c00640 1 -- 172.21.15.84:0/1858802782 wait complete. 2024-09-21T07:56:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:40 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:56:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:40 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:56:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:40 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:56:40.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:40 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:56:40.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:40 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:56:40.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:40 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:56:40.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:40 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:56:40.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:40 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:56:40.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:40 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:56:40.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:40 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:56:40.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:40 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:56:40.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:40 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 -- 172.21.15.84:0/1369385856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180950b0 msgr2=0x7fad180954c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 --2- 172.21.15.84:0/1369385856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180950b0 0x7fad180954c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fad14009860 tx=0x7fad1402a360 comp rx=0 tx=0).stop 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 -- 172.21.15.84:0/1369385856 shutdown_connections 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 --2- 172.21.15.84:0/1369385856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1809b330 0x7fad180a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 --2- 172.21.15.84:0/1369385856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad1809a9e0 0x7fad1809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 --2- 172.21.15.84:0/1369385856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180950b0 0x7fad180954c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 -- 172.21.15.84:0/1369385856 >> 172.21.15.84:0/1369385856 conn(0x7fad1800cdc0 msgr2=0x7fad1800d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 -- 172.21.15.84:0/1369385856 shutdown_connections 2024-09-21T07:56:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.064+0000 7fad27600640 1 -- 172.21.15.84:0/1369385856 wait complete. 2024-09-21T07:56:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.066+0000 7fad27600640 1 Processor -- start 2024-09-21T07:56:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.066+0000 7fad27600640 1 -- start start 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad27600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad180950b0 0x7fad1812b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad27600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad1809a9e0 0x7fad1812bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad27600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1809b330 0x7fad1812c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad27600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad180a4fe0 con 0x7fad1809b330 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad27600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad180a4e60 con 0x7fad1809a9e0 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad27600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fad180a5160 con 0x7fad180950b0 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad24c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad180950b0 0x7fad1812b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad24c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad180950b0 0x7fad1812b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42598/0 (socket says 172.21.15.84:42598) 2024-09-21T07:56:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad24c00640 1 -- 172.21.15.84:0/3528238593 learned_addr learned my addr 172.21.15.84:0/3528238593 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad1fe00640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad1809a9e0 0x7fad1812bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.067+0000 7fad25600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1809b330 0x7fad1812c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.068+0000 7fad24c00640 1 -- 172.21.15.84:0/3528238593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad1809a9e0 msgr2=0x7fad1812bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.068+0000 7fad24c00640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad1809a9e0 0x7fad1812bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.068+0000 7fad24c00640 1 -- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1809b330 msgr2=0x7fad1812c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.068+0000 7fad24c00640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1809b330 0x7fad1812c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.068+0000 7fad24c00640 1 -- 172.21.15.84:0/3528238593 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1813ae50 con 0x7fad180950b0 2024-09-21T07:56:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.068+0000 7fad25600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1809b330 0x7fad1812c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.068+0000 7fad24c00640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad180950b0 0x7fad1812b7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fad14035040 tx=0x7fad14032e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.069+0000 7fad1d600640 1 -- 172.21.15.84:0/3528238593 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14037040 con 0x7fad180950b0 2024-09-21T07:56:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.069+0000 7fad1d600640 1 -- 172.21.15.84:0/3528238593 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad14045070 con 0x7fad180950b0 2024-09-21T07:56:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.069+0000 7fad1d600640 1 -- 172.21.15.84:0/3528238593 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140307b0 con 0x7fad180950b0 2024-09-21T07:56:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.069+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1812d9b0 con 0x7fad180950b0 2024-09-21T07:56:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.070+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1812dd90 con 0x7fad180950b0 2024-09-21T07:56:41.075 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.074+0000 7fad2e5fc740 1 Processor -- start 2024-09-21T07:56:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.075+0000 7fad2e5fc740 1 -- start start 2024-09-21T07:56:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.076+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12a5ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.076+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc1268d2f0 0x55cc12a5b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.076+0000 7fad25600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12a5ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.076+0000 7fad25600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12a5ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58422/0 (socket says 172.21.15.84:58422) 2024-09-21T07:56:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.077+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126954d0 0x55cc12a5b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.077+0000 7fad25600640 1 -- 172.21.15.84:0/2428329647 learned_addr learned my addr 172.21.15.84:0/2428329647 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.077+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc129d06b0 con 0x55cc1268d2f0 2024-09-21T07:56:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.077+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cc129bfae0 con 0x55cc126b61b0 2024-09-21T07:56:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.077+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55cc129c38f0 con 0x55cc126954d0 2024-09-21T07:56:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.077+0000 7fad1fe00640 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126954d0 0x55cc12a5b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.079+0000 7fad1d600640 1 -- 172.21.15.84:0/3528238593 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fad14004160 con 0x7fad180950b0 2024-09-21T07:56:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.079+0000 7fad25600640 1 -- 172.21.15.84:0/2428329647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126954d0 msgr2=0x55cc12a5b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.079+0000 7fad25600640 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126954d0 0x55cc12a5b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.079+0000 7fad25600640 1 -- 172.21.15.84:0/2428329647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc1268d2f0 msgr2=0x55cc12a5b350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.079+0000 7fad24c00640 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc1268d2f0 0x55cc12a5b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.080+0000 7fad25600640 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc1268d2f0 0x55cc12a5b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.080+0000 7fad25600640 1 -- 172.21.15.84:0/2428329647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc1298c780 con 0x55cc126b61b0 2024-09-21T07:56:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.080+0000 7fad24c00640 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc1268d2f0 0x55cc12a5b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.081+0000 7fad25600640 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12a5ae10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad200521d0 tx=0x7fad20075b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=324857db8ddf6ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.081+0000 7fad11c00640 1 -- 172.21.15.84:0/2428329647 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20084070 con 0x55cc126b61b0 2024-09-21T07:56:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.081+0000 7fad1d600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fad080b6680 0x7fad080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.082+0000 7fad11c00640 1 -- 172.21.15.84:0/2428329647 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad2007eca0 con 0x55cc126b61b0 2024-09-21T07:56:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.082+0000 7fad11c00640 1 -- 172.21.15.84:0/2428329647 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20080dc0 con 0x55cc126b61b0 2024-09-21T07:56:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.082+0000 7fad1d600640 1 -- 172.21.15.84:0/3528238593 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fad1410fb70 con 0x7fad180950b0 2024-09-21T07:56:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.083+0000 7fad24c00640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fad080b6680 0x7fad080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.083+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 msgr2=0x55cc12a5ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.083+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12a5ae10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad200521d0 tx=0x7fad20075b00 comp rx=0 tx=0).stop 2024-09-21T07:56:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 shutdown_connections 2024-09-21T07:56:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126954d0 0x55cc12a5b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc1268d2f0 0x55cc12a5b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/2428329647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12a5ae10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 >> 172.21.15.84:0/2428329647 conn(0x55cc126aa300 msgr2=0x55cc12a58d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad24c00640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fad080b6680 0x7fad080b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55cc12a59a90 tx=0x7fad1402a360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 shutdown_connections 2024-09-21T07:56:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.084+0000 7fad2e5fc740 1 -- 172.21.15.84:0/2428329647 wait complete. 2024-09-21T07:56:41.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.085+0000 7fad2e5fc740 1 -- start start 2024-09-21T07:56:41.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.086+0000 7fad2e5fc740 1 Processor -- start 2024-09-21T07:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.087+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc1268d2f0 0x55cc12a66330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.087+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a66870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.087+0000 7fad25600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc1268d2f0 0x55cc12a66330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.088+0000 7fad25600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc1268d2f0 0x55cc12a66330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58430/0 (socket says 172.21.15.84:58430) 2024-09-21T07:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.088+0000 7fad25600640 1 -- 172.21.15.84:0/108169476 learned_addr learned my addr 172.21.15.84:0/108169476 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.088+0000 7fad1fe00640 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a66870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.088+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126b61b0 0x55cc12a66db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.088+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc128f7ab0 con 0x55cc126954d0 2024-09-21T07:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.088+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cc12966570 con 0x55cc1268d2f0 2024-09-21T07:56:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.088+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55cc12a69590 con 0x55cc126b61b0 2024-09-21T07:56:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.089+0000 7fad2e5fc740 10 client.0 _ll_register_callbacks cb 0x55cc12975100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.089+0000 7fad25600640 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126b61b0 0x55cc12a66db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.090+0000 7fad25600640 1 -- 172.21.15.84:0/108169476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126b61b0 msgr2=0x55cc12a66db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.090+0000 7fad25600640 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126b61b0 0x55cc12a66db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.090+0000 7fad25600640 1 -- 172.21.15.84:0/108169476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 msgr2=0x55cc12a66870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.090+0000 7fad25600640 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a66870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.090+0000 7fad25600640 1 -- 172.21.15.84:0/108169476 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc12721790 con 0x55cc1268d2f0 2024-09-21T07:56:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.090+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad2007eca0 con 0x55cc1268d2f0 2024-09-21T07:56:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.091+0000 7fad25600640 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc1268d2f0 0x55cc12a66330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad20068f20 tx=0x7fad200694a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc3f01a1a81033b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.091+0000 7fad06000640 10 client.27101 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:56:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.091+0000 7fad06000640 1 -- 172.21.15.84:0/108169476 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2009e050 con 0x55cc1268d2f0 2024-09-21T07:56:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.092+0000 7fad06000640 1 -- 172.21.15.84:0/108169476 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fad2007e5f0 con 0x55cc1268d2f0 2024-09-21T07:56:41.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.092+0000 7fad06000640 1 -- 172.21.15.84:0/108169476 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad20084040 con 0x55cc1268d2f0 2024-09-21T07:56:41.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.092+0000 7fad2e5fc740 10 client.27101 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:41.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.092+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55cc1279a620 con 0x55cc1268d2f0 2024-09-21T07:56:41.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad06000640 1 -- 172.21.15.84:0/108169476 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fad2007e7f0 con 0x55cc1268d2f0 2024-09-21T07:56:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad2e5fc740 10 client.27101 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad2e5fc740 10 client.27101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad2e5fc740 20 client.27101 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc12674d80 0x55cc12a78110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad2e5fc740 4 client.27101 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc129d2600 con 0x55cc12674d80 2024-09-21T07:56:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.093+0000 7fad1fe00640 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc12674d80 0x55cc12a78110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.094+0000 7fad06000640 10 client.27101 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.094+0000 7fad1fe00640 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc12674d80 0x55cc12a78110 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1639888fdd838213 server_cookie=cf7a65f99b938bee in_seq=0 out_seq=0 2024-09-21T07:56:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.095+0000 7fad06000640 1 -- 172.21.15.84:0/108169476 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc129d2600 con 0x55cc12674d80 2024-09-21T07:56:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.095+0000 7fad06000640 10 client.27101 handle_command_reply: tid=0 2024-09-21T07:56:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.095+0000 7fad2e5fc740 1 client.27101 shutdown 2024-09-21T07:56:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc1268d2f0 msgr2=0x55cc12a66330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc1268d2f0 0x55cc12a66330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad20068f20 tx=0x7fad200694a0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 shutdown_connections 2024-09-21T07:56:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc12674d80 0x55cc12a78110 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc126b61b0 0x55cc12a66db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a66870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/108169476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc1268d2f0 0x55cc12a66330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 >> 172.21.15.84:0/108169476 conn(0x55cc126aa300 msgr2=0x55cc12a5be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad06000640 0 client.27101 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 shutdown_connections 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.096+0000 7fad2e5fc740 1 -- 172.21.15.84:0/108169476 wait complete. 2024-09-21T07:56:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.097+0000 7fad2e5fc740 20 client.27101 trim_cache size 0 max 16384 2024-09-21T07:56:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.129+0000 7fad2e5fc740 1 Processor -- start 2024-09-21T07:56:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.130+0000 7fad2e5fc740 1 -- start start 2024-09-21T07:56:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.130+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a68210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.131+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126954d0 0x55cc12a71f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.131+0000 7fad25600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a68210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.131+0000 7fad25600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a68210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42630/0 (socket says 172.21.15.84:42630) 2024-09-21T07:56:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.132+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126b61b0 0x55cc12a7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.132+0000 7fad2e5fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad18141130 con 0x55cc126b61b0 2024-09-21T07:56:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.132+0000 7fad2e5fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad18142c70 con 0x55cc126954d0 2024-09-21T07:56:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.132+0000 7fad2e5fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fad18141800 con 0x55cc1268d2f0 2024-09-21T07:56:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.132+0000 7fad1fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126954d0 0x55cc12a71f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.132+0000 7fad25600640 1 -- 172.21.15.84:0/4266236776 learned_addr learned my addr 172.21.15.84:0/4266236776 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:41.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.133+0000 7fad25600640 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126b61b0 0x55cc12a7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.133+0000 7fad1fe00640 1 -- 172.21.15.84:0/4266236776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 msgr2=0x55cc12a68210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:41.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.133+0000 7fad1fe00640 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a68210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.134+0000 7fad1fe00640 1 -- 172.21.15.84:0/4266236776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126b61b0 msgr2=0x55cc12a7c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:41.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.134+0000 7fad1fe00640 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126b61b0 0x55cc12a7c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.134+0000 7fad1fe00640 1 -- 172.21.15.84:0/4266236776 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc12a5d9c0 con 0x55cc126954d0 2024-09-21T07:56:41.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.134+0000 7fad25600640 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126b61b0 0x55cc12a7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:41.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.134+0000 7fad1fe00640 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126954d0 0x55cc12a71f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55cc12966670 tx=0x7fad0c004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92484cde483e7569 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:41.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.135+0000 7fad11200640 1 -- 172.21.15.84:0/4266236776 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c003d20 con 0x55cc126954d0 2024-09-21T07:56:41.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.135+0000 7fad11200640 1 -- 172.21.15.84:0/4266236776 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad0c003ec0 con 0x55cc126954d0 2024-09-21T07:56:41.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.135+0000 7fad11200640 1 -- 172.21.15.84:0/4266236776 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c01d470 con 0x55cc126954d0 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 -- 172.21.15.84:0/4266236776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126954d0 msgr2=0x55cc12a71f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126954d0 0x55cc12a71f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55cc12966670 tx=0x7fad0c004430 comp rx=0 tx=0).stop 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 -- 172.21.15.84:0/4266236776 shutdown_connections 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126b61b0 0x55cc12a7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126954d0 0x55cc12a71f20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/4266236776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a68210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 -- 172.21.15.84:0/4266236776 >> 172.21.15.84:0/4266236776 conn(0x55cc126aa300 msgr2=0x55cc12a71810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 -- 172.21.15.84:0/4266236776 shutdown_connections 2024-09-21T07:56:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.137+0000 7fad2e5fc740 1 -- 172.21.15.84:0/4266236776 wait complete. 2024-09-21T07:56:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.138+0000 7fad2e5fc740 1 -- start start 2024-09-21T07:56:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.138+0000 7fad2e5fc740 1 Processor -- start 2024-09-21T07:56:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.139+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a7bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a7c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad2e5fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12ad8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad2e5fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad181425a0 con 0x55cc126954d0 2024-09-21T07:56:41.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad2e5fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad18141ed0 con 0x55cc126b61b0 2024-09-21T07:56:41.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad2e5fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fad1813f130 con 0x55cc1268d2f0 2024-09-21T07:56:41.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad2e5fc740 10 client.0 _ll_register_callbacks cb 0x7fad20081f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:41.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad25600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a7bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad25600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a7bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42636/0 (socket says 172.21.15.84:42636) 2024-09-21T07:56:41.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.140+0000 7fad25600640 1 -- 172.21.15.84:0/763859864 learned_addr learned my addr 172.21.15.84:0/763859864 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:41.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.141+0000 7fad25600640 1 -- 172.21.15.84:0/763859864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 msgr2=0x55cc12ad8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:41.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.141+0000 7fad25600640 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12ad8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.141+0000 7fad25600640 1 -- 172.21.15.84:0/763859864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 msgr2=0x55cc12a7c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:41.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.141+0000 7fad1fe00640 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a7c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.141+0000 7fad25600640 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a7c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.141+0000 7fad25600640 1 -- 172.21.15.84:0/763859864 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc12ad8ee0 con 0x55cc1268d2f0 2024-09-21T07:56:41.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.141+0000 7fad1fe00640 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a7c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:41.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.142+0000 7fad25600640 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a7bde0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fad20052860 tx=0x7fad20075b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c306159afcd3e857 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:41.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.142+0000 7fad06000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:41.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.143+0000 7fad06000640 1 -- 172.21.15.84:0/763859864 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad200aa070 con 0x55cc1268d2f0 2024-09-21T07:56:41.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.143+0000 7fad06000640 1 -- 172.21.15.84:0/763859864 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fad20080bf0 con 0x55cc1268d2f0 2024-09-21T07:56:41.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.143+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc129ce0b0 con 0x55cc1268d2f0 2024-09-21T07:56:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.143+0000 7fad06000640 1 -- 172.21.15.84:0/763859864 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad2009e070 con 0x55cc1268d2f0 2024-09-21T07:56:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.143+0000 7fad2e5fc740 10 client.27115 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.144+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc12ae2430 con 0x55cc1268d2f0 2024-09-21T07:56:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.144+0000 7fad06000640 1 -- 172.21.15.84:0/763859864 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cc129ce0b0 con 0x55cc1268d2f0 2024-09-21T07:56:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.144+0000 7fad06000640 1 -- 172.21.15.84:0/763859864 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fad20081790 con 0x55cc1268d2f0 2024-09-21T07:56:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.145+0000 7fad2e5fc740 10 client.27115 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.145+0000 7fad2e5fc740 10 client.27115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.145+0000 7fad2e5fc740 20 client.27115 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.145+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc1264a1c0 0x55cc12ae4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.145+0000 7fad2e5fc740 4 client.27115 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:56:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.145+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc129cb4e0 con 0x55cc1264a1c0 2024-09-21T07:56:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.146+0000 7fad1fe00640 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc1264a1c0 0x55cc12ae4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.146+0000 7fad1fe00640 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc1264a1c0 0x55cc12ae4b70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7707262010952796 server_cookie=50fa786214024bfd in_seq=0 out_seq=0 2024-09-21T07:56:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.146+0000 7fad06000640 10 client.27115 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:41.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.162+0000 7fad06000640 1 -- 172.21.15.84:0/763859864 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc129cb4e0 con 0x55cc1264a1c0 2024-09-21T07:56:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.162+0000 7fad06000640 10 client.27115 handle_command_reply: tid=0 2024-09-21T07:56:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.165+0000 7fad2e5fc740 1 client.27115 shutdown 2024-09-21T07:56:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 msgr2=0x55cc12a7bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a7bde0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fad20052860 tx=0x7fad20075b00 comp rx=0 tx=0).stop 2024-09-21T07:56:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 shutdown_connections 2024-09-21T07:56:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cc126b61b0 0x55cc12ad8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc126954d0 0x55cc12a7c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55cc1264a1c0 0x55cc12ae4b70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 --2- 172.21.15.84:0/763859864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55cc1268d2f0 0x55cc12a7bde0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 >> 172.21.15.84:0/763859864 conn(0x55cc126aa300 msgr2=0x55cc12a71fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.166+0000 7fad06000640 0 client.27115 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.167+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 shutdown_connections 2024-09-21T07:56:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.167+0000 7fad2e5fc740 1 -- 172.21.15.84:0/763859864 wait complete. 2024-09-21T07:56:41.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.167+0000 7fad2e5fc740 20 client.27115 trim_cache size 0 max 16384 2024-09-21T07:56:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:56:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:56:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:56:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:56:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.177+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fad080b6680 msgr2=0x7fad080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.177+0000 7fad27600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fad080b6680 0x7fad080b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55cc12a59a90 tx=0x7fad1402a360 comp rx=0 tx=0).stop 2024-09-21T07:56:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.177+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad180950b0 msgr2=0x7fad1812b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.177+0000 7fad27600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad180950b0 0x7fad1812b7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fad14035040 tx=0x7fad14032e90 comp rx=0 tx=0).stop 2024-09-21T07:56:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.178+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 shutdown_connections 2024-09-21T07:56:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.178+0000 7fad27600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fad080b6680 0x7fad080b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.178+0000 7fad27600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1809b330 0x7fad1812c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.178+0000 7fad27600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad1809a9e0 0x7fad1812bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.178+0000 7fad27600640 1 --2- 172.21.15.84:0/3528238593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad180950b0 0x7fad1812b7a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.178+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 >> 172.21.15.84:0/3528238593 conn(0x7fad1800cdc0 msgr2=0x7fad18098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.178+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 shutdown_connections 2024-09-21T07:56:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:41.181+0000 7fad27600640 1 -- 172.21.15.84:0/3528238593 wait complete. 2024-09-21T07:56:41.669 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:41 smithi084 ceph-mon[30411]: pgmap v561: 129 pgs: 129 active+clean; 38 GiB data, 78 GiB used, 994 GiB / 1.0 TiB avail; 33 KiB/s rd, 252 MiB/s wr, 1.50k op/s 2024-09-21T07:56:41.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:56:41.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:41 smithi162 ceph-mon[34833]: pgmap v561: 129 pgs: 129 active+clean; 38 GiB data, 78 GiB used, 994 GiB / 1.0 TiB avail; 33 KiB/s rd, 252 MiB/s wr, 1.50k op/s 2024-09-21T07:56:41.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:41 smithi191 ceph-mon[34667]: pgmap v561: 129 pgs: 129 active+clean; 38 GiB data, 78 GiB used, 994 GiB / 1.0 TiB avail; 33 KiB/s rd, 252 MiB/s wr, 1.50k op/s 2024-09-21T07:56:43.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:43 smithi162 ceph-mon[34833]: pgmap v562: 129 pgs: 129 active+clean; 38 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 10 KiB/s rd, 227 MiB/s wr, 1.37k op/s 2024-09-21T07:56:43.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:43 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:56:43.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:43 smithi084 ceph-mon[30411]: pgmap v562: 129 pgs: 129 active+clean; 38 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 10 KiB/s rd, 227 MiB/s wr, 1.37k op/s 2024-09-21T07:56:43.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:43 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:56:43.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:43 smithi191 ceph-mon[34667]: pgmap v562: 129 pgs: 129 active+clean; 38 GiB data, 79 GiB used, 994 GiB / 1.0 TiB avail; 10 KiB/s rd, 227 MiB/s wr, 1.37k op/s 2024-09-21T07:56:43.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:43 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:56:43.936 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '654cf922', total seconds elapsed: 43.1 2024-09-21T07:56:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:44.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:44 smithi191 ceph-mon[34667]: pgmap v563: 129 pgs: 129 active+clean; 38 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 14 KiB/s rd, 200 MiB/s wr, 1.32k op/s 2024-09-21T07:56:45.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:44 smithi162 ceph-mon[34833]: pgmap v563: 129 pgs: 129 active+clean; 38 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 14 KiB/s rd, 200 MiB/s wr, 1.32k op/s 2024-09-21T07:56:45.062 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:44 smithi084 ceph-mon[30411]: pgmap v563: 129 pgs: 129 active+clean; 38 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 14 KiB/s rd, 200 MiB/s wr, 1.32k op/s 2024-09-21T07:56:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.384+0000 7f8843200640 1 -- 172.21.15.84:0/612344972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8844109c40 msgr2=0x7f8844110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.384+0000 7f8843200640 1 --2- 172.21.15.84:0/612344972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8844109c40 0x7f8844110470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f883c009ca0 tx=0x7f883c02a8d0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.385+0000 7f8843200640 1 -- 172.21.15.84:0/612344972 shutdown_connections 2024-09-21T07:56:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.385+0000 7f8843200640 1 --2- 172.21.15.84:0/612344972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8844109c40 0x7f8844110470 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.385+0000 7f8843200640 1 --2- 172.21.15.84:0/612344972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88441092f0 0x7f8844109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.385+0000 7f8843200640 1 --2- 172.21.15.84:0/612344972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88441039b0 0x7f8844103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.385+0000 7f8843200640 1 -- 172.21.15.84:0/612344972 >> 172.21.15.84:0/612344972 conn(0x7f88440ff440 msgr2=0x7f8844101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.385+0000 7f8843200640 1 -- 172.21.15.84:0/612344972 shutdown_connections 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.385+0000 7f8843200640 1 -- 172.21.15.84:0/612344972 wait complete. 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.387+0000 7f8843200640 1 Processor -- start 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.388+0000 7f8843200640 1 -- start start 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.388+0000 7f8843200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88441039b0 0x7f8844074f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.388+0000 7f8843200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88441092f0 0x7f884406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.388+0000 7f8843200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109c40 0x7f884406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.388+0000 7f8843200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8844115bc0 con 0x7f8844109c40 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.388+0000 7f8843200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8844115a40 con 0x7f88441039b0 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.388+0000 7f8843200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8844115d40 con 0x7f88441092f0 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.389+0000 7f8841e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88441039b0 0x7f8844074f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.389+0000 7f8841e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88441039b0 0x7f8844074f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58456/0 (socket says 172.21.15.84:58456) 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.389+0000 7f8841e00640 1 -- 172.21.15.84:0/2805720411 learned_addr learned my addr 172.21.15.84:0/2805720411 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.389+0000 7f8841400640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88441092f0 0x7f884406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.393+0000 7f8841e00640 1 -- 172.21.15.84:0/2805720411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88441092f0 msgr2=0x7f884406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.394+0000 7f8841e00640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88441092f0 0x7f884406e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.394+0000 7f8841e00640 1 -- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109c40 msgr2=0x7f884406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.394+0000 7f8842800640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109c40 0x7f884406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.394+0000 7f8841e00640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109c40 0x7f884406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.394+0000 7f8841e00640 1 -- 172.21.15.84:0/2805720411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8844073b90 con 0x7f88441039b0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.396+0000 7f8842800640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109c40 0x7f884406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.397+0000 7f8841e00640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88441039b0 0x7f8844074f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b4a0 tx=0x7f882c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.398+0000 7f883aa00640 1 -- 172.21.15.84:0/2805720411 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c014070 con 0x7f88441039b0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.398+0000 7f883aa00640 1 -- 172.21.15.84:0/2805720411 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f882c010ac0 con 0x7f88441039b0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.398+0000 7f883aa00640 1 -- 172.21.15.84:0/2805720411 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c017c30 con 0x7f88441039b0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.401+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8844073e80 con 0x7f88441039b0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.401+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8844074340 con 0x7f88441039b0 2024-09-21T07:56:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.404+0000 7f883aa00640 1 -- 172.21.15.84:0/2805720411 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f882c017070 con 0x7f88441039b0 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.408+0000 7f883aa00640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f88280b6730 0x7f88280b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.409+0000 7f883aa00640 1 -- 172.21.15.84:0/2805720411 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f882c0e6d40 con 0x7f88441039b0 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.409+0000 7f8841400640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f88280b6730 0x7f88280b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.411+0000 7f8841400640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f88280b6730 0x7f88280b8c40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8834006fd0 tx=0x7f8834006ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.417+0000 7f884fe83740 1 Processor -- start 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.418+0000 7f884fe83740 1 -- start start 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.418+0000 7f884fe83740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5ccaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.418+0000 7f884fe83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed58fb1b0 0x561ed5ccb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f884fe83740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5903390 0x561ed5ccb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f8841e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5ccaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f8841e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5ccaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42670/0 (socket says 172.21.15.84:42670) 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f8841400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed58fb1b0 0x561ed5ccb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f8841400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed58fb1b0 0x561ed5ccb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58468/0 (socket says 172.21.15.84:58468) 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f8841e00640 1 -- 172.21.15.84:0/76525593 learned_addr learned my addr 172.21.15.84:0/76525593 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561ed5c41f70 con 0x561ed5903390 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561ed5c313a0 con 0x561ed58fb1b0 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.419+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561ed5c351b0 con 0x561ed5924070 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.420+0000 7f8841e00640 1 -- 172.21.15.84:0/76525593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed58fb1b0 msgr2=0x561ed5ccb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.420+0000 7f8841e00640 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed58fb1b0 0x561ed5ccb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.420+0000 7f8842800640 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5903390 0x561ed5ccb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.420+0000 7f8841e00640 1 -- 172.21.15.84:0/76525593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5903390 msgr2=0x561ed5ccb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.421+0000 7f8841e00640 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5903390 0x561ed5ccb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.421+0000 7f8841e00640 1 -- 172.21.15.84:0/76525593 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ed5bfbc90 con 0x561ed5924070 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.422+0000 7f8842800640 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5903390 0x561ed5ccb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.422+0000 7f8841e00640 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5ccaf30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ac7b0 tx=0x7f882c017650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e974f19b5373e968 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.423+0000 7f8833400640 1 -- 172.21.15.84:0/76525593 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ac330 con 0x561ed5924070 2024-09-21T07:56:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.424+0000 7f8833400640 1 -- 172.21.15.84:0/76525593 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f882c0acf20 con 0x561ed5924070 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.424+0000 7f8833400640 1 -- 172.21.15.84:0/76525593 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ac330 con 0x561ed5924070 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.425+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 msgr2=0x561ed5ccaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.425+0000 7f884fe83740 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5ccaf30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ac7b0 tx=0x7f882c017650 comp rx=0 tx=0).stop 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.425+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 shutdown_connections 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.425+0000 7f884fe83740 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5903390 0x561ed5ccb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.425+0000 7f884fe83740 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed58fb1b0 0x561ed5ccb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.425+0000 7f884fe83740 1 --2- 172.21.15.84:0/76525593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5ccaf30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.425+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 >> 172.21.15.84:0/76525593 conn(0x561ed5918460 msgr2=0x561ed5cc8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.426+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 shutdown_connections 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.426+0000 7f884fe83740 1 -- 172.21.15.84:0/76525593 wait complete. 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.427+0000 7f884fe83740 1 -- start start 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.427+0000 7f884fe83740 1 Processor -- start 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.429+0000 7f884fe83740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed58fb1b0 0x561ed5cd6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.429+0000 7f884fe83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.429+0000 7f884fe83740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5924070 0x561ed5ce29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.430+0000 7f884fe83740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561ed5a92700 con 0x561ed5924070 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.430+0000 7f8841e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed58fb1b0 0x561ed5cd6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.430+0000 7f884fe83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561ed5bcc540 con 0x561ed5903390 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.430+0000 7f884fe83740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561ed5cd96b0 con 0x561ed58fb1b0 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.430+0000 7f884fe83740 10 client.0 _ll_register_callbacks cb 0x561ed5bdc430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.431+0000 7f8841400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.431+0000 7f8841e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed58fb1b0 0x561ed5cd6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42680/0 (socket says 172.21.15.84:42680) 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.431+0000 7f8841e00640 1 -- 172.21.15.84:0/1142594005 learned_addr learned my addr 172.21.15.84:0/1142594005 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.433+0000 7f8842800640 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5924070 0x561ed5ce29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.433+0000 7f8841e00640 1 -- 172.21.15.84:0/1142594005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 msgr2=0x561ed5cd6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.433+0000 7f8841e00640 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.433+0000 7f8841e00640 1 -- 172.21.15.84:0/1142594005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5924070 msgr2=0x561ed5ce29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.433+0000 7f8841e00640 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5924070 0x561ed5ce29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.433+0000 7f8841e00640 1 -- 172.21.15.84:0/1142594005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ed598f650 con 0x561ed58fb1b0 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.435+0000 7f8841e00640 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed58fb1b0 0x561ed5cd6710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f882c0a8df0 tx=0x7f882c0e4650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240087c1ad9feaa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.435+0000 7f8827e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.435+0000 7f8827e00640 1 -- 172.21.15.84:0/1142594005 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ac330 con 0x561ed58fb1b0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.435+0000 7f8827e00640 1 -- 172.21.15.84:0/1142594005 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f882c0add50 con 0x561ed58fb1b0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.435+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561ed5bceb50 con 0x561ed58fb1b0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.436+0000 7f8827e00640 1 -- 172.21.15.84:0/1142594005 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f882c0acf20 con 0x561ed58fb1b0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.436+0000 7f884fe83740 10 client.27124 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.436+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ed5be9910 con 0x561ed58fb1b0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f8827e00640 1 -- 172.21.15.84:0/1142594005 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f882c0acf20 con 0x561ed58fb1b0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f8827e00640 1 -- 172.21.15.84:0/1142594005 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f882c0ab4f0 con 0x561ed58fb1b0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f884fe83740 10 client.27124 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f884fe83740 10 client.27124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f884fe83740 20 client.27124 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f884fe83740 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58e29f0 0x561ed5ce8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f884fe83740 4 client.27124 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.437+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ed5c43ec0 con 0x561ed58e29f0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.438+0000 7f8841400640 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58e29f0 0x561ed5ce8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.439+0000 7f8841400640 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58e29f0 0x561ed5ce8680 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b96d8b2ca91638 server_cookie=f9df4a79fdabc7b5 in_seq=0 out_seq=0 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.439+0000 7f8827e00640 10 client.27124 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.440+0000 7f8827e00640 1 -- 172.21.15.84:0/1142594005 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ed5c43ec0 con 0x561ed58e29f0 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.440+0000 7f8827e00640 10 client.27124 handle_command_reply: tid=0 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.440+0000 7f884fe83740 1 client.27124 shutdown 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.441+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed58fb1b0 msgr2=0x561ed5cd6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.441+0000 7f884fe83740 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed58fb1b0 0x561ed5cd6710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f882c0a8df0 tx=0x7f882c0e4650 comp rx=0 tx=0).stop 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.443+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 shutdown_connections 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.443+0000 7f884fe83740 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed5924070 0x561ed5ce29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.443+0000 7f884fe83740 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.443+0000 7f884fe83740 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58e29f0 0x561ed5ce8680 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.443+0000 7f884fe83740 1 --2- 172.21.15.84:0/1142594005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed58fb1b0 0x561ed5cd6710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.443+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 >> 172.21.15.84:0/1142594005 conn(0x561ed5918460 msgr2=0x561ed5cc75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.443+0000 7f8827e00640 0 client.27124 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.445+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 shutdown_connections 2024-09-21T07:56:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.445+0000 7f884fe83740 1 -- 172.21.15.84:0/1142594005 wait complete. 2024-09-21T07:56:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.445+0000 7f884fe83740 20 client.27124 trim_cache size 0 max 16384 2024-09-21T07:56:46.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.484+0000 7f884fe83740 1 Processor -- start 2024-09-21T07:56:46.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.484+0000 7f884fe83740 1 -- start start 2024-09-21T07:56:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.485+0000 7f884fe83740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5cd1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.486+0000 7f884fe83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.486+0000 7f884fe83740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5cd3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.486+0000 7f8841400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.486+0000 7f8841400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58486/0 (socket says 172.21.15.84:58486) 2024-09-21T07:56:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.487+0000 7f884fe83740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8844125be0 con 0x561ed58fb1b0 2024-09-21T07:56:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.487+0000 7f884fe83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88441ac430 con 0x561ed5903390 2024-09-21T07:56:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.487+0000 7f884fe83740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f88441262b0 con 0x561ed5924070 2024-09-21T07:56:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.487+0000 7f8841400640 1 -- 172.21.15.84:0/1567846000 learned_addr learned my addr 172.21.15.84:0/1567846000 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:46.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.488+0000 7f8842800640 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5cd3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.488+0000 7f8841e00640 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5cd1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.489+0000 7f8841e00640 1 -- 172.21.15.84:0/1567846000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 msgr2=0x561ed5cd3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.489+0000 7f8841e00640 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5cd3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.489+0000 7f8841e00640 1 -- 172.21.15.84:0/1567846000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 msgr2=0x561ed5cd85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.489+0000 7f8841e00640 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.489+0000 7f8841e00640 1 -- 172.21.15.84:0/1567846000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ed5cee970 con 0x561ed58fb1b0 2024-09-21T07:56:46.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.491+0000 7f8841e00640 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5cd1a80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ac4d0 tx=0x7f882c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9076bc3184a21a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:46.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.491+0000 7f8832a00640 1 -- 172.21.15.84:0/1567846000 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0acf20 con 0x561ed58fb1b0 2024-09-21T07:56:46.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.492+0000 7f8832a00640 1 -- 172.21.15.84:0/1567846000 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561ed5bceb50 con 0x561ed58fb1b0 2024-09-21T07:56:46.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.492+0000 7f8832a00640 1 -- 172.21.15.84:0/1567846000 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0acf20 con 0x561ed58fb1b0 2024-09-21T07:56:46.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.495+0000 7f884fe83740 1 -- 172.21.15.84:0/1567846000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 msgr2=0x561ed5cd1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.495+0000 7f884fe83740 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5cd1a80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ac4d0 tx=0x7f882c000bc0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.495+0000 7f884fe83740 1 -- 172.21.15.84:0/1567846000 shutdown_connections 2024-09-21T07:56:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.497+0000 7f884fe83740 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5924070 0x561ed5cd3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.497+0000 7f884fe83740 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5903390 0x561ed5cd85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.497+0000 7f884fe83740 1 --2- 172.21.15.84:0/1567846000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5cd1a80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.497+0000 7f884fe83740 1 -- 172.21.15.84:0/1567846000 >> 172.21.15.84:0/1567846000 conn(0x561ed5918460 msgr2=0x561ed5cd6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:46.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.497+0000 7f884fe83740 1 -- 172.21.15.84:0/1567846000 shutdown_connections 2024-09-21T07:56:46.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.498+0000 7f884fe83740 1 -- 172.21.15.84:0/1567846000 wait complete. 2024-09-21T07:56:46.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.498+0000 7f884fe83740 1 -- start start 2024-09-21T07:56:46.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.499+0000 7f884fe83740 1 Processor -- start 2024-09-21T07:56:46.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.502+0000 7f884fe83740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5ce7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.502+0000 7f884fe83740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5903390 0x561ed5ce8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.503+0000 7f884fe83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5924070 0x561ed5d5a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.503+0000 7f884fe83740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8844127050 con 0x561ed58fb1b0 2024-09-21T07:56:46.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.503+0000 7f8841400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5903390 0x561ed5ce8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.503+0000 7f8841400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5903390 0x561ed5ce8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:42684/0 (socket says 172.21.15.84:42684) 2024-09-21T07:56:46.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.504+0000 7f8841400640 1 -- 172.21.15.84:0/963279849 learned_addr learned my addr 172.21.15.84:0/963279849 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:46.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.504+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8844126980 con 0x561ed5924070 2024-09-21T07:56:46.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.504+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f884406f4f0 con 0x561ed5903390 2024-09-21T07:56:46.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.505+0000 7f884fe83740 10 client.0 _ll_register_callbacks cb 0x7f882c0ac240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:46.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.507+0000 7f8841e00640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5ce7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.507+0000 7f8842800640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5924070 0x561ed5d5a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.509+0000 7f8841400640 1 -- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5924070 msgr2=0x561ed5d5a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.509+0000 7f8841400640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5924070 0x561ed5d5a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.509+0000 7f8841400640 1 -- 172.21.15.84:0/963279849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 msgr2=0x561ed5ce7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.509+0000 7f8841400640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5ce7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.509+0000 7f8841400640 1 -- 172.21.15.84:0/963279849 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ed5d5ab40 con 0x561ed5903390 2024-09-21T07:56:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.511+0000 7f8842800640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5924070 0x561ed5d5a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:46.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.511+0000 7f8841e00640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5ce7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:46.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.511+0000 7f8827e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:46.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.512+0000 7f8841400640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5903390 0x561ed5ce8030 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f88340519a0 tx=0x7f88340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8341a17006974c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:46.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.512+0000 7f8827e00640 1 -- 172.21.15.84:0/963279849 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834071060 con 0x561ed5903390 2024-09-21T07:56:46.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.513+0000 7f8827e00640 1 -- 172.21.15.84:0/963279849 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f8834058710 con 0x561ed5903390 2024-09-21T07:56:46.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.513+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561ed5bceb50 con 0x561ed5903390 2024-09-21T07:56:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.514+0000 7f8827e00640 1 -- 172.21.15.84:0/963279849 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8834052040 con 0x561ed5903390 2024-09-21T07:56:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.514+0000 7f884fe83740 10 client.27130 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.514+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ed5d5bca0 con 0x561ed5903390 2024-09-21T07:56:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.514+0000 7f8827e00640 1 -- 172.21.15.84:0/963279849 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561ed5bceb50 con 0x561ed5903390 2024-09-21T07:56:46.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.516+0000 7f8827e00640 1 -- 172.21.15.84:0/963279849 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8834055030 con 0x561ed5903390 2024-09-21T07:56:46.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.516+0000 7f884fe83740 10 client.27130 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:46.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.516+0000 7f884fe83740 10 client.27130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:46.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.516+0000 7f884fe83740 20 client.27130 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:46.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.516+0000 7f884fe83740 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58b7da0 0x561ed5d5e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:46.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.517+0000 7f884fe83740 4 client.27130 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:56:46.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.517+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561ed5c3f970 con 0x561ed58b7da0 2024-09-21T07:56:46.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.517+0000 7f8841e00640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58b7da0 0x561ed5d5e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.519+0000 7f8841e00640 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58b7da0 0x561ed5d5e410 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92247ee66b7f0394 server_cookie=e2465695e6a741f3 in_seq=0 out_seq=0 2024-09-21T07:56:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.519+0000 7f8827e00640 10 client.27130 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.520+0000 7f8827e00640 1 -- 172.21.15.84:0/963279849 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x561ed5c3f970 con 0x561ed58b7da0 2024-09-21T07:56:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.520+0000 7f8827e00640 10 client.27130 handle_command_reply: tid=0 2024-09-21T07:56:46.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.521+0000 7f884fe83740 1 client.27130 shutdown 2024-09-21T07:56:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.522+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5903390 msgr2=0x561ed5ce8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.522+0000 7f884fe83740 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5903390 0x561ed5ce8030 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f88340519a0 tx=0x7f88340046c0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.526+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 shutdown_connections 2024-09-21T07:56:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.526+0000 7f884fe83740 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ed5924070 0x561ed5d5a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.526+0000 7f884fe83740 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x561ed58b7da0 0x561ed5d5e410 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.526+0000 7f884fe83740 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed5903390 0x561ed5ce8030 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.526+0000 7f884fe83740 1 --2- 172.21.15.84:0/963279849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ed58fb1b0 0x561ed5ce7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.526+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 >> 172.21.15.84:0/963279849 conn(0x561ed5918460 msgr2=0x561ed5cd6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.526+0000 7f8827e00640 0 client.27130 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.527+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 shutdown_connections 2024-09-21T07:56:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.527+0000 7f884fe83740 1 -- 172.21.15.84:0/963279849 wait complete. 2024-09-21T07:56:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.528+0000 7f884fe83740 20 client.27130 trim_cache size 0 max 16384 2024-09-21T07:56:46.532 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:56:46.532 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T07:56:46.533 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.535 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.536 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:56:46.537 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.535+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f88280b6730 msgr2=0x7f88280b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.535+0000 7f8843200640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f88280b6730 0x7f88280b8c40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8834006fd0 tx=0x7f8834006ec0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.535+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88441039b0 msgr2=0x7f8844074f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.535+0000 7f8843200640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88441039b0 0x7f8844074f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b4a0 tx=0x7f882c00b960 comp rx=0 tx=0).stop 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.536+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 shutdown_connections 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.536+0000 7f8843200640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f88280b6730 0x7f88280b8c40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.536+0000 7f8843200640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109c40 0x7f884406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.536+0000 7f8843200640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88441092f0 0x7f884406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.536+0000 7f8843200640 1 --2- 172.21.15.84:0/2805720411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88441039b0 0x7f8844074f20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.536+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 >> 172.21.15.84:0/2805720411 conn(0x7f88440ff440 msgr2=0x7f8844101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.537+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 shutdown_connections 2024-09-21T07:56:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:46.537+0000 7f8843200640 1 -- 172.21.15.84:0/2805720411 wait complete. 2024-09-21T07:56:47.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:47 smithi191 ceph-mon[34667]: pgmap v564: 129 pgs: 129 active+clean; 38 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 15 KiB/s rd, 173 MiB/s wr, 1.25k op/s 2024-09-21T07:56:47.665 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:47 smithi084 ceph-mon[30411]: pgmap v564: 129 pgs: 129 active+clean; 38 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 15 KiB/s rd, 173 MiB/s wr, 1.25k op/s 2024-09-21T07:56:47.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:47 smithi162 ceph-mon[34833]: pgmap v564: 129 pgs: 129 active+clean; 38 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 15 KiB/s rd, 173 MiB/s wr, 1.25k op/s 2024-09-21T07:56:49.629 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:56:49.630 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:56:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:49 smithi162 ceph-mon[34833]: pgmap v565: 129 pgs: 129 active+clean; 39 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 14 KiB/s rd, 161 MiB/s wr, 1.23k op/s 2024-09-21T07:56:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:49 smithi084 ceph-mon[30411]: pgmap v565: 129 pgs: 129 active+clean; 39 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 14 KiB/s rd, 161 MiB/s wr, 1.23k op/s 2024-09-21T07:56:49.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:49 smithi191 ceph-mon[34667]: pgmap v565: 129 pgs: 129 active+clean; 39 GiB data, 80 GiB used, 993 GiB / 1.0 TiB avail; 14 KiB/s rd, 161 MiB/s wr, 1.23k op/s 2024-09-21T07:56:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:51.446 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:51 smithi084 ceph-mon[30411]: pgmap v566: 129 pgs: 129 active+clean; 39 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 18 KiB/s rd, 173 MiB/s wr, 1.41k op/s 2024-09-21T07:56:51.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:51 smithi162 ceph-mon[34833]: pgmap v566: 129 pgs: 129 active+clean; 39 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 18 KiB/s rd, 173 MiB/s wr, 1.41k op/s 2024-09-21T07:56:51.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:51 smithi191 ceph-mon[34667]: pgmap v566: 129 pgs: 129 active+clean; 39 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 18 KiB/s rd, 173 MiB/s wr, 1.41k op/s 2024-09-21T07:56:53.776 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:53 smithi084 ceph-mon[30411]: pgmap v567: 129 pgs: 129 active+clean; 39 GiB data, 81 GiB used, 991 GiB / 1.0 TiB avail; 12 KiB/s rd, 170 MiB/s wr, 1.44k op/s 2024-09-21T07:56:53.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:53 smithi162 ceph-mon[34833]: pgmap v567: 129 pgs: 129 active+clean; 39 GiB data, 81 GiB used, 991 GiB / 1.0 TiB avail; 12 KiB/s rd, 170 MiB/s wr, 1.44k op/s 2024-09-21T07:56:53.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:53 smithi191 ceph-mon[34667]: pgmap v567: 129 pgs: 129 active+clean; 39 GiB data, 81 GiB used, 991 GiB / 1.0 TiB avail; 12 KiB/s rd, 170 MiB/s wr, 1.44k op/s 2024-09-21T07:56:54.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.038+0000 7f3b48600640 1 -- 172.21.15.84:0/184487598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010a650 msgr2=0x7f3b4010aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.039+0000 7f3b48600640 1 --2- 172.21.15.84:0/184487598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010a650 0x7f3b4010aa60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b340074e0 tx=0x7f3b3402b080 comp rx=0 tx=0).stop 2024-09-21T07:56:54.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.039+0000 7f3b48600640 1 -- 172.21.15.84:0/184487598 shutdown_connections 2024-09-21T07:56:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.039+0000 7f3b48600640 1 --2- 172.21.15.84:0/184487598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010d620 0x7f3b40117090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.039+0000 7f3b48600640 1 --2- 172.21.15.84:0/184487598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4010ccd0 0x7f3b4010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.039+0000 7f3b48600640 1 --2- 172.21.15.84:0/184487598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010a650 0x7f3b4010aa60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.039+0000 7f3b48600640 1 -- 172.21.15.84:0/184487598 >> 172.21.15.84:0/184487598 conn(0x7f3b40070ec0 msgr2=0x7f3b400712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.040+0000 7f3b48600640 1 -- 172.21.15.84:0/184487598 shutdown_connections 2024-09-21T07:56:54.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.040+0000 7f3b48600640 1 -- 172.21.15.84:0/184487598 wait complete. 2024-09-21T07:56:54.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.042+0000 7f3b48600640 1 Processor -- start 2024-09-21T07:56:54.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.044+0000 7f3b48600640 1 -- start start 2024-09-21T07:56:54.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.045+0000 7f3b48600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010a650 0x7f3b40114610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.046+0000 7f3b48600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010ccd0 0x7f3b40114b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.046+0000 7f3b48600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4010d620 0x7f3b40115090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.046+0000 7f3b45c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010a650 0x7f3b40114610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.046+0000 7f3b45c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010a650 0x7f3b40114610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56354/0 (socket says 172.21.15.84:56354) 2024-09-21T07:56:54.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.047+0000 7f3b48600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40119ea0 con 0x7f3b4010d620 2024-09-21T07:56:54.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.047+0000 7f3b48600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40119d20 con 0x7f3b4010a650 2024-09-21T07:56:54.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.047+0000 7f3b48600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4011a020 con 0x7f3b4010ccd0 2024-09-21T07:56:54.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.047+0000 7f3b45200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010ccd0 0x7f3b40114b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.047+0000 7f3b45200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010ccd0 0x7f3b40114b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:44978/0 (socket says 172.21.15.84:44978) 2024-09-21T07:56:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.047+0000 7f3b45200640 1 -- 172.21.15.84:0/2897606690 learned_addr learned my addr 172.21.15.84:0/2897606690 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:54.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.048+0000 7f3b46600640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4010d620 0x7f3b40115090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.048+0000 7f3b45c00640 1 -- 172.21.15.84:0/2897606690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010ccd0 msgr2=0x7f3b40114b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.048+0000 7f3b45c00640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010ccd0 0x7f3b40114b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.048+0000 7f3b45c00640 1 -- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4010d620 msgr2=0x7f3b40115090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.048+0000 7f3b45c00640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4010d620 0x7f3b40115090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.048+0000 7f3b45c00640 1 -- 172.21.15.84:0/2897606690 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b401b54b0 con 0x7f3b4010a650 2024-09-21T07:56:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.050+0000 7f3b45c00640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010a650 0x7f3b40114610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3b34006010 tx=0x7f3b3402bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.051+0000 7f3b3e000640 1 -- 172.21.15.84:0/2897606690 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340046c0 con 0x7f3b4010a650 2024-09-21T07:56:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.055+0000 7f3b3e000640 1 -- 172.21.15.84:0/2897606690 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b3400a580 con 0x7f3b4010a650 2024-09-21T07:56:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.055+0000 7f3b3e000640 1 -- 172.21.15.84:0/2897606690 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340084e0 con 0x7f3b4010a650 2024-09-21T07:56:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.055+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b401b5740 con 0x7f3b4010a650 2024-09-21T07:56:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.055+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b401b5ba0 con 0x7f3b4010a650 2024-09-21T07:56:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.058+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4010aa60 con 0x7f3b4010a650 2024-09-21T07:56:54.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.064+0000 7f3b3e000640 1 -- 172.21.15.84:0/2897606690 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3b34043020 con 0x7f3b4010a650 2024-09-21T07:56:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.067+0000 7f3b3e000640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b280b6850 0x7f3b280b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.068+0000 7f3b3e000640 1 -- 172.21.15.84:0/2897606690 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7f3b34106db0 con 0x7f3b4010a650 2024-09-21T07:56:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.068+0000 7f3b45200640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b280b6850 0x7f3b280b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.068+0000 7f3b3e000640 1 -- 172.21.15.84:0/2897606690 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b3404a020 con 0x7f3b4010a650 2024-09-21T07:56:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.070+0000 7f3b45200640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b280b6850 0x7f3b280b8d60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b40074b80 tx=0x7f3b2c009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.474+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b4011d0c0 con 0x7f3b4010a650 2024-09-21T07:56:54.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.476+0000 7f3b3e000640 1 -- 172.21.15.84:0/2897606690 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f3b340cd010 con 0x7f3b4010a650 2024-09-21T07:56:54.483 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:56:54.483 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:56:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:56:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.480+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b280b6850 msgr2=0x7f3b280b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.480+0000 7f3b48600640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b280b6850 0x7f3b280b8d60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b40074b80 tx=0x7f3b2c009190 comp rx=0 tx=0).stop 2024-09-21T07:56:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.480+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010a650 msgr2=0x7f3b40114610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.480+0000 7f3b48600640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010a650 0x7f3b40114610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3b34006010 tx=0x7f3b3402bbf0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 shutdown_connections 2024-09-21T07:56:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b280b6850 0x7f3b280b8d60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4010d620 0x7f3b40115090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b4010ccd0 0x7f3b40114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 --2- 172.21.15.84:0/2897606690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4010a650 0x7f3b40114610 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 >> 172.21.15.84:0/2897606690 conn(0x7f3b40070ec0 msgr2=0x7f3b4010ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 shutdown_connections 2024-09-21T07:56:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:54.481+0000 7f3b48600640 1 -- 172.21.15.84:0/2897606690 wait complete. 2024-09-21T07:56:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.693+0000 7fa205200640 1 -- 172.21.15.84:0/2485209766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2001079f0 msgr2=0x7fa200107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.693+0000 7fa205200640 1 --2- 172.21.15.84:0/2485209766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2001079f0 0x7fa200107e60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009ca0 tx=0x7fa1f802a8d0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.695+0000 7fa205200640 1 -- 172.21.15.84:0/2485209766 shutdown_connections 2024-09-21T07:56:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.695+0000 7fa205200640 1 --2- 172.21.15.84:0/2485209766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2001079f0 0x7fa200107e60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.695+0000 7fa205200640 1 --2- 172.21.15.84:0/2485209766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 0x7fa2001073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.695+0000 7fa205200640 1 --2- 172.21.15.84:0/2485209766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa200102530 0x7fa200102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.695+0000 7fa205200640 1 -- 172.21.15.84:0/2485209766 >> 172.21.15.84:0/2485209766 conn(0x7fa2000fe230 msgr2=0x7fa200100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.696+0000 7fa205200640 1 -- 172.21.15.84:0/2485209766 shutdown_connections 2024-09-21T07:56:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.697+0000 7fa205200640 1 -- 172.21.15.84:0/2485209766 wait complete. 2024-09-21T07:56:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.698+0000 7fa205200640 1 Processor -- start 2024-09-21T07:56:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.699+0000 7fa205200640 1 -- start start 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.700+0000 7fa205200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa200102530 0x7fa200116a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.700+0000 7fa205200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 0x7fa20010fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.700+0000 7fa205200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2001079f0 0x7fa200110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.700+0000 7fa205200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa200119e30 con 0x7fa2001079f0 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.700+0000 7fa205200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa200119cb0 con 0x7fa200102e80 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.700+0000 7fa205200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa200119fb0 con 0x7fa200102530 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.702+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 0x7fa20010fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.702+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 0x7fa20010fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56372/0 (socket says 172.21.15.84:56372) 2024-09-21T07:56:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.702+0000 7fa1fea00640 1 -- 172.21.15.84:0/3493082526 learned_addr learned my addr 172.21.15.84:0/3493082526 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1fea00640 1 -- 172.21.15.84:0/3493082526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa200102530 msgr2=0x7fa200116a20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1ff400640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa200102530 0x7fa200116a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2001079f0 0x7fa200110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1fea00640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa200102530 0x7fa200116a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1fea00640 1 -- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2001079f0 msgr2=0x7fa200110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1fea00640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2001079f0 0x7fa200110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1fea00640 1 -- 172.21.15.84:0/3493082526 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa200110a80 con 0x7fa200102e80 2024-09-21T07:56:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.703+0000 7fa1ff400640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa200102530 0x7fa200116a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.704+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2001079f0 0x7fa200110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.704+0000 7fa1fea00640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 0x7fa20010fce0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00e9c0 tx=0x7fa1ec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.707+0000 7fa1f7e00640 1 -- 172.21.15.84:0/3493082526 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00ccc0 con 0x7fa200102e80 2024-09-21T07:56:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.707+0000 7fa1f7e00640 1 -- 172.21.15.84:0/3493082526 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1ec0054d0 con 0x7fa200102e80 2024-09-21T07:56:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.707+0000 7fa1f7e00640 1 -- 172.21.15.84:0/3493082526 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec010430 con 0x7fa200102e80 2024-09-21T07:56:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.707+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa200115740 con 0x7fa200102e80 2024-09-21T07:56:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.708+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa200115c40 con 0x7fa200102e80 2024-09-21T07:56:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.717+0000 7fa20d7cb740 1 Processor -- start 2024-09-21T07:56:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.718+0000 7fa20d7cb740 1 -- start start 2024-09-21T07:56:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.718+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44c9be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.719+0000 7fa1f7e00640 1 -- 172.21.15.84:0/3493082526 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa1ec0046c0 con 0x7fa200102e80 2024-09-21T07:56:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44c9be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44c9be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:44994/0 (socket says 172.21.15.84:44994) 2024-09-21T07:56:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 0x555b44c9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa1ffe00640 1 -- 172.21.15.84:0/3021510312 learned_addr learned my addr 172.21.15.84:0/3021510312 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448d64d0 0x555b44c9c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555b44c116b0 con 0x555b448d64d0 2024-09-21T07:56:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555b44c00ae0 con 0x555b448ce2f0 2024-09-21T07:56:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.721+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555b44c048f0 con 0x555b448f71b0 2024-09-21T07:56:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.722+0000 7fa1ffe00640 1 -- 172.21.15.84:0/3021510312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 msgr2=0x555b44c9c350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:56:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.722+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 0x555b44c9c350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.722+0000 7fa1ffe00640 1 -- 172.21.15.84:0/3021510312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448d64d0 msgr2=0x555b44c9c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.722+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448d64d0 0x555b44c9c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.722+0000 7fa1ffe00640 1 -- 172.21.15.84:0/3021510312 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b44bcd780 con 0x555b448f71b0 2024-09-21T07:56:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.724+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44c9be10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009860 tx=0x7fa1f8009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8591629201b12e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.725+0000 7fa1f7e00640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1e40b67d0 0x7fa1e40b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.725+0000 7fa1f7e00640 1 -- 172.21.15.84:0/3493082526 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa1ec0e7e70 con 0x7fa200102e80 2024-09-21T07:56:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.726+0000 7fa1f4c00640 1 -- 172.21.15.84:0/3021510312 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8031460 con 0x555b448f71b0 2024-09-21T07:56:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.726+0000 7fa1f4c00640 1 -- 172.21.15.84:0/3021510312 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f8036040 con 0x555b448f71b0 2024-09-21T07:56:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.726+0000 7fa1f4c00640 1 -- 172.21.15.84:0/3021510312 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f803b400 con 0x555b448f71b0 2024-09-21T07:56:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.732+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 msgr2=0x555b44c9be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.732+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44c9be10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009860 tx=0x7fa1f8009890 comp rx=0 tx=0).stop 2024-09-21T07:56:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.733+0000 7fa1ff400640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1e40b67d0 0x7fa1e40b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.735+0000 7fa1ff400640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1e40b67d0 0x7fa1e40b8ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x555b44c9aa90 tx=0x7fa1f0005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.735+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 shutdown_connections 2024-09-21T07:56:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.735+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448d64d0 0x555b44c9c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.735+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 0x555b44c9c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.735+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3021510312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44c9be10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.735+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 >> 172.21.15.84:0/3021510312 conn(0x555b448eb300 msgr2=0x555b44c99d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.739+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 shutdown_connections 2024-09-21T07:56:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.741+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3021510312 wait complete. 2024-09-21T07:56:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.742+0000 7fa20d7cb740 1 -- start start 2024-09-21T07:56:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.742+0000 7fa20d7cb740 1 Processor -- start 2024-09-21T07:56:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 0x555b44ca74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.750 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44ca7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448f71b0 0x555b44cb3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555b44b38ab0 con 0x555b448f71b0 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555b44ba7570 con 0x555b448ce2f0 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555b44caa530 con 0x555b448d64d0 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa20d7cb740 10 client.0 _ll_register_callbacks cb 0x555b44bb6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44ca7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44ca7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:45010/0 (socket says 172.21.15.84:45010) 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.747+0000 7fa1fea00640 1 -- 172.21.15.84:0/3323358529 learned_addr learned my addr 172.21.15.84:0/3323358529 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.748+0000 7fa1fea00640 1 -- 172.21.15.84:0/3323358529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 msgr2=0x555b44ca74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.748+0000 7fa1fea00640 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 0x555b44ca74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.748+0000 7fa1fea00640 1 -- 172.21.15.84:0/3323358529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448f71b0 msgr2=0x555b44cb3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.748+0000 7fa1fea00640 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448f71b0 0x555b44cb3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.752+0000 7fa1fea00640 1 -- 172.21.15.84:0/3323358529 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b44962790 con 0x555b448d64d0 2024-09-21T07:56:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.753+0000 7fa1fea00640 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44ca7a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec004650 tx=0x7fa1ec0ad3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99a433bf702e519 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.754+0000 7fa1e9600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.754+0000 7fa1e9600640 1 -- 172.21.15.84:0/3323358529 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0acdf0 con 0x555b448d64d0 2024-09-21T07:56:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.755+0000 7fa1e9600640 1 -- 172.21.15.84:0/3323358529 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa1ec004fe0 con 0x555b448d64d0 2024-09-21T07:56:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.755+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f8036040 con 0x555b448d64d0 2024-09-21T07:56:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.755+0000 7fa1e9600640 1 -- 172.21.15.84:0/3323358529 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1ec005680 con 0x555b448d64d0 2024-09-21T07:56:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.756+0000 7fa20d7cb740 10 client.27145 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.756+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b449db620 con 0x555b448d64d0 2024-09-21T07:56:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.756+0000 7fa1e9600640 1 -- 172.21.15.84:0/3323358529 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f8036040 con 0x555b448d64d0 2024-09-21T07:56:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.757+0000 7fa1e9600640 1 -- 172.21.15.84:0/3323358529 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa1ec0a92e0 con 0x555b448d64d0 2024-09-21T07:56:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.757+0000 7fa20d7cb740 10 client.27145 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.757+0000 7fa20d7cb740 10 client.27145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.757+0000 7fa20d7cb740 20 client.27145 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.758+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b448b5d80 0x555b44cb95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.758+0000 7fa20d7cb740 4 client.27145 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.758+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b44c13600 con 0x555b448b5d80 2024-09-21T07:56:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.759+0000 7fa1ff400640 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b448b5d80 0x555b44cb95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.759+0000 7fa1ff400640 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b448b5d80 0x555b44cb95c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def0a7159716941 server_cookie=c39600704b98c97c in_seq=0 out_seq=0 2024-09-21T07:56:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.762+0000 7fa1e9600640 10 client.27145 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.763+0000 7fa1e9600640 1 -- 172.21.15.84:0/3323358529 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b44c13600 con 0x555b448b5d80 2024-09-21T07:56:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.763+0000 7fa1e9600640 10 client.27145 handle_command_reply: tid=0 2024-09-21T07:56:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.763+0000 7fa20d7cb740 1 client.27145 shutdown 2024-09-21T07:56:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.767+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 msgr2=0x555b44ca7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.767+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44ca7a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec004650 tx=0x7fa1ec0ad3a0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.771 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.770+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 shutdown_connections 2024-09-21T07:56:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.770+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448f71b0 0x555b44cb3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.770+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b448b5d80 0x555b44cb95c0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.770+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44ca7a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.770+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3323358529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448ce2f0 0x555b44ca74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.770+0000 7fa1e9600640 0 client.27145 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.770+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 >> 172.21.15.84:0/3323358529 conn(0x555b448eb300 msgr2=0x555b44c9ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.774 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.772+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 shutdown_connections 2024-09-21T07:56:54.774 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.773+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3323358529 wait complete. 2024-09-21T07:56:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.773+0000 7fa20d7cb740 20 client.27145 trim_cache size 0 max 16384 2024-09-21T07:56:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.806+0000 7fa20d7cb740 1 Processor -- start 2024-09-21T07:56:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa20d7cb740 1 -- start start 2024-09-21T07:56:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44ca79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448d64d0 0x555b44ca9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44cb3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001bf880 con 0x555b448ce2f0 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001c13c0 con 0x555b448d64d0 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001bff50 con 0x555b448f71b0 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448d64d0 0x555b44ca9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa1ff400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44ca79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.807+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44cb3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448d64d0 0x555b44ca9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56400/0 (socket says 172.21.15.84:56400) 2024-09-21T07:56:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1fea00640 1 -- 172.21.15.84:0/3079474179 learned_addr learned my addr 172.21.15.84:0/3079474179 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1ffe00640 1 -- 172.21.15.84:0/3079474179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448d64d0 msgr2=0x555b44ca9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448d64d0 0x555b44ca9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1ffe00640 1 -- 172.21.15.84:0/3079474179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 msgr2=0x555b44ca79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44ca79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1ffe00640 1 -- 172.21.15.84:0/3079474179 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b44ca9e10 con 0x555b448f71b0 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1ff400640 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44ca79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1fea00640 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448d64d0 0x555b44ca9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.808+0000 7fa1ffe00640 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44cb3720 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009ca0 tx=0x7fa1f8009540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf30021d75127d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.809+0000 7fa1ebe00640 1 -- 172.21.15.84:0/3079474179 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f804b070 con 0x555b448f71b0 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.809+0000 7fa1ebe00640 1 -- 172.21.15.84:0/3079474179 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f8036040 con 0x555b448f71b0 2024-09-21T07:56:54.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.809+0000 7fa1ebe00640 1 -- 172.21.15.84:0/3079474179 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80506c0 con 0x555b448f71b0 2024-09-21T07:56:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.810+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3079474179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 msgr2=0x555b44cb3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.810+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44cb3720 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009ca0 tx=0x7fa1f8009540 comp rx=0 tx=0).stop 2024-09-21T07:56:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.810+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3079474179 shutdown_connections 2024-09-21T07:56:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.810+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448f71b0 0x555b44cb3720 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.810+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448d64d0 0x555b44ca9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.810+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/3079474179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44ca79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.810+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3079474179 >> 172.21.15.84:0/3079474179 conn(0x555b448eb300 msgr2=0x555b44ca8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.811+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3079474179 shutdown_connections 2024-09-21T07:56:54.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.811+0000 7fa20d7cb740 1 -- 172.21.15.84:0/3079474179 wait complete. 2024-09-21T07:56:54.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.811+0000 7fa20d7cb740 1 -- start start 2024-09-21T07:56:54.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 1 Processor -- start 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44cab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44cab640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448f71b0 0x555b44d1bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001c0cf0 con 0x555b448ce2f0 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001c0620 con 0x555b448f71b0 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001bd840 con 0x555b448d64d0 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.812+0000 7fa20d7cb740 10 client.0 _ll_register_callbacks cb 0x7fa1ec0a9fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44cab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1fea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44cab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44cab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59976/0 (socket says 172.21.15.84:59976) 2024-09-21T07:56:54.815 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 -- 172.21.15.84:0/1414176406 learned_addr learned my addr 172.21.15.84:0/1414176406 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 -- 172.21.15.84:0/1414176406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 msgr2=0x555b44cab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44cab640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 -- 172.21.15.84:0/1414176406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448f71b0 msgr2=0x555b44d1bfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448f71b0 0x555b44d1bfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1ff400640 1 -- 172.21.15.84:0/1414176406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b44d1c610 con 0x555b448ce2f0 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.813+0000 7fa1fea00640 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44cab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.814+0000 7fa1ff400640 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44cab080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x555b44cb9d10 tx=0x7fa1f000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c827bdc7319d0e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:54.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.814+0000 7fa1e9600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:56:54.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.814+0000 7fa1e9600640 1 -- 172.21.15.84:0/1414176406 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f001f450 con 0x555b448ce2f0 2024-09-21T07:56:54.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.814+0000 7fa1e9600640 1 -- 172.21.15.84:0/1414176406 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fa1f001f5f0 con 0x555b448ce2f0 2024-09-21T07:56:54.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.814+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f8036040 con 0x555b448ce2f0 2024-09-21T07:56:54.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.815+0000 7fa1e9600640 1 -- 172.21.15.84:0/1414176406 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1f0037050 con 0x555b448ce2f0 2024-09-21T07:56:54.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.815+0000 7fa20d7cb740 10 client.16923 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:54.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.815+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b44d239d0 con 0x555b448ce2f0 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.815+0000 7fa1e9600640 1 -- 172.21.15.84:0/1414176406 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f8036040 con 0x555b448ce2f0 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.815+0000 7fa1e9600640 1 -- 172.21.15.84:0/1414176406 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa1f000f040 con 0x555b448ce2f0 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.815+0000 7fa20d7cb740 10 client.16923 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.815+0000 7fa20d7cb740 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.816+0000 7fa20d7cb740 20 client.16923 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.816+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b4488b1c0 0x555b44d26170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.816+0000 7fa20d7cb740 4 client.16923 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:56:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.816+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555b44c0f0b0 con 0x555b4488b1c0 2024-09-21T07:56:54.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.817+0000 7fa1fea00640 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b4488b1c0 0x555b44d26170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:54.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.818+0000 7fa1fea00640 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b4488b1c0 0x555b44d26170 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=763e1da0771f736d server_cookie=d9e12810b299b7e5 in_seq=0 out_seq=0 2024-09-21T07:56:54.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.819+0000 7fa1e9600640 10 client.16923 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.846+0000 7fa1e9600640 1 -- 172.21.15.84:0/1414176406 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555b44c0f0b0 con 0x555b4488b1c0 2024-09-21T07:56:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.846+0000 7fa1e9600640 10 client.16923 handle_command_reply: tid=0 2024-09-21T07:56:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.846+0000 7fa20d7cb740 1 client.16923 shutdown 2024-09-21T07:56:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.847+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 msgr2=0x555b44cab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.847+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44cab080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x555b44cb9d10 tx=0x7fa1f000e890 comp rx=0 tx=0).stop 2024-09-21T07:56:54.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.854+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 shutdown_connections 2024-09-21T07:56:54.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.854+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b448f71b0 0x555b44d1bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.854+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555b4488b1c0 0x555b44d26170 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.854+0000 7fa1e9600640 0 client.16923 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:56:54.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.854+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555b448d64d0 0x555b44cab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.858 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.854+0000 7fa20d7cb740 1 --2- 172.21.15.84:0/1414176406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555b448ce2f0 0x555b44cab080 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.858 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.854+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 >> 172.21.15.84:0/1414176406 conn(0x555b448eb300 msgr2=0x555b44c9ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.861+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 shutdown_connections 2024-09-21T07:56:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.862+0000 7fa20d7cb740 1 -- 172.21.15.84:0/1414176406 wait complete. 2024-09-21T07:56:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.862+0000 7fa20d7cb740 20 client.16923 trim_cache size 0 max 16384 2024-09-21T07:56:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:56:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:56:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:56:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:56:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1e40b67d0 msgr2=0x7fa1e40b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1e40b67d0 0x7fa1e40b8ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x555b44c9aa90 tx=0x7fa1f0005e50 comp rx=0 tx=0).stop 2024-09-21T07:56:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 msgr2=0x7fa20010fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 0x7fa20010fce0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00e9c0 tx=0x7fa1ec00ee80 comp rx=0 tx=0).stop 2024-09-21T07:56:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 shutdown_connections 2024-09-21T07:56:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1e40b67d0 0x7fa1e40b8ce0 secure :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0x555b44c9aa90 tx=0x7fa1f0005e50 comp rx=0 tx=0).stop 2024-09-21T07:56:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2001079f0 0x7fa200110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200102e80 0x7fa20010fce0 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00e9c0 tx=0x7fa1ec00ee80 comp rx=0 tx=0).stop 2024-09-21T07:56:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 --2- 172.21.15.84:0/3493082526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa200102530 0x7fa200116a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 >> 172.21.15.84:0/3493082526 conn(0x7fa2000fe230 msgr2=0x7fa200105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 shutdown_connections 2024-09-21T07:56:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:56:54.866+0000 7fa205200640 1 -- 172.21.15.84:0/3493082526 wait complete. 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: pgmap v568: 129 pgs: 129 active+clean; 40 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 26 KiB/s rd, 199 MiB/s wr, 1.65k op/s 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2897606690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:55 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: pgmap v568: 129 pgs: 129 active+clean; 40 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 26 KiB/s rd, 199 MiB/s wr, 1.65k op/s 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2897606690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:55 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: pgmap v568: 129 pgs: 129 active+clean; 40 GiB data, 82 GiB used, 991 GiB / 1.0 TiB avail; 26 KiB/s rd, 199 MiB/s wr, 1.65k op/s 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2897606690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:55.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:55 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:56:56.723 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:56 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi191 to 176.0M 2024-09-21T07:56:56.723 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:56 smithi084 ceph-mon[30411]: Unable to set osd_memory_target on smithi191 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-21T07:56:56.723 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:56 smithi084 ceph-mon[30411]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-21T07:56:56.724 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:56 smithi084 ceph-mon[30411]: Unable to set osd_memory_target on smithi162 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-21T07:56:56.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:56:56.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:56 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi191 to 176.0M 2024-09-21T07:56:56.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:56 smithi162 ceph-mon[34833]: Unable to set osd_memory_target on smithi191 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-21T07:56:56.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:56 smithi162 ceph-mon[34833]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-21T07:56:56.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:56 smithi162 ceph-mon[34833]: Unable to set osd_memory_target on smithi162 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-21T07:56:56.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:56 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi191 to 176.0M 2024-09-21T07:56:56.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:56 smithi191 ceph-mon[34667]: Unable to set osd_memory_target on smithi191 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-21T07:56:56.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:56 smithi191 ceph-mon[34667]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-21T07:56:56.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:56 smithi191 ceph-mon[34667]: Unable to set osd_memory_target on smithi162 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-21T07:56:57.675 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:56:57.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:57 smithi162 ceph-mon[34833]: pgmap v569: 129 pgs: 129 active+clean; 40 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 22 KiB/s rd, 209 MiB/s wr, 1.63k op/s 2024-09-21T07:56:57.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:57.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:57.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:56:57.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:57 smithi084 ceph-mon[30411]: pgmap v569: 129 pgs: 129 active+clean; 40 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 22 KiB/s rd, 209 MiB/s wr, 1.63k op/s 2024-09-21T07:56:57.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:57.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:57.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:56:57.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:57 smithi191 ceph-mon[34667]: pgmap v569: 129 pgs: 129 active+clean; 40 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 22 KiB/s rd, 209 MiB/s wr, 1.63k op/s 2024-09-21T07:56:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:56:59.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 -- 172.21.15.84:0/3590452557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde641094b0 msgr2=0x7fde641098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 --2- 172.21.15.84:0/3590452557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde641094b0 0x7fde641098c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fde50009900 tx=0x7fde5002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 -- 172.21.15.84:0/3590452557 shutdown_connections 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 --2- 172.21.15.84:0/3590452557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde64109e00 0x7fde64110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 --2- 172.21.15.84:0/3590452557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde641094b0 0x7fde641098c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 --2- 172.21.15.84:0/3590452557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde64103b70 0x7fde64103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 -- 172.21.15.84:0/3590452557 >> 172.21.15.84:0/3590452557 conn(0x7fde640ff5e0 msgr2=0x7fde64101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 -- 172.21.15.84:0/3590452557 shutdown_connections 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.273+0000 7fde6c200640 1 -- 172.21.15.84:0/3590452557 wait complete. 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.274+0000 7fde6c200640 1 Processor -- start 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.274+0000 7fde6c200640 1 -- start start 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde6c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde64103b70 0x7fde6419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde6c200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde641094b0 0x7fde6419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde6c200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde64109e00 0x7fde641a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde6c200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fde64113ac0 con 0x7fde641094b0 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde6c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde64113940 con 0x7fde64103b70 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde6c200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde64113c40 con 0x7fde64109e00 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde68e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde641094b0 0x7fde6419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde68e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde641094b0 0x7fde6419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48776/0 (socket says 172.21.15.84:48776) 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde68e00640 1 -- 172.21.15.84:0/146631795 learned_addr learned my addr 172.21.15.84:0/146631795 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde69800640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde64103b70 0x7fde6419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde6a200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde64109e00 0x7fde641a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde68e00640 1 -- 172.21.15.84:0/146631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde64109e00 msgr2=0x7fde641a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde68e00640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde64109e00 0x7fde641a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde68e00640 1 -- 172.21.15.84:0/146631795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde64103b70 msgr2=0x7fde6419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.275+0000 7fde68e00640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde64103b70 0x7fde6419c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.276+0000 7fde68e00640 1 -- 172.21.15.84:0/146631795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde641a2660 con 0x7fde641094b0 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.276+0000 7fde6a200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde64109e00 0x7fde641a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:59.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.276+0000 7fde69800640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde64103b70 0x7fde6419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.276+0000 7fde68e00640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde641094b0 0x7fde6419cc90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fde5002a910 tx=0x7fde50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.276+0000 7fde62000640 1 -- 172.21.15.84:0/146631795 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5003f030 con 0x7fde641094b0 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.276+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde641a28f0 con 0x7fde641094b0 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.277+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde641a90b0 con 0x7fde641094b0 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.277+0000 7fde62000640 1 -- 172.21.15.84:0/146631795 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde50003aa0 con 0x7fde641094b0 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.277+0000 7fde62000640 1 -- 172.21.15.84:0/146631795 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50035070 con 0x7fde641094b0 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.286+0000 7fde62000640 1 -- 172.21.15.84:0/146631795 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fde50042030 con 0x7fde641094b0 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.286+0000 7fde72e16740 1 Processor -- start 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.287+0000 7fde72e16740 1 -- start start 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.287+0000 7fde72e16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b7e1070 0x561f7bb87ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.287+0000 7fde72e16740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bb880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.287+0000 7fde72e16740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7c0390 0x561f7bb88620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.287+0000 7fde72e16740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561f7bafefb0 con 0x561f7b7c0390 2024-09-21T07:56:59.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.288+0000 7fde72e16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561f7baee3e0 con 0x561f7b7e1070 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.288+0000 7fde68e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7c0390 0x561f7bb88620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.288+0000 7fde68e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7c0390 0x561f7bb88620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48790/0 (socket says 172.21.15.84:48790) 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.288+0000 7fde68e00640 1 -- 172.21.15.84:0/4124972969 learned_addr learned my addr 172.21.15.84:0/4124972969 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.289+0000 7fde72e16740 1 -- 172.21.15.84:0/4124972969 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561f7baf21f0 con 0x561f7b7b81b0 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.289+0000 7fde69800640 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bb880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.290+0000 7fde62000640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fde4c0b6700 0x7fde4c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.290+0000 7fde68e00640 1 -- 172.21.15.84:0/4124972969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 msgr2=0x561f7bb880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.290+0000 7fde68e00640 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bb880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.290+0000 7fde68e00640 1 -- 172.21.15.84:0/4124972969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b7e1070 msgr2=0x561f7bb87ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.290+0000 7fde68e00640 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b7e1070 0x561f7bb87ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.290+0000 7fde68e00640 1 -- 172.21.15.84:0/4124972969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7bab8cd0 con 0x561f7b7c0390 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.291+0000 7fde62000640 1 -- 172.21.15.84:0/146631795 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fde50107d80 con 0x7fde641094b0 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.292+0000 7fde68e00640 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7c0390 0x561f7bb88620 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fde501050a0 tx=0x7fde50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43bd0b3f519da38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.292+0000 7fde56a00640 1 -- 172.21.15.84:0/4124972969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde500ce710 con 0x561f7b7c0390 2024-09-21T07:56:59.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.293+0000 7fde56a00640 1 -- 172.21.15.84:0/4124972969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde500ce450 con 0x561f7b7c0390 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.294+0000 7fde6a200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fde4c0b6700 0x7fde4c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.296+0000 7fde56a00640 1 -- 172.21.15.84:0/4124972969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5004b300 con 0x561f7b7c0390 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.296+0000 7fde72e16740 1 -- 172.21.15.84:0/4124972969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7c0390 msgr2=0x561f7bb88620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.297+0000 7fde6a200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fde4c0b6700 0x7fde4c0b8c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009370 tx=0x7fde5c009590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.297+0000 7fde72e16740 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7c0390 0x561f7bb88620 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fde501050a0 tx=0x7fde50000bc0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.297+0000 7fde72e16740 1 -- 172.21.15.84:0/4124972969 shutdown_connections 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.298+0000 7fde72e16740 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7c0390 0x561f7bb88620 secure :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fde501050a0 tx=0x7fde50000bc0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.298+0000 7fde72e16740 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bb880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.298+0000 7fde72e16740 1 --2- 172.21.15.84:0/4124972969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b7e1070 0x561f7bb87ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.298+0000 7fde72e16740 1 -- 172.21.15.84:0/4124972969 >> 172.21.15.84:0/4124972969 conn(0x561f7b7d5460 msgr2=0x561f7bb85a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.298+0000 7fde72e16740 1 -- 172.21.15.84:0/4124972969 shutdown_connections 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.299+0000 7fde72e16740 1 -- 172.21.15.84:0/4124972969 wait complete. 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.300+0000 7fde72e16740 1 -- start start 2024-09-21T07:56:59.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.300+0000 7fde72e16740 1 Processor -- start 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.301+0000 7fde72e16740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bba4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde72e16740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bba4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde72e16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde68e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bba4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde72e16740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561f7b94f700 con 0x561f7b7b81b0 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde72e16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561f7ba89580 con 0x561f7b79f9f0 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde72e16740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561f7bafefb0 con 0x561f7b7e1070 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde6a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde6a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57396/0 (socket says 172.21.15.84:57396) 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.302+0000 7fde6a200640 1 -- 172.21.15.84:0/2571316720 learned_addr learned my addr 172.21.15.84:0/2571316720 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.303+0000 7fde69800640 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bba4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.303+0000 7fde72e16740 10 client.0 _ll_register_callbacks cb 0x561f7ba99470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.303+0000 7fde6a200640 1 -- 172.21.15.84:0/2571316720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 msgr2=0x561f7bba4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.303+0000 7fde6a200640 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bba4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.303+0000 7fde6a200640 1 -- 172.21.15.84:0/2571316720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 msgr2=0x561f7bba4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.303+0000 7fde6a200640 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bba4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.303+0000 7fde6a200640 1 -- 172.21.15.84:0/2571316720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7b84c650 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.304+0000 7fde6a200640 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb8a90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0117c0 tx=0x7fde5c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a01d9b677029b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.304+0000 7fde4b400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.304+0000 7fde4b400640 1 -- 172.21.15.84:0/2571316720 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c022070 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.304+0000 7fde4b400640 1 -- 172.21.15.84:0/2571316720 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fde5c010ad0 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.304+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f7ba8bb90 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.305+0000 7fde4b400640 1 -- 172.21.15.84:0/2571316720 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde5c02e050 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.305+0000 7fde72e16740 10 client.27146 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.305+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f7baa6950 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.305+0000 7fde4b400640 1 -- 172.21.15.84:0/2571316720 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561f7ba8bb90 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.306+0000 7fde4b400640 1 -- 172.21.15.84:0/2571316720 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fde5c0263b0 con 0x561f7b79f9f0 2024-09-21T07:56:59.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.307+0000 7fde72e16740 10 client.27146 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.307+0000 7fde72e16740 10 client.27146 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.307+0000 7fde72e16740 20 client.27146 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.307+0000 7fde72e16740 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7b774da0 0x561f7bbbebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.307+0000 7fde72e16740 4 client.27146 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.307+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f7bb00f00 con 0x561f7b774da0 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.309+0000 7fde69800640 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7b774da0 0x561f7bbbebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.309+0000 7fde69800640 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7b774da0 0x561f7bbbebd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fa3aabe85af17d84 server_cookie=a487e48c193e6a6d in_seq=0 out_seq=0 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.310+0000 7fde4b400640 10 client.27146 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.313+0000 7fde4b400640 1 -- 172.21.15.84:0/2571316720 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f7bb00f00 con 0x561f7b774da0 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.313+0000 7fde4b400640 10 client.27146 handle_command_reply: tid=0 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.313+0000 7fde72e16740 1 client.27146 shutdown 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 msgr2=0x561f7bbb8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb8a90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0117c0 tx=0x7fde5c004ab0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 shutdown_connections 2024-09-21T07:56:59.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7b774da0 0x561f7bbbebd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb8a90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bba4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde4b400640 0 client.27146 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 --2- 172.21.15.84:0/2571316720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bba4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.314+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 >> 172.21.15.84:0/2571316720 conn(0x561f7b7d5460 msgr2=0x561f7bb88bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.315+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 shutdown_connections 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.317+0000 7fde72e16740 1 -- 172.21.15.84:0/2571316720 wait complete. 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.319+0000 7fde72e16740 20 client.27146 trim_cache size 0 max 16384 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.349+0000 7fde72e16740 1 Processor -- start 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.350+0000 7fde72e16740 1 -- start start 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.350+0000 7fde72e16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bb892e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.350+0000 7fde72e16740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bbb8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde72e16740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bbb8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde72e16740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fde4400fde0 con 0x561f7b7b81b0 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde72e16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde44011920 con 0x561f7b79f9f0 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde72e16740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde440104b0 con 0x561f7b7e1070 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde69800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bb892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde69800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bb892e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57410/0 (socket says 172.21.15.84:57410) 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde69800640 1 -- 172.21.15.84:0/3037100387 learned_addr learned my addr 172.21.15.84:0/3037100387 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.351+0000 7fde68e00640 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bbb8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde69800640 1 -- 172.21.15.84:0/3037100387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 msgr2=0x561f7bbb8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde6a200640 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bbb8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde69800640 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bbb8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde69800640 1 -- 172.21.15.84:0/3037100387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 msgr2=0x561f7bbb8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde69800640 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bbb8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde69800640 1 -- 172.21.15.84:0/3037100387 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7bb88990 con 0x561f7b79f9f0 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde68e00640 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bbb8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:56:59.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde69800640 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bb892e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x561f7bb86820 tx=0x7fde58000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa9d39f7e6207ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.352+0000 7fde6a200640 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bbb8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.353+0000 7fde56000640 1 -- 172.21.15.84:0/3037100387 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58010e50 con 0x561f7b79f9f0 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.353+0000 7fde56000640 1 -- 172.21.15.84:0/3037100387 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde5800fd80 con 0x561f7b79f9f0 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.353+0000 7fde56000640 1 -- 172.21.15.84:0/3037100387 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58004a90 con 0x561f7b79f9f0 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.354+0000 7fde72e16740 1 -- 172.21.15.84:0/3037100387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 msgr2=0x561f7bb892e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.354+0000 7fde72e16740 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bb892e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x561f7bb86820 tx=0x7fde58000bc0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.355+0000 7fde72e16740 1 -- 172.21.15.84:0/3037100387 shutdown_connections 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.355+0000 7fde72e16740 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7e1070 0x561f7bbb8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.355+0000 7fde72e16740 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7b81b0 0x561f7bbb8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.355+0000 7fde72e16740 1 --2- 172.21.15.84:0/3037100387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bb892e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.355+0000 7fde72e16740 1 -- 172.21.15.84:0/3037100387 >> 172.21.15.84:0/3037100387 conn(0x561f7b7d5460 msgr2=0x561f7bb88bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.355+0000 7fde72e16740 1 -- 172.21.15.84:0/3037100387 shutdown_connections 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.355+0000 7fde72e16740 1 -- 172.21.15.84:0/3037100387 wait complete. 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.356+0000 7fde72e16740 1 -- start start 2024-09-21T07:56:59.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.356+0000 7fde72e16740 1 Processor -- start 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde72e16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde72e16740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bbb5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde72e16740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7e1070 0x561f7bbb1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde72e16740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fde44011250 con 0x561f7b7e1070 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde72e16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde44010b80 con 0x561f7b79f9f0 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde72e16740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde4400dda0 con 0x561f7b7b81b0 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde72e16740 10 client.0 _ll_register_callbacks cb 0x7fde5c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.357+0000 7fde68e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bbb5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde68e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bbb5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49822/0 (socket says 172.21.15.84:49822) 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde68e00640 1 -- 172.21.15.84:0/2461309521 learned_addr learned my addr 172.21.15.84:0/2461309521 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde69800640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde68e00640 1 -- 172.21.15.84:0/2461309521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 msgr2=0x561f7bbb4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde68e00640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde68e00640 1 -- 172.21.15.84:0/2461309521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7e1070 msgr2=0x561f7bbb1ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde6a200640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7e1070 0x561f7bbb1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde68e00640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7e1070 0x561f7bbb1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde68e00640 1 -- 172.21.15.84:0/2461309521 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7bbb2310 con 0x561f7b7b81b0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde69800640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.358+0000 7fde6a200640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7e1070 0x561f7bbb1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.359+0000 7fde68e00640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bbb5400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fde500ce640 tx=0x7fde500cade0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cbfff908f4878a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.359+0000 7fde4b400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.359+0000 7fde4b400640 1 -- 172.21.15.84:0/2461309521 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde500ce0b0 con 0x561f7b7b81b0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.359+0000 7fde4b400640 1 -- 172.21.15.84:0/2461309521 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9344+0+0 (secure 0 0 0) 0x7fde501053e0 con 0x561f7b7b81b0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.360+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde5800fd80 con 0x561f7b7b81b0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.360+0000 7fde4b400640 1 -- 172.21.15.84:0/2461309521 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde500ce290 con 0x561f7b7b81b0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.360+0000 7fde72e16740 10 client.27166 fetch_fsmap learned FSMap version 29 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.360+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f7bc2a070 con 0x561f7b7b81b0 2024-09-21T07:56:59.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde4b400640 1 -- 172.21.15.84:0/2461309521 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde5800fd80 con 0x561f7b7b81b0 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde4b400640 1 -- 172.21.15.84:0/2461309521 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fde50046c20 con 0x561f7b7b81b0 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde72e16740 10 client.27166 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde72e16740 10 client.27166 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde72e16740 20 client.27166 populate_metadata read hostname 'smithi084' 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde72e16740 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7bc2a6b0 0x561f7bc2cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde72e16740 4 client.27166 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f7bafc9b0 con 0x561f7bc2a6b0 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.361+0000 7fde69800640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7bc2a6b0 0x561f7bc2cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.362+0000 7fde4b400640 10 client.27166 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.362+0000 7fde69800640 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7bc2a6b0 0x561f7bc2cad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13d084956e1f29b1 server_cookie=640381f034830e35 in_seq=0 out_seq=0 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.362+0000 7fde4b400640 1 -- 172.21.15.84:0/2461309521 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f7bafc9b0 con 0x561f7bc2a6b0 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.362+0000 7fde4b400640 10 client.27166 handle_command_reply: tid=0 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.363+0000 7fde72e16740 1 client.27166 shutdown 2024-09-21T07:56:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.363+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 msgr2=0x561f7bbb5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.363+0000 7fde72e16740 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bbb5400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fde500ce640 tx=0x7fde500cade0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.363+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 shutdown_connections 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.363+0000 7fde72e16740 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x561f7bc2a6b0 0x561f7bc2cad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.364+0000 7fde72e16740 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f7b7e1070 0x561f7bbb1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.364+0000 7fde72e16740 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561f7b7b81b0 0x561f7bbb5400 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.364+0000 7fde4b400640 0 client.27166 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.364+0000 7fde72e16740 1 --2- 172.21.15.84:0/2461309521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f7b79f9f0 0x561f7bbb4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.364+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 >> 172.21.15.84:0/2461309521 conn(0x561f7b7d5460 msgr2=0x561f7bb85350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.364+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 shutdown_connections 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.365+0000 7fde72e16740 1 -- 172.21.15.84:0/2461309521 wait complete. 2024-09-21T07:56:59.460 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.365+0000 7fde72e16740 20 client.27166 trim_cache size 0 max 16384 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.374+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fde4c0b6700 msgr2=0x7fde4c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.374+0000 7fde6c200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fde4c0b6700 0x7fde4c0b8c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009370 tx=0x7fde5c009590 comp rx=0 tx=0).stop 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.374+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde641094b0 msgr2=0x7fde6419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.374+0000 7fde6c200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde641094b0 0x7fde6419cc90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fde5002a910 tx=0x7fde50004270 comp rx=0 tx=0).stop 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.375+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 shutdown_connections 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.375+0000 7fde6c200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fde4c0b6700 0x7fde4c0b8c10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.375+0000 7fde6c200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde64109e00 0x7fde641a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.375+0000 7fde6c200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde641094b0 0x7fde6419cc90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.375+0000 7fde6c200640 1 --2- 172.21.15.84:0/146631795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde64103b70 0x7fde6419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:56:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.375+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 >> 172.21.15.84:0/146631795 conn(0x7fde640ff5e0 msgr2=0x7fde64108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:56:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.378+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 shutdown_connections 2024-09-21T07:56:59.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:56:59.378+0000 7fde6c200640 1 -- 172.21.15.84:0/146631795 wait complete. 2024-09-21T07:56:59.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:56:59 smithi084 ceph-mon[30411]: pgmap v570: 129 pgs: 129 active+clean; 40 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 21 KiB/s rd, 210 MiB/s wr, 1.56k op/s 2024-09-21T07:56:59.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:56:59 smithi162 ceph-mon[34833]: pgmap v570: 129 pgs: 129 active+clean; 40 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 21 KiB/s rd, 210 MiB/s wr, 1.56k op/s 2024-09-21T07:56:59.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:56:59 smithi191 ceph-mon[34667]: pgmap v570: 129 pgs: 129 active+clean; 40 GiB data, 83 GiB used, 990 GiB / 1.0 TiB avail; 21 KiB/s rd, 210 MiB/s wr, 1.56k op/s 2024-09-21T07:57:01.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:01 smithi162 ceph-mon[34833]: pgmap v571: 129 pgs: 129 active+clean; 40 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 43 KiB/s rd, 229 MiB/s wr, 1.61k op/s 2024-09-21T07:57:01.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:01 smithi084 ceph-mon[30411]: pgmap v571: 129 pgs: 129 active+clean; 40 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 43 KiB/s rd, 229 MiB/s wr, 1.61k op/s 2024-09-21T07:57:01.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:01 smithi191 ceph-mon[34667]: pgmap v571: 129 pgs: 129 active+clean; 40 GiB data, 84 GiB used, 989 GiB / 1.0 TiB avail; 43 KiB/s rd, 229 MiB/s wr, 1.61k op/s 2024-09-21T07:57:02.509 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T07:57:02.509 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T07:57:02.509 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:57:02.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:57:03.458 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:03.511 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:03.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:03 smithi162 ceph-mon[34833]: pgmap v572: 129 pgs: 129 active+clean; 41 GiB data, 84 GiB used, 988 GiB / 1.0 TiB avail; 38 KiB/s rd, 232 MiB/s wr, 1.50k op/s 2024-09-21T07:57:03.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:03 smithi084 ceph-mon[30411]: pgmap v572: 129 pgs: 129 active+clean; 41 GiB data, 84 GiB used, 988 GiB / 1.0 TiB avail; 38 KiB/s rd, 232 MiB/s wr, 1.50k op/s 2024-09-21T07:57:03.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:03 smithi191 ceph-mon[34667]: pgmap v572: 129 pgs: 129 active+clean; 41 GiB data, 84 GiB used, 988 GiB / 1.0 TiB avail; 38 KiB/s rd, 232 MiB/s wr, 1.50k op/s 2024-09-21T07:57:05.526 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:05 smithi084 ceph-mon[30411]: pgmap v573: 129 pgs: 129 active+clean; 41 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 64 KiB/s rd, 242 MiB/s wr, 1.49k op/s 2024-09-21T07:57:05.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:05 smithi162 ceph-mon[34833]: pgmap v573: 129 pgs: 129 active+clean; 41 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 64 KiB/s rd, 242 MiB/s wr, 1.49k op/s 2024-09-21T07:57:05.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:05 smithi191 ceph-mon[34667]: pgmap v573: 129 pgs: 129 active+clean; 41 GiB data, 85 GiB used, 988 GiB / 1.0 TiB avail; 64 KiB/s rd, 242 MiB/s wr, 1.49k op/s 2024-09-21T07:57:07.791 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:07 smithi084 ceph-mon[30411]: pgmap v574: 129 pgs: 129 active+clean; 41 GiB data, 85 GiB used, 987 GiB / 1.0 TiB avail; 50 KiB/s rd, 224 MiB/s wr, 1.31k op/s 2024-09-21T07:57:07.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:07 smithi162 ceph-mon[34833]: pgmap v574: 129 pgs: 129 active+clean; 41 GiB data, 85 GiB used, 987 GiB / 1.0 TiB avail; 50 KiB/s rd, 224 MiB/s wr, 1.31k op/s 2024-09-21T07:57:07.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:07 smithi191 ceph-mon[34667]: pgmap v574: 129 pgs: 129 active+clean; 41 GiB data, 85 GiB used, 987 GiB / 1.0 TiB avail; 50 KiB/s rd, 224 MiB/s wr, 1.31k op/s 2024-09-21T07:57:08.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:08 smithi084 ceph-mon[30411]: pgmap v575: 129 pgs: 129 active+clean; 41 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 49 KiB/s rd, 211 MiB/s wr, 1.21k op/s 2024-09-21T07:57:09.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:08 smithi162 ceph-mon[34833]: pgmap v575: 129 pgs: 129 active+clean; 41 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 49 KiB/s rd, 211 MiB/s wr, 1.21k op/s 2024-09-21T07:57:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.118+0000 7f02dcc00640 1 -- 172.21.15.84:0/1023920771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8102870 msgr2=0x7f02d8102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.118+0000 7f02dcc00640 1 --2- 172.21.15.84:0/1023920771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8102870 0x7f02d8102c80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009900 tx=0x7f02c802a440 comp rx=0 tx=0).stop 2024-09-21T07:57:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.118+0000 7f02dcc00640 1 -- 172.21.15.84:0/1023920771 shutdown_connections 2024-09-21T07:57:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.118+0000 7f02dcc00640 1 --2- 172.21.15.84:0/1023920771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d8108b00 0x7f02d810f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.118+0000 7f02dcc00640 1 --2- 172.21.15.84:0/1023920771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02d81081b0 0x7f02d81085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.118+0000 7f02dcc00640 1 --2- 172.21.15.84:0/1023920771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8102870 0x7f02d8102c80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.118+0000 7f02dcc00640 1 -- 172.21.15.84:0/1023920771 >> 172.21.15.84:0/1023920771 conn(0x7f02d80fe2c0 msgr2=0x7f02d8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.119+0000 7f02dcc00640 1 -- 172.21.15.84:0/1023920771 shutdown_connections 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.119+0000 7f02dcc00640 1 -- 172.21.15.84:0/1023920771 wait complete. 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.120+0000 7f02dcc00640 1 Processor -- start 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.120+0000 7f02dcc00640 1 -- start start 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.121+0000 7f02dcc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d8102870 0x7f02d806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.121+0000 7f02dcc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02d81081b0 0x7f02d806d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.121+0000 7f02dcc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8108b00 0x7f02d8072910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.121+0000 7f02dcc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02d8111780 con 0x7f02d81081b0 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.122+0000 7f02dcc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02d8111600 con 0x7f02d8102870 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.122+0000 7f02dcc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02d8111900 con 0x7f02d8108b00 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.122+0000 7f02d6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02d81081b0 0x7f02d806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.122+0000 7f02d6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02d81081b0 0x7f02d806d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42434/0 (socket says 172.21.15.84:42434) 2024-09-21T07:57:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.122+0000 7f02d6a00640 1 -- 172.21.15.84:0/606308056 learned_addr learned my addr 172.21.15.84:0/606308056 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.122+0000 7f02d7e00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8108b00 0x7f02d8072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.122+0000 7f02d7400640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d8102870 0x7f02d806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.123+0000 7f02d7e00640 1 -- 172.21.15.84:0/606308056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d8102870 msgr2=0x7f02d806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.123+0000 7f02d7e00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d8102870 0x7f02d806d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.123+0000 7f02d7e00640 1 -- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02d81081b0 msgr2=0x7f02d806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.123+0000 7f02d7e00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02d81081b0 0x7f02d806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.123+0000 7f02d7e00640 1 -- 172.21.15.84:0/606308056 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d8072f50 con 0x7f02d8108b00 2024-09-21T07:57:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.124+0000 7f02d7e00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8108b00 0x7f02d8072910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f02d000be20 tx=0x7f02d000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.124+0000 7f02cfe00640 1 -- 172.21.15.84:0/606308056 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0019070 con 0x7f02d8108b00 2024-09-21T07:57:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.124+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d8073240 con 0x7f02d8108b00 2024-09-21T07:57:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.124+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d8073a80 con 0x7f02d8108b00 2024-09-21T07:57:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.125+0000 7f02cfe00640 1 -- 172.21.15.84:0/606308056 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02d00148f0 con 0x7f02d8108b00 2024-09-21T07:57:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.125+0000 7f02cfe00640 1 -- 172.21.15.84:0/606308056 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0012860 con 0x7f02d8108b00 2024-09-21T07:57:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.129+0000 7f02e5015740 1 Processor -- start 2024-09-21T07:57:09.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.134+0000 7f02cfe00640 1 -- 172.21.15.84:0/606308056 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f02d001c070 con 0x7f02d8108b00 2024-09-21T07:57:09.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.136+0000 7f02cfe00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02bc0b6770 0x7f02bc0b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.137+0000 7f02cfe00640 1 -- 172.21.15.84:0/606308056 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7f02d00e7100 con 0x7f02d8108b00 2024-09-21T07:57:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02e5015740 1 -- start start 2024-09-21T07:57:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02e5015740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed35070 0x55b4bf0dbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02e5015740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0dc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02e5015740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed14390 0x55b4bf0dc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02e5015740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf052fb0 con 0x55b4bed0c1b0 2024-09-21T07:57:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02e5015740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf0423e0 con 0x55b4bed14390 2024-09-21T07:57:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02e5015740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf0461f0 con 0x55b4bed35070 2024-09-21T07:57:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.138+0000 7f02d7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed35070 0x55b4bf0dbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.139+0000 7f02d7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed35070 0x55b4bf0dbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34964/0 (socket says 172.21.15.84:34964) 2024-09-21T07:57:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.139+0000 7f02d7400640 1 -- 172.21.15.84:0/3595258672 learned_addr learned my addr 172.21.15.84:0/3595258672 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.139+0000 7f02d7400640 1 -- 172.21.15.84:0/3595258672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed14390 msgr2=0x55b4bf0dc7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.139+0000 7f02d7400640 1 --2- 172.21.15.84:0/3595258672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed14390 0x55b4bf0dc7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.139+0000 7f02d7400640 1 -- 172.21.15.84:0/3595258672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 msgr2=0x55b4bf0dc270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.139+0000 7f02d7400640 1 --2- 172.21.15.84:0/3595258672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0dc270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.139+0000 7f02d7400640 1 -- 172.21.15.84:0/3595258672 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4bf00ccd0 con 0x55b4bed35070 2024-09-21T07:57:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.141+0000 7f02d7400640 1 --2- 172.21.15.84:0/3595258672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed35070 0x55b4bf0dbd30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009230 tx=0x7f02c80095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35834617a4fcdd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.142+0000 7f02d6a00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02bc0b6770 0x7f02bc0b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.142+0000 7f02c3e00640 1 -- 172.21.15.84:0/3595258672 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8035030 con 0x55b4bed35070 2024-09-21T07:57:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.142+0000 7f02c3e00640 1 -- 172.21.15.84:0/3595258672 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c8047070 con 0x55b4bed35070 2024-09-21T07:57:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.142+0000 7f02c3e00640 1 -- 172.21.15.84:0/3595258672 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c804c690 con 0x55b4bed35070 2024-09-21T07:57:09.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.144+0000 7f02e5015740 1 -- 172.21.15.84:0/3595258672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed35070 msgr2=0x55b4bf0dbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.144+0000 7f02e5015740 1 --2- 172.21.15.84:0/3595258672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed35070 0x55b4bf0dbd30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009230 tx=0x7f02c80095f0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.144+0000 7f02d6a00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02bc0b6770 0x7f02bc0b8c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x55b4bf0da9b0 tx=0x7f02c400a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.145+0000 7f02e5015740 1 -- 172.21.15.84:0/3595258672 shutdown_connections 2024-09-21T07:57:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.145+0000 7f02e5015740 1 --2- 172.21.15.84:0/3595258672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed14390 0x55b4bf0dc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.145+0000 7f02e5015740 1 --2- 172.21.15.84:0/3595258672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0dc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.145+0000 7f02e5015740 1 --2- 172.21.15.84:0/3595258672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed35070 0x55b4bf0dbd30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.145+0000 7f02e5015740 1 -- 172.21.15.84:0/3595258672 >> 172.21.15.84:0/3595258672 conn(0x55b4bed29460 msgr2=0x55b4bf0d9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.146+0000 7f02e5015740 1 -- 172.21.15.84:0/3595258672 shutdown_connections 2024-09-21T07:57:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.146+0000 7f02e5015740 1 -- 172.21.15.84:0/3595258672 wait complete. 2024-09-21T07:57:09.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.149+0000 7f02e5015740 1 -- start start 2024-09-21T07:57:09.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.150+0000 7f02e5015740 1 Processor -- start 2024-09-21T07:57:09.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.151+0000 7f02e5015740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0e7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.152+0000 7f02d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:08 smithi191 ceph-mon[34667]: pgmap v575: 129 pgs: 129 active+clean; 41 GiB data, 86 GiB used, 987 GiB / 1.0 TiB avail; 49 KiB/s rd, 211 MiB/s wr, 1.21k op/s 2024-09-21T07:57:09.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.152+0000 7f02d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0e7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42438/0 (socket says 172.21.15.84:42438) 2024-09-21T07:57:09.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.153+0000 7f02e5015740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.153+0000 7f02d7400640 1 -- 172.21.15.84:0/4121855937 learned_addr learned my addr 172.21.15.84:0/4121855937 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.153+0000 7f02e5015740 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf0f3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.153+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b4beea3700 con 0x55b4bed0c1b0 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.153+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b4befdd580 con 0x55b4bed35070 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.153+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf0ea4b0 con 0x55b4bed14390 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02e5015740 10 client.0 _ll_register_callbacks cb 0x55b4befed470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02d6a00640 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02d7400640 1 -- 172.21.15.84:0/4121855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 msgr2=0x55b4bf0e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02d7400640 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02d7400640 1 -- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 msgr2=0x55b4bf0f3830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02d7400640 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf0f3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02d7400640 1 -- 172.21.15.84:0/4121855937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4beda0650 con 0x55b4bed0c1b0 2024-09-21T07:57:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.154+0000 7f02d6a00640 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.155+0000 7f02d7400640 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0e7990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f02c802a960 tx=0x7f02c8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce73b306e24c312 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.155+0000 7f02c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.156+0000 7f02c0c00640 1 -- 172.21.15.84:0/4121855937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8035040 con 0x55b4bed0c1b0 2024-09-21T07:57:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.156+0000 7f02c0c00640 1 -- 172.21.15.84:0/4121855937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7f02c80037f0 con 0x55b4bed0c1b0 2024-09-21T07:57:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.156+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4befdfb90 con 0x55b4bed0c1b0 2024-09-21T07:57:09.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.157+0000 7f02c0c00640 1 -- 172.21.15.84:0/4121855937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f02c804c470 con 0x55b4bed0c1b0 2024-09-21T07:57:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.158+0000 7f02e5015740 10 client.16941 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.158+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b4beffa950 con 0x55b4bed0c1b0 2024-09-21T07:57:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02c0c00640 1 -- 172.21.15.84:0/4121855937 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b4befdfb90 con 0x55b4bed0c1b0 2024-09-21T07:57:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02c0c00640 1 -- 172.21.15.84:0/4121855937 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f02c8055550 con 0x55b4bed0c1b0 2024-09-21T07:57:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02e5015740 10 client.16941 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02e5015740 10 client.16941 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:57:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02e5015740 20 client.16941 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02e5015740 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becf39f0 0x55b4bf0f9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02e5015740 4 client.16941 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.159+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4bf054f00 con 0x55b4becf39f0 2024-09-21T07:57:09.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.164+0000 7f02d6a00640 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becf39f0 0x55b4bf0f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.165+0000 7f02d6a00640 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becf39f0 0x55b4bf0f9710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c72452a226cc2596 server_cookie=100a1a71ce744d0f in_seq=0 out_seq=0 2024-09-21T07:57:09.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.165+0000 7f02c0c00640 10 client.16941 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:57:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.167+0000 7f02c0c00640 1 -- 172.21.15.84:0/4121855937 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4bf054f00 con 0x55b4becf39f0 2024-09-21T07:57:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.167+0000 7f02c0c00640 10 client.16941 handle_command_reply: tid=0 2024-09-21T07:57:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.167+0000 7f02e5015740 1 client.16941 shutdown 2024-09-21T07:57:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.168+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 msgr2=0x55b4bf0e7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.168+0000 7f02e5015740 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0e7990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f02c802a960 tx=0x7f02c8003c20 comp rx=0 tx=0).stop 2024-09-21T07:57:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.169+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 shutdown_connections 2024-09-21T07:57:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.169+0000 7f02e5015740 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becf39f0 0x55b4bf0f9710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.169+0000 7f02e5015740 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf0f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.169+0000 7f02e5015740 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.169+0000 7f02e5015740 1 --2- 172.21.15.84:0/4121855937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0e7990 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.169+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 >> 172.21.15.84:0/4121855937 conn(0x55b4bed29460 msgr2=0x55b4bf0deec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.170+0000 7f02c0c00640 0 client.16941 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:57:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.172+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 shutdown_connections 2024-09-21T07:57:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.172+0000 7f02e5015740 1 -- 172.21.15.84:0/4121855937 wait complete. 2024-09-21T07:57:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.172+0000 7f02e5015740 20 client.16941 trim_cache size 0 max 16384 2024-09-21T07:57:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 Processor -- start 2024-09-21T07:57:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 -- start start 2024-09-21T07:57:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf0e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8010020 con 0x55b4bed0c1b0 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8011b60 con 0x55b4bed35070 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.211+0000 7f02e5015740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80106f0 con 0x55b4bed14390 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34980/0 (socket says 172.21.15.84:34980) 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d6a00640 1 -- 172.21.15.84:0/110766377 learned_addr learned my addr 172.21.15.84:0/110766377 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d7e00640 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf0e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d6a00640 1 -- 172.21.15.84:0/110766377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 msgr2=0x55b4bf0e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d6a00640 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf0e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d6a00640 1 -- 172.21.15.84:0/110766377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 msgr2=0x55b4bf0d9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.212+0000 7f02d6a00640 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.213+0000 7f02d6a00640 1 -- 172.21.15.84:0/110766377 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4bf0f3be0 con 0x55b4bed14390 2024-09-21T07:57:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.213+0000 7f02d6a00640 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e4980 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f02c400fb60 tx=0x7f02c4012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e247649af121de66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.213+0000 7f02c3400640 1 -- 172.21.15.84:0/110766377 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4016070 con 0x55b4bed14390 2024-09-21T07:57:09.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.214+0000 7f02c3400640 1 -- 172.21.15.84:0/110766377 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c402a070 con 0x55b4bed14390 2024-09-21T07:57:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.214+0000 7f02c3400640 1 -- 172.21.15.84:0/110766377 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4024350 con 0x55b4bed14390 2024-09-21T07:57:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.215+0000 7f02e5015740 1 -- 172.21.15.84:0/110766377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 msgr2=0x55b4bf0e4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.215+0000 7f02e5015740 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e4980 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f02c400fb60 tx=0x7f02c4012000 comp rx=0 tx=0).stop 2024-09-21T07:57:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.215+0000 7f02e5015740 1 -- 172.21.15.84:0/110766377 shutdown_connections 2024-09-21T07:57:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.215+0000 7f02e5015740 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf0e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.215+0000 7f02e5015740 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0e4980 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.215+0000 7f02e5015740 1 --2- 172.21.15.84:0/110766377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0d9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.215+0000 7f02e5015740 1 -- 172.21.15.84:0/110766377 >> 172.21.15.84:0/110766377 conn(0x55b4bed29460 msgr2=0x55b4bf0d94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.216+0000 7f02e5015740 1 -- 172.21.15.84:0/110766377 shutdown_connections 2024-09-21T07:57:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.216+0000 7f02e5015740 1 -- 172.21.15.84:0/110766377 wait complete. 2024-09-21T07:57:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.216+0000 7f02e5015740 1 -- start start 2024-09-21T07:57:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.217+0000 7f02e5015740 1 Processor -- start 2024-09-21T07:57:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.217+0000 7f02e5015740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.217+0000 7f02e5015740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0f9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.219+0000 7f02d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.219+0000 7f02d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0f8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42448/0 (socket says 172.21.15.84:42448) 2024-09-21T07:57:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02e5015740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf162e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02e5015740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8011490 con 0x55b4bed0c1b0 2024-09-21T07:57:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02e5015740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8010dc0 con 0x55b4bed35070 2024-09-21T07:57:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02e5015740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02b800e000 con 0x55b4bed14390 2024-09-21T07:57:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02e5015740 10 client.0 _ll_register_callbacks cb 0x7f02c8003b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02d7400640 1 -- 172.21.15.84:0/3157339722 learned_addr learned my addr 172.21.15.84:0/3157339722 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02d7e00640 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf162e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02d7400640 1 -- 172.21.15.84:0/3157339722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 msgr2=0x55b4bf0f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02d7400640 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02d7400640 1 -- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 msgr2=0x55b4bf162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.220+0000 7f02d7400640 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf162e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.221+0000 7f02d7400640 1 -- 172.21.15.84:0/3157339722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4bf1633c0 con 0x55b4bed0c1b0 2024-09-21T07:57:09.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.221+0000 7f02d7400640 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0f8b70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000c00 tx=0x7f02c80095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957f8ac6fae4576a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.221+0000 7f02c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.222+0000 7f02c0c00640 1 -- 172.21.15.84:0/3157339722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8041060 con 0x55b4bed0c1b0 2024-09-21T07:57:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.222+0000 7f02c0c00640 1 -- 172.21.15.84:0/3157339722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7f02c8055630 con 0x55b4bed0c1b0 2024-09-21T07:57:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.224+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c402a070 con 0x55b4bed0c1b0 2024-09-21T07:57:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.225+0000 7f02c0c00640 1 -- 172.21.15.84:0/3157339722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f02c80035f0 con 0x55b4bed0c1b0 2024-09-21T07:57:09.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.226+0000 7f02e5015740 10 client.16944 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:09.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.226+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b4bf164550 con 0x55b4bed0c1b0 2024-09-21T07:57:09.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02c0c00640 1 -- 172.21.15.84:0/3157339722 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c402a070 con 0x55b4bed0c1b0 2024-09-21T07:57:09.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02c0c00640 1 -- 172.21.15.84:0/3157339722 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f02c80432b0 con 0x55b4bed0c1b0 2024-09-21T07:57:09.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02e5015740 10 client.16944 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:09.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02e5015740 10 client.16944 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:57:09.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02e5015740 20 client.16944 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:09.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02e5015740 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becc8da0 0x55b4bf166c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02e5015740 4 client.16944 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:57:09.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.232+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b4bf0509b0 con 0x55b4becc8da0 2024-09-21T07:57:09.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.234+0000 7f02d6a00640 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becc8da0 0x55b4bf166c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.236+0000 7f02d6a00640 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becc8da0 0x55b4bf166c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=df7a0ab38cc4a9c1 server_cookie=c64d70f873352d3b in_seq=0 out_seq=0 2024-09-21T07:57:09.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.237+0000 7f02c0c00640 10 client.16944 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:57:09.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.237+0000 7f02c0c00640 1 -- 172.21.15.84:0/3157339722 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b4bf0509b0 con 0x55b4becc8da0 2024-09-21T07:57:09.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.237+0000 7f02c0c00640 10 client.16944 handle_command_reply: tid=0 2024-09-21T07:57:09.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.238+0000 7f02e5015740 1 client.16944 shutdown 2024-09-21T07:57:09.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.239+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 msgr2=0x55b4bf0f8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.239+0000 7f02e5015740 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0f8b70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000c00 tx=0x7f02c80095d0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.243+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 shutdown_connections 2024-09-21T07:57:09.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.243+0000 7f02e5015740 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55b4becc8da0 0x55b4bf166c50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.243+0000 7f02e5015740 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b4bed35070 0x55b4bf162e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.243+0000 7f02e5015740 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b4bed14390 0x55b4bf0f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.243+0000 7f02e5015740 1 --2- 172.21.15.84:0/3157339722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b4bed0c1b0 0x55b4bf0f8b70 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.243+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 >> 172.21.15.84:0/3157339722 conn(0x55b4bed29460 msgr2=0x55b4bf0d8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.244+0000 7f02c0c00640 0 client.16944 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:57:09.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.245+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 shutdown_connections 2024-09-21T07:57:09.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.246+0000 7f02e5015740 1 -- 172.21.15.84:0/3157339722 wait complete. 2024-09-21T07:57:09.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.246+0000 7f02e5015740 20 client.16944 trim_cache size 0 max 16384 2024-09-21T07:57:09.251 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:57:09.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.254+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02bc0b6770 msgr2=0x7f02bc0b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.254+0000 7f02dcc00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02bc0b6770 0x7f02bc0b8c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x55b4bf0da9b0 tx=0x7f02c400a380 comp rx=0 tx=0).stop 2024-09-21T07:57:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.254+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8108b00 msgr2=0x7f02d8072910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.254+0000 7f02dcc00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8108b00 0x7f02d8072910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f02d000be20 tx=0x7f02d000bf10 comp rx=0 tx=0).stop 2024-09-21T07:57:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.255+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 shutdown_connections 2024-09-21T07:57:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.255+0000 7f02dcc00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f02bc0b6770 0x7f02bc0b8c80 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x55b4bf0da9b0 tx=0x7f02c400a380 comp rx=0 tx=0).stop 2024-09-21T07:57:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.255+0000 7f02dcc00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02d8108b00 0x7f02d8072910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.255+0000 7f02dcc00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02d81081b0 0x7f02d806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.255+0000 7f02dcc00640 1 --2- 172.21.15.84:0/606308056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d8102870 0x7f02d806d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.255+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 >> 172.21.15.84:0/606308056 conn(0x7f02d80fe2c0 msgr2=0x7f02d81006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.255+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 shutdown_connections 2024-09-21T07:57:09.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.256+0000 7f02dcc00640 1 -- 172.21.15.84:0/606308056 wait complete. 2024-09-21T07:57:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.751+0000 7fa97fe00640 1 -- 172.21.15.84:0/767375455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 msgr2=0x7fa9800757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.751+0000 7fa97fe00640 1 --2- 172.21.15.84:0/767375455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa9800757b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa97001a910 tx=0x7fa97003b470 comp rx=0 tx=0).stop 2024-09-21T07:57:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.752+0000 7fa97fe00640 1 -- 172.21.15.84:0/767375455 shutdown_connections 2024-09-21T07:57:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.752+0000 7fa97fe00640 1 --2- 172.21.15.84:0/767375455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9801141d0 0x7fa9801166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.752+0000 7fa97fe00640 1 --2- 172.21.15.84:0/767375455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa980075dd0 0x7fa9800761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.752+0000 7fa97fe00640 1 --2- 172.21.15.84:0/767375455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa9800757b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.752+0000 7fa97fe00640 1 -- 172.21.15.84:0/767375455 >> 172.21.15.84:0/767375455 conn(0x7fa9800ff330 msgr2=0x7fa980101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.752+0000 7fa97fe00640 1 -- 172.21.15.84:0/767375455 shutdown_connections 2024-09-21T07:57:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.755+0000 7fa97fe00640 1 -- 172.21.15.84:0/767375455 wait complete. 2024-09-21T07:57:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.757+0000 7fa97fe00640 1 Processor -- start 2024-09-21T07:57:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.757+0000 7fa97fe00640 1 -- start start 2024-09-21T07:57:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.758+0000 7fa97fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa980075dd0 0x7fa980113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.758+0000 7fa97fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa98010fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.758+0000 7fa97fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9801141d0 0x7fa980110530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.758+0000 7fa97ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa980075dd0 0x7fa980113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa98010fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa98010fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35000/0 (socket says 172.21.15.84:35000) 2024-09-21T07:57:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa980075dd0 0x7fa980113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47062/0 (socket says 172.21.15.84:47062) 2024-09-21T07:57:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97e000640 1 -- 172.21.15.84:0/304531682 learned_addr learned my addr 172.21.15.84:0/304531682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa98010a250 con 0x7fa9801141d0 2024-09-21T07:57:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa98010a0d0 con 0x7fa980075dd0 2024-09-21T07:57:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa98010a3d0 con 0x7fa980077390 2024-09-21T07:57:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.759+0000 7fa97f400640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9801141d0 0x7fa980110530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.762+0000 7fa97e000640 1 -- 172.21.15.84:0/304531682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa980075dd0 msgr2=0x7fa980113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.762+0000 7fa97e000640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa980075dd0 0x7fa980113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.762+0000 7fa97e000640 1 -- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9801141d0 msgr2=0x7fa980110530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.762+0000 7fa97e000640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9801141d0 0x7fa980110530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.762+0000 7fa97e000640 1 -- 172.21.15.84:0/304531682 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9801a4330 con 0x7fa980077390 2024-09-21T07:57:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.766+0000 7fa97e000640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa98010fde0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00b450 tx=0x7fa96c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.767+0000 7fa977400640 1 -- 172.21.15.84:0/304531682 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c015020 con 0x7fa980077390 2024-09-21T07:57:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.767+0000 7fa977400640 1 -- 172.21.15.84:0/304531682 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa96c011d40 con 0x7fa980077390 2024-09-21T07:57:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.767+0000 7fa977400640 1 -- 172.21.15.84:0/304531682 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00f340 con 0x7fa980077390 2024-09-21T07:57:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.767+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9801a4560 con 0x7fa980077390 2024-09-21T07:57:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.768+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9801a4ae0 con 0x7fa980077390 2024-09-21T07:57:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.783+0000 7fa98ca45740 1 Processor -- start 2024-09-21T07:57:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.783+0000 7fa98ca45740 1 -- start start 2024-09-21T07:57:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.784+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a48e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.784+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01267b2f0 0x55d012a49350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.784+0000 7fa97f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a48e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa97f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a48e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47066/0 (socket says 172.21.15.84:47066) 2024-09-21T07:57:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa97f400640 1 -- 172.21.15.84:0/2703101263 learned_addr learned my addr 172.21.15.84:0/2703101263 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa98ca45740 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126834d0 0x55d012a49890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d0129be6b0 con 0x55d01267b2f0 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d0129adae0 con 0x55d0126a41b0 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d0129b18f0 con 0x55d0126834d0 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa977400640 1 -- 172.21.15.84:0/304531682 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa96c018020 con 0x7fa980077390 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa97e000640 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126834d0 0x55d012a49890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.785+0000 7fa97ea00640 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01267b2f0 0x55d012a49350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.786+0000 7fa97f400640 1 -- 172.21.15.84:0/2703101263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126834d0 msgr2=0x55d012a49890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.786+0000 7fa97f400640 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126834d0 0x55d012a49890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.786+0000 7fa97f400640 1 -- 172.21.15.84:0/2703101263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01267b2f0 msgr2=0x55d012a49350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.787+0000 7fa97f400640 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01267b2f0 0x55d012a49350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.787+0000 7fa97f400640 1 -- 172.21.15.84:0/2703101263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01297a780 con 0x55d0126a41b0 2024-09-21T07:57:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.787+0000 7fa97ea00640 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01267b2f0 0x55d012a49350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.787+0000 7fa97e000640 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126834d0 0x55d012a49890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.788+0000 7fa977400640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9640b6850 0x7fa9640b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.788+0000 7fa977400640 1 -- 172.21.15.84:0/304531682 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7fa96c0e74c0 con 0x7fa980077390 2024-09-21T07:57:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.788+0000 7fa97ea00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9640b6850 0x7fa9640b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.789+0000 7fa97f400640 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a48e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa97800b530 tx=0x7fa978009630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6739dd14769375 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.789+0000 7fa96be00640 1 -- 172.21.15.84:0/2703101263 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97800a9f0 con 0x55d0126a41b0 2024-09-21T07:57:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.790+0000 7fa96be00640 1 -- 172.21.15.84:0/2703101263 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa978019070 con 0x55d0126a41b0 2024-09-21T07:57:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.790+0000 7fa96be00640 1 -- 172.21.15.84:0/2703101263 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978013380 con 0x55d0126a41b0 2024-09-21T07:57:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.792+0000 7fa97ea00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9640b6850 0x7fa9640b8d60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa970000c00 tx=0x7fa97001a600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.792+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 msgr2=0x55d012a48e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.793+0000 7fa98ca45740 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a48e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa97800b530 tx=0x7fa978009630 comp rx=0 tx=0).stop 2024-09-21T07:57:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.793+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 shutdown_connections 2024-09-21T07:57:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.793+0000 7fa98ca45740 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126834d0 0x55d012a49890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.793+0000 7fa98ca45740 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d01267b2f0 0x55d012a49350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.793+0000 7fa98ca45740 1 --2- 172.21.15.84:0/2703101263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a48e10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.793+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 >> 172.21.15.84:0/2703101263 conn(0x55d012698300 msgr2=0x55d012a46d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.794+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 shutdown_connections 2024-09-21T07:57:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.794+0000 7fa98ca45740 1 -- 172.21.15.84:0/2703101263 wait complete. 2024-09-21T07:57:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.795+0000 7fa98ca45740 1 -- start start 2024-09-21T07:57:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.796+0000 7fa98ca45740 1 Processor -- start 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.796+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d01267b2f0 0x55d012a54460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.796+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126834d0 0x55d012a549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.796+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126a41b0 0x55d012a60880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.796+0000 7fa98ca45740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d0128e5ab0 con 0x55d0126a41b0 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.796+0000 7fa98ca45740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d012954570 con 0x55d0126834d0 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.797+0000 7fa98ca45740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d012a57590 con 0x55d01267b2f0 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.797+0000 7fa98ca45740 10 client.0 _ll_register_callbacks cb 0x55d012963100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.797+0000 7fa97ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d01267b2f0 0x55d012a54460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.797+0000 7fa97ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d01267b2f0 0x55d012a54460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35016/0 (socket says 172.21.15.84:35016) 2024-09-21T07:57:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.797+0000 7fa97ea00640 1 -- 172.21.15.84:0/475204456 learned_addr learned my addr 172.21.15.84:0/475204456 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.797+0000 7fa97e000640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126834d0 0x55d012a549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.797+0000 7fa97f400640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126a41b0 0x55d012a60880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.798+0000 7fa97ea00640 1 -- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126834d0 msgr2=0x55d012a549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.798+0000 7fa97ea00640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126834d0 0x55d012a549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.798+0000 7fa97ea00640 1 -- 172.21.15.84:0/475204456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126a41b0 msgr2=0x55d012a60880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.798+0000 7fa97ea00640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126a41b0 0x55d012a60880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.798+0000 7fa97ea00640 1 -- 172.21.15.84:0/475204456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01270f790 con 0x55d01267b2f0 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.798+0000 7fa97e000640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126834d0 0x55d012a549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.798+0000 7fa97ea00640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d01267b2f0 0x55d012a54460 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa970044000 tx=0x7fa97003b470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9643e12dabdc06fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.799+0000 7fa968c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.799+0000 7fa968c00640 1 -- 172.21.15.84:0/475204456 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970053070 con 0x55d01267b2f0 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.799+0000 7fa968c00640 1 -- 172.21.15.84:0/475204456 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7fa970040a10 con 0x55d01267b2f0 2024-09-21T07:57:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.799+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa978019070 con 0x55d01267b2f0 2024-09-21T07:57:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.800+0000 7fa968c00640 1 -- 172.21.15.84:0/475204456 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa970004c10 con 0x55d01267b2f0 2024-09-21T07:57:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.800+0000 7fa98ca45740 10 client.27190 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.800+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d012788620 con 0x55d01267b2f0 2024-09-21T07:57:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.801+0000 7fa968c00640 1 -- 172.21.15.84:0/475204456 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa978019070 con 0x55d01267b2f0 2024-09-21T07:57:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.803+0000 7fa968c00640 1 -- 172.21.15.84:0/475204456 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa97004b040 con 0x55d01267b2f0 2024-09-21T07:57:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.803+0000 7fa98ca45740 10 client.27190 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.803+0000 7fa98ca45740 10 client.27190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.803+0000 7fa98ca45740 20 client.27190 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.803+0000 7fa98ca45740 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d012662d80 0x55d012a775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.803+0000 7fa98ca45740 4 client.27190 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.803+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0129c0600 con 0x55d012662d80 2024-09-21T07:57:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.804+0000 7fa97e000640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d012662d80 0x55d012a775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.804+0000 7fa97e000640 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d012662d80 0x55d012a775d0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb01e8fe09059ee server_cookie=832546d27c06826a in_seq=0 out_seq=0 2024-09-21T07:57:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.805+0000 7fa968c00640 10 client.27190 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.808+0000 7fa968c00640 1 -- 172.21.15.84:0/475204456 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0129c0600 con 0x55d012662d80 2024-09-21T07:57:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.808+0000 7fa968c00640 10 client.27190 handle_command_reply: tid=0 2024-09-21T07:57:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.808+0000 7fa98ca45740 1 client.27190 shutdown 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d01267b2f0 msgr2=0x55d012a54460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d01267b2f0 0x55d012a54460 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa970044000 tx=0x7fa97003b470 comp rx=0 tx=0).stop 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 shutdown_connections 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126a41b0 0x55d012a60880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126834d0 0x55d012a549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d012662d80 0x55d012a775d0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 --2- 172.21.15.84:0/475204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d01267b2f0 0x55d012a54460 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa970044000 tx=0x7fa97003b470 comp rx=0 tx=0).stop 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa968c00640 0 client.27190 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 >> 172.21.15.84:0/475204456 conn(0x55d012698300 msgr2=0x55d012a49e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 shutdown_connections 2024-09-21T07:57:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.811+0000 7fa98ca45740 1 -- 172.21.15.84:0/475204456 wait complete. 2024-09-21T07:57:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.813+0000 7fa98ca45740 20 client.27190 trim_cache size 0 max 16384 2024-09-21T07:57:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.867+0000 7fa98ca45740 1 Processor -- start 2024-09-21T07:57:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.867+0000 7fa98ca45740 1 -- start start 2024-09-21T07:57:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d012662d80 0x55d012a60780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a45a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a51630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa98ca45740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa9801a62c0 con 0x55d0126834d0 2024-09-21T07:57:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa98ca45740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9801a7e00 con 0x55d0126a41b0 2024-09-21T07:57:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa98ca45740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa9801a6990 con 0x55d012662d80 2024-09-21T07:57:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa97f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a51630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa97f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a51630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47080/0 (socket says 172.21.15.84:47080) 2024-09-21T07:57:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.869+0000 7fa97f400640 1 -- 172.21.15.84:0/1707589318 learned_addr learned my addr 172.21.15.84:0/1707589318 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.868+0000 7fa97ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d012662d80 0x55d012a60780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.869+0000 7fa97e000640 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a45a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.869+0000 7fa97f400640 1 -- 172.21.15.84:0/1707589318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d012662d80 msgr2=0x55d012a60780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.869+0000 7fa97f400640 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d012662d80 0x55d012a60780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.869+0000 7fa97f400640 1 -- 172.21.15.84:0/1707589318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 msgr2=0x55d012a45a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.869+0000 7fa97f400640 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a45a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.869+0000 7fa97f400640 1 -- 172.21.15.84:0/1707589318 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d012a52940 con 0x55d0126a41b0 2024-09-21T07:57:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.870+0000 7fa97e000640 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a45a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.870+0000 7fa97f400640 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a51630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa978018000 tx=0x7fa9780098c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae4e0a84d1f3d96e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.871+0000 7fa96b400640 1 -- 172.21.15.84:0/1707589318 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978003d60 con 0x55d0126a41b0 2024-09-21T07:57:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.871+0000 7fa96b400640 1 -- 172.21.15.84:0/1707589318 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa978019070 con 0x55d0126a41b0 2024-09-21T07:57:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.871+0000 7fa96b400640 1 -- 172.21.15.84:0/1707589318 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978003d60 con 0x55d0126a41b0 2024-09-21T07:57:09.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.874+0000 7fa98ca45740 1 -- 172.21.15.84:0/1707589318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 msgr2=0x55d012a51630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.874+0000 7fa98ca45740 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a51630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa978018000 tx=0x7fa9780098c0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.876 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.874+0000 7fa98ca45740 1 -- 172.21.15.84:0/1707589318 shutdown_connections 2024-09-21T07:57:09.876 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.874+0000 7fa98ca45740 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0126a41b0 0x55d012a51630 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.876 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.874+0000 7fa98ca45740 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a45a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.876 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.874+0000 7fa98ca45740 1 --2- 172.21.15.84:0/1707589318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d012662d80 0x55d012a60780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.876 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.874+0000 7fa98ca45740 1 -- 172.21.15.84:0/1707589318 >> 172.21.15.84:0/1707589318 conn(0x55d012698300 msgr2=0x55d012a45360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.875+0000 7fa98ca45740 1 -- 172.21.15.84:0/1707589318 shutdown_connections 2024-09-21T07:57:09.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.875+0000 7fa98ca45740 1 -- 172.21.15.84:0/1707589318 wait complete. 2024-09-21T07:57:09.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.875+0000 7fa98ca45740 1 -- start start 2024-09-21T07:57:09.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.876+0000 7fa98ca45740 1 Processor -- start 2024-09-21T07:57:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.877+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d012662d80 0x55d012a5ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.878+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a5a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.878+0000 7fa98ca45740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126a41b0 0x55d012a5a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.878+0000 7fa97ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d012662d80 0x55d012a5ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.878+0000 7fa97ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d012662d80 0x55d012a5ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47088/0 (socket says 172.21.15.84:47088) 2024-09-21T07:57:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.879+0000 7fa97ea00640 1 -- 172.21.15.84:0/3205180578 learned_addr learned my addr 172.21.15.84:0/3205180578 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.879+0000 7fa97f400640 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126a41b0 0x55d012a5a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.879+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa9801a7730 con 0x55d0126834d0 2024-09-21T07:57:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.879+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9801a7060 con 0x55d012662d80 2024-09-21T07:57:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.879+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa980074a80 con 0x55d0126a41b0 2024-09-21T07:57:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.879+0000 7fa98ca45740 10 client.0 _ll_register_callbacks cb 0x7fa97001a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.880+0000 7fa97f400640 1 -- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d012662d80 msgr2=0x55d012a5ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.880+0000 7fa97f400640 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d012662d80 0x55d012a5ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.880+0000 7fa97f400640 1 -- 172.21.15.84:0/3205180578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 msgr2=0x55d012a5a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.880+0000 7fa97f400640 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a5a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.880+0000 7fa97f400640 1 -- 172.21.15.84:0/3205180578 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d012a5af20 con 0x55d0126a41b0 2024-09-21T07:57:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.880+0000 7fa97ea00640 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d012662d80 0x55d012a5ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.881+0000 7fa97f400640 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126a41b0 0x55d012a5a8b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa978018000 tx=0x7fa978004100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ae993a7ae29bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.881+0000 7fa968c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.882+0000 7fa968c00640 1 -- 172.21.15.84:0/3205180578 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978036060 con 0x55d0126a41b0 2024-09-21T07:57:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.882+0000 7fa968c00640 1 -- 172.21.15.84:0/3205180578 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7fa978004560 con 0x55d0126a41b0 2024-09-21T07:57:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.883+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa978019070 con 0x55d0126a41b0 2024-09-21T07:57:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.884+0000 7fa968c00640 1 -- 172.21.15.84:0/3205180578 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa978004760 con 0x55d0126a41b0 2024-09-21T07:57:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.884+0000 7fa98ca45740 10 client.27196 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.884+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d012ae1d90 con 0x55d0126a41b0 2024-09-21T07:57:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.884+0000 7fa968c00640 1 -- 172.21.15.84:0/3205180578 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa978019070 con 0x55d0126a41b0 2024-09-21T07:57:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.885+0000 7fa968c00640 1 -- 172.21.15.84:0/3205180578 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa9780315e0 con 0x55d0126a41b0 2024-09-21T07:57:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.885+0000 7fa98ca45740 10 client.27196 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.885+0000 7fa98ca45740 10 client.27196 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.885+0000 7fa98ca45740 20 client.27196 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.885+0000 7fa98ca45740 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d0126381c0 0x55d012ae4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.885+0000 7fa98ca45740 4 client.27196 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:57:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.885+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0129bc0b0 con 0x55d0126381c0 2024-09-21T07:57:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.886+0000 7fa97ea00640 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d0126381c0 0x55d012ae4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.886+0000 7fa97ea00640 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d0126381c0 0x55d012ae4230 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84dbfaef79016b8e server_cookie=7c42f8e730bc3120 in_seq=0 out_seq=0 2024-09-21T07:57:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:09.886+0000 7fa968c00640 10 client.27196 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:09.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.955+0000 7fa3e6c00640 1 -- 172.21.15.84:0/1000290941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e0075730 msgr2=0x7fa3e0075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.955+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/1000290941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e0075730 0x7fa3e0075b40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009900 tx=0x7fa3d402a410 comp rx=0 tx=0).stop 2024-09-21T07:57:09.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.955+0000 7fa3e6c00640 1 -- 172.21.15.84:0/1000290941 shutdown_connections 2024-09-21T07:57:09.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.955+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/1000290941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e010ff90 0x7fa3e01123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.955+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/1000290941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0076080 0x7fa3e010fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.955+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/1000290941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e0075730 0x7fa3e0075b40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.955+0000 7fa3e6c00640 1 -- 172.21.15.84:0/1000290941 >> 172.21.15.84:0/1000290941 conn(0x7fa3e00ff400 msgr2=0x7fa3e0101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:09.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:09 smithi084 ceph-mon[30411]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T07:57:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.956+0000 7fa3e6c00640 1 -- 172.21.15.84:0/1000290941 shutdown_connections 2024-09-21T07:57:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.956+0000 7fa3e6c00640 1 -- 172.21.15.84:0/1000290941 wait complete. 2024-09-21T07:57:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.957+0000 7fa3e6c00640 1 Processor -- start 2024-09-21T07:57:09.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.962+0000 7fa3e6c00640 1 -- start start 2024-09-21T07:57:09.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.965+0000 7fa3e6c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0075730 0x7fa3e0074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.966+0000 7fa3e6c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0076080 0x7fa3e006e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.966+0000 7fa3e6c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e010ff90 0x7fa3e006e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.966+0000 7fa3e5800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0075730 0x7fa3e0074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.967+0000 7fa3e5800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0075730 0x7fa3e0074ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42490/0 (socket says 172.21.15.84:42490) 2024-09-21T07:57:09.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.967+0000 7fa3e6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e010ff90 0x7fa3e006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.967+0000 7fa3e6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e010ff90 0x7fa3e006e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47112/0 (socket says 172.21.15.84:47112) 2024-09-21T07:57:09.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.968+0000 7fa3e5800640 1 -- 172.21.15.84:0/2592065916 learned_addr learned my addr 172.21.15.84:0/2592065916 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:09.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.968+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0115ba0 con 0x7fa3e0075730 2024-09-21T07:57:09.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.968+0000 7fa3e4e00640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0076080 0x7fa3e006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.968+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0115a20 con 0x7fa3e010ff90 2024-09-21T07:57:09.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.969+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0115d20 con 0x7fa3e0076080 2024-09-21T07:57:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.971+0000 7fa3e6200640 1 -- 172.21.15.84:0/2592065916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0076080 msgr2=0x7fa3e006e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.971+0000 7fa3e6200640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0076080 0x7fa3e006e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.971+0000 7fa3e6200640 1 -- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0075730 msgr2=0x7fa3e0074ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.971+0000 7fa3e6200640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0075730 0x7fa3e0074ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.971+0000 7fa3e6200640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e006efa0 con 0x7fa3e010ff90 2024-09-21T07:57:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.972+0000 7fa3e6200640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e010ff90 0x7fa3e006e780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800be20 tx=0x7fa3d800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.973+0000 7fa3de000640 1 -- 172.21.15.84:0/2592065916 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8019070 con 0x7fa3e010ff90 2024-09-21T07:57:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.973+0000 7fa3de000640 1 -- 172.21.15.84:0/2592065916 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3d80148f0 con 0x7fa3e010ff90 2024-09-21T07:57:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.973+0000 7fa3de000640 1 -- 172.21.15.84:0/2592065916 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8012840 con 0x7fa3e010ff90 2024-09-21T07:57:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.978+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e0073c50 con 0x7fa3e010ff90 2024-09-21T07:57:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.978+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e0074050 con 0x7fa3e010ff90 2024-09-21T07:57:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.980+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e0075b40 con 0x7fa3e010ff90 2024-09-21T07:57:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.988+0000 7fa3de000640 1 -- 172.21.15.84:0/2592065916 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa3d8014440 con 0x7fa3e010ff90 2024-09-21T07:57:09.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.992+0000 7fa3de000640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3c80b6800 0x7fa3c80b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.994+0000 7fa3e5800640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3c80b6800 0x7fa3c80b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.995+0000 7fa3de000640 1 -- 172.21.15.84:0/2592065916 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7fa3d80e7320 con 0x7fa3e010ff90 2024-09-21T07:57:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.996+0000 7fa3de000640 1 -- 172.21.15.84:0/2592065916 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3d80e7710 con 0x7fa3e010ff90 2024-09-21T07:57:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:09.997+0000 7fa3e5800640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3c80b6800 0x7fa3c80b8d10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4000c00 tx=0x7fa3d402a910 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:10.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:09 smithi162 ceph-mon[34833]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T07:57:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa968c00640 1 -- 172.21.15.84:0/3205180578 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0129bc0b0 con 0x55d0126381c0 2024-09-21T07:57:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa968c00640 10 client.27196 handle_command_reply: tid=0 2024-09-21T07:57:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 client.27196 shutdown 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126a41b0 msgr2=0x55d012a5a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126a41b0 0x55d012a5a8b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa978018000 tx=0x7fa978004100 comp rx=0 tx=0).stop 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 shutdown_connections 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d0126381c0 0x55d012ae4230 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0126a41b0 0x55d012a5a8b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0126834d0 0x55d012a5a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 --2- 172.21.15.84:0/3205180578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d012662d80 0x55d012a5ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 >> 172.21.15.84:0/3205180578 conn(0x55d012698300 msgr2=0x55d012a49e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.100+0000 7fa968c00640 0 client.27196 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.101+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 shutdown_connections 2024-09-21T07:57:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.101+0000 7fa98ca45740 1 -- 172.21.15.84:0/3205180578 wait complete. 2024-09-21T07:57:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.101+0000 7fa98ca45740 20 client.27196 trim_cache size 0 max 16384 2024-09-21T07:57:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:57:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:57:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:57:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:57:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.103+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9640b6850 msgr2=0x7fa9640b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.103+0000 7fa97fe00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9640b6850 0x7fa9640b8d60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa970000c00 tx=0x7fa97001a600 comp rx=0 tx=0).stop 2024-09-21T07:57:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.103+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 msgr2=0x7fa98010fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.103+0000 7fa97fe00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa98010fde0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00b450 tx=0x7fa96c00b910 comp rx=0 tx=0).stop 2024-09-21T07:57:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.104+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 shutdown_connections 2024-09-21T07:57:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.104+0000 7fa97fe00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa9640b6850 0x7fa9640b8d60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.104+0000 7fa97fe00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9801141d0 0x7fa980110530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.104+0000 7fa97fe00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa980077390 0x7fa98010fde0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.104+0000 7fa97fe00640 1 --2- 172.21.15.84:0/304531682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa980075dd0 0x7fa980113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.104+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 >> 172.21.15.84:0/304531682 conn(0x7fa9800ff330 msgr2=0x7fa980103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.104+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 shutdown_connections 2024-09-21T07:57:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:10.105+0000 7fa97fe00640 1 -- 172.21.15.84:0/304531682 wait complete. 2024-09-21T07:57:10.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:09 smithi191 ceph-mon[34667]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T07:57:10.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.456+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3e006f490 con 0x7fa3e010ff90 2024-09-21T07:57:10.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.458+0000 7fa3de000640 1 -- 172.21.15.84:0/2592065916 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fa3d80b18f0 con 0x7fa3e010ff90 2024-09-21T07:57:10.464 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:57:10.464 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:57:10.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.461+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3c80b6800 msgr2=0x7fa3c80b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:10.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.461+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3c80b6800 0x7fa3c80b8d10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4000c00 tx=0x7fa3d402a910 comp rx=0 tx=0).stop 2024-09-21T07:57:10.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.462+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e010ff90 msgr2=0x7fa3e006e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:10.465 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:57:10.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.462+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e010ff90 0x7fa3e006e780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800be20 tx=0x7fa3d800bf10 comp rx=0 tx=0).stop 2024-09-21T07:57:10.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.463+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 shutdown_connections 2024-09-21T07:57:10.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.463+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa3c80b6800 0x7fa3c80b8d10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.463+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e010ff90 0x7fa3e006e780 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.463+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0076080 0x7fa3e006e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.463+0000 7fa3e6c00640 1 --2- 172.21.15.84:0/2592065916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0075730 0x7fa3e0074ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:10.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.464+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 >> 172.21.15.84:0/2592065916 conn(0x7fa3e00ff400 msgr2=0x7fa3e0109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:10.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.465+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 shutdown_connections 2024-09-21T07:57:10.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:10.465+0000 7fa3e6c00640 1 -- 172.21.15.84:0/2592065916 wait complete. 2024-09-21T07:57:11.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:10 smithi162 ceph-mon[34833]: pgmap v577: 129 pgs: 129 active+clean; 42 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 56 KiB/s rd, 239 MiB/s wr, 1.42k op/s 2024-09-21T07:57:11.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:10 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2592065916' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:11.056 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:10 smithi191 ceph-mon[34667]: pgmap v577: 129 pgs: 129 active+clean; 42 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 56 KiB/s rd, 239 MiB/s wr, 1.42k op/s 2024-09-21T07:57:11.056 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:10 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2592065916' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:11.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:10 smithi084 ceph-mon[30411]: pgmap v577: 129 pgs: 129 active+clean; 42 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 56 KiB/s rd, 239 MiB/s wr, 1.42k op/s 2024-09-21T07:57:11.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:10 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2592065916' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:11.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:57:12.188 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T07:57:12.188 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T07:57:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:13.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:13 smithi162 ceph-mon[34833]: pgmap v578: 129 pgs: 129 active+clean; 42 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 74 KiB/s rd, 234 MiB/s wr, 1.47k op/s 2024-09-21T07:57:13.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:13 smithi084 ceph-mon[30411]: pgmap v578: 129 pgs: 129 active+clean; 42 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 74 KiB/s rd, 234 MiB/s wr, 1.47k op/s 2024-09-21T07:57:13.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:13 smithi191 ceph-mon[34667]: pgmap v578: 129 pgs: 129 active+clean; 42 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 74 KiB/s rd, 234 MiB/s wr, 1.47k op/s 2024-09-21T07:57:15.794 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:15 smithi084 ceph-mon[30411]: pgmap v579: 129 pgs: 129 active+clean; 42 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 46 KiB/s rd, 228 MiB/s wr, 1.52k op/s 2024-09-21T07:57:15.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:15 smithi162 ceph-mon[34833]: pgmap v579: 129 pgs: 129 active+clean; 42 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 46 KiB/s rd, 228 MiB/s wr, 1.52k op/s 2024-09-21T07:57:15.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:15 smithi191 ceph-mon[34667]: pgmap v579: 129 pgs: 129 active+clean; 42 GiB data, 87 GiB used, 986 GiB / 1.0 TiB avail; 46 KiB/s rd, 228 MiB/s wr, 1.52k op/s 2024-09-21T07:57:15.946 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:16.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.193+0000 7ffb9d400640 1 -- 172.21.15.84:0/4002244486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb98109e00 msgr2=0x7ffb98110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.193+0000 7ffb9d400640 1 --2- 172.21.15.84:0/4002244486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb98109e00 0x7ffb98110630 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ffb90009be0 tx=0x7ffb9002a6d0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.193+0000 7ffb9d400640 1 -- 172.21.15.84:0/4002244486 shutdown_connections 2024-09-21T07:57:16.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.194+0000 7ffb9d400640 1 --2- 172.21.15.84:0/4002244486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb98109e00 0x7ffb98110630 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.194+0000 7ffb9d400640 1 --2- 172.21.15.84:0/4002244486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb981094b0 0x7ffb981098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.194+0000 7ffb9d400640 1 --2- 172.21.15.84:0/4002244486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 0x7ffb98103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.195+0000 7ffb9d400640 1 -- 172.21.15.84:0/4002244486 >> 172.21.15.84:0/4002244486 conn(0x7ffb980ff5e0 msgr2=0x7ffb98101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:16.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.195+0000 7ffb9d400640 1 -- 172.21.15.84:0/4002244486 shutdown_connections 2024-09-21T07:57:16.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.195+0000 7ffb9d400640 1 -- 172.21.15.84:0/4002244486 wait complete. 2024-09-21T07:57:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.197+0000 7ffb9d400640 1 Processor -- start 2024-09-21T07:57:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.197+0000 7ffb9d400640 1 -- start start 2024-09-21T07:57:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.198+0000 7ffb9d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 0x7ffb981a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.198+0000 7ffb9d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb981094b0 0x7ffb981a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.198+0000 7ffb9d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb98109e00 0x7ffb981a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.198+0000 7ffb9d400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98111910 con 0x7ffb981094b0 2024-09-21T07:57:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.198+0000 7ffb9d400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98111790 con 0x7ffb98103b70 2024-09-21T07:57:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.198+0000 7ffb9d400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98111a90 con 0x7ffb98109e00 2024-09-21T07:57:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.200+0000 7ffb96800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 0x7ffb981a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.200+0000 7ffb96800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 0x7ffb981a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47132/0 (socket says 172.21.15.84:47132) 2024-09-21T07:57:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.200+0000 7ffb96800640 1 -- 172.21.15.84:0/649576380 learned_addr learned my addr 172.21.15.84:0/649576380 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.200+0000 7ffb95e00640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb981094b0 0x7ffb981a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.200+0000 7ffb97200640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb98109e00 0x7ffb981a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.201+0000 7ffb96800640 1 -- 172.21.15.84:0/649576380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb98109e00 msgr2=0x7ffb981a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.201+0000 7ffb96800640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb98109e00 0x7ffb981a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.201+0000 7ffb96800640 1 -- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb981094b0 msgr2=0x7ffb981a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.201+0000 7ffb96800640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb981094b0 0x7ffb981a10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.201+0000 7ffb96800640 1 -- 172.21.15.84:0/649576380 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb981a6a80 con 0x7ffb98103b70 2024-09-21T07:57:16.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.201+0000 7ffb96800640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 0x7ffb981a0b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b4a0 tx=0x7ffb8800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:16.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.203+0000 7ffb8f400640 1 -- 172.21.15.84:0/649576380 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88014070 con 0x7ffb98103b70 2024-09-21T07:57:16.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.203+0000 7ffb8f400640 1 -- 172.21.15.84:0/649576380 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb88010ac0 con 0x7ffb98103b70 2024-09-21T07:57:16.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.203+0000 7ffb8f400640 1 -- 172.21.15.84:0/649576380 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88017b60 con 0x7ffb98103b70 2024-09-21T07:57:16.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.203+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb981a6d70 con 0x7ffb98103b70 2024-09-21T07:57:16.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.203+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb981ad4d0 con 0x7ffb98103b70 2024-09-21T07:57:16.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.221+0000 7ffba4086740 1 Processor -- start 2024-09-21T07:57:16.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.221+0000 7ffb8f400640 1 -- 172.21.15.84:0/649576380 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ffb88017070 con 0x7ffb98103b70 2024-09-21T07:57:16.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.222+0000 7ffba4086740 1 -- start start 2024-09-21T07:57:16.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.222+0000 7ffba4086740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bf1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.222+0000 7ffba4086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395bf22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.222+0000 7ffba4086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395bf2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.222+0000 7ffba4086740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d395b68fb0 con 0x55d3958221b0 2024-09-21T07:57:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.222+0000 7ffba4086740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d395b583e0 con 0x55d39582a390 2024-09-21T07:57:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.222+0000 7ffba4086740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d395b5c1f0 con 0x55d39584b070 2024-09-21T07:57:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.224+0000 7ffb95e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395bf2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.224+0000 7ffb95e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395bf2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47134/0 (socket says 172.21.15.84:47134) 2024-09-21T07:57:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.224+0000 7ffb95e00640 1 -- 172.21.15.84:0/3107128930 learned_addr learned my addr 172.21.15.84:0/3107128930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.225+0000 7ffb95e00640 1 -- 172.21.15.84:0/3107128930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 msgr2=0x55d395bf1da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.225+0000 7ffb95e00640 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bf1da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.225+0000 7ffb95e00640 1 -- 172.21.15.84:0/3107128930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 msgr2=0x55d395bf22e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.225+0000 7ffb96800640 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395bf22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.225+0000 7ffb95e00640 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395bf22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.225+0000 7ffb95e00640 1 -- 172.21.15.84:0/3107128930 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d395b22cd0 con 0x55d39582a390 2024-09-21T07:57:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.225+0000 7ffb96800640 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395bf22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.226+0000 7ffb95e00640 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395bf2820 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009a60 tx=0x7ffb84009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd43613cb0753dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.230+0000 7ffb83400640 1 -- 172.21.15.84:0/3107128930 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400ec50 con 0x55d39582a390 2024-09-21T07:57:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.230+0000 7ffb83400640 1 -- 172.21.15.84:0/3107128930 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb8400edf0 con 0x55d39582a390 2024-09-21T07:57:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.230+0000 7ffb83400640 1 -- 172.21.15.84:0/3107128930 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400ec50 con 0x55d39582a390 2024-09-21T07:57:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.231+0000 7ffba4086740 1 -- 172.21.15.84:0/3107128930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 msgr2=0x55d395bf2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.231+0000 7ffba4086740 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395bf2820 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009a60 tx=0x7ffb84009f20 comp rx=0 tx=0).stop 2024-09-21T07:57:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.235+0000 7ffb8f400640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffb7c0b6810 0x7ffb7c0b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.236+0000 7ffb8f400640 1 -- 172.21.15.84:0/649576380 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7ffb880e6c20 con 0x7ffb98103b70 2024-09-21T07:57:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.234+0000 7ffba4086740 1 -- 172.21.15.84:0/3107128930 shutdown_connections 2024-09-21T07:57:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.237+0000 7ffba4086740 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395bf2820 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.237+0000 7ffb97200640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffb7c0b6810 0x7ffb7c0b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.237+0000 7ffba4086740 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395bf22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.238+0000 7ffba4086740 1 --2- 172.21.15.84:0/3107128930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bf1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.238+0000 7ffba4086740 1 -- 172.21.15.84:0/3107128930 >> 172.21.15.84:0/3107128930 conn(0x55d39583f460 msgr2=0x55d395befc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:16.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.240+0000 7ffba4086740 1 -- 172.21.15.84:0/3107128930 shutdown_connections 2024-09-21T07:57:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.240+0000 7ffba4086740 1 -- 172.21.15.84:0/3107128930 wait complete. 2024-09-21T07:57:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.241+0000 7ffba4086740 1 -- start start 2024-09-21T07:57:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.241+0000 7ffba4086740 1 Processor -- start 2024-09-21T07:57:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.243+0000 7ffb97200640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffb7c0b6810 0x7ffb7c0b8d20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffb90004af0 tx=0x7ffb90009940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:16.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.249+0000 7ffba4086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3958221b0 0x55d395bfd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.251+0000 7ffba4086740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39582a390 0x55d395bfda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.251+0000 7ffba4086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d39584b070 0x55d395c1a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.251+0000 7ffb96800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3958221b0 0x55d395bfd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.251+0000 7ffb96800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3958221b0 0x55d395bfd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47136/0 (socket says 172.21.15.84:47136) 2024-09-21T07:57:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.251+0000 7ffb95e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39582a390 0x55d395bfda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.251+0000 7ffb95e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39582a390 0x55d395bfda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35116/0 (socket says 172.21.15.84:35116) 2024-09-21T07:57:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.252+0000 7ffb96800640 1 -- 172.21.15.84:0/2120302686 learned_addr learned my addr 172.21.15.84:0/2120302686 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:16.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.252+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d3959b9700 con 0x55d39584b070 2024-09-21T07:57:16.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.252+0000 7ffb97200640 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d39584b070 0x55d395c1a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.252+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d395af3580 con 0x55d3958221b0 2024-09-21T07:57:16.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.253+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d395c11530 con 0x55d39582a390 2024-09-21T07:57:16.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.254+0000 7ffb95e00640 1 -- 172.21.15.84:0/2120302686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3958221b0 msgr2=0x55d395bfd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:16.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.254+0000 7ffb95e00640 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3958221b0 0x55d395bfd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.254+0000 7ffb95e00640 1 -- 172.21.15.84:0/2120302686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d39584b070 msgr2=0x55d395c1a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:16.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.254+0000 7ffb95e00640 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d39584b070 0x55d395c1a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.254+0000 7ffb95e00640 1 -- 172.21.15.84:0/2120302686 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3958b6650 con 0x55d39582a390 2024-09-21T07:57:16.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.255+0000 7ffb95e00640 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39582a390 0x55d395bfda50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb84005d70 tx=0x7ffb84005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4573f5e0ea5883e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:16.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.255+0000 7ffba4086740 10 client.0 _ll_register_callbacks cb 0x55d395b03470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:16.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.255+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d395af5b90 con 0x55d39582a390 2024-09-21T07:57:16.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.255+0000 7ffb77e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:16.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.259+0000 7ffb77e00640 1 -- 172.21.15.84:0/2120302686 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84028060 con 0x55d39582a390 2024-09-21T07:57:16.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.260+0000 7ffb77e00640 1 -- 172.21.15.84:0/2120302686 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7ffb8400ea50 con 0x55d39582a390 2024-09-21T07:57:16.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.260+0000 7ffb77e00640 1 -- 172.21.15.84:0/2120302686 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb8400ec50 con 0x55d39582a390 2024-09-21T07:57:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.261+0000 7ffba4086740 10 client.27211 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:16.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.262+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d395b10950 con 0x55d39582a390 2024-09-21T07:57:16.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.263+0000 7ffb77e00640 1 -- 172.21.15.84:0/2120302686 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffb8400f040 con 0x55d39582a390 2024-09-21T07:57:16.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.263+0000 7ffba4086740 10 client.27211 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:16.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.263+0000 7ffba4086740 10 client.27211 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:57:16.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.263+0000 7ffba4086740 20 client.27211 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:16.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.263+0000 7ffba4086740 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3958099f0 0x55d395c201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.263+0000 7ffba4086740 4 client.27211 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:16.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.263+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d395b6af00 con 0x55d3958099f0 2024-09-21T07:57:16.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.267+0000 7ffb96800640 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3958099f0 0x55d395c201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.268+0000 7ffb96800640 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3958099f0 0x55d395c201d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3eaf7f6a6cef17e2 server_cookie=ab71b527be9450f7 in_seq=0 out_seq=0 2024-09-21T07:57:16.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.268+0000 7ffb77e00640 10 client.27211 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:57:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.269+0000 7ffb77e00640 1 -- 172.21.15.84:0/2120302686 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d395b6af00 con 0x55d3958099f0 2024-09-21T07:57:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.269+0000 7ffb77e00640 10 client.27211 handle_command_reply: tid=0 2024-09-21T07:57:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.269+0000 7ffba4086740 1 client.27211 shutdown 2024-09-21T07:57:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.270+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39582a390 msgr2=0x55d395bfda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.270+0000 7ffba4086740 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39582a390 0x55d395bfda50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffb84005d70 tx=0x7ffb84005270 comp rx=0 tx=0).stop 2024-09-21T07:57:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.270+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 shutdown_connections 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.270+0000 7ffba4086740 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3958099f0 0x55d395c201d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.271+0000 7ffba4086740 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d39584b070 0x55d395c1a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.271+0000 7ffba4086740 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39582a390 0x55d395bfda50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.271+0000 7ffba4086740 1 --2- 172.21.15.84:0/2120302686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3958221b0 0x55d395bfd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.271+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 >> 172.21.15.84:0/2120302686 conn(0x55d39583f460 msgr2=0x55d395bf4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.272+0000 7ffb77e00640 0 client.27211 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.272+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 shutdown_connections 2024-09-21T07:57:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.272+0000 7ffba4086740 1 -- 172.21.15.84:0/2120302686 wait complete. 2024-09-21T07:57:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.273+0000 7ffba4086740 20 client.27211 trim_cache size 0 max 16384 2024-09-21T07:57:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.318+0000 7ffba4086740 1 Processor -- start 2024-09-21T07:57:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.318+0000 7ffba4086740 1 -- start start 2024-09-21T07:57:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.319+0000 7ffba4086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395befd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.319+0000 7ffba4086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c1a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.319+0000 7ffba4086740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bfd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.319+0000 7ffba4086740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb981aee70 con 0x55d3958221b0 2024-09-21T07:57:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.319+0000 7ffba4086740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb981b09b0 con 0x55d39582a390 2024-09-21T07:57:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.319+0000 7ffba4086740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffb981af540 con 0x55d39584b070 2024-09-21T07:57:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.323+0000 7ffb97200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bfd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.323+0000 7ffb95e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c1a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.323+0000 7ffb95e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c1a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47140/0 (socket says 172.21.15.84:47140) 2024-09-21T07:57:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.323+0000 7ffb95e00640 1 -- 172.21.15.84:0/1443951768 learned_addr learned my addr 172.21.15.84:0/1443951768 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.324+0000 7ffb96800640 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395befd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.325+0000 7ffb97200640 1 -- 172.21.15.84:0/1443951768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 msgr2=0x55d395c1a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.325+0000 7ffb97200640 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c1a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.325+0000 7ffb97200640 1 -- 172.21.15.84:0/1443951768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 msgr2=0x55d395befd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.325+0000 7ffb97200640 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395befd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.325+0000 7ffb97200640 1 -- 172.21.15.84:0/1443951768 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d395bfe7d0 con 0x55d39584b070 2024-09-21T07:57:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.325+0000 7ffb96800640 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395befd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.326+0000 7ffb95e00640 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c1a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.326+0000 7ffb97200640 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bfd2c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb90034040 tx=0x7ffb9003d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36f7a01e9ab0fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.327+0000 7ffb82a00640 1 -- 172.21.15.84:0/1443951768 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90036040 con 0x55d39584b070 2024-09-21T07:57:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.328+0000 7ffb82a00640 1 -- 172.21.15.84:0/1443951768 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9004f070 con 0x55d39584b070 2024-09-21T07:57:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.328+0000 7ffb82a00640 1 -- 172.21.15.84:0/1443951768 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9003d6c0 con 0x55d39584b070 2024-09-21T07:57:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.329+0000 7ffba4086740 1 -- 172.21.15.84:0/1443951768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 msgr2=0x55d395bfd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.330+0000 7ffba4086740 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bfd2c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb90034040 tx=0x7ffb9003d000 comp rx=0 tx=0).stop 2024-09-21T07:57:16.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.330+0000 7ffba4086740 1 -- 172.21.15.84:0/1443951768 shutdown_connections 2024-09-21T07:57:16.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.330+0000 7ffba4086740 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395bfd2c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.330+0000 7ffba4086740 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c1a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.330+0000 7ffba4086740 1 --2- 172.21.15.84:0/1443951768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395befd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.331+0000 7ffba4086740 1 -- 172.21.15.84:0/1443951768 >> 172.21.15.84:0/1443951768 conn(0x55d39583f460 msgr2=0x55d395bef5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:16.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.332+0000 7ffba4086740 1 -- 172.21.15.84:0/1443951768 shutdown_connections 2024-09-21T07:57:16.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.332+0000 7ffba4086740 1 -- 172.21.15.84:0/1443951768 wait complete. 2024-09-21T07:57:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.333+0000 7ffba4086740 1 -- start start 2024-09-21T07:57:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.334+0000 7ffba4086740 1 Processor -- start 2024-09-21T07:57:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.336+0000 7ffba4086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395c12ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffba4086740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c13420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffba4086740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395c899d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffba4086740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb981b02e0 con 0x55d3958221b0 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffba4086740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb981afc10 con 0x55d39582a390 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffba4086740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98074cd0 con 0x55d39584b070 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffb97200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395c899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffb97200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395c899d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35144/0 (socket says 172.21.15.84:35144) 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.337+0000 7ffb97200640 1 -- 172.21.15.84:0/3397468007 learned_addr learned my addr 172.21.15.84:0/3397468007 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.339+0000 7ffba4086740 10 client.0 _ll_register_callbacks cb 0x7ffb8400eea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.340+0000 7ffb96800640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395c12ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.340+0000 7ffb95e00640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c13420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.342+0000 7ffb97200640 1 -- 172.21.15.84:0/3397468007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 msgr2=0x55d395c13420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.342+0000 7ffb97200640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c13420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.342+0000 7ffb97200640 1 -- 172.21.15.84:0/3397468007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 msgr2=0x55d395c12ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.342+0000 7ffb97200640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395c12ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.342+0000 7ffb97200640 1 -- 172.21.15.84:0/3397468007 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d395c89f40 con 0x55d39584b070 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.342+0000 7ffb97200640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395c899d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffb9002acc0 tx=0x7ffb90030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=886e6f48f2e0dd97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.342+0000 7ffb77e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.343+0000 7ffb95e00640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c13420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.345+0000 7ffb77e00640 1 -- 172.21.15.84:0/3397468007 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90058070 con 0x55d39584b070 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.345+0000 7ffb77e00640 1 -- 172.21.15.84:0/3397468007 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9520+0+0 (secure 0 0 0) 0x7ffb90004000 con 0x55d39584b070 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.345+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb9004f070 con 0x55d39584b070 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.345+0000 7ffb77e00640 1 -- 172.21.15.84:0/3397468007 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb90036070 con 0x55d39584b070 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.345+0000 7ffba4086740 10 client.27217 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.345+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d395c8b130 con 0x55d39584b070 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.345+0000 7ffb77e00640 1 -- 172.21.15.84:0/3397468007 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9004f070 con 0x55d39584b070 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.346+0000 7ffb77e00640 1 -- 172.21.15.84:0/3397468007 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ffb9003dc20 con 0x55d39584b070 2024-09-21T07:57:16.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.346+0000 7ffba4086740 10 client.27217 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.346+0000 7ffba4086740 10 client.27217 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:57:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.346+0000 7ffba4086740 20 client.27217 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.347+0000 7ffba4086740 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3957deda0 0x55d395c8d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.347+0000 7ffba4086740 4 client.27217 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:57:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.347+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d395b669b0 con 0x55d3957deda0 2024-09-21T07:57:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.348+0000 7ffb96800640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3957deda0 0x55d395c8d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.349+0000 7ffb96800640 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3957deda0 0x55d395c8d750 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b7dbd634a42bd41b server_cookie=ccbf97cf3a143158 in_seq=0 out_seq=0 2024-09-21T07:57:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.349+0000 7ffb77e00640 10 client.27217 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:57:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.349+0000 7ffb77e00640 1 -- 172.21.15.84:0/3397468007 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d395b669b0 con 0x55d3957deda0 2024-09-21T07:57:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.350+0000 7ffb77e00640 10 client.27217 handle_command_reply: tid=0 2024-09-21T07:57:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.350+0000 7ffba4086740 1 client.27217 shutdown 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 msgr2=0x55d395c899d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395c899d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffb9002acc0 tx=0x7ffb90030650 comp rx=0 tx=0).stop 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 shutdown_connections 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55d3957deda0 0x55d395c8d750 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d39584b070 0x55d395c899d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d39582a390 0x55d395c13420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 --2- 172.21.15.84:0/3397468007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d3958221b0 0x55d395c12ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 >> 172.21.15.84:0/3397468007 conn(0x55d39583f460 msgr2=0x55d395bef470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.351+0000 7ffb77e00640 0 client.27217 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:57:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.352+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 shutdown_connections 2024-09-21T07:57:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.352+0000 7ffba4086740 1 -- 172.21.15.84:0/3397468007 wait complete. 2024-09-21T07:57:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.352+0000 7ffba4086740 20 client.27217 trim_cache size 0 max 16384 2024-09-21T07:57:16.356 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:57:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.354+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffb7c0b6810 msgr2=0x7ffb7c0b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.354+0000 7ffb9d400640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffb7c0b6810 0x7ffb7c0b8d20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffb90004af0 tx=0x7ffb90009940 comp rx=0 tx=0).stop 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.354+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 msgr2=0x7ffb981a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.354+0000 7ffb9d400640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 0x7ffb981a0b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b4a0 tx=0x7ffb8800b960 comp rx=0 tx=0).stop 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 shutdown_connections 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ffb7c0b6810 0x7ffb7c0b8d20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb98109e00 0x7ffb981a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb981094b0 0x7ffb981a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 --2- 172.21.15.84:0/649576380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb98103b70 0x7ffb981a0b10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 >> 172.21.15.84:0/649576380 conn(0x7ffb980ff5e0 msgr2=0x7ffb98101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 shutdown_connections 2024-09-21T07:57:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:16.355+0000 7ffb9d400640 1 -- 172.21.15.84:0/649576380 wait complete. 2024-09-21T07:57:17.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:17 smithi162 ceph-mon[34833]: pgmap v580: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 54 KiB/s rd, 220 MiB/s wr, 1.58k op/s 2024-09-21T07:57:17.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:17 smithi084 ceph-mon[30411]: pgmap v580: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 54 KiB/s rd, 220 MiB/s wr, 1.58k op/s 2024-09-21T07:57:17.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:17 smithi191 ceph-mon[34667]: pgmap v580: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 54 KiB/s rd, 220 MiB/s wr, 1.58k op/s 2024-09-21T07:57:18.711 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:18 smithi084 ceph-mon[30411]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T07:57:18.712 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:18 smithi084 ceph-mon[30411]: pgmap v582: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 33 KiB/s rd, 218 MiB/s wr, 1.67k op/s 2024-09-21T07:57:19.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:57:19.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:18 smithi162 ceph-mon[34833]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T07:57:19.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:18 smithi162 ceph-mon[34833]: pgmap v582: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 33 KiB/s rd, 218 MiB/s wr, 1.67k op/s 2024-09-21T07:57:19.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:18 smithi191 ceph-mon[34667]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T07:57:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:18 smithi191 ceph-mon[34667]: pgmap v582: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 33 KiB/s rd, 218 MiB/s wr, 1.67k op/s 2024-09-21T07:57:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.535+0000 7ff3e7e00640 1 -- 172.21.15.84:0/1350602397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e81047f0 msgr2=0x7ff3e8104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.535+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/1350602397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e81047f0 0x7ff3e8104c00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009900 tx=0x7ff3d802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.536+0000 7ff3e7e00640 1 -- 172.21.15.84:0/1350602397 shutdown_connections 2024-09-21T07:57:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.536+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/1350602397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e810dc50 0x7ff3e8110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.536+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/1350602397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3e8105140 0x7ff3e810d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.536+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/1350602397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e81047f0 0x7ff3e8104c00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.536+0000 7ff3e7e00640 1 -- 172.21.15.84:0/1350602397 >> 172.21.15.84:0/1350602397 conn(0x7ff3e80fe330 msgr2=0x7ff3e8100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.537+0000 7ff3e7e00640 1 -- 172.21.15.84:0/1350602397 shutdown_connections 2024-09-21T07:57:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.537+0000 7ff3e7e00640 1 -- 172.21.15.84:0/1350602397 wait complete. 2024-09-21T07:57:19.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.539+0000 7ff3e7e00640 1 Processor -- start 2024-09-21T07:57:19.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.540+0000 7ff3e7e00640 1 -- start start 2024-09-21T07:57:19.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.543+0000 7ff3e7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3e81047f0 0x7ff3e819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.543+0000 7ff3e7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8105140 0x7ff3e819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.543+0000 7ff3e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e810dc50 0x7ff3e819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.544+0000 7ff3e6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8105140 0x7ff3e819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.544+0000 7ff3e6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8105140 0x7ff3e819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52104/0 (socket says 172.21.15.84:52104) 2024-09-21T07:57:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.545+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3e81047f0 0x7ff3e819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.545+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3e81047f0 0x7ff3e819a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59824/0 (socket says 172.21.15.84:59824) 2024-09-21T07:57:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.546+0000 7ff3e6000640 1 -- 172.21.15.84:0/162678793 learned_addr learned my addr 172.21.15.84:0/162678793 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:19.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.546+0000 7ff3e7400640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e810dc50 0x7ff3e819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.546+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8113920 con 0x7ff3e810dc50 2024-09-21T07:57:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.546+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81137a0 con 0x7ff3e8105140 2024-09-21T07:57:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.546+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8113aa0 con 0x7ff3e81047f0 2024-09-21T07:57:19.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.547+0000 7ff3e6000640 1 -- 172.21.15.84:0/162678793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3e81047f0 msgr2=0x7ff3e819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:19.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.547+0000 7ff3e6000640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3e81047f0 0x7ff3e819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.547+0000 7ff3e6000640 1 -- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e810dc50 msgr2=0x7ff3e819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.547+0000 7ff3e6000640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e810dc50 0x7ff3e819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.547+0000 7ff3e6000640 1 -- 172.21.15.84:0/162678793 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e81a00c0 con 0x7ff3e8105140 2024-09-21T07:57:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.548+0000 7ff3e6000640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8105140 0x7ff3e819a6f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400d740 tx=0x7ff3d400dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.548+0000 7ff3eca00640 1 -- 172.21.15.84:0/162678793 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4017070 con 0x7ff3e8105140 2024-09-21T07:57:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.548+0000 7ff3eca00640 1 -- 172.21.15.84:0/162678793 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d400de50 con 0x7ff3e8105140 2024-09-21T07:57:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.548+0000 7ff3eca00640 1 -- 172.21.15.84:0/162678793 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400f620 con 0x7ff3e8105140 2024-09-21T07:57:19.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.552+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e81a03b0 con 0x7ff3e8105140 2024-09-21T07:57:19.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.553+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e806cde0 con 0x7ff3e8105140 2024-09-21T07:57:19.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.559+0000 7ff3f4a31740 1 Processor -- start 2024-09-21T07:57:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.561+0000 7ff3eca00640 1 -- 172.21.15.84:0/162678793 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff3d401a070 con 0x7ff3e8105140 2024-09-21T07:57:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.561+0000 7ff3f4a31740 1 -- start start 2024-09-21T07:57:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.574+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.574+0000 7ff3eca00640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3cc0c7780 0x7ff3cc0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab6015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd92b70 0x55ab6015b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ab600d0a90 con 0x55ab5fd92b70 2024-09-21T07:57:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab600bfec0 con 0x55ab5fdb3850 2024-09-21T07:57:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ab600c3cd0 con 0x55ab5fd8a990 2024-09-21T07:57:19.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab6015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab6015b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59832/0 (socket says 172.21.15.84:59832) 2024-09-21T07:57:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2422001901 learned_addr learned my addr 172.21.15.84:0/2422001901 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.575+0000 7ff3eca00640 1 -- 172.21.15.84:0/162678793 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7ff3d40e71b0 con 0x7ff3e8105140 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.577+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2422001901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 msgr2=0x55ab6015ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.577+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/2422001901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.577+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2422001901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd92b70 msgr2=0x55ab6015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.577+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/2422001901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd92b70 0x55ab6015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.577+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2422001901 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab600659d0 con 0x55ab5fd8a990 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.580+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/2422001901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab6015b0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009900 tx=0x7ff3d8005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98588451554e5bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.580+0000 7ff3d3e00640 1 -- 172.21.15.84:0/2422001901 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8035040 con 0x55ab5fd8a990 2024-09-21T07:57:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.580+0000 7ff3d3e00640 1 -- 172.21.15.84:0/2422001901 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d8047070 con 0x55ab5fd8a990 2024-09-21T07:57:19.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.580+0000 7ff3d3e00640 1 -- 172.21.15.84:0/2422001901 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8004ac0 con 0x55ab5fd8a990 2024-09-21T07:57:19.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.581+0000 7ff3e6000640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3cc0c7780 0x7ff3cc0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.583+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2422001901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 msgr2=0x55ab6015b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:19.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.585+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2422001901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab6015b0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009900 tx=0x7ff3d8005d50 comp rx=0 tx=0).stop 2024-09-21T07:57:19.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.586+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2422001901 shutdown_connections 2024-09-21T07:57:19.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.587+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2422001901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd92b70 0x55ab6015b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.587+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2422001901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab6015b0d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.587+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2422001901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.587+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2422001901 >> 172.21.15.84:0/2422001901 conn(0x55ab5fda7c40 msgr2=0x55ab60158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:19.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.593+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2422001901 shutdown_connections 2024-09-21T07:57:19.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.593+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2422001901 wait complete. 2024-09-21T07:57:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.594+0000 7ff3f4a31740 1 -- start start 2024-09-21T07:57:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.594+0000 7ff3f4a31740 1 Processor -- start 2024-09-21T07:57:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.595+0000 7ff3e6000640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3cc0c7780 0x7ff3cc0c9c90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009610 tx=0x7ff3d4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.603+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab60166680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.606+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd92b70 0x55ab60166bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.606+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 0x55ab60172620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.607+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ab5ff217b0 con 0x55ab5fdb3850 2024-09-21T07:57:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.607+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab60064650 con 0x55ab5fd92b70 2024-09-21T07:57:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.607+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ab60169310 con 0x55ab5fd8a990 2024-09-21T07:57:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.607+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd92b70 0x55ab60166bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.607+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd92b70 0x55ab60166bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52124/0 (socket says 172.21.15.84:52124) 2024-09-21T07:57:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.607+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2638089255 learned_addr learned my addr 172.21.15.84:0/2638089255 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.607+0000 7ff3f4a31740 10 client.0 _ll_register_callbacks cb 0x55ab5fdcb0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.608+0000 7ff3e7400640 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab60166680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.608+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2638089255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 msgr2=0x55ab60166680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.608+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab60166680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.608+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2638089255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 msgr2=0x55ab60172620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.608+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 0x55ab60172620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.608+0000 7ff3e6a00640 1 -- 172.21.15.84:0/2638089255 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab5fe2dba0 con 0x55ab5fd92b70 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.609+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd92b70 0x55ab60166bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800b010 tx=0x7ff3d80044e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc8aa31a918d1775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.609+0000 7ff3d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:57:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.614+0000 7ff3d0c00640 1 -- 172.21.15.84:0/2638089255 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8035040 con 0x55ab5fd92b70 2024-09-21T07:57:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.614+0000 7ff3d0c00640 1 -- 172.21.15.84:0/2638089255 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7ff3d8004860 con 0x55ab5fd92b70 2024-09-21T07:57:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.614+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d8047070 con 0x55ab5fd92b70 2024-09-21T07:57:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.615+0000 7ff3d0c00640 1 -- 172.21.15.84:0/2638089255 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3d8009520 con 0x55ab5fd92b70 2024-09-21T07:57:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.615+0000 7ff3f4a31740 10 client.27203 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.615+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ab60175270 con 0x55ab5fd92b70 2024-09-21T07:57:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.616+0000 7ff3d0c00640 1 -- 172.21.15.84:0/2638089255 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d8047070 con 0x55ab5fd92b70 2024-09-21T07:57:19.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.616+0000 7ff3d0c00640 1 -- 172.21.15.84:0/2638089255 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff3d80329f0 con 0x55ab5fd92b70 2024-09-21T07:57:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.618+0000 7ff3f4a31740 10 client.27203 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.618+0000 7ff3f4a31740 10 client.27203 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:57:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.618+0000 7ff3f4a31740 20 client.27203 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.618+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab5fd721d0 0x55ab601785d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.618+0000 7ff3f4a31740 4 client.27203 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.618+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab600d29e0 con 0x55ab5fd721d0 2024-09-21T07:57:19.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.618+0000 7ff3e7400640 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab5fd721d0 0x55ab601785d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.621+0000 7ff3d0c00640 10 client.27203 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:19.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.621+0000 7ff3e7400640 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab5fd721d0 0x55ab601785d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc135de4e6a8b504 server_cookie=e12cc08f7d7cd117 in_seq=0 out_seq=0 2024-09-21T07:57:19.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.622+0000 7ff3d0c00640 1 -- 172.21.15.84:0/2638089255 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab600d29e0 con 0x55ab5fd721d0 2024-09-21T07:57:19.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.622+0000 7ff3d0c00640 10 client.27203 handle_command_reply: tid=0 2024-09-21T07:57:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.622+0000 7ff3f4a31740 1 client.27203 shutdown 2024-09-21T07:57:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.622+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd92b70 msgr2=0x55ab60166bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd92b70 0x55ab60166bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800b010 tx=0x7ff3d80044e0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 shutdown_connections 2024-09-21T07:57:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 0x55ab60172620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd92b70 0x55ab60166bc0 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800b010 tx=0x7ff3d80044e0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab5fd721d0 0x55ab601785d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/2638089255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd8a990 0x55ab60166680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 >> 172.21.15.84:0/2638089255 conn(0x55ab5fda7c40 msgr2=0x55ab6015dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:19.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.623+0000 7ff3d0c00640 0 client.27203 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.624+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 shutdown_connections 2024-09-21T07:57:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.625+0000 7ff3f4a31740 1 -- 172.21.15.84:0/2638089255 wait complete. 2024-09-21T07:57:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.625+0000 7ff3f4a31740 20 client.27203 trim_cache size 0 max 16384 2024-09-21T07:57:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.670+0000 7ff3f4a31740 1 Processor -- start 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.671+0000 7ff3f4a31740 1 -- start start 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.671+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd8a990 0x55ab6015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.671+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.671+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab60172590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.671+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8074e10 con 0x55ab5fd8a990 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.671+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81a7e70 con 0x55ab5fdb3850 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.671+0000 7ff3f4a31740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81a6b10 con 0x55ab5fd47580 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.672+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.672+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52128/0 (socket says 172.21.15.84:52128) 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.672+0000 7ff3e6a00640 1 -- 172.21.15.84:0/460190537 learned_addr learned my addr 172.21.15.84:0/460190537 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.673+0000 7ff3e7400640 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd8a990 0x55ab6015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.673+0000 7ff3e7400640 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab60172590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.674+0000 7ff3e6a00640 1 -- 172.21.15.84:0/460190537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 msgr2=0x55ab60172590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.674+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab60172590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.674+0000 7ff3e6a00640 1 -- 172.21.15.84:0/460190537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd8a990 msgr2=0x55ab6015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.674+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd8a990 0x55ab6015e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.674+0000 7ff3e6a00640 1 -- 172.21.15.84:0/460190537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6015e8e0 con 0x55ab5fdb3850 2024-09-21T07:57:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.675+0000 7ff3e7400640 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab60172590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.675+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015b2a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8006010 tx=0x7ff3d800b1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc529a53f4dd0ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:19.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.676+0000 7ff3d3400640 1 -- 172.21.15.84:0/460190537 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8035040 con 0x55ab5fdb3850 2024-09-21T07:57:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.677+0000 7ff3d3400640 1 -- 172.21.15.84:0/460190537 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d8047070 con 0x55ab5fdb3850 2024-09-21T07:57:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.677+0000 7ff3d3400640 1 -- 172.21.15.84:0/460190537 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8035040 con 0x55ab5fdb3850 2024-09-21T07:57:19.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.678+0000 7ff3f4a31740 1 -- 172.21.15.84:0/460190537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 msgr2=0x55ab6015b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:19.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.678+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015b2a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8006010 tx=0x7ff3d800b1f0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.679+0000 7ff3f4a31740 1 -- 172.21.15.84:0/460190537 shutdown_connections 2024-09-21T07:57:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.679+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab60172590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.679+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fdb3850 0x55ab6015b2a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.679+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/460190537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fd8a990 0x55ab6015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.679+0000 7ff3f4a31740 1 -- 172.21.15.84:0/460190537 >> 172.21.15.84:0/460190537 conn(0x55ab5fda7c40 msgr2=0x55ab6015dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:19.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.680+0000 7ff3f4a31740 1 -- 172.21.15.84:0/460190537 shutdown_connections 2024-09-21T07:57:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.680+0000 7ff3f4a31740 1 -- 172.21.15.84:0/460190537 wait complete. 2024-09-21T07:57:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.681+0000 7ff3f4a31740 1 -- start start 2024-09-21T07:57:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.681+0000 7ff3f4a31740 1 Processor -- start 2024-09-21T07:57:19.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.683+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab6017b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.684+0000 7ff3f4a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd8a990 0x55ab6017be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.684+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab6017b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.684+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab6017b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59876/0 (socket says 172.21.15.84:59876) 2024-09-21T07:57:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.685+0000 7ff3e7400640 1 -- 172.21.15.84:0/435861336 learned_addr learned my addr 172.21.15.84:0/435861336 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.686+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 0x55ab601785d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.687+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd8a990 0x55ab6017be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.687+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81a77a0 con 0x55ab5fdb3850 2024-09-21T07:57:19.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.687+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81a70d0 con 0x55ab5fd8a990 2024-09-21T07:57:19.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.688+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8072e10 con 0x55ab5fd47580 2024-09-21T07:57:19.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.689+0000 7ff3f4a31740 10 client.0 _ll_register_callbacks cb 0x7ff3e0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:19.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.689+0000 7ff3e6a00640 1 -- 172.21.15.84:0/435861336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 msgr2=0x55ab6017b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.689+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab6017b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.689+0000 7ff3e6a00640 1 -- 172.21.15.84:0/435861336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 msgr2=0x55ab601785d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:19.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.689+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 0x55ab601785d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:19.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.689+0000 7ff3e6a00640 1 -- 172.21.15.84:0/435861336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab60178d60 con 0x55ab5fd8a990 2024-09-21T07:57:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.703+0000 7ff3e6a00640 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd8a990 0x55ab6017be70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8005d90 tx=0x7ff3d800b030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=424c3dbdada31be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.703+0000 7ff3d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:57:19.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.711+0000 7ff3d0c00640 1 -- 172.21.15.84:0/435861336 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8035070 con 0x55ab5fd8a990 2024-09-21T07:57:19.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.711+0000 7ff3d0c00640 1 -- 172.21.15.84:0/435861336 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7ff3d80047b0 con 0x55ab5fd8a990 2024-09-21T07:57:19.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.711+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d8047070 con 0x55ab5fd8a990 2024-09-21T07:57:19.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.712+0000 7ff3d0c00640 1 -- 172.21.15.84:0/435861336 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3d8074050 con 0x55ab5fd8a990 2024-09-21T07:57:19.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.712+0000 7ff3f4a31740 10 client.27209 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:19.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.712+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ab60178d60 con 0x55ab5fd8a990 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.712+0000 7ff3d0c00640 1 -- 172.21.15.84:0/435861336 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d8047070 con 0x55ab5fd8a990 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.713+0000 7ff3d0c00640 1 -- 172.21.15.84:0/435861336 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff3d8066540 con 0x55ab5fd8a990 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.713+0000 7ff3f4a31740 10 client.27209 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.713+0000 7ff3f4a31740 10 client.27209 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.713+0000 7ff3f4a31740 20 client.27209 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.713+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab601e39f0 0x55ab601e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.713+0000 7ff3f4a31740 4 client.27209 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T07:57:19.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.713+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x55ab600ce490 con 0x55ab601e39f0 2024-09-21T07:57:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.715+0000 7ff3e7400640 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab601e39f0 0x55ab601e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:19.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.719+0000 7ff3e7400640 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab601e39f0 0x55ab601e5e10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=126095d9bc9a3385 server_cookie=24fb08ca2610919f in_seq=0 out_seq=0 2024-09-21T07:57:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:19.719+0000 7ff3d0c00640 10 client.27209 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:20.836 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:21.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:21 smithi084 ceph-mon[30411]: pgmap v583: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 32 KiB/s rd, 218 MiB/s wr, 1.83k op/s 2024-09-21T07:57:21.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:21 smithi162 ceph-mon[34833]: pgmap v583: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 32 KiB/s rd, 218 MiB/s wr, 1.83k op/s 2024-09-21T07:57:21.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:21 smithi191 ceph-mon[34667]: pgmap v583: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 985 GiB / 1.0 TiB avail; 32 KiB/s rd, 218 MiB/s wr, 1.83k op/s 2024-09-21T07:57:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.719+0000 7ff3d0c00640 1 -- 172.21.15.84:0/435861336 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ab600ce490 con 0x55ab601e39f0 2024-09-21T07:57:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.719+0000 7ff3d0c00640 10 client.27209 handle_command_reply: tid=0 2024-09-21T07:57:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.719+0000 7ff3f4a31740 1 client.27209 shutdown 2024-09-21T07:57:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.720+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd8a990 msgr2=0x55ab6017be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.720+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd8a990 0x55ab6017be70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8005d90 tx=0x7ff3d800b030 comp rx=0 tx=0).stop 2024-09-21T07:57:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.721+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 shutdown_connections 2024-09-21T07:57:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.721+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ab5fdb3850 0x55ab601785d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.721+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab5fd8a990 0x55ab6017be70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.721+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ab601e39f0 0x55ab601e5e10 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.721+0000 7ff3f4a31740 1 --2- 172.21.15.84:0/435861336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab5fd47580 0x55ab6017b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.721+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 >> 172.21.15.84:0/435861336 conn(0x55ab5fda7c40 msgr2=0x55ab6015bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.721+0000 7ff3d0c00640 0 client.27209 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.722+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 shutdown_connections 2024-09-21T07:57:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.722+0000 7ff3f4a31740 1 -- 172.21.15.84:0/435861336 wait complete. 2024-09-21T07:57:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.722+0000 7ff3f4a31740 20 client.27209 trim_cache size 0 max 16384 2024-09-21T07:57:22.724 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 22, 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "26aae511": { 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 22, 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:57:22.725 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 139.2, 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:22.726 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3cc0c7780 msgr2=0x7ff3cc0c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3cc0c7780 0x7ff3cc0c9c90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009610 tx=0x7ff3d4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8105140 msgr2=0x7ff3e819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8105140 0x7ff3e819a6f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400d740 tx=0x7ff3d400dc00 comp rx=0 tx=0).stop 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 shutdown_connections 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff3cc0c7780 0x7ff3cc0c9c90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e810dc50 0x7ff3e819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8105140 0x7ff3e819a6f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 --2- 172.21.15.84:0/162678793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3e81047f0 0x7ff3e819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.725+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 >> 172.21.15.84:0/162678793 conn(0x7ff3e80fe330 msgr2=0x7ff3e8105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.726+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 shutdown_connections 2024-09-21T07:57:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.727+0000 7ff3e7e00640 1 -- 172.21.15.84:0/162678793 wait complete. 2024-09-21T07:57:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 -- 172.21.15.84:0/3384587267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4077940 msgr2=0x7f61f4077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3384587267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4077940 0x7f61f4077d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009900 tx=0x7f61e402a410 comp rx=0 tx=0).stop 2024-09-21T07:57:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 -- 172.21.15.84:0/3384587267 shutdown_connections 2024-09-21T07:57:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3384587267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4114770 0x7f61f4116b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3384587267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f4078290 0x7f61f4114230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3384587267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4077940 0x7f61f4077d50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 -- 172.21.15.84:0/3384587267 >> 172.21.15.84:0/3384587267 conn(0x7f61f41017c0 msgr2=0x7f61f4103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 -- 172.21.15.84:0/3384587267 shutdown_connections 2024-09-21T07:57:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.872+0000 7f61f8c00640 1 -- 172.21.15.84:0/3384587267 wait complete. 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.873+0000 7f61f8c00640 1 Processor -- start 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.873+0000 7f61f8c00640 1 -- start start 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.873+0000 7f61f8c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f4077940 0x7f61f41a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4078290 0x7f61f41a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4114770 0x7f61f41a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f8c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f61f411a100 con 0x7f61f4078290 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61f4119f80 con 0x7f61f4114770 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f8c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f61f411a280 con 0x7f61f4077940 2024-09-21T07:57:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f4077940 0x7f61f41a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4114770 0x7f61f41a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4114770 0x7f61f41a6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52154/0 (socket says 172.21.15.84:52154) 2024-09-21T07:57:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f4077940 0x7f61f41a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59896/0 (socket says 172.21.15.84:59896) 2024-09-21T07:57:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 -- 172.21.15.84:0/3914194248 learned_addr learned my addr 172.21.15.84:0/3914194248 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f1400640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4078290 0x7f61f41a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 -- 172.21.15.84:0/3914194248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f4077940 msgr2=0x7f61f41a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f4077940 0x7f61f41a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 -- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4078290 msgr2=0x7f61f41a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4078290 0x7f61f41a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.874+0000 7f61f2800640 1 -- 172.21.15.84:0/3914194248 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f41a6a40 con 0x7f61f4114770 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.875+0000 7f61f2800640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4114770 0x7f61f41a6310 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00eb10 tx=0x7f61ec00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.875+0000 7f61eaa00640 1 -- 172.21.15.84:0/3914194248 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec004b20 con 0x7f61f4114770 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.875+0000 7f61eaa00640 1 -- 172.21.15.84:0/3914194248 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61ec004cc0 con 0x7f61f4114770 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.875+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f41a6d30 con 0x7f61f4114770 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.875+0000 7f61eaa00640 1 -- 172.21.15.84:0/3914194248 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec010670 con 0x7f61f4114770 2024-09-21T07:57:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.875+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f41ad490 con 0x7f61f4114770 2024-09-21T07:57:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.878+0000 7f61ff823740 1 Processor -- start 2024-09-21T07:57:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61eaa00640 1 -- 172.21.15.84:0/3914194248 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f61ec005020 con 0x7f61f4114770 2024-09-21T07:57:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61ff823740 1 -- start start 2024-09-21T07:57:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61ff823740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccaeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61ff823740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccaf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61ff823740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8e7390 0x56104ccaf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61ff823740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56104cc25fb0 con 0x56104c8e7390 2024-09-21T07:57:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61ff823740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56104cc153e0 con 0x56104c8df1b0 2024-09-21T07:57:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.879+0000 7f61ff823740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56104cc191f0 con 0x56104c908070 2024-09-21T07:57:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccaf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccaf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52162/0 (socket says 172.21.15.84:52162) 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 -- 172.21.15.84:0/305469963 learned_addr learned my addr 172.21.15.84:0/305469963 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1400640 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccaeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1400640 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8e7390 0x56104ccaf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 -- 172.21.15.84:0/305469963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 msgr2=0x56104ccaeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccaeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 -- 172.21.15.84:0/305469963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8e7390 msgr2=0x56104ccaf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8e7390 0x56104ccaf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1e00640 1 -- 172.21.15.84:0/305469963 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104cbdfcd0 con 0x56104c8df1b0 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.880+0000 7f61f1400640 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8e7390 0x56104ccaf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.881+0000 7f61f1e00640 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccaf2e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009900 tx=0x7f61e4032b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa128a28a613307 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.881+0000 7f61df000640 1 -- 172.21.15.84:0/305469963 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4040070 con 0x56104c8df1b0 2024-09-21T07:57:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.881+0000 7f61df000640 1 -- 172.21.15.84:0/305469963 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e4004030 con 0x56104c8df1b0 2024-09-21T07:57:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61eaa00640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61d80b6700 0x7f61d80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61df000640 1 -- 172.21.15.84:0/305469963 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4035040 con 0x56104c8df1b0 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 -- 172.21.15.84:0/305469963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 msgr2=0x56104ccaf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccaf2e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009900 tx=0x7f61e4032b90 comp rx=0 tx=0).stop 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61f1400640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61d80b6700 0x7f61d80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61eaa00640 1 -- 172.21.15.84:0/3914194248 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f61ec0e8060 con 0x7f61f4114770 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 -- 172.21.15.84:0/305469963 shutdown_connections 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8e7390 0x56104ccaf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccaf2e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 --2- 172.21.15.84:0/305469963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccaeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 -- 172.21.15.84:0/305469963 >> 172.21.15.84:0/305469963 conn(0x56104c8fc460 msgr2=0x56104ccacc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.882+0000 7f61ff823740 1 -- 172.21.15.84:0/305469963 shutdown_connections 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.883+0000 7f61f1400640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61d80b6700 0x7f61d80b8c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f61f407a0a0 tx=0x7f61e0004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.883+0000 7f61ff823740 1 -- 172.21.15.84:0/305469963 wait complete. 2024-09-21T07:57:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.883+0000 7f61ff823740 1 -- start start 2024-09-21T07:57:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.883+0000 7f61ff823740 1 Processor -- start 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.885+0000 7f61ff823740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8df1b0 0x56104ccba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.885+0000 7f61ff823740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccbaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.885+0000 7f61ff823740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccbaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.885+0000 7f61ff823740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56104ca76700 con 0x56104c8df1b0 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.885+0000 7f61ff823740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56104cbb0580 con 0x56104c8e7390 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.885+0000 7f61ff823740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56104ccbd5c0 con 0x56104c908070 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.885+0000 7f61ff823740 10 client.0 _ll_register_callbacks cb 0x56104cbc0470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:22.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccbaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccbaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccbaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52166/0 (socket says 172.21.15.84:52166) 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 -- 172.21.15.84:0/2748538439 learned_addr learned my addr 172.21.15.84:0/2748538439 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 -- 172.21.15.84:0/2748538439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 msgr2=0x56104ccbaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccbaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 -- 172.21.15.84:0/2748538439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8df1b0 msgr2=0x56104ccba4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8df1b0 0x56104ccba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.886+0000 7f61f1400640 1 -- 172.21.15.84:0/2748538439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56104c973650 con 0x56104c8e7390 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61f1400640 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccbaa00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f61e0005bc0 tx=0x7f61e0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b579604b93e09b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61d3400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61d3400640 1 -- 172.21.15.84:0/2748538439 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e002d060 con 0x56104c8e7390 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61d3400640 1 -- 172.21.15.84:0/2748538439 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f61e001ebe0 con 0x56104c8e7390 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56104cbb2b90 con 0x56104c8e7390 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61d3400640 1 -- 172.21.15.84:0/2748538439 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61e001ede0 con 0x56104c8e7390 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61ff823740 10 client.27221 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.887+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56104cbcd950 con 0x56104c8e7390 2024-09-21T07:57:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61d3400640 1 -- 172.21.15.84:0/2748538439 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56104cbb2b90 con 0x56104c8e7390 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61d3400640 1 -- 172.21.15.84:0/2748538439 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f61e001c4a0 con 0x56104c8e7390 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61ff823740 10 client.27221 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61ff823740 10 client.27221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61ff823740 20 client.27221 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61ff823740 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c8c69f0 0x56104cccc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61ff823740 4 client.27221 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.888+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56104cc27f00 con 0x56104c8c69f0 2024-09-21T07:57:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.889+0000 7f61f1e00640 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c8c69f0 0x56104cccc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.890+0000 7f61d3400640 10 client.27221 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:57:22.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.890+0000 7f61f1e00640 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c8c69f0 0x56104cccc7e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe7615607b16668b server_cookie=fba22978381c7a95 in_seq=0 out_seq=0 2024-09-21T07:57:22.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.890+0000 7f61d3400640 1 -- 172.21.15.84:0/2748538439 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56104cc27f00 con 0x56104c8c69f0 2024-09-21T07:57:22.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.890+0000 7f61d3400640 10 client.27221 handle_command_reply: tid=0 2024-09-21T07:57:22.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.892+0000 7f61ff823740 1 client.27221 shutdown 2024-09-21T07:57:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.893+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 msgr2=0x56104ccbaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.893+0000 7f61ff823740 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccbaa00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f61e0005bc0 tx=0x7f61e0005f90 comp rx=0 tx=0).stop 2024-09-21T07:57:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.901+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 shutdown_connections 2024-09-21T07:57:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.901+0000 7f61ff823740 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c8c69f0 0x56104cccc7e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.901+0000 7f61ff823740 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c908070 0x56104ccbaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.901+0000 7f61ff823740 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccbaa00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.901+0000 7f61ff823740 1 --2- 172.21.15.84:0/2748538439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c8df1b0 0x56104ccba4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.901+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 >> 172.21.15.84:0/2748538439 conn(0x56104c8fc460 msgr2=0x56104ccb1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.901+0000 7f61d3400640 0 client.27221 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:57:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.902+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 shutdown_connections 2024-09-21T07:57:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.902+0000 7f61ff823740 1 -- 172.21.15.84:0/2748538439 wait complete. 2024-09-21T07:57:22.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.904+0000 7f61ff823740 20 client.27221 trim_cache size 0 max 16384 2024-09-21T07:57:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.946+0000 7f61ff823740 1 Processor -- start 2024-09-21T07:57:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.946+0000 7f61ff823740 1 -- start start 2024-09-21T07:57:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.947+0000 7f61ff823740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8df1b0 0x56104ccb76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.947+0000 7f61ff823740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccb7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.947+0000 7f61ff823740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 0x56104ccd1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.947+0000 7f61ff823740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f61f41b7380 con 0x56104c908070 2024-09-21T07:57:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.947+0000 7f61ff823740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61f41b8ec0 con 0x56104c8e7390 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.947+0000 7f61ff823740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f61f41b7a50 con 0x56104c8df1b0 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.947+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8df1b0 0x56104ccb76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccb7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8df1b0 0x56104ccb76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59924/0 (socket says 172.21.15.84:59924) 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1e00640 1 -- 172.21.15.84:0/499068227 learned_addr learned my addr 172.21.15.84:0/499068227 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1400640 1 -- 172.21.15.84:0/499068227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8df1b0 msgr2=0x56104ccb76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1400640 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8df1b0 0x56104ccb76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1400640 1 -- 172.21.15.84:0/499068227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 msgr2=0x56104ccd1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1400640 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 0x56104ccd1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1400640 1 -- 172.21.15.84:0/499068227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104ccc91c0 con 0x56104c8e7390 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.948+0000 7f61f1e00640 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8df1b0 0x56104ccb76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.949+0000 7f61f1400640 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccb7bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f61e001ca60 tx=0x7f61e001ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8925ebe48cae75c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.949+0000 7f61de600640 1 -- 172.21.15.84:0/499068227 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e001cae0 con 0x56104c8e7390 2024-09-21T07:57:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.949+0000 7f61de600640 1 -- 172.21.15.84:0/499068227 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e001cc80 con 0x56104c8e7390 2024-09-21T07:57:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.949+0000 7f61de600640 1 -- 172.21.15.84:0/499068227 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0028d00 con 0x56104c8e7390 2024-09-21T07:57:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.952+0000 7f61ff823740 1 -- 172.21.15.84:0/499068227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 msgr2=0x56104ccb7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.952+0000 7f61ff823740 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccb7bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f61e001ca60 tx=0x7f61e001ceb0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.953+0000 7f61ff823740 1 -- 172.21.15.84:0/499068227 shutdown_connections 2024-09-21T07:57:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.953+0000 7f61ff823740 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 0x56104ccd1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.953+0000 7f61ff823740 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8e7390 0x56104ccb7bf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.953+0000 7f61ff823740 1 --2- 172.21.15.84:0/499068227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8df1b0 0x56104ccb76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.953+0000 7f61ff823740 1 -- 172.21.15.84:0/499068227 >> 172.21.15.84:0/499068227 conn(0x56104c8fc460 msgr2=0x56104ccb8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.954+0000 7f61ff823740 1 -- 172.21.15.84:0/499068227 shutdown_connections 2024-09-21T07:57:22.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.955+0000 7f61ff823740 1 -- 172.21.15.84:0/499068227 wait complete. 2024-09-21T07:57:22.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.955+0000 7f61ff823740 1 -- start start 2024-09-21T07:57:22.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.956+0000 7f61ff823740 1 Processor -- start 2024-09-21T07:57:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.958+0000 7f61ff823740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccbecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.958+0000 7f61ff823740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8e7390 0x56104ccbf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.958+0000 7f61ff823740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 0x56104cd361e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.959+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccbecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.959+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccbecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52190/0 (socket says 172.21.15.84:52190) 2024-09-21T07:57:22.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.959+0000 7f61ff823740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f61f41b87f0 con 0x56104c908070 2024-09-21T07:57:22.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.959+0000 7f61ff823740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61f41b8120 con 0x56104c8df1b0 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.959+0000 7f61ff823740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f61f41b5380 con 0x56104c8e7390 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.959+0000 7f61ff823740 10 client.0 _ll_register_callbacks cb 0x7f61e00208b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.959+0000 7f61f1e00640 1 -- 172.21.15.84:0/1892286292 learned_addr learned my addr 172.21.15.84:0/1892286292 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.960+0000 7f61f1e00640 1 -- 172.21.15.84:0/1892286292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8e7390 msgr2=0x56104ccbf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.960+0000 7f61f1e00640 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8e7390 0x56104ccbf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.960+0000 7f61f1e00640 1 -- 172.21.15.84:0/1892286292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 msgr2=0x56104cd361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.960+0000 7f61f1e00640 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 0x56104cd361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.960+0000 7f61f1e00640 1 -- 172.21.15.84:0/1892286292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56104cd36720 con 0x56104c8df1b0 2024-09-21T07:57:22.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.960+0000 7f61f1e00640 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccbecd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f61e4032fd0 tx=0x7f61e4031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12b64606aec2ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.963+0000 7f61d3400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:57:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.963+0000 7f61d3400640 1 -- 172.21.15.84:0/1892286292 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4035040 con 0x56104c8df1b0 2024-09-21T07:57:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.963+0000 7f61d3400640 1 -- 172.21.15.84:0/1892286292 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f61e40051f0 con 0x56104c8df1b0 2024-09-21T07:57:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.964+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61e001cc80 con 0x56104c8df1b0 2024-09-21T07:57:22.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.965+0000 7f61d3400640 1 -- 172.21.15.84:0/1892286292 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61e405b050 con 0x56104c8df1b0 2024-09-21T07:57:22.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.965+0000 7f61ff823740 10 client.27227 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:22.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.965+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56104cd37810 con 0x56104c8df1b0 2024-09-21T07:57:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.967+0000 7f61d3400640 1 -- 172.21.15.84:0/1892286292 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e001cc80 con 0x56104c8df1b0 2024-09-21T07:57:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.967+0000 7f61d3400640 1 -- 172.21.15.84:0/1892286292 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f61e4004750 con 0x56104c8df1b0 2024-09-21T07:57:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.967+0000 7f61ff823740 10 client.27227 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.967+0000 7f61ff823740 10 client.27227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:57:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.967+0000 7f61ff823740 20 client.27227 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.967+0000 7f61ff823740 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c89bda0 0x56104cd39be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.968+0000 7f61ff823740 4 client.27227 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:57:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.968+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56104cc239b0 con 0x56104c89bda0 2024-09-21T07:57:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.968+0000 7f61f1400640 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c89bda0 0x56104cd39be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.970+0000 7f61f1400640 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c89bda0 0x56104cd39be0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=915e0e43267ec905 server_cookie=678a888ed1ee1724 in_seq=0 out_seq=0 2024-09-21T07:57:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.971+0000 7f61d3400640 10 client.27227 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:57:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.971+0000 7f61d3400640 1 -- 172.21.15.84:0/1892286292 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56104cc239b0 con 0x56104c89bda0 2024-09-21T07:57:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.971+0000 7f61d3400640 10 client.27227 handle_command_reply: tid=0 2024-09-21T07:57:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.971+0000 7f61ff823740 1 client.27227 shutdown 2024-09-21T07:57:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.972+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 msgr2=0x56104ccbecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.972+0000 7f61ff823740 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccbecd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f61e4032fd0 tx=0x7f61e4031400 comp rx=0 tx=0).stop 2024-09-21T07:57:22.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 shutdown_connections 2024-09-21T07:57:22.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x56104c89bda0 0x56104cd39be0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104c908070 0x56104cd361e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56104c8e7390 0x56104ccbf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 --2- 172.21.15.84:0/1892286292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56104c8df1b0 0x56104ccbecd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 >> 172.21.15.84:0/1892286292 conn(0x56104c8fc460 msgr2=0x56104ccc5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61d3400640 0 client.27227 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:57:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 shutdown_connections 2024-09-21T07:57:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.973+0000 7f61ff823740 1 -- 172.21.15.84:0/1892286292 wait complete. 2024-09-21T07:57:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.975+0000 7f61ff823740 20 client.27227 trim_cache size 0 max 16384 2024-09-21T07:57:22.981 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:57:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.981+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61d80b6700 msgr2=0x7f61d80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.981+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61d80b6700 0x7f61d80b8c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f61f407a0a0 tx=0x7f61e0004730 comp rx=0 tx=0).stop 2024-09-21T07:57:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4114770 msgr2=0x7f61f41a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4114770 0x7f61f41a6310 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00eb10 tx=0x7f61ec00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 shutdown_connections 2024-09-21T07:57:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f61d80b6700 0x7f61d80b8c10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f4114770 0x7f61f41a6310 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61f4078290 0x7f61f41a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 --2- 172.21.15.84:0/3914194248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f4077940 0x7f61f41a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.982+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 >> 172.21.15.84:0/3914194248 conn(0x7f61f41017c0 msgr2=0x7f61f4103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.983+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 shutdown_connections 2024-09-21T07:57:22.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:22.983+0000 7f61f8c00640 1 -- 172.21.15.84:0/3914194248 wait complete. 2024-09-21T07:57:23.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:23 smithi162 ceph-mon[34833]: pgmap v584: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 984 GiB / 1.0 TiB avail; 30 KiB/s rd, 215 MiB/s wr, 2.07k op/s 2024-09-21T07:57:23.812 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:23 smithi084 ceph-mon[30411]: pgmap v584: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 984 GiB / 1.0 TiB avail; 30 KiB/s rd, 215 MiB/s wr, 2.07k op/s 2024-09-21T07:57:23.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:23 smithi191 ceph-mon[34667]: pgmap v584: 129 pgs: 129 active+clean; 42 GiB data, 88 GiB used, 984 GiB / 1.0 TiB avail; 30 KiB/s rd, 215 MiB/s wr, 2.07k op/s 2024-09-21T07:57:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.554+0000 7f74d3e00640 1 -- 172.21.15.84:0/2244405028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d410a900 msgr2=0x7f74d410ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.554+0000 7f74d3e00640 1 --2- 172.21.15.84:0/2244405028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d410a900 0x7f74d410ad10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009ca0 tx=0x7f74c402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.554+0000 7f74d3e00640 1 -- 172.21.15.84:0/2244405028 shutdown_connections 2024-09-21T07:57:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.554+0000 7f74d3e00640 1 --2- 172.21.15.84:0/2244405028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d411cba0 0x7f74d411efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.555+0000 7f74d3e00640 1 --2- 172.21.15.84:0/2244405028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d410a900 0x7f74d410ad10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.555+0000 7f74d3e00640 1 --2- 172.21.15.84:0/2244405028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d4111ca0 0x7f74d410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.555+0000 7f74d3e00640 1 -- 172.21.15.84:0/2244405028 >> 172.21.15.84:0/2244405028 conn(0x7f74d4070c00 msgr2=0x7f74d4071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.555+0000 7f74d3e00640 1 -- 172.21.15.84:0/2244405028 shutdown_connections 2024-09-21T07:57:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.559+0000 7f74d3e00640 1 -- 172.21.15.84:0/2244405028 wait complete. 2024-09-21T07:57:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.560+0000 7f74d3e00640 1 Processor -- start 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.561+0000 7f74d3e00640 1 -- start start 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.561+0000 7f74d3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d410a900 0x7f74d41126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.561+0000 7f74d3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d4111ca0 0x7f74d4112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.561+0000 7f74d3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d411cba0 0x7f74d4117ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.561+0000 7f74d3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41226f0 con 0x7f74d4111ca0 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.562+0000 7f74d3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4122570 con 0x7f74d410a900 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.562+0000 7f74d3e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4122870 con 0x7f74d411cba0 2024-09-21T07:57:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.562+0000 7f74d3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d411cba0 0x7f74d4117ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.562+0000 7f74d3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d411cba0 0x7f74d4117ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59942/0 (socket says 172.21.15.84:59942) 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.562+0000 7f74d3400640 1 -- 172.21.15.84:0/110115684 learned_addr learned my addr 172.21.15.84:0/110115684 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.562+0000 7f74d2000640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d4111ca0 0x7f74d4112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.562+0000 7f74d2a00640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d410a900 0x7f74d41126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.563+0000 7f74d3400640 1 -- 172.21.15.84:0/110115684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d410a900 msgr2=0x7f74d41126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.563+0000 7f74d3400640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d410a900 0x7f74d41126a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.563+0000 7f74d3400640 1 -- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d4111ca0 msgr2=0x7f74d4112c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.563+0000 7f74d3400640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d4111ca0 0x7f74d4112c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.563+0000 7f74d3400640 1 -- 172.21.15.84:0/110115684 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d41185b0 con 0x7f74d411cba0 2024-09-21T07:57:24.566 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.563+0000 7f74d3400640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d411cba0 0x7f74d4117ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009fd0 tx=0x7f74bc00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.564+0000 7f74cb400640 1 -- 172.21.15.84:0/110115684 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc011830 con 0x7f74d411cba0 2024-09-21T07:57:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.564+0000 7f74cb400640 1 -- 172.21.15.84:0/110115684 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74bc016070 con 0x7f74d411cba0 2024-09-21T07:57:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.564+0000 7f74cb400640 1 -- 172.21.15.84:0/110115684 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc010df0 con 0x7f74d411cba0 2024-09-21T07:57:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.565+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d41188a0 con 0x7f74d411cba0 2024-09-21T07:57:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.565+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d4119040 con 0x7f74d411cba0 2024-09-21T07:57:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.570+0000 7f74e0c2d740 1 Processor -- start 2024-09-21T07:57:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.572+0000 7f74cb400640 1 -- 172.21.15.84:0/110115684 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f74bc0104a0 con 0x7f74d411cba0 2024-09-21T07:57:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.573+0000 7f74e0c2d740 1 -- start start 2024-09-21T07:57:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.573+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ed01b0 0x562ef6274e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.573+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6275350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.573+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef6275890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.573+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ef61ea6b0 con 0x562ef5ed01b0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.573+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562ef61d9ae0 con 0x562ef5eaf4d0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.573+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562ef61dd8f0 con 0x562ef5ea72f0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6275350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6275350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59946/0 (socket says 172.21.15.84:59946) 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 -- 172.21.15.84:0/459441620 learned_addr learned my addr 172.21.15.84:0/459441620 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 -- 172.21.15.84:0/459441620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 msgr2=0x562ef6275890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 --2- 172.21.15.84:0/459441620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef6275890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 -- 172.21.15.84:0/459441620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ed01b0 msgr2=0x562ef6274e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 --2- 172.21.15.84:0/459441620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ed01b0 0x562ef6274e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.574+0000 7f74d2a00640 1 -- 172.21.15.84:0/459441620 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef61a6780 con 0x562ef5ea72f0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.575+0000 7f74d2a00640 1 --2- 172.21.15.84:0/459441620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6275350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009c20 tx=0x7f74cc0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab663594d8f97913 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.575+0000 7f74c3e00640 1 -- 172.21.15.84:0/459441620 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc012450 con 0x562ef5ea72f0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.575+0000 7f74c3e00640 1 -- 172.21.15.84:0/459441620 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74cc012aa0 con 0x562ef5ea72f0 2024-09-21T07:57:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.575+0000 7f74c3e00640 1 -- 172.21.15.84:0/459441620 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00fb50 con 0x562ef5ea72f0 2024-09-21T07:57:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.578+0000 7f74e0c2d740 1 -- 172.21.15.84:0/459441620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 msgr2=0x562ef6275350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.578+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/459441620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6275350 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009c20 tx=0x7f74cc0117b0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.578+0000 7f74e0c2d740 1 -- 172.21.15.84:0/459441620 shutdown_connections 2024-09-21T07:57:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.578+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/459441620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef6275890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.578+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/459441620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6275350 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.578+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/459441620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ed01b0 0x562ef6274e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.578+0000 7f74e0c2d740 1 -- 172.21.15.84:0/459441620 >> 172.21.15.84:0/459441620 conn(0x562ef5ec4300 msgr2=0x562ef6272d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.579+0000 7f74e0c2d740 1 -- 172.21.15.84:0/459441620 shutdown_connections 2024-09-21T07:57:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.579+0000 7f74e0c2d740 1 -- 172.21.15.84:0/459441620 wait complete. 2024-09-21T07:57:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.582+0000 7f74e0c2d740 1 -- start start 2024-09-21T07:57:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.584+0000 7f74cb400640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f74b80b6610 0x7f74b80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.585+0000 7f74cb400640 1 -- 172.21.15.84:0/110115684 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f74bc0e6a70 con 0x7f74d411cba0 2024-09-21T07:57:24.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.585+0000 7f74e0c2d740 1 Processor -- start 2024-09-21T07:57:24.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.586+0000 7f74d2000640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f74b80b6610 0x7f74b80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.588+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ea72f0 0x562ef6280440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.588+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef6280980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.588+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ed01b0 0x562ef6280f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.588+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ef6111ab0 con 0x562ef5ea72f0 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.588+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562ef6180570 con 0x562ef5eaf4d0 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.588+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562ef6283590 con 0x562ef5ed01b0 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.589+0000 7f74e0c2d740 10 client.0 _ll_register_callbacks cb 0x562ef618f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.589+0000 7f74d2000640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f74b80b6610 0x7f74b80b8b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f74c402ade0 tx=0x7f74c4005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.589+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ea72f0 0x562ef6280440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.589+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ea72f0 0x562ef6280440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46598/0 (socket says 172.21.15.84:46598) 2024-09-21T07:57:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.589+0000 7f74d2a00640 1 -- 172.21.15.84:0/3193391589 learned_addr learned my addr 172.21.15.84:0/3193391589 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.590+0000 7f74d2a00640 1 -- 172.21.15.84:0/3193391589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ed01b0 msgr2=0x562ef6280f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.590+0000 7f74d2a00640 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ed01b0 0x562ef6280f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.590+0000 7f74d2a00640 1 -- 172.21.15.84:0/3193391589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 msgr2=0x562ef6280980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:57:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.590+0000 7f74d2a00640 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef6280980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.590+0000 7f74d2a00640 1 -- 172.21.15.84:0/3193391589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef5f3b790 con 0x562ef5ea72f0 2024-09-21T07:57:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.593+0000 7f74d2a00640 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ea72f0 0x562ef6280440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00f730 tx=0x7f74cc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcd298bc593744c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.593+0000 7f74c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.595+0000 7f74c0c00640 1 -- 172.21.15.84:0/3193391589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc012450 con 0x562ef5ea72f0 2024-09-21T07:57:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.595+0000 7f74c0c00640 1 -- 172.21.15.84:0/3193391589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f74cc0125f0 con 0x562ef5ea72f0 2024-09-21T07:57:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.596+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74cc012aa0 con 0x562ef5ea72f0 2024-09-21T07:57:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.598+0000 7f74c0c00640 1 -- 172.21.15.84:0/3193391589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74cc0127f0 con 0x562ef5ea72f0 2024-09-21T07:57:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.598+0000 7f74e0c2d740 10 client.16977 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.598+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562ef5fb4620 con 0x562ef5ea72f0 2024-09-21T07:57:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.601+0000 7f74c0c00640 1 -- 172.21.15.84:0/3193391589 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74cc012aa0 con 0x562ef5ea72f0 2024-09-21T07:57:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.602+0000 7f74c0c00640 1 -- 172.21.15.84:0/3193391589 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f74cc0046c0 con 0x562ef5ea72f0 2024-09-21T07:57:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.603+0000 7f74e0c2d740 10 client.16977 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.603+0000 7f74e0c2d740 10 client.16977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.603+0000 7f74e0c2d740 20 client.16977 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.603+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5e8ed80 0x562ef62924a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.603+0000 7f74e0c2d740 4 client.16977 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.603+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ef61ec600 con 0x562ef5e8ed80 2024-09-21T07:57:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.604+0000 7f74d2000640 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5e8ed80 0x562ef62924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.606+0000 7f74d2000640 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5e8ed80 0x562ef62924a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389f5ee06b9f0bc6 server_cookie=a9524dda8fa40b88 in_seq=0 out_seq=0 2024-09-21T07:57:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.606+0000 7f74c0c00640 10 client.16977 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.607+0000 7f74c0c00640 1 -- 172.21.15.84:0/3193391589 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ef61ec600 con 0x562ef5e8ed80 2024-09-21T07:57:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.608+0000 7f74c0c00640 10 client.16977 handle_command_reply: tid=0 2024-09-21T07:57:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.608+0000 7f74e0c2d740 1 client.16977 shutdown 2024-09-21T07:57:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.608+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ea72f0 msgr2=0x562ef6280440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.608+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ea72f0 0x562ef6280440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00f730 tx=0x7f74cc00f580 comp rx=0 tx=0).stop 2024-09-21T07:57:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.609+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 shutdown_connections 2024-09-21T07:57:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.609+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5e8ed80 0x562ef62924a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.609+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ed01b0 0x562ef6280f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.609+0000 7f74c0c00640 0 client.16977 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.610+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef6280980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.610+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3193391589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5ea72f0 0x562ef6280440 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.610+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 >> 172.21.15.84:0/3193391589 conn(0x562ef5ec4300 msgr2=0x562ef6275e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.611+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 shutdown_connections 2024-09-21T07:57:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.611+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3193391589 wait complete. 2024-09-21T07:57:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.612+0000 7f74e0c2d740 20 client.16977 trim_cache size 0 max 16384 2024-09-21T07:57:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.653+0000 7f74e0c2d740 1 Processor -- start 2024-09-21T07:57:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.653+0000 7f74e0c2d740 1 -- start start 2024-09-21T07:57:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.654+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5e8ed80 0x562ef6271a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.654+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5ea72f0 0x562ef627d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.654+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5eaf4d0 0x562ef627db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.654+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41c83c0 con 0x562ef5eaf4d0 2024-09-21T07:57:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.654+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41c9f00 con 0x562ef5ea72f0 2024-09-21T07:57:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.654+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41c8a90 con 0x562ef5e8ed80 2024-09-21T07:57:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.654+0000 7f74d2000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5ea72f0 0x562ef627d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.655+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5e8ed80 0x562ef6271a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.655+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5e8ed80 0x562ef6271a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59956/0 (socket says 172.21.15.84:59956) 2024-09-21T07:57:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.655+0000 7f74d2a00640 1 -- 172.21.15.84:0/974056640 learned_addr learned my addr 172.21.15.84:0/974056640 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.656+0000 7f74d2000640 1 -- 172.21.15.84:0/974056640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5e8ed80 msgr2=0x562ef6271a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.656+0000 7f74d2000640 1 --2- 172.21.15.84:0/974056640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5e8ed80 0x562ef6271a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.656+0000 7f74d2000640 1 -- 172.21.15.84:0/974056640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5eaf4d0 msgr2=0x562ef627db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.656+0000 7f74d2000640 1 --2- 172.21.15.84:0/974056640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5eaf4d0 0x562ef627db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.656+0000 7f74d2000640 1 -- 172.21.15.84:0/974056640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef626d000 con 0x562ef5ea72f0 2024-09-21T07:57:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.657+0000 7f74d2000640 1 --2- 172.21.15.84:0/974056640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5ea72f0 0x562ef627d630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f74c402aeb0 tx=0x7f74c403d070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2fd0c289a60f195 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.657+0000 7f74c3400640 1 -- 172.21.15.84:0/974056640 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4054070 con 0x562ef5ea72f0 2024-09-21T07:57:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.658+0000 7f74c3400640 1 -- 172.21.15.84:0/974056640 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74c4036050 con 0x562ef5ea72f0 2024-09-21T07:57:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.658+0000 7f74c3400640 1 -- 172.21.15.84:0/974056640 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4030820 con 0x562ef5ea72f0 2024-09-21T07:57:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.662+0000 7f74e0c2d740 1 -- 172.21.15.84:0/974056640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5ea72f0 msgr2=0x562ef627d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.662+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/974056640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5ea72f0 0x562ef627d630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f74c402aeb0 tx=0x7f74c403d070 comp rx=0 tx=0).stop 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.662+0000 7f74e0c2d740 1 -- 172.21.15.84:0/974056640 shutdown_connections 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.662+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/974056640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5eaf4d0 0x562ef627db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.662+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/974056640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5ea72f0 0x562ef627d630 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.662+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/974056640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5e8ed80 0x562ef6271a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.662+0000 7f74e0c2d740 1 -- 172.21.15.84:0/974056640 >> 172.21.15.84:0/974056640 conn(0x562ef5ec4300 msgr2=0x562ef6271360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.663+0000 7f74e0c2d740 1 -- 172.21.15.84:0/974056640 shutdown_connections 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.663+0000 7f74e0c2d740 1 -- 172.21.15.84:0/974056640 wait complete. 2024-09-21T07:57:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.664+0000 7f74e0c2d740 1 -- start start 2024-09-21T07:57:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.664+0000 7f74e0c2d740 1 Processor -- start 2024-09-21T07:57:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.665+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5e8ed80 0x562ef6288f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.665+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6286490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.665+0000 7f74e0c2d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef62869d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.665+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41c9830 con 0x562ef5e8ed80 2024-09-21T07:57:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.665+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41c9160 con 0x562ef5eaf4d0 2024-09-21T07:57:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.665+0000 7f74e0c2d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41c6380 con 0x562ef5ea72f0 2024-09-21T07:57:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.665+0000 7f74e0c2d740 10 client.0 _ll_register_callbacks cb 0x7f74cc009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.666+0000 7f74d2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6286490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.666+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5e8ed80 0x562ef6288f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.666+0000 7f74d3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef62869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.666+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5e8ed80 0x562ef6288f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46616/0 (socket says 172.21.15.84:46616) 2024-09-21T07:57:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.666+0000 7f74d2a00640 1 -- 172.21.15.84:0/3800572660 learned_addr learned my addr 172.21.15.84:0/3800572660 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.666+0000 7f74d2000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6286490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:59958/0 (socket says 172.21.15.84:59958) 2024-09-21T07:57:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.667+0000 7f74d2000640 1 -- 172.21.15.84:0/3800572660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 msgr2=0x562ef62869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.667+0000 7f74d2000640 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef62869d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.667+0000 7f74d2000640 1 -- 172.21.15.84:0/3800572660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5e8ed80 msgr2=0x562ef6288f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.667+0000 7f74d2000640 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5e8ed80 0x562ef6288f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.667+0000 7f74d2000640 1 -- 172.21.15.84:0/3800572660 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef62870e0 con 0x562ef5ea72f0 2024-09-21T07:57:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.668+0000 7f74d2000640 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6286490 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f74c402a900 tx=0x7f74c4009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cca7cdb706ed652 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.668+0000 7f74c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.669+0000 7f74c0c00640 1 -- 172.21.15.84:0/3800572660 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c405d060 con 0x562ef5ea72f0 2024-09-21T07:57:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.669+0000 7f74c0c00640 1 -- 172.21.15.84:0/3800572660 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f74c402f610 con 0x562ef5ea72f0 2024-09-21T07:57:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.670+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74c4036050 con 0x562ef5ea72f0 2024-09-21T07:57:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.670+0000 7f74c0c00640 1 -- 172.21.15.84:0/3800572660 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74c4054070 con 0x562ef5ea72f0 2024-09-21T07:57:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.670+0000 7f74e0c2d740 10 client.27262 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.670+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562ef62fcb20 con 0x562ef5ea72f0 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74c0c00640 1 -- 172.21.15.84:0/3800572660 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74c4036050 con 0x562ef5ea72f0 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74c0c00640 1 -- 172.21.15.84:0/3800572660 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f74c4030b20 con 0x562ef5ea72f0 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74e0c2d740 10 client.27262 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74e0c2d740 10 client.27262 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74e0c2d740 20 client.27262 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5ed01b0 0x562ef62ff190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74e0c2d740 4 client.27262 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:57:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.671+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ef61e80b0 con 0x562ef5ed01b0 2024-09-21T07:57:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.672+0000 7f74d2a00640 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5ed01b0 0x562ef62ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.672+0000 7f74c0c00640 10 client.27262 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.673+0000 7f74d2a00640 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5ed01b0 0x562ef62ff190 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6495f56f4ff26e81 server_cookie=ad13b24e1bf23345 in_seq=0 out_seq=0 2024-09-21T07:57:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.687+0000 7f74c0c00640 1 -- 172.21.15.84:0/3800572660 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ef61e80b0 con 0x562ef5ed01b0 2024-09-21T07:57:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.687+0000 7f74c0c00640 10 client.27262 handle_command_reply: tid=0 2024-09-21T07:57:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 client.27262 shutdown 2024-09-21T07:57:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 msgr2=0x562ef6286490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6286490 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f74c402a900 tx=0x7f74c4009800 comp rx=0 tx=0).stop 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 shutdown_connections 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562ef5eaf4d0 0x562ef62869d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562ef5ed01b0 0x562ef62ff190 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562ef5ea72f0 0x562ef6286490 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 --2- 172.21.15.84:0/3800572660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ef5e8ed80 0x562ef6288f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 >> 172.21.15.84:0/3800572660 conn(0x562ef5ec4300 msgr2=0x562ef628b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74c0c00640 0 client.27262 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.688+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 shutdown_connections 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.689+0000 7f74e0c2d740 1 -- 172.21.15.84:0/3800572660 wait complete. 2024-09-21T07:57:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.689+0000 7f74e0c2d740 20 client.27262 trim_cache size 0 max 16384 2024-09-21T07:57:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:57:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:57:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:57:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f74b80b6610 msgr2=0x7f74b80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f74b80b6610 0x7f74b80b8b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f74c402ade0 tx=0x7f74c4005fd0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d411cba0 msgr2=0x7f74d4117ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d411cba0 0x7f74d4117ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009fd0 tx=0x7f74bc00b8e0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 shutdown_connections 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f74b80b6610 0x7f74b80b8b20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74d411cba0 0x7f74d4117ed0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d4111ca0 0x7f74d4112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 --2- 172.21.15.84:0/110115684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d410a900 0x7f74d41126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 >> 172.21.15.84:0/110115684 conn(0x7f74d4070c00 msgr2=0x7f74d411ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 shutdown_connections 2024-09-21T07:57:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:24.690+0000 7f74d3e00640 1 -- 172.21.15.84:0/110115684 wait complete. 2024-09-21T07:57:25.798 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:25 smithi084 ceph-mon[30411]: pgmap v585: 129 pgs: 129 active+clean; 43 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 28 KiB/s rd, 204 MiB/s wr, 2.20k op/s 2024-09-21T07:57:25.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:25 smithi162 ceph-mon[34833]: pgmap v585: 129 pgs: 129 active+clean; 43 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 28 KiB/s rd, 204 MiB/s wr, 2.20k op/s 2024-09-21T07:57:25.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:25 smithi191 ceph-mon[34667]: pgmap v585: 129 pgs: 129 active+clean; 43 GiB data, 89 GiB used, 984 GiB / 1.0 TiB avail; 28 KiB/s rd, 204 MiB/s wr, 2.20k op/s 2024-09-21T07:57:27.495 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '26aae511', quiesce took 25.0 seconds. Will release after: -5.75 2024-09-21T07:57:27.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:57:27.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:27 smithi162 ceph-mon[34833]: pgmap v586: 129 pgs: 129 active+clean; 43 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 29 KiB/s rd, 197 MiB/s wr, 2.22k op/s 2024-09-21T07:57:27.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:27 smithi084 ceph-mon[30411]: pgmap v586: 129 pgs: 129 active+clean; 43 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 29 KiB/s rd, 197 MiB/s wr, 2.22k op/s 2024-09-21T07:57:27.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:27 smithi191 ceph-mon[34667]: pgmap v586: 129 pgs: 129 active+clean; 43 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 29 KiB/s rd, 197 MiB/s wr, 2.22k op/s 2024-09-21T07:57:28.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:57:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:28.731 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.851+0000 7f7301c00640 1 -- 172.21.15.84:0/2888233058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc109c40 msgr2=0x7f72fc110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.851+0000 7f7301c00640 1 --2- 172.21.15.84:0/2888233058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc109c40 0x7f72fc110470 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009900 tx=0x7f72f402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.851+0000 7f7301c00640 1 -- 172.21.15.84:0/2888233058 shutdown_connections 2024-09-21T07:57:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.851+0000 7f7301c00640 1 --2- 172.21.15.84:0/2888233058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc109c40 0x7f72fc110470 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.851+0000 7f7301c00640 1 --2- 172.21.15.84:0/2888233058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72fc1092f0 0x7f72fc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.851+0000 7f7301c00640 1 --2- 172.21.15.84:0/2888233058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 0x7f72fc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.851+0000 7f7301c00640 1 -- 172.21.15.84:0/2888233058 >> 172.21.15.84:0/2888233058 conn(0x7f72fc0ff440 msgr2=0x7f72fc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.852+0000 7f7301c00640 1 -- 172.21.15.84:0/2888233058 shutdown_connections 2024-09-21T07:57:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.852+0000 7f7301c00640 1 -- 172.21.15.84:0/2888233058 wait complete. 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 Processor -- start 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 -- start start 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 0x7f72fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc1092f0 0x7f72fc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72fc109c40 0x7f72fc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc113950 con 0x7f72fc1092f0 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc1137d0 con 0x7f72fc109c40 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.853+0000 7f7301c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc113ad0 con 0x7f72fc1039b0 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc1092f0 0x7f72fc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 0x7f72fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 0x7f72fc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57158/0 (socket says 172.21.15.84:57158) 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 -- 172.21.15.84:0/1975587606 learned_addr learned my addr 172.21.15.84:0/1975587606 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f7301200640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72fc109c40 0x7f72fc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 -- 172.21.15.84:0/1975587606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72fc109c40 msgr2=0x7f72fc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72fc109c40 0x7f72fc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 -- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc1092f0 msgr2=0x7f72fc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc1092f0 0x7f72fc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 -- 172.21.15.84:0/1975587606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc1a85e0 con 0x7f72fc1039b0 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.854+0000 7f72fbe00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 0x7f72fc075710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00eb90 tx=0x7f72ec00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.855+0000 7f72f8c00640 1 -- 172.21.15.84:0/1975587606 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec004d20 con 0x7f72fc1039b0 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.855+0000 7f72f8c00640 1 -- 172.21.15.84:0/1975587606 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72ec00ee90 con 0x7f72fc1039b0 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.855+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc1a88d0 con 0x7f72fc1039b0 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.855+0000 7f72f8c00640 1 -- 172.21.15.84:0/1975587606 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec010670 con 0x7f72fc1039b0 2024-09-21T07:57:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.855+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72fc1a8dc0 con 0x7f72fc1039b0 2024-09-21T07:57:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.856+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72fc103dc0 con 0x7f72fc1039b0 2024-09-21T07:57:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.859+0000 7f72f8c00640 1 -- 172.21.15.84:0/1975587606 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f72ec010830 con 0x7f72fc1039b0 2024-09-21T07:57:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.860+0000 7f72f8c00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72e00b6680 0x7f72e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.860+0000 7f72f8c00640 1 -- 172.21.15.84:0/1975587606 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f72ec0e8330 con 0x7f72fc1039b0 2024-09-21T07:57:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.860+0000 7f72fb400640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72e00b6680 0x7f72e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:28.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.861+0000 7f72fb400640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72e00b6680 0x7f72e00b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f72fc102cf0 tx=0x7f72e8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:28.862+0000 7f72f8c00640 1 -- 172.21.15.84:0/1975587606 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72ec056710 con 0x7f72fc1039b0 2024-09-21T07:57:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.106+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72fc076a10 con 0x7f72fc1039b0 2024-09-21T07:57:29.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.107+0000 7f72f8c00640 1 -- 172.21.15.84:0/1975587606 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f72fc076a10 con 0x7f72fc1039b0 2024-09-21T07:57:29.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:57:29.110 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:57:29.110 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72e00b6680 msgr2=0x7f72e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72e00b6680 0x7f72e00b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f72fc102cf0 tx=0x7f72e8005f90 comp rx=0 tx=0).stop 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 msgr2=0x7f72fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 0x7f72fc075710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00eb90 tx=0x7f72ec00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 shutdown_connections 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72e00b6680 0x7f72e00b8b90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72fc109c40 0x7f72fc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72fc1092f0 0x7f72fc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 --2- 172.21.15.84:0/1975587606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72fc1039b0 0x7f72fc075710 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 >> 172.21.15.84:0/1975587606 conn(0x7f72fc0ff440 msgr2=0x7f72fc106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:29.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 shutdown_connections 2024-09-21T07:57:29.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.110+0000 7f7301c00640 1 -- 172.21.15.84:0/1975587606 wait complete. 2024-09-21T07:57:29.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 -- 172.21.15.84:0/960124734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410b500 msgr2=0x7f3b3410b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 --2- 172.21.15.84:0/960124734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410b500 0x7f3b3410b910 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009900 tx=0x7f3b2002a410 comp rx=0 tx=0).stop 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 -- 172.21.15.84:0/960124734 shutdown_connections 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 --2- 172.21.15.84:0/960124734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3410be50 0x7f3b34112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 --2- 172.21.15.84:0/960124734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410b500 0x7f3b3410b910 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 --2- 172.21.15.84:0/960124734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 0x7f3b34105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 -- 172.21.15.84:0/960124734 >> 172.21.15.84:0/960124734 conn(0x7f3b34101670 msgr2=0x7f3b34103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 -- 172.21.15.84:0/960124734 shutdown_connections 2024-09-21T07:57:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.374+0000 7f3b33200640 1 -- 172.21.15.84:0/960124734 wait complete. 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.375+0000 7f3b33200640 1 Processor -- start 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b33200640 1 -- start start 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b33200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 0x7f3b3419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b33200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3410b500 0x7f3b3419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b33200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410be50 0x7f3b341a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b33200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3b34115b60 con 0x7f3b3410be50 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b33200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b341159e0 con 0x7f3b3410b500 2024-09-21T07:57:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b33200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b34115ce0 con 0x7f3b34105bc0 2024-09-21T07:57:29.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b31e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 0x7f3b3419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b31e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 0x7f3b3419c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57178/0 (socket says 172.21.15.84:57178) 2024-09-21T07:57:29.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b32800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410be50 0x7f3b341a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b31e00640 1 -- 172.21.15.84:0/865470410 learned_addr learned my addr 172.21.15.84:0/865470410 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.376+0000 7f3b31400640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3410b500 0x7f3b3419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b31e00640 1 -- 172.21.15.84:0/865470410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3410b500 msgr2=0x7f3b3419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b31e00640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3410b500 0x7f3b3419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b31e00640 1 -- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410be50 msgr2=0x7f3b341a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b31e00640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410be50 0x7f3b341a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b31e00640 1 -- 172.21.15.84:0/865470410 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b341a2480 con 0x7f3b34105bc0 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b31e00640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 0x7f3b3419c510 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400e9f0 tx=0x7f3b2400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b2aa00640 1 -- 172.21.15.84:0/865470410 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400cd80 con 0x7f3b34105bc0 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b2aa00640 1 -- 172.21.15.84:0/865470410 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b240054d0 con 0x7f3b34105bc0 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b341a2770 con 0x7f3b34105bc0 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.377+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b341a8ed0 con 0x7f3b34105bc0 2024-09-21T07:57:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.378+0000 7f3b2aa00640 1 -- 172.21.15.84:0/865470410 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24010690 con 0x7f3b34105bc0 2024-09-21T07:57:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 Processor -- start 2024-09-21T07:57:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 -- start start 2024-09-21T07:57:29.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f96390 0x55bdd235e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bdd22d4fb0 con 0x55bdd1f96390 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bdd22c43e0 con 0x55bdd1fb7070 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55bdd22c81f0 con 0x55bdd1f8e1b0 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b2aa00640 1 -- 172.21.15.84:0/865470410 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3b24004e90 con 0x7f3b34105bc0 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.381+0000 7f3b31400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f96390 0x55bdd235e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f96390 0x55bdd235e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44712/0 (socket says 172.21.15.84:44712) 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31400640 1 -- 172.21.15.84:0/1300262597 learned_addr learned my addr 172.21.15.84:0/1300262597 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b32800640 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31e00640 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31400640 1 -- 172.21.15.84:0/1300262597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 msgr2=0x55bdd235e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31400640 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31400640 1 -- 172.21.15.84:0/1300262597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 msgr2=0x55bdd235df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31400640 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31400640 1 -- 172.21.15.84:0/1300262597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd228ecd0 con 0x55bdd1f96390 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b32800640 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.382+0000 7f3b31e00640 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.383+0000 7f3b31400640 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f96390 0x55bdd235e9f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3b20005ab0 tx=0x7f3b20004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85eb87243c6b2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.383+0000 7f3b1f400640 1 -- 172.21.15.84:0/1300262597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20035040 con 0x55bdd1f96390 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.383+0000 7f3b1f400640 1 -- 172.21.15.84:0/1300262597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b200054f0 con 0x55bdd1f96390 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.383+0000 7f3b1f400640 1 -- 172.21.15.84:0/1300262597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b200035f0 con 0x55bdd1f96390 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b2aa00640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b180b6680 0x7f3b180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 -- 172.21.15.84:0/1300262597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f96390 msgr2=0x55bdd235e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f96390 0x55bdd235e9f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3b20005ab0 tx=0x7f3b20004040 comp rx=0 tx=0).stop 2024-09-21T07:57:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b2aa00640 1 -- 172.21.15.84:0/865470410 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f3b240e7f30 con 0x7f3b34105bc0 2024-09-21T07:57:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 -- 172.21.15.84:0/1300262597 shutdown_connections 2024-09-21T07:57:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f96390 0x55bdd235e9f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/1300262597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 -- 172.21.15.84:0/1300262597 >> 172.21.15.84:0/1300262597 conn(0x55bdd1fab460 msgr2=0x55bdd235be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b32800640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b180b6680 0x7f3b180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 -- 172.21.15.84:0/1300262597 shutdown_connections 2024-09-21T07:57:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.384+0000 7f3b3fea0740 1 -- 172.21.15.84:0/1300262597 wait complete. 2024-09-21T07:57:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.385+0000 7f3b32800640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b180b6680 0x7f3b180b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005fd0 tx=0x7f3b2c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.385+0000 7f3b3fea0740 1 -- start start 2024-09-21T07:57:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.385+0000 7f3b3fea0740 1 Processor -- start 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd2369a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1fb7070 0x55bdd2369f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1f759f0 0x55bdd23759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bdd2125700 con 0x55bdd1fb7070 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bdd225f580 con 0x55bdd1f759f0 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55bdd236c6f0 con 0x55bdd1f8e1b0 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b3fea0740 10 client.0 _ll_register_callbacks cb 0x55bdd226f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b31400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1fb7070 0x55bdd2369f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b31400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1fb7070 0x55bdd2369f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44726/0 (socket says 172.21.15.84:44726) 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b31400640 1 -- 172.21.15.84:0/2647153926 learned_addr learned my addr 172.21.15.84:0/2647153926 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b32800640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1f759f0 0x55bdd23759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.386+0000 7f3b31e00640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd2369a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b31400640 1 -- 172.21.15.84:0/2647153926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 msgr2=0x55bdd2369a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b31400640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd2369a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b31400640 1 -- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1f759f0 msgr2=0x55bdd23759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b31400640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1f759f0 0x55bdd23759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b31400640 1 -- 172.21.15.84:0/2647153926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd2022650 con 0x55bdd1fb7070 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b32800640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1f759f0 0x55bdd23759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b31400640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1fb7070 0x55bdd2369f90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3b2002a450 tx=0x7f3b20004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a13bdd503df93d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b13e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b13e00640 1 -- 172.21.15.84:0/2647153926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20052060 con 0x55bdd1fb7070 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bdd2261b90 con 0x55bdd1fb7070 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.387+0000 7f3b13e00640 1 -- 172.21.15.84:0/2647153926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f3b200035f0 con 0x55bdd1fb7070 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b13e00640 1 -- 172.21.15.84:0/2647153926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b20059050 con 0x55bdd1fb7070 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 10 client.16998 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bdd227c950 con 0x55bdd1fb7070 2024-09-21T07:57:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b13e00640 1 -- 172.21.15.84:0/2647153926 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bdd2261b90 con 0x55bdd1fb7070 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b13e00640 1 -- 172.21.15.84:0/2647153926 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3b200317d0 con 0x55bdd1fb7070 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 10 client.16998 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 10 client.16998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 20 client.16998 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd1f4ada0 0x55bdd237b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 4 client.16998 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.388+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdd22d6f00 con 0x55bdd1f4ada0 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.389+0000 7f3b31e00640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd1f4ada0 0x55bdd237b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.389+0000 7f3b31e00640 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd1f4ada0 0x55bdd237b780 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4303cf2e5250f53 server_cookie=ece66119de4c24a7 in_seq=0 out_seq=0 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.389+0000 7f3b13e00640 10 client.16998 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.390+0000 7f3b13e00640 1 -- 172.21.15.84:0/2647153926 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bdd22d6f00 con 0x55bdd1f4ada0 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.390+0000 7f3b13e00640 10 client.16998 handle_command_reply: tid=0 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.390+0000 7f3b3fea0740 1 client.16998 shutdown 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.390+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1fb7070 msgr2=0x55bdd2369f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.390+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1fb7070 0x55bdd2369f90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3b2002a450 tx=0x7f3b20004980 comp rx=0 tx=0).stop 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 shutdown_connections 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1f759f0 0x55bdd23759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1fb7070 0x55bdd2369f90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd1f4ada0 0x55bdd237b780 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/2647153926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd2369a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 >> 172.21.15.84:0/2647153926 conn(0x55bdd1fab460 msgr2=0x55bdd235a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b13e00640 0 client.16998 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 shutdown_connections 2024-09-21T07:57:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 1 -- 172.21.15.84:0/2647153926 wait complete. 2024-09-21T07:57:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.391+0000 7f3b3fea0740 20 client.16998 trim_cache size 0 max 16384 2024-09-21T07:57:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.405+0000 7f3b3fea0740 1 Processor -- start 2024-09-21T07:57:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.405+0000 7f3b3fea0740 1 -- start start 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f759f0 0x55bdd236b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3b341b2d50 con 0x55bdd1f8e1b0 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b341b4890 con 0x55bdd1fb7070 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b341b3420 con 0x55bdd1f759f0 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b31400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b32800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b32800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33516/0 (socket says 172.21.15.84:33516) 2024-09-21T07:57:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b32800640 1 -- 172.21.15.84:0/3958711312 learned_addr learned my addr 172.21.15.84:0/3958711312 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.406+0000 7f3b31e00640 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f759f0 0x55bdd236b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b32800640 1 -- 172.21.15.84:0/3958711312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f759f0 msgr2=0x55bdd236b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b32800640 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f759f0 0x55bdd236b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b32800640 1 -- 172.21.15.84:0/3958711312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f8e1b0 msgr2=0x55bdd235b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b32800640 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b32800640 1 -- 172.21.15.84:0/3958711312 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd2360260 con 0x55bdd1fb7070 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b31400640 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b31e00640 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f759f0 0x55bdd236b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b32800640 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235bb50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c004390 tx=0x7f3b2c01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a8b509c1685d008 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b1ea00640 1 -- 172.21.15.84:0/3958711312 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00f9e0 con 0x55bdd1fb7070 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b1ea00640 1 -- 172.21.15.84:0/3958711312 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b2c00fb80 con 0x55bdd1fb7070 2024-09-21T07:57:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.407+0000 7f3b1ea00640 1 -- 172.21.15.84:0/3958711312 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c01e690 con 0x55bdd1fb7070 2024-09-21T07:57:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.408+0000 7f3b3fea0740 1 -- 172.21.15.84:0/3958711312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 msgr2=0x55bdd235bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.408+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235bb50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c004390 tx=0x7f3b2c01a000 comp rx=0 tx=0).stop 2024-09-21T07:57:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.408+0000 7f3b3fea0740 1 -- 172.21.15.84:0/3958711312 shutdown_connections 2024-09-21T07:57:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.408+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd235bb50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.408+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f8e1b0 0x55bdd235b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.408+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/3958711312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f759f0 0x55bdd236b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.408+0000 7f3b3fea0740 1 -- 172.21.15.84:0/3958711312 >> 172.21.15.84:0/3958711312 conn(0x55bdd1fab460 msgr2=0x55bdd236ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.409+0000 7f3b3fea0740 1 -- 172.21.15.84:0/3958711312 shutdown_connections 2024-09-21T07:57:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.409+0000 7f3b3fea0740 1 -- 172.21.15.84:0/3958711312 wait complete. 2024-09-21T07:57:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.409+0000 7f3b3fea0740 1 -- start start 2024-09-21T07:57:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.409+0000 7f3b3fea0740 1 Processor -- start 2024-09-21T07:57:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f759f0 0x55bdd237ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd237d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b3fea0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd23e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3b341b41c0 con 0x55bdd1f759f0 2024-09-21T07:57:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b341b3af0 con 0x55bdd1fb7070 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b3fea0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b341b0d50 con 0x55bdd1f8e1b0 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b3fea0740 10 client.0 _ll_register_callbacks cb 0x7f3b20005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f759f0 0x55bdd237ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f759f0 0x55bdd237ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44746/0 (socket says 172.21.15.84:44746) 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 -- 172.21.15.84:0/28641112 learned_addr learned my addr 172.21.15.84:0/28641112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31400640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd237d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b32800640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd23e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 -- 172.21.15.84:0/28641112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 msgr2=0x55bdd237d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd237d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 -- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 msgr2=0x55bdd23e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd23e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31e00640 1 -- 172.21.15.84:0/28641112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd23e5440 con 0x55bdd1f759f0 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.410+0000 7f3b31400640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd237d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b31e00640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f759f0 0x55bdd237ceb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3b240ad690 tx=0x7f3b240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d050a3e37b4ba0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b13e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b13e00640 1 -- 172.21.15.84:0/28641112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24005180 con 0x55bdd1f759f0 2024-09-21T07:57:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b13e00640 1 -- 172.21.15.84:0/28641112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f3b240e5510 con 0x55bdd1f759f0 2024-09-21T07:57:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b2c00fb80 con 0x55bdd1f759f0 2024-09-21T07:57:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b13e00640 1 -- 172.21.15.84:0/28641112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b24097020 con 0x55bdd1f759f0 2024-09-21T07:57:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b3fea0740 10 client.17004 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.411+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bdd23e66f0 con 0x55bdd1f759f0 2024-09-21T07:57:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b13e00640 1 -- 172.21.15.84:0/28641112 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b2c00fb80 con 0x55bdd1f759f0 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b13e00640 1 -- 172.21.15.84:0/28641112 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3b240eb020 con 0x55bdd1f759f0 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b3fea0740 10 client.17004 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b3fea0740 10 client.17004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b3fea0740 20 client.17004 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd23e6e70 0x55bdd23e9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b3fea0740 4 client.17004 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bdd22d29b0 con 0x55bdd23e6e70 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.412+0000 7f3b31400640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd23e6e70 0x55bdd23e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b31400640 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd23e6e70 0x55bdd23e9290 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6736598ba589f6f0 server_cookie=afa8bde69ff69980 in_seq=0 out_seq=0 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b13e00640 10 client.17004 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b13e00640 1 -- 172.21.15.84:0/28641112 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bdd22d29b0 con 0x55bdd23e6e70 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b13e00640 10 client.17004 handle_command_reply: tid=0 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 client.17004 shutdown 2024-09-21T07:57:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f759f0 msgr2=0x55bdd237ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f759f0 0x55bdd237ceb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3b240ad690 tx=0x7f3b240048f0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 shutdown_connections 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bdd1fb7070 0x55bdd23e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bdd23e6e70 0x55bdd23e9290 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdd1f8e1b0 0x55bdd237d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 --2- 172.21.15.84:0/28641112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bdd1f759f0 0x55bdd237ceb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 >> 172.21.15.84:0/28641112 conn(0x55bdd1fab460 msgr2=0x55bdd236ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.413+0000 7f3b13e00640 0 client.17004 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 shutdown_connections 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b3fea0740 1 -- 172.21.15.84:0/28641112 wait complete. 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b3fea0740 20 client.17004 trim_cache size 0 max 16384 2024-09-21T07:57:29.418 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:57:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b180b6680 msgr2=0x7f3b180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b180b6680 0x7f3b180b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005fd0 tx=0x7f3b2c009500 comp rx=0 tx=0).stop 2024-09-21T07:57:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 msgr2=0x7f3b3419c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 0x7f3b3419c510 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400e9f0 tx=0x7f3b2400edf0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 shutdown_connections 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3b180b6680 0x7f3b180b8b90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3410be50 0x7f3b341a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3410b500 0x7f3b3419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 --2- 172.21.15.84:0/865470410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b34105bc0 0x7f3b3419c510 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.414+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 >> 172.21.15.84:0/865470410 conn(0x7f3b34101670 msgr2=0x7f3b34108b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.415+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 shutdown_connections 2024-09-21T07:57:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:29.415+0000 7f3b33200640 1 -- 172.21.15.84:0/865470410 wait complete. 2024-09-21T07:57:29.714 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:29 smithi084 ceph-mon[30411]: pgmap v587: 129 pgs: 129 active+clean; 43 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 28 KiB/s rd, 191 MiB/s wr, 2.21k op/s 2024-09-21T07:57:29.715 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:29 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1975587606' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:29.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:29 smithi162 ceph-mon[34833]: pgmap v587: 129 pgs: 129 active+clean; 43 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 28 KiB/s rd, 191 MiB/s wr, 2.21k op/s 2024-09-21T07:57:29.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:29 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1975587606' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:29.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:29 smithi191 ceph-mon[34667]: pgmap v587: 129 pgs: 129 active+clean; 43 GiB data, 90 GiB used, 983 GiB / 1.0 TiB avail; 28 KiB/s rd, 191 MiB/s wr, 2.21k op/s 2024-09-21T07:57:29.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:29 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1975587606' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:31.278 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 26aae511 --release --await' 2024-09-21T07:57:31.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 26aae511 --release --await 2024-09-21T07:57:31.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:31 smithi084 ceph-mon[30411]: pgmap v588: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 26 KiB/s rd, 175 MiB/s wr, 2.06k op/s 2024-09-21T07:57:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:31.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:31 smithi162 ceph-mon[34833]: pgmap v588: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 26 KiB/s rd, 175 MiB/s wr, 2.06k op/s 2024-09-21T07:57:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:31 smithi191 ceph-mon[34667]: pgmap v588: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 26 KiB/s rd, 175 MiB/s wr, 2.06k op/s 2024-09-21T07:57:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 -- 172.21.15.84:0/2059964459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c0760a0 msgr2=0x7fa12c10fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 --2- 172.21.15.84:0/2059964459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c0760a0 0x7fa12c10fc00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009900 tx=0x7fa11c02a410 comp rx=0 tx=0).stop 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 -- 172.21.15.84:0/2059964459 shutdown_connections 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 --2- 172.21.15.84:0/2059964459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c110140 0x7fa12c112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 --2- 172.21.15.84:0/2059964459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c0760a0 0x7fa12c10fc00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 --2- 172.21.15.84:0/2059964459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa12c075750 0x7fa12c075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 -- 172.21.15.84:0/2059964459 >> 172.21.15.84:0/2059964459 conn(0x7fa12c0ff5d0 msgr2=0x7fa12c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 -- 172.21.15.84:0/2059964459 shutdown_connections 2024-09-21T07:57:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.360+0000 7fa134800640 1 -- 172.21.15.84:0/2059964459 wait complete. 2024-09-21T07:57:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.361+0000 7fa134800640 1 Processor -- start 2024-09-21T07:57:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.361+0000 7fa134800640 1 -- start start 2024-09-21T07:57:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa134800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa12c075750 0x7fa12c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa134800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c0760a0 0x7fa12c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa134800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c110140 0x7fa12c1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa134800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c115cb0 con 0x7fa12c110140 2024-09-21T07:57:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa134800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c115b30 con 0x7fa12c0760a0 2024-09-21T07:57:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa134800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c115e30 con 0x7fa12c075750 2024-09-21T07:57:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c0760a0 0x7fa12c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa132800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c110140 0x7fa12c1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c0760a0 0x7fa12c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33544/0 (socket says 172.21.15.84:33544) 2024-09-21T07:57:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131400640 1 -- 172.21.15.84:0/899650668 learned_addr learned my addr 172.21.15.84:0/899650668 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131e00640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa12c075750 0x7fa12c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131400640 1 -- 172.21.15.84:0/899650668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa12c075750 msgr2=0x7fa12c19c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131400640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa12c075750 0x7fa12c19c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131400640 1 -- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c110140 msgr2=0x7fa12c1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.362+0000 7fa131400640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c110140 0x7fa12c1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.363+0000 7fa131400640 1 -- 172.21.15.84:0/899650668 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c1a26b0 con 0x7fa12c0760a0 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.363+0000 7fa131400640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c0760a0 0x7fa12c19cce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa11c02a930 tx=0x7fa11c031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.363+0000 7fa126a00640 1 -- 172.21.15.84:0/899650668 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c03f030 con 0x7fa12c0760a0 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.363+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c1a2940 con 0x7fa12c0760a0 2024-09-21T07:57:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.363+0000 7fa126a00640 1 -- 172.21.15.84:0/899650668 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa11c004490 con 0x7fa12c0760a0 2024-09-21T07:57:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.363+0000 7fa126a00640 1 -- 172.21.15.84:0/899650668 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c035070 con 0x7fa12c0760a0 2024-09-21T07:57:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.363+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c1a9100 con 0x7fa12c0760a0 2024-09-21T07:57:32.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.366+0000 7fa13b48c740 1 Processor -- start 2024-09-21T07:57:32.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa13b48c740 1 -- start start 2024-09-21T07:57:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3ae3840 0x558ba3eabc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa13b48c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558ba3e22290 con 0x558ba3ae3840 2024-09-21T07:57:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa13b48c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ba3e116c0 con 0x558ba3b04520 2024-09-21T07:57:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa13b48c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558ba3e154d0 con 0x558ba3adb660 2024-09-21T07:57:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa132800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa132800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33560/0 (socket says 172.21.15.84:33560) 2024-09-21T07:57:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa132800640 1 -- 172.21.15.84:0/1637496252 learned_addr learned my addr 172.21.15.84:0/1637496252 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa131e00640 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.367+0000 7fa126a00640 1 -- 172.21.15.84:0/899650668 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa11c042030 con 0x7fa12c0760a0 2024-09-21T07:57:32.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa132800640 1 -- 172.21.15.84:0/1637496252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 msgr2=0x558ba3eab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa132800640 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa132800640 1 -- 172.21.15.84:0/1637496252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3ae3840 msgr2=0x558ba3eabc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa132800640 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3ae3840 0x558ba3eabc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa132800640 1 -- 172.21.15.84:0/1637496252 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba3d9e460 con 0x558ba3b04520 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa132800640 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eab1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa128009f50 tx=0x7fa1280118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab135c985c36b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa11b000640 1 -- 172.21.15.84:0/1637496252 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128004d20 con 0x558ba3b04520 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa11b000640 1 -- 172.21.15.84:0/1637496252 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa128004050 con 0x558ba3b04520 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.368+0000 7fa11b000640 1 -- 172.21.15.84:0/1637496252 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128005280 con 0x558ba3b04520 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 -- 172.21.15.84:0/1637496252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 msgr2=0x558ba3eab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eab1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa128009f50 tx=0x7fa1280118d0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 -- 172.21.15.84:0/1637496252 shutdown_connections 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3ae3840 0x558ba3eabc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1637496252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eab1c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 -- 172.21.15.84:0/1637496252 >> 172.21.15.84:0/1637496252 conn(0x558ba3af8910 msgr2=0x558ba3ea90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 -- 172.21.15.84:0/1637496252 shutdown_connections 2024-09-21T07:57:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa126a00640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1140b6630 0x7fa1140b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.369+0000 7fa13b48c740 1 -- 172.21.15.84:0/1637496252 wait complete. 2024-09-21T07:57:32.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.370+0000 7fa131e00640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1140b6630 0x7fa1140b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.370+0000 7fa126a00640 1 -- 172.21.15.84:0/899650668 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fa11c107dd0 con 0x7fa12c0760a0 2024-09-21T07:57:32.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.370+0000 7fa13b48c740 1 -- start start 2024-09-21T07:57:32.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.370+0000 7fa13b48c740 1 Processor -- start 2024-09-21T07:57:32.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.370+0000 7fa131e00640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1140b6630 0x7fa1140b8b40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x558ba3ea9e40 tx=0x7fa120005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:32.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3adb660 0x558ba3eb6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ec2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa13b48c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558ba3c72bb0 con 0x558ba3b04520 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa13b48c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558ba3dac6c0 con 0x558ba3adb660 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa13b48c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558ba3eb99a0 con 0x558ba3ae3840 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa13b48c740 10 client.0 _ll_register_callbacks cb 0x558ba3dc7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa131400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa131400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57256/0 (socket says 172.21.15.84:57256) 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa131400640 1 -- 172.21.15.84:0/1710217480 learned_addr learned my addr 172.21.15.84:0/1710217480 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa131e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3adb660 0x558ba3eb6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.371+0000 7fa132800640 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ec2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa131400640 1 -- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3adb660 msgr2=0x558ba3eb6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa131400640 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3adb660 0x558ba3eb6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa131400640 1 -- 172.21.15.84:0/1710217480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 msgr2=0x558ba3ec2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa131400640 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ec2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa131400640 1 -- 172.21.15.84:0/1710217480 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba3b6fb00 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa131e00640 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3adb660 0x558ba3eb6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa131400640 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb7340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0cd5e0 tx=0x7fa11c0c9e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b0ab9168dd1ca75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa10f400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa10f400640 1 -- 172.21.15.84:0/1710217480 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c049070 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa128004050 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.372+0000 7fa10f400640 1 -- 172.21.15.84:0/1710217480 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fa11c0d6fc0 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa10f400640 1 -- 172.21.15.84:0/1710217480 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa11c0cd050 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 10 client.27298 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ba3be6960 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa10f400640 1 -- 172.21.15.84:0/1710217480 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa128004050 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa10f400640 1 -- 172.21.15.84:0/1710217480 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa11c0ceb60 con 0x558ba3ae3840 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 10 client.27298 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 10 client.27298 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:57:32.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 20 client.27298 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:32.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3ac2ea0 0x558ba3ec8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 4 client.27298 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:32.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.373+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ba3e241e0 con 0x558ba3ac2ea0 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.374+0000 7fa131e00640 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3ac2ea0 0x558ba3ec8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.375+0000 7fa131e00640 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3ac2ea0 0x558ba3ec8c30 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c07f804de38614d8 server_cookie=bcfea8a5f1ec8109 in_seq=0 out_seq=0 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.375+0000 7fa10f400640 10 client.27298 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa10f400640 1 -- 172.21.15.84:0/1710217480 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ba3e241e0 con 0x558ba3ac2ea0 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa10f400640 10 client.27298 handle_command_reply: tid=0 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 client.27298 shutdown 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 msgr2=0x558ba3eb7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb7340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0cd5e0 tx=0x7fa11c0c9e00 comp rx=0 tx=0).stop 2024-09-21T07:57:32.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 shutdown_connections 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ec2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3ac2ea0 0x558ba3ec8c30 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb7340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 --2- 172.21.15.84:0/1710217480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3adb660 0x558ba3eb6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 >> 172.21.15.84:0/1710217480 conn(0x558ba3af8910 msgr2=0x558ba3eae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa10f400640 0 client.27298 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 shutdown_connections 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 1 -- 172.21.15.84:0/1710217480 wait complete. 2024-09-21T07:57:32.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.376+0000 7fa13b48c740 20 client.27298 trim_cache size 0 max 16384 2024-09-21T07:57:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 Processor -- start 2024-09-21T07:57:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 -- start start 2024-09-21T07:57:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3adb660 0x558ba3ec2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eb0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b3080 con 0x558ba3adb660 2024-09-21T07:57:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b4bc0 con 0x558ba3b04520 2024-09-21T07:57:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.394+0000 7fa13b48c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b3750 con 0x558ba3ae3840 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3adb660 0x558ba3ec2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3adb660 0x558ba3ec2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44784/0 (socket says 172.21.15.84:44784) 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 -- 172.21.15.84:0/903023940 learned_addr learned my addr 172.21.15.84:0/903023940 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131400640 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa132800640 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eb0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 -- 172.21.15.84:0/903023940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 msgr2=0x558ba3eb87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 -- 172.21.15.84:0/903023940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 msgr2=0x558ba3eb0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eb0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa131e00640 1 -- 172.21.15.84:0/903023940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba3eb7e80 con 0x558ba3adb660 2024-09-21T07:57:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.395+0000 7fa132800640 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eb0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.396+0000 7fa131e00640 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3adb660 0x558ba3ec2b90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x558ba3ec93c0 tx=0x7fa12001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f7b48518faeac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.396+0000 7fa11a600640 1 -- 172.21.15.84:0/903023940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12001dd00 con 0x558ba3adb660 2024-09-21T07:57:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.396+0000 7fa11a600640 1 -- 172.21.15.84:0/903023940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa12000fc40 con 0x558ba3adb660 2024-09-21T07:57:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.396+0000 7fa11a600640 1 -- 172.21.15.84:0/903023940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12002bb10 con 0x558ba3adb660 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 -- 172.21.15.84:0/903023940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3adb660 msgr2=0x558ba3ec2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3adb660 0x558ba3ec2b90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x558ba3ec93c0 tx=0x7fa12001b000 comp rx=0 tx=0).stop 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 -- 172.21.15.84:0/903023940 shutdown_connections 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3b04520 0x558ba3eb0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3ae3840 0x558ba3eb87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 --2- 172.21.15.84:0/903023940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3adb660 0x558ba3ec2b90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 -- 172.21.15.84:0/903023940 >> 172.21.15.84:0/903023940 conn(0x558ba3af8910 msgr2=0x558ba3eb80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 -- 172.21.15.84:0/903023940 shutdown_connections 2024-09-21T07:57:32.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 -- 172.21.15.84:0/903023940 wait complete. 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 -- start start 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.397+0000 7fa13b48c740 1 Processor -- start 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eb43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3ae3840 0x558ba3ebebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa13b48c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ebf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa13b48c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b44f0 con 0x558ba3b04520 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa13b48c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b3e20 con 0x558ba3ae3840 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa13b48c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1b1080 con 0x558ba3adb660 2024-09-21T07:57:32.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa13b48c740 10 client.0 _ll_register_callbacks cb 0x7fa11c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa131e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eb43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa131e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eb43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57284/0 (socket says 172.21.15.84:57284) 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa131e00640 1 -- 172.21.15.84:0/3864286274 learned_addr learned my addr 172.21.15.84:0/3864286274 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa131400640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3ae3840 0x558ba3ebebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.398+0000 7fa132800640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ebf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa131e00640 1 -- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3ae3840 msgr2=0x558ba3ebebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa131e00640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3ae3840 0x558ba3ebebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa131e00640 1 -- 172.21.15.84:0/3864286274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 msgr2=0x558ba3ebf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa131e00640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ebf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa131e00640 1 -- 172.21.15.84:0/3864286274 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba3ebf670 con 0x558ba3adb660 2024-09-21T07:57:32.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa131400640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3ae3840 0x558ba3ebebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:32.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa131e00640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eb43b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa12000feb0 tx=0x7fa12000fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6cb8e9480cffd1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:32.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa10f400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:32.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa10f400640 1 -- 172.21.15.84:0/3864286274 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12000f790 con 0x558ba3adb660 2024-09-21T07:57:32.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa12000fc40 con 0x558ba3adb660 2024-09-21T07:57:32.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.399+0000 7fa10f400640 1 -- 172.21.15.84:0/3864286274 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fa12000f930 con 0x558ba3adb660 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa10f400640 1 -- 172.21.15.84:0/3864286274 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa120005040 con 0x558ba3adb660 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 10 client.27304 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ba3eb3bb0 con 0x558ba3adb660 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa10f400640 1 -- 172.21.15.84:0/3864286274 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa12000fc40 con 0x558ba3adb660 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa10f400640 1 -- 172.21.15.84:0/3864286274 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa12002f020 con 0x558ba3adb660 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 10 client.27304 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 10 client.27304 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 20 client.27304 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:32.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3a98250 0x558ba3f36a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:32.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 4 client.27304 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "26aae511", "release": true, "await": true}] 2024-09-21T07:57:32.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.401+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "26aae511", "release": true, "await": true}) -- 0x558ba3e1fc90 con 0x558ba3a98250 2024-09-21T07:57:32.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.402+0000 7fa131400640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3a98250 0x558ba3f36a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:32.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.402+0000 7fa131400640 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3a98250 0x558ba3f36a90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a5b199f7c72c5c3 server_cookie=6d8361e2e3132d32 in_seq=0 out_seq=0 2024-09-21T07:57:32.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.402+0000 7fa10f400640 10 client.27304 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:32.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.408+0000 7fa10f400640 1 -- 172.21.15.84:0/3864286274 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558ba3e1fc90 con 0x558ba3a98250 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.408+0000 7fa10f400640 10 client.27304 handle_command_reply: tid=0 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.408+0000 7fa13b48c740 1 client.27304 shutdown 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.408+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 msgr2=0x558ba3eb43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.408+0000 7fa13b48c740 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eb43b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa12000feb0 tx=0x7fa12000fee0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 shutdown_connections 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ba3b04520 0x558ba3ebf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558ba3ae3840 0x558ba3ebebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558ba3a98250 0x558ba3f36a90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 --2- 172.21.15.84:0/3864286274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558ba3adb660 0x558ba3eb43b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 >> 172.21.15.84:0/3864286274 conn(0x558ba3af8910 msgr2=0x558ba3eac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:32.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa10f400640 0 client.27304 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:32.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 shutdown_connections 2024-09-21T07:57:32.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 1 -- 172.21.15.84:0/3864286274 wait complete. 2024-09-21T07:57:32.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.409+0000 7fa13b48c740 20 client.27304 trim_cache size 0 max 16384 2024-09-21T07:57:32.412 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:57:32.412 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:57:32.412 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:57:32.412 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 24, 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "26aae511": { 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 24, 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 139.2, 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:57:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:32.414 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1140b6630 msgr2=0x7fa1140b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1140b6630 0x7fa1140b8b40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x558ba3ea9e40 tx=0x7fa120005f90 comp rx=0 tx=0).stop 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c0760a0 msgr2=0x7fa12c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c0760a0 0x7fa12c19cce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa11c02a930 tx=0x7fa11c031a20 comp rx=0 tx=0).stop 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 shutdown_connections 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1140b6630 0x7fa1140b8b40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa12c110140 0x7fa12c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c0760a0 0x7fa12c19cce0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 --2- 172.21.15.84:0/899650668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa12c075750 0x7fa12c19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 >> 172.21.15.84:0/899650668 conn(0x7fa12c0ff5d0 msgr2=0x7fa12c109ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.414+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 shutdown_connections 2024-09-21T07:57:32.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:32.415+0000 7fa134800640 1 -- 172.21.15.84:0/899650668 wait complete. 2024-09-21T07:57:32.610 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:57:32.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:57:33.234 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '26aae511', total seconds elapsed: 30.7 2024-09-21T07:57:33.235 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T07:57:33.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:57:33.406 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:33.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:33 smithi084 ceph-mon[30411]: pgmap v589: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 25 KiB/s rd, 137 MiB/s wr, 1.67k op/s 2024-09-21T07:57:33.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:33 smithi162 ceph-mon[34833]: pgmap v589: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 25 KiB/s rd, 137 MiB/s wr, 1.67k op/s 2024-09-21T07:57:33.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:33 smithi191 ceph-mon[34667]: pgmap v589: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 25 KiB/s rd, 137 MiB/s wr, 1.67k op/s 2024-09-21T07:57:35.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:35 smithi162 ceph-mon[34833]: pgmap v590: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 13 KiB/s rd, 98 MiB/s wr, 1.21k op/s 2024-09-21T07:57:35.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:35 smithi084 ceph-mon[30411]: pgmap v590: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 13 KiB/s rd, 98 MiB/s wr, 1.21k op/s 2024-09-21T07:57:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:35 smithi191 ceph-mon[34667]: pgmap v590: 129 pgs: 129 active+clean; 43 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 13 KiB/s rd, 98 MiB/s wr, 1.21k op/s 2024-09-21T07:57:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 -- 172.21.15.84:0/4229962391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc350105db0 msgr2=0x7fc3501061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 --2- 172.21.15.84:0/4229962391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc350105db0 0x7fc3501061c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc340009860 tx=0x7fc34002a340 comp rx=0 tx=0).stop 2024-09-21T07:57:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 -- 172.21.15.84:0/4229962391 shutdown_connections 2024-09-21T07:57:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 --2- 172.21.15.84:0/4229962391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc35010c040 0x7fc350112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 --2- 172.21.15.84:0/4229962391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc35010b6f0 0x7fc35010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 --2- 172.21.15.84:0/4229962391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc350105db0 0x7fc3501061c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 -- 172.21.15.84:0/4229962391 >> 172.21.15.84:0/4229962391 conn(0x7fc3501017c0 msgr2=0x7fc350103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.523+0000 7fc355c00640 1 -- 172.21.15.84:0/4229962391 shutdown_connections 2024-09-21T07:57:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.524+0000 7fc355c00640 1 -- 172.21.15.84:0/4229962391 wait complete. 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.525+0000 7fc355c00640 1 Processor -- start 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.525+0000 7fc355c00640 1 -- start start 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.525+0000 7fc355c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc350105db0 0x7fc35019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.525+0000 7fc355c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35010b6f0 0x7fc35019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.525+0000 7fc355c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc35010c040 0x7fc3501a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.525+0000 7fc355c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc350115d00 con 0x7fc350105db0 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.525+0000 7fc355c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc350115b80 con 0x7fc35010b6f0 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc355c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc350115e80 con 0x7fc35010c040 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35010b6f0 0x7fc35019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35010b6f0 0x7fc35019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33586/0 (socket says 172.21.15.84:33586) 2024-09-21T07:57:36.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 -- 172.21.15.84:0/1903031664 learned_addr learned my addr 172.21.15.84:0/1903031664 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:36.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34ea00640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc350105db0 0x7fc35019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 -- 172.21.15.84:0/1903031664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc35010c040 msgr2=0x7fc3501a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc35010c040 0x7fc3501a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 -- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc350105db0 msgr2=0x7fc35019c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc350105db0 0x7fc35019c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.526+0000 7fc34e000640 1 -- 172.21.15.84:0/1903031664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3501a26c0 con 0x7fc35010b6f0 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.527+0000 7fc34e000640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35010b6f0 0x7fc35019ccf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00e9c0 tx=0x7fc33c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.527+0000 7fc347400640 1 -- 172.21.15.84:0/1903031664 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00ccc0 con 0x7fc35010b6f0 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.527+0000 7fc347400640 1 -- 172.21.15.84:0/1903031664 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc33c0108e0 con 0x7fc35010b6f0 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.527+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3501a29b0 con 0x7fc35010b6f0 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.527+0000 7fc347400640 1 -- 172.21.15.84:0/1903031664 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0187e0 con 0x7fc35010b6f0 2024-09-21T07:57:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.527+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3501a9110 con 0x7fc35010b6f0 2024-09-21T07:57:36.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.532+0000 7fc347400640 1 -- 172.21.15.84:0/1903031664 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc33c010430 con 0x7fc35010b6f0 2024-09-21T07:57:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.533+0000 7fc35c7c8740 1 Processor -- start 2024-09-21T07:57:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.534+0000 7fc347400640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3340b6700 0x7fc3340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.534+0000 7fc347400640 1 -- 172.21.15.84:0/1903031664 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fc33c0e7d60 con 0x7fc35010b6f0 2024-09-21T07:57:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.534+0000 7fc35c7c8740 1 -- start start 2024-09-21T07:57:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc34f400640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3340b6700 0x7fc3340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x5635036fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56350332b490 0x5635036fc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036fc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563503671e90 con 0x563503354350 2024-09-21T07:57:36.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5635036612c0 con 0x563503333670 2024-09-21T07:57:36.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5635036650d0 con 0x56350332b490 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.535+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x5635036fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56350332b490 0x5635036fc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x5635036fbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44820/0 (socket says 172.21.15.84:44820) 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34ea00640 1 -- 172.21.15.84:0/2495056019 learned_addr learned my addr 172.21.15.84:0/2495056019 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34e000640 1 -- 172.21.15.84:0/2495056019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 msgr2=0x5635036fc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34e000640 1 --2- 172.21.15.84:0/2495056019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34e000640 1 -- 172.21.15.84:0/2495056019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 msgr2=0x5635036fbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34e000640 1 --2- 172.21.15.84:0/2495056019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x5635036fbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34e000640 1 -- 172.21.15.84:0/2495056019 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635033bf930 con 0x56350332b490 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34f400640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3340b6700 0x7fc3340b8c10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc3480092f0 tx=0x7fc348009220 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.536+0000 7fc34e000640 1 --2- 172.21.15.84:0/2495056019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56350332b490 0x5635036fc250 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0e50c0 tx=0x7fc33c010720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9124d5ecce207def server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:36.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.537+0000 7fc33be00640 1 -- 172.21.15.84:0/2495056019 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0b22a0 con 0x56350332b490 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.537+0000 7fc33be00640 1 -- 172.21.15.84:0/2495056019 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc33c0b71e0 con 0x56350332b490 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.537+0000 7fc33be00640 1 -- 172.21.15.84:0/2495056019 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0a9370 con 0x56350332b490 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 -- 172.21.15.84:0/2495056019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56350332b490 msgr2=0x5635036fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/2495056019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56350332b490 0x5635036fc250 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0e50c0 tx=0x7fc33c010720 comp rx=0 tx=0).stop 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 -- 172.21.15.84:0/2495056019 shutdown_connections 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/2495056019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036fc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/2495056019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56350332b490 0x5635036fc250 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/2495056019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x5635036fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 -- 172.21.15.84:0/2495056019 >> 172.21.15.84:0/2495056019 conn(0x563503348740 msgr2=0x5635036f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 -- 172.21.15.84:0/2495056019 shutdown_connections 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.539+0000 7fc35c7c8740 1 -- 172.21.15.84:0/2495056019 wait complete. 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.540+0000 7fc35c7c8740 1 -- start start 2024-09-21T07:57:36.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.540+0000 7fc35c7c8740 1 Processor -- start 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56350332b490 0x5635037100b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x5635037105f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x56350371c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5635034c2890 con 0x563503354350 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5635035fc160 con 0x56350332b490 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563503712c50 con 0x563503333670 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc35c7c8740 10 client.0 _ll_register_callbacks cb 0x563503618a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.541+0000 7fc34f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x56350371c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.542+0000 7fc34f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x56350371c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44830/0 (socket says 172.21.15.84:44830) 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.542+0000 7fc34f400640 1 -- 172.21.15.84:0/1759848689 learned_addr learned my addr 172.21.15.84:0/1759848689 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:36.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.542+0000 7fc34f400640 1 -- 172.21.15.84:0/1759848689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 msgr2=0x5635037105f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.542+0000 7fc34f400640 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x5635037105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.542+0000 7fc34f400640 1 -- 172.21.15.84:0/1759848689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56350332b490 msgr2=0x5635037100b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:57:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.542+0000 7fc34f400640 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56350332b490 0x5635037100b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.542+0000 7fc34f400640 1 -- 172.21.15.84:0/1759848689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350371c570 con 0x563503354350 2024-09-21T07:57:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.543+0000 7fc34f400640 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x56350371c000 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc3480118d0 tx=0x7fc348011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d63207ad85fa4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.543+0000 7fc338c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:36.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.544+0000 7fc338c00640 1 -- 172.21.15.84:0/1759848689 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348022020 con 0x563503354350 2024-09-21T07:57:36.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.544+0000 7fc338c00640 1 -- 172.21.15.84:0/1759848689 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fc348010ad0 con 0x563503354350 2024-09-21T07:57:36.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.547+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc33c0b71e0 con 0x563503354350 2024-09-21T07:57:36.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.547+0000 7fc338c00640 1 -- 172.21.15.84:0/1759848689 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc348010cd0 con 0x563503354350 2024-09-21T07:57:36.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.547+0000 7fc35c7c8740 10 client.17031 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:36.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.548+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56350371eea0 con 0x563503354350 2024-09-21T07:57:36.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.548+0000 7fc338c00640 1 -- 172.21.15.84:0/1759848689 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc33c0b71e0 con 0x563503354350 2024-09-21T07:57:36.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.548+0000 7fc338c00640 1 -- 172.21.15.84:0/1759848689 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc34800f040 con 0x563503354350 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.549+0000 7fc35c7c8740 10 client.17031 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.549+0000 7fc35c7c8740 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.549+0000 7fc35c7c8740 20 client.17031 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.549+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503312cd0 0x5635037224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.549+0000 7fc35c7c8740 4 client.17031 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.549+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563503673de0 con 0x563503312cd0 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.549+0000 7fc34ea00640 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503312cd0 0x5635037224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.550+0000 7fc34ea00640 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503312cd0 0x5635037224b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=758f7b80e7ae771f server_cookie=77f25caab17c0db6 in_seq=0 out_seq=0 2024-09-21T07:57:36.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.550+0000 7fc338c00640 10 client.17031 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:36.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.551+0000 7fc338c00640 1 -- 172.21.15.84:0/1759848689 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563503673de0 con 0x563503312cd0 2024-09-21T07:57:36.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.551+0000 7fc338c00640 10 client.17031 handle_command_reply: tid=0 2024-09-21T07:57:36.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.551+0000 7fc35c7c8740 1 client.17031 shutdown 2024-09-21T07:57:36.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.552+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 msgr2=0x56350371c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.552+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x56350371c000 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc3480118d0 tx=0x7fc348011cd0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.552+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 shutdown_connections 2024-09-21T07:57:36.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.552+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563503354350 0x56350371c000 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.552+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503312cd0 0x5635037224b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.552+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x5635037105f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.555+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1759848689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56350332b490 0x5635037100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.555+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 >> 172.21.15.84:0/1759848689 conn(0x563503348740 msgr2=0x5635036fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:36.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.552+0000 7fc338c00640 0 client.17031 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:36.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.556+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 shutdown_connections 2024-09-21T07:57:36.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.557+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1759848689 wait complete. 2024-09-21T07:57:36.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.557+0000 7fc35c7c8740 20 client.17031 trim_cache size 0 max 16384 2024-09-21T07:57:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.587+0000 7fc35c7c8740 1 Processor -- start 2024-09-21T07:57:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.587+0000 7fc35c7c8740 1 -- start start 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56350332b490 0x5635036f9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036f9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503354350 0x56350370aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501aed50 con 0x56350332b490 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501b0890 con 0x563503333670 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501af420 con 0x563503354350 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc34e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc34f400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503354350 0x56350370aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc34f400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503354350 0x56350370aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57334/0 (socket says 172.21.15.84:57334) 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc34e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33602/0 (socket says 172.21.15.84:33602) 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.588+0000 7fc34f400640 1 -- 172.21.15.84:0/761698040 learned_addr learned my addr 172.21.15.84:0/761698040 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc34f400640 1 -- 172.21.15.84:0/761698040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 msgr2=0x5635036f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc34f400640 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc34f400640 1 -- 172.21.15.84:0/761698040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56350332b490 msgr2=0x5635036f9300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc34f400640 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56350332b490 0x5635036f9300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc34f400640 1 -- 172.21.15.84:0/761698040 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350370e3b0 con 0x563503354350 2024-09-21T07:57:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc34e000640 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc34f400640 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503354350 0x56350370aff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc348005c40 tx=0x7fc348000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa52c47036762ced server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.589+0000 7fc33b400640 1 -- 172.21.15.84:0/761698040 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348034070 con 0x563503354350 2024-09-21T07:57:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.590+0000 7fc33b400640 1 -- 172.21.15.84:0/761698040 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc348017030 con 0x563503354350 2024-09-21T07:57:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc35c7c8740 1 -- 172.21.15.84:0/761698040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503354350 msgr2=0x56350370aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc33b400640 1 -- 172.21.15.84:0/761698040 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348034070 con 0x563503354350 2024-09-21T07:57:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503354350 0x56350370aff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc348005c40 tx=0x7fc348000f40 comp rx=0 tx=0).stop 2024-09-21T07:57:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc35c7c8740 1 -- 172.21.15.84:0/761698040 shutdown_connections 2024-09-21T07:57:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503354350 0x56350370aff0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503333670 0x5635036f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/761698040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56350332b490 0x5635036f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.591+0000 7fc35c7c8740 1 -- 172.21.15.84:0/761698040 >> 172.21.15.84:0/761698040 conn(0x563503348740 msgr2=0x563503700e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:36.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.599+0000 7fc35c7c8740 1 -- 172.21.15.84:0/761698040 shutdown_connections 2024-09-21T07:57:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.599+0000 7fc35c7c8740 1 -- 172.21.15.84:0/761698040 wait complete. 2024-09-21T07:57:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.599+0000 7fc35c7c8740 1 -- start start 2024-09-21T07:57:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.601+0000 7fc35c7c8740 1 Processor -- start 2024-09-21T07:57:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.603+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x563503717f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.603+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503354350 0x5635037184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.603+0000 7fc35c7c8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635032e8080 0x563503712f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.603+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501b01c0 con 0x5635032e8080 2024-09-21T07:57:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.603+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501afaf0 con 0x563503354350 2024-09-21T07:57:36.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.603+0000 7fc35c7c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501acd70 con 0x563503333670 2024-09-21T07:57:36.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.603+0000 7fc35c7c8740 10 client.0 _ll_register_callbacks cb 0x7fc348009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:36.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.604+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x563503717f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.604+0000 7fc34ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x563503717f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57350/0 (socket says 172.21.15.84:57350) 2024-09-21T07:57:36.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.605+0000 7fc34e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503354350 0x5635037184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.607+0000 7fc34e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503354350 0x5635037184b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33610/0 (socket says 172.21.15.84:33610) 2024-09-21T07:57:36.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.607+0000 7fc34e000640 1 -- 172.21.15.84:0/1120031716 learned_addr learned my addr 172.21.15.84:0/1120031716 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:36.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.607+0000 7fc34f400640 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635032e8080 0x563503712f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.608+0000 7fc34ea00640 1 -- 172.21.15.84:0/1120031716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503354350 msgr2=0x5635037184b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.609+0000 7fc34ea00640 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503354350 0x5635037184b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.609+0000 7fc34ea00640 1 -- 172.21.15.84:0/1120031716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635032e8080 msgr2=0x563503712f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.609+0000 7fc34ea00640 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635032e8080 0x563503712f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.609+0000 7fc34ea00640 1 -- 172.21.15.84:0/1120031716 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563503718c80 con 0x563503333670 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.614+0000 7fc34f400640 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635032e8080 0x563503712f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.617+0000 7fc34ea00640 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x563503717f70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x5635036f92d0 tx=0x7fc34002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29246ed5093fb612 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.617+0000 7fc338c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.619+0000 7fc338c00640 1 -- 172.21.15.84:0/1120031716 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340049070 con 0x563503333670 2024-09-21T07:57:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.620+0000 7fc338c00640 1 -- 172.21.15.84:0/1120031716 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fc340004040 con 0x563503333670 2024-09-21T07:57:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.621+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc348017030 con 0x563503333670 2024-09-21T07:57:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.622+0000 7fc338c00640 1 -- 172.21.15.84:0/1120031716 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc340037040 con 0x563503333670 2024-09-21T07:57:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.622+0000 7fc35c7c8740 10 client.27316 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:36.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.623+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563503702630 con 0x563503333670 2024-09-21T07:57:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.624+0000 7fc338c00640 1 -- 172.21.15.84:0/1120031716 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc348017030 con 0x563503333670 2024-09-21T07:57:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.624+0000 7fc338c00640 1 -- 172.21.15.84:0/1120031716 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc34004c020 con 0x563503333670 2024-09-21T07:57:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.625+0000 7fc35c7c8740 10 client.27316 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.625+0000 7fc35c7c8740 10 client.27316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.625+0000 7fc35c7c8740 20 client.27316 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.626+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503702db0 0x5635037051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.626+0000 7fc35c7c8740 4 client.27316 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:57:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.626+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56350366f890 con 0x563503702db0 2024-09-21T07:57:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.626+0000 7fc34e000640 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503702db0 0x5635037051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.627+0000 7fc34e000640 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503702db0 0x5635037051d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f460c5792909ccc8 server_cookie=7c6fee91bf717417 in_seq=0 out_seq=0 2024-09-21T07:57:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.627+0000 7fc338c00640 10 client.27316 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.632+0000 7fc338c00640 1 -- 172.21.15.84:0/1120031716 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56350366f890 con 0x563503702db0 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.632+0000 7fc338c00640 10 client.27316 handle_command_reply: tid=0 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.632+0000 7fc35c7c8740 1 client.27316 shutdown 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.634+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 msgr2=0x563503717f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.634+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x563503717f70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x5635036f92d0 tx=0x7fc34002a340 comp rx=0 tx=0).stop 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.637+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 shutdown_connections 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.637+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635032e8080 0x563503712f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.637+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563503354350 0x5635037184b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.637+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563503702db0 0x5635037051d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.637+0000 7fc35c7c8740 1 --2- 172.21.15.84:0/1120031716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563503333670 0x563503717f70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.637+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 >> 172.21.15.84:0/1120031716 conn(0x563503348740 msgr2=0x563503700e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:36.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.637+0000 7fc338c00640 0 client.27316 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:36.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.640+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 shutdown_connections 2024-09-21T07:57:36.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.641+0000 7fc35c7c8740 1 -- 172.21.15.84:0/1120031716 wait complete. 2024-09-21T07:57:36.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.642+0000 7fc35c7c8740 20 client.27316 trim_cache size 0 max 16384 2024-09-21T07:57:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:57:36.646 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:57:36.646 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "008af55a-e9e2-461c-9512-4f52101e1e46", 2024-09-21T07:57:36.646 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:57:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:57:36.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.645+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3340b6700 msgr2=0x7fc3340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.645+0000 7fc355c00640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3340b6700 0x7fc3340b8c10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc3480092f0 tx=0x7fc348009220 comp rx=0 tx=0).stop 2024-09-21T07:57:36.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.645+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35010b6f0 msgr2=0x7fc35019ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:36.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.645+0000 7fc355c00640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35010b6f0 0x7fc35019ccf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00e9c0 tx=0x7fc33c00ee80 comp rx=0 tx=0).stop 2024-09-21T07:57:36.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.646+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 shutdown_connections 2024-09-21T07:57:36.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.646+0000 7fc355c00640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc3340b6700 0x7fc3340b8c10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.646+0000 7fc355c00640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc35010c040 0x7fc3501a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.646+0000 7fc355c00640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35010b6f0 0x7fc35019ccf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.646+0000 7fc355c00640 1 --2- 172.21.15.84:0/1903031664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc350105db0 0x7fc35019c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:36.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.646+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 >> 172.21.15.84:0/1903031664 conn(0x7fc3501017c0 msgr2=0x7fc350109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:36.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.646+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 shutdown_connections 2024-09-21T07:57:36.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:36.649+0000 7fc355c00640 1 -- 172.21.15.84:0/1903031664 wait complete. 2024-09-21T07:57:37.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:37 smithi162 ceph-mon[34833]: pgmap v591: 129 pgs: 129 active+clean; 44 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 17 KiB/s rd, 71 MiB/s wr, 851 op/s 2024-09-21T07:57:37.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:37 smithi084 ceph-mon[30411]: pgmap v591: 129 pgs: 129 active+clean; 44 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 17 KiB/s rd, 71 MiB/s wr, 851 op/s 2024-09-21T07:57:37.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:37 smithi191 ceph-mon[34667]: pgmap v591: 129 pgs: 129 active+clean; 44 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 17 KiB/s rd, 71 MiB/s wr, 851 op/s 2024-09-21T07:57:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.084+0000 7f66fa600640 1 -- 172.21.15.84:0/63623003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f41141d0 msgr2=0x7f66f41166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.084+0000 7f66fa600640 1 --2- 172.21.15.84:0/63623003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f41141d0 0x7f66f41166a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009ca0 tx=0x7f66ec02a8d0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.086+0000 7f66fa600640 1 -- 172.21.15.84:0/63623003 shutdown_connections 2024-09-21T07:57:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.086+0000 7f66fa600640 1 --2- 172.21.15.84:0/63623003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f41141d0 0x7f66f41166a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.086+0000 7f66fa600640 1 --2- 172.21.15.84:0/63623003 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 0x7f66f40761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.086+0000 7f66fa600640 1 --2- 172.21.15.84:0/63623003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f4077390 0x7f66f40757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.086+0000 7f66fa600640 1 -- 172.21.15.84:0/63623003 >> 172.21.15.84:0/63623003 conn(0x7f66f40ff330 msgr2=0x7f66f4101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:38.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.090+0000 7f66fa600640 1 -- 172.21.15.84:0/63623003 shutdown_connections 2024-09-21T07:57:38.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.090+0000 7f66fa600640 1 -- 172.21.15.84:0/63623003 wait complete. 2024-09-21T07:57:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.092+0000 7f66fa600640 1 Processor -- start 2024-09-21T07:57:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.094+0000 7f66fa600640 1 -- start start 2024-09-21T07:57:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.094+0000 7f66fa600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 0x7f66f4113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.094+0000 7f66fa600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f4077390 0x7f66f410cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.094+0000 7f66fa600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f41141d0 0x7f66f410d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.094+0000 7f66fa600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4119dd0 con 0x7f66f41141d0 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.094+0000 7f66fa600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4119c50 con 0x7f66f4077390 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.094+0000 7f66fa600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4119f50 con 0x7f66f4075dd0 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 0x7f66f4113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f4077390 0x7f66f410cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 0x7f66f4113920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49962/0 (socket says 172.21.15.84:49962) 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 -- 172.21.15.84:0/4086240387 learned_addr learned my addr 172.21.15.84:0/4086240387 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:38.096 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9c00640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f41141d0 0x7f66f410d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 -- 172.21.15.84:0/4086240387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f4077390 msgr2=0x7f66f410cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f4077390 0x7f66f410cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 -- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f41141d0 msgr2=0x7f66f410d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f41141d0 0x7f66f410d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.095+0000 7f66f9200640 1 -- 172.21.15.84:0/4086240387 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f410d940 con 0x7f66f4075dd0 2024-09-21T07:57:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.096+0000 7f66f9200640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 0x7f66f4113920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d950 tx=0x7f66e800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.096+0000 7f66f1600640 1 -- 172.21.15.84:0/4086240387 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8017030 con 0x7f66f4075dd0 2024-09-21T07:57:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.096+0000 7f66f1600640 1 -- 172.21.15.84:0/4086240387 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66e8004020 con 0x7f66f4075dd0 2024-09-21T07:57:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.096+0000 7f66f1600640 1 -- 172.21.15.84:0/4086240387 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e80047a0 con 0x7f66f4075dd0 2024-09-21T07:57:38.098 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.097+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f41125e0 con 0x7f66f4075dd0 2024-09-21T07:57:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.097+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f4112ae0 con 0x7f66f4075dd0 2024-09-21T07:57:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.106+0000 7f6702c5f740 1 Processor -- start 2024-09-21T07:57:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.107+0000 7f6702c5f740 1 -- start start 2024-09-21T07:57:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.109+0000 7f66f1600640 1 -- 172.21.15.84:0/4086240387 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f66e8009a30 con 0x7f66f4075dd0 2024-09-21T07:57:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.111+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aed91e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 0x55d4aed92350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed92890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f6702c5f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d4aed076b0 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f6702c5f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4aecf6ae0 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f6702c5f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d4aecfa8f0 con 0x55d4ae9c42f0 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f66f9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aed91e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f66f9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aed91e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55962/0 (socket says 172.21.15.84:55962) 2024-09-21T07:57:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.112+0000 7f66f9c00640 1 -- 172.21.15.84:0/874169593 learned_addr learned my addr 172.21.15.84:0/874169593 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.113+0000 7f66f9c00640 1 -- 172.21.15.84:0/874169593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 msgr2=0x55d4aed92350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.113+0000 7f66f9c00640 1 --2- 172.21.15.84:0/874169593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 0x55d4aed92350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.113+0000 7f66f9c00640 1 -- 172.21.15.84:0/874169593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 msgr2=0x55d4aed92890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.113+0000 7f66f9c00640 1 --2- 172.21.15.84:0/874169593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed92890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.113+0000 7f66f9c00640 1 -- 172.21.15.84:0/874169593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4aecc3780 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.113+0000 7f66f9c00640 1 --2- 172.21.15.84:0/874169593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aed91e10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009490 tx=0x7f66ec004aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2996af9021a118c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.114+0000 7f66e6000640 1 -- 172.21.15.84:0/874169593 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec031660 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.114+0000 7f66e6000640 1 -- 172.21.15.84:0/874169593 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66ec040070 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.114+0000 7f66e6000640 1 -- 172.21.15.84:0/874169593 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec031660 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.115+0000 7f66f1600640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f66dc0b6780 0x7f66dc0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.115+0000 7f6702c5f740 1 -- 172.21.15.84:0/874169593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 msgr2=0x55d4aed91e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.116 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.115+0000 7f6702c5f740 1 --2- 172.21.15.84:0/874169593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aed91e10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009490 tx=0x7f66ec004aa0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.116+0000 7f6702c5f740 1 -- 172.21.15.84:0/874169593 shutdown_connections 2024-09-21T07:57:38.117 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.116+0000 7f6702c5f740 1 --2- 172.21.15.84:0/874169593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed92890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.116+0000 7f6702c5f740 1 --2- 172.21.15.84:0/874169593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 0x55d4aed92350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.116+0000 7f6702c5f740 1 --2- 172.21.15.84:0/874169593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aed91e10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.116+0000 7f6702c5f740 1 -- 172.21.15.84:0/874169593 >> 172.21.15.84:0/874169593 conn(0x55d4ae9e1300 msgr2=0x55d4aed8fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.116+0000 7f66f9200640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f66dc0b6780 0x7f66dc0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.116+0000 7f6702c5f740 1 -- 172.21.15.84:0/874169593 shutdown_connections 2024-09-21T07:57:38.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.117+0000 7f6702c5f740 1 -- 172.21.15.84:0/874169593 wait complete. 2024-09-21T07:57:38.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.117+0000 7f66f1600640 1 -- 172.21.15.84:0/4086240387 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f66e80e7500 con 0x7f66f4075dd0 2024-09-21T07:57:38.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.120+0000 7f6702c5f740 1 -- start start 2024-09-21T07:57:38.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.121+0000 7f6702c5f740 1 Processor -- start 2024-09-21T07:57:38.122 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.121+0000 7f66f9200640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f66dc0b6780 0x7f66dc0b8c90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55d4aed90a90 tx=0x7f66e80a96d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:38.123 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.122+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9c42f0 0x55d4aed9d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.123 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.122+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed9da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.122+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aeda9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.122+0000 7f6702c5f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d4aec2eab0 con 0x55d4ae9c42f0 2024-09-21T07:57:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.122+0000 7f6702c5f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4aec9d570 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.122+0000 7f6702c5f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d4aeda0530 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.123+0000 7f6702c5f740 10 client.0 _ll_register_callbacks cb 0x55d4aecac100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.123+0000 7f66f3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed9da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.124 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.123+0000 7f66f3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed9da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49970/0 (socket says 172.21.15.84:49970) 2024-09-21T07:57:38.125 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.123+0000 7f66f9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aeda9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.125 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.123+0000 7f66f3e00640 1 -- 172.21.15.84:0/2467452005 learned_addr learned my addr 172.21.15.84:0/2467452005 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:38.125 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.123+0000 7f66f9c00640 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9c42f0 0x55d4aed9d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.126+0000 7f66f3e00640 1 -- 172.21.15.84:0/2467452005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 msgr2=0x55d4aeda9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.126+0000 7f66f3e00640 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aeda9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.126+0000 7f66f3e00640 1 -- 172.21.15.84:0/2467452005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9c42f0 msgr2=0x55d4aed9d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.126+0000 7f66f3e00640 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9c42f0 0x55d4aed9d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.126+0000 7f66f3e00640 1 -- 172.21.15.84:0/2467452005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4aea58790 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.126+0000 7f66f3e00640 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed9da50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66e00116f0 tx=0x7f66e0011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c086c42a9d6553f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.126+0000 7f66daa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.127+0000 7f66daa00640 1 -- 172.21.15.84:0/2467452005 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e001e060 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.127+0000 7f66daa00640 1 -- 172.21.15.84:0/2467452005 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f66e000fe30 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.128+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66ec040070 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.128+0000 7f66daa00640 1 -- 172.21.15.84:0/2467452005 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66e0019430 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.129+0000 7f6702c5f740 10 client.27325 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.129+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d4aead1620 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.132+0000 7f66daa00640 1 -- 172.21.15.84:0/2467452005 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66ec040070 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.132+0000 7f66daa00640 1 -- 172.21.15.84:0/2467452005 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f66e0011ce0 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.132+0000 7f6702c5f740 10 client.27325 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.132+0000 7f6702c5f740 10 client.27325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.133+0000 7f6702c5f740 20 client.27325 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.133+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9abd80 0x55d4aedaf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.133+0000 7f6702c5f740 4 client.27325 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.133+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4aed09600 con 0x55d4ae9abd80 2024-09-21T07:57:38.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.134+0000 7f66f9c00640 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9abd80 0x55d4aedaf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.137+0000 7f66daa00640 10 client.27325 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:38.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.137+0000 7f66f9c00640 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9abd80 0x55d4aedaf5b0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368d01baeca5ec4f server_cookie=95b04e0c7ce95a4 in_seq=0 out_seq=0 2024-09-21T07:57:38.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.138+0000 7f66daa00640 1 -- 172.21.15.84:0/2467452005 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4aed09600 con 0x55d4ae9abd80 2024-09-21T07:57:38.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.138+0000 7f66daa00640 10 client.27325 handle_command_reply: tid=0 2024-09-21T07:57:38.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.138+0000 7f6702c5f740 1 client.27325 shutdown 2024-09-21T07:57:38.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 msgr2=0x55d4aed9da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed9da50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66e00116f0 tx=0x7f66e0011bb0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 shutdown_connections 2024-09-21T07:57:38.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9ed1b0 0x55d4aeda9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9abd80 0x55d4aedaf5b0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aed9da50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f66daa00640 0 client.27325 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:38.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.139+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2467452005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9c42f0 0x55d4aed9d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.140+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 >> 172.21.15.84:0/2467452005 conn(0x55d4ae9e1300 msgr2=0x55d4aed92e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:38.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.140+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 shutdown_connections 2024-09-21T07:57:38.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.140+0000 7f6702c5f740 1 -- 172.21.15.84:0/2467452005 wait complete. 2024-09-21T07:57:38.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.140+0000 7f6702c5f740 20 client.27325 trim_cache size 0 max 16384 2024-09-21T07:57:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.183+0000 7f6702c5f740 1 Processor -- start 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f6702c5f740 1 -- start start 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9abd80 0x55d4aed9da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9c42f0 0x55d4aed8ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f6702c5f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41bfb20 con 0x55d4ae9abd80 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f6702c5f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41c1660 con 0x55d4ae9c42f0 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f6702c5f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41c01f0 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f66f9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9abd80 0x55d4aed9da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f66f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9c42f0 0x55d4aed8ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f66f3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9c42f0 0x55d4aed8ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55978/0 (socket says 172.21.15.84:55978) 2024-09-21T07:57:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f66f9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9abd80 0x55d4aed9da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53488/0 (socket says 172.21.15.84:53488) 2024-09-21T07:57:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f66f3e00640 1 -- 172.21.15.84:0/2039182789 learned_addr learned my addr 172.21.15.84:0/2039182789 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.184+0000 7f66f9c00640 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66f3e00640 1 -- 172.21.15.84:0/2039182789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 msgr2=0x55d4aeda9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66f3e00640 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66f3e00640 1 -- 172.21.15.84:0/2039182789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9abd80 msgr2=0x55d4aed9da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66f3e00640 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9abd80 0x55d4aed9da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66f3e00640 1 -- 172.21.15.84:0/2039182789 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4aed9ba10 con 0x55d4ae9c42f0 2024-09-21T07:57:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66f3e00640 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9c42f0 0x55d4aed8ea70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009810 tx=0x7f66e000f7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35bee3f5b7d5818a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66e5600640 1 -- 172.21.15.84:0/2039182789 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0028080 con 0x55d4ae9c42f0 2024-09-21T07:57:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.185+0000 7f66e5600640 1 -- 172.21.15.84:0/2039182789 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66e000fe30 con 0x55d4ae9c42f0 2024-09-21T07:57:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f66e5600640 1 -- 172.21.15.84:0/2039182789 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0003850 con 0x55d4ae9c42f0 2024-09-21T07:57:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f6702c5f740 1 -- 172.21.15.84:0/2039182789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9c42f0 msgr2=0x55d4aed8ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9c42f0 0x55d4aed8ea70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009810 tx=0x7f66e000f7b0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f6702c5f740 1 -- 172.21.15.84:0/2039182789 shutdown_connections 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9c42f0 0x55d4aed8ea70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f6702c5f740 1 --2- 172.21.15.84:0/2039182789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9abd80 0x55d4aed9da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.186+0000 7f6702c5f740 1 -- 172.21.15.84:0/2039182789 >> 172.21.15.84:0/2039182789 conn(0x55d4ae9e1300 msgr2=0x55d4aed8e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.187+0000 7f6702c5f740 1 -- 172.21.15.84:0/2039182789 shutdown_connections 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.187+0000 7f6702c5f740 1 -- 172.21.15.84:0/2039182789 wait complete. 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.187+0000 7f6702c5f740 1 -- start start 2024-09-21T07:57:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.187+0000 7f6702c5f740 1 Processor -- start 2024-09-21T07:57:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9abd80 0x55d4aeda6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 0x55d4aeda15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f6702c5f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f6702c5f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41c0f90 con 0x55d4ae9cc4d0 2024-09-21T07:57:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f6702c5f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41c08c0 con 0x55d4ae9abd80 2024-09-21T07:57:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f6702c5f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41bdb20 con 0x55d4ae9c42f0 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f6702c5f740 10 client.0 _ll_register_callbacks cb 0x7f66e0009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f66f9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9abd80 0x55d4aeda6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f66f9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9abd80 0x55d4aeda6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55990/0 (socket says 172.21.15.84:55990) 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f66f9c00640 1 -- 172.21.15.84:0/1687279654 learned_addr learned my addr 172.21.15.84:0/1687279654 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f66f3e00640 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 0x55d4aeda15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.188+0000 7f66f9c00640 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66f9c00640 1 -- 172.21.15.84:0/1687279654 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 msgr2=0x55d4aeda15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66f9c00640 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 0x55d4aeda15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66f9c00640 1 -- 172.21.15.84:0/1687279654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 msgr2=0x55d4aeda1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66f9c00640 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66f9c00640 1 -- 172.21.15.84:0/1687279654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4aee18ee0 con 0x55d4ae9abd80 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66f9c00640 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9abd80 0x55d4aeda6140 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66ec003ba0 tx=0x7f66ec003bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af0a9eed886839e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66daa00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:57:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.189+0000 7f66daa00640 1 -- 172.21.15.84:0/1687279654 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec004d50 con 0x55d4ae9abd80 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.190+0000 7f66daa00640 1 -- 172.21.15.84:0/1687279654 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f66ec030800 con 0x55d4ae9abd80 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.190+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66e000fe30 con 0x55d4ae9abd80 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.190+0000 7f66daa00640 1 -- 172.21.15.84:0/1687279654 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66ec030a00 con 0x55d4ae9abd80 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.190+0000 7f6702c5f740 10 client.27311 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.190+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d4aee1a010 con 0x55d4ae9abd80 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f66daa00640 1 -- 172.21.15.84:0/1687279654 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66e000fe30 con 0x55d4ae9abd80 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f66daa00640 1 -- 172.21.15.84:0/1687279654 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f66ec055c20 con 0x55d4ae9abd80 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f6702c5f740 10 client.27311 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f6702c5f740 10 client.27311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f6702c5f740 20 client.27311 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f6702c5f740 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9ed1b0 0x55d4aee1c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f6702c5f740 4 client.27311 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.191+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d4aed050b0 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.192+0000 7f66f3e00640 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9ed1b0 0x55d4aee1c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.193+0000 7f66daa00640 10 client.27311 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.193+0000 7f66f3e00640 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9ed1b0 0x55d4aee1c2a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2d111a0ac76fe81 server_cookie=7956ff2197b5a8e4 in_seq=0 out_seq=0 2024-09-21T07:57:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.211+0000 7f66daa00640 1 -- 172.21.15.84:0/1687279654 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d4aed050b0 con 0x55d4ae9ed1b0 2024-09-21T07:57:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.212+0000 7f66daa00640 10 client.27311 handle_command_reply: tid=0 2024-09-21T07:57:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.212+0000 7f6702c5f740 1 client.27311 shutdown 2024-09-21T07:57:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.214+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9abd80 msgr2=0x55d4aeda6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.214+0000 7f6702c5f740 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9abd80 0x55d4aeda6140 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f66ec003ba0 tx=0x7f66ec003bd0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.217+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 shutdown_connections 2024-09-21T07:57:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.218+0000 7f6702c5f740 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4ae9cc4d0 0x55d4aeda1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.218+0000 7f6702c5f740 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55d4ae9ed1b0 0x55d4aee1c2a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.218+0000 7f6702c5f740 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d4ae9c42f0 0x55d4aeda15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.218+0000 7f6702c5f740 1 --2- 172.21.15.84:0/1687279654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4ae9abd80 0x55d4aeda6140 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.218+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 >> 172.21.15.84:0/1687279654 conn(0x55d4ae9e1300 msgr2=0x55d4aed92e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.218+0000 7f66daa00640 0 client.27311 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.220+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 shutdown_connections 2024-09-21T07:57:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.220+0000 7f6702c5f740 1 -- 172.21.15.84:0/1687279654 wait complete. 2024-09-21T07:57:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.221+0000 7f6702c5f740 20 client.27311 trim_cache size 0 max 16384 2024-09-21T07:57:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:57:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:57:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:57:38.224 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:57:38.225 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.224+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f66dc0b6780 msgr2=0x7f66dc0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.224+0000 7f66fa600640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f66dc0b6780 0x7f66dc0b8c90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55d4aed90a90 tx=0x7f66e80a96d0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.224+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 msgr2=0x7f66f4113920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.224+0000 7f66fa600640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 0x7f66f4113920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d950 tx=0x7f66e800de10 comp rx=0 tx=0).stop 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.225+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 shutdown_connections 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.225+0000 7f66fa600640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f66dc0b6780 0x7f66dc0b8c90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.225+0000 7f66fa600640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f41141d0 0x7f66f410d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.225+0000 7f66fa600640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f4077390 0x7f66f410cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.225+0000 7f66fa600640 1 --2- 172.21.15.84:0/4086240387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4075dd0 0x7f66f4113920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.225+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 >> 172.21.15.84:0/4086240387 conn(0x7f66f40ff330 msgr2=0x7f66f4103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.226+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 shutdown_connections 2024-09-21T07:57:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:38.227+0000 7f66fa600640 1 -- 172.21.15.84:0/4086240387 wait complete. 2024-09-21T07:57:38.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:38 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:57:38.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:38 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:57:38.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:38 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:57:38.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:38 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:57:38.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:38 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:57:38.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:38 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:57:38.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:38 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:57:38.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:38 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:57:38.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:38 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:57:38.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:38 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:57:38.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:38 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:57:38.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:38 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:57:39.529 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:39 smithi084 ceph-mon[30411]: pgmap v592: 129 pgs: 129 active+clean; 44 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 66 MiB/s wr, 758 op/s 2024-09-21T07:57:39.530 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:39 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:57:39.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:39 smithi162 ceph-mon[34833]: pgmap v592: 129 pgs: 129 active+clean; 44 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 66 MiB/s wr, 758 op/s 2024-09-21T07:57:39.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:39 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:57:39.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:39 smithi191 ceph-mon[34667]: pgmap v592: 129 pgs: 129 active+clean; 44 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 66 MiB/s wr, 758 op/s 2024-09-21T07:57:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:39 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:57:41.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:41 smithi084 ceph-mon[30411]: pgmap v593: 129 pgs: 129 active+clean; 44 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 11 KiB/s rd, 84 MiB/s wr, 859 op/s 2024-09-21T07:57:41.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:57:41.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:41 smithi162 ceph-mon[34833]: pgmap v593: 129 pgs: 129 active+clean; 44 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 11 KiB/s rd, 84 MiB/s wr, 859 op/s 2024-09-21T07:57:41.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:41 smithi191 ceph-mon[34667]: pgmap v593: 129 pgs: 129 active+clean; 44 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 11 KiB/s rd, 84 MiB/s wr, 859 op/s 2024-09-21T07:57:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.352+0000 7fdc2ea00640 1 --2- 172.21.15.84:0/2932040176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc280a5790 0x7fdc280b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:57:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.353+0000 7fdc34e00640 1 -- 172.21.15.84:0/2932040176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280a4e40 msgr2=0x7fdc280a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.353+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2932040176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280a4e40 0x7fdc280a5250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009860 tx=0x7fdc1c02a380 comp rx=0 tx=0).stop 2024-09-21T07:57:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.353+0000 7fdc34e00640 1 -- 172.21.15.84:0/2932040176 shutdown_connections 2024-09-21T07:57:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.353+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2932040176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc280b7b60 0x7fdc280b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.353+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2932040176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc280a5790 0x7fdc280b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.353+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2932040176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280a4e40 0x7fdc280a5250 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.353+0000 7fdc34e00640 1 -- 172.21.15.84:0/2932040176 >> 172.21.15.84:0/2932040176 conn(0x7fdc2801cc20 msgr2=0x7fdc2801d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.354+0000 7fdc34e00640 1 -- 172.21.15.84:0/2932040176 shutdown_connections 2024-09-21T07:57:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.354+0000 7fdc34e00640 1 -- 172.21.15.84:0/2932040176 wait complete. 2024-09-21T07:57:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.356+0000 7fdc34e00640 1 Processor -- start 2024-09-21T07:57:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.357+0000 7fdc34e00640 1 -- start start 2024-09-21T07:57:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.358+0000 7fdc34e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc280a4e40 0x7fdc280b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc34e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc280a5790 0x7fdc280b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:42.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc34e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280b7b60 0x7fdc281586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc2f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc280a4e40 0x7fdc280b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc2f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc280a4e40 0x7fdc280b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53506/0 (socket says 172.21.15.84:53506) 2024-09-21T07:57:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc2f400640 1 -- 172.21.15.84:0/2832979142 learned_addr learned my addr 172.21.15.84:0/2832979142 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc2fe00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280b7b60 0x7fdc281586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdc280adc00 con 0x7fdc280a4e40 2024-09-21T07:57:42.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc280ada80 con 0x7fdc280b7b60 2024-09-21T07:57:42.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.359+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdc280add80 con 0x7fdc280a5790 2024-09-21T07:57:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.360+0000 7fdc2fe00640 1 -- 172.21.15.84:0/2832979142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc280a5790 msgr2=0x7fdc280b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.360+0000 7fdc2fe00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc280a5790 0x7fdc280b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.360+0000 7fdc2fe00640 1 -- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc280a4e40 msgr2=0x7fdc280b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.360+0000 7fdc2fe00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc280a4e40 0x7fdc280b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.360+0000 7fdc2fe00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc280b2a60 con 0x7fdc280b7b60 2024-09-21T07:57:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.361+0000 7fdc2fe00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280b7b60 0x7fdc281586d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdc30052860 tx=0x7fdc3006a4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.362+0000 7fdc23e00640 1 -- 172.21.15.84:0/2832979142 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30072a20 con 0x7fdc280b7b60 2024-09-21T07:57:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.362+0000 7fdc23e00640 1 -- 172.21.15.84:0/2832979142 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc30072bc0 con 0x7fdc280b7b60 2024-09-21T07:57:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.362+0000 7fdc23e00640 1 -- 172.21.15.84:0/2832979142 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc300775e0 con 0x7fdc280b7b60 2024-09-21T07:57:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.362+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc28158d30 con 0x7fdc280b7b60 2024-09-21T07:57:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.362+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc281591f0 con 0x7fdc280b7b60 2024-09-21T07:57:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.369+0000 7fdc23e00640 1 -- 172.21.15.84:0/2832979142 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fdc30078420 con 0x7fdc280b7b60 2024-09-21T07:57:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.369+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc280a61c0 con 0x7fdc280b7b60 2024-09-21T07:57:42.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.372+0000 7fdc23e00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdc180b6730 0x7fdc180b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:42.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.372+0000 7fdc23e00640 1 -- 172.21.15.84:0/2832979142 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fdc3014bdb0 con 0x7fdc280b7b60 2024-09-21T07:57:42.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.376+0000 7fdc23e00640 1 -- 172.21.15.84:0/2832979142 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc300b6710 con 0x7fdc280b7b60 2024-09-21T07:57:42.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.377+0000 7fdc2f400640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdc180b6730 0x7fdc180b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:42.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.386+0000 7fdc2f400640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdc180b6730 0x7fdc180b8c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c000c00 tx=0x7fdc1c02a880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:42.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.852+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc281594e0 con 0x7fdc280b7b60 2024-09-21T07:57:42.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.852+0000 7fdc23e00640 1 -- 172.21.15.84:0/2832979142 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fdc30111f70 con 0x7fdc280b7b60 2024-09-21T07:57:42.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:57:42.857 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:57:42.857 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:57:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.857+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdc180b6730 msgr2=0x7fdc180b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:42.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.857+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdc180b6730 0x7fdc180b8c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c000c00 tx=0x7fdc1c02a880 comp rx=0 tx=0).stop 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.857+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280b7b60 msgr2=0x7fdc281586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.857+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280b7b60 0x7fdc281586d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdc30052860 tx=0x7fdc3006a4f0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.858+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 shutdown_connections 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.858+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdc180b6730 0x7fdc180b8c40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.858+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc280b7b60 0x7fdc281586d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.858+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc280a5790 0x7fdc280b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.858+0000 7fdc34e00640 1 --2- 172.21.15.84:0/2832979142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc280a4e40 0x7fdc280b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.858+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 >> 172.21.15.84:0/2832979142 conn(0x7fdc2801cc20 msgr2=0x7fdc280a7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.858+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 shutdown_connections 2024-09-21T07:57:42.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:42.859+0000 7fdc34e00640 1 -- 172.21.15.84:0/2832979142 wait complete. 2024-09-21T07:57:43.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:43 smithi162 ceph-mon[34833]: pgmap v594: 129 pgs: 129 active+clean; 45 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 29 KiB/s rd, 103 MiB/s wr, 963 op/s 2024-09-21T07:57:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:43 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2832979142' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:43.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:43 smithi084 ceph-mon[30411]: pgmap v594: 129 pgs: 129 active+clean; 45 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 29 KiB/s rd, 103 MiB/s wr, 963 op/s 2024-09-21T07:57:43.811 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:43 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2832979142' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:43.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:43 smithi191 ceph-mon[34667]: pgmap v594: 129 pgs: 129 active+clean; 45 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 29 KiB/s rd, 103 MiB/s wr, 963 op/s 2024-09-21T07:57:43.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:43 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2832979142' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:45.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:45 smithi162 ceph-mon[34833]: pgmap v595: 129 pgs: 129 active+clean; 45 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 146 MiB/s wr, 1.28k op/s 2024-09-21T07:57:45.816 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:45 smithi084 ceph-mon[30411]: pgmap v595: 129 pgs: 129 active+clean; 45 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 146 MiB/s wr, 1.28k op/s 2024-09-21T07:57:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:45 smithi191 ceph-mon[34667]: pgmap v595: 129 pgs: 129 active+clean; 45 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 30 KiB/s rd, 146 MiB/s wr, 1.28k op/s 2024-09-21T07:57:47.316 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T07:57:47.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T07:57:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.409+0000 7f3ec8200640 1 -- 172.21.15.84:0/703513286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0077380 msgr2=0x7f3ec00757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.409+0000 7f3ec8200640 1 --2- 172.21.15.84:0/703513286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0077380 0x7f3ec00757b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009900 tx=0x7f3eac02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.410+0000 7f3ec8200640 1 -- 172.21.15.84:0/703513286 shutdown_connections 2024-09-21T07:57:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.410+0000 7f3ec8200640 1 --2- 172.21.15.84:0/703513286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0114440 0x7f3ec0116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.410+0000 7f3ec8200640 1 --2- 172.21.15.84:0/703513286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ec0075dd0 0x7f3ec00761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.410+0000 7f3ec8200640 1 --2- 172.21.15.84:0/703513286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0077380 0x7f3ec00757b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.410+0000 7f3ec8200640 1 -- 172.21.15.84:0/703513286 >> 172.21.15.84:0/703513286 conn(0x7f3ec00ff5e0 msgr2=0x7f3ec0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.410+0000 7f3ec8200640 1 -- 172.21.15.84:0/703513286 shutdown_connections 2024-09-21T07:57:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.410+0000 7f3ec8200640 1 -- 172.21.15.84:0/703513286 wait complete. 2024-09-21T07:57:47.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.412+0000 7f3ec8200640 1 Processor -- start 2024-09-21T07:57:47.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.412+0000 7f3ec8200640 1 -- start start 2024-09-21T07:57:47.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.412+0000 7f3ec8200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ec0075dd0 0x7f3ec01a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.412+0000 7f3ec8200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0077380 0x7f3ec01a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec8200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0114440 0x7f3ec01a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec8200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec011a0c0 con 0x7f3ec0075dd0 2024-09-21T07:57:47.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec8200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec0119f40 con 0x7f3ec0114440 2024-09-21T07:57:47.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec8200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec011a240 con 0x7f3ec0077380 2024-09-21T07:57:47.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec4e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0077380 0x7f3ec01a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0114440 0x7f3ec01a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec4e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0077380 0x7f3ec01a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50038/0 (socket says 172.21.15.84:50038) 2024-09-21T07:57:47.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec4e00640 1 -- 172.21.15.84:0/3918852754 learned_addr learned my addr 172.21.15.84:0/3918852754 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:47.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.413+0000 7f3ec5800640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ec0075dd0 0x7f3ec01a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.414+0000 7f3ec4e00640 1 -- 172.21.15.84:0/3918852754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0114440 msgr2=0x7f3ec01a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.414+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0114440 0x7f3ec01a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.414+0000 7f3ec4e00640 1 -- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ec0075dd0 msgr2=0x7f3ec01a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.414+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ec0075dd0 0x7f3ec01a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.414+0000 7f3ec4e00640 1 -- 172.21.15.84:0/3918852754 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec01a6a20 con 0x7f3ec0077380 2024-09-21T07:57:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.414+0000 7f3ec6200640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0114440 0x7f3ec01a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.414+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0077380 0x7f3ec01a1050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400e9c0 tx=0x7f3eb400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.415+0000 7f3ebe000640 1 -- 172.21.15.84:0/3918852754 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400cd80 con 0x7f3ec0077380 2024-09-21T07:57:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.415+0000 7f3ebe000640 1 -- 172.21.15.84:0/3918852754 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb40054d0 con 0x7f3ec0077380 2024-09-21T07:57:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.415+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec01a6d10 con 0x7f3ec0077380 2024-09-21T07:57:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.415+0000 7f3ebe000640 1 -- 172.21.15.84:0/3918852754 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4010430 con 0x7f3ec0077380 2024-09-21T07:57:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.415+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec01ad470 con 0x7f3ec0077380 2024-09-21T07:57:47.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.421+0000 7f3ebe000640 1 -- 172.21.15.84:0/3918852754 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3eb4004fd0 con 0x7f3ec0077380 2024-09-21T07:57:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.424+0000 7f3ebe000640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ea80b6680 0x7f3ea80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.424+0000 7f3ebe000640 1 -- 172.21.15.84:0/3918852754 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f3eb40e7ec0 con 0x7f3ec0077380 2024-09-21T07:57:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.425+0000 7f3ec5800640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ea80b6680 0x7f3ea80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.425+0000 7f3ecefc9740 1 Processor -- start 2024-09-21T07:57:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.426+0000 7f3ecefc9740 1 -- start start 2024-09-21T07:57:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.426+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037ab11070 0x56037aeb7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.426+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aeb80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.426+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aaf0390 0x56037aeb85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.426+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56037ae2ef70 con 0x56037aaf0390 2024-09-21T07:57:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.426+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56037ae1e3a0 con 0x56037ab11070 2024-09-21T07:57:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.426+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56037ae221b0 con 0x56037aae81b0 2024-09-21T07:57:47.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.427+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037ab11070 0x56037aeb7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.427+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037ab11070 0x56037aeb7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56046/0 (socket says 172.21.15.84:56046) 2024-09-21T07:57:47.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.427+0000 7f3ec5800640 1 -- 172.21.15.84:0/2976984572 learned_addr learned my addr 172.21.15.84:0/2976984572 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:47.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.427+0000 7f3ec5800640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ea80b6680 0x7f3ea80b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3eac005ab0 tx=0x7f3eac005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:47.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.427+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aeb80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec5800640 1 -- 172.21.15.84:0/2976984572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 msgr2=0x56037aeb80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec5800640 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aeb80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec5800640 1 -- 172.21.15.84:0/2976984572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aaf0390 msgr2=0x56037aeb85e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec6200640 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aaf0390 0x56037aeb85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec5800640 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aaf0390 0x56037aeb85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec5800640 1 -- 172.21.15.84:0/2976984572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56037ade8c90 con 0x56037ab11070 2024-09-21T07:57:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec6200640 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aaf0390 0x56037aeb85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.428+0000 7f3ec5800640 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037ab11070 0x56037aeb7b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009900 tx=0x7f3eac03d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dee5dd020eb3d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.429+0000 7f3eb2a00640 1 -- 172.21.15.84:0/2976984572 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac04d070 con 0x56037ab11070 2024-09-21T07:57:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.429+0000 7f3eb2a00640 1 -- 172.21.15.84:0/2976984572 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eac004c20 con 0x56037ab11070 2024-09-21T07:57:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.429+0000 7f3eb2a00640 1 -- 172.21.15.84:0/2976984572 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac035040 con 0x56037ab11070 2024-09-21T07:57:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.430+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2976984572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037ab11070 msgr2=0x56037aeb7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.430+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037ab11070 0x56037aeb7b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009900 tx=0x7f3eac03d000 comp rx=0 tx=0).stop 2024-09-21T07:57:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.431+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2976984572 shutdown_connections 2024-09-21T07:57:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.431+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aaf0390 0x56037aeb85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.431+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aeb80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.431+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2976984572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037ab11070 0x56037aeb7b60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.431+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2976984572 >> 172.21.15.84:0/2976984572 conn(0x56037ab05460 msgr2=0x56037aeb5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.432+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2976984572 shutdown_connections 2024-09-21T07:57:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.433+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2976984572 wait complete. 2024-09-21T07:57:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.434+0000 7f3ecefc9740 1 -- start start 2024-09-21T07:57:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.437+0000 7f3ecefc9740 1 Processor -- start 2024-09-21T07:57:47.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.437+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aec36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aaf0390 0x56037aec3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037ab11070 0x56037aecf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56037ac7f700 con 0x56037ab11070 2024-09-21T07:57:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56037adb9540 con 0x56037aaf0390 2024-09-21T07:57:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56037aec62e0 con 0x56037aae81b0 2024-09-21T07:57:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ecefc9740 10 client.0 _ll_register_callbacks cb 0x56037adc9430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:47.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aec36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ec4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aaf0390 0x56037aec3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ec6200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037ab11070 0x56037aecf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aec36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50060/0 (socket says 172.21.15.84:50060) 2024-09-21T07:57:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.438+0000 7f3ec5800640 1 -- 172.21.15.84:0/2972213050 learned_addr learned my addr 172.21.15.84:0/2972213050 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.442+0000 7f3ec6200640 1 -- 172.21.15.84:0/2972213050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 msgr2=0x56037aec36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.442+0000 7f3ec6200640 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aec36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.442+0000 7f3ec6200640 1 -- 172.21.15.84:0/2972213050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aaf0390 msgr2=0x56037aec3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.442+0000 7f3ec6200640 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aaf0390 0x56037aec3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.442+0000 7f3ec6200640 1 -- 172.21.15.84:0/2972213050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56037ab7c650 con 0x56037ab11070 2024-09-21T07:57:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.442+0000 7f3ec6200640 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037ab11070 0x56037aecf650 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8011d50 tx=0x7f3eb8013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d7a153b3e40b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.443+0000 7f3ea7400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.443+0000 7f3ea7400640 1 -- 172.21.15.84:0/2972213050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8020060 con 0x56037ab11070 2024-09-21T07:57:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.444+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56037adbbb50 con 0x56037ab11070 2024-09-21T07:57:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.444+0000 7f3ea7400640 1 -- 172.21.15.84:0/2972213050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f3eb8003b80 con 0x56037ab11070 2024-09-21T07:57:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.444+0000 7f3ea7400640 1 -- 172.21.15.84:0/2972213050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3eb8020060 con 0x56037ab11070 2024-09-21T07:57:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.444+0000 7f3ecefc9740 10 client.17061 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.444+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56037add6910 con 0x56037ab11070 2024-09-21T07:57:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.445+0000 7f3ea7400640 1 -- 172.21.15.84:0/2972213050 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56037adbbb50 con 0x56037ab11070 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.447+0000 7f3ea7400640 1 -- 172.21.15.84:0/2972213050 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3eb801b550 con 0x56037ab11070 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.447+0000 7f3ecefc9740 10 client.17061 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.447+0000 7f3ecefc9740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.447+0000 7f3ecefc9740 20 client.17061 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.447+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037aacf9f0 0x56037aed5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.447+0000 7f3ecefc9740 4 client.17061 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.447+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56037ae30ec0 con 0x56037aacf9f0 2024-09-21T07:57:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.448+0000 7f3ec5800640 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037aacf9f0 0x56037aed5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.449+0000 7f3ea7400640 10 client.17061 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.449+0000 7f3ec5800640 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037aacf9f0 0x56037aed5680 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cff95f1bb9c3f644 server_cookie=c95d31a4e55e3b9 in_seq=0 out_seq=0 2024-09-21T07:57:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.450+0000 7f3ea7400640 1 -- 172.21.15.84:0/2972213050 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56037ae30ec0 con 0x56037aacf9f0 2024-09-21T07:57:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.450+0000 7f3ea7400640 10 client.17061 handle_command_reply: tid=0 2024-09-21T07:57:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.450+0000 7f3ecefc9740 1 client.17061 shutdown 2024-09-21T07:57:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.451+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037ab11070 msgr2=0x56037aecf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.451+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037ab11070 0x56037aecf650 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8011d50 tx=0x7f3eb8013830 comp rx=0 tx=0).stop 2024-09-21T07:57:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.451+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 shutdown_connections 2024-09-21T07:57:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.451+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037ab11070 0x56037aecf650 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.451+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aaf0390 0x56037aec3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.452+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037aacf9f0 0x56037aed5680 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.452+0000 7f3ea7400640 0 client.17061 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.452+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/2972213050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aae81b0 0x56037aec36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.452+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 >> 172.21.15.84:0/2972213050 conn(0x56037ab05460 msgr2=0x56037aebacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.452+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 shutdown_connections 2024-09-21T07:57:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.453+0000 7f3ecefc9740 1 -- 172.21.15.84:0/2972213050 wait complete. 2024-09-21T07:57:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.453+0000 7f3ecefc9740 20 client.17061 trim_cache size 0 max 16384 2024-09-21T07:57:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.492+0000 7f3ecefc9740 1 Processor -- start 2024-09-21T07:57:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.492+0000 7f3ecefc9740 1 -- start start 2024-09-21T07:57:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.493+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aacf9f0 0x56037aec3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.493+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aae81b0 0x56037aecf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.493+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037aecfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.493+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01b74b0 con 0x56037aacf9f0 2024-09-21T07:57:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.493+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01b8ff0 con 0x56037aae81b0 2024-09-21T07:57:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.493+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01b7b80 con 0x56037aaf0390 2024-09-21T07:57:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.494+0000 7f3ec6200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037aecfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.494+0000 7f3ec6200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037aecfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50062/0 (socket says 172.21.15.84:50062) 2024-09-21T07:57:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.494+0000 7f3ec6200640 1 -- 172.21.15.84:0/267623260 learned_addr learned my addr 172.21.15.84:0/267623260 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.494+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aae81b0 0x56037aecf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.494+0000 7f3ec5800640 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aacf9f0 0x56037aec3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.495+0000 7f3ec6200640 1 -- 172.21.15.84:0/267623260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aae81b0 msgr2=0x56037aecf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.495+0000 7f3ec6200640 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aae81b0 0x56037aecf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.495+0000 7f3ec6200640 1 -- 172.21.15.84:0/267623260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aacf9f0 msgr2=0x56037aec3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.495+0000 7f3ec6200640 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aacf9f0 0x56037aec3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.495+0000 7f3ec6200640 1 -- 172.21.15.84:0/267623260 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56037aec2450 con 0x56037aaf0390 2024-09-21T07:57:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.495+0000 7f3ec5800640 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aacf9f0 0x56037aec3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.495+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aae81b0 0x56037aecf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.496+0000 7f3ec6200640 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037aecfa90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3eb801be70 tx=0x7f3eb801bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b9cb3c7ab55efc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.496+0000 7f3eb2000640 1 -- 172.21.15.84:0/267623260 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8032070 con 0x56037aaf0390 2024-09-21T07:57:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.496+0000 7f3eb2000640 1 -- 172.21.15.84:0/267623260 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb8011040 con 0x56037aaf0390 2024-09-21T07:57:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.496+0000 7f3eb2000640 1 -- 172.21.15.84:0/267623260 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8005360 con 0x56037aaf0390 2024-09-21T07:57:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.498+0000 7f3ecefc9740 1 -- 172.21.15.84:0/267623260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 msgr2=0x56037aecfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.498+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037aecfa90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3eb801be70 tx=0x7f3eb801bea0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.498+0000 7f3ecefc9740 1 -- 172.21.15.84:0/267623260 shutdown_connections 2024-09-21T07:57:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.498+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037aecfa90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.498+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aae81b0 0x56037aecf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.498+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/267623260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aacf9f0 0x56037aec3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.499+0000 7f3ecefc9740 1 -- 172.21.15.84:0/267623260 >> 172.21.15.84:0/267623260 conn(0x56037ab05460 msgr2=0x56037aec36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.500+0000 7f3ecefc9740 1 -- 172.21.15.84:0/267623260 shutdown_connections 2024-09-21T07:57:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.500+0000 7f3ecefc9740 1 -- 172.21.15.84:0/267623260 wait complete. 2024-09-21T07:57:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.501+0000 7f3ecefc9740 1 -- start start 2024-09-21T07:57:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.501+0000 7f3ecefc9740 1 Processor -- start 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.502+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aacf9f0 0x56037aec78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.502+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aae81b0 0x56037aec7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.502+0000 7f3ecefc9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037af3f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.502+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01b8920 con 0x56037aae81b0 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.502+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01b8250 con 0x56037aacf9f0 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.502+0000 7f3ecefc9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01b54b0 con 0x56037aaf0390 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.502+0000 7f3ecefc9740 10 client.0 _ll_register_callbacks cb 0x7f3eb8011990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.503+0000 7f3ec6200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037af3f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.503+0000 7f3ec6200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037af3f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50078/0 (socket says 172.21.15.84:50078) 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.503+0000 7f3ec6200640 1 -- 172.21.15.84:0/220189144 learned_addr learned my addr 172.21.15.84:0/220189144 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:47.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.503+0000 7f3ec5800640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aacf9f0 0x56037aec78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.503+0000 7f3ec6200640 1 -- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aacf9f0 msgr2=0x56037aec78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:47.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.503+0000 7f3ec6200640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aacf9f0 0x56037aec78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.503+0000 7f3ec6200640 1 -- 172.21.15.84:0/220189144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aae81b0 msgr2=0x56037aec7e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:47.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.504+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aae81b0 0x56037aec7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.504+0000 7f3ec6200640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aae81b0 0x56037aec7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.504+0000 7f3ec6200640 1 -- 172.21.15.84:0/220189144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56037aec86c0 con 0x56037aaf0390 2024-09-21T07:57:47.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.504+0000 7f3ec4e00640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aae81b0 0x56037aec7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:47.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.505+0000 7f3ec6200640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037af3f040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8030040 tx=0x7f3eb801b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35ecd0b0c53fa0c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:47.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.505+0000 7f3ea7400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:57:47.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.506+0000 7f3ea7400640 1 -- 172.21.15.84:0/220189144 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8032030 con 0x56037aaf0390 2024-09-21T07:57:47.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.506+0000 7f3ea7400640 1 -- 172.21.15.84:0/220189144 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f3eb802a040 con 0x56037aaf0390 2024-09-21T07:57:47.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.506+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eb8011040 con 0x56037aaf0390 2024-09-21T07:57:47.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.507+0000 7f3ea7400640 1 -- 172.21.15.84:0/220189144 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3eb80111f0 con 0x56037aaf0390 2024-09-21T07:57:47.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.507+0000 7f3ecefc9740 10 client.27352 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:47.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.507+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56037af51560 con 0x56037aaf0390 2024-09-21T07:57:47.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ea7400640 1 -- 172.21.15.84:0/220189144 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb8011040 con 0x56037aaf0390 2024-09-21T07:57:47.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ea7400640 1 -- 172.21.15.84:0/220189144 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3eb8038550 con 0x56037aaf0390 2024-09-21T07:57:47.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ecefc9740 10 client.27352 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:47.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ecefc9740 10 client.27352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:47.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ecefc9740 20 client.27352 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:47.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037ab11070 0x56037af53be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:47.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ecefc9740 4 client.27352 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:57:47.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.508+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56037ae2c970 con 0x56037ab11070 2024-09-21T07:57:47.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.511+0000 7f3ec5800640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037ab11070 0x56037af53be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.512+0000 7f3ec5800640 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037ab11070 0x56037af53be0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c20ae593aac4c01 server_cookie=7ba1aa8f7704830a in_seq=0 out_seq=0 2024-09-21T07:57:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.512+0000 7f3ea7400640 10 client.27352 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.513+0000 7f3ea7400640 1 -- 172.21.15.84:0/220189144 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x56037ae2c970 con 0x56037ab11070 2024-09-21T07:57:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.513+0000 7f3ea7400640 10 client.27352 handle_command_reply: tid=0 2024-09-21T07:57:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.513+0000 7f3ecefc9740 1 client.27352 shutdown 2024-09-21T07:57:47.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 msgr2=0x56037af3f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037af3f040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8030040 tx=0x7f3eb801b7c0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 shutdown_connections 2024-09-21T07:57:47.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56037ab11070 0x56037af53be0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ea7400640 0 client.27352 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:47.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56037aaf0390 0x56037af3f040 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56037aae81b0 0x56037aec7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 --2- 172.21.15.84:0/220189144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56037aacf9f0 0x56037aec78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.519+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 >> 172.21.15.84:0/220189144 conn(0x56037ab05460 msgr2=0x56037aebac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.530 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:57:47.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.520+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 shutdown_connections 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.520+0000 7f3ecefc9740 1 -- 172.21.15.84:0/220189144 wait complete. 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.521+0000 7f3ecefc9740 20 client.27352 trim_cache size 0 max 16384 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ea80b6680 msgr2=0x7f3ea80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ea80b6680 0x7f3ea80b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3eac005ab0 tx=0x7f3eac005a20 comp rx=0 tx=0).stop 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0077380 msgr2=0x7f3ec01a1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0077380 0x7f3ec01a1050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400e9c0 tx=0x7f3eb400ee80 comp rx=0 tx=0).stop 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 shutdown_connections 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3ea80b6680 0x7f3ea80b8b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec0114440 0x7f3ec01a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ec0077380 0x7f3ec01a1050 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 --2- 172.21.15.84:0/3918852754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ec0075dd0 0x7f3ec01a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.522+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 >> 172.21.15.84:0/3918852754 conn(0x7f3ec00ff5e0 msgr2=0x7f3ec0110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:47.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.523+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 shutdown_connections 2024-09-21T07:57:47.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:47.523+0000 7f3ec8200640 1 -- 172.21.15.84:0/3918852754 wait complete. 2024-09-21T07:57:47.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:47 smithi162 ceph-mon[34833]: pgmap v596: 129 pgs: 129 active+clean; 45 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 43 KiB/s rd, 165 MiB/s wr, 1.40k op/s 2024-09-21T07:57:47.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:47 smithi084 ceph-mon[30411]: pgmap v596: 129 pgs: 129 active+clean; 45 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 43 KiB/s rd, 165 MiB/s wr, 1.40k op/s 2024-09-21T07:57:47.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:47 smithi191 ceph-mon[34667]: pgmap v596: 129 pgs: 129 active+clean; 45 GiB data, 94 GiB used, 979 GiB / 1.0 TiB avail; 43 KiB/s rd, 165 MiB/s wr, 1.40k op/s 2024-09-21T07:57:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:49 smithi162 ceph-mon[34833]: pgmap v597: 129 pgs: 129 active+clean; 45 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 38 KiB/s rd, 174 MiB/s wr, 1.44k op/s 2024-09-21T07:57:49.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:49 smithi084 ceph-mon[30411]: pgmap v597: 129 pgs: 129 active+clean; 45 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 38 KiB/s rd, 174 MiB/s wr, 1.44k op/s 2024-09-21T07:57:49.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:49 smithi191 ceph-mon[34667]: pgmap v597: 129 pgs: 129 active+clean; 45 GiB data, 95 GiB used, 978 GiB / 1.0 TiB avail; 38 KiB/s rd, 174 MiB/s wr, 1.44k op/s 2024-09-21T07:57:50.249 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:57:50.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:57:50.372 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.638+0000 7f5267e00640 1 -- 172.21.15.84:0/903061510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5268109f00 msgr2=0x7f526810a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.638+0000 7f5267e00640 1 --2- 172.21.15.84:0/903061510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5268109f00 0x7f526810a310 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5254009900 tx=0x7f525402a420 comp rx=0 tx=0).stop 2024-09-21T07:57:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.640+0000 7f5267e00640 1 -- 172.21.15.84:0/903061510 shutdown_connections 2024-09-21T07:57:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.640+0000 7f5267e00640 1 --2- 172.21.15.84:0/903061510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5268110180 0x7f52681169b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.641+0000 7f5267e00640 1 --2- 172.21.15.84:0/903061510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f526810f830 0x7f526810fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.641+0000 7f5267e00640 1 --2- 172.21.15.84:0/903061510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5268109f00 0x7f526810a310 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.641+0000 7f5267e00640 1 -- 172.21.15.84:0/903061510 >> 172.21.15.84:0/903061510 conn(0x7f52680795e0 msgr2=0x7f52681081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.642+0000 7f5267e00640 1 -- 172.21.15.84:0/903061510 shutdown_connections 2024-09-21T07:57:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.642+0000 7f5267e00640 1 -- 172.21.15.84:0/903061510 wait complete. 2024-09-21T07:57:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.648+0000 7f5267e00640 1 Processor -- start 2024-09-21T07:57:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.648+0000 7f5267e00640 1 -- start start 2024-09-21T07:57:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.649+0000 7f5267e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268109f00 0x7f52681a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.650+0000 7f5267e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f526810f830 0x7f52681a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.650+0000 7f5267e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5268110180 0x7f52681a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.650+0000 7f5267e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5268119e90 con 0x7f5268110180 2024-09-21T07:57:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.650+0000 7f5267e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5268119d10 con 0x7f5268109f00 2024-09-21T07:57:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.650+0000 7f5267e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f526811a010 con 0x7f526810f830 2024-09-21T07:57:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.651+0000 7f5266a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268109f00 0x7f52681a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.651+0000 7f5266000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f526810f830 0x7f52681a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.651+0000 7f5266000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f526810f830 0x7f52681a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48474/0 (socket says 172.21.15.84:48474) 2024-09-21T07:57:51.653 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.651+0000 7f5266000640 1 -- 172.21.15.84:0/3156538761 learned_addr learned my addr 172.21.15.84:0/3156538761 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.652+0000 7f5266000640 1 -- 172.21.15.84:0/3156538761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268109f00 msgr2=0x7f52681a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.652+0000 7f5266000640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268109f00 0x7f52681a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.652+0000 7f5266000640 1 -- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5268110180 msgr2=0x7f52681a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.652+0000 7f5266000640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5268110180 0x7f52681a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.652+0000 7f5266000640 1 -- 172.21.15.84:0/3156538761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52681a67b0 con 0x7f526810f830 2024-09-21T07:57:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.653+0000 7f5266000640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f526810f830 0x7f52681a0eb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f526000cce0 tx=0x7f526000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.654+0000 7f525f400640 1 -- 172.21.15.84:0/3156538761 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526000f450 con 0x7f526810f830 2024-09-21T07:57:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.654+0000 7f525f400640 1 -- 172.21.15.84:0/3156538761 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f526000faa0 con 0x7f526810f830 2024-09-21T07:57:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.654+0000 7f525f400640 1 -- 172.21.15.84:0/3156538761 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5260018c50 con 0x7f526810f830 2024-09-21T07:57:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.654+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52681a6aa0 con 0x7f526810f830 2024-09-21T07:57:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.654+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52681ad2c0 con 0x7f526810f830 2024-09-21T07:57:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.663+0000 7f525f400640 1 -- 172.21.15.84:0/3156538761 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f52600213f0 con 0x7f526810f830 2024-09-21T07:57:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.664+0000 7f527485c740 1 Processor -- start 2024-09-21T07:57:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.664+0000 7f527485c740 1 -- start start 2024-09-21T07:57:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.665+0000 7f527485c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f280ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f527485c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24412f0 0x5592f280f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f527485c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f527485c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592f27846b0 con 0x5592f24494d0 2024-09-21T07:57:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f527485c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592f2773ae0 con 0x5592f246a1b0 2024-09-21T07:57:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f527485c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592f27778f0 con 0x5592f24412f0 2024-09-21T07:57:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f5267400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f280ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f5267400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f280ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47152/0 (socket says 172.21.15.84:47152) 2024-09-21T07:57:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.666+0000 7f5267400640 1 -- 172.21.15.84:0/2913640738 learned_addr learned my addr 172.21.15.84:0/2913640738 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.667+0000 7f5267400640 1 -- 172.21.15.84:0/2913640738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24412f0 msgr2=0x5592f280f350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.667+0000 7f5267400640 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24412f0 0x5592f280f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.667+0000 7f5267400640 1 -- 172.21.15.84:0/2913640738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 msgr2=0x5592f280f890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.668+0000 7f525f400640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f524c0b6880 0x7f524c0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.669+0000 7f5266000640 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.669+0000 7f5267400640 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.669+0000 7f5267400640 1 -- 172.21.15.84:0/2913640738 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592f2740780 con 0x5592f246a1b0 2024-09-21T07:57:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.670+0000 7f5266000640 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.669+0000 7f525f400640 1 -- 172.21.15.84:0/3156538761 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f52600e7fc0 con 0x7f526810f830 2024-09-21T07:57:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.671+0000 7f5266a00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f524c0b6880 0x7f524c0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.671+0000 7f5267400640 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f280ee10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5258009bf0 tx=0x7f525800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c323beedb3c059 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.672+0000 7f5253e00640 1 -- 172.21.15.84:0/2913640738 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258005020 con 0x5592f246a1b0 2024-09-21T07:57:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.672+0000 7f5253e00640 1 -- 172.21.15.84:0/2913640738 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52580047a0 con 0x5592f246a1b0 2024-09-21T07:57:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.672+0000 7f5253e00640 1 -- 172.21.15.84:0/2913640738 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258010670 con 0x5592f246a1b0 2024-09-21T07:57:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.674+0000 7f5266a00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f524c0b6880 0x7f524c0b8d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5254005ab0 tx=0x7f5254000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.674+0000 7f527485c740 1 -- 172.21.15.84:0/2913640738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 msgr2=0x5592f280ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.674+0000 7f527485c740 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f280ee10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5258009bf0 tx=0x7f525800e720 comp rx=0 tx=0).stop 2024-09-21T07:57:51.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.674+0000 7f527485c740 1 -- 172.21.15.84:0/2913640738 shutdown_connections 2024-09-21T07:57:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.675+0000 7f527485c740 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.675+0000 7f527485c740 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24412f0 0x5592f280f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.675+0000 7f527485c740 1 --2- 172.21.15.84:0/2913640738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f280ee10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.675+0000 7f527485c740 1 -- 172.21.15.84:0/2913640738 >> 172.21.15.84:0/2913640738 conn(0x5592f245e300 msgr2=0x5592f280cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.676+0000 7f527485c740 1 -- 172.21.15.84:0/2913640738 shutdown_connections 2024-09-21T07:57:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.676+0000 7f527485c740 1 -- 172.21.15.84:0/2913640738 wait complete. 2024-09-21T07:57:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.678+0000 7f527485c740 1 -- start start 2024-09-21T07:57:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.678+0000 7f527485c740 1 Processor -- start 2024-09-21T07:57:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.678+0000 7f527485c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24412f0 0x5592f281a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f527485c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24494d0 0x5592f281a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f527485c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f28268e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f527485c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592f26abab0 con 0x5592f24412f0 2024-09-21T07:57:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f527485c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592f271a570 con 0x5592f246a1b0 2024-09-21T07:57:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f527485c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592f281d590 con 0x5592f24494d0 2024-09-21T07:57:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f527485c740 10 client.0 _ll_register_callbacks cb 0x5592f2729100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f5266a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24412f0 0x5592f281a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f5266a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24412f0 0x5592f281a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46718/0 (socket says 172.21.15.84:46718) 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f5266a00640 1 -- 172.21.15.84:0/661053744 learned_addr learned my addr 172.21.15.84:0/661053744 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.679+0000 7f5267400640 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f28268e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.680+0000 7f5266a00640 1 -- 172.21.15.84:0/661053744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24494d0 msgr2=0x5592f281a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.680+0000 7f5266a00640 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24494d0 0x5592f281a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.680+0000 7f5266a00640 1 -- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 msgr2=0x5592f28268e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.680+0000 7f5266a00640 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f28268e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.680+0000 7f5266a00640 1 -- 172.21.15.84:0/661053744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592f24d5790 con 0x5592f24412f0 2024-09-21T07:57:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.680+0000 7f5267400640 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f28268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:57:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.680+0000 7f5266a00640 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24412f0 0x5592f281a490 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f52540092a0 tx=0x7f525402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370a74d0c2cd732c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.681+0000 7f5250c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.681+0000 7f5250c00640 1 -- 172.21.15.84:0/661053744 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525404d020 con 0x5592f24412f0 2024-09-21T07:57:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.681+0000 7f5250c00640 1 -- 172.21.15.84:0/661053744 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f52540048c0 con 0x5592f24412f0 2024-09-21T07:57:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.682+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52580047a0 con 0x5592f24412f0 2024-09-21T07:57:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.682+0000 7f5250c00640 1 -- 172.21.15.84:0/661053744 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5254058050 con 0x5592f24412f0 2024-09-21T07:57:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.682+0000 7f527485c740 10 client.17067 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.682+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592f254e620 con 0x5592f24412f0 2024-09-21T07:57:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.683+0000 7f5250c00640 1 -- 172.21.15.84:0/661053744 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52580047a0 con 0x5592f24412f0 2024-09-21T07:57:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.683+0000 7f5250c00640 1 -- 172.21.15.84:0/661053744 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5254049480 con 0x5592f24412f0 2024-09-21T07:57:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.684+0000 7f527485c740 10 client.17067 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.684+0000 7f527485c740 10 client.17067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.684+0000 7f527485c740 20 client.17067 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.684+0000 7f527485c740 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2428d80 0x5592f282c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.685+0000 7f527485c740 4 client.17067 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.685+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592f2786600 con 0x5592f2428d80 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.685+0000 7f5266000640 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2428d80 0x5592f282c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.685+0000 7f5266000640 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2428d80 0x5592f282c670 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40206f29a243a6df server_cookie=366c55c32b349023 in_seq=0 out_seq=0 2024-09-21T07:57:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.686+0000 7f5250c00640 10 client.17067 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.688+0000 7f5250c00640 1 -- 172.21.15.84:0/661053744 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592f2786600 con 0x5592f2428d80 2024-09-21T07:57:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.688+0000 7f5250c00640 10 client.17067 handle_command_reply: tid=0 2024-09-21T07:57:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.688+0000 7f527485c740 1 client.17067 shutdown 2024-09-21T07:57:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24412f0 msgr2=0x5592f281a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24412f0 0x5592f281a490 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f52540092a0 tx=0x7f525402a420 comp rx=0 tx=0).stop 2024-09-21T07:57:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 shutdown_connections 2024-09-21T07:57:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f28268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2428d80 0x5592f282c670 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f24494d0 0x5592f281a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 --2- 172.21.15.84:0/661053744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24412f0 0x5592f281a490 secure :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f52540092a0 tx=0x7f525402a420 comp rx=0 tx=0).stop 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f5250c00640 0 client.17067 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.690+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 >> 172.21.15.84:0/661053744 conn(0x5592f245e300 msgr2=0x5592f280fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.691+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 shutdown_connections 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.691+0000 7f527485c740 1 -- 172.21.15.84:0/661053744 wait complete. 2024-09-21T07:57:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.691+0000 7f527485c740 20 client.17067 trim_cache size 0 max 16384 2024-09-21T07:57:51.716 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.715+0000 7f527485c740 1 Processor -- start 2024-09-21T07:57:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.715+0000 7f527485c740 1 -- start start 2024-09-21T07:57:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.715+0000 7f527485c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.717 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.715+0000 7f527485c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f246a1b0 0x5592f281c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.715+0000 7f527485c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f23fe1c0 0x5592f2810550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f527485c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f524800ff30 con 0x5592f24494d0 2024-09-21T07:57:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f527485c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5248011a70 con 0x5592f23fe1c0 2024-09-21T07:57:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f527485c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5248010600 con 0x5592f246a1b0 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f5266a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f5266a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46734/0 (socket says 172.21.15.84:46734) 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f5266a00640 1 -- 172.21.15.84:0/1529314102 learned_addr learned my addr 172.21.15.84:0/1529314102 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f5266000640 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f246a1b0 0x5592f281c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.716+0000 7f5267400640 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f23fe1c0 0x5592f2810550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.717+0000 7f5266a00640 1 -- 172.21.15.84:0/1529314102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f246a1b0 msgr2=0x5592f281c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.717+0000 7f5266a00640 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f246a1b0 0x5592f281c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.717+0000 7f5266a00640 1 -- 172.21.15.84:0/1529314102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f23fe1c0 msgr2=0x5592f2810550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.717+0000 7f5266a00640 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f23fe1c0 0x5592f2810550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.717+0000 7f5266a00640 1 -- 172.21.15.84:0/1529314102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592f280da70 con 0x5592f24494d0 2024-09-21T07:57:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.717+0000 7f5266a00640 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280be30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5254004370 tx=0x7f52540094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff2aafde9a8dda0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.718+0000 7f5253400640 1 -- 172.21.15.84:0/1529314102 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525404d070 con 0x5592f24494d0 2024-09-21T07:57:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.718+0000 7f5253400640 1 -- 172.21.15.84:0/1529314102 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5254060030 con 0x5592f24494d0 2024-09-21T07:57:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.718+0000 7f5253400640 1 -- 172.21.15.84:0/1529314102 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254035040 con 0x5592f24494d0 2024-09-21T07:57:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.719+0000 7f527485c740 1 -- 172.21.15.84:0/1529314102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 msgr2=0x5592f280be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.719+0000 7f527485c740 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280be30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5254004370 tx=0x7f52540094c0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.719+0000 7f527485c740 1 -- 172.21.15.84:0/1529314102 shutdown_connections 2024-09-21T07:57:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.719+0000 7f527485c740 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f23fe1c0 0x5592f2810550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.719+0000 7f527485c740 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f246a1b0 0x5592f281c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.719+0000 7f527485c740 1 --2- 172.21.15.84:0/1529314102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f24494d0 0x5592f280be30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.719+0000 7f527485c740 1 -- 172.21.15.84:0/1529314102 >> 172.21.15.84:0/1529314102 conn(0x5592f245e300 msgr2=0x5592f280fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.720+0000 7f527485c740 1 -- 172.21.15.84:0/1529314102 shutdown_connections 2024-09-21T07:57:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.720+0000 7f527485c740 1 -- 172.21.15.84:0/1529314102 wait complete. 2024-09-21T07:57:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.721+0000 7f527485c740 1 -- start start 2024-09-21T07:57:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.721+0000 7f527485c740 1 Processor -- start 2024-09-21T07:57:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.722+0000 7f527485c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f23fe1c0 0x5592f2820ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.722+0000 7f527485c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f2821400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.722+0000 7f527485c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f2894030 0x5592f2896450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.722+0000 7f527485c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52480113a0 con 0x5592f2894030 2024-09-21T07:57:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.722+0000 7f527485c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5248010cd0 con 0x5592f246a1b0 2024-09-21T07:57:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.722+0000 7f527485c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f524800df30 con 0x5592f23fe1c0 2024-09-21T07:57:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.722+0000 7f527485c740 10 client.0 _ll_register_callbacks cb 0x7f5254040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.723+0000 7f5267400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f2894030 0x5592f2896450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.725 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.723+0000 7f5267400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f2894030 0x5592f2896450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46746/0 (socket says 172.21.15.84:46746) 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.723+0000 7f5267400640 1 -- 172.21.15.84:0/3151344990 learned_addr learned my addr 172.21.15.84:0/3151344990 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.723+0000 7f5266a00640 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f23fe1c0 0x5592f2820ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.723+0000 7f5267400640 1 -- 172.21.15.84:0/3151344990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f23fe1c0 msgr2=0x5592f2820ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.723+0000 7f5267400640 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f23fe1c0 0x5592f2820ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.724+0000 7f5267400640 1 -- 172.21.15.84:0/3151344990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 msgr2=0x5592f2821400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.724+0000 7f5267400640 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f2821400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.724+0000 7f5267400640 1 -- 172.21.15.84:0/3151344990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592f2896990 con 0x5592f2894030 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.724+0000 7f5267400640 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f2894030 0x5592f2896450 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5258004700 tx=0x7f5258009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd05e8d9e9f13e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:51.726 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.724+0000 7f5250c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:57:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.725+0000 7f5250c00640 1 -- 172.21.15.84:0/3151344990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525801d040 con 0x5592f2894030 2024-09-21T07:57:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.725+0000 7f5250c00640 1 -- 172.21.15.84:0/3151344990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f525802e470 con 0x5592f2894030 2024-09-21T07:57:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.725+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5254060030 con 0x5592f2894030 2024-09-21T07:57:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.726+0000 7f5250c00640 1 -- 172.21.15.84:0/3151344990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f525801d040 con 0x5592f2894030 2024-09-21T07:57:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.729+0000 7f527485c740 10 client.17073 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.729+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592f2897b80 con 0x5592f2894030 2024-09-21T07:57:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f5250c00640 1 -- 172.21.15.84:0/3151344990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5254060030 con 0x5592f2894030 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f5250c00640 1 -- 172.21.15.84:0/3151344990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5258004f30 con 0x5592f2894030 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f527485c740 10 client.17073 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f527485c740 10 client.17073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f527485c740 20 client.17073 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f527485c740 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2897f70 0x5592f289a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f527485c740 4 client.17073 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592f27820b0 con 0x5592f2897f70 2024-09-21T07:57:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.731+0000 7f5266a00640 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2897f70 0x5592f289a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.732+0000 7f5266a00640 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2897f70 0x5592f289a390 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f55525977e8038 server_cookie=140b9243b73169df in_seq=0 out_seq=0 2024-09-21T07:57:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.732+0000 7f5250c00640 10 client.17073 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:51.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:51 smithi162 ceph-mon[34833]: pgmap v598: 129 pgs: 129 active+clean; 46 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 39 KiB/s rd, 211 MiB/s wr, 1.62k op/s 2024-09-21T07:57:51.814 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:51 smithi084 ceph-mon[30411]: pgmap v598: 129 pgs: 129 active+clean; 46 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 39 KiB/s rd, 211 MiB/s wr, 1.62k op/s 2024-09-21T07:57:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.824+0000 7f5250c00640 1 -- 172.21.15.84:0/3151344990 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592f27820b0 con 0x5592f2897f70 2024-09-21T07:57:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.825+0000 7f5250c00640 10 client.17073 handle_command_reply: tid=0 2024-09-21T07:57:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.825+0000 7f527485c740 1 client.17073 shutdown 2024-09-21T07:57:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.825+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f2894030 msgr2=0x5592f2896450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.825+0000 7f527485c740 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f2894030 0x5592f2896450 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5258004700 tx=0x7f5258009f10 comp rx=0 tx=0).stop 2024-09-21T07:57:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 shutdown_connections 2024-09-21T07:57:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f527485c740 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f2894030 0x5592f2896450 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f527485c740 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f246a1b0 0x5592f2821400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f527485c740 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f2897f70 0x5592f289a390 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f527485c740 1 --2- 172.21.15.84:0/3151344990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f23fe1c0 0x5592f2820ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 >> 172.21.15.84:0/3151344990 conn(0x5592f245e300 msgr2=0x5592f281c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f5250c00640 0 client.17073 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.826+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 shutdown_connections 2024-09-21T07:57:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.828+0000 7f527485c740 1 -- 172.21.15.84:0/3151344990 wait complete. 2024-09-21T07:57:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.828+0000 7f527485c740 20 client.17073 trim_cache size 0 max 16384 2024-09-21T07:57:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:57:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:57:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:57:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:57:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.831+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f524c0b6880 msgr2=0x7f524c0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.831+0000 7f5267e00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f524c0b6880 0x7f524c0b8d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5254005ab0 tx=0x7f5254000bc0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.831+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f526810f830 msgr2=0x7f52681a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.831+0000 7f5267e00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f526810f830 0x7f52681a0eb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f526000cce0 tx=0x7f526000a620 comp rx=0 tx=0).stop 2024-09-21T07:57:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.833+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 shutdown_connections 2024-09-21T07:57:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.833+0000 7f5267e00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f524c0b6880 0x7f524c0b8d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.833+0000 7f5267e00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5268110180 0x7f52681a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.833+0000 7f5267e00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f526810f830 0x7f52681a0eb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.833+0000 7f5267e00640 1 --2- 172.21.15.84:0/3156538761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268109f00 0x7f52681a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.833+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 >> 172.21.15.84:0/3156538761 conn(0x7f52680795e0 msgr2=0x7f52681084c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.834+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 shutdown_connections 2024-09-21T07:57:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:57:51.834+0000 7f5267e00640 1 -- 172.21.15.84:0/3156538761 wait complete. 2024-09-21T07:57:51.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:51 smithi191 ceph-mon[34667]: pgmap v598: 129 pgs: 129 active+clean; 46 GiB data, 96 GiB used, 977 GiB / 1.0 TiB avail; 39 KiB/s rd, 211 MiB/s wr, 1.62k op/s 2024-09-21T07:57:52.440 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 -- 172.21.15.84:0/361177588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 msgr2=0x7f9b4c109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 --2- 172.21.15.84:0/361177588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 0x7f9b4c109720 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009860 tx=0x7f9b3802a360 comp rx=0 tx=0).stop 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 -- 172.21.15.84:0/361177588 shutdown_connections 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 --2- 172.21.15.84:0/361177588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c109c60 0x7f9b4c110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 --2- 172.21.15.84:0/361177588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 0x7f9b4c109720 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 --2- 172.21.15.84:0/361177588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b4c1039d0 0x7f9b4c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 -- 172.21.15.84:0/361177588 >> 172.21.15.84:0/361177588 conn(0x7f9b4c0ff440 msgr2=0x7f9b4c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.619+0000 7f9b4b200640 1 -- 172.21.15.84:0/361177588 shutdown_connections 2024-09-21T07:57:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.620+0000 7f9b4b200640 1 -- 172.21.15.84:0/361177588 wait complete. 2024-09-21T07:57:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 Processor -- start 2024-09-21T07:57:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 -- start start 2024-09-21T07:57:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c1039d0 0x7f9b4c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 0x7f9b4c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b4c109c60 0x7f9b4c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c113920 con 0x7f9b4c109c60 2024-09-21T07:57:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1137a0 con 0x7f9b4c1039d0 2024-09-21T07:57:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.621+0000 7f9b4b200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c113aa0 con 0x7f9b4c109310 2024-09-21T07:57:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b4a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b4c109c60 0x7f9b4c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b49400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 0x7f9b4c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b49400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 0x7f9b4c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48532/0 (socket says 172.21.15.84:48532) 2024-09-21T07:57:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b49400640 1 -- 172.21.15.84:0/417281307 learned_addr learned my addr 172.21.15.84:0/417281307 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b49e00640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c1039d0 0x7f9b4c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b4a800640 1 -- 172.21.15.84:0/417281307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 msgr2=0x7f9b4c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b4a800640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 0x7f9b4c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b4a800640 1 -- 172.21.15.84:0/417281307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c1039d0 msgr2=0x7f9b4c19a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b4a800640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c1039d0 0x7f9b4c19a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.622+0000 7f9b4a800640 1 -- 172.21.15.84:0/417281307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c1a0240 con 0x7f9b4c109c60 2024-09-21T07:57:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.623+0000 7f9b4a800640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b4c109c60 0x7f9b4c19fb10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400e940 tx=0x7f9b4400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.623+0000 7f9b42a00640 1 -- 172.21.15.84:0/417281307 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44004d20 con 0x7f9b4c109c60 2024-09-21T07:57:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.623+0000 7f9b42a00640 1 -- 172.21.15.84:0/417281307 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b44005020 con 0x7f9b4c109c60 2024-09-21T07:57:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.623+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c1a0530 con 0x7f9b4c109c60 2024-09-21T07:57:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.623+0000 7f9b42a00640 1 -- 172.21.15.84:0/417281307 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b440116d0 con 0x7f9b4c109c60 2024-09-21T07:57:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.623+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c1a6c90 con 0x7f9b4c109c60 2024-09-21T07:57:52.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.627+0000 7f9b577d6740 1 Processor -- start 2024-09-21T07:57:52.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.630+0000 7f9b42a00640 1 -- 172.21.15.84:0/417281307 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9b44005440 con 0x7f9b4c109c60 2024-09-21T07:57:52.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.632+0000 7f9b577d6740 1 -- start start 2024-09-21T07:57:52.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b42a00640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9b300b66f0 0x7f9b300b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cb45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758cb4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758cc6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b577d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b758c2ca90 con 0x55b7588eeb70 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b577d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b758c1bec0 con 0x55b75890f850 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b577d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b758c1fcd0 con 0x55b7588e6990 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b42a00640 1 -- 172.21.15.84:0/417281307 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f9b440e7b70 con 0x7f9b4c109c60 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b49e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cb45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b49e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cb45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47212/0 (socket says 172.21.15.84:47212) 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b4a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758cc6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.633+0000 7f9b49e00640 1 -- 172.21.15.84:0/1184994750 learned_addr learned my addr 172.21.15.84:0/1184994750 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:52.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.634+0000 7f9b49e00640 1 -- 172.21.15.84:0/1184994750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 msgr2=0x55b758cb4b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:57:52.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.634+0000 7f9b49e00640 1 --2- 172.21.15.84:0/1184994750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758cb4b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.634+0000 7f9b49e00640 1 -- 172.21.15.84:0/1184994750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 msgr2=0x55b758cc6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:52.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.634+0000 7f9b49e00640 1 --2- 172.21.15.84:0/1184994750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758cc6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.634+0000 7f9b49e00640 1 -- 172.21.15.84:0/1184994750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b758bc19d0 con 0x55b75890f850 2024-09-21T07:57:52.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.634+0000 7f9b49400640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9b300b66f0 0x7f9b300b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.634+0000 7f9b49e00640 1 --2- 172.21.15.84:0/1184994750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cb45f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009cc0 tx=0x7f9b3c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2acd454369fb475 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.635+0000 7f9b37000640 1 -- 172.21.15.84:0/1184994750 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c005220 con 0x55b75890f850 2024-09-21T07:57:52.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.635+0000 7f9b37000640 1 -- 172.21.15.84:0/1184994750 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3c004c50 con 0x55b75890f850 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.635+0000 7f9b37000640 1 -- 172.21.15.84:0/1184994750 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c019810 con 0x55b75890f850 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.636+0000 7f9b577d6740 1 -- 172.21.15.84:0/1184994750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 msgr2=0x55b758cb45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.636+0000 7f9b577d6740 1 --2- 172.21.15.84:0/1184994750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cb45f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009cc0 tx=0x7f9b3c011810 comp rx=0 tx=0).stop 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.636+0000 7f9b577d6740 1 -- 172.21.15.84:0/1184994750 shutdown_connections 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.636+0000 7f9b577d6740 1 --2- 172.21.15.84:0/1184994750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758cc6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.636+0000 7f9b577d6740 1 --2- 172.21.15.84:0/1184994750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758cb4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.636+0000 7f9b577d6740 1 --2- 172.21.15.84:0/1184994750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cb45f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.636+0000 7f9b577d6740 1 -- 172.21.15.84:0/1184994750 >> 172.21.15.84:0/1184994750 conn(0x55b758903c40 msgr2=0x55b758cb6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.637+0000 7f9b577d6740 1 -- 172.21.15.84:0/1184994750 shutdown_connections 2024-09-21T07:57:52.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.637+0000 7f9b577d6740 1 -- 172.21.15.84:0/1184994750 wait complete. 2024-09-21T07:57:52.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.637+0000 7f9b49400640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9b300b66f0 0x7f9b300b8c00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c106d60 tx=0x7f9b38005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.638+0000 7f9b577d6740 1 -- start start 2024-09-21T07:57:52.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.638+0000 7f9b577d6740 1 Processor -- start 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.638+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758ccb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.638+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758ccbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.638+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.638+0000 7f9b577d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b758a7d7b0 con 0x55b7588eeb70 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.638+0000 7f9b577d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b758bc0650 con 0x55b75890f850 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b577d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b758cc7a40 con 0x55b7588e6990 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b577d6740 10 client.0 _ll_register_callbacks cb 0x55b7589270a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b4a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b4a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47226/0 (socket says 172.21.15.84:47226) 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b4a800640 1 -- 172.21.15.84:0/2662642727 learned_addr learned my addr 172.21.15.84:0/2662642727 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b49e00640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758ccb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b4a800640 1 -- 172.21.15.84:0/2662642727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 msgr2=0x55b758ccb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b4a800640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758ccb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.639+0000 7f9b4a800640 1 -- 172.21.15.84:0/2662642727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 msgr2=0x55b758ccbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.640+0000 7f9b49400640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758ccbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.640+0000 7f9b4a800640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758ccbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.640+0000 7f9b4a800640 1 -- 172.21.15.84:0/2662642727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b758989ba0 con 0x55b75890f850 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.640+0000 7f9b49400640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758ccbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.640+0000 7f9b4a800640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd0b40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9b440aa8a0 tx=0x7f9b440acff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5981b26d3dccfe90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.640+0000 7f9b2b400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.641+0000 7f9b2b400640 1 -- 172.21.15.84:0/2662642727 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4401f040 con 0x55b75890f850 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.641+0000 7f9b2b400640 1 -- 172.21.15.84:0/2662642727 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f9b440b6040 con 0x55b75890f850 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.641+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b3c004c50 con 0x55b75890f850 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.641+0000 7f9b2b400640 1 -- 172.21.15.84:0/2662642727 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b440add30 con 0x55b75890f850 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.641+0000 7f9b577d6740 10 client.27359 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.641+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b758cba4b0 con 0x55b75890f850 2024-09-21T07:57:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.642+0000 7f9b2b400640 1 -- 172.21.15.84:0/2662642727 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3c004c50 con 0x55b75890f850 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.642+0000 7f9b2b400640 1 -- 172.21.15.84:0/2662642727 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9b4400f040 con 0x55b75890f850 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.643+0000 7f9b577d6740 10 client.27359 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.643+0000 7f9b577d6740 10 client.27359 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.643+0000 7f9b577d6740 20 client.27359 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.643+0000 7f9b577d6740 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588ce1d0 0x55b758cbda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.643+0000 7f9b577d6740 4 client.27359 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.643+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b758c2e9e0 con 0x55b7588ce1d0 2024-09-21T07:57:52.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.643+0000 7f9b49e00640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588ce1d0 0x55b758cbda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.644+0000 7f9b49e00640 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588ce1d0 0x55b758cbda10 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e3c4abd97c48ba server_cookie=5231f35dd1face15 in_seq=0 out_seq=0 2024-09-21T07:57:52.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.644+0000 7f9b2b400640 10 client.27359 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.645+0000 7f9b2b400640 1 -- 172.21.15.84:0/2662642727 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b758c2e9e0 con 0x55b7588ce1d0 2024-09-21T07:57:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.645+0000 7f9b2b400640 10 client.27359 handle_command_reply: tid=0 2024-09-21T07:57:52.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.645+0000 7f9b577d6740 1 client.27359 shutdown 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 msgr2=0x55b758cd0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd0b40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9b440aa8a0 tx=0x7f9b440acff0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 shutdown_connections 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd0b40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758ccbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588ce1d0 0x55b758cbda10 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 --2- 172.21.15.84:0/2662642727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758ccb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b2b400640 0 client.27359 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 >> 172.21.15.84:0/2662642727 conn(0x55b758903c40 msgr2=0x55b758cb5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.646+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 shutdown_connections 2024-09-21T07:57:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.647+0000 7f9b577d6740 1 -- 172.21.15.84:0/2662642727 wait complete. 2024-09-21T07:57:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.647+0000 7f9b577d6740 20 client.27359 trim_cache size 0 max 16384 2024-09-21T07:57:52.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.668+0000 7f9b577d6740 1 Processor -- start 2024-09-21T07:57:52.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.668+0000 7f9b577d6740 1 -- start start 2024-09-21T07:57:52.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.669+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7588e6990 0x55b758cc8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.669+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588eeb70 0x55b758cc9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.669+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b75890f850 0x55b758cca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.669+0000 7f9b577d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1aeae0 con 0x55b75890f850 2024-09-21T07:57:52.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.669+0000 7f9b577d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1b0620 con 0x55b7588e6990 2024-09-21T07:57:52.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.669+0000 7f9b577d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1af1b0 con 0x55b7588eeb70 2024-09-21T07:57:52.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7588e6990 0x55b758cc8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7588e6990 0x55b758cc8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47230/0 (socket says 172.21.15.84:47230) 2024-09-21T07:57:52.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49e00640 1 -- 172.21.15.84:0/196419517 learned_addr learned my addr 172.21.15.84:0/196419517 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:52.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49400640 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588eeb70 0x55b758cc9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49400640 1 -- 172.21.15.84:0/196419517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7588e6990 msgr2=0x55b758cc8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:52.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49400640 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7588e6990 0x55b758cc8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49400640 1 -- 172.21.15.84:0/196419517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b75890f850 msgr2=0x55b758cca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:57:52.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49400640 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b75890f850 0x55b758cca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.670+0000 7f9b49400640 1 -- 172.21.15.84:0/196419517 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b758cb8280 con 0x55b7588eeb70 2024-09-21T07:57:52.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.671+0000 7f9b49400640 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588eeb70 0x55b758cc9be0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802a950 tx=0x7f9b3803b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b633159acefbcf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.671+0000 7f9b36600640 1 -- 172.21.15.84:0/196419517 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38044050 con 0x55b7588eeb70 2024-09-21T07:57:52.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.671+0000 7f9b36600640 1 -- 172.21.15.84:0/196419517 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3804e070 con 0x55b7588eeb70 2024-09-21T07:57:52.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.671+0000 7f9b36600640 1 -- 172.21.15.84:0/196419517 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38037040 con 0x55b7588eeb70 2024-09-21T07:57:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.673+0000 7f9b577d6740 1 -- 172.21.15.84:0/196419517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588eeb70 msgr2=0x55b758cc9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.673+0000 7f9b577d6740 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588eeb70 0x55b758cc9be0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802a950 tx=0x7f9b3803b000 comp rx=0 tx=0).stop 2024-09-21T07:57:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.673+0000 7f9b577d6740 1 -- 172.21.15.84:0/196419517 shutdown_connections 2024-09-21T07:57:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.673+0000 7f9b577d6740 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b75890f850 0x55b758cca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.673+0000 7f9b577d6740 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588eeb70 0x55b758cc9be0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.673+0000 7f9b577d6740 1 --2- 172.21.15.84:0/196419517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7588e6990 0x55b758cc8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.673+0000 7f9b577d6740 1 -- 172.21.15.84:0/196419517 >> 172.21.15.84:0/196419517 conn(0x55b758903c40 msgr2=0x55b758cb4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.674+0000 7f9b577d6740 1 -- 172.21.15.84:0/196419517 shutdown_connections 2024-09-21T07:57:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.674+0000 7f9b577d6740 1 -- 172.21.15.84:0/196419517 wait complete. 2024-09-21T07:57:52.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.675+0000 7f9b577d6740 1 -- start start 2024-09-21T07:57:52.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.675+0000 7f9b577d6740 1 Processor -- start 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758cd37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758cd3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b577d6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b577d6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1aff50 con 0x55b7588eeb70 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b577d6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1af880 con 0x55b75890f850 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b577d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c1acae0 con 0x55b7588e6990 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b4a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b4a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:47242/0 (socket says 172.21.15.84:47242) 2024-09-21T07:57:52.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b4a800640 1 -- 172.21.15.84:0/4108469877 learned_addr learned my addr 172.21.15.84:0/4108469877 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b4a800640 1 -- 172.21.15.84:0/4108469877 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 msgr2=0x55b758cd37b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b4a800640 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758cd37b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b4a800640 1 -- 172.21.15.84:0/4108469877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 msgr2=0x55b758cd3cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:57:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.676+0000 7f9b4a800640 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758cd3cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.677+0000 7f9b4a800640 1 -- 172.21.15.84:0/4108469877 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b758cb7400 con 0x55b75890f850 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.677+0000 7f9b4a800640 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd4230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9b440a9c00 tx=0x7f9b440accd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937c8430d9a5abfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.677+0000 7f9b2b400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.677+0000 7f9b2b400640 1 -- 172.21.15.84:0/4108469877 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4401f070 con 0x55b75890f850 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.677+0000 7f9b2b400640 1 -- 172.21.15.84:0/4108469877 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f9b440a8f80 con 0x55b75890f850 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.677+0000 7f9b2b400640 10 client.0 inactive, discarding osd_map(90..90 src has 1..90) 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.678+0000 7f9b577d6740 10 client.0 _ll_register_callbacks cb 0x7f9b440a9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.678+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b3804e070 con 0x55b75890f850 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.678+0000 7f9b2b400640 1 -- 172.21.15.84:0/4108469877 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b440acda0 con 0x55b75890f850 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.678+0000 7f9b577d6740 10 client.27365 fetch_fsmap learned FSMap version 29 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.678+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b758d50f70 con 0x55b75890f850 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.678+0000 7f9b2b400640 1 -- 172.21.15.84:0/4108469877 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9b440a9180 con 0x55b75890f850 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.679+0000 7f9b577d6740 10 client.27365 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.679+0000 7f9b577d6740 10 client.27365 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.679+0000 7f9b577d6740 20 client.27365 populate_metadata read hostname 'smithi084' 2024-09-21T07:57:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.679+0000 7f9b577d6740 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588a3580 0x55b758d536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.679+0000 7f9b577d6740 4 client.27365 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T07:57:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.679+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x55b758c2a490 con 0x55b7588a3580 2024-09-21T07:57:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.679+0000 7f9b49e00640 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588a3580 0x55b758d536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.680+0000 7f9b2b400640 10 client.27365 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.680+0000 7f9b49e00640 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588a3580 0x55b758d536f0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f0e4f11acb348d server_cookie=f397354949fdcfbf in_seq=0 out_seq=0 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.865+0000 7f9b2b400640 1 -- 172.21.15.84:0/4108469877 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b758c2a490 con 0x55b7588a3580 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.865+0000 7f9b2b400640 10 client.27365 handle_command_reply: tid=0 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.865+0000 7f9b577d6740 1 client.27365 shutdown 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 msgr2=0x55b758cd4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd4230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9b440a9c00 tx=0x7f9b440accd0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 shutdown_connections 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b75890f850 0x55b758cd4230 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7588eeb70 0x55b758cd3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b7588a3580 0x55b758d536f0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 --2- 172.21.15.84:0/4108469877 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7588e6990 0x55b758cd37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 >> 172.21.15.84:0/4108469877 conn(0x55b758903c40 msgr2=0x55b758ccf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b2b400640 0 client.27365 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:57:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 shutdown_connections 2024-09-21T07:57:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 1 -- 172.21.15.84:0/4108469877 wait complete. 2024-09-21T07:57:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.866+0000 7f9b577d6740 20 client.27365 trim_cache size 0 max 16384 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 26, 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "e7a3bb18": { 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 26, 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:57:52.870 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 139.2, 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:57:52.871 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:57:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.870+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9b300b66f0 msgr2=0x7f9b300b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.870+0000 7f9b4b200640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9b300b66f0 0x7f9b300b8c00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c106d60 tx=0x7f9b38005850 comp rx=0 tx=0).stop 2024-09-21T07:57:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.870+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b4c109c60 msgr2=0x7f9b4c19fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.870+0000 7f9b4b200640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b4c109c60 0x7f9b4c19fb10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400e940 tx=0x7f9b4400ee00 comp rx=0 tx=0).stop 2024-09-21T07:57:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 shutdown_connections 2024-09-21T07:57:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9b300b66f0 0x7f9b300b8c00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b4c109c60 0x7f9b4c19fb10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4c109310 0x7f9b4c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 --2- 172.21.15.84:0/417281307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c1039d0 0x7f9b4c19a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 >> 172.21.15.84:0/417281307 conn(0x7f9b4c0ff440 msgr2=0x7f9b4c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 shutdown_connections 2024-09-21T07:57:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:52.871+0000 7f9b4b200640 1 -- 172.21.15.84:0/417281307 wait complete. 2024-09-21T07:57:53.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:53 smithi191 ceph-mon[34667]: pgmap v599: 129 pgs: 129 active+clean; 46 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 50 KiB/s rd, 219 MiB/s wr, 1.54k op/s 2024-09-21T07:57:53.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:53 smithi084 ceph-mon[30411]: pgmap v599: 129 pgs: 129 active+clean; 46 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 50 KiB/s rd, 219 MiB/s wr, 1.54k op/s 2024-09-21T07:57:54.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:53 smithi162 ceph-mon[34833]: pgmap v599: 129 pgs: 129 active+clean; 46 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 50 KiB/s rd, 219 MiB/s wr, 1.54k op/s 2024-09-21T07:57:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:55 smithi191 ceph-mon[34667]: pgmap v600: 129 pgs: 129 active+clean; 47 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 31 KiB/s rd, 228 MiB/s wr, 1.47k op/s 2024-09-21T07:57:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:55 smithi162 ceph-mon[34833]: pgmap v600: 129 pgs: 129 active+clean; 47 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 31 KiB/s rd, 228 MiB/s wr, 1.47k op/s 2024-09-21T07:57:56.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:55 smithi084 ceph-mon[30411]: pgmap v600: 129 pgs: 129 active+clean; 47 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 31 KiB/s rd, 228 MiB/s wr, 1.47k op/s 2024-09-21T07:57:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:57 smithi191 ceph-mon[34667]: pgmap v601: 129 pgs: 129 active+clean; 47 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 54 KiB/s rd, 211 MiB/s wr, 1.28k op/s 2024-09-21T07:57:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:57 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:58.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:57 smithi162 ceph-mon[34833]: pgmap v601: 129 pgs: 129 active+clean; 47 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 54 KiB/s rd, 211 MiB/s wr, 1.28k op/s 2024-09-21T07:57:58.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:57 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:58.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:57 smithi084 ceph-mon[30411]: pgmap v601: 129 pgs: 129 active+clean; 47 GiB data, 98 GiB used, 975 GiB / 1.0 TiB avail; 54 KiB/s rd, 211 MiB/s wr, 1.28k op/s 2024-09-21T07:57:58.060 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:57 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:58.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.417+0000 7fdf52600640 1 -- 172.21.15.84:0/2182581728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c11cf80 msgr2=0x7fdf4c11f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:58.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.418+0000 7fdf52600640 1 --2- 172.21.15.84:0/2182581728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c11f3a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009ca0 tx=0x7fdf4402a8f0 comp rx=0 tx=0).stop 2024-09-21T07:57:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.418+0000 7fdf52600640 1 -- 172.21.15.84:0/2182581728 shutdown_connections 2024-09-21T07:57:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.419+0000 7fdf52600640 1 --2- 172.21.15.84:0/2182581728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c11f3a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.419+0000 7fdf52600640 1 --2- 172.21.15.84:0/2182581728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c06fa20 0x7fdf4c11ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.419+0000 7fdf52600640 1 --2- 172.21.15.84:0/2182581728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4c06f0d0 0x7fdf4c06f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.419+0000 7fdf52600640 1 -- 172.21.15.84:0/2182581728 >> 172.21.15.84:0/2182581728 conn(0x7fdf4c10a3c0 msgr2=0x7fdf4c10c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.421+0000 7fdf52600640 1 -- 172.21.15.84:0/2182581728 shutdown_connections 2024-09-21T07:57:58.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.422+0000 7fdf52600640 1 -- 172.21.15.84:0/2182581728 wait complete. 2024-09-21T07:57:58.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.430+0000 7fdf52600640 1 Processor -- start 2024-09-21T07:57:58.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.434+0000 7fdf52600640 1 -- start start 2024-09-21T07:57:58.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.435+0000 7fdf52600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c06f0d0 0x7fdf4c1a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:58.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.436+0000 7fdf52600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4c06fa20 0x7fdf4c1a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:58.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.436+0000 7fdf52600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c1aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:58.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.437+0000 7fdf52600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c122980 con 0x7fdf4c06f0d0 2024-09-21T07:57:58.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.437+0000 7fdf4be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c1aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:58.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.437+0000 7fdf4be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c1aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38568/0 (socket says 172.21.15.84:38568) 2024-09-21T07:57:58.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.437+0000 7fdf4be00640 1 -- 172.21.15.84:0/3249561782 learned_addr learned my addr 172.21.15.84:0/3249561782 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:57:58.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.437+0000 7fdf52600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c122800 con 0x7fdf4c11cf80 2024-09-21T07:57:58.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.437+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c122b00 con 0x7fdf4c06fa20 2024-09-21T07:57:58.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.437+0000 7fdf4b400640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c06f0d0 0x7fdf4c1a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:58.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.438+0000 7fdf4aa00640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4c06fa20 0x7fdf4c1a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:58.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.440+0000 7fdf4be00640 1 -- 172.21.15.84:0/3249561782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4c06fa20 msgr2=0x7fdf4c1a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.440+0000 7fdf4be00640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4c06fa20 0x7fdf4c1a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.440+0000 7fdf4be00640 1 -- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c06f0d0 msgr2=0x7fdf4c1a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.440+0000 7fdf4be00640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c06f0d0 0x7fdf4c1a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.440+0000 7fdf4be00640 1 -- 172.21.15.84:0/3249561782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4c1af340 con 0x7fdf4c11cf80 2024-09-21T07:57:58.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.444+0000 7fdf4be00640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c1aec10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdf44003bd0 tx=0x7fdf44003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:58.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.445+0000 7fdf43e00640 1 -- 172.21.15.84:0/3249561782 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44004040 con 0x7fdf4c11cf80 2024-09-21T07:57:58.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.445+0000 7fdf43e00640 1 -- 172.21.15.84:0/3249561782 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf4402d070 con 0x7fdf4c11cf80 2024-09-21T07:57:58.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.445+0000 7fdf43e00640 1 -- 172.21.15.84:0/3249561782 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4402fb70 con 0x7fdf4c11cf80 2024-09-21T07:57:58.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.446+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4c1af5d0 con 0x7fdf4c11cf80 2024-09-21T07:57:58.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.446+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4c1b5d90 con 0x7fdf4c11cf80 2024-09-21T07:57:58.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.452+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4c06f560 con 0x7fdf4c11cf80 2024-09-21T07:57:58.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.460+0000 7fdf43e00640 1 -- 172.21.15.84:0/3249561782 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fdf4402fd10 con 0x7fdf4c11cf80 2024-09-21T07:57:58.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.473+0000 7fdf43e00640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf300b6880 0x7fdf300b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:57:58.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.475+0000 7fdf43e00640 1 -- 172.21.15.84:0/3249561782 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7fdf44109260 con 0x7fdf4c11cf80 2024-09-21T07:57:58.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.476+0000 7fdf4b400640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf300b6880 0x7fdf300b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:57:58.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.478+0000 7fdf43e00640 1 -- 172.21.15.84:0/3249561782 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf4410f1d0 con 0x7fdf4c11cf80 2024-09-21T07:57:58.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.480+0000 7fdf4b400640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf300b6880 0x7fdf300b8d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c006fd0 tx=0x7fdf3c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:57:58.583 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e7a3bb18', quiesce took 25.3 seconds. Will release after: -6.050000000000001 2024-09-21T07:57:58.584 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:57:58.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.995+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf4c118110 con 0x7fdf4c11cf80 2024-09-21T07:57:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:58.997+0000 7fdf43e00640 1 -- 172.21.15.84:0/3249561782 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fdf440cf3c0 con 0x7fdf4c11cf80 2024-09-21T07:57:59.000 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:57:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:57:59.001 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:57:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.002+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf300b6880 msgr2=0x7fdf300b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.002+0000 7fdf52600640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf300b6880 0x7fdf300b8d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c006fd0 tx=0x7fdf3c008040 comp rx=0 tx=0).stop 2024-09-21T07:57:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.002+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c11cf80 msgr2=0x7fdf4c1aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:57:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.002+0000 7fdf52600640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c1aec10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdf44003bd0 tx=0x7fdf44003c00 comp rx=0 tx=0).stop 2024-09-21T07:57:59.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.003+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 shutdown_connections 2024-09-21T07:57:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.003+0000 7fdf52600640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdf300b6880 0x7fdf300b8d90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.003+0000 7fdf52600640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf4c11cf80 0x7fdf4c1aec10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.003+0000 7fdf52600640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf4c06fa20 0x7fdf4c1a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.003+0000 7fdf52600640 1 --2- 172.21.15.84:0/3249561782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf4c06f0d0 0x7fdf4c1a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:57:59.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.003+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 >> 172.21.15.84:0/3249561782 conn(0x7fdf4c10a3c0 msgr2=0x7fdf4c11ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:57:59.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.005+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 shutdown_connections 2024-09-21T07:57:59.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:57:59.005+0000 7fdf52600640 1 -- 172.21.15.84:0/3249561782 wait complete. 2024-09-21T07:57:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:59 smithi191 ceph-mon[34667]: pgmap v602: 129 pgs: 129 active+clean; 47 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 40 KiB/s rd, 206 MiB/s wr, 1.21k op/s 2024-09-21T07:57:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:57:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:57:59 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3249561782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:57:59.951 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:59 smithi084 ceph-mon[30411]: pgmap v602: 129 pgs: 129 active+clean; 47 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 40 KiB/s rd, 206 MiB/s wr, 1.21k op/s 2024-09-21T07:57:59.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:59.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:59.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:57:59.952 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:57:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3249561782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:00.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:59 smithi162 ceph-mon[34833]: pgmap v602: 129 pgs: 129 active+clean; 47 GiB data, 99 GiB used, 974 GiB / 1.0 TiB avail; 40 KiB/s rd, 206 MiB/s wr, 1.21k op/s 2024-09-21T07:58:00.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:00.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:00.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:58:00.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:57:59 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3249561782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:00.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:00 smithi191 ceph-mon[34667]: pgmap v603: 129 pgs: 129 active+clean; 48 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 42 KiB/s rd, 245 MiB/s wr, 1.39k op/s 2024-09-21T07:58:01.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:00 smithi162 ceph-mon[34833]: pgmap v603: 129 pgs: 129 active+clean; 48 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 42 KiB/s rd, 245 MiB/s wr, 1.39k op/s 2024-09-21T07:58:01.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:00 smithi084 ceph-mon[30411]: pgmap v603: 129 pgs: 129 active+clean; 48 GiB data, 100 GiB used, 973 GiB / 1.0 TiB avail; 42 KiB/s rd, 245 MiB/s wr, 1.39k op/s 2024-09-21T07:58:01.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:58:01.448 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:03.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:03 smithi084 ceph-mon[30411]: pgmap v604: 129 pgs: 129 active+clean; 48 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 44 KiB/s rd, 240 MiB/s wr, 1.31k op/s 2024-09-21T07:58:03.586 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:03.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:03 smithi162 ceph-mon[34833]: pgmap v604: 129 pgs: 129 active+clean; 48 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 44 KiB/s rd, 240 MiB/s wr, 1.31k op/s 2024-09-21T07:58:03.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.822+0000 7f461e200640 1 -- 172.21.15.84:0/691269844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f461810f900 msgr2=0x7f461810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:03.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.822+0000 7f461e200640 1 --2- 172.21.15.84:0/691269844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f461810f900 0x7f461810fd10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f460c009900 tx=0x7f460c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.822+0000 7f461e200640 1 -- 172.21.15.84:0/691269844 shutdown_connections 2024-09-21T07:58:03.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.822+0000 7f461e200640 1 --2- 172.21.15.84:0/691269844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4618110250 0x7f4618116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.822+0000 7f461e200640 1 --2- 172.21.15.84:0/691269844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f461810f900 0x7f461810fd10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.822+0000 7f461e200640 1 --2- 172.21.15.84:0/691269844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4618109fc0 0x7f461810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.822+0000 7f461e200640 1 -- 172.21.15.84:0/691269844 >> 172.21.15.84:0/691269844 conn(0x7f46180795c0 msgr2=0x7f46181081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:03.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.823+0000 7f461e200640 1 -- 172.21.15.84:0/691269844 shutdown_connections 2024-09-21T07:58:03.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.823+0000 7f461e200640 1 -- 172.21.15.84:0/691269844 wait complete. 2024-09-21T07:58:03.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.824+0000 7f461e200640 1 Processor -- start 2024-09-21T07:58:03.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.825+0000 7f461e200640 1 -- start start 2024-09-21T07:58:03.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.825+0000 7f461e200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4618109fc0 0x7f46181a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:03.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.825+0000 7f461e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461810f900 0x7f46181a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:03.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.825+0000 7f461e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4618110250 0x7f46181a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:03.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.825+0000 7f461e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4618119f00 con 0x7f4618110250 2024-09-21T07:58:03.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.825+0000 7f461e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4618119d80 con 0x7f461810f900 2024-09-21T07:58:03.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.825+0000 7f461e200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f461811a080 con 0x7f4618109fc0 2024-09-21T07:58:03.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461810f900 0x7f46181a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:03.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461810f900 0x7f46181a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38596/0 (socket says 172.21.15.84:38596) 2024-09-21T07:58:03.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 -- 172.21.15.84:0/3052226558 learned_addr learned my addr 172.21.15.84:0/3052226558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:03.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f461d800640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4618110250 0x7f46181a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 -- 172.21.15.84:0/3052226558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4618109fc0 msgr2=0x7f46181a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4618109fc0 0x7f46181a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 -- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4618110250 msgr2=0x7f46181a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4618110250 0x7f46181a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f4617e00640 1 -- 172.21.15.84:0/3052226558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46181a67a0 con 0x7f461810f900 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.826+0000 7f461d800640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4618110250 0x7f46181a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.827+0000 7f4617e00640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461810f900 0x7f46181a0e90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f460c02a910 tx=0x7f460c003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.827+0000 7f4615600640 1 -- 172.21.15.84:0/3052226558 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c03f070 con 0x7f461810f900 2024-09-21T07:58:03.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.827+0000 7f4615600640 1 -- 172.21.15.84:0/3052226558 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460c003e40 con 0x7f461810f900 2024-09-21T07:58:03.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.827+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46181a6a30 con 0x7f461810f900 2024-09-21T07:58:03.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.828+0000 7f4615600640 1 -- 172.21.15.84:0/3052226558 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c035030 con 0x7f461810f900 2024-09-21T07:58:03.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.828+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46181a6f60 con 0x7f461810f900 2024-09-21T07:58:03.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.829+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461810a3d0 con 0x7f461810f900 2024-09-21T07:58:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.834+0000 7f4615600640 1 -- 172.21.15.84:0/3052226558 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f460c042070 con 0x7f461810f900 2024-09-21T07:58:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.837+0000 7f4615600640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46000b67b0 0x7f46000b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:03.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.838+0000 7f4615600640 1 -- 172.21.15.84:0/3052226558 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f460c1084e0 con 0x7f461810f900 2024-09-21T07:58:03.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.838+0000 7f4615600640 1 -- 172.21.15.84:0/3052226558 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46181a6f60 con 0x7f461810f900 2024-09-21T07:58:03.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.841+0000 7f461ce00640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46000b67b0 0x7f46000b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:03.847+0000 7f461ce00640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46000b67b0 0x7f46000b8cc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f460400a990 tx=0x7f4604005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:03.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:03 smithi191 ceph-mon[34667]: pgmap v604: 129 pgs: 129 active+clean; 48 GiB data, 101 GiB used, 972 GiB / 1.0 TiB avail; 44 KiB/s rd, 240 MiB/s wr, 1.31k op/s 2024-09-21T07:58:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.306+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46181a1a20 con 0x7f461810f900 2024-09-21T07:58:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:58:04.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.308+0000 7f4615600640 1 -- 172.21.15.84:0/3052226558 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f46181a1a20 con 0x7f461810f900 2024-09-21T07:58:04.311 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:58:04.311 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:58:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46000b67b0 msgr2=0x7f46000b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46000b67b0 0x7f46000b8cc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f460400a990 tx=0x7f4604005c70 comp rx=0 tx=0).stop 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461810f900 msgr2=0x7f46181a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461810f900 0x7f46181a0e90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f460c02a910 tx=0x7f460c003cd0 comp rx=0 tx=0).stop 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 shutdown_connections 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f46000b67b0 0x7f46000b8cc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4618110250 0x7f46181a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461810f900 0x7f46181a0e90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.312+0000 7f461e200640 1 --2- 172.21.15.84:0/3052226558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4618109fc0 0x7f46181a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.313+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 >> 172.21.15.84:0/3052226558 conn(0x7f46180795c0 msgr2=0x7f461810de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.313+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 shutdown_connections 2024-09-21T07:58:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:04.314+0000 7f461e200640 1 -- 172.21.15.84:0/3052226558 wait complete. 2024-09-21T07:58:04.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:04 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3052226558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:04.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:04 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3052226558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:04 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3052226558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:58:05.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.178+0000 7f7fc7200640 1 -- 172.21.15.84:0/1055671453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8103910 msgr2=0x7f7fc8103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.178+0000 7f7fc7200640 1 --2- 172.21.15.84:0/1055671453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8103910 0x7f7fc8103d20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009900 tx=0x7f7fb802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.178+0000 7f7fc7200640 1 -- 172.21.15.84:0/1055671453 shutdown_connections 2024-09-21T07:58:05.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.178+0000 7f7fc7200640 1 --2- 172.21.15.84:0/1055671453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc8109b90 0x7f7fc81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.178+0000 7f7fc7200640 1 --2- 172.21.15.84:0/1055671453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc8109240 0x7f7fc8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.181 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.178+0000 7f7fc7200640 1 --2- 172.21.15.84:0/1055671453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8103910 0x7f7fc8103d20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.178+0000 7f7fc7200640 1 -- 172.21.15.84:0/1055671453 >> 172.21.15.84:0/1055671453 conn(0x7f7fc80ff330 msgr2=0x7f7fc8101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.179+0000 7f7fc7200640 1 -- 172.21.15.84:0/1055671453 shutdown_connections 2024-09-21T07:58:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.179+0000 7f7fc7200640 1 -- 172.21.15.84:0/1055671453 wait complete. 2024-09-21T07:58:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.180+0000 7f7fc7200640 1 Processor -- start 2024-09-21T07:58:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.180+0000 7f7fc7200640 1 -- start start 2024-09-21T07:58:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc7200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc8103910 0x7f7fc8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8109240 0x7f7fc8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc8109b90 0x7f7fc8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8113850 con 0x7f7fc8109b90 2024-09-21T07:58:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81136d0 con 0x7f7fc8109240 2024-09-21T07:58:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc7200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81139d0 con 0x7f7fc8103910 2024-09-21T07:58:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8109240 0x7f7fc8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc8103910 0x7f7fc8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8109240 0x7f7fc8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38602/0 (socket says 172.21.15.84:38602) 2024-09-21T07:58:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.181+0000 7f7fc5400640 1 -- 172.21.15.84:0/3956807229 learned_addr learned my addr 172.21.15.84:0/3956807229 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc6800640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc8109b90 0x7f7fc8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc5400640 1 -- 172.21.15.84:0/3956807229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc8103910 msgr2=0x7f7fc8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc5400640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc8103910 0x7f7fc8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc5400640 1 -- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc8109b90 msgr2=0x7f7fc8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc5400640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc8109b90 0x7f7fc8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc5400640 1 -- 172.21.15.84:0/3956807229 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc81a8560 con 0x7f7fc8109240 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc6800640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc8109b90 0x7f7fc8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fc5400640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8109240 0x7f7fc8075c50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000d740 tx=0x7f7fb000dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.182+0000 7f7fbea00640 1 -- 172.21.15.84:0/3956807229 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0017070 con 0x7f7fc8109240 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.183+0000 7f7fbea00640 1 -- 172.21.15.84:0/3956807229 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb000de50 con 0x7f7fc8109240 2024-09-21T07:58:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.183+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc81a8850 con 0x7f7fc8109240 2024-09-21T07:58:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.183+0000 7f7fbea00640 1 -- 172.21.15.84:0/3956807229 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000f620 con 0x7f7fc8109240 2024-09-21T07:58:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.183+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc81a8df0 con 0x7f7fc8109240 2024-09-21T07:58:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.186+0000 7f7fd41f2740 1 Processor -- start 2024-09-21T07:58:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.186+0000 7f7fd41f2740 1 -- start start 2024-09-21T07:58:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf67ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf67d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2b74d0 0x55c9cf67d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9cf5f26b0 con 0x55c9cf2af2f0 2024-09-21T07:58:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c9cf5e1ae0 con 0x55c9cf2d81b0 2024-09-21T07:58:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c9cf5e58f0 con 0x55c9cf2b74d0 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fc6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf67ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fc6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf67ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38616/0 (socket says 172.21.15.84:38616) 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fc6800640 1 -- 172.21.15.84:0/1610330756 learned_addr learned my addr 172.21.15.84:0/1610330756 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf67d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fbea00640 1 -- 172.21.15.84:0/3956807229 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7fb001a070 con 0x7f7fc8109240 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fc5400640 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2b74d0 0x55c9cf67d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.188+0000 7f7fc5e00640 1 -- 172.21.15.84:0/1610330756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2b74d0 msgr2=0x55c9cf67d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2b74d0 0x55c9cf67d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fc5e00640 1 -- 172.21.15.84:0/1610330756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 msgr2=0x55c9cf67ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf67ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fc5e00640 1 -- 172.21.15.84:0/1610330756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9cf5ae780 con 0x55c9cf2af2f0 2024-09-21T07:58:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fc5400640 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2b74d0 0x55c9cf67d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fc6800640 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf67ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf67d350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8077160 tx=0x7f7fb8032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5458b531c65e5392 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fb7400640 1 -- 172.21.15.84:0/1610330756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8040070 con 0x55c9cf2af2f0 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fb7400640 1 -- 172.21.15.84:0/1610330756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb8004030 con 0x55c9cf2af2f0 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.189+0000 7f7fb7400640 1 -- 172.21.15.84:0/1610330756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8035040 con 0x55c9cf2af2f0 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.190+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1610330756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 msgr2=0x55c9cf67d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.190+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf67d350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8077160 tx=0x7f7fb8032bd0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1610330756 shutdown_connections 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2b74d0 0x55c9cf67d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf67d350 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1610330756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf67ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1610330756 >> 172.21.15.84:0/1610330756 conn(0x55c9cf2cc300 msgr2=0x55c9cf67ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1610330756 shutdown_connections 2024-09-21T07:58:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1610330756 wait complete. 2024-09-21T07:58:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fbea00640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7fac0b6640 0x7f7fac0b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.191+0000 7f7fd41f2740 1 -- start start 2024-09-21T07:58:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.192+0000 7f7fbea00640 1 -- 172.21.15.84:0/3956807229 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f7fb00e74c0 con 0x7f7fc8109240 2024-09-21T07:58:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.192+0000 7f7fd41f2740 1 Processor -- start 2024-09-21T07:58:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.192+0000 7f7fc6800640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7fac0b6640 0x7f7fac0b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.193+0000 7f7fc6800640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7fac0b6640 0x7f7fac0b8b50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0005bf0 tx=0x7f7fc0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.193+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf6883f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.193+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf688930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.193+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2d81b0 0x55c9cf688e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.193+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9cf519ab0 con 0x55c9cf2d81b0 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.193+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c9cf588570 con 0x55c9cf2b74d0 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.193+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c9cf68b530 con 0x55c9cf2af2f0 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.194+0000 7f7fd41f2740 10 client.0 _ll_register_callbacks cb 0x55c9cf597100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.194+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf6883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.194+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf6883f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50400/0 (socket says 172.21.15.84:50400) 2024-09-21T07:58:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.194+0000 7f7fc5e00640 1 -- 172.21.15.84:0/2993316478 learned_addr learned my addr 172.21.15.84:0/2993316478 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.194+0000 7f7fc5400640 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf688930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.194+0000 7f7fc6800640 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2d81b0 0x55c9cf688e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.195+0000 7f7fc5e00640 1 -- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 msgr2=0x55c9cf688930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.195+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf688930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.195+0000 7f7fc5e00640 1 -- 172.21.15.84:0/2993316478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2d81b0 msgr2=0x55c9cf688e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.195+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2d81b0 0x55c9cf688e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.195+0000 7f7fc5e00640 1 -- 172.21.15.84:0/2993316478 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9cf343790 con 0x55c9cf2af2f0 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.195+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf6883f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7fb802a430 tx=0x7f7fb8005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14bc48f858009a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.195+0000 7f7fabe00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.196+0000 7f7fabe00640 1 -- 172.21.15.84:0/2993316478 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8035070 con 0x55c9cf2af2f0 2024-09-21T07:58:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.196+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb8004030 con 0x55c9cf2af2f0 2024-09-21T07:58:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.197+0000 7f7fabe00640 1 -- 172.21.15.84:0/2993316478 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f7fb8005460 con 0x55c9cf2af2f0 2024-09-21T07:58:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.197+0000 7f7fabe00640 1 -- 172.21.15.84:0/2993316478 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7fb8040040 con 0x55c9cf2af2f0 2024-09-21T07:58:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.197+0000 7f7fd41f2740 10 client.27388 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.197+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9cf3bc620 con 0x55c9cf2af2f0 2024-09-21T07:58:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fabe00640 1 -- 172.21.15.84:0/2993316478 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb8004030 con 0x55c9cf2af2f0 2024-09-21T07:58:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fabe00640 1 -- 172.21.15.84:0/2993316478 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7fb8004c20 con 0x55c9cf2af2f0 2024-09-21T07:58:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fd41f2740 10 client.27388 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fd41f2740 10 client.27388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fd41f2740 20 client.27388 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf296d80 0x55c9cf69a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fd41f2740 4 client.27388 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.198+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9cf5f4600 con 0x55c9cf296d80 2024-09-21T07:58:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.204+0000 7f7fc5400640 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf296d80 0x55c9cf69a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.208+0000 7f7fc5400640 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf296d80 0x55c9cf69a280 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aba8d81105636f2 server_cookie=7bca7c8966442378 in_seq=0 out_seq=0 2024-09-21T07:58:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.208+0000 7f7fabe00640 10 client.27388 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.209+0000 7f7fabe00640 1 -- 172.21.15.84:0/2993316478 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9cf5f4600 con 0x55c9cf296d80 2024-09-21T07:58:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.209+0000 7f7fabe00640 10 client.27388 handle_command_reply: tid=0 2024-09-21T07:58:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.209+0000 7f7fd41f2740 1 client.27388 shutdown 2024-09-21T07:58:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 msgr2=0x55c9cf6883f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf6883f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7fb802a430 tx=0x7f7fb8005e20 comp rx=0 tx=0).stop 2024-09-21T07:58:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 shutdown_connections 2024-09-21T07:58:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2d81b0 0x55c9cf688e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf688930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf296d80 0x55c9cf69a280 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/2993316478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf6883f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 >> 172.21.15.84:0/2993316478 conn(0x55c9cf2cc300 msgr2=0x55c9cf67de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fabe00640 0 client.27388 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 shutdown_connections 2024-09-21T07:58:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 1 -- 172.21.15.84:0/2993316478 wait complete. 2024-09-21T07:58:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.210+0000 7f7fd41f2740 20 client.27388 trim_cache size 0 max 16384 2024-09-21T07:58:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.229+0000 7f7fd41f2740 1 Processor -- start 2024-09-21T07:58:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.229+0000 7f7fd41f2740 1 -- start start 2024-09-21T07:58:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.229+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf679a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.229+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf6855e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2d81b0 0x55c9cf685b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81b2ec0 con 0x55c9cf2af2f0 2024-09-21T07:58:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81b4a00 con 0x55c9cf2b74d0 2024-09-21T07:58:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81b3590 con 0x55c9cf2d81b0 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf679a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf6855e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf679a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52504/0 (socket says 172.21.15.84:52504) 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5e00640 1 -- 172.21.15.84:0/1650278485 learned_addr learned my addr 172.21.15.84:0/1650278485 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc6800640 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2d81b0 0x55c9cf685b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5400640 1 -- 172.21.15.84:0/1650278485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2d81b0 msgr2=0x55c9cf685b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5400640 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2d81b0 0x55c9cf685b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5400640 1 -- 172.21.15.84:0/1650278485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 msgr2=0x55c9cf679a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5400640 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf679a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.230+0000 7f7fc5400640 1 -- 172.21.15.84:0/1650278485 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9cf6868f0 con 0x55c9cf2b74d0 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.231+0000 7f7fc6800640 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2d81b0 0x55c9cf685b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.231+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf679a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.232+0000 7f7fc5400640 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf6855e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00e4820 tx=0x7f7fb00d0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba13631bb570783 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.232+0000 7f7fb6a00640 1 -- 172.21.15.84:0/1650278485 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0021040 con 0x55c9cf2b74d0 2024-09-21T07:58:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.232+0000 7f7fb6a00640 1 -- 172.21.15.84:0/1650278485 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb00b1a00 con 0x55c9cf2b74d0 2024-09-21T07:58:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.232+0000 7f7fb6a00640 1 -- 172.21.15.84:0/1650278485 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00a9320 con 0x55c9cf2b74d0 2024-09-21T07:58:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.233+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1650278485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 msgr2=0x55c9cf6855e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.233+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf6855e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00e4820 tx=0x7f7fb00d0040 comp rx=0 tx=0).stop 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.233+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1650278485 shutdown_connections 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.233+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2d81b0 0x55c9cf685b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.233+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2b74d0 0x55c9cf6855e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.233+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/1650278485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2af2f0 0x55c9cf679a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.233+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1650278485 >> 172.21.15.84:0/1650278485 conn(0x55c9cf2cc300 msgr2=0x55c9cf679360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.234+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1650278485 shutdown_connections 2024-09-21T07:58:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.234+0000 7f7fd41f2740 1 -- 172.21.15.84:0/1650278485 wait complete. 2024-09-21T07:58:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.234+0000 7f7fd41f2740 1 -- start start 2024-09-21T07:58:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.235+0000 7f7fd41f2740 1 Processor -- start 2024-09-21T07:58:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.235+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf69d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.235+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2b74d0 0x55c9cf69d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.235+0000 7f7fd41f2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf6f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.235+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81b4330 con 0x55c9cf2b74d0 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.235+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81b3c60 con 0x55c9cf2d81b0 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.235+0000 7f7fd41f2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc81b0f10 con 0x55c9cf2af2f0 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fd41f2740 10 client.0 _ll_register_callbacks cb 0x7f7fc0009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf69d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf69d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50420/0 (socket says 172.21.15.84:50420) 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 -- 172.21.15.84:0/3370493653 learned_addr learned my addr 172.21.15.84:0/3370493653 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc6800640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf6f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5400640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2b74d0 0x55c9cf69d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 -- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 msgr2=0x55c9cf6f9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf6f9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 -- 172.21.15.84:0/3370493653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2b74d0 msgr2=0x55c9cf69d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2b74d0 0x55c9cf69d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5e00640 1 -- 172.21.15.84:0/3370493653 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9cf6fa2e0 con 0x55c9cf2af2f0 2024-09-21T07:58:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.236+0000 7f7fc5400640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2b74d0 0x55c9cf69d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.237+0000 7f7fc5e00640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf69d170 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8003a60 tx=0x7f7fb8005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ebf55d6ac740d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.237+0000 7f7fabe00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.237+0000 7f7fabe00640 1 -- 172.21.15.84:0/3370493653 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8035040 con 0x55c9cf2af2f0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.237+0000 7f7fabe00640 1 -- 172.21.15.84:0/3370493653 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f7fb8005390 con 0x55c9cf2af2f0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.238+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb00b1a00 con 0x55c9cf2af2f0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.238+0000 7f7fabe00640 1 -- 172.21.15.84:0/3370493653 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7fb8005590 con 0x55c9cf2af2f0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.238+0000 7f7fd41f2740 10 client.27394 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.238+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9cf7048b0 con 0x55c9cf2af2f0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.238+0000 7f7fabe00640 1 -- 172.21.15.84:0/3370493653 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb00b1a00 con 0x55c9cf2af2f0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fabe00640 1 -- 172.21.15.84:0/3370493653 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7fb8004a20 con 0x55c9cf2af2f0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fd41f2740 10 client.27394 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fd41f2740 10 client.27394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fd41f2740 20 client.27394 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf26c1c0 0x55c9cf7070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fd41f2740 4 client.27394 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9cf5f00b0 con 0x55c9cf26c1c0 2024-09-21T07:58:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.239+0000 7f7fc5400640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf26c1c0 0x55c9cf7070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.240+0000 7f7fc5400640 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf26c1c0 0x55c9cf7070a0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69040892eb8f6775 server_cookie=5fef22ba99e7240f in_seq=0 out_seq=0 2024-09-21T07:58:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.240+0000 7f7fabe00640 10 client.27394 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fabe00640 1 -- 172.21.15.84:0/3370493653 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9cf5f00b0 con 0x55c9cf26c1c0 2024-09-21T07:58:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fabe00640 10 client.27394 handle_command_reply: tid=0 2024-09-21T07:58:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 client.27394 shutdown 2024-09-21T07:58:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 msgr2=0x55c9cf69d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf69d170 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8003a60 tx=0x7f7fb8005db0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 shutdown_connections 2024-09-21T07:58:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c9cf2d81b0 0x55c9cf6f9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9cf2b74d0 0x55c9cf69d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55c9cf26c1c0 0x55c9cf7070a0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.493+0000 7f7fd41f2740 1 --2- 172.21.15.84:0/3370493653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c9cf2af2f0 0x55c9cf69d170 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.494+0000 7f7fabe00640 0 client.27394 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.494+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 >> 172.21.15.84:0/3370493653 conn(0x55c9cf2cc300 msgr2=0x55c9cf67de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.494+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 shutdown_connections 2024-09-21T07:58:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.494+0000 7f7fd41f2740 1 -- 172.21.15.84:0/3370493653 wait complete. 2024-09-21T07:58:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.495+0000 7f7fd41f2740 20 client.27394 trim_cache size 0 max 16384 2024-09-21T07:58:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:58:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:58:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:58:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7fac0b6640 msgr2=0x7f7fac0b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7fac0b6640 0x7f7fac0b8b50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0005bf0 tx=0x7f7fc0009500 comp rx=0 tx=0).stop 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8109240 msgr2=0x7f7fc8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8109240 0x7f7fc8075c50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000d740 tx=0x7f7fb000dc00 comp rx=0 tx=0).stop 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 shutdown_connections 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7fac0b6640 0x7f7fac0b8b50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc8109b90 0x7f7fc8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8109240 0x7f7fc8075c50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.496+0000 7f7fc7200640 1 --2- 172.21.15.84:0/3956807229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc8103910 0x7f7fc8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.497+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 >> 172.21.15.84:0/3956807229 conn(0x7f7fc80ff330 msgr2=0x7f7fc8101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.502+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 shutdown_connections 2024-09-21T07:58:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:05.502+0000 7f7fc7200640 1 -- 172.21.15.84:0/3956807229 wait complete. 2024-09-21T07:58:05.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:05 smithi162 ceph-mon[34833]: pgmap v605: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 41 KiB/s rd, 244 MiB/s wr, 1.40k op/s 2024-09-21T07:58:05.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:05 smithi084 ceph-mon[30411]: pgmap v605: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 41 KiB/s rd, 244 MiB/s wr, 1.40k op/s 2024-09-21T07:58:05.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:05 smithi191 ceph-mon[34667]: pgmap v605: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 41 KiB/s rd, 244 MiB/s wr, 1.40k op/s 2024-09-21T07:58:06.471 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id e7a3bb18 --release --await' 2024-09-21T07:58:06.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id e7a3bb18 --release --await 2024-09-21T07:58:06.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.397+0000 7f5306600640 1 -- 172.21.15.84:0/2899403703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f8095030 msgr2=0x7f52f8095440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.397+0000 7f5306600640 1 --2- 172.21.15.84:0/2899403703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f8095030 0x7f52f8095440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009900 tx=0x7f52f402a440 comp rx=0 tx=0).stop 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.400+0000 7f5306600640 1 -- 172.21.15.84:0/2899403703 shutdown_connections 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.400+0000 7f5306600640 1 --2- 172.21.15.84:0/2899403703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f809b2c0 0x7f52f80a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.400+0000 7f5306600640 1 --2- 172.21.15.84:0/2899403703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52f809a970 0x7f52f809ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.400+0000 7f5306600640 1 --2- 172.21.15.84:0/2899403703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f8095030 0x7f52f8095440 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.400+0000 7f5306600640 1 -- 172.21.15.84:0/2899403703 >> 172.21.15.84:0/2899403703 conn(0x7f52f800cd80 msgr2=0x7f52f800d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.401+0000 7f5306600640 1 -- 172.21.15.84:0/2899403703 shutdown_connections 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.401+0000 7f5306600640 1 -- 172.21.15.84:0/2899403703 wait complete. 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.402+0000 7f5306600640 1 Processor -- start 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.405+0000 7f5306600640 1 -- start start 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.406+0000 7f5306600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f8095030 0x7f52f813fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.406+0000 7f5306600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f809a970 0x7f52f81401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.406+0000 7f5306600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52f809b2c0 0x7f52f8145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f5305200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f8095030 0x7f52f813fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f5305200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f8095030 0x7f52f813fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38652/0 (socket says 172.21.15.84:38652) 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f52ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f809a970 0x7f52f81401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f5305c00640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52f809b2c0 0x7f52f8145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f5305200640 1 -- 172.21.15.84:0/3532944535 learned_addr learned my addr 172.21.15.84:0/3532944535 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52f80a3ec0 con 0x7f52f809b2c0 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52f80a3d40 con 0x7f52f8095030 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.407+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f52f80a4040 con 0x7f52f809a970 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.409+0000 7f5305200640 1 -- 172.21.15.84:0/3532944535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f809a970 msgr2=0x7f52f81401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.409+0000 7f5305200640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f809a970 0x7f52f81401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.409+0000 7f5305200640 1 -- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52f809b2c0 msgr2=0x7f52f8145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.409+0000 7f5305200640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52f809b2c0 0x7f52f8145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.409+0000 7f5305200640 1 -- 172.21.15.84:0/3532944535 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f813f760 con 0x7f52f8095030 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.409+0000 7f5305c00640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52f809b2c0 0x7f52f8145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:06.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.409+0000 7f52ffe00640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f809a970 0x7f52f81401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.410+0000 7f5305200640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f8095030 0x7f52f813fc50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f52f4000c00 tx=0x7f52f4003e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.410+0000 7f52fd600640 1 -- 172.21.15.84:0/3532944535 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4040030 con 0x7f52f8095030 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.411+0000 7f52fd600640 1 -- 172.21.15.84:0/3532944535 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52f4004210 con 0x7f52f8095030 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.411+0000 7f52fd600640 1 -- 172.21.15.84:0/3532944535 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40317d0 con 0x7f52f8095030 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.411+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f8145a90 con 0x7f52f8095030 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.411+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f8145ef0 con 0x7f52f8095030 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.424+0000 7f52fd600640 1 -- 172.21.15.84:0/3532944535 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f52f4043030 con 0x7f52f8095030 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.429+0000 7f52fd600640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52e80b6810 0x7f52e80b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.430+0000 7f52fd600640 1 -- 172.21.15.84:0/3532944535 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f52f4109080 con 0x7f52f8095030 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:05.432+0000 7f52ffe00640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52e80b6810 0x7f52e80b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.105+0000 7f52ffe00640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52e80b6810 0x7f52e80b8d20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52f809a620 tx=0x7f52ec00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.107+0000 7f530e831740 1 Processor -- start 2024-09-21T07:58:06.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.107+0000 7f530e831740 1 -- start start 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.107+0000 7f530e831740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772164f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.107+0000 7f530e831740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.107+0000 7f530e831740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x5577721659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f5305200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f5305200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772164f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50442/0 (socket says 172.21.15.84:50442) 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f5305c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x5577721659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f5305c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x5577721659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52532/0 (socket says 172.21.15.84:52532) 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f52ffe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f52ffe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38668/0 (socket says 172.21.15.84:38668) 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f5305200640 1 -- 172.21.15.84:0/182560219 learned_addr learned my addr 172.21.15.84:0/182560219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577720dbfb0 con 0x557771d9d390 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.108+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5577720cb3e0 con 0x557771d951b0 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.109+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5577720cf1f0 con 0x557771dbe070 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.110+0000 7f5305c00640 1 -- 172.21.15.84:0/182560219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 msgr2=0x557772164f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.110+0000 7f5305c00640 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772164f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.110+0000 7f5305c00640 1 -- 172.21.15.84:0/182560219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 msgr2=0x5577721654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.110+0000 7f5305c00640 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.110+0000 7f5305c00640 1 -- 172.21.15.84:0/182560219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557772095cd0 con 0x557771d9d390 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.112+0000 7f5305200640 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772164f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.113+0000 7f5305c00640 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x5577721659f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5300069e80 tx=0x7f5300064940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe6659efecc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.114+0000 7f52f2000640 1 -- 172.21.15.84:0/182560219 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530006adc0 con 0x557771d9d390 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.114+0000 7f52f2000640 1 -- 172.21.15.84:0/182560219 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f530007f8d0 con 0x557771d9d390 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.114+0000 7f52f2000640 1 -- 172.21.15.84:0/182560219 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300075820 con 0x557771d9d390 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.115+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 msgr2=0x5577721659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.115+0000 7f530e831740 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x5577721659f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5300069e80 tx=0x7f5300064940 comp rx=0 tx=0).stop 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.116+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 shutdown_connections 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.116+0000 7f530e831740 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x5577721659f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.116+0000 7f530e831740 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.116+0000 7f530e831740 1 --2- 172.21.15.84:0/182560219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772164f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.116+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 >> 172.21.15.84:0/182560219 conn(0x557771db2460 msgr2=0x557772162e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.116+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 shutdown_connections 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.116+0000 7f530e831740 1 -- 172.21.15.84:0/182560219 wait complete. 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.117+0000 7f530e831740 1 -- start start 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.117+0000 7f530e831740 1 Processor -- start 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f530e831740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d951b0 0x557772170710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f530e831740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x557772170c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f530e831740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771dbe070 0x55777217caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f530e831740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557771f2c700 con 0x557771d951b0 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f530e831740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557772066580 con 0x557771dbe070 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f530e831740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557772173750 con 0x557771d9d390 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f530e831740 10 client.0 _ll_register_callbacks cb 0x557772076470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:06.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f52ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x557772170c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f52ffe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x557772170c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50448/0 (socket says 172.21.15.84:50448) 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f5305200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d951b0 0x557772170710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.118+0000 7f52ffe00640 1 -- 172.21.15.84:0/2785378490 learned_addr learned my addr 172.21.15.84:0/2785378490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f5305c00640 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771dbe070 0x55777217caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f52ffe00640 1 -- 172.21.15.84:0/2785378490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771dbe070 msgr2=0x55777217caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f52ffe00640 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771dbe070 0x55777217caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f52ffe00640 1 -- 172.21.15.84:0/2785378490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d951b0 msgr2=0x557772170710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f52ffe00640 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d951b0 0x557772170710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f52ffe00640 1 -- 172.21.15.84:0/2785378490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557771e29650 con 0x557771d9d390 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f5305c00640 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771dbe070 0x55777217caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f52e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.119+0000 7f52ffe00640 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x557772170c50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f52f8008810 tx=0x7f52ec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=370bd58077ad3468 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.120+0000 7f52e6a00640 1 -- 172.21.15.84:0/2785378490 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec004020 con 0x557771d9d390 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.120+0000 7f52e6a00640 1 -- 172.21.15.84:0/2785378490 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f52ec0041c0 con 0x557771d9d390 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.120+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557772068b90 con 0x557771d9d390 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f52e6a00640 1 -- 172.21.15.84:0/2785378490 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52ec0043c0 con 0x557771d9d390 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f530e831740 10 client.27403 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557772083950 con 0x557771d9d390 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f52e6a00640 1 -- 172.21.15.84:0/2785378490 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557772068b90 con 0x557771d9d390 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f52e6a00640 1 -- 172.21.15.84:0/2785378490 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f52ec026070 con 0x557771d9d390 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f530e831740 10 client.27403 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f530e831740 10 client.27403 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f530e831740 20 client.27403 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f530e831740 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d7c9f0 0x557772182a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.121+0000 7f530e831740 4 client.27403 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.122+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577720ddf00 con 0x557771d7c9f0 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.122+0000 7f5305200640 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d7c9f0 0x557772182a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.122+0000 7f52e6a00640 10 client.27403 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.122+0000 7f5305200640 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d7c9f0 0x557772182a20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7c9826cd5fd827f3 server_cookie=233ba169b2d91ea in_seq=0 out_seq=0 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.123+0000 7f52e6a00640 1 -- 172.21.15.84:0/2785378490 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577720ddf00 con 0x557771d7c9f0 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.123+0000 7f52e6a00640 10 client.27403 handle_command_reply: tid=0 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.123+0000 7f530e831740 1 client.27403 shutdown 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 msgr2=0x557772170c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x557772170c50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f52f8008810 tx=0x7f52ec004730 comp rx=0 tx=0).stop 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 shutdown_connections 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d7c9f0 0x557772182a20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771dbe070 0x55777217caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x557772170c50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 --2- 172.21.15.84:0/2785378490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d951b0 0x557772170710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f52e6a00640 0 client.27403 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 >> 172.21.15.84:0/2785378490 conn(0x557771db2460 msgr2=0x557772168100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 shutdown_connections 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 1 -- 172.21.15.84:0/2785378490 wait complete. 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.124+0000 7f530e831740 20 client.27403 trim_cache size 0 max 16384 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.151+0000 7f530e831740 1 Processor -- start 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.151+0000 7f530e831740 1 -- start start 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f530e831740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f530e831740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x5577721666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f530e831740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771dbe070 0x557772162610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f530e831740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52e000fec0 con 0x557771dbe070 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f530e831740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0011a00 con 0x557771d951b0 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f530e831740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0010590 con 0x557771d9d390 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f5305200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.152+0000 7f5305200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721725f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38684/0 (socket says 172.21.15.84:38684) 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f5305c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771dbe070 0x557772162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f5305200640 1 -- 172.21.15.84:0/80499076 learned_addr learned my addr 172.21.15.84:0/80499076 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f52ffe00640 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x5577721666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f5305200640 1 -- 172.21.15.84:0/80499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 msgr2=0x5577721666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f5305200640 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x5577721666b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f5305200640 1 -- 172.21.15.84:0/80499076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771dbe070 msgr2=0x557772162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f5305200640 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771dbe070 0x557772162610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.153+0000 7f5305200640 1 -- 172.21.15.84:0/80499076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577721717b0 con 0x557771d951b0 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.154+0000 7f5305200640 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721725f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52f40ce420 tx=0x7f52f402a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f8fe5c9a26993e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.154+0000 7f52f1600640 1 -- 172.21.15.84:0/80499076 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f404a040 con 0x557771d951b0 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.154+0000 7f52f1600640 1 -- 172.21.15.84:0/80499076 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52f40d3620 con 0x557771d951b0 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.154+0000 7f52f1600640 1 -- 172.21.15.84:0/80499076 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40d80d0 con 0x557771d951b0 2024-09-21T07:58:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 -- 172.21.15.84:0/80499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 msgr2=0x5577721725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721725f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52f40ce420 tx=0x7f52f402a440 comp rx=0 tx=0).stop 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 -- 172.21.15.84:0/80499076 shutdown_connections 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771dbe070 0x557772162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771d9d390 0x5577721666b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 --2- 172.21.15.84:0/80499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x5577721725f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 -- 172.21.15.84:0/80499076 >> 172.21.15.84:0/80499076 conn(0x557771db2460 msgr2=0x557772165fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 -- 172.21.15.84:0/80499076 shutdown_connections 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.155+0000 7f530e831740 1 -- 172.21.15.84:0/80499076 wait complete. 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.156+0000 7f530e831740 1 -- start start 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.156+0000 7f530e831740 1 Processor -- start 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.156+0000 7f530e831740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x557772179230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.156+0000 7f530e831740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x557772176700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f530e831740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772176c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f530e831740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0011330 con 0x557771d9d390 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f530e831740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0010c60 con 0x557771d951b0 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f530e831740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f52e000dec0 con 0x557771dbe070 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f530e831740 10 client.0 _ll_register_callbacks cb 0x7f52ec011750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x557772179230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x557772179230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38700/0 (socket says 172.21.15.84:38700) 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 -- 172.21.15.84:0/3225041862 learned_addr learned my addr 172.21.15.84:0/3225041862 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f52ffe00640 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x557772176700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 -- 172.21.15.84:0/3225041862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 msgr2=0x557772176c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772176c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 -- 172.21.15.84:0/3225041862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 msgr2=0x557772176700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x557772176700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.157+0000 7f5305200640 1 -- 172.21.15.84:0/3225041862 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557772177410 con 0x557771d951b0 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.158+0000 7f5305200640 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x557772179230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f52f4109050 tx=0x7f52f402a940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8518d979b07a5db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.158+0000 7f52e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.158+0000 7f52e6a00640 1 -- 172.21.15.84:0/3225041862 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f404a040 con 0x557771d951b0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.158+0000 7f52e6a00640 1 -- 172.21.15.84:0/3225041862 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9432+0+0 (secure 0 0 0) 0x7f52f40cadb0 con 0x557771d951b0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.159+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52f40d3620 con 0x557771d951b0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.160+0000 7f52e6a00640 1 -- 172.21.15.84:0/3225041862 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52f407e0d0 con 0x557771d951b0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.160+0000 7f530e831740 10 client.27410 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.160+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55777220f3c0 con 0x557771d951b0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.160+0000 7f52e6a00640 1 -- 172.21.15.84:0/3225041862 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52f40d3620 con 0x557771d951b0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.161+0000 7f52e6a00640 1 -- 172.21.15.84:0/3225041862 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f52f4106c90 con 0x557771d951b0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.161+0000 7f530e831740 10 client.27410 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.161+0000 7f530e831740 10 client.27410 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.161+0000 7f530e831740 20 client.27410 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.161+0000 7f530e831740 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d51da0 0x557772211aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.161+0000 7f530e831740 4 client.27410 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.161+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577720d99b0 con 0x557771d51da0 2024-09-21T07:58:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.163+0000 7f52ffe00640 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d51da0 0x557772211aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.165+0000 7f52ffe00640 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d51da0 0x557772211aa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c259d84427a6244 server_cookie=6fb25fd0909baf2 in_seq=0 out_seq=0 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.165+0000 7f52e6a00640 10 client.27410 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.165+0000 7f52e6a00640 1 -- 172.21.15.84:0/3225041862 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577720d99b0 con 0x557771d51da0 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.165+0000 7f52e6a00640 10 client.27410 handle_command_reply: tid=0 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 client.27410 shutdown 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 msgr2=0x557772179230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x557772179230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f52f4109050 tx=0x7f52f402a940 comp rx=0 tx=0).stop 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 shutdown_connections 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x557771d51da0 0x557772211aa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557771dbe070 0x557772176c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557771d9d390 0x557772176700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 --2- 172.21.15.84:0/3225041862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557771d951b0 0x557772179230 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 >> 172.21.15.84:0/3225041862 conn(0x557771db2460 msgr2=0x5577721666c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f52e6a00640 0 client.27410 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.166+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 shutdown_connections 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.167+0000 7f530e831740 1 -- 172.21.15.84:0/3225041862 wait complete. 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.167+0000 7f530e831740 20 client.27410 trim_cache size 0 max 16384 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52e80b6810 msgr2=0x7f52e80b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52e80b6810 0x7f52e80b8d20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52f809a620 tx=0x7f52ec00b390 comp rx=0 tx=0).stop 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f8095030 msgr2=0x7f52f813fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f8095030 0x7f52f813fc50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f52f4000c00 tx=0x7f52f4003e90 comp rx=0 tx=0).stop 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 shutdown_connections 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52e80b6810 0x7f52e80b8d20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52f809b2c0 0x7f52f8145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52f809a970 0x7f52f81401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 --2- 172.21.15.84:0/3532944535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52f8095030 0x7f52f813fc50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 >> 172.21.15.84:0/3532944535 conn(0x7f52f800cd80 msgr2=0x7f52f8098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 shutdown_connections 2024-09-21T07:58:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:06.168+0000 7f5306600640 1 -- 172.21.15.84:0/3532944535 wait complete. 2024-09-21T07:58:07.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:58:07.440 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:07.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:07 smithi084 ceph-mon[30411]: pgmap v606: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 50 KiB/s rd, 225 MiB/s wr, 1.37k op/s 2024-09-21T07:58:07.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:07 smithi162 ceph-mon[34833]: pgmap v606: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 50 KiB/s rd, 225 MiB/s wr, 1.37k op/s 2024-09-21T07:58:07.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:07 smithi191 ceph-mon[34667]: pgmap v606: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 971 GiB / 1.0 TiB avail; 50 KiB/s rd, 225 MiB/s wr, 1.37k op/s 2024-09-21T07:58:08.332 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 -- 172.21.15.84:0/8460314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81039b0 msgr2=0x7f7ca8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 --2- 172.21.15.84:0/8460314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81039b0 0x7f7ca8103dc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009900 tx=0x7f7c9802a410 comp rx=0 tx=0).stop 2024-09-21T07:58:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 -- 172.21.15.84:0/8460314 shutdown_connections 2024-09-21T07:58:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 --2- 172.21.15.84:0/8460314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca8109c40 0x7f7ca8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 --2- 172.21.15.84:0/8460314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca81092f0 0x7f7ca8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 --2- 172.21.15.84:0/8460314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81039b0 0x7f7ca8103dc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 -- 172.21.15.84:0/8460314 >> 172.21.15.84:0/8460314 conn(0x7f7ca80ff440 msgr2=0x7f7ca8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.377+0000 7f7cad000640 1 -- 172.21.15.84:0/8460314 shutdown_connections 2024-09-21T07:58:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.378+0000 7f7cad000640 1 -- 172.21.15.84:0/8460314 wait complete. 2024-09-21T07:58:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.378+0000 7f7cad000640 1 Processor -- start 2024-09-21T07:58:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7cad000640 1 -- start start 2024-09-21T07:58:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7cad000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca81039b0 0x7f7ca819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7cad000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81092f0 0x7f7ca819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7cad000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca8109c40 0x7f7ca81a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7cad000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8113900 con 0x7f7ca81039b0 2024-09-21T07:58:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7cad000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8113780 con 0x7f7ca81092f0 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7cad000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8113a80 con 0x7f7ca8109c40 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca81039b0 0x7f7ca819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7ca6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81092f0 0x7f7ca819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca81039b0 0x7f7ca819c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50818/0 (socket says 172.21.15.84:50818) 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7ca7400640 1 -- 172.21.15.84:0/1138672776 learned_addr learned my addr 172.21.15.84:0/1138672776 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.379+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca8109c40 0x7f7ca81a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7ca7400640 1 -- 172.21.15.84:0/1138672776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca8109c40 msgr2=0x7f7ca81a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7ca7400640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca8109c40 0x7f7ca81a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7ca7400640 1 -- 172.21.15.84:0/1138672776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81092f0 msgr2=0x7f7ca819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7ca7400640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81092f0 0x7f7ca819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7ca7400640 1 -- 172.21.15.84:0/1138672776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca81a24c0 con 0x7f7ca81039b0 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81092f0 0x7f7ca819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7ca7400640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca81039b0 0x7f7ca819c550 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c98005940 tx=0x7f7c980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:09.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.380+0000 7f7c9fe00640 1 -- 172.21.15.84:0/1138672776 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9803f030 con 0x7f7ca81039b0 2024-09-21T07:58:09.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.381+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca81a2750 con 0x7f7ca81039b0 2024-09-21T07:58:09.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.381+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca81a8f10 con 0x7f7ca81039b0 2024-09-21T07:58:09.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.381+0000 7f7c9fe00640 1 -- 172.21.15.84:0/1138672776 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c980044c0 con 0x7f7ca81039b0 2024-09-21T07:58:09.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.381+0000 7f7c9fe00640 1 -- 172.21.15.84:0/1138672776 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98035070 con 0x7f7ca81039b0 2024-09-21T07:58:09.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.385+0000 7f7c9fe00640 1 -- 172.21.15.84:0/1138672776 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7c98042030 con 0x7f7ca81039b0 2024-09-21T07:58:09.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.386+0000 7f7c9fe00640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7c8c0b6700 0x7f7c8c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.386+0000 7f7c9fe00640 1 -- 172.21.15.84:0/1138672776 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9520+0+0 (secure 0 0 0) 0x7f7c98107c40 con 0x7f7ca81039b0 2024-09-21T07:58:09.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.386+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7c8c0b6700 0x7f7c8c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.387+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7c8c0b6700 0x7f7c8c0b8c10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8108e90 tx=0x7f7c94005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.396+0000 7f7cb52c1740 1 Processor -- start 2024-09-21T07:58:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.397+0000 7f7cb52c1740 1 -- start start 2024-09-21T07:58:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.397+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ede520 0x5559b7285340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.397+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 0x5559b7285880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.397+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7285dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.397+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5559b71fc290 con 0x5559b6eb5660 2024-09-21T07:58:09.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.397+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5559b71eb6c0 con 0x5559b6ebd840 2024-09-21T07:58:09.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.397+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5559b71ef4d0 con 0x5559b6ede520 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.398+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ede520 0x5559b7285340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.398+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ede520 0x5559b7285340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37064/0 (socket says 172.21.15.84:37064) 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.398+0000 7f7ca7400640 1 -- 172.21.15.84:0/2352329330 learned_addr learned my addr 172.21.15.84:0/2352329330 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.399+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7285dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.400+0000 7f7ca7e00640 1 -- 172.21.15.84:0/2352329330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ede520 msgr2=0x5559b7285340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.400+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ede520 0x5559b7285340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.400+0000 7f7ca7e00640 1 -- 172.21.15.84:0/2352329330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 msgr2=0x5559b7285880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.400+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 0x5559b7285880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.400+0000 7f7ca7e00640 1 -- 172.21.15.84:0/2352329330 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b7178460 con 0x5559b6ebd840 2024-09-21T07:58:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.404+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7285dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009f00 tx=0x7f7ca0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd6aa4f693418802 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.405+0000 7f7c9cc00640 1 -- 172.21.15.84:0/2352329330 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0004d20 con 0x5559b6ebd840 2024-09-21T07:58:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.405+0000 7f7c9cc00640 1 -- 172.21.15.84:0/2352329330 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca0004030 con 0x5559b6ebd840 2024-09-21T07:58:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.405+0000 7f7c9cc00640 1 -- 172.21.15.84:0/2352329330 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0005280 con 0x5559b6ebd840 2024-09-21T07:58:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.406+0000 7f7cb52c1740 1 -- 172.21.15.84:0/2352329330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 msgr2=0x5559b7285dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.406+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7285dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009f00 tx=0x7f7ca0011810 comp rx=0 tx=0).stop 2024-09-21T07:58:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.407+0000 7f7cb52c1740 1 -- 172.21.15.84:0/2352329330 shutdown_connections 2024-09-21T07:58:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.407+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7285dc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.407+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 0x5559b7285880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.407+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/2352329330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ede520 0x5559b7285340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.407+0000 7f7cb52c1740 1 -- 172.21.15.84:0/2352329330 >> 172.21.15.84:0/2352329330 conn(0x5559b6ed2910 msgr2=0x5559b7283230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.409+0000 7f7cb52c1740 1 -- 172.21.15.84:0/2352329330 shutdown_connections 2024-09-21T07:58:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.409+0000 7f7cb52c1740 1 -- 172.21.15.84:0/2352329330 wait complete. 2024-09-21T07:58:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.410+0000 7f7cb52c1740 1 -- start start 2024-09-21T07:58:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.411+0000 7f7cb52c1740 1 Processor -- start 2024-09-21T07:58:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b7290f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7291470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ede520 0x5559b72a5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5559b704cbb0 con 0x5559b6ede520 2024-09-21T07:58:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5559b71866c0 con 0x5559b6ebd840 2024-09-21T07:58:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5559b7293b70 con 0x5559b6eb5660 2024-09-21T07:58:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7cb52c1740 10 client.0 _ll_register_callbacks cb 0x5559b71a1490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b7290f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b7290f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37066/0 (socket says 172.21.15.84:37066) 2024-09-21T07:58:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7ca7400640 1 -- 172.21.15.84:0/925813566 learned_addr learned my addr 172.21.15.84:0/925813566 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ede520 0x5559b72a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.413+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7291470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7ca7400640 1 -- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 msgr2=0x5559b7291470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7ca7400640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7291470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7ca7400640 1 -- 172.21.15.84:0/925813566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ede520 msgr2=0x5559b72a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7ca7400640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ede520 0x5559b72a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7ca7400640 1 -- 172.21.15.84:0/925813566 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b6f49b00 con 0x5559b6eb5660 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ede520 0x5559b72a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7ca7400640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b7290f30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c98032af0 tx=0x7f7c980cd130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=265ee972a8e5bd41 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7c91600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.414+0000 7f7c91600640 1 -- 172.21.15.84:0/925813566 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c980b4e60 con 0x5559b6eb5660 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.415+0000 7f7c91600640 1 -- 172.21.15.84:0/925813566 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9520+0+0 (secure 0 0 0) 0x7f7c980d6e00 con 0x5559b6eb5660 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.415+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca0004030 con 0x5559b6eb5660 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.415+0000 7f7c91600640 1 -- 172.21.15.84:0/925813566 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7c98049070 con 0x5559b6eb5660 2024-09-21T07:58:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.415+0000 7f7cb52c1740 10 client.27418 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.415+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5559b6fc0960 con 0x5559b6eb5660 2024-09-21T07:58:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.415+0000 7f7c91600640 1 -- 172.21.15.84:0/925813566 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca0004030 con 0x5559b6eb5660 2024-09-21T07:58:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7c91600640 1 -- 172.21.15.84:0/925813566 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7c980c9070 con 0x5559b6eb5660 2024-09-21T07:58:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7cb52c1740 10 client.27418 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7cb52c1740 10 client.27418 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:58:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7cb52c1740 20 client.27418 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e9cea0 0x5559b72ab840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7cb52c1740 4 client.27418 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559b71fe1e0 con 0x5559b6e9cea0 2024-09-21T07:58:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.416+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e9cea0 0x5559b72ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.417+0000 7f7c91600640 10 client.27418 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.417+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e9cea0 0x5559b72ab840 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736e2a283d6ca7db server_cookie=baa371ad166d714a in_seq=0 out_seq=0 2024-09-21T07:58:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7c91600640 1 -- 172.21.15.84:0/925813566 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559b71fe1e0 con 0x5559b6e9cea0 2024-09-21T07:58:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7c91600640 10 client.27418 handle_command_reply: tid=0 2024-09-21T07:58:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 client.27418 shutdown 2024-09-21T07:58:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 msgr2=0x5559b7290f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b7290f30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c98032af0 tx=0x7f7c980cd130 comp rx=0 tx=0).stop 2024-09-21T07:58:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 shutdown_connections 2024-09-21T07:58:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ede520 0x5559b72a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ebd840 0x5559b7291470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e9cea0 0x5559b72ab840 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/925813566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b7290f30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 >> 172.21.15.84:0/925813566 conn(0x5559b6ed2910 msgr2=0x5559b72884d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.418+0000 7f7c91600640 0 client.27418 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.419+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 shutdown_connections 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.419+0000 7f7cb52c1740 1 -- 172.21.15.84:0/925813566 wait complete. 2024-09-21T07:58:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.419+0000 7f7cb52c1740 20 client.27418 trim_cache size 0 max 16384 2024-09-21T07:58:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.456+0000 7f7cb52c1740 1 Processor -- start 2024-09-21T07:58:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.456+0000 7f7cb52c1740 1 -- start start 2024-09-21T07:58:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.457+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 0x5559b728df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.457+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ebd840 0x5559b728e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.457+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b72b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.457+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7c88010070 con 0x5559b6eb5660 2024-09-21T07:58:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.457+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c88011bb0 con 0x5559b6ede520 2024-09-21T07:58:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.457+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7c88010740 con 0x5559b6ebd840 2024-09-21T07:58:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.458+0000 7f7ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b72b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.458+0000 7f7ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b72b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57956/0 (socket says 172.21.15.84:57956) 2024-09-21T07:58:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.458+0000 7f7ca7e00640 1 -- 172.21.15.84:0/1113049621 learned_addr learned my addr 172.21.15.84:0/1113049621 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.459+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ebd840 0x5559b728e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.459+0000 7f7ca7400640 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 0x5559b728df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.459+0000 7f7ca7e00640 1 -- 172.21.15.84:0/1113049621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ebd840 msgr2=0x5559b728e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.459+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ebd840 0x5559b728e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.459+0000 7f7ca7e00640 1 -- 172.21.15.84:0/1113049621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 msgr2=0x5559b728df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.459+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 0x5559b728df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.459+0000 7f7ca7e00640 1 -- 172.21.15.84:0/1113049621 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b7283750 con 0x5559b6ede520 2024-09-21T07:58:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.460+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b72b1040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000f80 tx=0x7f7ca0009cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa32ac65a0e0819c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.461+0000 7f7c93e00640 1 -- 172.21.15.84:0/1113049621 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0004ac0 con 0x5559b6ede520 2024-09-21T07:58:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.461+0000 7f7c93e00640 1 -- 172.21.15.84:0/1113049621 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca0004c60 con 0x5559b6ede520 2024-09-21T07:58:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.461+0000 7f7c93e00640 1 -- 172.21.15.84:0/1113049621 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0004ac0 con 0x5559b6ede520 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.463+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1113049621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 msgr2=0x5559b72b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.463+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b72b1040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000f80 tx=0x7f7ca0009cb0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.463+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1113049621 shutdown_connections 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.463+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b72b1040 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.463+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6ebd840 0x5559b728e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.463+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1113049621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6eb5660 0x5559b728df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.464+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1113049621 >> 172.21.15.84:0/1113049621 conn(0x5559b6ed2910 msgr2=0x5559b728f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.464+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1113049621 shutdown_connections 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.464+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1113049621 wait complete. 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.465+0000 7f7cb52c1740 1 -- start start 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.465+0000 7f7cb52c1740 1 Processor -- start 2024-09-21T07:58:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.466+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b729dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.467+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ebd840 0x5559b729e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.467+0000 7f7cb52c1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b7320220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.467+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7c880114e0 con 0x5559b6ebd840 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.467+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c88010e10 con 0x5559b6ede520 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.468+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b729dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.468+0000 7f7cb52c1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8800e050 con 0x5559b6eb5660 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.468+0000 7f7cb52c1740 10 client.0 _ll_register_callbacks cb 0x7f7c98005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.468+0000 7f7ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b7320220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.468+0000 7f7ca7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b729dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37082/0 (socket says 172.21.15.84:37082) 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.468+0000 7f7ca7400640 1 -- 172.21.15.84:0/1491033808 learned_addr learned my addr 172.21.15.84:0/1491033808 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.468+0000 7f7ca6a00640 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ebd840 0x5559b729e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.469+0000 7f7ca7e00640 1 -- 172.21.15.84:0/1491033808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 msgr2=0x5559b729dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.469+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b729dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.469+0000 7f7ca7e00640 1 -- 172.21.15.84:0/1491033808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ebd840 msgr2=0x5559b729e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.469+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ebd840 0x5559b729e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.469+0000 7f7ca7e00640 1 -- 172.21.15.84:0/1491033808 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b7320890 con 0x5559b6ede520 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.470+0000 7f7c91600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.470+0000 7f7ca7e00640 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b7320220 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009270 tx=0x7f7ca0024890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1825bc6aca53925a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.470+0000 7f7c91600640 1 -- 172.21.15.84:0/1491033808 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0033020 con 0x5559b6ede520 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.470+0000 7f7c91600640 1 -- 172.21.15.84:0/1491033808 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9520+0+0 (secure 0 0 0) 0x7f7ca0024c10 con 0x5559b6ede520 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.471+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca0004c60 con 0x5559b6ede520 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.471+0000 7f7c91600640 1 -- 172.21.15.84:0/1491033808 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ca0004ac0 con 0x5559b6ede520 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.471+0000 7f7cb52c1740 10 client.27428 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.471+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5559b7327bf0 con 0x5559b6ede520 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7c91600640 1 -- 172.21.15.84:0/1491033808 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca0004c60 con 0x5559b6ede520 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7c91600640 1 -- 172.21.15.84:0/1491033808 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7ca0018070 con 0x5559b6ede520 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7cb52c1740 10 client.27428 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7cb52c1740 10 client.27428 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7cb52c1740 20 client.27428 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e72250 0x5559b732a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7cb52c1740 4 client.27428 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e7a3bb18", "release": true, "await": true}] 2024-09-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.475+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e7a3bb18", "release": true, "await": true}) -- 0x5559b71f9c90 con 0x5559b6e72250 2024-09-21T07:58:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.480+0000 7f7ca7400640 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e72250 0x5559b732a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.482+0000 7f7ca7400640 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e72250 0x5559b732a0e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=300e8e54570b1685 server_cookie=25eb3f8b5785295f in_seq=0 out_seq=0 2024-09-21T07:58:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.482+0000 7f7c91600640 10 client.27428 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.488+0000 7f7c91600640 1 -- 172.21.15.84:0/1491033808 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5559b71f9c90 con 0x5559b6e72250 2024-09-21T07:58:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.488+0000 7f7c91600640 10 client.27428 handle_command_reply: tid=0 2024-09-21T07:58:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.488+0000 7f7cb52c1740 1 client.27428 shutdown 2024-09-21T07:58:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 msgr2=0x5559b7320220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b7320220 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009270 tx=0x7f7ca0024890 comp rx=0 tx=0).stop 2024-09-21T07:58:09.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 shutdown_connections 2024-09-21T07:58:09.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559b6ede520 0x5559b7320220 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559b6ebd840 0x5559b729e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5559b6e72250 0x5559b732a0e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 --2- 172.21.15.84:0/1491033808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559b6eb5660 0x5559b729dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 >> 172.21.15.84:0/1491033808 conn(0x5559b6ed2910 msgr2=0x5559b72921e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:09.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.493+0000 7f7c91600640 0 client.27428 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:09.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.494+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 shutdown_connections 2024-09-21T07:58:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.499+0000 7f7cb52c1740 1 -- 172.21.15.84:0/1491033808 wait complete. 2024-09-21T07:58:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.499+0000 7f7cb52c1740 20 client.27428 trim_cache size 0 max 16384 2024-09-21T07:58:09.508 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:58:09.508 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 28, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "e7a3bb18": { 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 28, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 139.2, 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:58:09.509 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:58:09.510 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7c8c0b6700 msgr2=0x7f7c8c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7c8c0b6700 0x7f7c8c0b8c10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8108e90 tx=0x7f7c94005f90 comp rx=0 tx=0).stop 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca81039b0 msgr2=0x7f7ca819c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca81039b0 0x7f7ca819c550 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c98005940 tx=0x7f7c980040c0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 shutdown_connections 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7c8c0b6700 0x7f7c8c0b8c10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca8109c40 0x7f7ca81a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ca81092f0 0x7f7ca819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 --2- 172.21.15.84:0/1138672776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ca81039b0 0x7f7ca819c550 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.508+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 >> 172.21.15.84:0/1138672776 conn(0x7f7ca80ff440 msgr2=0x7f7ca810e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.509+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 shutdown_connections 2024-09-21T07:58:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:09.512+0000 7f7cad000640 1 -- 172.21.15.84:0/1138672776 wait complete. 2024-09-21T07:58:09.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:09 smithi162 ceph-mon[34833]: pgmap v607: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 970 GiB / 1.0 TiB avail; 26 KiB/s rd, 218 MiB/s wr, 1.39k op/s 2024-09-21T07:58:09.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:09 smithi162 ceph-mon[34833]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T07:58:09.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:09 smithi084 ceph-mon[30411]: pgmap v607: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 970 GiB / 1.0 TiB avail; 26 KiB/s rd, 218 MiB/s wr, 1.39k op/s 2024-09-21T07:58:09.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:09 smithi084 ceph-mon[30411]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T07:58:09.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:09 smithi191 ceph-mon[34667]: pgmap v607: 129 pgs: 129 active+clean; 49 GiB data, 102 GiB used, 970 GiB / 1.0 TiB avail; 26 KiB/s rd, 218 MiB/s wr, 1.39k op/s 2024-09-21T07:58:09.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:09 smithi191 ceph-mon[34667]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T07:58:11.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:11 smithi191 ceph-mon[34667]: pgmap v609: 129 pgs: 129 active+clean; 49 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 31 KiB/s rd, 232 MiB/s wr, 1.79k op/s 2024-09-21T07:58:12.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:11 smithi162 ceph-mon[34833]: pgmap v609: 129 pgs: 129 active+clean; 49 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 31 KiB/s rd, 232 MiB/s wr, 1.79k op/s 2024-09-21T07:58:12.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:11 smithi084 ceph-mon[30411]: pgmap v609: 129 pgs: 129 active+clean; 49 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 31 KiB/s rd, 232 MiB/s wr, 1.79k op/s 2024-09-21T07:58:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.675+0000 7f1188a00640 1 -- 172.21.15.84:0/2972769025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410b4d0 msgr2=0x7f118410b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.675+0000 7f1188a00640 1 --2- 172.21.15.84:0/2972769025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410b4d0 0x7f118410b8e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1170009900 tx=0x7f117002a400 comp rx=0 tx=0).stop 2024-09-21T07:58:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.675+0000 7f1188a00640 1 -- 172.21.15.84:0/2972769025 shutdown_connections 2024-09-21T07:58:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.675+0000 7f1188a00640 1 --2- 172.21.15.84:0/2972769025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f118410be20 0x7f1184112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.675+0000 7f1188a00640 1 --2- 172.21.15.84:0/2972769025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410b4d0 0x7f118410b8e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.675+0000 7f1188a00640 1 --2- 172.21.15.84:0/2972769025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1184105c20 0x7f1184106030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.675+0000 7f1188a00640 1 -- 172.21.15.84:0/2972769025 >> 172.21.15.84:0/2972769025 conn(0x7f1184101690 msgr2=0x7f1184103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:13.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:13 smithi084 ceph-mon[30411]: pgmap v610: 129 pgs: 129 active+clean; 50 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 26 KiB/s rd, 210 MiB/s wr, 1.86k op/s 2024-09-21T07:58:13.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.676+0000 7f1188a00640 1 -- 172.21.15.84:0/2972769025 shutdown_connections 2024-09-21T07:58:13.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.676+0000 7f1188a00640 1 -- 172.21.15.84:0/2972769025 wait complete. 2024-09-21T07:58:13.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.678+0000 7f1188a00640 1 Processor -- start 2024-09-21T07:58:13.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.678+0000 7f1188a00640 1 -- start start 2024-09-21T07:58:13.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1188a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1184105c20 0x7f118419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1188a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118410b4d0 0x7f118419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1188a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410be20 0x7f11841a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1188a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1184115b30 con 0x7f118410b4d0 2024-09-21T07:58:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1188a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11841159b0 con 0x7f118410be20 2024-09-21T07:58:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1188a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1184115cb0 con 0x7f1184105c20 2024-09-21T07:58:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1182a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118410b4d0 0x7f118419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1182a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118410b4d0 0x7f118419ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50872/0 (socket says 172.21.15.84:50872) 2024-09-21T07:58:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1182a00640 1 -- 172.21.15.84:0/3462731390 learned_addr learned my addr 172.21.15.84:0/3462731390 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.679+0000 7f1183400640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1184105c20 0x7f118419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.680+0000 7f1183e00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410be20 0x7f11841a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.680+0000 7f1182a00640 1 -- 172.21.15.84:0/3462731390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1184105c20 msgr2=0x7f118419c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.680+0000 7f1182a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1184105c20 0x7f118419c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.680+0000 7f1182a00640 1 -- 172.21.15.84:0/3462731390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410be20 msgr2=0x7f11841a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.681+0000 7f1182a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410be20 0x7f11841a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.681+0000 7f1182a00640 1 -- 172.21.15.84:0/3462731390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11841a23f0 con 0x7f118410b4d0 2024-09-21T07:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.681+0000 7f1183400640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1184105c20 0x7f118419c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.681+0000 7f1182a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118410b4d0 0x7f118419ca20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1170005ab0 tx=0x7f1170003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.682+0000 7f117be00640 1 -- 172.21.15.84:0/3462731390 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117003f070 con 0x7f118410b4d0 2024-09-21T07:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.682+0000 7f117be00640 1 -- 172.21.15.84:0/3462731390 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1170031b50 con 0x7f118410b4d0 2024-09-21T07:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.682+0000 7f117be00640 1 -- 172.21.15.84:0/3462731390 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170035030 con 0x7f118410b4d0 2024-09-21T07:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.682+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11841a2680 con 0x7f118410b4d0 2024-09-21T07:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.682+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11841a8e40 con 0x7f118410b4d0 2024-09-21T07:58:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.687+0000 7f117be00640 1 -- 172.21.15.84:0/3462731390 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f1170042070 con 0x7f118410b4d0 2024-09-21T07:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.689+0000 7f117be00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11680b6700 0x7f11680b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.689+0000 7f117be00640 1 -- 172.21.15.84:0/3462731390 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9520+0+0 (secure 0 0 0) 0x7f1170107ec0 con 0x7f118410b4d0 2024-09-21T07:58:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.689+0000 7f1183400640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11680b6700 0x7f11680b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.690+0000 7f1183400640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11680b6700 0x7f11680b8c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f11740058c0 tx=0x7f1174005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:13.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.808+0000 7f1190c07740 1 Processor -- start 2024-09-21T07:58:13.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.823+0000 7f1190c07740 1 -- start start 2024-09-21T07:58:13.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.823+0000 7f1190c07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bdb070 0x55ff80f8a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.823+0000 7f1190c07740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bb21b0 0x55ff80f8acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.827+0000 7f1190c07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bba390 0x55ff80f8b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.828+0000 7f1190c07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ff80ef8fb0 con 0x55ff80bdb070 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.828+0000 7f1183e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bba390 0x55ff80f8b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.828+0000 7f1183e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bba390 0x55ff80f8b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57994/0 (socket says 172.21.15.84:57994) 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.828+0000 7f1183e00640 1 -- 172.21.15.84:0/573184958 learned_addr learned my addr 172.21.15.84:0/573184958 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.828+0000 7f1190c07740 1 -- 172.21.15.84:0/573184958 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ff80ee83e0 con 0x55ff80bba390 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.828+0000 7f1190c07740 1 -- 172.21.15.84:0/573184958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ff80eec1f0 con 0x55ff80bb21b0 2024-09-21T07:58:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.828+0000 7f1182a00640 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bb21b0 0x55ff80f8acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.829+0000 7f1183400640 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bdb070 0x55ff80f8a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.830+0000 7f1183e00640 1 -- 172.21.15.84:0/573184958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bb21b0 msgr2=0x55ff80f8acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.830+0000 7f1183e00640 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bb21b0 0x55ff80f8acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.830+0000 7f1183e00640 1 -- 172.21.15.84:0/573184958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bdb070 msgr2=0x55ff80f8a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.830+0000 7f1183e00640 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bdb070 0x55ff80f8a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.830+0000 7f1183e00640 1 -- 172.21.15.84:0/573184958 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff80eb2cd0 con 0x55ff80bba390 2024-09-21T07:58:13.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.830+0000 7f1183e00640 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bba390 0x55ff80f8b200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f117c009fc0 tx=0x7f117c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3420918dbbe675d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:13.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.830+0000 7f116fe00640 1 -- 172.21.15.84:0/573184958 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c003b70 con 0x55ff80bba390 2024-09-21T07:58:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.831+0000 7f116fe00640 1 -- 172.21.15.84:0/573184958 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f117c003d10 con 0x55ff80bba390 2024-09-21T07:58:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.831+0000 7f116fe00640 1 -- 172.21.15.84:0/573184958 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c011a00 con 0x55ff80bba390 2024-09-21T07:58:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.832+0000 7f1190c07740 1 -- 172.21.15.84:0/573184958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bba390 msgr2=0x55ff80f8b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.832+0000 7f1190c07740 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bba390 0x55ff80f8b200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f117c009fc0 tx=0x7f117c010860 comp rx=0 tx=0).stop 2024-09-21T07:58:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.835+0000 7f1190c07740 1 -- 172.21.15.84:0/573184958 shutdown_connections 2024-09-21T07:58:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.835+0000 7f1190c07740 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bba390 0x55ff80f8b200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.835+0000 7f1190c07740 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bb21b0 0x55ff80f8acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.835+0000 7f1190c07740 1 --2- 172.21.15.84:0/573184958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bdb070 0x55ff80f8a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.835+0000 7f1190c07740 1 -- 172.21.15.84:0/573184958 >> 172.21.15.84:0/573184958 conn(0x55ff80bcf460 msgr2=0x55ff80f88670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.836+0000 7f1190c07740 1 -- 172.21.15.84:0/573184958 shutdown_connections 2024-09-21T07:58:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.836+0000 7f1190c07740 1 -- 172.21.15.84:0/573184958 wait complete. 2024-09-21T07:58:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.837+0000 7f1190c07740 1 -- start start 2024-09-21T07:58:13.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.837+0000 7f1190c07740 1 Processor -- start 2024-09-21T07:58:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.839+0000 7f1190c07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bb21b0 0x55ff80f95f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.839+0000 7f1190c07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bba390 0x55ff80f96480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.839+0000 7f1190c07740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bdb070 0x55ff80fa2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.840+0000 7f1182a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bba390 0x55ff80f96480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.840+0000 7f1183400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bb21b0 0x55ff80f95f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.840+0000 7f1183400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bb21b0 0x55ff80f95f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57998/0 (socket says 172.21.15.84:57998) 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.841+0000 7f1190c07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ff80d49700 con 0x55ff80bba390 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.841+0000 7f1183400640 1 -- 172.21.15.84:0/2863249954 learned_addr learned my addr 172.21.15.84:0/2863249954 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.841+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ff80e83580 con 0x55ff80bb21b0 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.841+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ff80f98f60 con 0x55ff80bdb070 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.841+0000 7f1190c07740 10 client.0 _ll_register_callbacks cb 0x55ff80e93470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.843+0000 7f1183400640 1 -- 172.21.15.84:0/2863249954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bdb070 msgr2=0x55ff80fa2250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.843+0000 7f1183400640 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bdb070 0x55ff80fa2250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.843+0000 7f1183400640 1 -- 172.21.15.84:0/2863249954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bba390 msgr2=0x55ff80f96480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.843+0000 7f1183400640 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bba390 0x55ff80f96480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.845+0000 7f1183400640 1 -- 172.21.15.84:0/2863249954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff80c46650 con 0x55ff80bb21b0 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.845+0000 7f1183400640 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bb21b0 0x55ff80f95f40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f117400beb0 tx=0x7f11740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c699d9ec256c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.845+0000 7f116cc00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.846+0000 7f116cc00640 1 -- 172.21.15.84:0/2863249954 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174004220 con 0x55ff80bb21b0 2024-09-21T07:58:13.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.846+0000 7f116cc00640 1 -- 172.21.15.84:0/2863249954 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9520+0+0 (secure 0 0 0) 0x7f11740043c0 con 0x55ff80bb21b0 2024-09-21T07:58:13.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.846+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff80e85b90 con 0x55ff80bb21b0 2024-09-21T07:58:13.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.846+0000 7f116cc00640 1 -- 172.21.15.84:0/2863249954 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1174030710 con 0x55ff80bb21b0 2024-09-21T07:58:13.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.846+0000 7f1190c07740 10 client.27440 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:13.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.846+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ff80ea0950 con 0x55ff80bb21b0 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.848+0000 7f116cc00640 1 -- 172.21.15.84:0/2863249954 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ff80e85b90 con 0x55ff80bb21b0 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.848+0000 7f116cc00640 1 -- 172.21.15.84:0/2863249954 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1174003c80 con 0x55ff80bb21b0 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.852+0000 7f1190c07740 10 client.27440 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.852+0000 7f1190c07740 10 client.27440 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.852+0000 7f1190c07740 20 client.27440 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.852+0000 7f1190c07740 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff80b999f0 0x55ff80f82b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.852+0000 7f1190c07740 4 client.27440 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.852+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff80efaf00 con 0x55ff80b999f0 2024-09-21T07:58:13.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.852+0000 7f1182a00640 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff80b999f0 0x55ff80f82b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.855+0000 7f116cc00640 10 client.27440 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:58:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.855+0000 7f1182a00640 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff80b999f0 0x55ff80f82b60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5b3a5e15bd05d889 server_cookie=8a9c3c1c03ee0dd1 in_seq=0 out_seq=0 2024-09-21T07:58:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.856+0000 7f116cc00640 1 -- 172.21.15.84:0/2863249954 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff80efaf00 con 0x55ff80b999f0 2024-09-21T07:58:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.856+0000 7f116cc00640 10 client.27440 handle_command_reply: tid=0 2024-09-21T07:58:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.856+0000 7f1190c07740 1 client.27440 shutdown 2024-09-21T07:58:13.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.856+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bb21b0 msgr2=0x55ff80f95f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.856+0000 7f1190c07740 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bb21b0 0x55ff80f95f40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f117400beb0 tx=0x7f11740046c0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.857+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 shutdown_connections 2024-09-21T07:58:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.857+0000 7f1190c07740 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff80b999f0 0x55ff80f82b60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.857+0000 7f1190c07740 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bdb070 0x55ff80fa2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.857+0000 7f1190c07740 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80bba390 0x55ff80f96480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.857+0000 7f1190c07740 1 --2- 172.21.15.84:0/2863249954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bb21b0 0x55ff80f95f40 secure :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f117400beb0 tx=0x7f11740046c0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.857+0000 7f116cc00640 0 client.27440 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:58:13.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.857+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 >> 172.21.15.84:0/2863249954 conn(0x55ff80bcf460 msgr2=0x55ff80f7e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.858+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 shutdown_connections 2024-09-21T07:58:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.858+0000 7f1190c07740 1 -- 172.21.15.84:0/2863249954 wait complete. 2024-09-21T07:58:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.858+0000 7f1190c07740 20 client.27440 trim_cache size 0 max 16384 2024-09-21T07:58:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.886+0000 7f1190c07740 1 Processor -- start 2024-09-21T07:58:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.886+0000 7f1190c07740 1 -- start start 2024-09-21T07:58:13.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.887+0000 7f1190c07740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80f7efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.887+0000 7f1190c07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80f8bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.887+0000 7f1190c07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80fa21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.887+0000 7f1190c07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f11841aeb90 con 0x55ff80b6eda0 2024-09-21T07:58:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.887+0000 7f1190c07740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11841b06d0 con 0x55ff80bdb070 2024-09-21T07:58:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.887+0000 7f1190c07740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f11841af260 con 0x55ff80bba390 2024-09-21T07:58:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80f7efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80f7efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:37118/0 (socket says 172.21.15.84:37118) 2024-09-21T07:58:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 -- 172.21.15.84:0/327836985 learned_addr learned my addr 172.21.15.84:0/327836985 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1182a00640 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80f8bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 -- 172.21.15.84:0/327836985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 msgr2=0x55ff80f8bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80f8bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 -- 172.21.15.84:0/327836985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 msgr2=0x55ff80fa21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80fa21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.888+0000 7f1183400640 1 -- 172.21.15.84:0/327836985 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff80f94440 con 0x55ff80bba390 2024-09-21T07:58:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.890+0000 7f1183400640 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80f7efc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1174042570 tx=0x7f1174042910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982b4aff23e6d3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.891+0000 7f116f400640 1 -- 172.21.15.84:0/327836985 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174047040 con 0x55ff80bba390 2024-09-21T07:58:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.892+0000 7f116f400640 1 -- 172.21.15.84:0/327836985 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1174042d30 con 0x55ff80bba390 2024-09-21T07:58:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.892+0000 7f116f400640 1 -- 172.21.15.84:0/327836985 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174030cd0 con 0x55ff80bba390 2024-09-21T07:58:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.893+0000 7f1190c07740 1 -- 172.21.15.84:0/327836985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 msgr2=0x55ff80f7efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.893+0000 7f1190c07740 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80f7efc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1174042570 tx=0x7f1174042910 comp rx=0 tx=0).stop 2024-09-21T07:58:13.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.894+0000 7f1190c07740 1 -- 172.21.15.84:0/327836985 shutdown_connections 2024-09-21T07:58:13.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.895+0000 7f1190c07740 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80fa21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.895+0000 7f1190c07740 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80f8bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.895+0000 7f1190c07740 1 --2- 172.21.15.84:0/327836985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80f7efc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.895+0000 7f1190c07740 1 -- 172.21.15.84:0/327836985 >> 172.21.15.84:0/327836985 conn(0x55ff80bcf460 msgr2=0x55ff80f8b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:13.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.896+0000 7f1190c07740 1 -- 172.21.15.84:0/327836985 shutdown_connections 2024-09-21T07:58:13.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.896+0000 7f1190c07740 1 -- 172.21.15.84:0/327836985 wait complete. 2024-09-21T07:58:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.898+0000 7f1190c07740 1 -- start start 2024-09-21T07:58:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.899+0000 7f1190c07740 1 Processor -- start 2024-09-21T07:58:13.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:13 smithi191 ceph-mon[34667]: pgmap v610: 129 pgs: 129 active+clean; 50 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 26 KiB/s rd, 210 MiB/s wr, 1.86k op/s 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.903+0000 7f1190c07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80faa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.903+0000 7f1190c07740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80fa5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.903+0000 7f1190c07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80fa5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.903+0000 7f1190c07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f11841b0000 con 0x55ff80b6eda0 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.903+0000 7f1190c07740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11841af930 con 0x55ff80bdb070 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.903+0000 7f1190c07740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f11841acb70 con 0x55ff80bba390 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.903+0000 7f1190c07740 10 client.0 _ll_register_callbacks cb 0x7f117400bde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:13.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.904+0000 7f1182a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80fa5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.904+0000 7f1183400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80faa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.905+0000 7f1183400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80faa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50892/0 (socket says 172.21.15.84:50892) 2024-09-21T07:58:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.905+0000 7f1183400640 1 -- 172.21.15.84:0/4032814038 learned_addr learned my addr 172.21.15.84:0/4032814038 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.904+0000 7f1183e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80fa5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.906+0000 7f1182a00640 1 -- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 msgr2=0x55ff80fa5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.906+0000 7f1182a00640 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80fa5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.906+0000 7f1182a00640 1 -- 172.21.15.84:0/4032814038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 msgr2=0x55ff80faa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:13.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.906+0000 7f1182a00640 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80faa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.906+0000 7f1182a00640 1 -- 172.21.15.84:0/4032814038 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff80fa62c0 con 0x55ff80bba390 2024-09-21T07:58:13.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.906+0000 7f1183e00640 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80fa5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:13.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.911+0000 7f1182a00640 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80fa5810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1170105230 tx=0x7f1170031f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a24399fa7f58658b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:13.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.911+0000 7f116cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:13.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.911+0000 7f116cc00640 1 -- 172.21.15.84:0/4032814038 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170049040 con 0x55ff80bba390 2024-09-21T07:58:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.911+0000 7f116cc00640 1 -- 172.21.15.84:0/4032814038 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9520+0+0 (secure 0 0 0) 0x7f11700c9ba0 con 0x55ff80bba390 2024-09-21T07:58:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.912+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1174042d30 con 0x55ff80bba390 2024-09-21T07:58:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.912+0000 7f116cc00640 1 -- 172.21.15.84:0/4032814038 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f11700ce030 con 0x55ff80bba390 2024-09-21T07:58:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.912+0000 7f1190c07740 10 client.27439 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.912+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ff8100acc0 con 0x55ff80bba390 2024-09-21T07:58:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.913+0000 7f116cc00640 1 -- 172.21.15.84:0/4032814038 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1174042d30 con 0x55ff80bba390 2024-09-21T07:58:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.915+0000 7f116cc00640 1 -- 172.21.15.84:0/4032814038 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f117004c060 con 0x55ff80bba390 2024-09-21T07:58:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.915+0000 7f1190c07740 10 client.27439 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.915+0000 7f1190c07740 10 client.27439 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:58:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.915+0000 7f1190c07740 20 client.27439 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.915+0000 7f1190c07740 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff8100b490 0x55ff8100d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.915+0000 7f1190c07740 4 client.27439 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:58:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.915+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff80ef69b0 con 0x55ff8100b490 2024-09-21T07:58:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.916+0000 7f1183400640 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff8100b490 0x55ff8100d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.923+0000 7f116cc00640 10 client.27439 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:58:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.923+0000 7f1183400640 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff8100b490 0x55ff8100d8b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f716c6d8945a13ab server_cookie=ea14b44fc2448fb9 in_seq=0 out_seq=0 2024-09-21T07:58:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.923+0000 7f116cc00640 1 -- 172.21.15.84:0/4032814038 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff80ef69b0 con 0x55ff8100b490 2024-09-21T07:58:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.923+0000 7f116cc00640 10 client.27439 handle_command_reply: tid=0 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.923+0000 7f1190c07740 1 client.27439 shutdown 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.924+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 msgr2=0x55ff80fa5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.924+0000 7f1190c07740 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80fa5810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1170105230 tx=0x7f1170031f70 comp rx=0 tx=0).stop 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.924+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 shutdown_connections 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.924+0000 7f1190c07740 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x55ff8100b490 0x55ff8100d8b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.924+0000 7f1190c07740 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff80bdb070 0x55ff80fa5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.925+0000 7f116cc00640 0 client.27439 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:58:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.925+0000 7f1190c07740 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ff80bba390 0x55ff80fa5810 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.925+0000 7f1190c07740 1 --2- 172.21.15.84:0/4032814038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff80b6eda0 0x55ff80faa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.925+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 >> 172.21.15.84:0/4032814038 conn(0x55ff80bcf460 msgr2=0x55ff80f8c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:13.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.925+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 shutdown_connections 2024-09-21T07:58:13.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.925+0000 7f1190c07740 1 -- 172.21.15.84:0/4032814038 wait complete. 2024-09-21T07:58:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.926+0000 7f1190c07740 20 client.27439 trim_cache size 0 max 16384 2024-09-21T07:58:13.930 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:58:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.929+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11680b6700 msgr2=0x7f11680b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.929+0000 7f1188a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11680b6700 0x7f11680b8c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f11740058c0 tx=0x7f1174005850 comp rx=0 tx=0).stop 2024-09-21T07:58:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.929+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118410b4d0 msgr2=0x7f118419ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:13.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.929+0000 7f1188a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118410b4d0 0x7f118419ca20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1170005ab0 tx=0x7f1170003b90 comp rx=0 tx=0).stop 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 shutdown_connections 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f11680b6700 0x7f11680b8c10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f118410be20 0x7f11841a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118410b4d0 0x7f118419ca20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 --2- 172.21.15.84:0/3462731390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1184105c20 0x7f118419c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 >> 172.21.15.84:0/3462731390 conn(0x7f1184101690 msgr2=0x7f1184103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 shutdown_connections 2024-09-21T07:58:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:13.932+0000 7f1188a00640 1 -- 172.21.15.84:0/3462731390 wait complete. 2024-09-21T07:58:14.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:13 smithi162 ceph-mon[34833]: pgmap v610: 129 pgs: 129 active+clean; 50 GiB data, 103 GiB used, 970 GiB / 1.0 TiB avail; 26 KiB/s rd, 210 MiB/s wr, 1.86k op/s 2024-09-21T07:58:15.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:15 smithi191 ceph-mon[34667]: pgmap v611: 129 pgs: 129 active+clean; 50 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 14 KiB/s rd, 199 MiB/s wr, 1.98k op/s 2024-09-21T07:58:16.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:15 smithi162 ceph-mon[34833]: pgmap v611: 129 pgs: 129 active+clean; 50 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 14 KiB/s rd, 199 MiB/s wr, 1.98k op/s 2024-09-21T07:58:16.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:15 smithi084 ceph-mon[30411]: pgmap v611: 129 pgs: 129 active+clean; 50 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 14 KiB/s rd, 199 MiB/s wr, 1.98k op/s 2024-09-21T07:58:16.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:16 smithi191 ceph-mon[34667]: pgmap v612: 129 pgs: 129 active+clean; 50 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 22 KiB/s rd, 184 MiB/s wr, 1.91k op/s 2024-09-21T07:58:16.973 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:16 smithi084 ceph-mon[30411]: pgmap v612: 129 pgs: 129 active+clean; 50 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 22 KiB/s rd, 184 MiB/s wr, 1.91k op/s 2024-09-21T07:58:17.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:16 smithi162 ceph-mon[34833]: pgmap v612: 129 pgs: 129 active+clean; 50 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 22 KiB/s rd, 184 MiB/s wr, 1.91k op/s 2024-09-21T07:58:18.115 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e7a3bb18', total seconds elapsed: 44.9 2024-09-21T07:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.887+0000 7fe32aa00640 1 -- 172.21.15.84:0/1965930976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe32410fa10 msgr2=0x7fe32410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.887+0000 7fe32aa00640 1 --2- 172.21.15.84:0/1965930976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe32410fa10 0x7fe32410fe20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe314009900 tx=0x7fe31402a410 comp rx=0 tx=0).stop 2024-09-21T07:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.888+0000 7fe32aa00640 1 -- 172.21.15.84:0/1965930976 shutdown_connections 2024-09-21T07:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.888+0000 7fe32aa00640 1 --2- 172.21.15.84:0/1965930976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 0x7fe324116b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.888+0000 7fe32aa00640 1 --2- 172.21.15.84:0/1965930976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe32410fa10 0x7fe32410fe20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.888+0000 7fe32aa00640 1 --2- 172.21.15.84:0/1965930976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe32410a0e0 0x7fe32410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.888+0000 7fe32aa00640 1 -- 172.21.15.84:0/1965930976 >> 172.21.15.84:0/1965930976 conn(0x7fe324079630 msgr2=0x7fe3241081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.888+0000 7fe32aa00640 1 -- 172.21.15.84:0/1965930976 shutdown_connections 2024-09-21T07:58:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.888+0000 7fe32aa00640 1 -- 172.21.15.84:0/1965930976 wait complete. 2024-09-21T07:58:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.890+0000 7fe32aa00640 1 Processor -- start 2024-09-21T07:58:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.891+0000 7fe32aa00640 1 -- start start 2024-09-21T07:58:18.893 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe32aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe32410a0e0 0x7fe324075070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe32aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe32410fa10 0x7fe324070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe32aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 0x7fe324070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe32aa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe32411a000 con 0x7fe324110360 2024-09-21T07:58:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe32aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe324119e80 con 0x7fe32410a0e0 2024-09-21T07:58:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe32aa00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe32411a180 con 0x7fe32410fa10 2024-09-21T07:58:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe328a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 0x7fe324070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe328a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 0x7fe324070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32806/0 (socket says 172.21.15.84:32806) 2024-09-21T07:58:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.892+0000 7fe328a00640 1 -- 172.21.15.84:0/3067095941 learned_addr learned my addr 172.21.15.84:0/3067095941 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.893+0000 7fe328a00640 1 -- 172.21.15.84:0/3067095941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe32410fa10 msgr2=0x7fe324070330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.893+0000 7fe328a00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe32410fa10 0x7fe324070330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.893+0000 7fe328a00640 1 -- 172.21.15.84:0/3067095941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe32410a0e0 msgr2=0x7fe324075070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.893+0000 7fe328a00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe32410a0e0 0x7fe324075070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.893+0000 7fe328a00640 1 -- 172.21.15.84:0/3067095941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe324080a80 con 0x7fe324110360 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.894+0000 7fe328a00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 0x7fe324070aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00efd0 tx=0x7fe31c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.894+0000 7fe320c00640 1 -- 172.21.15.84:0/3067095941 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c003b70 con 0x7fe324110360 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.894+0000 7fe320c00640 1 -- 172.21.15.84:0/3067095941 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe31c003d10 con 0x7fe324110360 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.894+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe324080d70 con 0x7fe324110360 2024-09-21T07:58:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.894+0000 7fe320c00640 1 -- 172.21.15.84:0/3067095941 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0108a0 con 0x7fe324110360 2024-09-21T07:58:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.894+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3240812c0 con 0x7fe324110360 2024-09-21T07:58:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.899+0000 7fe331a17740 1 Processor -- start 2024-09-21T07:58:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.900+0000 7fe320c00640 1 -- 172.21.15.84:0/3067095941 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe31c010a40 con 0x7fe324110360 2024-09-21T07:58:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.900+0000 7fe331a17740 1 -- start start 2024-09-21T07:58:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe331a17740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae6dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe331a17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae6e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe331a17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe331a17740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55923ade36b0 con 0x55923aaa84d0 2024-09-21T07:58:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe331a17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55923add2ae0 con 0x55923aaa02f0 2024-09-21T07:58:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe331a17740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55923add68f0 con 0x55923aac91b0 2024-09-21T07:58:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe323400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae6dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe323400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae6dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60864/0 (socket says 172.21.15.84:60864) 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.901+0000 7fe323400640 1 -- 172.21.15.84:0/2798421490 learned_addr learned my addr 172.21.15.84:0/2798421490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.902+0000 7fe323e00640 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae6e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.902+0000 7fe323400640 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.902+0000 7fe323e00640 1 -- 172.21.15.84:0/2798421490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 msgr2=0x55923ae6dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.902+0000 7fe323e00640 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae6dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.902+0000 7fe323e00640 1 -- 172.21.15.84:0/2798421490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 msgr2=0x55923ae6e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.903+0000 7fe320c00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3080b67b0 0x7fe3080b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.903+0000 7fe323e00640 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.903+0000 7fe323e00640 1 -- 172.21.15.84:0/2798421490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923ad9f780 con 0x55923aaa02f0 2024-09-21T07:58:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.903+0000 7fe323400640 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.903+0000 7fe320c00640 1 -- 172.21.15.84:0/3067095941 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fe31c0e7ef0 con 0x7fe324110360 2024-09-21T07:58:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.903+0000 7fe323400640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3080b67b0 0x7fe3080b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.904+0000 7fe323e00640 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae6e170 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe31000b9d0 tx=0x7fe31000be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2249c721aa7490e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.904+0000 7fe319200640 1 -- 172.21.15.84:0/2798421490 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310016070 con 0x55923aaa02f0 2024-09-21T07:58:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.904+0000 7fe319200640 1 -- 172.21.15.84:0/2798421490 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3100054d0 con 0x55923aaa02f0 2024-09-21T07:58:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.904+0000 7fe319200640 1 -- 172.21.15.84:0/2798421490 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004e00 con 0x55923aaa02f0 2024-09-21T07:58:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.905+0000 7fe323400640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3080b67b0 0x7fe3080b8cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe314000c00 tx=0x7fe314005eb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.906+0000 7fe331a17740 1 -- 172.21.15.84:0/2798421490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 msgr2=0x55923ae6e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.906+0000 7fe331a17740 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae6e170 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe31000b9d0 tx=0x7fe31000be90 comp rx=0 tx=0).stop 2024-09-21T07:58:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.907+0000 7fe331a17740 1 -- 172.21.15.84:0/2798421490 shutdown_connections 2024-09-21T07:58:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.907+0000 7fe331a17740 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.907+0000 7fe331a17740 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae6e170 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.907+0000 7fe331a17740 1 --2- 172.21.15.84:0/2798421490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae6dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.907+0000 7fe331a17740 1 -- 172.21.15.84:0/2798421490 >> 172.21.15.84:0/2798421490 conn(0x55923aabd300 msgr2=0x55923ae6bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.907+0000 7fe331a17740 1 -- 172.21.15.84:0/2798421490 shutdown_connections 2024-09-21T07:58:18.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.908+0000 7fe331a17740 1 -- 172.21.15.84:0/2798421490 wait complete. 2024-09-21T07:58:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.908+0000 7fe331a17740 1 -- start start 2024-09-21T07:58:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.909+0000 7fe331a17740 1 Processor -- start 2024-09-21T07:58:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.910+0000 7fe331a17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae79180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.910+0000 7fe331a17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae796c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.911+0000 7fe331a17740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae79c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.911+0000 7fe323400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae796c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.911+0000 7fe323400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae796c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32824/0 (socket says 172.21.15.84:32824) 2024-09-21T07:58:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.911+0000 7fe328a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae79c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.911+0000 7fe328a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae79c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60878/0 (socket says 172.21.15.84:60878) 2024-09-21T07:58:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.911+0000 7fe323400640 1 -- 172.21.15.84:0/1315925741 learned_addr learned my addr 172.21.15.84:0/1315925741 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.912+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55923ad0aab0 con 0x55923aaa84d0 2024-09-21T07:58:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.912+0000 7fe323e00640 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae79180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.912+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55923ad79570 con 0x55923aaa02f0 2024-09-21T07:58:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.912+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55923ae7c3b0 con 0x55923aac91b0 2024-09-21T07:58:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.912+0000 7fe331a17740 10 client.0 _ll_register_callbacks cb 0x55923ad88100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.913+0000 7fe328a00640 1 -- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 msgr2=0x55923ae79180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.913+0000 7fe328a00640 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae79180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.913+0000 7fe328a00640 1 -- 172.21.15.84:0/1315925741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 msgr2=0x55923ae796c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.913+0000 7fe328a00640 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae796c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.913+0000 7fe328a00640 1 -- 172.21.15.84:0/1315925741 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923ab34790 con 0x55923aac91b0 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.914+0000 7fe328a00640 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae79c00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0e5250 tx=0x7fe31c0ad850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7768d595299b0072 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.914+0000 7fe30d600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.914+0000 7fe30d600640 1 -- 172.21.15.84:0/1315925741 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0ad460 con 0x55923aac91b0 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.914+0000 7fe30d600640 1 -- 172.21.15.84:0/1315925741 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fe31c0acbb0 con 0x55923aac91b0 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.914+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3100054d0 con 0x55923aac91b0 2024-09-21T07:58:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.914+0000 7fe30d600640 1 -- 172.21.15.84:0/1315925741 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe31c0ae050 con 0x55923aac91b0 2024-09-21T07:58:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.915+0000 7fe331a17740 10 client.27448 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.915+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55923abad620 con 0x55923aac91b0 2024-09-21T07:58:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.915+0000 7fe30d600640 1 -- 172.21.15.84:0/1315925741 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3100054d0 con 0x55923aac91b0 2024-09-21T07:58:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.915+0000 7fe30d600640 1 -- 172.21.15.84:0/1315925741 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe31c01f020 con 0x55923aac91b0 2024-09-21T07:58:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.916+0000 7fe331a17740 10 client.27448 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.916+0000 7fe331a17740 10 client.27448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.916+0000 7fe331a17740 20 client.27448 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.916+0000 7fe331a17740 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa87d80 0x55923ae8b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.916+0000 7fe331a17740 4 client.27448 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.916+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55923ade5600 con 0x55923aa87d80 2024-09-21T07:58:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.916+0000 7fe323e00640 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa87d80 0x55923ae8b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.917+0000 7fe30d600640 10 client.27448 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.917+0000 7fe323e00640 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa87d80 0x55923ae8b400 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e75625bdf44ea15 server_cookie=bcd5c6d8fa8f549d in_seq=0 out_seq=0 2024-09-21T07:58:18.922 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe30d600640 1 -- 172.21.15.84:0/1315925741 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55923ade5600 con 0x55923aa87d80 2024-09-21T07:58:18.922 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe30d600640 10 client.27448 handle_command_reply: tid=0 2024-09-21T07:58:18.922 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 client.27448 shutdown 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 msgr2=0x55923ae79c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae79c00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0e5250 tx=0x7fe31c0ad850 comp rx=0 tx=0).stop 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 shutdown_connections 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa87d80 0x55923ae8b400 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae79c00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae796c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 --2- 172.21.15.84:0/1315925741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae79180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 >> 172.21.15.84:0/1315925741 conn(0x55923aabd300 msgr2=0x55923ae6ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe30d600640 0 client.27448 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 shutdown_connections 2024-09-21T07:58:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 1 -- 172.21.15.84:0/1315925741 wait complete. 2024-09-21T07:58:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.918+0000 7fe331a17740 20 client.27448 trim_cache size 0 max 16384 2024-09-21T07:58:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.943+0000 7fe331a17740 1 Processor -- start 2024-09-21T07:58:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.943+0000 7fe331a17740 1 -- start start 2024-09-21T07:58:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.943+0000 7fe331a17740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aaa02f0 0x55923ae6aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.944+0000 7fe331a17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.944+0000 7fe331a17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aac91b0 0x55923ae76350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.944+0000 7fe331a17740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe30400ff40 con 0x55923aaa84d0 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.944+0000 7fe328a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aac91b0 0x55923ae76350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe323e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aaa02f0 0x55923ae6aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe328a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aac91b0 0x55923ae76350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48848/0 (socket says 172.21.15.84:48848) 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe328a00640 1 -- 172.21.15.84:0/3725918996 learned_addr learned my addr 172.21.15.84:0/3725918996 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe331a17740 1 -- 172.21.15.84:0/3725918996 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe304011a80 con 0x55923aac91b0 2024-09-21T07:58:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe331a17740 1 -- 172.21.15.84:0/3725918996 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe304010610 con 0x55923aaa02f0 2024-09-21T07:58:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe328a00640 1 -- 172.21.15.84:0/3725918996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aaa02f0 msgr2=0x55923ae6aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe328a00640 1 --2- 172.21.15.84:0/3725918996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aaa02f0 0x55923ae6aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.945+0000 7fe328a00640 1 -- 172.21.15.84:0/3725918996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 msgr2=0x55923ae6f370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:58:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.946+0000 7fe328a00640 1 --2- 172.21.15.84:0/3725918996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.946+0000 7fe328a00640 1 -- 172.21.15.84:0/3725918996 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923ae6c420 con 0x55923aac91b0 2024-09-21T07:58:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.946+0000 7fe328a00640 1 --2- 172.21.15.84:0/3725918996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aac91b0 0x55923ae76350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0d1180 tx=0x7fe31c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b7fa27a230ab94e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.947+0000 7fe30fe00640 1 -- 172.21.15.84:0/3725918996 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0ad460 con 0x55923aac91b0 2024-09-21T07:58:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.947+0000 7fe30fe00640 1 -- 172.21.15.84:0/3725918996 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe31c0b2430 con 0x55923aac91b0 2024-09-21T07:58:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.947+0000 7fe30fe00640 1 -- 172.21.15.84:0/3725918996 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0c3b00 con 0x55923aac91b0 2024-09-21T07:58:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.950+0000 7fe331a17740 1 -- 172.21.15.84:0/3725918996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aac91b0 msgr2=0x55923ae76350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.950+0000 7fe331a17740 1 --2- 172.21.15.84:0/3725918996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aac91b0 0x55923ae76350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0d1180 tx=0x7fe31c009f90 comp rx=0 tx=0).stop 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.950+0000 7fe331a17740 1 -- 172.21.15.84:0/3725918996 shutdown_connections 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.951+0000 7fe331a17740 1 --2- 172.21.15.84:0/3725918996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aac91b0 0x55923ae76350 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.951+0000 7fe331a17740 1 --2- 172.21.15.84:0/3725918996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae6f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.951+0000 7fe331a17740 1 --2- 172.21.15.84:0/3725918996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aaa02f0 0x55923ae6aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.951+0000 7fe331a17740 1 -- 172.21.15.84:0/3725918996 >> 172.21.15.84:0/3725918996 conn(0x55923aabd300 msgr2=0x55923ae6ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.952+0000 7fe331a17740 1 -- 172.21.15.84:0/3725918996 shutdown_connections 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.952+0000 7fe331a17740 1 -- 172.21.15.84:0/3725918996 wait complete. 2024-09-21T07:58:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.953+0000 7fe331a17740 1 -- start start 2024-09-21T07:58:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.953+0000 7fe331a17740 1 Processor -- start 2024-09-21T07:58:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe331a17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae7f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe331a17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae7fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe331a17740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae800d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe331a17740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe3040113b0 con 0x55923aaa84d0 2024-09-21T07:58:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe331a17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe304010ce0 con 0x55923aaa02f0 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe331a17740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe30400df40 con 0x55923aac91b0 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe331a17740 10 client.0 _ll_register_callbacks cb 0x7fe31c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.954+0000 7fe323400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae7fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae7f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae7fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32840/0 (socket says 172.21.15.84:32840) 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323400640 1 -- 172.21.15.84:0/53483090 learned_addr learned my addr 172.21.15.84:0/53483090 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323400640 1 -- 172.21.15.84:0/53483090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 msgr2=0x55923ae800d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323400640 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323400640 1 -- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 msgr2=0x55923ae7f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323400640 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae7f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:18.959 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.955+0000 7fe323400640 1 -- 172.21.15.84:0/53483090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923aef4dd0 con 0x55923aaa84d0 2024-09-21T07:58:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.956+0000 7fe323e00640 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae7f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.956+0000 7fe323400640 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae7fb90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe31402aa00 tx=0x7fe31402a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aef75013219af58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:18.961 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.956+0000 7fe30d600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.957+0000 7fe30d600640 1 -- 172.21.15.84:0/53483090 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31404f070 con 0x55923aaa84d0 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.957+0000 7fe30d600640 1 -- 172.21.15.84:0/53483090 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fe3140316b0 con 0x55923aaa84d0 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.957+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe31c0b2430 con 0x55923aaa84d0 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.957+0000 7fe30d600640 1 -- 172.21.15.84:0/53483090 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe31405b050 con 0x55923aaa84d0 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.957+0000 7fe331a17740 10 client.17169 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.957+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55923aef6030 con 0x55923aaa84d0 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe30d600640 1 -- 172.21.15.84:0/53483090 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe31c0b2430 con 0x55923aaa84d0 2024-09-21T07:58:18.962 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe30d600640 1 -- 172.21.15.84:0/53483090 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe31404ba60 con 0x55923aaa84d0 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe331a17740 10 client.17169 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe331a17740 10 client.17169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe331a17740 20 client.17169 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe331a17740 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa5d1c0 0x55923aef8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe331a17740 4 client.17169 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.958+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55923ade10b0 con 0x55923aa5d1c0 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.959+0000 7fe323e00640 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa5d1c0 0x55923aef8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.959+0000 7fe30d600640 10 client.17169 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:18.963 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:18.959+0000 7fe323e00640 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa5d1c0 0x55923aef8820 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac5ba1e3b656f43f server_cookie=897c5b18e09278cc in_seq=0 out_seq=0 2024-09-21T07:58:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.010+0000 7fe30d600640 1 -- 172.21.15.84:0/53483090 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55923ade10b0 con 0x55923aa5d1c0 2024-09-21T07:58:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.010+0000 7fe30d600640 10 client.17169 handle_command_reply: tid=0 2024-09-21T07:58:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.010+0000 7fe331a17740 1 client.17169 shutdown 2024-09-21T07:58:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 msgr2=0x55923ae7fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae7fb90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe31402aa00 tx=0x7fe31402a910 comp rx=0 tx=0).stop 2024-09-21T07:58:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 shutdown_connections 2024-09-21T07:58:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55923aa5d1c0 0x55923aef8820 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55923aac91b0 0x55923ae800d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55923aaa84d0 0x55923ae7fb90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 --2- 172.21.15.84:0/53483090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55923aaa02f0 0x55923ae7f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe30d600640 0 client.17169 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 >> 172.21.15.84:0/53483090 conn(0x55923aabd300 msgr2=0x55923ae6a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.011+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 shutdown_connections 2024-09-21T07:58:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.012+0000 7fe331a17740 1 -- 172.21.15.84:0/53483090 wait complete. 2024-09-21T07:58:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.013+0000 7fe331a17740 20 client.17169 trim_cache size 0 max 16384 2024-09-21T07:58:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:58:19.017 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:58:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:58:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:58:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3080b67b0 msgr2=0x7fe3080b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3080b67b0 0x7fe3080b8cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe314000c00 tx=0x7fe314005eb0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 msgr2=0x7fe324070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 0x7fe324070aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00efd0 tx=0x7fe31c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 shutdown_connections 2024-09-21T07:58:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe3080b67b0 0x7fe3080b8cc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe324110360 0x7fe324070aa0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe32410fa10 0x7fe324070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 --2- 172.21.15.84:0/3067095941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe32410a0e0 0x7fe324075070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.017+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 >> 172.21.15.84:0/3067095941 conn(0x7fe324079630 msgr2=0x7fe3241087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.019+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 shutdown_connections 2024-09-21T07:58:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:19.019+0000 7fe32aa00640 1 -- 172.21.15.84:0/3067095941 wait complete. 2024-09-21T07:58:19.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:18 smithi162 ceph-mon[34833]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T07:58:19.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:18 smithi162 ceph-mon[34833]: pgmap v614: 129 pgs: 129 active+clean; 50 GiB data, 105 GiB used, 968 GiB / 1.0 TiB avail; 22 KiB/s rd, 177 MiB/s wr, 1.90k op/s 2024-09-21T07:58:19.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:18 smithi084 ceph-mon[30411]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T07:58:19.059 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:18 smithi084 ceph-mon[30411]: pgmap v614: 129 pgs: 129 active+clean; 50 GiB data, 105 GiB used, 968 GiB / 1.0 TiB avail; 22 KiB/s rd, 177 MiB/s wr, 1.90k op/s 2024-09-21T07:58:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:18 smithi191 ceph-mon[34667]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T07:58:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:18 smithi191 ceph-mon[34667]: pgmap v614: 129 pgs: 129 active+clean; 50 GiB data, 105 GiB used, 968 GiB / 1.0 TiB avail; 22 KiB/s rd, 177 MiB/s wr, 1.90k op/s 2024-09-21T07:58:21.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:58:21.538 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:21 smithi084 ceph-mon[30411]: pgmap v615: 129 pgs: 129 active+clean; 51 GiB data, 106 GiB used, 967 GiB / 1.0 TiB avail; 22 KiB/s rd, 180 MiB/s wr, 1.90k op/s 2024-09-21T07:58:21.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:21 smithi162 ceph-mon[34833]: pgmap v615: 129 pgs: 129 active+clean; 51 GiB data, 106 GiB used, 967 GiB / 1.0 TiB avail; 22 KiB/s rd, 180 MiB/s wr, 1.90k op/s 2024-09-21T07:58:21.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:21 smithi191 ceph-mon[34667]: pgmap v615: 129 pgs: 129 active+clean; 51 GiB data, 106 GiB used, 967 GiB / 1.0 TiB avail; 22 KiB/s rd, 180 MiB/s wr, 1.90k op/s 2024-09-21T07:58:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:23.496 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:23 smithi084 ceph-mon[30411]: pgmap v616: 129 pgs: 129 active+clean; 51 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 45 KiB/s rd, 186 MiB/s wr, 1.87k op/s 2024-09-21T07:58:23.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:23 smithi162 ceph-mon[34833]: pgmap v616: 129 pgs: 129 active+clean; 51 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 45 KiB/s rd, 186 MiB/s wr, 1.87k op/s 2024-09-21T07:58:23.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:23 smithi191 ceph-mon[34667]: pgmap v616: 129 pgs: 129 active+clean; 51 GiB data, 106 GiB used, 966 GiB / 1.0 TiB avail; 45 KiB/s rd, 186 MiB/s wr, 1.87k op/s 2024-09-21T07:58:25.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:25 smithi162 ceph-mon[34833]: pgmap v617: 129 pgs: 129 active+clean; 52 GiB data, 107 GiB used, 966 GiB / 1.0 TiB avail; 44 KiB/s rd, 189 MiB/s wr, 1.74k op/s 2024-09-21T07:58:25.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:25 smithi084 ceph-mon[30411]: pgmap v617: 129 pgs: 129 active+clean; 52 GiB data, 107 GiB used, 966 GiB / 1.0 TiB avail; 44 KiB/s rd, 189 MiB/s wr, 1.74k op/s 2024-09-21T07:58:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:25 smithi191 ceph-mon[34667]: pgmap v617: 129 pgs: 129 active+clean; 52 GiB data, 107 GiB used, 966 GiB / 1.0 TiB avail; 44 KiB/s rd, 189 MiB/s wr, 1.74k op/s 2024-09-21T07:58:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.695+0000 7f3521a00640 1 -- 172.21.15.84:0/390851739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10ad10 msgr2=0x7f351c116fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.695+0000 7f3521a00640 1 --2- 172.21.15.84:0/390851739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10ad10 0x7f351c116fc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3514005fd0 tx=0x7f351402c6b0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.696+0000 7f3521a00640 1 -- 172.21.15.84:0/390851739 shutdown_connections 2024-09-21T07:58:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.697+0000 7f3521a00640 1 --2- 172.21.15.84:0/390851739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10ad10 0x7f351c116fc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.697+0000 7f3521a00640 1 --2- 172.21.15.84:0/390851739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c10a3c0 0x7f351c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.697+0000 7f3521a00640 1 --2- 172.21.15.84:0/390851739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351c10f150 0x7f351c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.697+0000 7f3521a00640 1 -- 172.21.15.84:0/390851739 >> 172.21.15.84:0/390851739 conn(0x7f351c0712f0 msgr2=0x7f351c073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:27.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.704+0000 7f3521a00640 1 -- 172.21.15.84:0/390851739 shutdown_connections 2024-09-21T07:58:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.704+0000 7f3521a00640 1 -- 172.21.15.84:0/390851739 wait complete. 2024-09-21T07:58:27.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.716+0000 7f3521a00640 1 Processor -- start 2024-09-21T07:58:27.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.717+0000 7f3521a00640 1 -- start start 2024-09-21T07:58:27.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.720+0000 7f3521a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351c10a3c0 0x7f351c115fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.723+0000 7f3521a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c10ad10 0x7f351c116560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.723+0000 7f3521a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10f150 0x7f351c1ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.723+0000 7f3521a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f351c119710 con 0x7f351c10ad10 2024-09-21T07:58:27.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.723+0000 7f3521a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f351c119590 con 0x7f351c10a3c0 2024-09-21T07:58:27.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.723+0000 7f3521a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f351c119890 con 0x7f351c10f150 2024-09-21T07:58:27.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.724+0000 7f351aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351c10a3c0 0x7f351c115fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.724+0000 7f351b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10f150 0x7f351c1ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.724+0000 7f351b400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10f150 0x7f351c1ab8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60926/0 (socket says 172.21.15.84:60926) 2024-09-21T07:58:27.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.724+0000 7f351b400640 1 -- 172.21.15.84:0/1286577919 learned_addr learned my addr 172.21.15.84:0/1286577919 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:27.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.725+0000 7f351b400640 1 -- 172.21.15.84:0/1286577919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351c10a3c0 msgr2=0x7f351c115fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.725+0000 7f351b400640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351c10a3c0 0x7f351c115fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.725+0000 7f351b400640 1 -- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c10ad10 msgr2=0x7f351c116560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.725+0000 7f351b400640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c10ad10 0x7f351c116560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.725+0000 7f351b400640 1 -- 172.21.15.84:0/1286577919 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351c1abff0 con 0x7f351c10f150 2024-09-21T07:58:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.728+0000 7f351b400640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10f150 0x7f351c1ab8c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3514036040 tx=0x7f351400a960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:27.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.728+0000 7f3513400640 1 -- 172.21.15.84:0/1286577919 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514038070 con 0x7f351c10f150 2024-09-21T07:58:27.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.730+0000 7f3513400640 1 -- 172.21.15.84:0/1286577919 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f351403a070 con 0x7f351c10f150 2024-09-21T07:58:27.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.730+0000 7f3513400640 1 -- 172.21.15.84:0/1286577919 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35140045a0 con 0x7f351c10f150 2024-09-21T07:58:27.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.735+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351c1ac280 con 0x7f351c10f150 2024-09-21T07:58:27.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.736+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351c1ac680 con 0x7f351c10f150 2024-09-21T07:58:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.745+0000 7f3513400640 1 -- 172.21.15.84:0/1286577919 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3514003970 con 0x7f351c10f150 2024-09-21T07:58:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.748+0000 7f3513400640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35000b6730 0x7f35000b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.750+0000 7f351aa00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35000b6730 0x7f35000b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.751+0000 7f3513400640 1 -- 172.21.15.84:0/1286577919 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f3514033bc0 con 0x7f351c10f150 2024-09-21T07:58:27.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.753+0000 7f351aa00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35000b6730 0x7f35000b8c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f350c0096c0 tx=0x7f350c009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:27.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.769+0000 7f3528691740 1 Processor -- start 2024-09-21T07:58:27.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.769+0000 7f3528691740 1 -- start start 2024-09-21T07:58:27.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.770+0000 7f3528691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.771+0000 7f3528691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89dd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.771+0000 7f3528691740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89dd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.771+0000 7f351aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.771+0000 7f351aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89dcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48890/0 (socket says 172.21.15.84:48890) 2024-09-21T07:58:27.774 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:27 smithi084 ceph-mon[30411]: pgmap v618: 129 pgs: 129 active+clean; 52 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 41 KiB/s rd, 215 MiB/s wr, 1.82k op/s 2024-09-21T07:58:27.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.772+0000 7f351a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89dd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.773+0000 7f351a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89dd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60932/0 (socket says 172.21.15.84:60932) 2024-09-21T07:58:27.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.773+0000 7f351aa00640 1 -- 172.21.15.84:0/3385811006 learned_addr learned my addr 172.21.15.84:0/3385811006 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:27.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.773+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555cd8953fb0 con 0x555cd8615390 2024-09-21T07:58:27.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.773+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555cd89433e0 con 0x555cd8636070 2024-09-21T07:58:27.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.773+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555cd89471f0 con 0x555cd860d1b0 2024-09-21T07:58:27.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.774+0000 7f351a000640 1 -- 172.21.15.84:0/3385811006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 msgr2=0x555cd89dcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:27.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.774+0000 7f351a000640 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89dcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.774+0000 7f351a000640 1 -- 172.21.15.84:0/3385811006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 msgr2=0x555cd89dd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:27.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.775+0000 7f351a000640 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89dd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.775+0000 7f351a000640 1 -- 172.21.15.84:0/3385811006 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cd890dcd0 con 0x555cd860d1b0 2024-09-21T07:58:27.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.775+0000 7f351aa00640 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:27.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.776+0000 7f351a000640 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89dd2e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f351c06c970 tx=0x7f350800e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd8fd873e7601fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:27.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.777+0000 7f3507e00640 1 -- 172.21.15.84:0/3385811006 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350800ed50 con 0x555cd860d1b0 2024-09-21T07:58:27.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.778+0000 7f3507e00640 1 -- 172.21.15.84:0/3385811006 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35080054d0 con 0x555cd860d1b0 2024-09-21T07:58:27.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.779+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 msgr2=0x555cd89dd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.780+0000 7f3507e00640 1 -- 172.21.15.84:0/3385811006 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350800ed50 con 0x555cd860d1b0 2024-09-21T07:58:27.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.780+0000 7f3528691740 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89dd2e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f351c06c970 tx=0x7f350800e350 comp rx=0 tx=0).stop 2024-09-21T07:58:27.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.782+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 shutdown_connections 2024-09-21T07:58:27.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.782+0000 7f3528691740 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89dd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.782+0000 7f3528691740 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89dd2e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.782+0000 7f3528691740 1 --2- 172.21.15.84:0/3385811006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.782+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 >> 172.21.15.84:0/3385811006 conn(0x555cd862a460 msgr2=0x555cd89dac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:27.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.783+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 shutdown_connections 2024-09-21T07:58:27.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.783+0000 7f3528691740 1 -- 172.21.15.84:0/3385811006 wait complete. 2024-09-21T07:58:27.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.785+0000 7f3528691740 1 -- start start 2024-09-21T07:58:27.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.785+0000 7f3528691740 1 Processor -- start 2024-09-21T07:58:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.790+0000 7f3528691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89e8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.790+0000 7f3528691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8615390 0x555cd89e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.791+0000 7f351aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.791+0000 7f351aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89e8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60938/0 (socket says 172.21.15.84:60938) 2024-09-21T07:58:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.791+0000 7f351a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8615390 0x555cd89e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.791+0000 7f351a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8615390 0x555cd89e89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48906/0 (socket says 172.21.15.84:48906) 2024-09-21T07:58:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.792+0000 7f351aa00640 1 -- 172.21.15.84:0/1746556218 learned_addr learned my addr 172.21.15.84:0/1746556218 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.792+0000 7f3528691740 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 0x555cd89f4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.792+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555cd87a4700 con 0x555cd8636070 2024-09-21T07:58:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.793+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555cd88de580 con 0x555cd8615390 2024-09-21T07:58:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.793+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555cd89eb5d0 con 0x555cd860d1b0 2024-09-21T07:58:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.794+0000 7f351aa00640 1 -- 172.21.15.84:0/1746556218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8615390 msgr2=0x555cd89e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.794+0000 7f351aa00640 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8615390 0x555cd89e89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.794+0000 7f351aa00640 1 -- 172.21.15.84:0/1746556218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 msgr2=0x555cd89f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.794+0000 7f351aa00640 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 0x555cd89f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.794+0000 7f3528691740 10 client.0 _ll_register_callbacks cb 0x555cd88ee470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.794+0000 7f351aa00640 1 -- 172.21.15.84:0/1746556218 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cd86a1650 con 0x555cd860d1b0 2024-09-21T07:58:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.795+0000 7f351a000640 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8615390 0x555cd89e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:27.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.795+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555cd88e0b90 con 0x555cd860d1b0 2024-09-21T07:58:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.798+0000 7f351aa00640 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89e8470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f350c0124c0 tx=0x7f350c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f1f429dde47677 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.798+0000 7f3504c00640 10 client.27463 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:27.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:27 smithi162 ceph-mon[34833]: pgmap v618: 129 pgs: 129 active+clean; 52 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 41 KiB/s rd, 215 MiB/s wr, 1.82k op/s 2024-09-21T07:58:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.798+0000 7f3504c00640 1 -- 172.21.15.84:0/1746556218 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c005220 con 0x555cd860d1b0 2024-09-21T07:58:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.798+0000 7f3504c00640 1 -- 172.21.15.84:0/1746556218 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f350c0053c0 con 0x555cd860d1b0 2024-09-21T07:58:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.799+0000 7f3504c00640 1 -- 172.21.15.84:0/1746556218 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f350c005600 con 0x555cd860d1b0 2024-09-21T07:58:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.800+0000 7f3528691740 10 client.27463 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.800+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555cd88fb950 con 0x555cd860d1b0 2024-09-21T07:58:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.801+0000 7f3504c00640 1 -- 172.21.15.84:0/1746556218 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f350c00f040 con 0x555cd860d1b0 2024-09-21T07:58:27.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.802+0000 7f3528691740 10 client.27463 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:27.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.802+0000 7f3528691740 10 client.27463 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:58:27.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.802+0000 7f3528691740 20 client.27463 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:27.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.802+0000 7f3528691740 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85f49f0 0x555cd89fa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.802+0000 7f3528691740 4 client.27463 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:27.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.802+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cd8955f00 con 0x555cd85f49f0 2024-09-21T07:58:27.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.803+0000 7f351a000640 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85f49f0 0x555cd89fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.803+0000 7f3504c00640 10 client.27463 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:58:27.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.803+0000 7f351a000640 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85f49f0 0x555cd89fa630 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1950e50bb69980b server_cookie=ebaba2f47403fc0d in_seq=0 out_seq=0 2024-09-21T07:58:27.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.805+0000 7f3504c00640 1 -- 172.21.15.84:0/1746556218 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cd8955f00 con 0x555cd85f49f0 2024-09-21T07:58:27.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.805+0000 7f3504c00640 10 client.27463 handle_command_reply: tid=0 2024-09-21T07:58:27.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.805+0000 7f3528691740 1 client.27463 shutdown 2024-09-21T07:58:27.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.805+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 msgr2=0x555cd89e8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.805+0000 7f3528691740 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89e8470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f350c0124c0 tx=0x7f350c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.805+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 shutdown_connections 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.805+0000 7f3528691740 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85f49f0 0x555cd89fa630 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.806+0000 7f3528691740 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 0x555cd89f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.806+0000 7f3528691740 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8615390 0x555cd89e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.806+0000 7f3528691740 1 --2- 172.21.15.84:0/1746556218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89e8470 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.806+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 >> 172.21.15.84:0/1746556218 conn(0x555cd862a460 msgr2=0x555cd89dff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:27.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.806+0000 7f3504c00640 0 client.27463 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:58:27.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.806+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 shutdown_connections 2024-09-21T07:58:27.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.807+0000 7f3528691740 1 -- 172.21.15.84:0/1746556218 wait complete. 2024-09-21T07:58:27.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.807+0000 7f3528691740 20 client.27463 trim_cache size 0 max 16384 2024-09-21T07:58:27.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.850+0000 7f3528691740 1 Processor -- start 2024-09-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.865+0000 7f3528691740 1 -- start start 2024-09-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.866+0000 7f3528691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd860d1b0 0x555cd89e9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.866+0000 7f3528691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd8615390 0x555cd89da260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.866+0000 7f3528691740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 0x555cd89da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.866+0000 7f3528691740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1bfc40 con 0x555cd8636070 2024-09-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.866+0000 7f3528691740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1c1780 con 0x555cd860d1b0 2024-09-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.866+0000 7f3528691740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1c0310 con 0x555cd8615390 2024-09-21T07:58:27.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.867+0000 7f351aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd860d1b0 0x555cd89e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.868+0000 7f351aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd860d1b0 0x555cd89e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34658/0 (socket says 172.21.15.84:34658) 2024-09-21T07:58:27.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.868+0000 7f351aa00640 1 -- 172.21.15.84:0/596088784 learned_addr learned my addr 172.21.15.84:0/596088784 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.868+0000 7f351a000640 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd8615390 0x555cd89da260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.869+0000 7f351a000640 1 -- 172.21.15.84:0/596088784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd860d1b0 msgr2=0x555cd89e9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.869+0000 7f351a000640 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd860d1b0 0x555cd89e9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.869+0000 7f351a000640 1 -- 172.21.15.84:0/596088784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 msgr2=0x555cd89da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.869+0000 7f351a000640 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 0x555cd89da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.869+0000 7f351a000640 1 -- 172.21.15.84:0/596088784 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cd89ea840 con 0x555cd8615390 2024-09-21T07:58:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.871+0000 7f351a000640 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd8615390 0x555cd89da260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x555cd89fad90 tx=0x7f3508009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce2da15ef2eb8d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.871+0000 7f3507400640 1 -- 172.21.15.84:0/596088784 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350801d040 con 0x555cd8615390 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.871+0000 7f3507400640 1 -- 172.21.15.84:0/596088784 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35080047a0 con 0x555cd8615390 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.871+0000 7f3507400640 1 -- 172.21.15.84:0/596088784 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350801d040 con 0x555cd8615390 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.875+0000 7f3528691740 1 -- 172.21.15.84:0/596088784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd8615390 msgr2=0x555cd89da260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.875+0000 7f3528691740 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd8615390 0x555cd89da260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x555cd89fad90 tx=0x7f3508009770 comp rx=0 tx=0).stop 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.875+0000 7f3528691740 1 -- 172.21.15.84:0/596088784 shutdown_connections 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.875+0000 7f3528691740 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8636070 0x555cd89da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.876+0000 7f3528691740 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd8615390 0x555cd89da260 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.876+0000 7f3528691740 1 --2- 172.21.15.84:0/596088784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd860d1b0 0x555cd89e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.876+0000 7f3528691740 1 -- 172.21.15.84:0/596088784 >> 172.21.15.84:0/596088784 conn(0x555cd862a460 msgr2=0x555cd89de790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:27.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.878+0000 7f3528691740 1 -- 172.21.15.84:0/596088784 shutdown_connections 2024-09-21T07:58:27.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.878+0000 7f3528691740 1 -- 172.21.15.84:0/596088784 wait complete. 2024-09-21T07:58:27.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.881+0000 7f3528691740 1 -- start start 2024-09-21T07:58:27.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.884+0000 7f3528691740 1 Processor -- start 2024-09-21T07:58:27.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.888+0000 7f3528691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.889+0000 7f3528691740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.892+0000 7f3528691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89eced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.892+0000 7f3528691740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1c10b0 con 0x555cd8615390 2024-09-21T07:58:27.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.892+0000 7f3528691740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1c09e0 con 0x555cd8636070 2024-09-21T07:58:27.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.892+0000 7f3528691740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1bdc40 con 0x555cd860d1b0 2024-09-21T07:58:27.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.892+0000 7f3528691740 10 client.0 _ll_register_callbacks cb 0x7f350c010c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:27.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.892+0000 7f351aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.893+0000 7f351b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.893+0000 7f351b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89eced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34662/0 (socket says 172.21.15.84:34662) 2024-09-21T07:58:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.893+0000 7f351b400640 1 -- 172.21.15.84:0/369633143 learned_addr learned my addr 172.21.15.84:0/369633143 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.893+0000 7f351aa00640 1 -- 172.21.15.84:0/369633143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 msgr2=0x555cd89eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.893+0000 7f351aa00640 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.893+0000 7f351aa00640 1 -- 172.21.15.84:0/369633143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 msgr2=0x555cd89ec7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:58:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.896+0000 7f351a000640 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.896+0000 7f351aa00640 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89ec7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.896+0000 7f351aa00640 1 -- 172.21.15.84:0/369633143 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cd8a63ff0 con 0x555cd860d1b0 2024-09-21T07:58:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.896+0000 7f351a000640 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:27.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.898+0000 7f351aa00640 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89f12d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f350c006010 tx=0x7f350c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b374f3af38840480 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:27.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.898+0000 7f3504c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:27.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.898+0000 7f3504c00640 1 -- 172.21.15.84:0/369633143 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c044060 con 0x555cd860d1b0 2024-09-21T07:58:27.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.898+0000 7f3504c00640 1 -- 172.21.15.84:0/369633143 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f350c004da0 con 0x555cd860d1b0 2024-09-21T07:58:27.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.899+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555cd89519b0 con 0x555cd860d1b0 2024-09-21T07:58:27.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.899+0000 7f3504c00640 1 -- 172.21.15.84:0/369633143 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f350c039040 con 0x555cd860d1b0 2024-09-21T07:58:27.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.899+0000 7f3528691740 10 client.27469 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:27.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.899+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555cd8a65140 con 0x555cd860d1b0 2024-09-21T07:58:27.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.900+0000 7f3504c00640 1 -- 172.21.15.84:0/369633143 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555cd89519b0 con 0x555cd860d1b0 2024-09-21T07:58:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.901+0000 7f3504c00640 1 -- 172.21.15.84:0/369633143 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f350c0327a0 con 0x555cd860d1b0 2024-09-21T07:58:27.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:27 smithi191 ceph-mon[34667]: pgmap v618: 129 pgs: 129 active+clean; 52 GiB data, 108 GiB used, 965 GiB / 1.0 TiB avail; 41 KiB/s rd, 215 MiB/s wr, 1.82k op/s 2024-09-21T07:58:27.909 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:58:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.902+0000 7f3528691740 10 client.27469 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.902+0000 7f3528691740 10 client.27469 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:58:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.902+0000 7f3528691740 20 client.27469 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.902+0000 7f3528691740 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85c9da0 0x555cd8a678a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.902+0000 7f3528691740 4 client.27469 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.902+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555cd894ede0 con 0x555cd85c9da0 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.902+0000 7f351a000640 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85c9da0 0x555cd8a678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.903+0000 7f351a000640 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85c9da0 0x555cd8a678a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5599c55d6e7343ee server_cookie=3612311b7063ff36 in_seq=0 out_seq=0 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.903+0000 7f3504c00640 10 client.27469 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.904+0000 7f3504c00640 1 -- 172.21.15.84:0/369633143 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555cd894ede0 con 0x555cd85c9da0 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.904+0000 7f3504c00640 10 client.27469 handle_command_reply: tid=0 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.904+0000 7f3528691740 1 client.27469 shutdown 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 msgr2=0x555cd89f12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89f12d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f350c006010 tx=0x7f350c017000 comp rx=0 tx=0).stop 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 shutdown_connections 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x555cd85c9da0 0x555cd8a678a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555cd8636070 0x555cd89eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cd8615390 0x555cd89ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 --2- 172.21.15.84:0/369633143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555cd860d1b0 0x555cd89f12d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 >> 172.21.15.84:0/369633143 conn(0x555cd862a460 msgr2=0x555cd89e98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:27.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3504c00640 0 client.27469 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:58:27.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.905+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 shutdown_connections 2024-09-21T07:58:27.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.906+0000 7f3528691740 1 -- 172.21.15.84:0/369633143 wait complete. 2024-09-21T07:58:27.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.906+0000 7f3528691740 20 client.27469 trim_cache size 0 max 16384 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35000b6730 msgr2=0x7f35000b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35000b6730 0x7f35000b8c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f350c0096c0 tx=0x7f350c009260 comp rx=0 tx=0).stop 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10f150 msgr2=0x7f351c1ab8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10f150 0x7f351c1ab8c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3514036040 tx=0x7f351400a960 comp rx=0 tx=0).stop 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 shutdown_connections 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35000b6730 0x7f35000b8c40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f351c10f150 0x7f351c1ab8c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.908+0000 7f3521a00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c10ad10 0x7f351c116560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.909+0000 7f3521a00640 1 --2- 172.21.15.84:0/1286577919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f351c10a3c0 0x7f351c115fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.909+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 >> 172.21.15.84:0/1286577919 conn(0x7f351c0712f0 msgr2=0x7f351c11bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.909+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 shutdown_connections 2024-09-21T07:58:27.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:27.909+0000 7f3521a00640 1 -- 172.21.15.84:0/1286577919 wait complete. 2024-09-21T07:58:28.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:58:29.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:29 smithi162 ceph-mon[34833]: pgmap v619: 129 pgs: 129 active+clean; 52 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 38 KiB/s rd, 215 MiB/s wr, 1.70k op/s 2024-09-21T07:58:29.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:29 smithi084 ceph-mon[30411]: pgmap v619: 129 pgs: 129 active+clean; 52 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 38 KiB/s rd, 215 MiB/s wr, 1.70k op/s 2024-09-21T07:58:29.868 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:29.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:29 smithi191 ceph-mon[34667]: pgmap v619: 129 pgs: 129 active+clean; 52 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 38 KiB/s rd, 215 MiB/s wr, 1.70k op/s 2024-09-21T07:58:31.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:31 smithi162 ceph-mon[34833]: pgmap v620: 129 pgs: 129 active+clean; 53 GiB data, 111 GiB used, 962 GiB / 1.0 TiB avail; 36 KiB/s rd, 265 MiB/s wr, 1.90k op/s 2024-09-21T07:58:31.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:31 smithi084 ceph-mon[30411]: pgmap v620: 129 pgs: 129 active+clean; 53 GiB data, 111 GiB used, 962 GiB / 1.0 TiB avail; 36 KiB/s rd, 265 MiB/s wr, 1.90k op/s 2024-09-21T07:58:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:31 smithi191 ceph-mon[34667]: pgmap v620: 129 pgs: 129 active+clean; 53 GiB data, 111 GiB used, 962 GiB / 1.0 TiB avail; 36 KiB/s rd, 265 MiB/s wr, 1.90k op/s 2024-09-21T07:58:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.349+0000 7f9922400640 1 -- 172.21.15.84:0/2634147483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 msgr2=0x7f9914099d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.349+0000 7f9922400640 1 --2- 172.21.15.84:0/2634147483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 0x7f9914099d10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f990801a910 tx=0x7f990803b450 comp rx=0 tx=0).stop 2024-09-21T07:58:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.349+0000 7f9922400640 1 -- 172.21.15.84:0/2634147483 shutdown_connections 2024-09-21T07:58:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.351+0000 7f9922400640 1 --2- 172.21.15.84:0/2634147483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991409a250 0x7f991409a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.351+0000 7f9922400640 1 --2- 172.21.15.84:0/2634147483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 0x7f9914099d10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.351+0000 7f9922400640 1 --2- 172.21.15.84:0/2634147483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9914094cc0 0x7f99140950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.351+0000 7f9922400640 1 -- 172.21.15.84:0/2634147483 >> 172.21.15.84:0/2634147483 conn(0x7f991400cd90 msgr2=0x7f991400d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.351+0000 7f9922400640 1 -- 172.21.15.84:0/2634147483 shutdown_connections 2024-09-21T07:58:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.351+0000 7f9922400640 1 -- 172.21.15.84:0/2634147483 wait complete. 2024-09-21T07:58:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.353+0000 7f9922400640 1 Processor -- start 2024-09-21T07:58:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.353+0000 7f9922400640 1 -- start start 2024-09-21T07:58:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.353+0000 7f9922400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9914094cc0 0x7f99140a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.354+0000 7f9922400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 0x7f99140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.354+0000 7f9922400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f991409a250 0x7f99140a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.354+0000 7f9922400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f991409dbb0 con 0x7f99140956f0 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.354+0000 7f9922400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f991409da30 con 0x7f9914094cc0 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.354+0000 7f9922400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f991409dd30 con 0x7f991409a250 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.354+0000 7f991be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 0x7f99140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.355+0000 7f991be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 0x7f99140a5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33944/0 (socket says 172.21.15.84:33944) 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.355+0000 7f991be00640 1 -- 172.21.15.84:0/718622869 learned_addr learned my addr 172.21.15.84:0/718622869 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.355+0000 7f9921000640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9914094cc0 0x7f99140a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.356+0000 7f9921a00640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f991409a250 0x7f99140a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.357+0000 7f9921000640 1 -- 172.21.15.84:0/718622869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f991409a250 msgr2=0x7f99140a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.357+0000 7f9921000640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f991409a250 0x7f99140a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.357+0000 7f9921000640 1 -- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 msgr2=0x7f99140a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.357+0000 7f9921000640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 0x7f99140a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.357+0000 7f9921000640 1 -- 172.21.15.84:0/718622869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9914136bd0 con 0x7f9914094cc0 2024-09-21T07:58:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.358+0000 7f9921000640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9914094cc0 0x7f99140a94c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9910009fd0 tx=0x7f991000b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.362+0000 7f9919600640 1 -- 172.21.15.84:0/718622869 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910015020 con 0x7f9914094cc0 2024-09-21T07:58:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.362+0000 7f9919600640 1 -- 172.21.15.84:0/718622869 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9910011ce0 con 0x7f9914094cc0 2024-09-21T07:58:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.362+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9914136da0 con 0x7f9914094cc0 2024-09-21T07:58:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.362+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9914137200 con 0x7f9914094cc0 2024-09-21T07:58:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.363+0000 7f9919600640 1 -- 172.21.15.84:0/718622869 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991000f2e0 con 0x7f9914094cc0 2024-09-21T07:58:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.371+0000 7f992ac0f740 1 Processor -- start 2024-09-21T07:58:32.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.372+0000 7f992ac0f740 1 -- start start 2024-09-21T07:58:32.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.372+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c7031b0 0x55719caa7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719caa8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719caa8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f992ac0f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55719ca1d6b0 con 0x55719c7031b0 2024-09-21T07:58:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f992ac0f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55719ca0cae0 con 0x55719c6e24d0 2024-09-21T07:58:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f992ac0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55719ca108f0 con 0x55719c6da2f0 2024-09-21T07:58:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f991be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719caa8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f991be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719caa8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34690/0 (socket says 172.21.15.84:34690) 2024-09-21T07:58:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f991be00640 1 -- 172.21.15.84:0/4236200120 learned_addr learned my addr 172.21.15.84:0/4236200120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.373+0000 7f9921a00640 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c7031b0 0x55719caa7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.374+0000 7f991be00640 1 -- 172.21.15.84:0/4236200120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 msgr2=0x55719caa8350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.374+0000 7f991be00640 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719caa8350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.374+0000 7f991be00640 1 -- 172.21.15.84:0/4236200120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c7031b0 msgr2=0x55719caa7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.374+0000 7f991be00640 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c7031b0 0x55719caa7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.374+0000 7f991be00640 1 -- 172.21.15.84:0/4236200120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719c9d9780 con 0x55719c6e24d0 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.374+0000 7f9921a00640 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c7031b0 0x55719caa7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.375+0000 7f991be00640 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719caa8890 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9908004a00 tx=0x7f9908004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=191d46e63dbecd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:32.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.375+0000 7f990e000640 1 -- 172.21.15.84:0/4236200120 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908046030 con 0x55719c6e24d0 2024-09-21T07:58:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.375+0000 7f990e000640 1 -- 172.21.15.84:0/4236200120 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9908004b50 con 0x55719c6e24d0 2024-09-21T07:58:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.375+0000 7f990e000640 1 -- 172.21.15.84:0/4236200120 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908040b40 con 0x55719c6e24d0 2024-09-21T07:58:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.376+0000 7f9919600640 1 -- 172.21.15.84:0/718622869 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9910018020 con 0x7f9914094cc0 2024-09-21T07:58:32.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.377+0000 7f992ac0f740 1 -- 172.21.15.84:0/4236200120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 msgr2=0x55719caa8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.377+0000 7f992ac0f740 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719caa8890 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9908004a00 tx=0x7f9908004a30 comp rx=0 tx=0).stop 2024-09-21T07:58:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.377+0000 7f992ac0f740 1 -- 172.21.15.84:0/4236200120 shutdown_connections 2024-09-21T07:58:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.377+0000 7f992ac0f740 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719caa8890 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.377+0000 7f992ac0f740 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719caa8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.377+0000 7f992ac0f740 1 --2- 172.21.15.84:0/4236200120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c7031b0 0x55719caa7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.377+0000 7f992ac0f740 1 -- 172.21.15.84:0/4236200120 >> 172.21.15.84:0/4236200120 conn(0x55719c6f7300 msgr2=0x55719caa5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.379+0000 7f9919600640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99040b6880 0x7f99040b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.379+0000 7f992ac0f740 1 -- 172.21.15.84:0/4236200120 shutdown_connections 2024-09-21T07:58:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.379+0000 7f992ac0f740 1 -- 172.21.15.84:0/4236200120 wait complete. 2024-09-21T07:58:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.379+0000 7f9919600640 1 -- 172.21.15.84:0/718622869 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f99100e6f00 con 0x7f9914094cc0 2024-09-21T07:58:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.380+0000 7f991be00640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99040b6880 0x7f99040b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.381+0000 7f992ac0f740 1 -- start start 2024-09-21T07:58:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.381+0000 7f992ac0f740 1 Processor -- start 2024-09-21T07:58:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.382+0000 7f991be00640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99040b6880 0x7f99040b8d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f990803ba40 tx=0x7f990803b450 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.382+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719cab3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.383+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719cab3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.383+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c7031b0 0x55719cabf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.384+0000 7f992ac0f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55719c944ab0 con 0x55719c6da2f0 2024-09-21T07:58:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.384+0000 7f992ac0f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55719c9b3570 con 0x55719c6e24d0 2024-09-21T07:58:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.384+0000 7f992ac0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55719cab6530 con 0x55719c7031b0 2024-09-21T07:58:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.384+0000 7f992ac0f740 10 client.0 _ll_register_callbacks cb 0x55719c9c2100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.383+0000 7f9921000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719cab3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.383+0000 7f9921a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c7031b0 0x55719cabf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.386+0000 7f9921a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c7031b0 0x55719cabf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53946/0 (socket says 172.21.15.84:53946) 2024-09-21T07:58:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.386+0000 7f9921a00640 1 -- 172.21.15.84:0/2766866161 learned_addr learned my addr 172.21.15.84:0/2766866161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.383+0000 7f991be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719cab3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9921a00640 1 -- 172.21.15.84:0/2766866161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 msgr2=0x55719cab3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9921a00640 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719cab3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9921a00640 1 -- 172.21.15.84:0/2766866161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 msgr2=0x55719cab3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9921a00640 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719cab3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9921a00640 1 -- 172.21.15.84:0/2766866161 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719c76e790 con 0x55719c7031b0 2024-09-21T07:58:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9921000640 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719cab3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9921a00640 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c7031b0 0x55719cabf8b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f991c051d10 tx=0x7f991c081810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56466344f563686 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.387+0000 7f9902a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.388+0000 7f9902a00640 1 -- 172.21.15.84:0/2766866161 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c07f450 con 0x55719c7031b0 2024-09-21T07:58:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.388+0000 7f9902a00640 1 -- 172.21.15.84:0/2766866161 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f991c07f5f0 con 0x55719c7031b0 2024-09-21T07:58:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.389+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9908004b50 con 0x55719c7031b0 2024-09-21T07:58:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.389+0000 7f9902a00640 1 -- 172.21.15.84:0/2766866161 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f991c092050 con 0x55719c7031b0 2024-09-21T07:58:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.389+0000 7f992ac0f740 10 client.27475 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.389+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55719c7e7620 con 0x55719c7031b0 2024-09-21T07:58:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f9902a00640 1 -- 172.21.15.84:0/2766866161 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9908004b50 con 0x55719c7031b0 2024-09-21T07:58:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f9902a00640 1 -- 172.21.15.84:0/2766866161 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f991c08a990 con 0x55719c7031b0 2024-09-21T07:58:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f992ac0f740 10 client.27475 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f992ac0f740 10 client.27475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f992ac0f740 20 client.27475 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f992ac0f740 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6c1d80 0x55719cac5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f992ac0f740 4 client.27475 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.390+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55719ca1f600 con 0x55719c6c1d80 2024-09-21T07:58:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.391+0000 7f9921000640 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6c1d80 0x55719cac5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.391+0000 7f9921000640 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6c1d80 0x55719cac5650 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a7e8200255496b server_cookie=90e26eec40397606 in_seq=0 out_seq=0 2024-09-21T07:58:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.391+0000 7f9902a00640 10 client.27475 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.392+0000 7f9902a00640 1 -- 172.21.15.84:0/2766866161 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55719ca1f600 con 0x55719c6c1d80 2024-09-21T07:58:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.392+0000 7f9902a00640 10 client.27475 handle_command_reply: tid=0 2024-09-21T07:58:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.392+0000 7f992ac0f740 1 client.27475 shutdown 2024-09-21T07:58:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.393+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c7031b0 msgr2=0x55719cabf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.393+0000 7f992ac0f740 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c7031b0 0x55719cabf8b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f991c051d10 tx=0x7f991c081810 comp rx=0 tx=0).stop 2024-09-21T07:58:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.394+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 shutdown_connections 2024-09-21T07:58:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.394+0000 7f992ac0f740 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6c1d80 0x55719cac5650 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.394+0000 7f992ac0f740 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c7031b0 0x55719cabf8b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.394+0000 7f992ac0f740 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c6e24d0 0x55719cab3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.394+0000 7f992ac0f740 1 --2- 172.21.15.84:0/2766866161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719cab3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.394+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 >> 172.21.15.84:0/2766866161 conn(0x55719c6f7300 msgr2=0x55719caa8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.394+0000 7f9902a00640 0 client.27475 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.395+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 shutdown_connections 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.395+0000 7f992ac0f740 1 -- 172.21.15.84:0/2766866161 wait complete. 2024-09-21T07:58:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.395+0000 7f992ac0f740 20 client.27475 trim_cache size 0 max 16384 2024-09-21T07:58:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.413+0000 7f992ac0f740 1 Processor -- start 2024-09-21T07:58:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.413+0000 7f992ac0f740 1 -- start start 2024-09-21T07:58:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719caa4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6e24d0 0x55719caa9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f992ac0f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc00fdf0 con 0x55719c6da2f0 2024-09-21T07:58:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f992ac0f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc011930 con 0x55719c7031b0 2024-09-21T07:58:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f992ac0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0104c0 con 0x55719c6e24d0 2024-09-21T07:58:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f991be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6e24d0 0x55719caa9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f991be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6e24d0 0x55719caa9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53952/0 (socket says 172.21.15.84:53952) 2024-09-21T07:58:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f991be00640 1 -- 172.21.15.84:0/1591889127 learned_addr learned my addr 172.21.15.84:0/1591889127 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.414+0000 7f9921000640 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719caa4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.415+0000 7f991be00640 1 -- 172.21.15.84:0/1591889127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 msgr2=0x55719cab0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.415+0000 7f991be00640 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.415+0000 7f991be00640 1 -- 172.21.15.84:0/1591889127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 msgr2=0x55719caa4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.415+0000 7f991be00640 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719caa4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.415+0000 7f991be00640 1 -- 172.21.15.84:0/1591889127 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719cab1950 con 0x55719c6e24d0 2024-09-21T07:58:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.416+0000 7f991be00640 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6e24d0 0x55719caa9550 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9908040820 tx=0x7f99080048e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87c885f05c82de32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.416+0000 7f990d600640 1 -- 172.21.15.84:0/1591889127 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908046040 con 0x55719c6e24d0 2024-09-21T07:58:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.416+0000 7f990d600640 1 -- 172.21.15.84:0/1591889127 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9908040850 con 0x55719c6e24d0 2024-09-21T07:58:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.416+0000 7f990d600640 1 -- 172.21.15.84:0/1591889127 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990806b630 con 0x55719c6e24d0 2024-09-21T07:58:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 -- 172.21.15.84:0/1591889127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6e24d0 msgr2=0x55719caa9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6e24d0 0x55719caa9550 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9908040820 tx=0x7f99080048e0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 -- 172.21.15.84:0/1591889127 shutdown_connections 2024-09-21T07:58:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6e24d0 0x55719caa9550 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1591889127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6da2f0 0x55719caa4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 -- 172.21.15.84:0/1591889127 >> 172.21.15.84:0/1591889127 conn(0x55719c6f7300 msgr2=0x55719caa8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.417+0000 7f992ac0f740 1 -- 172.21.15.84:0/1591889127 shutdown_connections 2024-09-21T07:58:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.418+0000 7f992ac0f740 1 -- 172.21.15.84:0/1591889127 wait complete. 2024-09-21T07:58:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.418+0000 7f992ac0f740 1 -- start start 2024-09-21T07:58:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.418+0000 7f992ac0f740 1 Processor -- start 2024-09-21T07:58:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719cabbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6e24d0 0x55719cab93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f992ac0f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f992ac0f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc011260 con 0x55719c6e24d0 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f992ac0f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc010b90 con 0x55719c7031b0 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f992ac0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc00ddf0 con 0x55719c6da2f0 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f992ac0f740 10 client.0 _ll_register_callbacks cb 0x7f991c051960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f9921a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.422 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f9921a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34722/0 (socket says 172.21.15.84:34722) 2024-09-21T07:58:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f9921a00640 1 -- 172.21.15.84:0/1895661091 learned_addr learned my addr 172.21.15.84:0/1895661091 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:32.423 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.419+0000 7f9921000640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719cabbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f9921000640 1 -- 172.21.15.84:0/1895661091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 msgr2=0x55719cab9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f9921000640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f991be00640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6e24d0 0x55719cab93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f9921000640 1 -- 172.21.15.84:0/1895661091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6e24d0 msgr2=0x55719cab93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f9921000640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6e24d0 0x55719cab93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f9921000640 1 -- 172.21.15.84:0/1895661091 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719cab9fa0 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f991be00640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6e24d0 0x55719cab93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f9921000640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719cabbf00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f99100e4260 tx=0x7f99100a8a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd3b1934f0ff3e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.420+0000 7f9902a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.421+0000 7f9902a00640 1 -- 172.21.15.84:0/1895661091 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99100a80d0 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.421+0000 7f9902a00640 1 -- 172.21.15.84:0/1895661091 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f9910010380 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.421+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9908040850 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.421+0000 7f9902a00640 1 -- 172.21.15.84:0/1895661091 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99100ac470 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.421+0000 7f992ac0f740 10 client.27481 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.421+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55719cb2ff70 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.421+0000 7f9902a00640 1 -- 172.21.15.84:0/1895661091 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9908040850 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f9902a00640 1 -- 172.21.15.84:0/1895661091 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f99100e44e0 con 0x55719c6da2f0 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f992ac0f740 10 client.27481 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f992ac0f740 10 client.27481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f992ac0f740 20 client.27481 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6971c0 0x55719cb32750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f992ac0f740 4 client.27481 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:58:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55719ca1b0b0 con 0x55719c6971c0 2024-09-21T07:58:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f991be00640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6971c0 0x55719cb32750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f991be00640 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6971c0 0x55719cb32750 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa2e1e96cb0168f server_cookie=2d83040432ede723 in_seq=0 out_seq=0 2024-09-21T07:58:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.422+0000 7f9902a00640 10 client.27481 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f9902a00640 1 -- 172.21.15.84:0/1895661091 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55719ca1b0b0 con 0x55719c6971c0 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f9902a00640 10 client.27481 handle_command_reply: tid=0 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 client.27481 shutdown 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 msgr2=0x55719cabbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719cabbf00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f99100e4260 tx=0x7f99100a8a40 comp rx=0 tx=0).stop 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 shutdown_connections 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55719c7031b0 0x55719cab9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c6e24d0 0x55719cab93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55719c6971c0 0x55719cb32750 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 --2- 172.21.15.84:0/1895661091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55719c6da2f0 0x55719cabbf00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f9902a00640 0 client.27481 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.438+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 >> 172.21.15.84:0/1895661091 conn(0x55719c6f7300 msgr2=0x55719caa9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 shutdown_connections 2024-09-21T07:58:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f992ac0f740 1 -- 172.21.15.84:0/1895661091 wait complete. 2024-09-21T07:58:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f992ac0f740 20 client.27481 trim_cache size 0 max 16384 2024-09-21T07:58:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:58:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:58:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:58:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:58:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99040b6880 msgr2=0x7f99040b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99040b6880 0x7f99040b8d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f990803ba40 tx=0x7f990803b450 comp rx=0 tx=0).stop 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9914094cc0 msgr2=0x7f99140a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9914094cc0 0x7f99140a94c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9910009fd0 tx=0x7f991000b870 comp rx=0 tx=0).stop 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 shutdown_connections 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99040b6880 0x7f99040b8d90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f991409a250 0x7f99140a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99140956f0 0x7f99140a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 --2- 172.21.15.84:0/718622869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9914094cc0 0x7f99140a94c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.439+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 >> 172.21.15.84:0/718622869 conn(0x7f991400cd90 msgr2=0x7f9914097c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.440+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 shutdown_connections 2024-09-21T07:58:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:32.440+0000 7f9922400640 1 -- 172.21.15.84:0/718622869 wait complete. 2024-09-21T07:58:33.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:33 smithi191 ceph-mon[34667]: pgmap v621: 129 pgs: 129 active+clean; 54 GiB data, 112 GiB used, 961 GiB / 1.0 TiB avail; 41 KiB/s rd, 266 MiB/s wr, 1.75k op/s 2024-09-21T07:58:34.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:33 smithi162 ceph-mon[34833]: pgmap v621: 129 pgs: 129 active+clean; 54 GiB data, 112 GiB used, 961 GiB / 1.0 TiB avail; 41 KiB/s rd, 266 MiB/s wr, 1.75k op/s 2024-09-21T07:58:34.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:33 smithi084 ceph-mon[30411]: pgmap v621: 129 pgs: 129 active+clean; 54 GiB data, 112 GiB used, 961 GiB / 1.0 TiB avail; 41 KiB/s rd, 266 MiB/s wr, 1.75k op/s 2024-09-21T07:58:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.289+0000 7fc5c6000640 1 -- 172.21.15.84:0/2751629201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c0111cd0 msgr2=0x7fc5c010d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.289+0000 7fc5c6000640 1 --2- 172.21.15.84:0/2751629201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c0111cd0 0x7fc5c010d6b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009900 tx=0x7fc5b002a440 comp rx=0 tx=0).stop 2024-09-21T07:58:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.289+0000 7fc5c6000640 1 -- 172.21.15.84:0/2751629201 shutdown_connections 2024-09-21T07:58:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.289+0000 7fc5c6000640 1 --2- 172.21.15.84:0/2751629201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5c011cba0 0x7fc5c011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.289+0000 7fc5c6000640 1 --2- 172.21.15.84:0/2751629201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c010dbf0 0x7fc5c010e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.289+0000 7fc5c6000640 1 --2- 172.21.15.84:0/2751629201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c0111cd0 0x7fc5c010d6b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.289+0000 7fc5c6000640 1 -- 172.21.15.84:0/2751629201 >> 172.21.15.84:0/2751629201 conn(0x7fc5c006e9f0 msgr2=0x7fc5c006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:34.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.291+0000 7fc5c6000640 1 -- 172.21.15.84:0/2751629201 shutdown_connections 2024-09-21T07:58:34.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.293+0000 7fc5c6000640 1 -- 172.21.15.84:0/2751629201 wait complete. 2024-09-21T07:58:34.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.296+0000 7fc5c6000640 1 Processor -- start 2024-09-21T07:58:34.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.296+0000 7fc5c6000640 1 -- start start 2024-09-21T07:58:34.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.298+0000 7fc5c6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c010dbf0 0x7fc5c01a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.299+0000 7fc5c6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c011cba0 0x7fc5c01a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c6000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5c01aea50 0x7fc5c01aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c010dbf0 0x7fc5c01a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c6000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0122720 con 0x7fc5c011cba0 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c6000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01225a0 con 0x7fc5c010dbf0 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c6000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01228a0 con 0x7fc5c01aea50 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c010dbf0 0x7fc5c01a92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34748/0 (socket says 172.21.15.84:34748) 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c4c00640 1 -- 172.21.15.84:0/1393259510 learned_addr learned my addr 172.21.15.84:0/1393259510 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.300+0000 7fc5c5600640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5c01aea50 0x7fc5c01aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.301+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c011cba0 0x7fc5c01a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.301+0000 7fc5c4c00640 1 -- 172.21.15.84:0/1393259510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5c01aea50 msgr2=0x7fc5c01aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.302+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5c01aea50 0x7fc5c01aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.302+0000 7fc5c4c00640 1 -- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c011cba0 msgr2=0x7fc5c01a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.302+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c011cba0 0x7fc5c01a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.302+0000 7fc5c4c00640 1 -- 172.21.15.84:0/1393259510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c01af630 con 0x7fc5c010dbf0 2024-09-21T07:58:34.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.302+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c011cba0 0x7fc5c01a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:34.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.302+0000 7fc5c5600640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5c01aea50 0x7fc5c01aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:34.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.302+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c010dbf0 0x7fc5c01a92d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009850 tx=0x7fc5b0003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:34.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.303+0000 7fc5bd600640 1 -- 172.21.15.84:0/1393259510 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0040030 con 0x7fc5c010dbf0 2024-09-21T07:58:34.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.303+0000 7fc5bd600640 1 -- 172.21.15.84:0/1393259510 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b003c8f0 con 0x7fc5c010dbf0 2024-09-21T07:58:34.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.303+0000 7fc5bd600640 1 -- 172.21.15.84:0/1393259510 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00318e0 con 0x7fc5c010dbf0 2024-09-21T07:58:34.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.303+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c01b5bd0 con 0x7fc5c010dbf0 2024-09-21T07:58:34.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.303+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c01b5f70 con 0x7fc5c010dbf0 2024-09-21T07:58:34.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.310+0000 7fc5bd600640 1 -- 172.21.15.84:0/1393259510 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc5b0043030 con 0x7fc5c010dbf0 2024-09-21T07:58:34.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.317+0000 7fc5bd600640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5a40b6730 0x7fc5a40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.317+0000 7fc5bd600640 1 -- 172.21.15.84:0/1393259510 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fc5b0108150 con 0x7fc5c010dbf0 2024-09-21T07:58:34.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.321+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5a40b6730 0x7fc5a40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.322+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5a40b6730 0x7fc5a40b8c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac005d00 tx=0x7fc5ac005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:34.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.326+0000 7fc5ce279740 1 Processor -- start 2024-09-21T07:58:34.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.329+0000 7fc5ce279740 1 -- start start 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.329+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd99070 0x55f35013ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.329+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f3501404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.329+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f3501409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5ce279740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3500b6fb0 con 0x55f34fd78390 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5ce279740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f3500a63e0 con 0x55f34fd99070 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5ce279740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f3500aa1f0 con 0x55f34fd701b0 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5bfe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f3501404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5bfe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f3501404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53972/0 (socket says 172.21.15.84:53972) 2024-09-21T07:58:34.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5bfe00640 1 -- 172.21.15.84:0/1538316847 learned_addr learned my addr 172.21.15.84:0/1538316847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:34.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5c5600640 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f3501409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5bfe00640 1 -- 172.21.15.84:0/1538316847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd99070 msgr2=0x55f35013ff70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:58:34.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.330+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd99070 0x55f35013ff70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.331+0000 7fc5bfe00640 1 -- 172.21.15.84:0/1538316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 msgr2=0x55f3501409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:34.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.331+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f3501409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.331+0000 7fc5bfe00640 1 -- 172.21.15.84:0/1538316847 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350070cd0 con 0x55f34fd701b0 2024-09-21T07:58:34.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.331+0000 7fc5c5600640 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f3501409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:34.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.332+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f3501404b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00b510 tx=0x7fc5ac012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574e712160923856 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:34.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.335+0000 7fc5b5c00640 1 -- 172.21.15.84:0/1538316847 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac003d70 con 0x55f34fd701b0 2024-09-21T07:58:34.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.335+0000 7fc5b5c00640 1 -- 172.21.15.84:0/1538316847 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5ac024070 con 0x55f34fd701b0 2024-09-21T07:58:34.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.335+0000 7fc5b5c00640 1 -- 172.21.15.84:0/1538316847 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac0116a0 con 0x55f34fd701b0 2024-09-21T07:58:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.336+0000 7fc5ce279740 1 -- 172.21.15.84:0/1538316847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 msgr2=0x55f3501404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.336+0000 7fc5ce279740 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f3501404b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00b510 tx=0x7fc5ac012000 comp rx=0 tx=0).stop 2024-09-21T07:58:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.338+0000 7fc5ce279740 1 -- 172.21.15.84:0/1538316847 shutdown_connections 2024-09-21T07:58:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.338+0000 7fc5ce279740 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f3501409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.338+0000 7fc5ce279740 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f3501404b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.338+0000 7fc5ce279740 1 --2- 172.21.15.84:0/1538316847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd99070 0x55f35013ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.338+0000 7fc5ce279740 1 -- 172.21.15.84:0/1538316847 >> 172.21.15.84:0/1538316847 conn(0x55f34fd8d460 msgr2=0x55f35013de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.339+0000 7fc5ce279740 1 -- 172.21.15.84:0/1538316847 shutdown_connections 2024-09-21T07:58:34.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.339+0000 7fc5ce279740 1 -- 172.21.15.84:0/1538316847 wait complete. 2024-09-21T07:58:34.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.343+0000 7fc5ce279740 1 -- start start 2024-09-21T07:58:34.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.345+0000 7fc5ce279740 1 Processor -- start 2024-09-21T07:58:34.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.350+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd701b0 0x55f35014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.351+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f35014bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.351+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350157a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.351+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd701b0 0x55f35014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.351+0000 7fc5ce279740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f34ff07700 con 0x55f34fd701b0 2024-09-21T07:58:34.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.352+0000 7fc5ce279740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f350041580 con 0x55f34fd78390 2024-09-21T07:58:34.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.352+0000 7fc5ce279740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f35014e750 con 0x55f34fd99070 2024-09-21T07:58:34.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.352+0000 7fc5ce279740 10 client.0 _ll_register_callbacks cb 0x55f350051470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:34.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.352+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd701b0 0x55f35014b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34016/0 (socket says 172.21.15.84:34016) 2024-09-21T07:58:34.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.352+0000 7fc5c4c00640 1 -- 172.21.15.84:0/605269772 learned_addr learned my addr 172.21.15.84:0/605269772 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:34.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.353+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f35014bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.354+0000 7fc5c5600640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.355+0000 7fc5c4c00640 1 -- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 msgr2=0x55f350157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:34.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.355+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.355+0000 7fc5c4c00640 1 -- 172.21.15.84:0/605269772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 msgr2=0x55f35014bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:34.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.355+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f35014bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.355+0000 7fc5c4c00640 1 -- 172.21.15.84:0/605269772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34fe04650 con 0x55f34fd701b0 2024-09-21T07:58:34.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.356+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f35014bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:34.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.357+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd701b0 0x55f35014b7c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00ca1e0 tx=0x7fc5b00cd620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6750fce84eff520 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:34.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.357+0000 7fc5aa000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:58:34.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.358+0000 7fc5aa000640 1 -- 172.21.15.84:0/605269772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b004a040 con 0x55f34fd701b0 2024-09-21T07:58:34.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.359+0000 7fc5aa000640 1 -- 172.21.15.84:0/605269772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fc5b00f10d0 con 0x55f34fd701b0 2024-09-21T07:58:34.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.360+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f350043b90 con 0x55f34fd701b0 2024-09-21T07:58:34.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.361+0000 7fc5aa000640 1 -- 172.21.15.84:0/605269772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc5b00ce310 con 0x55f34fd701b0 2024-09-21T07:58:34.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.361+0000 7fc5ce279740 10 client.17196 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:34.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.361+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f35005e950 con 0x55f34fd701b0 2024-09-21T07:58:34.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.362+0000 7fc5aa000640 1 -- 172.21.15.84:0/605269772 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f350043b90 con 0x55f34fd701b0 2024-09-21T07:58:34.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.362+0000 7fc5aa000640 1 -- 172.21.15.84:0/605269772 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc5b00d71a0 con 0x55f34fd701b0 2024-09-21T07:58:34.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.365+0000 7fc5ce279740 10 client.17196 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:34.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.365+0000 7fc5ce279740 10 client.17196 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:58:34.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.365+0000 7fc5ce279740 20 client.17196 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:34.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.365+0000 7fc5ce279740 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f34fd579f0 0x55f35015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.365+0000 7fc5ce279740 4 client.17196 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:34.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.365+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3500b8f00 con 0x55f34fd579f0 2024-09-21T07:58:34.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.366+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f34fd579f0 0x55f35015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.370+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f34fd579f0 0x55f35015d7b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd93745c812e6c02 server_cookie=a612a9320dfc35fe in_seq=0 out_seq=0 2024-09-21T07:58:34.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.371+0000 7fc5aa000640 10 client.17196 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:58:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.371+0000 7fc5aa000640 1 -- 172.21.15.84:0/605269772 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3500b8f00 con 0x55f34fd579f0 2024-09-21T07:58:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.371+0000 7fc5aa000640 10 client.17196 handle_command_reply: tid=0 2024-09-21T07:58:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 client.17196 shutdown 2024-09-21T07:58:34.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd701b0 msgr2=0x55f35014b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd701b0 0x55f35014b7c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00ca1e0 tx=0x7fc5b00cd620 comp rx=0 tx=0).stop 2024-09-21T07:58:34.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 shutdown_connections 2024-09-21T07:58:34.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f34fd579f0 0x55f35015d7b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f35014bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 --2- 172.21.15.84:0/605269772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd701b0 0x55f35014b7c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.372+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 >> 172.21.15.84:0/605269772 conn(0x55f34fd8d460 msgr2=0x55f35013c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.373+0000 7fc5aa000640 0 client.17196 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:58:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.373+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 shutdown_connections 2024-09-21T07:58:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.374+0000 7fc5ce279740 1 -- 172.21.15.84:0/605269772 wait complete. 2024-09-21T07:58:34.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.376+0000 7fc5ce279740 20 client.17196 trim_cache size 0 max 16384 2024-09-21T07:58:34.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.408+0000 7fc5ce279740 1 Processor -- start 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.408+0000 7fc5ce279740 1 -- start start 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.409+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f35014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.409+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f350141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.409+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd99070 0x55f350157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.409+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f35014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.409+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f35014d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:53988/0 (socket says 172.21.15.84:53988) 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.410+0000 7fc5bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f350141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.410+0000 7fc5bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f350141660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34778/0 (socket says 172.21.15.84:34778) 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.410+0000 7fc5c4c00640 1 -- 172.21.15.84:0/3908760270 learned_addr learned my addr 172.21.15.84:0/3908760270 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.410+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01c0090 con 0x55f34fd99070 2024-09-21T07:58:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.410+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01c1bd0 con 0x55f34fd78390 2024-09-21T07:58:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.411+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01c0760 con 0x55f34fd701b0 2024-09-21T07:58:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.411+0000 7fc5c4c00640 1 -- 172.21.15.84:0/3908760270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 msgr2=0x55f350141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.412+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f350141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.412+0000 7fc5c4c00640 1 -- 172.21.15.84:0/3908760270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd99070 msgr2=0x55f350157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.412+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd99070 0x55f350157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.412+0000 7fc5c4c00640 1 -- 172.21.15.84:0/3908760270 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f350142dd0 con 0x55f34fd701b0 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.412+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f350141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.413+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f35014d6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0105b10 tx=0x7fc5b00b90d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5011a63a2d5f63d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.413+0000 7fc5b5200640 1 -- 172.21.15.84:0/3908760270 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b004a070 con 0x55f34fd701b0 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.413+0000 7fc5b5200640 1 -- 172.21.15.84:0/3908760270 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b00cce70 con 0x55f34fd701b0 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.413+0000 7fc5b5200640 1 -- 172.21.15.84:0/3908760270 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00f10d0 con 0x55f34fd701b0 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.414+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 msgr2=0x55f35014d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.414+0000 7fc5ce279740 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f35014d6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0105b10 tx=0x7fc5b00b90d0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.414+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 shutdown_connections 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.414+0000 7fc5ce279740 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd99070 0x55f350157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.414+0000 7fc5ce279740 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd78390 0x55f350141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.414+0000 7fc5ce279740 1 --2- 172.21.15.84:0/3908760270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd701b0 0x55f35014d6a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.414+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 >> 172.21.15.84:0/3908760270 conn(0x55f34fd8d460 msgr2=0x55f350140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:34.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.416+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 shutdown_connections 2024-09-21T07:58:34.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.416+0000 7fc5ce279740 1 -- 172.21.15.84:0/3908760270 wait complete. 2024-09-21T07:58:34.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.417+0000 7fc5ce279740 1 -- start start 2024-09-21T07:58:34.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.417+0000 7fc5ce279740 1 Processor -- start 2024-09-21T07:58:34.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.418+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f350153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.419+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350154180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.419+0000 7fc5ce279740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd2cda0 0x55f35014e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.420+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f350153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.420+0000 7fc5c5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd2cda0 0x55f35014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.420+0000 7fc5c5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd2cda0 0x55f35014e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34782/0 (socket says 172.21.15.84:34782) 2024-09-21T07:58:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.420+0000 7fc5c5600640 1 -- 172.21.15.84:0/775537558 learned_addr learned my addr 172.21.15.84:0/775537558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.420+0000 7fc5bfe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.424+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01c1500 con 0x55f34fd78390 2024-09-21T07:58:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.424+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01c0e30 con 0x55f34fd2cda0 2024-09-21T07:58:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.424+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01be090 con 0x55f34fd99070 2024-09-21T07:58:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.424+0000 7fc5ce279740 10 client.0 _ll_register_callbacks cb 0x7fc5b00c9ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.424+0000 7fc5c5600640 1 -- 172.21.15.84:0/775537558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 msgr2=0x55f350154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.424+0000 7fc5c5600640 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.425+0000 7fc5c5600640 1 -- 172.21.15.84:0/775537558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 msgr2=0x55f350153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.425+0000 7fc5c5600640 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f350153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.425+0000 7fc5c5600640 1 -- 172.21.15.84:0/775537558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f35014f080 con 0x55f34fd2cda0 2024-09-21T07:58:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.425+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f350153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.426+0000 7fc5aa000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:34.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.426+0000 7fc5c5600640 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd2cda0 0x55f35014e990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8012be0 tx=0x7fc5b8010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab08f53486137b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:34.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.427+0000 7fc5aa000640 1 -- 172.21.15.84:0/775537558 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8012260 con 0x55f34fd2cda0 2024-09-21T07:58:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.427+0000 7fc5aa000640 1 -- 172.21.15.84:0/775537558 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fc5b8011440 con 0x55f34fd2cda0 2024-09-21T07:58:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.427+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b00cce70 con 0x55f34fd2cda0 2024-09-21T07:58:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.428+0000 7fc5aa000640 1 -- 172.21.15.84:0/775537558 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc5b8012400 con 0x55f34fd2cda0 2024-09-21T07:58:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.428+0000 7fc5ce279740 10 client.27503 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.428+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f3501c8ab0 con 0x55f34fd2cda0 2024-09-21T07:58:34.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.429+0000 7fc5aa000640 1 -- 172.21.15.84:0/775537558 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b00cce70 con 0x55f34fd2cda0 2024-09-21T07:58:34.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.432+0000 7fc5aa000640 1 -- 172.21.15.84:0/775537558 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc5b8011640 con 0x55f34fd2cda0 2024-09-21T07:58:34.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.433+0000 7fc5ce279740 10 client.27503 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:34.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.433+0000 7fc5ce279740 10 client.27503 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:58:34.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.433+0000 7fc5ce279740 20 client.27503 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:34.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.433+0000 7fc5ce279740 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f3501c9210 0x55f3501cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:34.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.433+0000 7fc5ce279740 4 client.27503 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:58:34.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.433+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3500b49b0 con 0x55f3501c9210 2024-09-21T07:58:34.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.434+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f3501c9210 0x55f3501cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:34.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.435+0000 7fc5c4c00640 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f3501c9210 0x55f3501cb630 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56a40c25fda45474 server_cookie=3ff28d4b9a85aa in_seq=0 out_seq=0 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.435+0000 7fc5aa000640 10 client.27503 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.435+0000 7fc5aa000640 1 -- 172.21.15.84:0/775537558 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3500b49b0 con 0x55f3501c9210 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.435+0000 7fc5aa000640 10 client.27503 handle_command_reply: tid=0 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.435+0000 7fc5ce279740 1 client.27503 shutdown 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd2cda0 msgr2=0x55f35014e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd2cda0 0x55f35014e990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8012be0 tx=0x7fc5b8010800 comp rx=0 tx=0).stop 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 shutdown_connections 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55f3501c9210 0x55f3501cb630 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5aa000640 0 client.27503 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f34fd2cda0 0x55f35014e990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f34fd99070 0x55f350154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 --2- 172.21.15.84:0/775537558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f34fd78390 0x55f350153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.436+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 >> 172.21.15.84:0/775537558 conn(0x55f34fd8d460 msgr2=0x55f35014d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:34.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.438+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 shutdown_connections 2024-09-21T07:58:34.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.439+0000 7fc5ce279740 1 -- 172.21.15.84:0/775537558 wait complete. 2024-09-21T07:58:34.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.439+0000 7fc5ce279740 20 client.27503 trim_cache size 0 max 16384 2024-09-21T07:58:34.443 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:58:34.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5a40b6730 msgr2=0x7fc5a40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5a40b6730 0x7fc5a40b8c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac005d00 tx=0x7fc5ac005c70 comp rx=0 tx=0).stop 2024-09-21T07:58:34.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c010dbf0 msgr2=0x7fc5c01a92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:34.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c010dbf0 0x7fc5c01a92d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009850 tx=0x7fc5b0003f60 comp rx=0 tx=0).stop 2024-09-21T07:58:34.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 shutdown_connections 2024-09-21T07:58:34.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc5a40b6730 0x7fc5a40b8c40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5c01aea50 0x7fc5c01aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.443+0000 7fc5c6000640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c011cba0 0x7fc5c01a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:34.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.444+0000 7fc5c6000640 1 --2- 172.21.15.84:0/1393259510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c010dbf0 0x7fc5c01a92d0 secure :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009850 tx=0x7fc5b0003f60 comp rx=0 tx=0).stop 2024-09-21T07:58:34.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.444+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 >> 172.21.15.84:0/1393259510 conn(0x7fc5c006e9f0 msgr2=0x7fc5c0110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:34.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.446+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 shutdown_connections 2024-09-21T07:58:34.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:34.446+0000 7fc5c6000640 1 -- 172.21.15.84:0/1393259510 wait complete. 2024-09-21T07:58:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:35 smithi191 ceph-mon[34667]: pgmap v622: 129 pgs: 129 active+clean; 54 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 22 KiB/s rd, 285 MiB/s wr, 1.80k op/s 2024-09-21T07:58:36.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:35 smithi162 ceph-mon[34833]: pgmap v622: 129 pgs: 129 active+clean; 54 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 22 KiB/s rd, 285 MiB/s wr, 1.80k op/s 2024-09-21T07:58:36.063 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:35 smithi084 ceph-mon[30411]: pgmap v622: 129 pgs: 129 active+clean; 54 GiB data, 113 GiB used, 960 GiB / 1.0 TiB avail; 22 KiB/s rd, 285 MiB/s wr, 1.80k op/s 2024-09-21T07:58:36.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:58:37.257 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:37.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:37 smithi084 ceph-mon[30411]: pgmap v623: 129 pgs: 129 active+clean; 55 GiB data, 114 GiB used, 959 GiB / 1.0 TiB avail; 33 KiB/s rd, 308 MiB/s wr, 1.97k op/s 2024-09-21T07:58:37.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:37 smithi191 ceph-mon[34667]: pgmap v623: 129 pgs: 129 active+clean; 55 GiB data, 114 GiB used, 959 GiB / 1.0 TiB avail; 33 KiB/s rd, 308 MiB/s wr, 1.97k op/s 2024-09-21T07:58:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:37 smithi162 ceph-mon[34833]: pgmap v623: 129 pgs: 129 active+clean; 55 GiB data, 114 GiB used, 959 GiB / 1.0 TiB avail; 33 KiB/s rd, 308 MiB/s wr, 1.97k op/s 2024-09-21T07:58:39.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:38 smithi162 ceph-mon[34833]: pgmap v624: 129 pgs: 129 active+clean; 55 GiB data, 114 GiB used, 958 GiB / 1.0 TiB avail; 21 KiB/s rd, 286 MiB/s wr, 1.85k op/s 2024-09-21T07:58:39.060 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:38 smithi084 ceph-mon[30411]: pgmap v624: 129 pgs: 129 active+clean; 55 GiB data, 114 GiB used, 958 GiB / 1.0 TiB avail; 21 KiB/s rd, 286 MiB/s wr, 1.85k op/s 2024-09-21T07:58:39.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:38 smithi191 ceph-mon[34667]: pgmap v624: 129 pgs: 129 active+clean; 55 GiB data, 114 GiB used, 958 GiB / 1.0 TiB avail; 21 KiB/s rd, 286 MiB/s wr, 1.85k op/s 2024-09-21T07:58:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.290+0000 7f286aa00640 1 -- 172.21.15.84:0/1900200850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864107be0 msgr2=0x7f28641080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.290+0000 7f286aa00640 1 --2- 172.21.15.84:0/1900200850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864107be0 0x7f28641080c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2850009930 tx=0x7f285002a420 comp rx=0 tx=0).stop 2024-09-21T07:58:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.294+0000 7f286aa00640 1 -- 172.21.15.84:0/1900200850 shutdown_connections 2024-09-21T07:58:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.294+0000 7f286aa00640 1 --2- 172.21.15.84:0/1900200850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864107be0 0x7f28641080c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.294+0000 7f286aa00640 1 --2- 172.21.15.84:0/1900200850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28641030f0 0x7f2864107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.294+0000 7f286aa00640 1 --2- 172.21.15.84:0/1900200850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28641027a0 0x7f2864102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.294+0000 7f286aa00640 1 -- 172.21.15.84:0/1900200850 >> 172.21.15.84:0/1900200850 conn(0x7f2864079730 msgr2=0x7f2864079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.295+0000 7f286aa00640 1 -- 172.21.15.84:0/1900200850 shutdown_connections 2024-09-21T07:58:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.295+0000 7f286aa00640 1 -- 172.21.15.84:0/1900200850 wait complete. 2024-09-21T07:58:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.298+0000 7f286aa00640 1 Processor -- start 2024-09-21T07:58:41.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.301+0000 7f286aa00640 1 -- start start 2024-09-21T07:58:41.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.301+0000 7f286aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28641027a0 0x7f28641a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.301+0000 7f286aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28641030f0 0x7f28641a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.302+0000 7f286aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2864107be0 0x7f28641a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.302+0000 7f286aa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f286411a0f0 con 0x7f2864107be0 2024-09-21T07:58:41.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.302+0000 7f286aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2864119f70 con 0x7f28641027a0 2024-09-21T07:58:41.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.302+0000 7f286aa00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f286411a270 con 0x7f28641030f0 2024-09-21T07:58:41.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.302+0000 7f2868a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2864107be0 0x7f28641a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.302+0000 7f2868a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2864107be0 0x7f28641a62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53596/0 (socket says 172.21.15.84:53596) 2024-09-21T07:58:41.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.302+0000 7f2868a00640 1 -- 172.21.15.84:0/2647224650 learned_addr learned my addr 172.21.15.84:0/2647224650 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:41.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.303+0000 7f2868a00640 1 -- 172.21.15.84:0/2647224650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28641030f0 msgr2=0x7f28641a1020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:58:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.303+0000 7f2868a00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28641030f0 0x7f28641a1020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.303+0000 7f2868a00640 1 -- 172.21.15.84:0/2647224650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28641027a0 msgr2=0x7f28641a0a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:58:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.303+0000 7f2868a00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28641027a0 0x7f28641a0a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.303+0000 7f2868a00640 1 -- 172.21.15.84:0/2647224650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28641a69f0 con 0x7f2864107be0 2024-09-21T07:58:41.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.304+0000 7f2868a00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2864107be0 0x7f28641a62c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2850005ab0 tx=0x7f2850003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.313+0000 7f2860c00640 1 -- 172.21.15.84:0/2647224650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285003f070 con 0x7f2864107be0 2024-09-21T07:58:41.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.313+0000 7f2860c00640 1 -- 172.21.15.84:0/2647224650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f285003bd20 con 0x7f2864107be0 2024-09-21T07:58:41.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.313+0000 7f2860c00640 1 -- 172.21.15.84:0/2647224650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850035030 con 0x7f2864107be0 2024-09-21T07:58:41.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.313+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28641a6c80 con 0x7f2864107be0 2024-09-21T07:58:41.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.313+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28641ad440 con 0x7f2864107be0 2024-09-21T07:58:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.338+0000 7f287180e740 1 Processor -- start 2024-09-21T07:58:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.338+0000 7f2860c00640 1 -- 172.21.15.84:0/2647224650 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2850042070 con 0x7f2864107be0 2024-09-21T07:58:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.342+0000 7f287180e740 1 -- start start 2024-09-21T07:58:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.342+0000 7f2860c00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28480b6700 0x7f28480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.343+0000 7f287180e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e07ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.343+0000 7f287180e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e080e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.343+0000 7f287180e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e08620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.344+0000 7f2860c00640 1 -- 172.21.15.84:0/2647224650 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f2850107dc0 con 0x7f2864107be0 2024-09-21T07:58:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.346+0000 7f2863400640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28480b6700 0x7f28480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.346+0000 7f287180e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557440d7efb0 con 0x557440a40390 2024-09-21T07:58:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.346+0000 7f287180e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557440d6e3e0 con 0x557440a61070 2024-09-21T07:58:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.346+0000 7f287180e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557440d721f0 con 0x557440a381b0 2024-09-21T07:58:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.346+0000 7f2868a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e08620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.347+0000 7f2868a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e08620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53608/0 (socket says 172.21.15.84:53608) 2024-09-21T07:58:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.347+0000 7f2868a00640 1 -- 172.21.15.84:0/3985658417 learned_addr learned my addr 172.21.15.84:0/3985658417 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.348+0000 7f2863e00640 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e07ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.350+0000 7f2868a00640 1 -- 172.21.15.84:0/3985658417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 msgr2=0x557440e080e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:58:41.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.350+0000 7f2868a00640 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e080e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.350+0000 7f2868a00640 1 -- 172.21.15.84:0/3985658417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 msgr2=0x557440e07ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:41.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.350+0000 7f2868a00640 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e07ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.350+0000 7f2868a00640 1 -- 172.21.15.84:0/3985658417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557440d38cd0 con 0x557440a40390 2024-09-21T07:58:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.351+0000 7f2868a00640 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e08620 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f28500c9e50 tx=0x7f28500cd1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38d9aca1d2785e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.353+0000 7f2863400640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28480b6700 0x7f28480b8c10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2864079d40 tx=0x7f285400b2f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.354+0000 7f2859200640 1 -- 172.21.15.84:0/3985658417 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28500cdf80 con 0x557440a40390 2024-09-21T07:58:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.355+0000 7f2859200640 1 -- 172.21.15.84:0/3985658417 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28500d2360 con 0x557440a40390 2024-09-21T07:58:41.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.356+0000 7f2859200640 1 -- 172.21.15.84:0/3985658417 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850031660 con 0x557440a40390 2024-09-21T07:58:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.357+0000 7f287180e740 1 -- 172.21.15.84:0/3985658417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 msgr2=0x557440e08620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.357+0000 7f287180e740 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e08620 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f28500c9e50 tx=0x7f28500cd1d0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.357+0000 7f287180e740 1 -- 172.21.15.84:0/3985658417 shutdown_connections 2024-09-21T07:58:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.357+0000 7f287180e740 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e08620 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.357+0000 7f287180e740 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.357+0000 7f287180e740 1 --2- 172.21.15.84:0/3985658417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e07ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.357+0000 7f287180e740 1 -- 172.21.15.84:0/3985658417 >> 172.21.15.84:0/3985658417 conn(0x557440a55460 msgr2=0x557440e05a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.361+0000 7f287180e740 1 -- 172.21.15.84:0/3985658417 shutdown_connections 2024-09-21T07:58:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.361+0000 7f287180e740 1 -- 172.21.15.84:0/3985658417 wait complete. 2024-09-21T07:58:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.362+0000 7f287180e740 1 -- start start 2024-09-21T07:58:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.363+0000 7f287180e740 1 Processor -- start 2024-09-21T07:58:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.364+0000 7f287180e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e136c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.364+0000 7f287180e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e13c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f287180e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e1f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f2863e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f2868a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e1f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f2868a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e1f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:44312/0 (socket says 172.21.15.84:44312) 2024-09-21T07:58:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f2868a00640 1 -- 172.21.15.84:0/53628155 learned_addr learned my addr 172.21.15.84:0/53628155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557440bcf700 con 0x557440a40390 2024-09-21T07:58:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557440d09580 con 0x557440a61070 2024-09-21T07:58:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.365+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557440e16140 con 0x557440a381b0 2024-09-21T07:58:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f2863400640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e13c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f287180e740 10 client.0 _ll_register_callbacks cb 0x557440d19470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f2868a00640 1 -- 172.21.15.84:0/53628155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 msgr2=0x557440e136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f2868a00640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f2868a00640 1 -- 172.21.15.84:0/53628155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 msgr2=0x557440e13c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f2868a00640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e13c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f2868a00640 1 -- 172.21.15.84:0/53628155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557440acc650 con 0x557440a61070 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.366+0000 7f2863e00640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.367+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557440d0bb90 con 0x557440a61070 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.367+0000 7f2868a00640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e1f480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f28500cd580 tx=0x7f28500ccd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c35b86b4ce66a68d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.367+0000 7f2863400640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e13c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.367+0000 7f284d600640 10 client.27512 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.367+0000 7f284d600640 1 -- 172.21.15.84:0/53628155 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28500ccdf0 con 0x557440a61070 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.367+0000 7f284d600640 1 -- 172.21.15.84:0/53628155 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f28500cebb0 con 0x557440a61070 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.368+0000 7f284d600640 1 -- 172.21.15.84:0/53628155 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f28500cedb0 con 0x557440a61070 2024-09-21T07:58:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.369+0000 7f287180e740 10 client.27512 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:41.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.369+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557440d26950 con 0x557440a61070 2024-09-21T07:58:41.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.369+0000 7f284d600640 1 -- 172.21.15.84:0/53628155 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f285003b870 con 0x557440a61070 2024-09-21T07:58:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.370+0000 7f287180e740 10 client.27512 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.370+0000 7f287180e740 10 client.27512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:41.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.370+0000 7f287180e740 20 client.27512 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.370+0000 7f287180e740 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a1f9f0 0x557440e25180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.370+0000 7f287180e740 4 client.27512 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:41.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.370+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557440d80f00 con 0x557440a1f9f0 2024-09-21T07:58:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.371+0000 7f2863e00640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a1f9f0 0x557440e25180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.378+0000 7f2863e00640 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a1f9f0 0x557440e25180 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00614075e0516f3 server_cookie=f59be50c4549692f in_seq=0 out_seq=0 2024-09-21T07:58:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.378+0000 7f284d600640 10 client.27512 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.379+0000 7f284d600640 1 -- 172.21.15.84:0/53628155 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557440d80f00 con 0x557440a1f9f0 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.379+0000 7f284d600640 10 client.27512 handle_command_reply: tid=0 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.379+0000 7f287180e740 1 client.27512 shutdown 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.380+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 msgr2=0x557440e1f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.380+0000 7f287180e740 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e1f480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f28500cd580 tx=0x7f28500ccd10 comp rx=0 tx=0).stop 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.380+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 shutdown_connections 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.380+0000 7f287180e740 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a61070 0x557440e1f480 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.380+0000 7f287180e740 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a40390 0x557440e13c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.380+0000 7f287180e740 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a1f9f0 0x557440e25180 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.381+0000 7f284d600640 0 client.27512 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:41.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.381+0000 7f287180e740 1 --2- 172.21.15.84:0/53628155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a381b0 0x557440e136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.381+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 >> 172.21.15.84:0/53628155 conn(0x557440a55460 msgr2=0x557440e09590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.383+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 shutdown_connections 2024-09-21T07:58:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.385+0000 7f287180e740 1 -- 172.21.15.84:0/53628155 wait complete. 2024-09-21T07:58:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.385+0000 7f287180e740 20 client.27512 trim_cache size 0 max 16384 2024-09-21T07:58:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.423+0000 7f287180e740 1 Processor -- start 2024-09-21T07:58:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.424+0000 7f287180e740 1 -- start start 2024-09-21T07:58:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.424+0000 7f287180e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a1f9f0 0x557440e05040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.424+0000 7f287180e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 0x557440e05580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.424+0000 7f287180e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a40390 0x557440e106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.424+0000 7f287180e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f284400ff40 con 0x557440a381b0 2024-09-21T07:58:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.424+0000 7f287180e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2844011a80 con 0x557440a40390 2024-09-21T07:58:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.424+0000 7f287180e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2844010610 con 0x557440a1f9f0 2024-09-21T07:58:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.425+0000 7f2868a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a40390 0x557440e106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.425+0000 7f2868a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a40390 0x557440e106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:44314/0 (socket says 172.21.15.84:44314) 2024-09-21T07:58:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.426+0000 7f2863e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a1f9f0 0x557440e05040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.426+0000 7f2863e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a1f9f0 0x557440e05040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50240/0 (socket says 172.21.15.84:50240) 2024-09-21T07:58:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.426+0000 7f2863e00640 1 -- 172.21.15.84:0/3348944007 learned_addr learned my addr 172.21.15.84:0/3348944007 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.427+0000 7f2868a00640 1 -- 172.21.15.84:0/3348944007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a1f9f0 msgr2=0x557440e05040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.427+0000 7f2868a00640 1 --2- 172.21.15.84:0/3348944007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a1f9f0 0x557440e05040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.427+0000 7f2868a00640 1 -- 172.21.15.84:0/3348944007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 msgr2=0x557440e05580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.427+0000 7f2868a00640 1 --2- 172.21.15.84:0/3348944007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 0x557440e05580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.427+0000 7f2868a00640 1 -- 172.21.15.84:0/3348944007 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557440e254f0 con 0x557440a40390 2024-09-21T07:58:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.427+0000 7f2868a00640 1 --2- 172.21.15.84:0/3348944007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a40390 0x557440e106b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2850009a50 tx=0x7f28500cf000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f091d6db2b1df534 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.428+0000 7f284fe00640 1 -- 172.21.15.84:0/3348944007 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28500e8060 con 0x557440a40390 2024-09-21T07:58:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.428+0000 7f284fe00640 1 -- 172.21.15.84:0/3348944007 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557440d0bb90 con 0x557440a40390 2024-09-21T07:58:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.428+0000 7f284fe00640 1 -- 172.21.15.84:0/3348944007 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285003b9a0 con 0x557440a40390 2024-09-21T07:58:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.429+0000 7f287180e740 1 -- 172.21.15.84:0/3348944007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a40390 msgr2=0x557440e106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.429+0000 7f287180e740 1 --2- 172.21.15.84:0/3348944007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a40390 0x557440e106b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2850009a50 tx=0x7f28500cf000 comp rx=0 tx=0).stop 2024-09-21T07:58:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.430+0000 7f287180e740 1 -- 172.21.15.84:0/3348944007 shutdown_connections 2024-09-21T07:58:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.430+0000 7f287180e740 1 --2- 172.21.15.84:0/3348944007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a40390 0x557440e106b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.430+0000 7f287180e740 1 --2- 172.21.15.84:0/3348944007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 0x557440e05580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.430+0000 7f287180e740 1 --2- 172.21.15.84:0/3348944007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a1f9f0 0x557440e05040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.430+0000 7f287180e740 1 -- 172.21.15.84:0/3348944007 >> 172.21.15.84:0/3348944007 conn(0x557440a55460 msgr2=0x557440e11d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.436+0000 7f287180e740 1 -- 172.21.15.84:0/3348944007 shutdown_connections 2024-09-21T07:58:41.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.436+0000 7f287180e740 1 -- 172.21.15.84:0/3348944007 wait complete. 2024-09-21T07:58:41.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.437+0000 7f287180e740 1 -- start start 2024-09-21T07:58:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.437+0000 7f287180e740 1 Processor -- start 2024-09-21T07:58:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.439+0000 7f287180e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a1f9f0 0x557440e17da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.440+0000 7f287180e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 0x557440e18380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.440+0000 7f287180e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a40390 0x557440e888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.441+0000 7f2868a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a40390 0x557440e888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.441+0000 7f2868a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a40390 0x557440e888f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50246/0 (socket says 172.21.15.84:50246) 2024-09-21T07:58:41.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.441+0000 7f2868a00640 1 -- 172.21.15.84:0/2337065181 learned_addr learned my addr 172.21.15.84:0/2337065181 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:41.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.441+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f28440113b0 con 0x557440a381b0 2024-09-21T07:58:41.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.441+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2844010ce0 con 0x557440a1f9f0 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.441+0000 7f2863e00640 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a1f9f0 0x557440e17da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.442+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f284400df40 con 0x557440a40390 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.442+0000 7f287180e740 10 client.0 _ll_register_callbacks cb 0x7f28500c97f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.444+0000 7f2868a00640 1 -- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a1f9f0 msgr2=0x557440e17da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.444+0000 7f2868a00640 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a1f9f0 0x557440e17da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.444+0000 7f2868a00640 1 -- 172.21.15.84:0/2337065181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 msgr2=0x557440e18380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.444+0000 7f2868a00640 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 0x557440e18380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.444+0000 7f2868a00640 1 -- 172.21.15.84:0/2337065181 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557440e88f60 con 0x557440a40390 2024-09-21T07:58:41.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.445+0000 7f2868a00640 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a40390 0x557440e888f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f28500caaf0 tx=0x7f285003bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eedad5648677e3b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:41.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.445+0000 7f284d600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:41.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.446+0000 7f284d600640 1 -- 172.21.15.84:0/2337065181 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28500e8070 con 0x557440a40390 2024-09-21T07:58:41.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.446+0000 7f284d600640 1 -- 172.21.15.84:0/2337065181 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f28500cebb0 con 0x557440a40390 2024-09-21T07:58:41.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.447+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557440d0bb90 con 0x557440a40390 2024-09-21T07:58:41.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.448+0000 7f284d600640 1 -- 172.21.15.84:0/2337065181 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f28500d72a0 con 0x557440a40390 2024-09-21T07:58:41.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.448+0000 7f287180e740 10 client.27508 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:41.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.448+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557440e88f60 con 0x557440a40390 2024-09-21T07:58:41.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.449+0000 7f284d600640 1 -- 172.21.15.84:0/2337065181 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557440d0bb90 con 0x557440a40390 2024-09-21T07:58:41.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.449+0000 7f284d600640 1 -- 172.21.15.84:0/2337065181 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f28500d34f0 con 0x557440a40390 2024-09-21T07:58:41.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.449+0000 7f287180e740 10 client.27508 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:41.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.449+0000 7f287180e740 10 client.27508 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:41.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.450+0000 7f287180e740 20 client.27508 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:41.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.450+0000 7f287180e740 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a61070 0x557440e926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:41.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.450+0000 7f287180e740 4 client.27508 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:58:41.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.450+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557440d7c9b0 con 0x557440a61070 2024-09-21T07:58:41.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.451+0000 7f2863e00640 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a61070 0x557440e926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.454+0000 7f2863e00640 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a61070 0x557440e926c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6ffc6b7c8a26217 server_cookie=2880a09b075e6aa6 in_seq=0 out_seq=0 2024-09-21T07:58:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.455+0000 7f284d600640 10 client.27508 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.455+0000 7f284d600640 1 -- 172.21.15.84:0/2337065181 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557440d7c9b0 con 0x557440a61070 2024-09-21T07:58:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.455+0000 7f284d600640 10 client.27508 handle_command_reply: tid=0 2024-09-21T07:58:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.455+0000 7f287180e740 1 client.27508 shutdown 2024-09-21T07:58:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.456+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a40390 msgr2=0x557440e888f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.456+0000 7f287180e740 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a40390 0x557440e888f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f28500caaf0 tx=0x7f285003bb70 comp rx=0 tx=0).stop 2024-09-21T07:58:41.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.457+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 shutdown_connections 2024-09-21T07:58:41.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.457+0000 7f287180e740 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557440a61070 0x557440e926c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.457+0000 7f287180e740 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557440a40390 0x557440e888f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.457+0000 7f287180e740 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557440a381b0 0x557440e18380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.457+0000 7f287180e740 1 --2- 172.21.15.84:0/2337065181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557440a1f9f0 0x557440e17da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.457+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 >> 172.21.15.84:0/2337065181 conn(0x557440a55460 msgr2=0x557440e08b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.457+0000 7f284d600640 0 client.27508 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:41.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.458+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 shutdown_connections 2024-09-21T07:58:41.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.458+0000 7f287180e740 1 -- 172.21.15.84:0/2337065181 wait complete. 2024-09-21T07:58:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.458+0000 7f287180e740 20 client.27508 trim_cache size 0 max 16384 2024-09-21T07:58:41.461 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:58:41.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.462+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28480b6700 msgr2=0x7f28480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.462+0000 7f286aa00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28480b6700 0x7f28480b8c10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2864079d40 tx=0x7f285400b2f0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.462+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2864107be0 msgr2=0x7f28641a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.462+0000 7f286aa00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2864107be0 0x7f28641a62c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2850005ab0 tx=0x7f2850003cd0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.464+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 shutdown_connections 2024-09-21T07:58:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.464+0000 7f286aa00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28480b6700 0x7f28480b8c10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.464+0000 7f286aa00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2864107be0 0x7f28641a62c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.464+0000 7f286aa00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28641030f0 0x7f28641a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.464+0000 7f286aa00640 1 --2- 172.21.15.84:0/2647224650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28641027a0 0x7f28641a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:41.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.464+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 >> 172.21.15.84:0/2647224650 conn(0x7f2864079730 msgr2=0x7f28641055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.471+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 shutdown_connections 2024-09-21T07:58:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:41.471+0000 7f286aa00640 1 -- 172.21.15.84:0/2647224650 wait complete. 2024-09-21T07:58:41.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:41 smithi084 ceph-mon[30411]: pgmap v625: 129 pgs: 129 active+clean; 55 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 23 KiB/s rd, 303 MiB/s wr, 2.11k op/s 2024-09-21T07:58:41.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:41 smithi162 ceph-mon[34833]: pgmap v625: 129 pgs: 129 active+clean; 55 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 23 KiB/s rd, 303 MiB/s wr, 2.11k op/s 2024-09-21T07:58:41.858 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:41 smithi191 ceph-mon[34667]: pgmap v625: 129 pgs: 129 active+clean; 55 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 23 KiB/s rd, 303 MiB/s wr, 2.11k op/s 2024-09-21T07:58:43.789 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:43 smithi084 ceph-mon[30411]: pgmap v626: 129 pgs: 129 active+clean; 55 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 26 KiB/s rd, 250 MiB/s wr, 1.90k op/s 2024-09-21T07:58:43.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:43 smithi162 ceph-mon[34833]: pgmap v626: 129 pgs: 129 active+clean; 55 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 26 KiB/s rd, 250 MiB/s wr, 1.90k op/s 2024-09-21T07:58:43.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:43 smithi191 ceph-mon[34667]: pgmap v626: 129 pgs: 129 active+clean; 55 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 26 KiB/s rd, 250 MiB/s wr, 1.90k op/s 2024-09-21T07:58:45.538 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:45 smithi084 ceph-mon[30411]: pgmap v627: 129 pgs: 129 active+clean; 56 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 19 KiB/s rd, 239 MiB/s wr, 1.94k op/s 2024-09-21T07:58:45.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:45 smithi162 ceph-mon[34833]: pgmap v627: 129 pgs: 129 active+clean; 56 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 19 KiB/s rd, 239 MiB/s wr, 1.94k op/s 2024-09-21T07:58:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.818+0000 7fecafe00640 1 -- 172.21.15.84:0/3784613754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca8110350 msgr2=0x7feca807b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.818+0000 7fecafe00640 1 --2- 172.21.15.84:0/3784613754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca8110350 0x7feca807b690 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feca0009ca0 tx=0x7feca002b9f0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.818+0000 7fecafe00640 1 -- 172.21.15.84:0/3784613754 shutdown_connections 2024-09-21T07:58:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.818+0000 7fecafe00640 1 --2- 172.21.15.84:0/3784613754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca8110350 0x7feca807b690 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.818+0000 7fecafe00640 1 --2- 172.21.15.84:0/3784613754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca810fa00 0x7feca810fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.819+0000 7fecafe00640 1 --2- 172.21.15.84:0/3784613754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca810ba30 0x7feca810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.819+0000 7fecafe00640 1 -- 172.21.15.84:0/3784613754 >> 172.21.15.84:0/3784613754 conn(0x7feca8070dd0 msgr2=0x7feca80711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.819+0000 7fecafe00640 1 -- 172.21.15.84:0/3784613754 shutdown_connections 2024-09-21T07:58:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.820+0000 7fecafe00640 1 -- 172.21.15.84:0/3784613754 wait complete. 2024-09-21T07:58:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.822+0000 7fecafe00640 1 Processor -- start 2024-09-21T07:58:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.822+0000 7fecafe00640 1 -- start start 2024-09-21T07:58:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.822+0000 7fecafe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca810ba30 0x7feca807ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.822+0000 7fecafe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca810fa00 0x7feca807b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.822+0000 7fecafe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca8110350 0x7feca807e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.823+0000 7fecaca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca810fa00 0x7feca807b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.823+0000 7fecaca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca810fa00 0x7feca807b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50272/0 (socket says 172.21.15.84:50272) 2024-09-21T07:58:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.823+0000 7fecaca00640 1 -- 172.21.15.84:0/1472501550 learned_addr learned my addr 172.21.15.84:0/1472501550 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.823+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feca8080ce0 con 0x7feca810ba30 2024-09-21T07:58:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.823+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feca8080b60 con 0x7feca8110350 2024-09-21T07:58:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.823+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feca8080e60 con 0x7feca810fa00 2024-09-21T07:58:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.823+0000 7fecade00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca8110350 0x7feca807e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.824+0000 7fecade00640 1 -- 172.21.15.84:0/1472501550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca810fa00 msgr2=0x7feca807b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.824+0000 7fecade00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca810fa00 0x7feca807b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.824+0000 7fecade00640 1 -- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca810ba30 msgr2=0x7feca807ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.824+0000 7fecad400640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca810ba30 0x7feca807ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.824+0000 7fecade00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca810ba30 0x7feca807ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.824+0000 7fecade00640 1 -- 172.21.15.84:0/1472501550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca807b910 con 0x7feca8110350 2024-09-21T07:58:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.824+0000 7fecaca00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca810fa00 0x7feca807b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.825+0000 7fecade00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca8110350 0x7feca807e1e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feca002bfe0 tx=0x7feca00309c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.825+0000 7feca6000640 1 -- 172.21.15.84:0/1472501550 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0034030 con 0x7feca8110350 2024-09-21T07:58:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.825+0000 7feca6000640 1 -- 172.21.15.84:0/1472501550 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca002f850 con 0x7feca8110350 2024-09-21T07:58:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.825+0000 7feca6000640 1 -- 172.21.15.84:0/1472501550 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca00046c0 con 0x7feca8110350 2024-09-21T07:58:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.825+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca807e720 con 0x7feca8110350 2024-09-21T07:58:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.825+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca807eb60 con 0x7feca8110350 2024-09-21T07:58:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.828+0000 7fecb6e2e740 1 Processor -- start 2024-09-21T07:58:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.832+0000 7feca6000640 1 -- 172.21.15.84:0/1472501550 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7feca0037070 con 0x7feca8110350 2024-09-21T07:58:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecb6e2e740 1 -- start start 2024-09-21T07:58:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29a60c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296932f0 0x562a29a61170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562a299d66b0 con 0x562a296932f0 2024-09-21T07:58:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562a299c5ae0 con 0x562a2969b4d0 2024-09-21T07:58:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562a299c98f0 con 0x562a296bc1b0 2024-09-21T07:58:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecaca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29a60c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecaca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29a60c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50276/0 (socket says 172.21.15.84:50276) 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.833+0000 7fecaca00640 1 -- 172.21.15.84:0/1349910517 learned_addr learned my addr 172.21.15.84:0/1349910517 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecaca00640 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecaca00640 1 -- 172.21.15.84:0/1349910517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 msgr2=0x562a29a616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecaca00640 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecaca00640 1 -- 172.21.15.84:0/1349910517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296932f0 msgr2=0x562a29a61170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecad400640 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296932f0 0x562a29a61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecaca00640 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296932f0 0x562a29a61170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecaca00640 1 -- 172.21.15.84:0/1349910517 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a29992780 con 0x562a296bc1b0 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecad400640 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296932f0 0x562a29a61170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7fecaca00640 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29a60c30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fec9c011b20 tx=0x7fec9c00aa90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93073ed33540c5ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.834+0000 7feca6000640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fec900b67b0 0x7fec900b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.835+0000 7feca6000640 1 -- 172.21.15.84:0/1472501550 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7feca0108b00 con 0x7feca8110350 2024-09-21T07:58:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.835+0000 7fec96600640 1 -- 172.21.15.84:0/1349910517 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00fa90 con 0x562a296bc1b0 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.835+0000 7fec96600640 1 -- 172.21.15.84:0/1349910517 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec9c00fc30 con 0x562a296bc1b0 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.835+0000 7fec96600640 1 -- 172.21.15.84:0/1349910517 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c003c60 con 0x562a296bc1b0 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.835+0000 7fecad400640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fec900b67b0 0x7fec900b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.836+0000 7fecb6e2e740 1 -- 172.21.15.84:0/1349910517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 msgr2=0x562a29a60c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.836+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29a60c30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fec9c011b20 tx=0x7fec9c00aa90 comp rx=0 tx=0).stop 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.836+0000 7fecad400640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fec900b67b0 0x7fec900b8cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x562a29a5f8b0 tx=0x7fec98005dd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.837+0000 7fecb6e2e740 1 -- 172.21.15.84:0/1349910517 shutdown_connections 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.837+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.837+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296932f0 0x562a29a61170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.837+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/1349910517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29a60c30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.837+0000 7fecb6e2e740 1 -- 172.21.15.84:0/1349910517 >> 172.21.15.84:0/1349910517 conn(0x562a296b0300 msgr2=0x562a29a5eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.839+0000 7fecb6e2e740 1 -- 172.21.15.84:0/1349910517 shutdown_connections 2024-09-21T07:58:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.839+0000 7fecb6e2e740 1 -- 172.21.15.84:0/1349910517 wait complete. 2024-09-21T07:58:45.843 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.841+0000 7fecb6e2e740 1 -- start start 2024-09-21T07:58:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.843+0000 7fecb6e2e740 1 Processor -- start 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.844+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 0x562a29a6c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.844+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a2969b4d0 0x562a29a6c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.844+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.844+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562a298fdab0 con 0x562a296bc1b0 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.844+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562a2996c570 con 0x562a296932f0 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.844+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562a29a6f3b0 con 0x562a2969b4d0 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.845+0000 7fecb6e2e740 10 client.0 _ll_register_callbacks cb 0x562a2997b100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a2969b4d0 0x562a29a6c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a2969b4d0 0x562a29a6c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:50284/0 (socket says 172.21.15.84:50284) 2024-09-21T07:58:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 -- 172.21.15.84:0/3481153107 learned_addr learned my addr 172.21.15.84:0/3481153107 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 -- 172.21.15.84:0/3481153107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 msgr2=0x562a29a6c280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:58:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 0x562a29a6c280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 -- 172.21.15.84:0/3481153107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 msgr2=0x562a29a786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.846+0000 7fecaca00640 1 -- 172.21.15.84:0/3481153107 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a29727790 con 0x562a2969b4d0 2024-09-21T07:58:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.849+0000 7fecaca00640 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a2969b4d0 0x562a29a6c7c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00a9a0 tx=0x7fec9c00a9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2667a35b228d73ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.850+0000 7fec8aa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.850+0000 7fec8aa00640 1 -- 172.21.15.84:0/3481153107 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c011230 con 0x562a2969b4d0 2024-09-21T07:58:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.850+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec9c00fc30 con 0x562a2969b4d0 2024-09-21T07:58:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.850+0000 7fec8aa00640 1 -- 172.21.15.84:0/3481153107 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fec9c011030 con 0x562a2969b4d0 2024-09-21T07:58:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.851+0000 7fec8aa00640 1 -- 172.21.15.84:0/3481153107 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec9c02e050 con 0x562a2969b4d0 2024-09-21T07:58:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.851+0000 7fecb6e2e740 10 client.27520 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.851+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a297a0620 con 0x562a2969b4d0 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.851+0000 7fec8aa00640 1 -- 172.21.15.84:0/3481153107 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec9c00fc30 con 0x562a2969b4d0 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.851+0000 7fec8aa00640 1 -- 172.21.15.84:0/3481153107 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fec9c0053a0 con 0x562a2969b4d0 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.852+0000 7fecb6e2e740 10 client.27520 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.852+0000 7fecb6e2e740 10 client.27520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.852+0000 7fecb6e2e740 20 client.27520 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.852+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a2967ad80 0x562a29a8f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.852+0000 7fecb6e2e740 4 client.27520 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.852+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a299d8600 con 0x562a2967ad80 2024-09-21T07:58:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.853+0000 7fecad400640 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a2967ad80 0x562a29a8f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.853+0000 7fec8aa00640 10 client.27520 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.853+0000 7fecad400640 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a2967ad80 0x562a29a8f1d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e2a85371a8be41 server_cookie=6f0f8b450ec44b1c in_seq=0 out_seq=0 2024-09-21T07:58:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.854+0000 7fec8aa00640 1 -- 172.21.15.84:0/3481153107 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a299d8600 con 0x562a2967ad80 2024-09-21T07:58:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.854+0000 7fec8aa00640 10 client.27520 handle_command_reply: tid=0 2024-09-21T07:58:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.854+0000 7fecb6e2e740 1 client.27520 shutdown 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.854+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a2969b4d0 msgr2=0x562a29a6c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.854+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a2969b4d0 0x562a29a6c7c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00a9a0 tx=0x7fec9c00a9d0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 shutdown_connections 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a2967ad80 0x562a29a8f1d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a2969b4d0 0x562a29a6c7c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/3481153107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 0x562a29a6c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 >> 172.21.15.84:0/3481153107 conn(0x562a296b0300 msgr2=0x562a29a61c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fec8aa00640 0 client.27520 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 shutdown_connections 2024-09-21T07:58:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 1 -- 172.21.15.84:0/3481153107 wait complete. 2024-09-21T07:58:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.855+0000 7fecb6e2e740 20 client.27520 trim_cache size 0 max 16384 2024-09-21T07:58:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.875+0000 7fecb6e2e740 1 Processor -- start 2024-09-21T07:58:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.875+0000 7fecb6e2e740 1 -- start start 2024-09-21T07:58:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.875+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296932f0 0x562a29a62620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a6deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a785a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feca81c8460 con 0x562a296bc1b0 2024-09-21T07:58:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feca81c9f50 con 0x562a2969b4d0 2024-09-21T07:58:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feca81c8ae0 con 0x562a296932f0 2024-09-21T07:58:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecade00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecad400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296932f0 0x562a29a62620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecade00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a785a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53656/0 (socket says 172.21.15.84:53656) 2024-09-21T07:58:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecade00640 1 -- 172.21.15.84:0/4252304110 learned_addr learned my addr 172.21.15.84:0/4252304110 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecaca00640 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a6deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.876+0000 7fecad400640 1 -- 172.21.15.84:0/4252304110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 msgr2=0x562a29a6deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fecad400640 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a6deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fecad400640 1 -- 172.21.15.84:0/4252304110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 msgr2=0x562a29a785a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fecad400640 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a785a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fecad400640 1 -- 172.21.15.84:0/4252304110 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a29a6a760 con 0x562a296932f0 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fecaca00640 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a6deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fecad400640 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296932f0 0x562a29a62620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x562a29a8f7a0 tx=0x7fec98011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b8ce567901ea454 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fec95c00640 1 -- 172.21.15.84:0/4252304110 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9801ce40 con 0x562a296932f0 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fec95c00640 1 -- 172.21.15.84:0/4252304110 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec98029070 con 0x562a296932f0 2024-09-21T07:58:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.877+0000 7fec95c00640 1 -- 172.21.15.84:0/4252304110 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9801b6e0 con 0x562a296932f0 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 -- 172.21.15.84:0/4252304110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296932f0 msgr2=0x562a29a62620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296932f0 0x562a29a62620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x562a29a8f7a0 tx=0x7fec98011000 comp rx=0 tx=0).stop 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 -- 172.21.15.84:0/4252304110 shutdown_connections 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a296bc1b0 0x562a29a785a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a2969b4d0 0x562a29a6deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/4252304110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296932f0 0x562a29a62620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 -- 172.21.15.84:0/4252304110 >> 172.21.15.84:0/4252304110 conn(0x562a296b0300 msgr2=0x562a29a6d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.878+0000 7fecb6e2e740 1 -- 172.21.15.84:0/4252304110 shutdown_connections 2024-09-21T07:58:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.879+0000 7fecb6e2e740 1 -- 172.21.15.84:0/4252304110 wait complete. 2024-09-21T07:58:45.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.879+0000 7fecb6e2e740 1 -- start start 2024-09-21T07:58:45.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.879+0000 7fecb6e2e740 1 Processor -- start 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 0x562a29a72010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a2969b4d0 0x562a29a725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecb6e2e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29af1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecaca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a2969b4d0 0x562a29a725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecaca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a2969b4d0 0x562a29a725f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53660/0 (socket says 172.21.15.84:53660) 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecb6e2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feca81c9880 con 0x562a2969b4d0 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feca81c91b0 con 0x562a296932f0 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecaca00640 1 -- 172.21.15.84:0/682248268 learned_addr learned my addr 172.21.15.84:0/682248268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feca81c23e0 con 0x562a296bc1b0 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecb6e2e740 10 client.0 _ll_register_callbacks cb 0x7fec9c0115e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecade00640 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29af1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.880+0000 7fecad400640 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 0x562a29a72010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fecaca00640 1 -- 172.21.15.84:0/682248268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 msgr2=0x562a29af1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fecaca00640 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29af1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fecaca00640 1 -- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 msgr2=0x562a29a72010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fecaca00640 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 0x562a29a72010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fecaca00640 1 -- 172.21.15.84:0/682248268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a29af2180 con 0x562a2969b4d0 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fecaca00640 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a2969b4d0 0x562a29a725f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00f850 tx=0x7fec9c00aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8f2297ac179b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fec8aa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fec8aa00640 1 -- 172.21.15.84:0/682248268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c036070 con 0x562a2969b4d0 2024-09-21T07:58:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fec8aa00640 1 -- 172.21.15.84:0/682248268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7fec9c00fb50 con 0x562a2969b4d0 2024-09-21T07:58:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.881+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec98029070 con 0x562a2969b4d0 2024-09-21T07:58:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.882+0000 7fec8aa00640 1 -- 172.21.15.84:0/682248268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec9c03f050 con 0x562a2969b4d0 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.882+0000 7fecb6e2e740 10 client.17214 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.882+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a29af9480 con 0x562a2969b4d0 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.882+0000 7fec8aa00640 1 -- 172.21.15.84:0/682248268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec98029070 con 0x562a2969b4d0 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.883+0000 7fec8aa00640 1 -- 172.21.15.84:0/682248268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fec9c039020 con 0x562a2969b4d0 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.883+0000 7fecb6e2e740 10 client.17214 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.883+0000 7fecb6e2e740 10 client.17214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.883+0000 7fecb6e2e740 20 client.17214 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.883+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a296501c0 0x562a29afba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.883+0000 7fecb6e2e740 4 client.17214 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:58:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.883+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a299d40b0 con 0x562a296501c0 2024-09-21T07:58:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.885+0000 7fecad400640 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a296501c0 0x562a29afba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.886+0000 7fecad400640 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a296501c0 0x562a29afba10 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e6151e0551c505 server_cookie=9c8a0437e0129b3 in_seq=0 out_seq=0 2024-09-21T07:58:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.886+0000 7fec8aa00640 10 client.17214 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:45 smithi191 ceph-mon[34667]: pgmap v627: 129 pgs: 129 active+clean; 56 GiB data, 116 GiB used, 957 GiB / 1.0 TiB avail; 19 KiB/s rd, 239 MiB/s wr, 1.94k op/s 2024-09-21T07:58:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:58:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.907+0000 7fec8aa00640 1 -- 172.21.15.84:0/682248268 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a299d40b0 con 0x562a296501c0 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.907+0000 7fec8aa00640 10 client.17214 handle_command_reply: tid=0 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.907+0000 7fecb6e2e740 1 client.17214 shutdown 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a2969b4d0 msgr2=0x562a29a725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a2969b4d0 0x562a29a725f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00f850 tx=0x7fec9c00aab0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 shutdown_connections 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x562a296501c0 0x562a29afba10 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562a296bc1b0 0x562a29af1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a2969b4d0 0x562a29a725f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 --2- 172.21.15.84:0/682248268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a296932f0 0x562a29a72010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 >> 172.21.15.84:0/682248268 conn(0x562a296b0300 msgr2=0x562a29a622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.908+0000 7fec8aa00640 0 client.17214 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.909+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 shutdown_connections 2024-09-21T07:58:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.909+0000 7fecb6e2e740 1 -- 172.21.15.84:0/682248268 wait complete. 2024-09-21T07:58:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.909+0000 7fecb6e2e740 20 client.17214 trim_cache size 0 max 16384 2024-09-21T07:58:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fec900b67b0 msgr2=0x7fec900b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fec900b67b0 0x7fec900b8cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x562a29a5f8b0 tx=0x7fec98005dd0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca8110350 msgr2=0x7feca807e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca8110350 0x7feca807e1e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feca002bfe0 tx=0x7feca00309c0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 shutdown_connections 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fec900b67b0 0x7fec900b8cc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca8110350 0x7feca807e1e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feca810fa00 0x7feca807b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 --2- 172.21.15.84:0/1472501550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca810ba30 0x7feca807ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.913+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 >> 172.21.15.84:0/1472501550 conn(0x7feca8070dd0 msgr2=0x7feca8069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.914+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 shutdown_connections 2024-09-21T07:58:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:45.914+0000 7fecafe00640 1 -- 172.21.15.84:0/1472501550 wait complete. 2024-09-21T07:58:46.270 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:58:46.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:58:46.972 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:47.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:47 smithi084 ceph-mon[30411]: pgmap v628: 129 pgs: 129 active+clean; 56 GiB data, 116 GiB used, 956 GiB / 1.0 TiB avail; 34 KiB/s rd, 228 MiB/s wr, 1.96k op/s 2024-09-21T07:58:47.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:47 smithi191 ceph-mon[34667]: pgmap v628: 129 pgs: 129 active+clean; 56 GiB data, 116 GiB used, 956 GiB / 1.0 TiB avail; 34 KiB/s rd, 228 MiB/s wr, 1.96k op/s 2024-09-21T07:58:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:47 smithi162 ceph-mon[34833]: pgmap v628: 129 pgs: 129 active+clean; 56 GiB data, 116 GiB used, 956 GiB / 1.0 TiB avail; 34 KiB/s rd, 228 MiB/s wr, 1.96k op/s 2024-09-21T07:58:49.852 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:49 smithi162 ceph-mon[34833]: pgmap v629: 129 pgs: 129 active+clean; 56 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 22 KiB/s rd, 169 MiB/s wr, 1.50k op/s 2024-09-21T07:58:49.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:49 smithi191 ceph-mon[34667]: pgmap v629: 129 pgs: 129 active+clean; 56 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 22 KiB/s rd, 169 MiB/s wr, 1.50k op/s 2024-09-21T07:58:50.065 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:49 smithi084 ceph-mon[30411]: pgmap v629: 129 pgs: 129 active+clean; 56 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 22 KiB/s rd, 169 MiB/s wr, 1.50k op/s 2024-09-21T07:58:50.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.401+0000 7f7db2400640 1 -- 172.21.15.84:0/88153376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac114430 msgr2=0x7f7dac116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.401+0000 7f7db2400640 1 --2- 172.21.15.84:0/88153376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac114430 0x7f7dac116920 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009ca0 tx=0x7f7da402a8f0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.405+0000 7f7db2400640 1 -- 172.21.15.84:0/88153376 shutdown_connections 2024-09-21T07:58:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.405+0000 7f7db2400640 1 --2- 172.21.15.84:0/88153376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac114430 0x7f7dac116920 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.405+0000 7f7db2400640 1 --2- 172.21.15.84:0/88153376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac075cf0 0x7f7dac076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.405+0000 7f7db2400640 1 --2- 172.21.15.84:0/88153376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dac077330 0x7f7dac0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.405+0000 7f7db2400640 1 -- 172.21.15.84:0/88153376 >> 172.21.15.84:0/88153376 conn(0x7f7dac07b910 msgr2=0x7f7dac07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.405+0000 7f7db2400640 1 -- 172.21.15.84:0/88153376 shutdown_connections 2024-09-21T07:58:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.406+0000 7f7db2400640 1 -- 172.21.15.84:0/88153376 wait complete. 2024-09-21T07:58:50.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.408+0000 7f7db2400640 1 Processor -- start 2024-09-21T07:58:50.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.408+0000 7f7db2400640 1 -- start start 2024-09-21T07:58:50.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.409+0000 7f7db2400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dac075cf0 0x7f7dac1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.409+0000 7f7db2400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac077330 0x7f7dac1a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.409+0000 7f7db2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac114430 0x7f7dac1a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.409+0000 7f7db2400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac11a0a0 con 0x7f7dac075cf0 2024-09-21T07:58:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.409+0000 7f7db2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac119f20 con 0x7f7dac114430 2024-09-21T07:58:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.409+0000 7f7db2400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac11a220 con 0x7f7dac077330 2024-09-21T07:58:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.409+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac114430 0x7f7dac1a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.410+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac114430 0x7f7dac1a62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43790/0 (socket says 172.21.15.84:43790) 2024-09-21T07:58:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.410+0000 7f7dabe00640 1 -- 172.21.15.84:0/2737208449 learned_addr learned my addr 172.21.15.84:0/2737208449 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.410+0000 7f7daaa00640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac077330 0x7f7dac1a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.410+0000 7f7dabe00640 1 -- 172.21.15.84:0/2737208449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac077330 msgr2=0x7f7dac1a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.411+0000 7f7dabe00640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac077330 0x7f7dac1a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.411+0000 7f7dabe00640 1 -- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dac075cf0 msgr2=0x7f7dac1a0a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:58:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.411+0000 7f7dabe00640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dac075cf0 0x7f7dac1a0a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.411+0000 7f7dabe00640 1 -- 172.21.15.84:0/2737208449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac1a6a00 con 0x7f7dac114430 2024-09-21T07:58:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.411+0000 7f7dabe00640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac114430 0x7f7dac1a62d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7da402ae60 tx=0x7f7da4003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.412+0000 7f7da3e00640 1 -- 172.21.15.84:0/2737208449 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4004040 con 0x7f7dac114430 2024-09-21T07:58:50.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.412+0000 7f7da3e00640 1 -- 172.21.15.84:0/2737208449 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da402d070 con 0x7f7dac114430 2024-09-21T07:58:50.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.412+0000 7f7daaa00640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac077330 0x7f7dac1a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:50.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.412+0000 7f7da3e00640 1 -- 172.21.15.84:0/2737208449 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4030c40 con 0x7f7dac114430 2024-09-21T07:58:50.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.412+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac1a6c90 con 0x7f7dac114430 2024-09-21T07:58:50.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.412+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac1ad450 con 0x7f7dac114430 2024-09-21T07:58:50.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.420+0000 7f7da3e00640 1 -- 172.21.15.84:0/2737208449 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7da40041e0 con 0x7f7dac114430 2024-09-21T07:58:50.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.422+0000 7f7da3e00640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7d900b67b0 0x7f7d900b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.423+0000 7f7da3e00640 1 -- 172.21.15.84:0/2737208449 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f7da4108dc0 con 0x7f7dac114430 2024-09-21T07:58:50.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.431+0000 7f7db9006740 1 Processor -- start 2024-09-21T07:58:50.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.424+0000 7f7dab400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7d900b67b0 0x7f7d900b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.431+0000 7f7db9006740 1 -- start start 2024-09-21T07:58:50.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.433+0000 7f7db9006740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0be0350 0x55ecc0f87d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.434+0000 7f7dab400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0be0350 0x55ecc0f87d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.434+0000 7f7dab400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0be0350 0x55ecc0f87d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49802/0 (socket says 172.21.15.84:49802) 2024-09-21T07:58:50.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.435+0000 7f7dab400640 1 -- 172.21.15.84:0/2433236608 learned_addr learned my addr 172.21.15.84:0/2433236608 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:50.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.435+0000 7f7db9006740 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bb7490 0x55ecc0f88250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.435+0000 7f7db9006740 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bbf670 0x55ecc0f88790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.436+0000 7f7dabe00640 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bbf670 0x55ecc0f88790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.436+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecc0efde90 con 0x55ecc0bb7490 2024-09-21T07:58:50.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.437+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ecc0eed2c0 con 0x55ecc0bbf670 2024-09-21T07:58:50.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.437+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ecc0ef10d0 con 0x55ecc0be0350 2024-09-21T07:58:50.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.438+0000 7f7daaa00640 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bb7490 0x55ecc0f88250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.440+0000 7f7dabe00640 1 -- 172.21.15.84:0/2433236608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0be0350 msgr2=0x55ecc0f87d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.440+0000 7f7dabe00640 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0be0350 0x55ecc0f87d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.440+0000 7f7dabe00640 1 -- 172.21.15.84:0/2433236608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bb7490 msgr2=0x55ecc0f88250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.440+0000 7f7dabe00640 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bb7490 0x55ecc0f88250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.440+0000 7f7dabe00640 1 -- 172.21.15.84:0/2433236608 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc0c4b930 con 0x55ecc0bbf670 2024-09-21T07:58:50.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.441+0000 7f7daaa00640 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bb7490 0x55ecc0f88250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:50.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.439+0000 7f7dab400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7d900b67b0 0x7f7d900b8cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00ae30 tx=0x7f7d9c0137d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.442+0000 7f7dabe00640 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bbf670 0x55ecc0f88790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7da4106120 tx=0x7f7da40cafa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd11d07944e9323 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.443+0000 7f7da0c00640 1 -- 172.21.15.84:0/2433236608 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da40cef20 con 0x55ecc0bbf670 2024-09-21T07:58:50.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.443+0000 7f7da0c00640 1 -- 172.21.15.84:0/2433236608 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da4036030 con 0x55ecc0bbf670 2024-09-21T07:58:50.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.443+0000 7f7da0c00640 1 -- 172.21.15.84:0/2433236608 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da41063a0 con 0x55ecc0bbf670 2024-09-21T07:58:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bbf670 msgr2=0x55ecc0f88790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bbf670 0x55ecc0f88790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7da4106120 tx=0x7f7da40cafa0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 shutdown_connections 2024-09-21T07:58:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bbf670 0x55ecc0f88790 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bb7490 0x55ecc0f88250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 --2- 172.21.15.84:0/2433236608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0be0350 0x55ecc0f87d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 >> 172.21.15.84:0/2433236608 conn(0x55ecc0bd4740 msgr2=0x55ecc0f85c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 shutdown_connections 2024-09-21T07:58:50.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.445+0000 7f7db9006740 1 -- 172.21.15.84:0/2433236608 wait complete. 2024-09-21T07:58:50.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.446+0000 7f7db9006740 1 -- start start 2024-09-21T07:58:50.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.446+0000 7f7db9006740 1 Processor -- start 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7db9006740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bb7490 0x55ecc0f93840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7db9006740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc0f93d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7db9006740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7db9006740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecc0d4e890 con 0x55ecc0be0350 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7db9006740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ecc0e88160 con 0x55ecc0bb7490 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7db9006740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ecc0f962b0 con 0x55ecc0bbf670 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7db9006740 10 client.0 _ll_register_callbacks cb 0x55ecc0ea4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc0f93d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc0f93d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49806/0 (socket says 172.21.15.84:49806) 2024-09-21T07:58:50.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.447+0000 7f7daaa00640 1 -- 172.21.15.84:0/3044517444 learned_addr learned my addr 172.21.15.84:0/3044517444 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:50.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.448+0000 7f7dab400640 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bb7490 0x55ecc0f93840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.448+0000 7f7dabe00640 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.448+0000 7f7dab400640 1 -- 172.21.15.84:0/3044517444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 msgr2=0x55ecc0f93d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.448+0000 7f7dab400640 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc0f93d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.448+0000 7f7dab400640 1 -- 172.21.15.84:0/3044517444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 msgr2=0x55ecc0f9f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.448+0000 7f7dab400640 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.448+0000 7f7dab400640 1 -- 172.21.15.84:0/3044517444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc0f9faf0 con 0x55ecc0bb7490 2024-09-21T07:58:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.449+0000 7f7dab400640 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bb7490 0x55ecc0f93840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c013cd0 tx=0x7f7d9c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff0682400cb9a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.449+0000 7f7d95600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.449+0000 7f7d95600640 1 -- 172.21.15.84:0/3044517444 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c010ce0 con 0x55ecc0bb7490 2024-09-21T07:58:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.449+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da4036030 con 0x55ecc0bb7490 2024-09-21T07:58:50.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.449+0000 7f7d95600640 1 -- 172.21.15.84:0/3044517444 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f7d9c010ae0 con 0x55ecc0bb7490 2024-09-21T07:58:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.451+0000 7f7d95600640 1 -- 172.21.15.84:0/3044517444 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d9c010ce0 con 0x55ecc0bb7490 2024-09-21T07:58:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.451+0000 7f7db9006740 10 client.27542 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:50.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.451+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ecc0fa2430 con 0x55ecc0bb7490 2024-09-21T07:58:50.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7d95600640 1 -- 172.21.15.84:0/3044517444 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da4036030 con 0x55ecc0bb7490 2024-09-21T07:58:50.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7d95600640 1 -- 172.21.15.84:0/3044517444 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7d9c005400 con 0x55ecc0bb7490 2024-09-21T07:58:50.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7db9006740 10 client.27542 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:50.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7db9006740 10 client.27542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7db9006740 20 client.27542 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7db9006740 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc0b9ecd0 0x55ecc0fa58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7db9006740 4 client.27542 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.452+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecc0effde0 con 0x55ecc0b9ecd0 2024-09-21T07:58:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.453+0000 7f7daaa00640 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc0b9ecd0 0x55ecc0fa58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.454+0000 7f7daaa00640 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc0b9ecd0 0x55ecc0fa58a0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d577278dadcba61 server_cookie=aebe0bdd43044550 in_seq=0 out_seq=0 2024-09-21T07:58:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.454+0000 7f7d95600640 10 client.27542 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:50.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.455+0000 7f7d95600640 1 -- 172.21.15.84:0/3044517444 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ecc0effde0 con 0x55ecc0b9ecd0 2024-09-21T07:58:50.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.455+0000 7f7d95600640 10 client.27542 handle_command_reply: tid=0 2024-09-21T07:58:50.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.455+0000 7f7db9006740 1 client.27542 shutdown 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.455+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bb7490 msgr2=0x55ecc0f93840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.455+0000 7f7db9006740 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bb7490 0x55ecc0f93840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c013cd0 tx=0x7f7d9c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 shutdown_connections 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc0b9ecd0 0x55ecc0fa58a0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc0f93d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 --2- 172.21.15.84:0/3044517444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0bb7490 0x55ecc0f93840 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c013cd0 tx=0x7f7d9c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 >> 172.21.15.84:0/3044517444 conn(0x55ecc0bd4740 msgr2=0x55ecc0f8aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7d95600640 0 client.27542 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:50.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 shutdown_connections 2024-09-21T07:58:50.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 1 -- 172.21.15.84:0/3044517444 wait complete. 2024-09-21T07:58:50.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.456+0000 7f7db9006740 20 client.27542 trim_cache size 0 max 16384 2024-09-21T07:58:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 Processor -- start 2024-09-21T07:58:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 -- start start 2024-09-21T07:58:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bbf670 0x55ecc0f85c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0b74080 0x55ecc0f8ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c00ffa0 con 0x55ecc0bbf670 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c011ae0 con 0x55ecc0be0350 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.480+0000 7f7db9006740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c010670 con 0x55ecc0b74080 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.481+0000 7f7dab400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bbf670 0x55ecc0f85c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.481+0000 7f7dab400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bbf670 0x55ecc0f85c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42526/0 (socket says 172.21.15.84:42526) 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.481+0000 7f7dab400640 1 -- 172.21.15.84:0/1912034586 learned_addr learned my addr 172.21.15.84:0/1912034586 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:50.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.481+0000 7f7daaa00640 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.481+0000 7f7dabe00640 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0b74080 0x55ecc0f8ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.482+0000 7f7dab400640 1 -- 172.21.15.84:0/1912034586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0b74080 msgr2=0x55ecc0f8ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.482+0000 7f7dab400640 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0b74080 0x55ecc0f8ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.482+0000 7f7dab400640 1 -- 172.21.15.84:0/1912034586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0be0350 msgr2=0x55ecc0f9f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.482+0000 7f7dab400640 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.482+0000 7f7dab400640 1 -- 172.21.15.84:0/1912034586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc0f8eed0 con 0x55ecc0bbf670 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.482+0000 7f7dab400640 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bbf670 0x55ecc0f85c30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c018040 tx=0x7f7d9c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57dbabbcce9fc4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.483+0000 7f7d97e00640 1 -- 172.21.15.84:0/1912034586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c036070 con 0x55ecc0bbf670 2024-09-21T07:58:50.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.483+0000 7f7d97e00640 1 -- 172.21.15.84:0/1912034586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d9c0116f0 con 0x55ecc0bbf670 2024-09-21T07:58:50.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.483+0000 7f7d97e00640 1 -- 172.21.15.84:0/1912034586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c003850 con 0x55ecc0bbf670 2024-09-21T07:58:50.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.484+0000 7f7db9006740 1 -- 172.21.15.84:0/1912034586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bbf670 msgr2=0x55ecc0f85c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.484+0000 7f7db9006740 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bbf670 0x55ecc0f85c30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c018040 tx=0x7f7d9c0107a0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.485+0000 7f7db9006740 1 -- 172.21.15.84:0/1912034586 shutdown_connections 2024-09-21T07:58:50.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.485+0000 7f7db9006740 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0b74080 0x55ecc0f8ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.485+0000 7f7db9006740 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0be0350 0x55ecc0f9f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.485+0000 7f7db9006740 1 --2- 172.21.15.84:0/1912034586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0bbf670 0x55ecc0f85c30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.485+0000 7f7db9006740 1 -- 172.21.15.84:0/1912034586 >> 172.21.15.84:0/1912034586 conn(0x55ecc0bd4740 msgr2=0x55ecc0f85520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.485+0000 7f7db9006740 1 -- 172.21.15.84:0/1912034586 shutdown_connections 2024-09-21T07:58:50.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.485+0000 7f7db9006740 1 -- 172.21.15.84:0/1912034586 wait complete. 2024-09-21T07:58:50.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.486+0000 7f7db9006740 1 -- start start 2024-09-21T07:58:50.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.486+0000 7f7db9006740 1 Processor -- start 2024-09-21T07:58:50.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7db9006740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0b74080 0x55ecc1009a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7db9006740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc1009f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7db9006740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7db9006740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c011410 con 0x55ecc0be0350 2024-09-21T07:58:50.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7db9006740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c010d40 con 0x55ecc0b74080 2024-09-21T07:58:50.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7db9006740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c00dfa0 con 0x55ecc0bbf670 2024-09-21T07:58:50.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7db9006740 10 client.0 _ll_register_callbacks cb 0x7f7d9c005b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:50.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7dab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0b74080 0x55ecc1009a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc1009f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7dab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0b74080 0x55ecc1009a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43828/0 (socket says 172.21.15.84:43828) 2024-09-21T07:58:50.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7dab400640 1 -- 172.21.15.84:0/4061678262 learned_addr learned my addr 172.21.15.84:0/4061678262 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:50.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.487+0000 7f7dabe00640 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.488+0000 7f7daaa00640 1 -- 172.21.15.84:0/4061678262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0b74080 msgr2=0x55ecc1009a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.488+0000 7f7daaa00640 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0b74080 0x55ecc1009a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.488+0000 7f7daaa00640 1 -- 172.21.15.84:0/4061678262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 msgr2=0x55ecc0f9b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:50.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.488+0000 7f7daaa00640 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.488+0000 7f7daaa00640 1 -- 172.21.15.84:0/4061678262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc0f9ba90 con 0x55ecc0bbf670 2024-09-21T07:58:50.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.488+0000 7f7daaa00640 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc1009f60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7dac06b8a0 tx=0x7f7d980118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff7dd5e8bed9e88f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:50.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.488+0000 7f7d95600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:50.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.489+0000 7f7d95600640 1 -- 172.21.15.84:0/4061678262 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d980108a0 con 0x55ecc0bbf670 2024-09-21T07:58:50.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.489+0000 7f7d95600640 1 -- 172.21.15.84:0/4061678262 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f7d98010a40 con 0x55ecc0bbf670 2024-09-21T07:58:50.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.489+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecc0efb890 con 0x55ecc0bbf670 2024-09-21T07:58:50.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7d95600640 1 -- 172.21.15.84:0/4061678262 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d98010c40 con 0x55ecc0bbf670 2024-09-21T07:58:50.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 10 client.27541 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:50.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ecc1021b70 con 0x55ecc0bbf670 2024-09-21T07:58:50.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7d95600640 1 -- 172.21.15.84:0/4061678262 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ecc0efb890 con 0x55ecc0bbf670 2024-09-21T07:58:50.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7d95600640 1 -- 172.21.15.84:0/4061678262 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7d980213c0 con 0x55ecc0bbf670 2024-09-21T07:58:50.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 10 client.27541 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:50.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 10 client.27541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:50.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 20 client.27541 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:50.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc1022320 0x55ecc1024740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:50.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 4 client.27541 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:58:50.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.490+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ecc0ef8cc0 con 0x55ecc1022320 2024-09-21T07:58:50.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.491+0000 7f7dab400640 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc1022320 0x55ecc1024740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:50.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.491+0000 7f7d95600640 10 client.27541 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:50.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.491+0000 7f7dab400640 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc1022320 0x55ecc1024740 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db8c547e45d099c2 server_cookie=b0f38649c41f7217 in_seq=0 out_seq=0 2024-09-21T07:58:50.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.493+0000 7f7d95600640 1 -- 172.21.15.84:0/4061678262 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ecc0ef8cc0 con 0x55ecc1022320 2024-09-21T07:58:50.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.493+0000 7f7d95600640 10 client.27541 handle_command_reply: tid=0 2024-09-21T07:58:50.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.493+0000 7f7db9006740 1 client.27541 shutdown 2024-09-21T07:58:50.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 msgr2=0x55ecc1009f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc1009f60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7dac06b8a0 tx=0x7f7d980118d0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 shutdown_connections 2024-09-21T07:58:50.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecc0be0350 0x55ecc0f9b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55ecc1022320 0x55ecc1024740 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecc0bbf670 0x55ecc1009f60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 --2- 172.21.15.84:0/4061678262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ecc0b74080 0x55ecc1009a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 >> 172.21.15.84:0/4061678262 conn(0x55ecc0bd4740 msgr2=0x55ecc0f8ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7d95600640 0 client.27541 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:50.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 shutdown_connections 2024-09-21T07:58:50.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 1 -- 172.21.15.84:0/4061678262 wait complete. 2024-09-21T07:58:50.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.495+0000 7f7db9006740 20 client.27541 trim_cache size 0 max 16384 2024-09-21T07:58:50.499 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:58:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:58:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "355130ec-018e-44d4-be31-b38df69327bd", 2024-09-21T07:58:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:58:50.499 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:58:50.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.496+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7d900b67b0 msgr2=0x7f7d900b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.496+0000 7f7db2400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7d900b67b0 0x7f7d900b8cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00ae30 tx=0x7f7d9c0137d0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.496+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac114430 msgr2=0x7f7dac1a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.496+0000 7f7db2400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac114430 0x7f7dac1a62d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7da402ae60 tx=0x7f7da4003ba0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 shutdown_connections 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f7d900b67b0 0x7f7d900b8cc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7dac114430 0x7f7dac1a62d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dac077330 0x7f7dac1a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 --2- 172.21.15.84:0/2737208449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dac075cf0 0x7f7dac1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 >> 172.21.15.84:0/2737208449 conn(0x7f7dac07b910 msgr2=0x7f7dac113190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 shutdown_connections 2024-09-21T07:58:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:50.497+0000 7f7db2400640 1 -- 172.21.15.84:0/2737208449 wait complete. 2024-09-21T07:58:50.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:50 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:58:50.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:50 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:58:50.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:50 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:58:50.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:50 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:58:50.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:50 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:58:50.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:50 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:58:51.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:50 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:58:51.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:50 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:58:51.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:50 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:58:51.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:51 smithi084 ceph-mon[30411]: pgmap v630: 129 pgs: 129 active+clean; 56 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 24 KiB/s rd, 210 MiB/s wr, 1.80k op/s 2024-09-21T07:58:51.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:51 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:58:51.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:51 smithi191 ceph-mon[34667]: pgmap v630: 129 pgs: 129 active+clean; 56 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 24 KiB/s rd, 210 MiB/s wr, 1.80k op/s 2024-09-21T07:58:51.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:51 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:58:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:51 smithi162 ceph-mon[34833]: pgmap v630: 129 pgs: 129 active+clean; 56 GiB data, 117 GiB used, 956 GiB / 1.0 TiB avail; 24 KiB/s rd, 210 MiB/s wr, 1.80k op/s 2024-09-21T07:58:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:51 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:58:52.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:58:53.711 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:58:53.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:53 smithi084 ceph-mon[30411]: pgmap v631: 129 pgs: 129 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 39 KiB/s rd, 200 MiB/s wr, 1.63k op/s 2024-09-21T07:58:53.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:53 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:58:53.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:53 smithi191 ceph-mon[34667]: pgmap v631: 129 pgs: 129 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 39 KiB/s rd, 200 MiB/s wr, 1.63k op/s 2024-09-21T07:58:53.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:53 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:58:54.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:53 smithi162 ceph-mon[34833]: pgmap v631: 129 pgs: 129 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 39 KiB/s rd, 200 MiB/s wr, 1.63k op/s 2024-09-21T07:58:54.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:53 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:58:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:55 smithi191 ceph-mon[34667]: pgmap v632: 129 pgs: 129 active+clean; 57 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 34 KiB/s rd, 209 MiB/s wr, 1.56k op/s 2024-09-21T07:58:56.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:55 smithi162 ceph-mon[34833]: pgmap v632: 129 pgs: 129 active+clean; 57 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 34 KiB/s rd, 209 MiB/s wr, 1.56k op/s 2024-09-21T07:58:56.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:55 smithi084 ceph-mon[30411]: pgmap v632: 129 pgs: 129 active+clean; 57 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 34 KiB/s rd, 209 MiB/s wr, 1.56k op/s 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.451+0000 7f22b2800640 1 -- 172.21.15.84:0/1564818668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 msgr2=0x7f22ac103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.451+0000 7f22b2800640 1 --2- 172.21.15.84:0/1564818668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac103dc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009900 tx=0x7f22a002a420 comp rx=0 tx=0).stop 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.451+0000 7f22b2800640 1 -- 172.21.15.84:0/1564818668 shutdown_connections 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.451+0000 7f22b2800640 1 --2- 172.21.15.84:0/1564818668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac109c40 0x7f22ac110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.451+0000 7f22b2800640 1 --2- 172.21.15.84:0/1564818668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ac1092f0 0x7f22ac109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.451+0000 7f22b2800640 1 --2- 172.21.15.84:0/1564818668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac103dc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.451+0000 7f22b2800640 1 -- 172.21.15.84:0/1564818668 >> 172.21.15.84:0/1564818668 conn(0x7f22ac0ff400 msgr2=0x7f22ac101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:56.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.452+0000 7f22b2800640 1 -- 172.21.15.84:0/1564818668 shutdown_connections 2024-09-21T07:58:56.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.452+0000 7f22b2800640 1 -- 172.21.15.84:0/1564818668 wait complete. 2024-09-21T07:58:56.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 Processor -- start 2024-09-21T07:58:56.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 -- start start 2024-09-21T07:58:56.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ac1092f0 0x7f22ac19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac109c40 0x7f22ac1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1139d0 con 0x7f22ac1092f0 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac113850 con 0x7f22ac109c40 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.453+0000 7f22b2800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac113b50 con 0x7f22ac1039b0 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49832/0 (socket says 172.21.15.84:49832) 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 -- 172.21.15.84:0/3315986982 learned_addr learned my addr 172.21.15.84:0/3315986982 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b0a00640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ac1092f0 0x7f22ac19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1e00640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac109c40 0x7f22ac1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 -- 172.21.15.84:0/3315986982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac109c40 msgr2=0x7f22ac1a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac109c40 0x7f22ac1a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 -- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ac1092f0 msgr2=0x7f22ac19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ac1092f0 0x7f22ac19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.454+0000 7f22b1400640 1 -- 172.21.15.84:0/3315986982 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac1a2470 con 0x7f22ac1039b0 2024-09-21T07:58:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.455+0000 7f22b1400640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac19c5c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f22a002aa10 tx=0x7f22a0003de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.455+0000 7f22aa000640 1 -- 172.21.15.84:0/3315986982 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a003f070 con 0x7f22ac1039b0 2024-09-21T07:58:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.455+0000 7f22aa000640 1 -- 172.21.15.84:0/3315986982 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a0031d60 con 0x7f22ac1039b0 2024-09-21T07:58:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.455+0000 7f22aa000640 1 -- 172.21.15.84:0/3315986982 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0035030 con 0x7f22ac1039b0 2024-09-21T07:58:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.455+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac1a2700 con 0x7f22ac1039b0 2024-09-21T07:58:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.456+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac1a8f80 con 0x7f22ac1039b0 2024-09-21T07:58:56.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.461+0000 7f22aa000640 1 -- 172.21.15.84:0/3315986982 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f22a0042070 con 0x7f22ac1039b0 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.464+0000 7f22aa000640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22940b6800 0x7f22940b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.464+0000 7f22baa72740 1 Processor -- start 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.464+0000 7f22aa000640 1 -- 172.21.15.84:0/3315986982 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f22a0108860 con 0x7f22ac1039b0 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.465+0000 7f22baa72740 1 -- start start 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.465+0000 7f22baa72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888fbd070 0x56488936c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.465+0000 7f22baa72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 0x56488936cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.465+0000 7f22baa72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888f9c390 0x56488936d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.465+0000 7f22baa72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5648892daf70 con 0x564888fbd070 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.465+0000 7f22baa72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5648892ca3a0 con 0x564888f941b0 2024-09-21T07:58:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.466+0000 7f22baa72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5648892ce1b0 con 0x564888f9c390 2024-09-21T07:58:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.466+0000 7f22b1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888fbd070 0x56488936c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.466+0000 7f22b1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888fbd070 0x56488936c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42574/0 (socket says 172.21.15.84:42574) 2024-09-21T07:58:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.466+0000 7f22b1400640 1 -- 172.21.15.84:0/2344385748 learned_addr learned my addr 172.21.15.84:0/2344385748 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.466+0000 7f22b1e00640 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888f9c390 0x56488936d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.466+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 0x56488936cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.467+0000 7f22b1400640 1 -- 172.21.15.84:0/2344385748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888f9c390 msgr2=0x56488936d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.467+0000 7f22b1400640 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888f9c390 0x56488936d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.467+0000 7f22b1400640 1 -- 172.21.15.84:0/2344385748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 msgr2=0x56488936cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.467+0000 7f22b1400640 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 0x56488936cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.467+0000 7f22b1400640 1 -- 172.21.15.84:0/2344385748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564889294c90 con 0x564888fbd070 2024-09-21T07:58:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.467+0000 7f22b1400640 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888fbd070 0x56488936c740 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f22a00cb340 tx=0x7f22a0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf46d146a792f6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.467+0000 7f229e600640 1 -- 172.21.15.84:0/2344385748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0049040 con 0x564888fbd070 2024-09-21T07:58:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.468+0000 7f229e600640 1 -- 172.21.15.84:0/2344385748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a00cf470 con 0x564888fbd070 2024-09-21T07:58:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.468+0000 7f229e600640 1 -- 172.21.15.84:0/2344385748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a00ce230 con 0x564888fbd070 2024-09-21T07:58:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.468+0000 7f22baa72740 1 -- 172.21.15.84:0/2344385748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888fbd070 msgr2=0x56488936c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.468+0000 7f22baa72740 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888fbd070 0x56488936c740 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f22a00cb340 tx=0x7f22a0009260 comp rx=0 tx=0).stop 2024-09-21T07:58:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.469+0000 7f22baa72740 1 -- 172.21.15.84:0/2344385748 shutdown_connections 2024-09-21T07:58:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.469+0000 7f22baa72740 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888f9c390 0x56488936d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.469+0000 7f22baa72740 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 0x56488936cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.469+0000 7f22baa72740 1 --2- 172.21.15.84:0/2344385748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888fbd070 0x56488936c740 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.469+0000 7f22baa72740 1 -- 172.21.15.84:0/2344385748 >> 172.21.15.84:0/2344385748 conn(0x564888fb1460 msgr2=0x56488936a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.469+0000 7f22b0a00640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22940b6800 0x7f22940b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.469+0000 7f22baa72740 1 -- 172.21.15.84:0/2344385748 shutdown_connections 2024-09-21T07:58:56.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.470+0000 7f22baa72740 1 -- 172.21.15.84:0/2344385748 wait complete. 2024-09-21T07:58:56.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.470+0000 7f22baa72740 1 -- start start 2024-09-21T07:58:56.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.471+0000 7f22baa72740 1 Processor -- start 2024-09-21T07:58:56.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.471+0000 7f22b0a00640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22940b6800 0x7f22940b8d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f22980058c0 tx=0x7f2298004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.471+0000 7f22baa72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x564889366690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.471+0000 7f22baa72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889366bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22baa72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889367110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22baa72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56488912b700 con 0x564888f941b0 2024-09-21T07:58:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22baa72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564889265540 con 0x564888f9c390 2024-09-21T07:58:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22baa72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564889369830 con 0x564888fbd070 2024-09-21T07:58:56.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22baa72740 10 client.0 _ll_register_callbacks cb 0x564889275430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22b1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889367110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22b1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889367110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49848/0 (socket says 172.21.15.84:49848) 2024-09-21T07:58:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22b1e00640 1 -- 172.21.15.84:0/2481042474 learned_addr learned my addr 172.21.15.84:0/2481042474 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.472+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889366bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b1400640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x564889366690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b0a00640 1 -- 172.21.15.84:0/2481042474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 msgr2=0x564889367110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889367110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b0a00640 1 -- 172.21.15.84:0/2481042474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 msgr2=0x564889366690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x564889366690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b0a00640 1 -- 172.21.15.84:0/2481042474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564889028650 con 0x564888f9c390 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b1400640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x564889366690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.473+0000 7f22b1e00640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889367110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:56.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.474+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889366bd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06b700 tx=0x7f22980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de88502f947332a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.474+0000 7f2292a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:56.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.475+0000 7f2292a00640 1 -- 172.21.15.84:0/2481042474 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229801ee60 con 0x564888f9c390 2024-09-21T07:58:56.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.475+0000 7f2292a00640 1 -- 172.21.15.84:0/2481042474 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f229800f910 con 0x564888f9c390 2024-09-21T07:58:56.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.475+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564889267b50 con 0x564888f9c390 2024-09-21T07:58:56.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.475+0000 7f2292a00640 1 -- 172.21.15.84:0/2481042474 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2298033050 con 0x564888f9c390 2024-09-21T07:58:56.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.475+0000 7f22baa72740 10 client.27557 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:56.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.475+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564889282910 con 0x564888f9c390 2024-09-21T07:58:56.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f2292a00640 1 -- 172.21.15.84:0/2481042474 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564889267b50 con 0x564888f9c390 2024-09-21T07:58:56.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f2292a00640 1 -- 172.21.15.84:0/2481042474 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f229801ca80 con 0x564888f9c390 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f22baa72740 10 client.27557 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f22baa72740 10 client.27557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f22baa72740 20 client.27557 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f22baa72740 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f7b9f0 0x5648893925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f22baa72740 4 client.27557 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.476+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648892dcec0 con 0x564888f7b9f0 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.477+0000 7f22b1400640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f7b9f0 0x5648893925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.478+0000 7f22b1400640 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f7b9f0 0x5648893925b0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d74e24c7397418a server_cookie=bbe00fd9f6e3f0eb in_seq=0 out_seq=0 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.478+0000 7f2292a00640 10 client.27557 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f2292a00640 1 -- 172.21.15.84:0/2481042474 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648892dcec0 con 0x564888f7b9f0 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f2292a00640 10 client.27557 handle_command_reply: tid=0 2024-09-21T07:58:56.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 client.27557 shutdown 2024-09-21T07:58:56.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 msgr2=0x564889366bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889366bd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06b700 tx=0x7f22980046c0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 shutdown_connections 2024-09-21T07:58:56.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f7b9f0 0x5648893925b0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889367110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889366bd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 --2- 172.21.15.84:0/2481042474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x564889366690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f2292a00640 0 client.27557 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:56.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.479+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 >> 172.21.15.84:0/2481042474 conn(0x564888fb1460 msgr2=0x56488936f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.482+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 shutdown_connections 2024-09-21T07:58:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.482+0000 7f22baa72740 1 -- 172.21.15.84:0/2481042474 wait complete. 2024-09-21T07:58:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.482+0000 7f22baa72740 20 client.27557 trim_cache size 0 max 16384 2024-09-21T07:58:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.514+0000 7f22baa72740 1 Processor -- start 2024-09-21T07:58:56.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.516+0000 7f22baa72740 1 -- start start 2024-09-21T07:58:56.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22baa72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 0x56488938ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22baa72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f9c390 0x564889365620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22baa72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889363880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22baa72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1aeb40 con 0x564888f9c390 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22baa72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1b0680 con 0x564888f941b0 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22baa72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1af210 con 0x564888fbd070 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22b1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889363880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22b0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f9c390 0x564889365620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22b1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889363880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49856/0 (socket says 172.21.15.84:49856) 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.517+0000 7f22b1e00640 1 -- 172.21.15.84:0/886267395 learned_addr learned my addr 172.21.15.84:0/886267395 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.518+0000 7f22b1e00640 1 -- 172.21.15.84:0/886267395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 msgr2=0x56488938ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.518+0000 7f22b1e00640 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 0x56488938ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.518+0000 7f22b1e00640 1 -- 172.21.15.84:0/886267395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f9c390 msgr2=0x564889365620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.518+0000 7f22b1e00640 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f9c390 0x564889365620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.518+0000 7f22b1e00640 1 -- 172.21.15.84:0/886267395 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56488936e680 con 0x564888fbd070 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.518+0000 7f22b0a00640 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f9c390 0x564889365620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.518+0000 7f22b1e00640 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889363880 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22a400ba50 tx=0x7f22a40097d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c57302d56db56d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.519+0000 7f229dc00640 1 -- 172.21.15.84:0/886267395 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4007c90 con 0x564888fbd070 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.519+0000 7f229dc00640 1 -- 172.21.15.84:0/886267395 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a4007e30 con 0x564888fbd070 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.519+0000 7f229dc00640 1 -- 172.21.15.84:0/886267395 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4007c90 con 0x564888fbd070 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.520+0000 7f22baa72740 1 -- 172.21.15.84:0/886267395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 msgr2=0x564889363880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.520+0000 7f22baa72740 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889363880 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22a400ba50 tx=0x7f22a40097d0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 -- 172.21.15.84:0/886267395 shutdown_connections 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x564889363880 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f9c390 0x564889365620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 --2- 172.21.15.84:0/886267395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f941b0 0x56488938ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 -- 172.21.15.84:0/886267395 >> 172.21.15.84:0/886267395 conn(0x564888fb1460 msgr2=0x564889364f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 -- 172.21.15.84:0/886267395 shutdown_connections 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 -- 172.21.15.84:0/886267395 wait complete. 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.521+0000 7f22baa72740 1 -- start start 2024-09-21T07:58:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.522+0000 7f22baa72740 1 Processor -- start 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22baa72740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x5648893893a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22baa72740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889383a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22baa72740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x5648893840b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22baa72740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1affb0 con 0x564888f941b0 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22baa72740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1af8e0 con 0x564888f9c390 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22baa72740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1acbc0 con 0x564888fbd070 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22baa72740 10 client.0 _ll_register_callbacks cb 0x7f229801e890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22b0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889383a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22b0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889383a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:43884/0 (socket says 172.21.15.84:43884) 2024-09-21T07:58:56.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.523+0000 7f22b0a00640 1 -- 172.21.15.84:0/2230628069 learned_addr learned my addr 172.21.15.84:0/2230628069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:56.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.524+0000 7f22b0a00640 1 -- 172.21.15.84:0/2230628069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 msgr2=0x5648893840b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:58:56.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.524+0000 7f22b1400640 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x5648893893a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.524+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x5648893840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.524+0000 7f22b0a00640 1 -- 172.21.15.84:0/2230628069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 msgr2=0x5648893893a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:56.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.524+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x5648893893a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.524+0000 7f22b0a00640 1 -- 172.21.15.84:0/2230628069 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564889384840 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.525+0000 7f22b0a00640 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889383a80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2298005b90 tx=0x7f2298028740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af748edf5cd06c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.525+0000 7f2292a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.525+0000 7f2292a00640 1 -- 172.21.15.84:0/2230628069 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229801ee60 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.525+0000 7f2292a00640 1 -- 172.21.15.84:0/2230628069 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f2298028cf0 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.525+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22a4007e30 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.526+0000 7f2292a00640 1 -- 172.21.15.84:0/2230628069 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2298047050 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.526+0000 7f22baa72740 10 client.27560 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.526+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648893fdff0 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.526+0000 7f22b1400640 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x5648893893a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.526+0000 7f2292a00640 1 -- 172.21.15.84:0/2230628069 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a4007e30 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.527+0000 7f2292a00640 1 -- 172.21.15.84:0/2230628069 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f229801c530 con 0x564888f9c390 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.528+0000 7f22baa72740 10 client.27560 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:56.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.528+0000 7f22baa72740 10 client.27560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:56.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.528+0000 7f22baa72740 20 client.27560 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:56.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.528+0000 7f22baa72740 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f50da0 0x5648894007b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:56.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.528+0000 7f22baa72740 4 client.27560 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:58:56.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.528+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5648892d8970 con 0x564888f50da0 2024-09-21T07:58:56.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.529+0000 7f22b1400640 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f50da0 0x5648894007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:56.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.531+0000 7f22b1400640 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f50da0 0x5648894007b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47df49e7095de218 server_cookie=b13e3f1a964b9028 in_seq=0 out_seq=0 2024-09-21T07:58:56.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.531+0000 7f2292a00640 10 client.27560 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:56.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.531+0000 7f2292a00640 1 -- 172.21.15.84:0/2230628069 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x5648892d8970 con 0x564888f50da0 2024-09-21T07:58:56.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.531+0000 7f2292a00640 10 client.27560 handle_command_reply: tid=0 2024-09-21T07:58:56.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.531+0000 7f22baa72740 1 client.27560 shutdown 2024-09-21T07:58:56.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 msgr2=0x564889383a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889383a80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2298005b90 tx=0x7f2298028740 comp rx=0 tx=0).stop 2024-09-21T07:58:56.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 shutdown_connections 2024-09-21T07:58:56.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564888f50da0 0x5648894007b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564888fbd070 0x5648893840b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564888f9c390 0x564889383a80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 --2- 172.21.15.84:0/2230628069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564888f941b0 0x5648893893a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.532+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 >> 172.21.15.84:0/2230628069 conn(0x564888fb1460 msgr2=0x56488936d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:56.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.533+0000 7f2292a00640 0 client.27560 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:56.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.533+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 shutdown_connections 2024-09-21T07:58:56.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.533+0000 7f22baa72740 1 -- 172.21.15.84:0/2230628069 wait complete. 2024-09-21T07:58:56.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.533+0000 7f22baa72740 20 client.27560 trim_cache size 0 max 16384 2024-09-21T07:58:56.536 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:58:56.536 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T07:58:56.536 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T07:58:56.536 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.538 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.539 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:58:56.541 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:58:56.542 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:58:56.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:58:56.543 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:58:56.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.537+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22940b6800 msgr2=0x7f22940b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.537+0000 7f22b2800640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22940b6800 0x7f22940b8d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f22980058c0 tx=0x7f2298004730 comp rx=0 tx=0).stop 2024-09-21T07:58:56.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.537+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 msgr2=0x7f22ac19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:56.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.537+0000 7f22b2800640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac19c5c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f22a002aa10 tx=0x7f22a0003de0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.542+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 shutdown_connections 2024-09-21T07:58:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.542+0000 7f22b2800640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f22940b6800 0x7f22940b8d10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.542+0000 7f22b2800640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac109c40 0x7f22ac1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.542+0000 7f22b2800640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22ac1092f0 0x7f22ac19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.542+0000 7f22b2800640 1 --2- 172.21.15.84:0/3315986982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22ac1039b0 0x7f22ac19c5c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.542+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 >> 172.21.15.84:0/3315986982 conn(0x7f22ac0ff400 msgr2=0x7f22ac1089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.543+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 shutdown_connections 2024-09-21T07:58:56.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:58:56.543+0000 7f22b2800640 1 -- 172.21.15.84:0/3315986982 wait complete. 2024-09-21T07:58:57.786 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:57 smithi084 ceph-mon[30411]: pgmap v633: 129 pgs: 129 active+clean; 57 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 60 KiB/s rd, 225 MiB/s wr, 1.48k op/s 2024-09-21T07:58:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:57 smithi191 ceph-mon[34667]: pgmap v633: 129 pgs: 129 active+clean; 57 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 60 KiB/s rd, 225 MiB/s wr, 1.48k op/s 2024-09-21T07:58:58.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:57 smithi162 ceph-mon[34833]: pgmap v633: 129 pgs: 129 active+clean; 57 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 60 KiB/s rd, 225 MiB/s wr, 1.48k op/s 2024-09-21T07:58:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.308+0000 7f2cb6800640 1 -- 172.21.15.84:0/2722917719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0076100 msgr2=0x7f2cb010faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.308+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2722917719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0076100 0x7f2cb010faf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009900 tx=0x7f2c9802a410 comp rx=0 tx=0).stop 2024-09-21T07:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.309+0000 7f2cb6800640 1 -- 172.21.15.84:0/2722917719 shutdown_connections 2024-09-21T07:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.309+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2722917719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cb0110030 0x7f2cb0112490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.309+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2722917719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0076100 0x7f2cb010faf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.309+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2722917719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb00757b0 0x7f2cb0075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.309+0000 7f2cb6800640 1 -- 172.21.15.84:0/2722917719 >> 172.21.15.84:0/2722917719 conn(0x7f2cb00ff520 msgr2=0x7f2cb0101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.309+0000 7f2cb6800640 1 -- 172.21.15.84:0/2722917719 shutdown_connections 2024-09-21T07:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.309+0000 7f2cb6800640 1 -- 172.21.15.84:0/2722917719 wait complete. 2024-09-21T07:58:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.311+0000 7f2cb6800640 1 Processor -- start 2024-09-21T07:58:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.311+0000 7f2cb6800640 1 -- start start 2024-09-21T07:58:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cb6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cb00757b0 0x7f2cb01135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cb6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb0076100 0x7f2cb0113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cb6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0110030 0x7f2cb0118e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cb6800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01065e0 con 0x7f2cb0076100 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cb6800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0106460 con 0x7f2cb00757b0 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cb6800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0106760 con 0x7f2cb0110030 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0110030 0x7f2cb0118e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2ca7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb0076100 0x7f2cb0113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0110030 0x7f2cb0118e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36584/0 (socket says 172.21.15.84:36584) 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2cafe00640 1 -- 172.21.15.84:0/2236561531 learned_addr learned my addr 172.21.15.84:0/2236561531 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.312+0000 7f2caf400640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cb00757b0 0x7f2cb01135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.313+0000 7f2cafe00640 1 -- 172.21.15.84:0/2236561531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cb00757b0 msgr2=0x7f2cb01135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.313+0000 7f2cafe00640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cb00757b0 0x7f2cb01135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.313+0000 7f2cafe00640 1 -- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb0076100 msgr2=0x7f2cb0113b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.313+0000 7f2cafe00640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb0076100 0x7f2cb0113b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.313+0000 7f2cafe00640 1 -- 172.21.15.84:0/2236561531 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb0119470 con 0x7f2cb0110030 2024-09-21T07:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.313+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb0076100 0x7f2cb0113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.314+0000 7f2cafe00640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0110030 0x7f2cb0118e00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b970 tx=0x7f2ca800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.314+0000 7f2cacc00640 1 -- 172.21.15.84:0/2236561531 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8019070 con 0x7f2cb0110030 2024-09-21T07:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.314+0000 7f2cacc00640 1 -- 172.21.15.84:0/2236561531 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca8014440 con 0x7f2cb0110030 2024-09-21T07:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.314+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb0119760 con 0x7f2cb0110030 2024-09-21T07:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.315+0000 7f2cacc00640 1 -- 172.21.15.84:0/2236561531 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80075d0 con 0x7f2cb0110030 2024-09-21T07:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.315+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb0119c30 con 0x7f2cb0110030 2024-09-21T07:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.319+0000 7f2cbd8bc740 1 Processor -- start 2024-09-21T07:58:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.321+0000 7f2cacc00640 1 -- 172.21.15.84:0/2236561531 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2ca801c070 con 0x7f2cb0110030 2024-09-21T07:58:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.321+0000 7f2cbd8bc740 1 -- start start 2024-09-21T07:58:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56037013a6b0 con 0x56036fe201b0 2024-09-21T07:58:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560370129ae0 con 0x56036fdf72f0 2024-09-21T07:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56037012d8f0 con 0x56036fdff4d0 2024-09-21T07:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2caf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2ca7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2caf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58090/0 (socket says 172.21.15.84:58090) 2024-09-21T07:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2caf400640 1 -- 172.21.15.84:0/689039217 learned_addr learned my addr 172.21.15.84:0/689039217 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.322+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2caf400640 1 -- 172.21.15.84:0/689039217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 msgr2=0x5603701c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2caf400640 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2caf400640 1 -- 172.21.15.84:0/689039217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 msgr2=0x5603701c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2caf400640 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2caf400640 1 -- 172.21.15.84:0/689039217 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603700f6780 con 0x56036fdf72f0 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2cacc00640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2c940b6680 0x7f2c940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2caf400640 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701c5170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000acb0 tx=0x7f2ca000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae33782ab188fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2cacc00640 1 -- 172.21.15.84:0/2236561531 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f2ca80e6d20 con 0x7f2cb0110030 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2c940b6680 0x7f2c940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.323+0000 7f2ca4c00640 1 -- 172.21.15.84:0/689039217 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca001d070 con 0x56036fdf72f0 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.324+0000 7f2ca4c00640 1 -- 172.21.15.84:0/689039217 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca0018af0 con 0x56036fdf72f0 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.324+0000 7f2ca4c00640 1 -- 172.21.15.84:0/689039217 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0010bb0 con 0x56036fdf72f0 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.324+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/689039217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 msgr2=0x5603701c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.324+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701c5170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000acb0 tx=0x7f2ca000f790 comp rx=0 tx=0).stop 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.324+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2c940b6680 0x7f2c940b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2c9802aa00 tx=0x7f2c98005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/689039217 shutdown_connections 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701c5170 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/689039217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/689039217 >> 172.21.15.84:0/689039217 conn(0x56036fe14300 msgr2=0x5603701c2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/689039217 shutdown_connections 2024-09-21T07:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/689039217 wait complete. 2024-09-21T07:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.325+0000 7f2cbd8bc740 1 -- start start 2024-09-21T07:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 1 Processor -- start 2024-09-21T07:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560370061ab0 con 0x56036fe201b0 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5603700d0570 con 0x56036fdf72f0 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5603701d33b0 con 0x56036fdff4d0 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.326+0000 7f2cbd8bc740 10 client.0 _ll_register_callbacks cb 0x5603700df100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2ca7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2caf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2ca7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36600/0 (socket says 172.21.15.84:36600) 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2ca7e00640 1 -- 172.21.15.84:0/3743985759 learned_addr learned my addr 172.21.15.84:0/3743985759 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2cafe00640 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2caf400640 1 -- 172.21.15.84:0/3743985759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 msgr2=0x5603701d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2caf400640 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2caf400640 1 -- 172.21.15.84:0/3743985759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 msgr2=0x5603701d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2caf400640 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.327+0000 7f2caf400640 1 -- 172.21.15.84:0/3743985759 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56036fe8b790 con 0x56036fdf72f0 2024-09-21T07:58:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2caf400640 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701d01f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000ac80 tx=0x7f2ca0018ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e75dc4ef5ce4f98b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2c9d600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:58:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2c9d600640 1 -- 172.21.15.84:0/3743985759 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0026020 con 0x56036fdf72f0 2024-09-21T07:58:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca0018af0 con 0x56036fdf72f0 2024-09-21T07:58:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2c9d600640 1 -- 172.21.15.84:0/3743985759 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f2ca0018640 con 0x56036fdf72f0 2024-09-21T07:58:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2c9d600640 1 -- 172.21.15.84:0/3743985759 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ca0031050 con 0x56036fdf72f0 2024-09-21T07:58:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2cbd8bc740 10 client.27569 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.328+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56036ff04620 con 0x56036fdf72f0 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2c9d600640 1 -- 172.21.15.84:0/3743985759 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca0018af0 con 0x56036fdf72f0 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2c9d600640 1 -- 172.21.15.84:0/3743985759 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ca0005480 con 0x56036fdf72f0 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2cbd8bc740 10 client.27569 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2cbd8bc740 10 client.27569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2cbd8bc740 20 client.27569 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdded80 0x5603701e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2cbd8bc740 4 client.27569 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.329+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56037013c600 con 0x56036fdded80 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.330+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdded80 0x5603701e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.330+0000 7f2c9d600640 10 client.27569 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.330+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdded80 0x5603701e22c0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ec326684113021a server_cookie=8dff4470abd1b737 in_seq=0 out_seq=0 2024-09-21T07:58:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.331+0000 7f2c9d600640 1 -- 172.21.15.84:0/3743985759 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56037013c600 con 0x56036fdded80 2024-09-21T07:58:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.331+0000 7f2c9d600640 10 client.27569 handle_command_reply: tid=0 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.331+0000 7f2cbd8bc740 1 client.27569 shutdown 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.331+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 msgr2=0x5603701d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.331+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701d01f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000ac80 tx=0x7f2ca0018ed0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 shutdown_connections 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fe201b0 0x5603701d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdded80 0x5603701e22c0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdff4d0 0x5603701d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/3743985759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdf72f0 0x5603701d01f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 >> 172.21.15.84:0/3743985759 conn(0x56036fe14300 msgr2=0x5603701c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2c9d600640 0 client.27569 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 shutdown_connections 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/3743985759 wait complete. 2024-09-21T07:58:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.332+0000 7f2cbd8bc740 20 client.27569 trim_cache size 0 max 16384 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.352+0000 7f2cbd8bc740 1 Processor -- start 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.352+0000 7f2cbd8bc740 1 -- start start 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdf72f0 0x5603701c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdff4d0 0x5603701cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fe201b0 0x5603701cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c00fef0 con 0x56036fdf72f0 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c011a30 con 0x56036fdff4d0 2024-09-21T07:58:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0105c0 con 0x56036fe201b0 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdff4d0 0x5603701cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdff4d0 0x5603701cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:58116/0 (socket says 172.21.15.84:58116) 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2ca7e00640 1 -- 172.21.15.84:0/7564934 learned_addr learned my addr 172.21.15.84:0/7564934 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2caf400640 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdf72f0 0x5603701c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.353+0000 7f2cafe00640 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fe201b0 0x5603701cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.354+0000 7f2ca7e00640 1 -- 172.21.15.84:0/7564934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fe201b0 msgr2=0x5603701cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.354+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fe201b0 0x5603701cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.354+0000 7f2ca7e00640 1 -- 172.21.15.84:0/7564934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdf72f0 msgr2=0x5603701c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.354+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdf72f0 0x5603701c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.354+0000 7f2ca7e00640 1 -- 172.21.15.84:0/7564934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603701e2630 con 0x56036fdff4d0 2024-09-21T07:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.354+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdff4d0 0x5603701cd3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2c980096c0 tx=0x7f2c98009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=345d1e7f4986c85e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.355+0000 7f2c9fe00640 1 -- 172.21.15.84:0/7564934 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9805b070 con 0x56036fdff4d0 2024-09-21T07:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.355+0000 7f2c9fe00640 1 -- 172.21.15.84:0/7564934 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c9804e8e0 con 0x56036fdff4d0 2024-09-21T07:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.355+0000 7f2c9fe00640 1 -- 172.21.15.84:0/7564934 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98035040 con 0x56036fdff4d0 2024-09-21T07:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.356+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/7564934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdff4d0 msgr2=0x5603701cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.356+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdff4d0 0x5603701cd3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2c980096c0 tx=0x7f2c98009260 comp rx=0 tx=0).stop 2024-09-21T07:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.356+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/7564934 shutdown_connections 2024-09-21T07:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.356+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fe201b0 0x5603701cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.356+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fdff4d0 0x5603701cd3c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.356+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/7564934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdf72f0 0x5603701c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.356+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/7564934 >> 172.21.15.84:0/7564934 conn(0x56036fe14300 msgr2=0x5603701c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.364+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/7564934 shutdown_connections 2024-09-21T07:58:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.369+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/7564934 wait complete. 2024-09-21T07:58:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.370+0000 7f2cbd8bc740 1 -- start start 2024-09-21T07:58:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.370+0000 7f2cbd8bc740 1 Processor -- start 2024-09-21T07:58:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.371+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdf72f0 0x5603701d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.371+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdff4d0 0x5603701d6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2cbd8bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fe201b0 0x5603701d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c011360 con 0x56036fdff4d0 2024-09-21T07:58:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c010c90 con 0x56036fe201b0 2024-09-21T07:58:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2cbd8bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c00def0 con 0x56036fdf72f0 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2caf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdf72f0 0x5603701d8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2caf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdf72f0 0x5603701d8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36620/0 (socket says 172.21.15.84:36620) 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2caf400640 1 -- 172.21.15.84:0/1367622478 learned_addr learned my addr 172.21.15.84:0/1367622478 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2cbd8bc740 10 client.0 _ll_register_callbacks cb 0x7f2ca001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2cafe00640 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fe201b0 0x5603701d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdff4d0 0x5603701d6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2caf400640 1 -- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fe201b0 msgr2=0x5603701d67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2caf400640 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fe201b0 0x5603701d67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2caf400640 1 -- 172.21.15.84:0/1367622478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdff4d0 msgr2=0x5603701d6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:58:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.372+0000 7f2caf400640 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdff4d0 0x5603701d6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.373+0000 7f2caf400640 1 -- 172.21.15.84:0/1367622478 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603701d6e70 con 0x56036fdf72f0 2024-09-21T07:58:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.373+0000 7f2caf400640 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdf72f0 0x5603701d8db0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000fc90 tx=0x7f2ca000a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f3814311896415 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:58:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.373+0000 7f2c9d600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.373+0000 7f2c9d600640 1 -- 172.21.15.84:0/1367622478 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0039070 con 0x56036fdf72f0 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.373+0000 7f2c9d600640 1 -- 172.21.15.84:0/1367622478 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7f2ca0018850 con 0x56036fdf72f0 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.374+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c9804e8e0 con 0x56036fdf72f0 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.374+0000 7f2c9d600640 1 -- 172.21.15.84:0/1367622478 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ca0043050 con 0x56036fdf72f0 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.374+0000 7f2cbd8bc740 10 client.27574 fetch_fsmap learned FSMap version 29 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.374+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56037025d930 con 0x56036fdf72f0 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.374+0000 7f2c9d600640 1 -- 172.21.15.84:0/1367622478 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c9804e8e0 con 0x56036fdf72f0 2024-09-21T07:58:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.375+0000 7f2c9d600640 1 -- 172.21.15.84:0/1367622478 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ca0004e40 con 0x56036fdf72f0 2024-09-21T07:58:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.376+0000 7f2cbd8bc740 10 client.27574 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:58:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.376+0000 7f2cbd8bc740 10 client.27574 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:58:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.376+0000 7f2cbd8bc740 20 client.27574 populate_metadata read hostname 'smithi084' 2024-09-21T07:58:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.376+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdb41c0 0x560370260020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:58:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.376+0000 7f2cbd8bc740 4 client.27574 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:58:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.376+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603701380b0 con 0x56036fdb41c0 2024-09-21T07:58:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.377+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdb41c0 0x560370260020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:58:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.379+0000 7f2ca7e00640 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdb41c0 0x560370260020 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8d9ab9e11c0e498 server_cookie=79962c5bfe1dab8e in_seq=0 out_seq=0 2024-09-21T07:58:59.382 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.381+0000 7f2c9d600640 10 client.27574 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.411+0000 7f2c9d600640 1 -- 172.21.15.84:0/1367622478 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603701380b0 con 0x56036fdb41c0 2024-09-21T07:58:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.411+0000 7f2c9d600640 10 client.27574 handle_command_reply: tid=0 2024-09-21T07:58:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.412+0000 7f2cbd8bc740 1 client.27574 shutdown 2024-09-21T07:58:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.413+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdf72f0 msgr2=0x5603701d8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.413+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdf72f0 0x5603701d8db0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000fc90 tx=0x7f2ca000a6b0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.414+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 shutdown_connections 2024-09-21T07:58:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.414+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56036fe201b0 0x5603701d67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.414+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56036fdff4d0 0x5603701d6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.414+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56036fdb41c0 0x560370260020 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.414+0000 7f2cbd8bc740 1 --2- 172.21.15.84:0/1367622478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56036fdf72f0 0x5603701d8db0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.414+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 >> 172.21.15.84:0/1367622478 conn(0x56036fe14300 msgr2=0x5603701db620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.414+0000 7f2c9d600640 0 client.27574 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:58:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.415+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 shutdown_connections 2024-09-21T07:58:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.416+0000 7f2cbd8bc740 1 -- 172.21.15.84:0/1367622478 wait complete. 2024-09-21T07:58:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.416+0000 7f2cbd8bc740 20 client.27574 trim_cache size 0 max 16384 2024-09-21T07:58:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T07:58:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T07:58:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T07:58:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T07:58:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.417+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2c940b6680 msgr2=0x7f2c940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.417+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2c940b6680 0x7f2c940b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2c9802aa00 tx=0x7f2c98005fd0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.417+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0110030 msgr2=0x7f2cb0118e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.417+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0110030 0x7f2cb0118e00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b970 tx=0x7f2ca800bd70 comp rx=0 tx=0).stop 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 shutdown_connections 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2c940b6680 0x7f2c940b8b90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cb0110030 0x7f2cb0118e00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb0076100 0x7f2cb0113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 --2- 172.21.15.84:0/2236561531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cb00757b0 0x7f2cb01135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 >> 172.21.15.84:0/2236561531 conn(0x7f2cb00ff520 msgr2=0x7f2cb01026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 shutdown_connections 2024-09-21T07:58:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:58:59.418+0000 7f2cb6800640 1 -- 172.21.15.84:0/2236561531 wait complete. 2024-09-21T07:58:59.448 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T07:58:59.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:58:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:59 smithi191 ceph-mon[34667]: pgmap v634: 129 pgs: 129 active+clean; 57 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 46 KiB/s rd, 190 MiB/s wr, 1.15k op/s 2024-09-21T07:58:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:58:59 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:00.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:59 smithi162 ceph-mon[34833]: pgmap v634: 129 pgs: 129 active+clean; 57 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 46 KiB/s rd, 190 MiB/s wr, 1.15k op/s 2024-09-21T07:59:00.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:58:59 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:59 smithi084 ceph-mon[30411]: pgmap v634: 129 pgs: 129 active+clean; 57 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 46 KiB/s rd, 190 MiB/s wr, 1.15k op/s 2024-09-21T07:59:00.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:58:59 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:00.151 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:00.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:00 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:00.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:00 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:00.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:00 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:00.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:00 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:59:01.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:00 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:01.049 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:00 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:59:01.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:00 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:01.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:00 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:01.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:00 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T07:59:01.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:01 smithi191 ceph-mon[34667]: pgmap v635: 129 pgs: 129 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 48 KiB/s rd, 238 MiB/s wr, 1.39k op/s 2024-09-21T07:59:02.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:01 smithi162 ceph-mon[34833]: pgmap v635: 129 pgs: 129 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 48 KiB/s rd, 238 MiB/s wr, 1.39k op/s 2024-09-21T07:59:02.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:01 smithi084 ceph-mon[30411]: pgmap v635: 129 pgs: 129 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 48 KiB/s rd, 238 MiB/s wr, 1.39k op/s 2024-09-21T07:59:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.718+0000 7ff917e00640 1 -- 172.21.15.84:0/3964102766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181025b0 msgr2=0x7ff9181029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.718+0000 7ff917e00640 1 --2- 172.21.15.84:0/3964102766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181025b0 0x7ff9181029c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff908009930 tx=0x7ff90802a440 comp rx=0 tx=0).stop 2024-09-21T07:59:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.720+0000 7ff917e00640 1 -- 172.21.15.84:0/3964102766 shutdown_connections 2024-09-21T07:59:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.720+0000 7ff917e00640 1 --2- 172.21.15.84:0/3964102766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 0x7ff918107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.720+0000 7ff917e00640 1 --2- 172.21.15.84:0/3964102766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff918102f00 0x7ff918107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.720+0000 7ff917e00640 1 --2- 172.21.15.84:0/3964102766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9181025b0 0x7ff9181029c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.720+0000 7ff917e00640 1 -- 172.21.15.84:0/3964102766 >> 172.21.15.84:0/3964102766 conn(0x7ff9180fe2c0 msgr2=0x7ff918100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.721+0000 7ff917e00640 1 -- 172.21.15.84:0/3964102766 shutdown_connections 2024-09-21T07:59:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.721+0000 7ff917e00640 1 -- 172.21.15.84:0/3964102766 wait complete. 2024-09-21T07:59:02.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.723+0000 7ff917e00640 1 Processor -- start 2024-09-21T07:59:02.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.723+0000 7ff917e00640 1 -- start start 2024-09-21T07:59:02.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9181025b0 0x7ff9181a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918102f00 0x7ff9181a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 0x7ff9181a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff918119f00 con 0x7ff9181025b0 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff918119d80 con 0x7ff918102f00 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff91811a080 con 0x7ff9181079f0 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 0x7ff9181a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 0x7ff9181a6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36632/0 (socket says 172.21.15.84:36632) 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.724+0000 7ff917400640 1 -- 172.21.15.84:0/3544182414 learned_addr learned my addr 172.21.15.84:0/3544182414 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:02.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.725+0000 7ff916000640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918102f00 0x7ff9181a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:02.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.725+0000 7ff917400640 1 -- 172.21.15.84:0/3544182414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918102f00 msgr2=0x7ff9181a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:02.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.725+0000 7ff917400640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918102f00 0x7ff9181a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.725+0000 7ff917400640 1 -- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9181025b0 msgr2=0x7ff9181a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:02.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.725+0000 7ff917400640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9181025b0 0x7ff9181a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:02.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.725+0000 7ff917400640 1 -- 172.21.15.84:0/3544182414 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9181a6840 con 0x7ff9181079f0 2024-09-21T07:59:02.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.726+0000 7ff917400640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 0x7ff9181a6110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff91000eb10 tx=0x7ff91000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:02.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.726+0000 7ff90f400640 1 -- 172.21.15.84:0/3544182414 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910004b20 con 0x7ff9181079f0 2024-09-21T07:59:02.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.726+0000 7ff90f400640 1 -- 172.21.15.84:0/3544182414 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff910004cc0 con 0x7ff9181079f0 2024-09-21T07:59:02.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.726+0000 7ff90f400640 1 -- 172.21.15.84:0/3544182414 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910010690 con 0x7ff9181079f0 2024-09-21T07:59:02.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.726+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9181a6b30 con 0x7ff9181079f0 2024-09-21T07:59:02.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.727+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9181ad290 con 0x7ff9181079f0 2024-09-21T07:59:02.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.729+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff918107430 con 0x7ff9181079f0 2024-09-21T07:59:02.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.731+0000 7ff90f400640 1 -- 172.21.15.84:0/3544182414 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff910005020 con 0x7ff9181079f0 2024-09-21T07:59:02.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.733+0000 7ff90f400640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8fc0b67b0 0x7ff8fc0b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:02.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.733+0000 7ff90f400640 1 -- 172.21.15.84:0/3544182414 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9432+0+0 (secure 0 0 0) 0x7ff9100e8190 con 0x7ff9181079f0 2024-09-21T07:59:02.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.734+0000 7ff916a00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8fc0b67b0 0x7ff8fc0b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:02.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.735+0000 7ff916a00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8fc0b67b0 0x7ff8fc0b8cc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff9080096c0 tx=0x7ff908000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:02.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:02.736+0000 7ff90f400640 1 -- 172.21.15.84:0/3544182414 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9100ae2f0 con 0x7ff9181079f0 2024-09-21T07:59:03.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.143+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9181ad5c0 con 0x7ff9181079f0 2024-09-21T07:59:03.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.144+0000 7ff90f400640 1 -- 172.21.15.84:0/3544182414 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7ff9100b26d0 con 0x7ff9181079f0 2024-09-21T07:59:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:59:03.148 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:59:03.148 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:59:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8fc0b67b0 msgr2=0x7ff8fc0b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8fc0b67b0 0x7ff8fc0b8cc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff9080096c0 tx=0x7ff908000bc0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 msgr2=0x7ff9181a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 0x7ff9181a6110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff91000eb10 tx=0x7ff91000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 shutdown_connections 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8fc0b67b0 0x7ff8fc0b8cc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9181079f0 0x7ff9181a6110 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918102f00 0x7ff9181a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 --2- 172.21.15.84:0/3544182414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9181025b0 0x7ff9181a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 >> 172.21.15.84:0/3544182414 conn(0x7ff9180fe2c0 msgr2=0x7ff918105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 shutdown_connections 2024-09-21T07:59:03.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:03.153+0000 7ff917e00640 1 -- 172.21.15.84:0/3544182414 wait complete. 2024-09-21T07:59:03.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:03 smithi191 ceph-mon[34667]: pgmap v636: 129 pgs: 129 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 71 KiB/s rd, 220 MiB/s wr, 1.17k op/s 2024-09-21T07:59:03.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:03 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3544182414' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:04.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:03 smithi162 ceph-mon[34833]: pgmap v636: 129 pgs: 129 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 71 KiB/s rd, 220 MiB/s wr, 1.17k op/s 2024-09-21T07:59:04.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:03 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3544182414' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:04.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:03 smithi084 ceph-mon[30411]: pgmap v636: 129 pgs: 129 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 71 KiB/s rd, 220 MiB/s wr, 1.17k op/s 2024-09-21T07:59:04.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:03 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3544182414' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:06.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:05 smithi162 ceph-mon[34833]: pgmap v637: 129 pgs: 129 active+clean; 58 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 56 KiB/s rd, 217 MiB/s wr, 1.11k op/s 2024-09-21T07:59:06.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:05 smithi084 ceph-mon[30411]: pgmap v637: 129 pgs: 129 active+clean; 58 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 56 KiB/s rd, 217 MiB/s wr, 1.11k op/s 2024-09-21T07:59:06.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:05 smithi191 ceph-mon[34667]: pgmap v637: 129 pgs: 129 active+clean; 58 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 56 KiB/s rd, 217 MiB/s wr, 1.11k op/s 2024-09-21T07:59:08.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:07 smithi162 ceph-mon[34833]: pgmap v638: 129 pgs: 129 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 74 KiB/s rd, 232 MiB/s wr, 1.26k op/s 2024-09-21T07:59:08.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:07 smithi084 ceph-mon[30411]: pgmap v638: 129 pgs: 129 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 74 KiB/s rd, 232 MiB/s wr, 1.26k op/s 2024-09-21T07:59:08.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:07 smithi191 ceph-mon[34667]: pgmap v638: 129 pgs: 129 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 74 KiB/s rd, 232 MiB/s wr, 1.26k op/s 2024-09-21T07:59:08.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T07:59:09.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:08 smithi162 ceph-mon[34833]: pgmap v639: 129 pgs: 129 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 48 KiB/s rd, 192 MiB/s wr, 1.11k op/s 2024-09-21T07:59:09.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:08 smithi162 ceph-mon[34833]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T07:59:09.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:08 smithi084 ceph-mon[30411]: pgmap v639: 129 pgs: 129 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 48 KiB/s rd, 192 MiB/s wr, 1.11k op/s 2024-09-21T07:59:09.058 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:08 smithi084 ceph-mon[30411]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T07:59:09.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:08 smithi191 ceph-mon[34667]: pgmap v639: 129 pgs: 129 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 48 KiB/s rd, 192 MiB/s wr, 1.11k op/s 2024-09-21T07:59:09.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:08 smithi191 ceph-mon[34667]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T07:59:09.240 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:11.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:11 smithi162 ceph-mon[34833]: pgmap v641: 129 pgs: 5 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 110 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 56 KiB/s rd, 205 MiB/s wr, 1.28k op/s 2024-09-21T07:59:11.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:11 smithi084 ceph-mon[30411]: pgmap v641: 129 pgs: 5 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 110 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 56 KiB/s rd, 205 MiB/s wr, 1.28k op/s 2024-09-21T07:59:11.857 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:11 smithi191 ceph-mon[34667]: pgmap v641: 129 pgs: 5 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 110 active+clean; 58 GiB data, 121 GiB used, 952 GiB / 1.0 TiB avail; 56 KiB/s rd, 205 MiB/s wr, 1.28k op/s 2024-09-21T07:59:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.768+0000 7f1579e00640 1 -- 172.21.15.84:0/3357901946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1574109400 msgr2=0x7f1574109810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.768+0000 7f1579e00640 1 --2- 172.21.15.84:0/3357901946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1574109400 0x7f1574109810 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1564009900 tx=0x7f156402a410 comp rx=0 tx=0).stop 2024-09-21T07:59:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.768+0000 7f1579e00640 1 -- 172.21.15.84:0/3357901946 shutdown_connections 2024-09-21T07:59:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.768+0000 7f1579e00640 1 --2- 172.21.15.84:0/3357901946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1574109d50 0x7f1574110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.768+0000 7f1579e00640 1 --2- 172.21.15.84:0/3357901946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1574109400 0x7f1574109810 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.768+0000 7f1579e00640 1 --2- 172.21.15.84:0/3357901946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1574103ad0 0x7f1574103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.768+0000 7f1579e00640 1 -- 172.21.15.84:0/3357901946 >> 172.21.15.84:0/3357901946 conn(0x7f15740ff510 msgr2=0x7f1574101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.769+0000 7f1579e00640 1 -- 172.21.15.84:0/3357901946 shutdown_connections 2024-09-21T07:59:12.772 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.769+0000 7f1579e00640 1 -- 172.21.15.84:0/3357901946 wait complete. 2024-09-21T07:59:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.771+0000 7f1579e00640 1 Processor -- start 2024-09-21T07:59:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.775+0000 7f1579e00640 1 -- start start 2024-09-21T07:59:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.775+0000 7f1579e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1574103ad0 0x7f1574198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.775+0000 7f1579e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1574109400 0x7f1574198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.775+0000 7f1579e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1574109d50 0x7f157419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.775+0000 7f1579e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1574111870 con 0x7f1574103ad0 2024-09-21T07:59:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.775+0000 7f1579e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15741116f0 con 0x7f1574109400 2024-09-21T07:59:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.775+0000 7f1579e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15741119f0 con 0x7f1574109d50 2024-09-21T07:59:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.776+0000 7f1572000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1574109400 0x7f1574198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.776+0000 7f1572000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1574109400 0x7f1574198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46212/0 (socket says 172.21.15.84:46212) 2024-09-21T07:59:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.776+0000 7f1572000640 1 -- 172.21.15.84:0/1159304236 learned_addr learned my addr 172.21.15.84:0/1159304236 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.776+0000 7f1573400640 1 --2- 172.21.15.84:0/1159304236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1574109d50 0x7f157419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.777+0000 7f1572000640 1 -- 172.21.15.84:0/1159304236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1574109d50 msgr2=0x7f157419dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.777+0000 7f1572000640 1 --2- 172.21.15.84:0/1159304236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1574109d50 0x7f157419dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.777+0000 7f1572000640 1 -- 172.21.15.84:0/1159304236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1574103ad0 msgr2=0x7f1574198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.777+0000 7f1572000640 1 --2- 172.21.15.84:0/1159304236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1574103ad0 0x7f1574198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.777+0000 7f1572000640 1 -- 172.21.15.84:0/1159304236 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157419e1c0 con 0x7f1574109400 2024-09-21T07:59:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.777+0000 7f1572000640 1 --2- 172.21.15.84:0/1159304236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1574109400 0x7f1574198830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f156402a980 tx=0x7f1564003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.778+0000 7f1578a00640 1 -- 172.21.15.84:0/1159304236 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156403f070 con 0x7f1574109400 2024-09-21T07:59:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.778+0000 7f1578a00640 1 -- 172.21.15.84:0/1159304236 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f156403bb10 con 0x7f1574109400 2024-09-21T07:59:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.778+0000 7f1578a00640 1 -- 172.21.15.84:0/1159304236 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564035030 con 0x7f1574109400 2024-09-21T07:59:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.778+0000 7f1579e00640 1 -- 172.21.15.84:0/1159304236 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157419e450 con 0x7f1574109400 2024-09-21T07:59:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.778+0000 7f1579e00640 1 -- 172.21.15.84:0/1159304236 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157419e8f0 con 0x7f1574109400 2024-09-21T07:59:12.787 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.786+0000 7f1580dcf740 1 Processor -- start 2024-09-21T07:59:12.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1580dcf740 1 -- start start 2024-09-21T07:59:12.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1578a00640 1 -- 172.21.15.84:0/1159304236 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f1564042070 con 0x7f1574109400 2024-09-21T07:59:12.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c3230c1b0 0x563c326b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.789 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1580dcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563c326266b0 con 0x563c3230c1b0 2024-09-21T07:59:12.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1580dcf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563c32615ae0 con 0x563c322e32f0 2024-09-21T07:59:12.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.787+0000 7f1580dcf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563c326198f0 con 0x563c322eb4d0 2024-09-21T07:59:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.789+0000 7f1572000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.789+0000 7f1572a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.789+0000 7f1572a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46218/0 (socket says 172.21.15.84:46218) 2024-09-21T07:59:12.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.789+0000 7f1572a00640 1 -- 172.21.15.84:0/2847605719 learned_addr learned my addr 172.21.15.84:0/2847605719 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:12.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.791+0000 7f1573400640 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c3230c1b0 0x563c326b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.791+0000 7f1572a00640 1 -- 172.21.15.84:0/2847605719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 msgr2=0x563c326b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.792+0000 7f1572a00640 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.792+0000 7f1572a00640 1 -- 172.21.15.84:0/2847605719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c3230c1b0 msgr2=0x563c326b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.792+0000 7f1572a00640 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c3230c1b0 0x563c326b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.792+0000 7f1572a00640 1 -- 172.21.15.84:0/2847605719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c325e2780 con 0x563c322e32f0 2024-09-21T07:59:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.792+0000 7f1578a00640 1 --2- 172.21.15.84:0/1159304236 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15580bab40 0x7f15580bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.792+0000 7f1578a00640 1 -- 172.21.15.84:0/1159304236 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f15641082f0 con 0x7f1574109400 2024-09-21T07:59:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.793+0000 7f1573400640 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c3230c1b0 0x563c326b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.793+0000 7f1573400640 1 --2- 172.21.15.84:0/1159304236 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15580bab40 0x7f15580bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.794+0000 7f1572a00640 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326b1170 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1560009c70 tx=0x7f156000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64b22a0c4705fb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.794+0000 7f155fe00640 1 -- 172.21.15.84:0/2847605719 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560005020 con 0x563c322e32f0 2024-09-21T07:59:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.794+0000 7f155fe00640 1 -- 172.21.15.84:0/2847605719 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15600047a0 con 0x563c322e32f0 2024-09-21T07:59:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.794+0000 7f155fe00640 1 -- 172.21.15.84:0/2847605719 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560010690 con 0x563c322e32f0 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.795+0000 7f1580dcf740 1 -- 172.21.15.84:0/2847605719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 msgr2=0x563c326b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.795+0000 7f1580dcf740 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326b1170 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1560009c70 tx=0x7f156000e720 comp rx=0 tx=0).stop 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.795+0000 7f1573400640 1 --2- 172.21.15.84:0/1159304236 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f15580bab40 0x7f15580bd050 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f156c00aef0 tx=0x7f156c00a530 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.797+0000 7f1580dcf740 1 -- 172.21.15.84:0/2847605719 shutdown_connections 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.797+0000 7f1580dcf740 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.797+0000 7f1580dcf740 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326b1170 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.797+0000 7f1580dcf740 1 --2- 172.21.15.84:0/2847605719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c3230c1b0 0x563c326b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.797+0000 7f1580dcf740 1 -- 172.21.15.84:0/2847605719 >> 172.21.15.84:0/2847605719 conn(0x563c32300300 msgr2=0x563c326aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.797+0000 7f1580dcf740 1 -- 172.21.15.84:0/2847605719 shutdown_connections 2024-09-21T07:59:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.797+0000 7f1580dcf740 1 -- 172.21.15.84:0/2847605719 wait complete. 2024-09-21T07:59:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.798+0000 7f1580dcf740 1 -- start start 2024-09-21T07:59:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.798+0000 7f1580dcf740 1 Processor -- start 2024-09-21T07:59:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.799+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326bc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.799+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322eb4d0 0x563c326bc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.799+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326bcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.799+0000 7f1580dcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563c3254dab0 con 0x563c322eb4d0 2024-09-21T07:59:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.799+0000 7f1580dcf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563c325bc570 con 0x563c322e32f0 2024-09-21T07:59:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.799+0000 7f1580dcf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563c326d03c0 con 0x563c3230c1b0 2024-09-21T07:59:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.800+0000 7f1580dcf740 10 client.0 _ll_register_callbacks cb 0x563c325cb100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.801+0000 7f1572a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.802+0000 7f1573400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326bcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.802+0000 7f1573400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326bcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:40156/0 (socket says 172.21.15.84:40156) 2024-09-21T07:59:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.802+0000 7f1573400640 1 -- 172.21.15.84:0/1186317477 learned_addr learned my addr 172.21.15.84:0/1186317477 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.803+0000 7f1573400640 1 -- 172.21.15.84:0/1186317477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 msgr2=0x563c326bc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.803+0000 7f1573400640 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326bc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.803+0000 7f1573400640 1 -- 172.21.15.84:0/1186317477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322eb4d0 msgr2=0x563c326bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.803+0000 7f1573400640 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322eb4d0 0x563c326bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.803+0000 7f1573400640 1 -- 172.21.15.84:0/1186317477 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c32377790 con 0x563c3230c1b0 2024-09-21T07:59:12.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.807+0000 7f1573400640 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326bcc90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f156c019de0 tx=0x7f156c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=677b806a9c6b50ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.807+0000 7f155cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.807+0000 7f155cc00640 1 -- 172.21.15.84:0/1186317477 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c027060 con 0x563c3230c1b0 2024-09-21T07:59:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.807+0000 7f155cc00640 1 -- 172.21.15.84:0/1186317477 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f156c0190d0 con 0x563c3230c1b0 2024-09-21T07:59:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.808+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15600047a0 con 0x563c3230c1b0 2024-09-21T07:59:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.808+0000 7f155cc00640 1 -- 172.21.15.84:0/1186317477 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f156c017420 con 0x563c3230c1b0 2024-09-21T07:59:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.808+0000 7f1580dcf740 10 client.27592 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.808+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c323f0620 con 0x563c3230c1b0 2024-09-21T07:59:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.809+0000 7f155cc00640 1 -- 172.21.15.84:0/1186317477 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f156c017a70 con 0x563c3230c1b0 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.809+0000 7f155cc00640 1 -- 172.21.15.84:0/1186317477 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f156c022670 con 0x563c3230c1b0 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.809+0000 7f1580dcf740 10 client.27592 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.809+0000 7f1580dcf740 10 client.27592 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.809+0000 7f1580dcf740 20 client.27592 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.809+0000 7f1580dcf740 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563c322cad80 0x563c326df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.809+0000 7f1580dcf740 4 client.27592 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.810+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f15600047a0 con 0x563c322cad80 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.810+0000 7f1572a00640 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563c322cad80 0x563c326df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.811+0000 7f155cc00640 10 client.27592 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.811+0000 7f1572a00640 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563c322cad80 0x563c326df3e0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b6491f9c1c73925 server_cookie=3987b4441279a5f7 in_seq=0 out_seq=0 2024-09-21T07:59:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.814+0000 7f155cc00640 1 -- 172.21.15.84:0/1186317477 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f15600047a0 con 0x563c322cad80 2024-09-21T07:59:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.814+0000 7f155cc00640 10 client.27592 handle_command_reply: tid=0 2024-09-21T07:59:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.814+0000 7f1580dcf740 1 client.27592 shutdown 2024-09-21T07:59:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 msgr2=0x563c326bcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326bcc90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f156c019de0 tx=0x7f156c004a40 comp rx=0 tx=0).stop 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 shutdown_connections 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563c322cad80 0x563c326df3e0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326bcc90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322eb4d0 0x563c326bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 --2- 172.21.15.84:0/1186317477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322e32f0 0x563c326bc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 >> 172.21.15.84:0/1186317477 conn(0x563c32300300 msgr2=0x563c326b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.815+0000 7f155cc00640 0 client.27592 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.816+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 shutdown_connections 2024-09-21T07:59:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.816+0000 7f1580dcf740 1 -- 172.21.15.84:0/1186317477 wait complete. 2024-09-21T07:59:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.816+0000 7f1580dcf740 20 client.27592 trim_cache size 0 max 16384 2024-09-21T07:59:12.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.852+0000 7f1580dcf740 1 Processor -- start 2024-09-21T07:59:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.855+0000 7f1580dcf740 1 -- start start 2024-09-21T07:59:12.858 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.856+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.856+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.856+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c3230c1b0 0x563c326b9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.856+0000 7f1580dcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f15741a87d0 con 0x563c322e32f0 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.856+0000 7f1580dcf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15741a65c0 con 0x563c3230c1b0 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.856+0000 7f1580dcf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15741a8100 con 0x563c322eb4d0 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.857+0000 7f1572000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.857+0000 7f1573400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c3230c1b0 0x563c326b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.857+0000 7f1573400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c3230c1b0 0x563c326b9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46238/0 (socket says 172.21.15.84:46238) 2024-09-21T07:59:12.859 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.857+0000 7f1573400640 1 -- 172.21.15.84:0/398774695 learned_addr learned my addr 172.21.15.84:0/398774695 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.858+0000 7f1572a00640 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.858+0000 7f1572000640 1 -- 172.21.15.84:0/398774695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c3230c1b0 msgr2=0x563c326b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.858+0000 7f1572000640 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c3230c1b0 0x563c326b9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.858+0000 7f1572000640 1 -- 172.21.15.84:0/398774695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 msgr2=0x563c326b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.860+0000 7f1572000640 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.860+0000 7f1572000640 1 -- 172.21.15.84:0/398774695 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c326a8d50 con 0x563c322eb4d0 2024-09-21T07:59:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.861+0000 7f1573400640 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c3230c1b0 0x563c326b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.861+0000 7f1572a00640 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.862+0000 7f1572000640 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b93e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1564105660 tx=0x7f156403bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e62bc5c4eedeb82e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.862+0000 7f155f400640 1 -- 172.21.15.84:0/398774695 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564049020 con 0x563c322eb4d0 2024-09-21T07:59:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.863+0000 7f155f400640 1 -- 172.21.15.84:0/398774695 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15640cd870 con 0x563c322eb4d0 2024-09-21T07:59:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.863+0000 7f155f400640 1 -- 172.21.15.84:0/398774695 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640d7780 con 0x563c322eb4d0 2024-09-21T07:59:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.864+0000 7f1580dcf740 1 -- 172.21.15.84:0/398774695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 msgr2=0x563c326b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.864+0000 7f1580dcf740 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b93e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1564105660 tx=0x7f156403bf50 comp rx=0 tx=0).stop 2024-09-21T07:59:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.864+0000 7f1580dcf740 1 -- 172.21.15.84:0/398774695 shutdown_connections 2024-09-21T07:59:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.864+0000 7f1580dcf740 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c3230c1b0 0x563c326b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.864+0000 7f1580dcf740 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c322eb4d0 0x563c326b93e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.864+0000 7f1580dcf740 1 --2- 172.21.15.84:0/398774695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.864+0000 7f1580dcf740 1 -- 172.21.15.84:0/398774695 >> 172.21.15.84:0/398774695 conn(0x563c32300300 msgr2=0x563c326b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.865+0000 7f1580dcf740 1 -- 172.21.15.84:0/398774695 shutdown_connections 2024-09-21T07:59:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.865+0000 7f1580dcf740 1 -- 172.21.15.84:0/398774695 wait complete. 2024-09-21T07:59:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.866+0000 7f1580dcf740 1 -- start start 2024-09-21T07:59:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.867+0000 7f1580dcf740 1 Processor -- start 2024-09-21T07:59:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.868+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.869+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322eb4d0 0x563c326d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.869+0000 7f1580dcf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.869+0000 7f1580dcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f15741a7360 con 0x563c322e32f0 2024-09-21T07:59:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.869+0000 7f1580dcf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15741a6c90 con 0x563c322eb4d0 2024-09-21T07:59:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.869+0000 7f1580dcf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15741a7a30 con 0x563c3230c1b0 2024-09-21T07:59:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.869+0000 7f1580dcf740 10 client.0 _ll_register_callbacks cb 0x7f156c00ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:12.873 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.870+0000 7f1572000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322eb4d0 0x563c326d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.873 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.870+0000 7f1572000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322eb4d0 0x563c326d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46240/0 (socket says 172.21.15.84:46240) 2024-09-21T07:59:12.873 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.870+0000 7f1572000640 1 -- 172.21.15.84:0/1158558623 learned_addr learned my addr 172.21.15.84:0/1158558623 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:12.873 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.870+0000 7f1572a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.870+0000 7f1573400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.871+0000 7f1572000640 1 -- 172.21.15.84:0/1158558623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 msgr2=0x563c326d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.872+0000 7f1572000640 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.872+0000 7f1572000640 1 -- 172.21.15.84:0/1158558623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 msgr2=0x563c326d5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.872+0000 7f1572000640 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326d5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.872+0000 7f1572000640 1 -- 172.21.15.84:0/1158558623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c326d3c40 con 0x563c322eb4d0 2024-09-21T07:59:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.872+0000 7f1573400640 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c3230c1b0 0x563c326d3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.872+0000 7f1572a00640 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c322e32f0 0x563c326d5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.874+0000 7f1572000640 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c322eb4d0 0x563c326d3110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1564108620 tx=0x7f1564003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bac82292678dc2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.874+0000 7f155cc00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:59:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.876+0000 7f155cc00640 1 -- 172.21.15.84:0/1158558623 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564049070 con 0x563c322eb4d0 2024-09-21T07:59:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.876+0000 7f155cc00640 1 -- 172.21.15.84:0/1158558623 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f15641058e0 con 0x563c322eb4d0 2024-09-21T07:59:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.876+0000 7f1580dcf740 1 -- 172.21.15.84:0/1158558623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15640cd870 con 0x563c322eb4d0 2024-09-21T07:59:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.877+0000 7f155cc00640 1 -- 172.21.15.84:0/1158558623 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15640cd6b0 con 0x563c322eb4d0 2024-09-21T07:59:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.877+0000 7f1580dcf740 10 client.27596 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.877+0000 7f1580dcf740 1 -- 172.21.15.84:0/1158558623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c32752320 con 0x563c322eb4d0 2024-09-21T07:59:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.877+0000 7f155cc00640 1 -- 172.21.15.84:0/1158558623 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15640cd870 con 0x563c322eb4d0 2024-09-21T07:59:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.878+0000 7f155cc00640 1 -- 172.21.15.84:0/1158558623 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f15640d72f0 con 0x563c322eb4d0 2024-09-21T07:59:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.878+0000 7f1580dcf740 10 client.27596 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.878+0000 7f1580dcf740 10 client.27596 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.878+0000 7f1580dcf740 20 client.27596 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.878+0000 7f1580dcf740 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563c322a01c0 0x563c327549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.878+0000 7f1580dcf740 4 client.27596 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T07:59:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.878+0000 7f1580dcf740 1 -- 172.21.15.84:0/1158558623 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c32628600 con 0x563c322a01c0 2024-09-21T07:59:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.879+0000 7f1572a00640 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563c322a01c0 0x563c327549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.880+0000 7f155cc00640 10 client.27596 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T07:59:12.880+0000 7f1572a00640 1 --2- 172.21.15.84:0/1158558623 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563c322a01c0 0x563c327549a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df842ef0c03e5a6d server_cookie=d9f17f5e13ff5b37 in_seq=0 out_seq=0 2024-09-21T07:59:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.631+0000 7f82c6400640 1 -- 172.21.15.84:0/887234937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c010a650 msgr2=0x7f82c010aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.631+0000 7f82c6400640 1 --2- 172.21.15.84:0/887234937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c010a650 0x7f82c010aa60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009370 tx=0x7f82b402b640 comp rx=0 tx=0).stop 2024-09-21T07:59:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.632+0000 7f82c6400640 1 -- 172.21.15.84:0/887234937 shutdown_connections 2024-09-21T07:59:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.632+0000 7f82c6400640 1 --2- 172.21.15.84:0/887234937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c0110660 0x7f82c0116e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.632+0000 7f82c6400640 1 --2- 172.21.15.84:0/887234937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82c010fd10 0x7f82c0110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.632+0000 7f82c6400640 1 --2- 172.21.15.84:0/887234937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c010a650 0x7f82c010aa60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.632+0000 7f82c6400640 1 -- 172.21.15.84:0/887234937 >> 172.21.15.84:0/887234937 conn(0x7f82c006e9f0 msgr2=0x7f82c006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:13.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.637+0000 7f82c6400640 1 -- 172.21.15.84:0/887234937 shutdown_connections 2024-09-21T07:59:13.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.638+0000 7f82c6400640 1 -- 172.21.15.84:0/887234937 wait complete. 2024-09-21T07:59:13.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.639+0000 7f82c6400640 1 Processor -- start 2024-09-21T07:59:13.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.642+0000 7f82c6400640 1 -- start start 2024-09-21T07:59:13.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.643+0000 7f82c6400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c010a650 0x7f82c011bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.643+0000 7f82c6400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82c010fd10 0x7f82c011c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.643+0000 7f82c6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c0110660 0x7f82c01214a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.644+0000 7f82c5a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c0110660 0x7f82c01214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.645+0000 7f82c5a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c0110660 0x7f82c01214a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46258/0 (socket says 172.21.15.84:46258) 2024-09-21T07:59:13.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.645+0000 7f82c5a00640 1 -- 172.21.15.84:0/4082244181 learned_addr learned my addr 172.21.15.84:0/4082244181 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:13.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.646+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82c0119aa0 con 0x7f82c010a650 2024-09-21T07:59:13.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.646+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82c0119920 con 0x7f82c0110660 2024-09-21T07:59:13.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.646+0000 7f82bfe00640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82c010fd10 0x7f82c011c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.647+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f82c0119c20 con 0x7f82c010fd10 2024-09-21T07:59:13.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.648+0000 7f82c5a00640 1 -- 172.21.15.84:0/4082244181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82c010fd10 msgr2=0x7f82c011c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.648+0000 7f82c5a00640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82c010fd10 0x7f82c011c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.648+0000 7f82c5000640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c010a650 0x7f82c011bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.648+0000 7f82c5a00640 1 -- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c010a650 msgr2=0x7f82c011bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.649+0000 7f82c5a00640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c010a650 0x7f82c011bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.650+0000 7f82c5a00640 1 -- 172.21.15.84:0/4082244181 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c0121bd0 con 0x7f82c0110660 2024-09-21T07:59:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.651+0000 7f82bfe00640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82c010fd10 0x7f82c011c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:13.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.651+0000 7f82c5000640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c010a650 0x7f82c011bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:13.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.652+0000 7f82c5a00640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c0110660 0x7f82c01214a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b970 tx=0x7f82b800be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.666+0000 7f82bd600640 1 -- 172.21.15.84:0/4082244181 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8019070 con 0x7f82c0110660 2024-09-21T07:59:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.666+0000 7f82bd600640 1 -- 172.21.15.84:0/4082244181 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82b8014440 con 0x7f82c0110660 2024-09-21T07:59:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.666+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c0121e60 con 0x7f82c0110660 2024-09-21T07:59:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.666+0000 7f82bd600640 1 -- 172.21.15.84:0/4082244181 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b80075d0 con 0x7f82c0110660 2024-09-21T07:59:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.667+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c0126630 con 0x7f82c0110660 2024-09-21T07:59:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.675+0000 7f82bd600640 1 -- 172.21.15.84:0/4082244181 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f82b800cb40 con 0x7f82c0110660 2024-09-21T07:59:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.679+0000 7f82bd600640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82a80b6880 0x7f82a80b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.679+0000 7f82bd600640 1 -- 172.21.15.84:0/4082244181 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f82b80e7090 con 0x7f82c0110660 2024-09-21T07:59:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.680+0000 7f82c5000640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82a80b6880 0x7f82a80b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.683+0000 7f82c5000640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82a80b6880 0x7f82a80b8d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f82b4000c00 tx=0x7f82b4005e70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:13.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.692+0000 7f82ce647740 1 Processor -- start 2024-09-21T07:59:13.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.692+0000 7f82ce647740 1 -- start start 2024-09-21T07:59:13.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.693+0000 7f82ce647740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abc5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.693+0000 7f82ce647740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abc6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.693+0000 7f82ce647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abc67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.693+0000 7f82ce647740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55582ab3cfb0 con 0x55582a7f61b0 2024-09-21T07:59:13.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.693+0000 7f82ce647740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55582ab2c3e0 con 0x55582a7fe390 2024-09-21T07:59:13.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.693+0000 7f82ce647740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55582ab301f0 con 0x55582a81f070 2024-09-21T07:59:13.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.696+0000 7f82c5000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abc5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.696+0000 7f82c5000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abc5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:40192/0 (socket says 172.21.15.84:40192) 2024-09-21T07:59:13.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.696+0000 7f82c5000640 1 -- 172.21.15.84:0/2625343792 learned_addr learned my addr 172.21.15.84:0/2625343792 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:13.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5a00640 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abc67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5000640 1 -- 172.21.15.84:0/2625343792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 msgr2=0x55582abc67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5000640 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abc67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5000640 1 -- 172.21.15.84:0/2625343792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 msgr2=0x55582abc6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5000640 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abc6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5000640 1 -- 172.21.15.84:0/2625343792 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582aaf6cd0 con 0x55582a81f070 2024-09-21T07:59:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5a00640 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abc67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.697+0000 7f82c5000640 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abc5d30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f82b4005410 tx=0x7f82b403c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9632a0db531cb57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.698+0000 7f82b2000640 1 -- 172.21.15.84:0/2625343792 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4036040 con 0x55582a81f070 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.698+0000 7f82b2000640 1 -- 172.21.15.84:0/2625343792 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82b404e070 con 0x55582a81f070 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.698+0000 7f82b2000640 1 -- 172.21.15.84:0/2625343792 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4049440 con 0x55582a81f070 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.699+0000 7f82ce647740 1 -- 172.21.15.84:0/2625343792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 msgr2=0x55582abc5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.699+0000 7f82ce647740 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abc5d30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f82b4005410 tx=0x7f82b403c000 comp rx=0 tx=0).stop 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.699+0000 7f82ce647740 1 -- 172.21.15.84:0/2625343792 shutdown_connections 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.699+0000 7f82ce647740 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abc67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.699+0000 7f82ce647740 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abc6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.699+0000 7f82ce647740 1 --2- 172.21.15.84:0/2625343792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abc5d30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.699+0000 7f82ce647740 1 -- 172.21.15.84:0/2625343792 >> 172.21.15.84:0/2625343792 conn(0x55582a813460 msgr2=0x55582abc3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.700+0000 7f82ce647740 1 -- 172.21.15.84:0/2625343792 shutdown_connections 2024-09-21T07:59:13.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.700+0000 7f82ce647740 1 -- 172.21.15.84:0/2625343792 wait complete. 2024-09-21T07:59:13.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.700+0000 7f82ce647740 1 -- start start 2024-09-21T07:59:13.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.701+0000 7f82ce647740 1 Processor -- start 2024-09-21T07:59:13.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.702+0000 7f82ce647740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.702+0000 7f82ce647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abd1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.703+0000 7f82ce647740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abdd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.703+0000 7f82ce647740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55582a98d700 con 0x55582a7f61b0 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.703+0000 7f82c5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.703+0000 7f82c5a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abdd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.703+0000 7f82c5a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abdd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:40198/0 (socket says 172.21.15.84:40198) 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.703+0000 7f82c5a00640 1 -- 172.21.15.84:0/1270575772 learned_addr learned my addr 172.21.15.84:0/1270575772 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55582aac7580 con 0x55582a7fe390 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55582abd44b0 con 0x55582a81f070 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82ce647740 10 client.0 _ll_register_callbacks cb 0x55582aad7470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:13.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.703+0000 7f82c5000640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38948/0 (socket says 172.21.15.84:38948) 2024-09-21T07:59:13.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82bfe00640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abd1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82c5a00640 1 -- 172.21.15.84:0/1270575772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 msgr2=0x55582abd1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82c5a00640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abd1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82c5a00640 1 -- 172.21.15.84:0/1270575772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 msgr2=0x55582abd19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82c5a00640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.704+0000 7f82c5a00640 1 -- 172.21.15.84:0/1270575772 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582a88a650 con 0x55582a81f070 2024-09-21T07:59:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.705+0000 7f82c5000640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.705+0000 7f82bfe00640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abd1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.705+0000 7f82c5a00640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abdd7d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b940 tx=0x7f82b800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd0babf83eae66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.705+0000 7f82a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.706+0000 7f82a6a00640 1 -- 172.21.15.84:0/1270575772 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8047040 con 0x55582a81f070 2024-09-21T07:59:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.706+0000 7f82a6a00640 1 -- 172.21.15.84:0/1270575772 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f82b80145f0 con 0x55582a81f070 2024-09-21T07:59:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.706+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55582aac9b90 con 0x55582a81f070 2024-09-21T07:59:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.708+0000 7f82a6a00640 1 -- 172.21.15.84:0/1270575772 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f82b80ad1c0 con 0x55582a81f070 2024-09-21T07:59:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.708+0000 7f82ce647740 10 client.27610 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.708+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55582aae4950 con 0x55582a81f070 2024-09-21T07:59:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.711+0000 7f82a6a00640 1 -- 172.21.15.84:0/1270575772 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55582aac9b90 con 0x55582a81f070 2024-09-21T07:59:13.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.713+0000 7f82a6a00640 1 -- 172.21.15.84:0/1270575772 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f82b80b10d0 con 0x55582a81f070 2024-09-21T07:59:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.715+0000 7f82ce647740 10 client.27610 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.715+0000 7f82ce647740 10 client.27610 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:59:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.715+0000 7f82ce647740 20 client.27610 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.715+0000 7f82ce647740 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a7dd9f0 0x55582abe38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.715+0000 7f82ce647740 4 client.27610 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.715+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55582ab3ef00 con 0x55582a7dd9f0 2024-09-21T07:59:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.715+0000 7f82c5000640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a7dd9f0 0x55582abe38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.716+0000 7f82c5000640 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a7dd9f0 0x55582abe38a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=17d25ae5875210ed server_cookie=65e666da5b3cf9c8 in_seq=0 out_seq=0 2024-09-21T07:59:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.716+0000 7f82a6a00640 10 client.27610 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:59:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.717+0000 7f82a6a00640 1 -- 172.21.15.84:0/1270575772 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55582ab3ef00 con 0x55582a7dd9f0 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.717+0000 7f82a6a00640 10 client.27610 handle_command_reply: tid=0 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.717+0000 7f82ce647740 1 client.27610 shutdown 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.718+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 msgr2=0x55582abdd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.718+0000 7f82ce647740 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abdd7d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b940 tx=0x7f82b800ce30 comp rx=0 tx=0).stop 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.718+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 shutdown_connections 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.718+0000 7f82ce647740 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a7dd9f0 0x55582abe38a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.719+0000 7f82ce647740 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a81f070 0x55582abdd7d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.719+0000 7f82a6a00640 0 client.27610 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.719+0000 7f82ce647740 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7fe390 0x55582abd1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.719+0000 7f82ce647740 1 --2- 172.21.15.84:0/1270575772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.719+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 >> 172.21.15.84:0/1270575772 conn(0x55582a813460 msgr2=0x55582abc8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:13.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.719+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 shutdown_connections 2024-09-21T07:59:13.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.719+0000 7f82ce647740 1 -- 172.21.15.84:0/1270575772 wait complete. 2024-09-21T07:59:13.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.720+0000 7f82ce647740 20 client.27610 trim_cache size 0 max 16384 2024-09-21T07:59:13.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.751+0000 7f82ce647740 1 Processor -- start 2024-09-21T07:59:13.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.752+0000 7f82ce647740 1 -- start start 2024-09-21T07:59:13.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.752+0000 7f82ce647740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7dd9f0 0x55582abcae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.752+0000 7f82ce647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7f61b0 0x55582abcb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.752+0000 7f82ce647740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7fe390 0x55582abc3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.752+0000 7f82ce647740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82c01c83e0 con 0x55582a7fe390 2024-09-21T07:59:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.752+0000 7f82ce647740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82c01c9f20 con 0x55582a7f61b0 2024-09-21T07:59:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.752+0000 7f82ce647740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f82c01c8ab0 con 0x55582a7dd9f0 2024-09-21T07:59:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.753+0000 7f82c5000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7dd9f0 0x55582abcae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.753+0000 7f82bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7f61b0 0x55582abcb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.754+0000 7f82bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7f61b0 0x55582abcb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46288/0 (socket says 172.21.15.84:46288) 2024-09-21T07:59:13.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.754+0000 7f82bfe00640 1 -- 172.21.15.84:0/519483875 learned_addr learned my addr 172.21.15.84:0/519483875 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.755+0000 7f82c5000640 1 -- 172.21.15.84:0/519483875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7f61b0 msgr2=0x55582abcb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.755+0000 7f82c5000640 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7f61b0 0x55582abcb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.755+0000 7f82c5000640 1 -- 172.21.15.84:0/519483875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7fe390 msgr2=0x55582abc3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.755+0000 7f82c5000640 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7fe390 0x55582abc3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.755+0000 7f82c5000640 1 -- 172.21.15.84:0/519483875 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582abc8b90 con 0x55582a7dd9f0 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.756+0000 7f82bfe00640 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7f61b0 0x55582abcb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.756+0000 7f82c5000640 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7dd9f0 0x55582abcae40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f82b403ccc0 tx=0x7f82b403c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5edac3875d81dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.757+0000 7f82b1600640 1 -- 172.21.15.84:0/519483875 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4036040 con 0x55582a7dd9f0 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.757+0000 7f82b1600640 1 -- 172.21.15.84:0/519483875 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55582ab3ef00 con 0x55582a7dd9f0 2024-09-21T07:59:13.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.757+0000 7f82b1600640 1 -- 172.21.15.84:0/519483875 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4049440 con 0x55582a7dd9f0 2024-09-21T07:59:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.760+0000 7f82ce647740 1 -- 172.21.15.84:0/519483875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7dd9f0 msgr2=0x55582abcae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.760+0000 7f82ce647740 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7dd9f0 0x55582abcae40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f82b403ccc0 tx=0x7f82b403c000 comp rx=0 tx=0).stop 2024-09-21T07:59:13.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.761+0000 7f82ce647740 1 -- 172.21.15.84:0/519483875 shutdown_connections 2024-09-21T07:59:13.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.762+0000 7f82ce647740 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7fe390 0x55582abc3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.762+0000 7f82ce647740 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7f61b0 0x55582abcb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.762+0000 7f82ce647740 1 --2- 172.21.15.84:0/519483875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7dd9f0 0x55582abcae40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.762+0000 7f82ce647740 1 -- 172.21.15.84:0/519483875 >> 172.21.15.84:0/519483875 conn(0x55582a813460 msgr2=0x55582abd0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.762+0000 7f82ce647740 1 -- 172.21.15.84:0/519483875 shutdown_connections 2024-09-21T07:59:13.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.763+0000 7f82ce647740 1 -- 172.21.15.84:0/519483875 wait complete. 2024-09-21T07:59:13.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.764+0000 7f82ce647740 1 -- start start 2024-09-21T07:59:13.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.766+0000 7f82ce647740 1 Processor -- start 2024-09-21T07:59:13.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.767+0000 7f82ce647740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7dd9f0 0x55582abd5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.767+0000 7f82ce647740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.767+0000 7f82ce647740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7fe390 0x55582ac4d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.767+0000 7f82ce647740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82c01c9850 con 0x55582a7f61b0 2024-09-21T07:59:13.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.767+0000 7f82ce647740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82c01c9180 con 0x55582a7dd9f0 2024-09-21T07:59:13.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.767+0000 7f82ce647740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f82c01c63c0 con 0x55582a7fe390 2024-09-21T07:59:13.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.767+0000 7f82ce647740 10 client.0 _ll_register_callbacks cb 0x7f82b80ac410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:13.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.768+0000 7f82c5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7dd9f0 0x55582abd5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.769+0000 7f82c5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7dd9f0 0x55582abd5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:46296/0 (socket says 172.21.15.84:46296) 2024-09-21T07:59:13.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.769+0000 7f82c5000640 1 -- 172.21.15.84:0/2075484445 learned_addr learned my addr 172.21.15.84:0/2075484445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:13.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.769+0000 7f82c5a00640 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7fe390 0x55582ac4d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.770+0000 7f82c5000640 1 -- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7fe390 msgr2=0x55582ac4d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.770+0000 7f82c5000640 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7fe390 0x55582ac4d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.770+0000 7f82c5000640 1 -- 172.21.15.84:0/2075484445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 msgr2=0x55582abd6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.770+0000 7f82c5000640 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.771+0000 7f82c5000640 1 -- 172.21.15.84:0/2075484445 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582ac4d780 con 0x55582a7dd9f0 2024-09-21T07:59:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.775+0000 7f82c5000640 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7dd9f0 0x55582abd5e10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009b30 tx=0x7f82b403ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a361837a2137e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.775+0000 7f82a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T07:59:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.775+0000 7f82a6a00640 1 -- 172.21.15.84:0/2075484445 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4067060 con 0x55582a7dd9f0 2024-09-21T07:59:13.778 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:13 smithi084 ceph-mon[30411]: pgmap v642: 129 pgs: 18 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 68 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 50 KiB/s rd, 233 MiB/s wr, 1.63k op/s 2024-09-21T07:59:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.776+0000 7f82a6a00640 1 -- 172.21.15.84:0/2075484445 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f82b4059040 con 0x55582a7dd9f0 2024-09-21T07:59:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.776+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55582ab3ef00 con 0x55582a7dd9f0 2024-09-21T07:59:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.777+0000 7f82a6a00640 1 -- 172.21.15.84:0/2075484445 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f82b4036050 con 0x55582a7dd9f0 2024-09-21T07:59:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.777+0000 7f82ce647740 10 client.27608 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.777+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55582ac4e9d0 con 0x55582a7dd9f0 2024-09-21T07:59:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.777+0000 7f82a6a00640 1 -- 172.21.15.84:0/2075484445 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55582ab3ef00 con 0x55582a7dd9f0 2024-09-21T07:59:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.779+0000 7f82a6a00640 1 -- 172.21.15.84:0/2075484445 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f82b403c520 con 0x55582a7dd9f0 2024-09-21T07:59:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.779+0000 7f82ce647740 10 client.27608 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.779+0000 7f82ce647740 10 client.27608 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T07:59:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.780+0000 7f82ce647740 20 client.27608 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.780+0000 7f82ce647740 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a81f070 0x55582ac50c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.780+0000 7f82ce647740 4 client.27608 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:59:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.780+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55582ab3a9b0 con 0x55582a81f070 2024-09-21T07:59:13.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.780+0000 7f82bfe00640 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a81f070 0x55582ac50c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:13.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.781+0000 7f82bfe00640 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a81f070 0x55582ac50c60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5cb9da24e85b6368 server_cookie=f207dd087c65085b in_seq=0 out_seq=0 2024-09-21T07:59:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.781+0000 7f82a6a00640 10 client.27608 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T07:59:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.782+0000 7f82a6a00640 1 -- 172.21.15.84:0/2075484445 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55582ab3a9b0 con 0x55582a81f070 2024-09-21T07:59:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.782+0000 7f82a6a00640 10 client.27608 handle_command_reply: tid=0 2024-09-21T07:59:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.782+0000 7f82ce647740 1 client.27608 shutdown 2024-09-21T07:59:13.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7dd9f0 msgr2=0x55582abd5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7dd9f0 0x55582abd5e10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009b30 tx=0x7f82b403ca50 comp rx=0 tx=0).stop 2024-09-21T07:59:13.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 shutdown_connections 2024-09-21T07:59:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55582a81f070 0x55582ac50c60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55582a7fe390 0x55582ac4d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55582a7f61b0 0x55582abd6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 --2- 172.21.15.84:0/2075484445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55582a7dd9f0 0x55582abd5e10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.783+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 >> 172.21.15.84:0/2075484445 conn(0x55582a813460 msgr2=0x55582abcfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.784+0000 7f82a6a00640 0 client.27608 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T07:59:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.784+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 shutdown_connections 2024-09-21T07:59:13.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.784+0000 7f82ce647740 1 -- 172.21.15.84:0/2075484445 wait complete. 2024-09-21T07:59:13.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.784+0000 7f82ce647740 20 client.27608 trim_cache size 0 max 16384 2024-09-21T07:59:13.788 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:59:13.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82a80b6880 msgr2=0x7f82a80b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82a80b6880 0x7f82a80b8d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f82b4000c00 tx=0x7f82b4005e70 comp rx=0 tx=0).stop 2024-09-21T07:59:13.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c0110660 msgr2=0x7f82c01214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c0110660 0x7f82c01214a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b970 tx=0x7f82b800be30 comp rx=0 tx=0).stop 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 shutdown_connections 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f82a80b6880 0x7f82a80b8d90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c0110660 0x7f82c01214a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82c010fd10 0x7f82c011c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 --2- 172.21.15.84:0/4082244181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c010a650 0x7f82c011bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.786+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 >> 172.21.15.84:0/4082244181 conn(0x7f82c006e9f0 msgr2=0x7f82c0071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.787+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 shutdown_connections 2024-09-21T07:59:13.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:13.787+0000 7f82c6400640 1 -- 172.21.15.84:0/4082244181 wait complete. 2024-09-21T07:59:13.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:13 smithi162 ceph-mon[34833]: pgmap v642: 129 pgs: 18 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 68 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 50 KiB/s rd, 233 MiB/s wr, 1.63k op/s 2024-09-21T07:59:13.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:13 smithi191 ceph-mon[34667]: pgmap v642: 129 pgs: 18 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 68 active+clean; 57 GiB data, 120 GiB used, 953 GiB / 1.0 TiB avail; 50 KiB/s rd, 233 MiB/s wr, 1.63k op/s 2024-09-21T07:59:15.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:15 smithi162 ceph-mon[34833]: pgmap v643: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 57 GiB data, 119 GiB used, 953 GiB / 1.0 TiB avail; 49 KiB/s rd, 227 MiB/s wr, 1.71k op/s 2024-09-21T07:59:15.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:15 smithi084 ceph-mon[30411]: pgmap v643: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 57 GiB data, 119 GiB used, 953 GiB / 1.0 TiB avail; 49 KiB/s rd, 227 MiB/s wr, 1.71k op/s 2024-09-21T07:59:15.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:15 smithi191 ceph-mon[34667]: pgmap v643: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 57 GiB data, 119 GiB used, 953 GiB / 1.0 TiB avail; 49 KiB/s rd, 227 MiB/s wr, 1.71k op/s 2024-09-21T07:59:17.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T07:59:17.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:17 smithi162 ceph-mon[34833]: pgmap v644: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 56 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 46 KiB/s rd, 214 MiB/s wr, 1.74k op/s 2024-09-21T07:59:17.807 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:17.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:17 smithi084 ceph-mon[30411]: pgmap v644: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 56 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 46 KiB/s rd, 214 MiB/s wr, 1.74k op/s 2024-09-21T07:59:17.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:17 smithi191 ceph-mon[34667]: pgmap v644: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 56 GiB data, 119 GiB used, 954 GiB / 1.0 TiB avail; 46 KiB/s rd, 214 MiB/s wr, 1.74k op/s 2024-09-21T07:59:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.727+0000 7f3adb800640 1 -- 172.21.15.84:0/2621863639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad4111f40 msgr2=0x7f3ad410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.727+0000 7f3adb800640 1 --2- 172.21.15.84:0/2621863639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad4111f40 0x7f3ad410a3c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009900 tx=0x7f3ac802a440 comp rx=0 tx=0).stop 2024-09-21T07:59:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.727+0000 7f3adb800640 1 -- 172.21.15.84:0/2621863639 shutdown_connections 2024-09-21T07:59:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.727+0000 7f3adb800640 1 --2- 172.21.15.84:0/2621863639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad411cc30 0x7f3ad411f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.727+0000 7f3adb800640 1 --2- 172.21.15.84:0/2621863639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ad410a9e0 0x7f3ad410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.727+0000 7f3adb800640 1 --2- 172.21.15.84:0/2621863639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad4111f40 0x7f3ad410a3c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.727+0000 7f3adb800640 1 -- 172.21.15.84:0/2621863639 >> 172.21.15.84:0/2621863639 conn(0x7f3ad4070ec0 msgr2=0x7f3ad40712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.728+0000 7f3adb800640 1 -- 172.21.15.84:0/2621863639 shutdown_connections 2024-09-21T07:59:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.728+0000 7f3adb800640 1 -- 172.21.15.84:0/2621863639 wait complete. 2024-09-21T07:59:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.729+0000 7f3adb800640 1 Processor -- start 2024-09-21T07:59:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.729+0000 7f3adb800640 1 -- start start 2024-09-21T07:59:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.730+0000 7f3adb800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad410a9e0 0x7f3ad41a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.730+0000 7f3adb800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad4111f40 0x7f3ad41a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.730+0000 7f3adb800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ad411cc30 0x7f3ad41aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.730+0000 7f3adb800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad4122960 con 0x7f3ad4111f40 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.730+0000 7f3adb800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad41227e0 con 0x7f3ad411cc30 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.730+0000 7f3adb800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad4122ae0 con 0x7f3ad410a9e0 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad410a9e0 0x7f3ad41a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad410a9e0 0x7f3ad41a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36376/0 (socket says 172.21.15.84:36376) 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad9800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ad411cc30 0x7f3ad41aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad8e00640 1 -- 172.21.15.84:0/926040739 learned_addr learned my addr 172.21.15.84:0/926040739 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad9800640 1 -- 172.21.15.84:0/926040739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad410a9e0 msgr2=0x7f3ad41a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad9800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad410a9e0 0x7f3ad41a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad9800640 1 -- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad4111f40 msgr2=0x7f3ad41a98f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:59:18.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad9800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad4111f40 0x7f3ad41a98f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.731+0000 7f3ad9800640 1 -- 172.21.15.84:0/926040739 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad41af2c0 con 0x7f3ad411cc30 2024-09-21T07:59:18.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.732+0000 7f3ad9800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ad411cc30 0x7f3ad41aeb90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00ca30 tx=0x7f3acc00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.732+0000 7f3ad1600640 1 -- 172.21.15.84:0/926040739 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc007d90 con 0x7f3ad411cc30 2024-09-21T07:59:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.732+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad41af5b0 con 0x7f3ad411cc30 2024-09-21T07:59:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.732+0000 7f3ad1600640 1 -- 172.21.15.84:0/926040739 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3acc005020 con 0x7f3ad411cc30 2024-09-21T07:59:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.732+0000 7f3ad1600640 1 -- 172.21.15.84:0/926040739 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00f690 con 0x7f3ad411cc30 2024-09-21T07:59:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.733+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad41b5d10 con 0x7f3ad411cc30 2024-09-21T07:59:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.740+0000 7f3ae23fa740 1 Processor -- start 2024-09-21T07:59:18.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.743+0000 7f3ad1600640 1 -- 172.21.15.84:0/926040739 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3acc00f830 con 0x7f3ad411cc30 2024-09-21T07:59:18.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.744+0000 7f3ae23fa740 1 -- start start 2024-09-21T07:59:18.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.744+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc059ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.744+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc8a1b0 0x558dbc05a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.744+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc05a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.744+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558dbbfd0fb0 con 0x558dbbcb3070 2024-09-21T07:59:18.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.744+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558dbbfc03e0 con 0x558dbbc92390 2024-09-21T07:59:18.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.744+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558dbbfc41f0 con 0x558dbbc8a1b0 2024-09-21T07:59:18.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.746+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc8a1b0 0x558dbc05a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.746+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc8a1b0 0x558dbc05a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36378/0 (socket says 172.21.15.84:36378) 2024-09-21T07:59:18.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.746+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3317245943 learned_addr learned my addr 172.21.15.84:0/3317245943 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:18.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.746+0000 7f3ad1600640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3abc0b6780 0x7f3abc0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.747+0000 7f3ad1600640 1 -- 172.21.15.84:0/926040739 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f3acc0e7660 con 0x7f3ad411cc30 2024-09-21T07:59:18.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc059ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3317245943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 msgr2=0x558dbc05a620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T07:59:18.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc05a620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad9800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3abc0b6780 0x7f3abc0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3317245943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 msgr2=0x558dbc059ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc059ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3317245943 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbbf8acd0 con 0x558dbbc8a1b0 2024-09-21T07:59:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.748+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc059ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.749+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc8a1b0 0x558dbc05a0e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004360 tx=0x7f3ac8004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b7d46eaed8214f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.750+0000 7f3ac6000640 1 -- 172.21.15.84:0/3317245943 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8035030 con 0x558dbbc8a1b0 2024-09-21T07:59:18.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.750+0000 7f3ac6000640 1 -- 172.21.15.84:0/3317245943 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac8040070 con 0x558dbbc8a1b0 2024-09-21T07:59:18.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.750+0000 7f3ac6000640 1 -- 172.21.15.84:0/3317245943 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8045d30 con 0x558dbbc8a1b0 2024-09-21T07:59:18.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.751+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3317245943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc8a1b0 msgr2=0x558dbc05a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.751+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc8a1b0 0x558dbc05a0e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004360 tx=0x7f3ac8004390 comp rx=0 tx=0).stop 2024-09-21T07:59:18.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.751+0000 7f3ad9800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3abc0b6780 0x7f3abc0b8c90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0aa300 tx=0x7f3acc0a9760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.752+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3317245943 shutdown_connections 2024-09-21T07:59:18.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.752+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc05a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.752+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc8a1b0 0x558dbc05a0e0 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004360 tx=0x7f3ac8004390 comp rx=0 tx=0).stop 2024-09-21T07:59:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.752+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3317245943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc059ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.752+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3317245943 >> 172.21.15.84:0/3317245943 conn(0x558dbbca7460 msgr2=0x558dbc057a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.752+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3317245943 shutdown_connections 2024-09-21T07:59:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.752+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3317245943 wait complete. 2024-09-21T07:59:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.753+0000 7f3ae23fa740 1 -- start start 2024-09-21T07:59:18.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.753+0000 7f3ae23fa740 1 Processor -- start 2024-09-21T07:59:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc92390 0x558dbc065950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc065f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc719f0 0x558dbc06b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558dbbe21700 con 0x558dbbc92390 2024-09-21T07:59:18.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558dbbf5b580 con 0x558dbbc719f0 2024-09-21T07:59:18.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558dbc068320 con 0x558dbbcb3070 2024-09-21T07:59:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ae23fa740 10 client.0 _ll_register_callbacks cb 0x558dbbf6b470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.754+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc065f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc92390 0x558dbc065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc065f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36394/0 (socket says 172.21.15.84:36394) 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3731826691 learned_addr learned my addr 172.21.15.84:0/3731826691 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc719f0 0x558dbc06b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc719f0 msgr2=0x558dbc06b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc719f0 0x558dbc06b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3731826691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc92390 msgr2=0x558dbc065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc92390 0x558dbc065950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.755+0000 7f3ad8e00640 1 -- 172.21.15.84:0/3731826691 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dbbd1e650 con 0x558dbbcb3070 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.756+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc065f30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009530 tx=0x7f3ac8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e5aad900d083298 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.756+0000 7f3abaa00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.757+0000 7f3abaa00640 1 -- 172.21.15.84:0/3731826691 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8063060 con 0x558dbbcb3070 2024-09-21T07:59:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.757+0000 7f3abaa00640 1 -- 172.21.15.84:0/3731826691 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f3ac80035f0 con 0x558dbbcb3070 2024-09-21T07:59:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.757+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558dbbf5db90 con 0x558dbbcb3070 2024-09-21T07:59:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.757+0000 7f3abaa00640 1 -- 172.21.15.84:0/3731826691 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ac806a050 con 0x558dbbcb3070 2024-09-21T07:59:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.757+0000 7f3ae23fa740 10 client.27628 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.757+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558dbbf78950 con 0x558dbbcb3070 2024-09-21T07:59:18.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.757+0000 7f3abaa00640 1 -- 172.21.15.84:0/3731826691 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558dbbf5db90 con 0x558dbbcb3070 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.758+0000 7f3abaa00640 1 -- 172.21.15.84:0/3731826691 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3ac803c9a0 con 0x558dbbcb3070 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.758+0000 7f3ae23fa740 10 client.27628 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.758+0000 7f3ae23fa740 10 client.27628 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.758+0000 7f3ae23fa740 20 client.27628 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.758+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbbc46da0 0x558dbc077600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.758+0000 7f3ae23fa740 4 client.27628 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.758+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558dbbfd2f00 con 0x558dbbc46da0 2024-09-21T07:59:18.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.759+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbbc46da0 0x558dbc077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.760+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbbc46da0 0x558dbc077600 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5e1995194ab28cfe server_cookie=4067417a745ba3ec in_seq=0 out_seq=0 2024-09-21T07:59:18.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.760+0000 7f3abaa00640 10 client.27628 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:59:18.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.761+0000 7f3abaa00640 1 -- 172.21.15.84:0/3731826691 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558dbbfd2f00 con 0x558dbbc46da0 2024-09-21T07:59:18.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.761+0000 7f3abaa00640 10 client.27628 handle_command_reply: tid=0 2024-09-21T07:59:18.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.761+0000 7f3ae23fa740 1 client.27628 shutdown 2024-09-21T07:59:18.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 msgr2=0x558dbc065f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc065f30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009530 tx=0x7f3ac8009260 comp rx=0 tx=0).stop 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 shutdown_connections 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbbc46da0 0x558dbc077600 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc719f0 0x558dbc06b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc065f30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3abaa00640 0 client.27628 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/3731826691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc92390 0x558dbc065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 >> 172.21.15.84:0/3731826691 conn(0x558dbbca7460 msgr2=0x558dbc05ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 shutdown_connections 2024-09-21T07:59:18.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 1 -- 172.21.15.84:0/3731826691 wait complete. 2024-09-21T07:59:18.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.762+0000 7f3ae23fa740 20 client.27628 trim_cache size 0 max 16384 2024-09-21T07:59:18.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.790+0000 7f3ae23fa740 1 Processor -- start 2024-09-21T07:59:18.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.791+0000 7f3ae23fa740 1 -- start start 2024-09-21T07:59:18.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.791+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc719f0 0x558dbc0573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.791+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc0578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.791+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc05ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.791+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad41b97c0 con 0x558dbbcb3070 2024-09-21T07:59:18.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.791+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad41b75b0 con 0x558dbbc92390 2024-09-21T07:59:18.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.791+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad41b90f0 con 0x558dbbc719f0 2024-09-21T07:59:18.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.792+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc0578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.792+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc719f0 0x558dbc0573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.792+0000 7f3ad8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc0578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53668/0 (socket says 172.21.15.84:53668) 2024-09-21T07:59:18.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.792+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc719f0 0x558dbc0573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36410/0 (socket says 172.21.15.84:36410) 2024-09-21T07:59:18.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.792+0000 7f3ad8e00640 1 -- 172.21.15.84:0/583814945 learned_addr learned my addr 172.21.15.84:0/583814945 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.793+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc05ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.793+0000 7f3ad3e00640 1 -- 172.21.15.84:0/583814945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 msgr2=0x558dbc0578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.793+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc0578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.793+0000 7f3ad3e00640 1 -- 172.21.15.84:0/583814945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 msgr2=0x558dbc05ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.793+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc05ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.793+0000 7f3ad3e00640 1 -- 172.21.15.84:0/583814945 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dbc064f70 con 0x558dbbc719f0 2024-09-21T07:59:18.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.794+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc719f0 0x558dbc0573b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x558dbbfd1100 tx=0x7f3ac0004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2358b1ec9ad85e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.794+0000 7f3ac5600640 1 -- 172.21.15.84:0/583814945 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0026070 con 0x558dbbc719f0 2024-09-21T07:59:18.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.795+0000 7f3ac5600640 1 -- 172.21.15.84:0/583814945 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac0016b70 con 0x558dbbc719f0 2024-09-21T07:59:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.795+0000 7f3ac5600640 1 -- 172.21.15.84:0/583814945 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000f040 con 0x558dbbc719f0 2024-09-21T07:59:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.796+0000 7f3ae23fa740 1 -- 172.21.15.84:0/583814945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc719f0 msgr2=0x558dbc0573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.796+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc719f0 0x558dbc0573b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x558dbbfd1100 tx=0x7f3ac0004700 comp rx=0 tx=0).stop 2024-09-21T07:59:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.796+0000 7f3ae23fa740 1 -- 172.21.15.84:0/583814945 shutdown_connections 2024-09-21T07:59:18.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.796+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbcb3070 0x558dbc05ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.796+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc0578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.796+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/583814945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbc719f0 0x558dbc0573b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.796+0000 7f3ae23fa740 1 -- 172.21.15.84:0/583814945 >> 172.21.15.84:0/583814945 conn(0x558dbbca7460 msgr2=0x558dbc063fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.797+0000 7f3ae23fa740 1 -- 172.21.15.84:0/583814945 shutdown_connections 2024-09-21T07:59:18.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.797+0000 7f3ae23fa740 1 -- 172.21.15.84:0/583814945 wait complete. 2024-09-21T07:59:18.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.798+0000 7f3ae23fa740 1 -- start start 2024-09-21T07:59:18.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.798+0000 7f3ae23fa740 1 Processor -- start 2024-09-21T07:59:18.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.799+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc719f0 0x558dbc06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.799+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc06e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.799+0000 7f3ae23fa740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc0dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.799+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad41b8350 con 0x558dbbc719f0 2024-09-21T07:59:18.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.799+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad41b7c80 con 0x558dbbc92390 2024-09-21T07:59:18.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.799+0000 7f3ae23fa740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad41b8a20 con 0x558dbbcb3070 2024-09-21T07:59:18.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.799+0000 7f3ae23fa740 10 client.0 _ll_register_callbacks cb 0x7f3ac8004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:18.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.800+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc719f0 0x558dbc06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.800+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc719f0 0x558dbc06e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40360/0 (socket says 172.21.15.84:40360) 2024-09-21T07:59:18.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.801+0000 7f3ad3e00640 1 -- 172.21.15.84:0/1597193823 learned_addr learned my addr 172.21.15.84:0/1597193823 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:18.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.801+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc0dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.801+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc06e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.801+0000 7f3ad3e00640 1 -- 172.21.15.84:0/1597193823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 msgr2=0x558dbc0dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:18.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.801+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc0dad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.802+0000 7f3ad3e00640 1 -- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 msgr2=0x558dbc06e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:18.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.802+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc06e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.802+0000 7f3ad3e00640 1 -- 172.21.15.84:0/1597193823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dbc05bae0 con 0x558dbbc719f0 2024-09-21T07:59:18.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.802+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc06e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:18.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.803+0000 7f3ad3e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc719f0 0x558dbc06e240 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000e9a0 tx=0x7f3ac0016860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7e668b49046f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:18.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.803+0000 7f3abaa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:18.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.804+0000 7f3abaa00640 1 -- 172.21.15.84:0/1597193823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0026070 con 0x558dbbc719f0 2024-09-21T07:59:18.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.804+0000 7f3abaa00640 1 -- 172.21.15.84:0/1597193823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f3ac0004220 con 0x558dbbc719f0 2024-09-21T07:59:18.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.805+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac0016b70 con 0x558dbbc719f0 2024-09-21T07:59:18.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.805+0000 7f3abaa00640 1 -- 172.21.15.84:0/1597193823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ac0022030 con 0x558dbbc719f0 2024-09-21T07:59:18.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.805+0000 7f3ae23fa740 10 client.17262 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:18.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.805+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558dbc0e2530 con 0x558dbbc719f0 2024-09-21T07:59:18.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.806+0000 7f3abaa00640 1 -- 172.21.15.84:0/1597193823 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac0016b70 con 0x558dbbc719f0 2024-09-21T07:59:18.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.806+0000 7f3abaa00640 1 -- 172.21.15.84:0/1597193823 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f3ac0015040 con 0x558dbbc719f0 2024-09-21T07:59:18.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.806+0000 7f3ae23fa740 10 client.17262 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:18.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.806+0000 7f3ae23fa740 10 client.17262 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T07:59:18.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.806+0000 7f3ae23fa740 20 client.17262 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:18.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.806+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbc0e2b30 0x558dbc0e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:18.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.807+0000 7f3ae23fa740 4 client.17262 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:59:18.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.807+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558dbbfce9b0 con 0x558dbc0e2b30 2024-09-21T07:59:18.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.807+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbc0e2b30 0x558dbc0e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:18.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.808+0000 7f3ad8e00640 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbc0e2b30 0x558dbc0e4f50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=939f634d3be53ca server_cookie=37d3adcf7522290b in_seq=0 out_seq=0 2024-09-21T07:59:18.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.808+0000 7f3abaa00640 10 client.17262 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T07:59:18.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.809+0000 7f3abaa00640 1 -- 172.21.15.84:0/1597193823 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558dbbfce9b0 con 0x558dbc0e2b30 2024-09-21T07:59:18.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.809+0000 7f3abaa00640 10 client.17262 handle_command_reply: tid=0 2024-09-21T07:59:18.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.810+0000 7f3ae23fa740 1 client.17262 shutdown 2024-09-21T07:59:18.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.812+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc719f0 msgr2=0x558dbc06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.812+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc719f0 0x558dbc06e240 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000e9a0 tx=0x7f3ac0016860 comp rx=0 tx=0).stop 2024-09-21T07:59:18.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.813+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 shutdown_connections 2024-09-21T07:59:18.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.813+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x558dbc0e2b30 0x558dbc0e4f50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.813+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558dbbcb3070 0x558dbc0dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.813+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558dbbc92390 0x558dbc06e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.813+0000 7f3ae23fa740 1 --2- 172.21.15.84:0/1597193823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558dbbc719f0 0x558dbc06e240 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.813+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 >> 172.21.15.84:0/1597193823 conn(0x558dbbca7460 msgr2=0x558dbc0573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.814+0000 7f3abaa00640 0 client.17262 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T07:59:18.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.814+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 shutdown_connections 2024-09-21T07:59:18.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.814+0000 7f3ae23fa740 1 -- 172.21.15.84:0/1597193823 wait complete. 2024-09-21T07:59:18.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.814+0000 7f3ae23fa740 20 client.17262 trim_cache size 0 max 16384 2024-09-21T07:59:18.817 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3abc0b6780 msgr2=0x7f3abc0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3abc0b6780 0x7f3abc0b8c90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0aa300 tx=0x7f3acc0a9760 comp rx=0 tx=0).stop 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ad411cc30 msgr2=0x7f3ad41aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ad411cc30 0x7f3ad41aeb90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00ca30 tx=0x7f3acc00cef0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 shutdown_connections 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f3abc0b6780 0x7f3abc0b8c90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ad411cc30 0x7f3ad41aeb90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad4111f40 0x7f3ad41a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 --2- 172.21.15.84:0/926040739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad410a9e0 0x7f3ad41a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:18.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 >> 172.21.15.84:0/926040739 conn(0x7f3ad4070ec0 msgr2=0x7f3ad4071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:18.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 shutdown_connections 2024-09-21T07:59:18.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:18.816+0000 7f3adb800640 1 -- 172.21.15.84:0/926040739 wait complete. 2024-09-21T07:59:19.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T07:59:19.704 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:19 smithi084 ceph-mon[30411]: pgmap v645: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 47 KiB/s rd, 243 MiB/s wr, 2.03k op/s 2024-09-21T07:59:19.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:19 smithi162 ceph-mon[34833]: pgmap v645: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 47 KiB/s rd, 243 MiB/s wr, 2.03k op/s 2024-09-21T07:59:19.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:19 smithi191 ceph-mon[34667]: pgmap v645: 129 pgs: 20 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 60 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 47 KiB/s rd, 243 MiB/s wr, 2.03k op/s 2024-09-21T07:59:20.298 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:21.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:21 smithi084 ceph-mon[30411]: pgmap v646: 129 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 77 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 41 KiB/s rd, 239 MiB/s wr, 2.02k op/s 2024-09-21T07:59:21.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:21 smithi191 ceph-mon[34667]: pgmap v646: 129 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 77 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 41 KiB/s rd, 239 MiB/s wr, 2.02k op/s 2024-09-21T07:59:22.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:21 smithi162 ceph-mon[34833]: pgmap v646: 129 pgs: 16 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 77 active+clean; 56 GiB data, 118 GiB used, 955 GiB / 1.0 TiB avail; 41 KiB/s rd, 239 MiB/s wr, 2.02k op/s 2024-09-21T07:59:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 -- 172.21.15.84:0/2346539536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6641094c0 msgr2=0x7ff6641098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 --2- 172.21.15.84:0/2346539536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6641094c0 0x7ff6641098d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff650009900 tx=0x7ff65002a410 comp rx=0 tx=0).stop 2024-09-21T07:59:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 -- 172.21.15.84:0/2346539536 shutdown_connections 2024-09-21T07:59:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 --2- 172.21.15.84:0/2346539536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff664109e10 0x7ff664110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 --2- 172.21.15.84:0/2346539536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6641094c0 0x7ff6641098d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 --2- 172.21.15.84:0/2346539536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff664103b80 0x7ff664103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 -- 172.21.15.84:0/2346539536 >> 172.21.15.84:0/2346539536 conn(0x7ff6640ff590 msgr2=0x7ff6641019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 -- 172.21.15.84:0/2346539536 shutdown_connections 2024-09-21T07:59:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.570+0000 7ff669a00640 1 -- 172.21.15.84:0/2346539536 wait complete. 2024-09-21T07:59:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.571+0000 7ff669a00640 1 Processor -- start 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.571+0000 7ff669a00640 1 -- start start 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff669a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff664103b80 0x7ff66419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff669a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6641094c0 0x7ff66419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff669a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff664109e10 0x7ff6641a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff669a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff664113b20 con 0x7ff664103b80 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff669a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641139a0 con 0x7ff6641094c0 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff669a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff664113ca0 con 0x7ff664109e10 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff662a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff664103b80 0x7ff66419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff662a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff664103b80 0x7ff66419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40382/0 (socket says 172.21.15.84:40382) 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff662a00640 1 -- 172.21.15.84:0/1832719490 learned_addr learned my addr 172.21.15.84:0/1832719490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff663400640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff664109e10 0x7ff6641a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.572+0000 7ff662000640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6641094c0 0x7ff66419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff662a00640 1 -- 172.21.15.84:0/1832719490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff664109e10 msgr2=0x7ff6641a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff662a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff664109e10 0x7ff6641a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff662a00640 1 -- 172.21.15.84:0/1832719490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6641094c0 msgr2=0x7ff66419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff662a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6641094c0 0x7ff66419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff662a00640 1 -- 172.21.15.84:0/1832719490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6641a2680 con 0x7ff664103b80 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff662a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff664103b80 0x7ff66419c710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff65400d950 tx=0x7ff65400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff65b400640 1 -- 172.21.15.84:0/1832719490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654017070 con 0x7ff664103b80 2024-09-21T07:59:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff65b400640 1 -- 172.21.15.84:0/1832719490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff654009c30 con 0x7ff664103b80 2024-09-21T07:59:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6641a2970 con 0x7ff664103b80 2024-09-21T07:59:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff65b400640 1 -- 172.21.15.84:0/1832719490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65400f620 con 0x7ff664103b80 2024-09-21T07:59:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.573+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641a90d0 con 0x7ff664103b80 2024-09-21T07:59:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.577+0000 7ff670683740 1 Processor -- start 2024-09-21T07:59:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.577+0000 7ff670683740 1 -- start start 2024-09-21T07:59:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.577+0000 7ff65b400640 1 -- 172.21.15.84:0/1832719490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff654010460 con 0x7ff664103b80 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff670683740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd878dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff670683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff670683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd878e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff670683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562cd8704fb0 con 0x562cd83c6390 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff670683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562cd86f43e0 con 0x562cd83be1b0 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff670683740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562cd86f81f0 con 0x562cd83e7070 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff662000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd878e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff663400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd878dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff662a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff663400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd878dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36436/0 (socket says 172.21.15.84:36436) 2024-09-21T07:59:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff663400640 1 -- 172.21.15.84:0/131970440 learned_addr learned my addr 172.21.15.84:0/131970440 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.578+0000 7ff662000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd878e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40386/0 (socket says 172.21.15.84:40386) 2024-09-21T07:59:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff663400640 1 -- 172.21.15.84:0/131970440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 msgr2=0x562cd878e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff663400640 1 --2- 172.21.15.84:0/131970440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff663400640 1 -- 172.21.15.84:0/131970440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 msgr2=0x562cd878e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff663400640 1 --2- 172.21.15.84:0/131970440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd878e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff663400640 1 -- 172.21.15.84:0/131970440 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd86becd0 con 0x562cd83e7070 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff663400640 1 --2- 172.21.15.84:0/131970440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd878dda0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0039f0 tx=0x7ff65c003eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dfd627c94a6389d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff65b400640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6480b6680 0x7ff6480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff64fe00640 1 -- 172.21.15.84:0/131970440 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c01a470 con 0x562cd83e7070 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff64fe00640 1 -- 172.21.15.84:0/131970440 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff65c015070 con 0x562cd83e7070 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff64fe00640 1 -- 172.21.15.84:0/131970440 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c010780 con 0x562cd83e7070 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.579+0000 7ff65b400640 1 -- 172.21.15.84:0/1832719490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7ff6540e7700 con 0x7ff664103b80 2024-09-21T07:59:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.580+0000 7ff662a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6480b6680 0x7ff6480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff662a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6480b6680 0x7ff6480b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x562cd878ca20 tx=0x7ff6540b4f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 -- 172.21.15.84:0/131970440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 msgr2=0x562cd878dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 --2- 172.21.15.84:0/131970440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd878dda0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0039f0 tx=0x7ff65c003eb0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 -- 172.21.15.84:0/131970440 shutdown_connections 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 --2- 172.21.15.84:0/131970440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd878e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 --2- 172.21.15.84:0/131970440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 --2- 172.21.15.84:0/131970440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd878dda0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 -- 172.21.15.84:0/131970440 >> 172.21.15.84:0/131970440 conn(0x562cd83db460 msgr2=0x562cd878bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 -- 172.21.15.84:0/131970440 shutdown_connections 2024-09-21T07:59:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 -- 172.21.15.84:0/131970440 wait complete. 2024-09-21T07:59:22.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.581+0000 7ff670683740 1 -- start start 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 1 Processor -- start 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd8799540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd8799a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83e7070 0x562cd87a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562cd8555700 con 0x562cd83c6390 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562cd868f580 con 0x562cd83e7070 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562cd879c580 con 0x562cd83be1b0 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.582+0000 7ff670683740 10 client.0 _ll_register_callbacks cb 0x562cd869f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd8799a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd8799a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40400/0 (socket says 172.21.15.84:40400) 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 -- 172.21.15.84:0/698382429 learned_addr learned my addr 172.21.15.84:0/698382429 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff663400640 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd8799540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff663400640 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83e7070 0x562cd87a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 -- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 msgr2=0x562cd8799540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd8799540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 -- 172.21.15.84:0/698382429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83e7070 msgr2=0x562cd87a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83e7070 0x562cd87a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 -- 172.21.15.84:0/698382429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd8452650 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff662000640 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd8799a80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff650005ab0 tx=0x7ff650004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e959844642b7f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.583+0000 7ff64cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.584+0000 7ff64cc00640 1 -- 172.21.15.84:0/698382429 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650035040 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.584+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562cd8691b90 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.584+0000 7ff64cc00640 1 -- 172.21.15.84:0/698382429 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7ff650005590 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.584+0000 7ff64cc00640 1 -- 172.21.15.84:0/698382429 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff650004750 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.584+0000 7ff670683740 10 client.17274 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.584+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562cd86ac950 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.584+0000 7ff64cc00640 1 -- 172.21.15.84:0/698382429 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562cd8691b90 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff64cc00640 1 -- 172.21.15.84:0/698382429 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff650003af0 con 0x562cd83c6390 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff670683740 10 client.17274 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff670683740 10 client.17274 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:59:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff670683740 20 client.17274 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff670683740 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd83a59f0 0x562cd87ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff670683740 4 client.17274 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cd8706f00 con 0x562cd83a59f0 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff663400640 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd83a59f0 0x562cd87ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff663400640 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd83a59f0 0x562cd87ab7b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8024b93bd5a1341 server_cookie=82a582fff5e32f8e in_seq=0 out_seq=0 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.585+0000 7ff64cc00640 10 client.17274 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.586+0000 7ff64cc00640 1 -- 172.21.15.84:0/698382429 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cd8706f00 con 0x562cd83a59f0 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.586+0000 7ff64cc00640 10 client.17274 handle_command_reply: tid=0 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.586+0000 7ff670683740 1 client.17274 shutdown 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 msgr2=0x562cd8799a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd8799a80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff650005ab0 tx=0x7ff650004510 comp rx=0 tx=0).stop 2024-09-21T07:59:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 shutdown_connections 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd83a59f0 0x562cd87ab7b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83e7070 0x562cd87a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83c6390 0x562cd8799a80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 --2- 172.21.15.84:0/698382429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd8799540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff64cc00640 0 client.17274 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 >> 172.21.15.84:0/698382429 conn(0x562cd83db460 msgr2=0x562cd8790f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 shutdown_connections 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 1 -- 172.21.15.84:0/698382429 wait complete. 2024-09-21T07:59:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.587+0000 7ff670683740 20 client.17274 trim_cache size 0 max 16384 2024-09-21T07:59:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.601+0000 7ff670683740 1 Processor -- start 2024-09-21T07:59:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.601+0000 7ff670683740 1 -- start start 2024-09-21T07:59:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.601+0000 7ff670683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.601+0000 7ff670683740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd87a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.601+0000 7ff670683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd837ada0 0x562cd87a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff670683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641b31a0 con 0x562cd837ada0 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff670683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641b4ce0 con 0x562cd83be1b0 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff670683740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641b3870 con 0x562cd83e7070 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff663400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd837ada0 0x562cd87a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd87a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd87a57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36464/0 (socket says 172.21.15.84:36464) 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff663400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd837ada0 0x562cd87a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40404/0 (socket says 172.21.15.84:40404) 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 -- 172.21.15.84:0/1554438209 learned_addr learned my addr 172.21.15.84:0/1554438209 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff663400640 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 -- 172.21.15.84:0/1554438209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 msgr2=0x562cd878bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 -- 172.21.15.84:0/1554438209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd837ada0 msgr2=0x562cd87a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd837ada0 0x562cd87a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff662000640 1 -- 172.21.15.84:0/1554438209 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd879a800 con 0x562cd83e7070 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.602+0000 7ff663400640 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.603+0000 7ff662000640 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd87a57d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff650005f70 tx=0x7ff650031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf57f9eff46a6e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.603+0000 7ff64f400640 1 -- 172.21.15.84:0/1554438209 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650035070 con 0x562cd83e7070 2024-09-21T07:59:22.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.603+0000 7ff64f400640 1 -- 172.21.15.84:0/1554438209 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff650041070 con 0x562cd83e7070 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.603+0000 7ff64f400640 1 -- 172.21.15.84:0/1554438209 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500048f0 con 0x562cd83e7070 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 -- 172.21.15.84:0/1554438209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 msgr2=0x562cd87a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd87a57d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff650005f70 tx=0x7ff650031400 comp rx=0 tx=0).stop 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 -- 172.21.15.84:0/1554438209 shutdown_connections 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd837ada0 0x562cd87a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83e7070 0x562cd87a57d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 --2- 172.21.15.84:0/1554438209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd83be1b0 0x562cd878bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 -- 172.21.15.84:0/1554438209 >> 172.21.15.84:0/1554438209 conn(0x562cd83db460 msgr2=0x562cd878b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 -- 172.21.15.84:0/1554438209 shutdown_connections 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 -- 172.21.15.84:0/1554438209 wait complete. 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.604+0000 7ff670683740 1 -- start start 2024-09-21T07:59:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 1 Processor -- start 2024-09-21T07:59:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd837ada0 0x562cd879db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd879e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83e7070 0x562cd8815170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641b4610 con 0x562cd83e7070 2024-09-21T07:59:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641b3f40 con 0x562cd837ada0 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641b1180 con 0x562cd83be1b0 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.605+0000 7ff670683740 10 client.0 _ll_register_callbacks cb 0x7ff6500041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd879e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd879e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36478/0 (socket says 172.21.15.84:36478) 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff663400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83e7070 0x562cd8815170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 -- 172.21.15.84:0/2598634455 learned_addr learned my addr 172.21.15.84:0/2598634455 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff663400640 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd837ada0 0x562cd879db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 -- 172.21.15.84:0/2598634455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd837ada0 msgr2=0x562cd879db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd837ada0 0x562cd879db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 -- 172.21.15.84:0/2598634455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83e7070 msgr2=0x562cd8815170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83e7070 0x562cd8815170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 -- 172.21.15.84:0/2598634455 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd879e990 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff662000640 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd879e0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff650003f80 tx=0x7ff650005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9b7e15d67919f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.606+0000 7ff64cc00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.607+0000 7ff64cc00640 1 -- 172.21.15.84:0/2598634455 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650060020 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.607+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff650041070 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.607+0000 7ff64cc00640 1 -- 172.21.15.84:0/2598634455 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7ff650031c30 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.607+0000 7ff64cc00640 1 -- 172.21.15.84:0/2598634455 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff650068050 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.607+0000 7ff670683740 10 client.27652 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.607+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562cd8816760 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.607+0000 7ff64cc00640 1 -- 172.21.15.84:0/2598634455 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff650041070 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff64cc00640 1 -- 172.21.15.84:0/2598634455 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff6500038f0 con 0x562cd83be1b0 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff670683740 10 client.27652 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff670683740 10 client.27652 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T07:59:22.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff670683740 20 client.27652 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff670683740 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd8816e80 0x562cd88192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff670683740 4 client.27652 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cd87029b0 con 0x562cd8816e80 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.608+0000 7ff663400640 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd8816e80 0x562cd88192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff663400640 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd8816e80 0x562cd88192a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea5034d5c63c48b2 server_cookie=c8a83478137d7af in_seq=0 out_seq=0 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff64cc00640 10 client.27652 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff64cc00640 1 -- 172.21.15.84:0/2598634455 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cd87029b0 con 0x562cd8816e80 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff64cc00640 10 client.27652 handle_command_reply: tid=0 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 client.27652 shutdown 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 msgr2=0x562cd879e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd879e0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff650003f80 tx=0x7ff650005d50 comp rx=0 tx=0).stop 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 shutdown_connections 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x562cd8816e80 0x562cd88192a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562cd83e7070 0x562cd8815170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cd83be1b0 0x562cd879e0a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 --2- 172.21.15.84:0/2598634455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562cd837ada0 0x562cd879db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 >> 172.21.15.84:0/2598634455 conn(0x562cd83db460 msgr2=0x562cd8790ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff64cc00640 0 client.27652 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 shutdown_connections 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.609+0000 7ff670683740 1 -- 172.21.15.84:0/2598634455 wait complete. 2024-09-21T07:59:22.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff670683740 20 client.27652 trim_cache size 0 max 16384 2024-09-21T07:59:22.614 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:59:22.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6480b6680 msgr2=0x7ff6480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6480b6680 0x7ff6480b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x562cd878ca20 tx=0x7ff6540b4f90 comp rx=0 tx=0).stop 2024-09-21T07:59:22.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff664103b80 msgr2=0x7ff66419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff664103b80 0x7ff66419c710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff65400d950 tx=0x7ff65400de10 comp rx=0 tx=0).stop 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 shutdown_connections 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff6480b6680 0x7ff6480b8b90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff664109e10 0x7ff6641a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6641094c0 0x7ff66419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 --2- 172.21.15.84:0/1832719490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff664103b80 0x7ff66419c710 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 >> 172.21.15.84:0/1832719490 conn(0x7ff6640ff590 msgr2=0x7ff6641029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.610+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 shutdown_connections 2024-09-21T07:59:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:22.611+0000 7ff669a00640 1 -- 172.21.15.84:0/1832719490 wait complete. 2024-09-21T07:59:23.891 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:23 smithi084 ceph-mon[30411]: pgmap v647: 129 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 113 active+clean; 54 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 54 KiB/s rd, 225 MiB/s wr, 1.91k op/s 2024-09-21T07:59:23.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:23 smithi191 ceph-mon[34667]: pgmap v647: 129 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 113 active+clean; 54 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 54 KiB/s rd, 225 MiB/s wr, 1.91k op/s 2024-09-21T07:59:24.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:23 smithi162 ceph-mon[34833]: pgmap v647: 129 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 113 active+clean; 54 GiB data, 115 GiB used, 958 GiB / 1.0 TiB avail; 54 KiB/s rd, 225 MiB/s wr, 1.91k op/s 2024-09-21T07:59:24.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T07:59:24.739 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 -- 172.21.15.84:0/1065215154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc541092d0 msgr2=0x7fbc541096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/1065215154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc541092d0 0x7fbc541096e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009900 tx=0x7fbc4002a410 comp rx=0 tx=0).stop 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 -- 172.21.15.84:0/1065215154 shutdown_connections 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/1065215154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc54109c20 0x7fbc54110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/1065215154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc541092d0 0x7fbc541096e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/1065215154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc54103990 0x7fbc54103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 -- 172.21.15.84:0/1065215154 >> 172.21.15.84:0/1065215154 conn(0x7fbc540ff3e0 msgr2=0x7fbc54101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 -- 172.21.15.84:0/1065215154 shutdown_connections 2024-09-21T07:59:25.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.487+0000 7fbc5aa00640 1 -- 172.21.15.84:0/1065215154 wait complete. 2024-09-21T07:59:25.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.488+0000 7fbc5aa00640 1 Processor -- start 2024-09-21T07:59:25.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.488+0000 7fbc5aa00640 1 -- start start 2024-09-21T07:59:25.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.488+0000 7fbc5aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc54103990 0x7fbc54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc541092d0 0x7fbc54075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc54109c20 0x7fbc54076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5aa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54113930 con 0x7fbc54109c20 2024-09-21T07:59:25.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5aa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541137b0 con 0x7fbc541092d0 2024-09-21T07:59:25.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5aa00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54113ab0 con 0x7fbc54103990 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc54109c20 0x7fbc54076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc58c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc541092d0 0x7fbc54075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc54109c20 0x7fbc54076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40434/0 (socket says 172.21.15.84:40434) 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc5a000640 1 -- 172.21.15.84:0/2815613293 learned_addr learned my addr 172.21.15.84:0/2815613293 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc59600640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc54103990 0x7fbc54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc58c00640 1 -- 172.21.15.84:0/2815613293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc54103990 msgr2=0x7fbc54075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc58c00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc54103990 0x7fbc54075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc58c00640 1 -- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc54109c20 msgr2=0x7fbc54076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc58c00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc54109c20 0x7fbc54076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.489+0000 7fbc58c00640 1 -- 172.21.15.84:0/2815613293 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc541a8640 con 0x7fbc541092d0 2024-09-21T07:59:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.490+0000 7fbc58c00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc541092d0 0x7fbc54075c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009230 tx=0x7fbc40003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.490+0000 7fbc52000640 1 -- 172.21.15.84:0/2815613293 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4003f070 con 0x7fbc541092d0 2024-09-21T07:59:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.490+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc541a88d0 con 0x7fbc541092d0 2024-09-21T07:59:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.490+0000 7fbc52000640 1 -- 172.21.15.84:0/2815613293 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc40031b50 con 0x7fbc541092d0 2024-09-21T07:59:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.490+0000 7fbc52000640 1 -- 172.21.15.84:0/2815613293 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40035030 con 0x7fbc541092d0 2024-09-21T07:59:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.490+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc541a8dd0 con 0x7fbc541092d0 2024-09-21T07:59:25.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.494+0000 7fbc62c4a740 1 Processor -- start 2024-09-21T07:59:25.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.494+0000 7fbc62c4a740 1 -- start start 2024-09-21T07:59:25.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54361d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54362270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c543627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563c542d8fb0 con 0x563c53f9a390 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563c542c83e0 con 0x563c53fbb070 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563c542cc1f0 con 0x563c53f921b0 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc5a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54361d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc5a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54361d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53752/0 (socket says 172.21.15.84:53752) 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc5a000640 1 -- 172.21.15.84:0/201582441 learned_addr learned my addr 172.21.15.84:0/201582441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc59600640 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54362270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc52000640 1 -- 172.21.15.84:0/2815613293 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbc40042070 con 0x7fbc541092d0 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc5a000640 1 -- 172.21.15.84:0/201582441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 msgr2=0x563c54362270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc5a000640 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54362270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.495+0000 7fbc5a000640 1 -- 172.21.15.84:0/201582441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 msgr2=0x563c543627b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:59:25.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.496+0000 7fbc5a000640 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c543627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.496+0000 7fbc5a000640 1 -- 172.21.15.84:0/201582441 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c54292cd0 con 0x563c53fbb070 2024-09-21T07:59:25.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.496+0000 7fbc5a000640 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54361d30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c011470 tx=0x7fbc4c011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b8412a289d1108 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:25.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.496+0000 7fbc46600640 1 -- 172.21.15.84:0/201582441 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c004b20 con 0x563c53fbb070 2024-09-21T07:59:25.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.496+0000 7fbc46600640 1 -- 172.21.15.84:0/201582441 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc4c004cc0 con 0x563c53fbb070 2024-09-21T07:59:25.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.496+0000 7fbc46600640 1 -- 172.21.15.84:0/201582441 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c005310 con 0x563c53fbb070 2024-09-21T07:59:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.497+0000 7fbc62c4a740 1 -- 172.21.15.84:0/201582441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 msgr2=0x563c54361d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.497+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54361d30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c011470 tx=0x7fbc4c011930 comp rx=0 tx=0).stop 2024-09-21T07:59:25.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.497+0000 7fbc62c4a740 1 -- 172.21.15.84:0/201582441 shutdown_connections 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.497+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c543627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.497+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54362270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.497+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/201582441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54361d30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.497+0000 7fbc62c4a740 1 -- 172.21.15.84:0/201582441 >> 172.21.15.84:0/201582441 conn(0x563c53faf460 msgr2=0x563c5435fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.498+0000 7fbc62c4a740 1 -- 172.21.15.84:0/201582441 shutdown_connections 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.498+0000 7fbc62c4a740 1 -- 172.21.15.84:0/201582441 wait complete. 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.498+0000 7fbc52000640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc3c0b6590 0x7fbc3c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.498+0000 7fbc52000640 1 -- 172.21.15.84:0/2815613293 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7fbc401080c0 con 0x7fbc541092d0 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.498+0000 7fbc59600640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc3c0b6590 0x7fbc3c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.498+0000 7fbc62c4a740 1 -- start start 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 1 Processor -- start 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc59600640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc3c0b6590 0x7fbc3c0b8aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x563c543609b0 tx=0x7fbc48005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c5436d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53f9a390 0x563c5436dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53fbb070 0x563c54379800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563c54129700 con 0x563c53f921b0 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563c54263580 con 0x563c53f9a390 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563c54370510 con 0x563c53fbb070 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc62c4a740 10 client.0 _ll_register_callbacks cb 0x563c54273470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc59600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c5436d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc59600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c5436d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40462/0 (socket says 172.21.15.84:40462) 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc59600640 1 -- 172.21.15.84:0/1556094686 learned_addr learned my addr 172.21.15.84:0/1556094686 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc5a000640 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53fbb070 0x563c54379800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.499+0000 7fbc58c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53f9a390 0x563c5436dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc59600640 1 -- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53fbb070 msgr2=0x563c54379800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc59600640 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53fbb070 0x563c54379800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc59600640 1 -- 172.21.15.84:0/1556094686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53f9a390 msgr2=0x563c5436dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc59600640 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53f9a390 0x563c5436dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc59600640 1 -- 172.21.15.84:0/1556094686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c54026650 con 0x563c53f921b0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc5a000640 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53fbb070 0x563c54379800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc59600640 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c5436d800 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbc48004300 tx=0x7fbc48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffe2d2510960f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.500+0000 7fbc3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.501+0000 7fbc3aa00640 1 -- 172.21.15.84:0/1556094686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48029440 con 0x563c53f921b0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.501+0000 7fbc3aa00640 1 -- 172.21.15.84:0/1556094686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7fbc4801f430 con 0x563c53f921b0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.501+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c54265b90 con 0x563c53f921b0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.501+0000 7fbc3aa00640 1 -- 172.21.15.84:0/1556094686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc4801f630 con 0x563c53f921b0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.501+0000 7fbc62c4a740 10 client.17289 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.501+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c54280950 con 0x563c53f921b0 2024-09-21T07:59:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.501+0000 7fbc3aa00640 1 -- 172.21.15.84:0/1556094686 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563c54265b90 con 0x563c53f921b0 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc3aa00640 1 -- 172.21.15.84:0/1556094686 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbc48027070 con 0x563c53f921b0 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc62c4a740 10 client.17289 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc62c4a740 10 client.17289 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc62c4a740 20 client.17289 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f799f0 0x563c5437f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc62c4a740 4 client.17289 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c542daf00 con 0x563c53f799f0 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.502+0000 7fbc58c00640 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f799f0 0x563c5437f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.503+0000 7fbc58c00640 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f799f0 0x563c5437f800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bff447fc7d75d693 server_cookie=60827d9bac008cb0 in_seq=0 out_seq=0 2024-09-21T07:59:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.503+0000 7fbc3aa00640 10 client.17289 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:59:25.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc3aa00640 1 -- 172.21.15.84:0/1556094686 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c542daf00 con 0x563c53f799f0 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc3aa00640 10 client.17289 handle_command_reply: tid=0 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 client.17289 shutdown 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 msgr2=0x563c5436d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c5436d800 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbc48004300 tx=0x7fbc48004730 comp rx=0 tx=0).stop 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 shutdown_connections 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f799f0 0x563c5437f800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53fbb070 0x563c54379800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53f9a390 0x563c5436dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/1556094686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c5436d800 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 >> 172.21.15.84:0/1556094686 conn(0x563c53faf460 msgr2=0x563c54364f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc3aa00640 0 client.17289 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 shutdown_connections 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 1 -- 172.21.15.84:0/1556094686 wait complete. 2024-09-21T07:59:25.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.504+0000 7fbc62c4a740 20 client.17289 trim_cache size 0 max 16384 2024-09-21T07:59:25.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.518+0000 7fbc62c4a740 1 Processor -- start 2024-09-21T07:59:25.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.518+0000 7fbc62c4a740 1 -- start start 2024-09-21T07:59:25.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.518+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54379700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c54379c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54384fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541b3000 con 0x563c53f9a390 2024-09-21T07:59:25.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541b4b40 con 0x563c53fbb070 2024-09-21T07:59:25.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541b36d0 con 0x563c53f921b0 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc58c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c54379c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54379700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54379700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36528/0 (socket says 172.21.15.84:36528) 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 -- 172.21.15.84:0/4179953320 learned_addr learned my addr 172.21.15.84:0/4179953320 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc5a000640 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54384fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 -- 172.21.15.84:0/4179953320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 msgr2=0x563c54384fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54384fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 -- 172.21.15.84:0/4179953320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 msgr2=0x563c54379c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c54379c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc59600640 1 -- 172.21.15.84:0/4179953320 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5436bb00 con 0x563c53f921b0 2024-09-21T07:59:25.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.519+0000 7fbc58c00640 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c54379c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.520+0000 7fbc59600640 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54379700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbc48005c20 tx=0x7fbc480046a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=340b815eee87bb25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.520+0000 7fbc45c00640 1 -- 172.21.15.84:0/4179953320 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4801f9d0 con 0x563c53f921b0 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.520+0000 7fbc45c00640 1 -- 172.21.15.84:0/4179953320 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc480298f0 con 0x563c53f921b0 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.520+0000 7fbc45c00640 1 -- 172.21.15.84:0/4179953320 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4801d900 con 0x563c53f921b0 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 -- 172.21.15.84:0/4179953320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 msgr2=0x563c54379700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54379700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbc48005c20 tx=0x7fbc480046a0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 -- 172.21.15.84:0/4179953320 shutdown_connections 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54384fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f9a390 0x563c54379c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/4179953320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f921b0 0x563c54379700 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 -- 172.21.15.84:0/4179953320 >> 172.21.15.84:0/4179953320 conn(0x563c53faf460 msgr2=0x563c5436be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 -- 172.21.15.84:0/4179953320 shutdown_connections 2024-09-21T07:59:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.521+0000 7fbc62c4a740 1 -- 172.21.15.84:0/4179953320 wait complete. 2024-09-21T07:59:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 -- start start 2024-09-21T07:59:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 Processor -- start 2024-09-21T07:59:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c54375970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f9a390 0x563c54375eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54370720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541b4470 con 0x563c53f921b0 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541b3da0 con 0x563c53fbb070 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541b0fe0 con 0x563c53f9a390 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.522+0000 7fbc62c4a740 10 client.0 _ll_register_callbacks cb 0x7fbc480040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc59600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c54375970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc5a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54370720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc5a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54370720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:53788/0 (socket says 172.21.15.84:53788) 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc5a000640 1 -- 172.21.15.84:0/158819847 learned_addr learned my addr 172.21.15.84:0/158819847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc58c00640 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f9a390 0x563c54375eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc59600640 1 -- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f9a390 msgr2=0x563c54375eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:25.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc59600640 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f9a390 0x563c54375eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc59600640 1 -- 172.21.15.84:0/158819847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 msgr2=0x563c54370720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc59600640 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54370720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc59600640 1 -- 172.21.15.84:0/158819847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c54370d10 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc59600640 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c54375970 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbc48004300 tx=0x7fbc48005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce20cb865de802 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.523+0000 7fbc3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.524+0000 7fbc3aa00640 1 -- 172.21.15.84:0/158819847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48003e50 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.524+0000 7fbc3aa00640 1 -- 172.21.15.84:0/158819847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7fbc4801f7d0 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.524+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc480298f0 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.524+0000 7fbc3aa00640 1 -- 172.21.15.84:0/158819847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc4801f9d0 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.524+0000 7fbc62c4a740 10 client.17295 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.524+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c543eaa20 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.524+0000 7fbc3aa00640 1 -- 172.21.15.84:0/158819847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc480298f0 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc3aa00640 1 -- 172.21.15.84:0/158819847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbc48049030 con 0x563c53f921b0 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc62c4a740 10 client.17295 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc62c4a740 10 client.17295 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T07:59:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc62c4a740 20 client.17295 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:25.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f4eda0 0x563c543ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:25.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc62c4a740 4 client.17295 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:59:25.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c542d69b0 con 0x563c53f4eda0 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.525+0000 7fbc58c00640 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f4eda0 0x563c543ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc58c00640 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f4eda0 0x563c543ecfb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c05409ec998768b server_cookie=8fe0fe03390754fe in_seq=0 out_seq=0 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc3aa00640 10 client.17295 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc3aa00640 1 -- 172.21.15.84:0/158819847 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c542d69b0 con 0x563c53f4eda0 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc3aa00640 10 client.17295 handle_command_reply: tid=0 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 client.17295 shutdown 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 msgr2=0x563c54375970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c54375970 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbc48004300 tx=0x7fbc48005270 comp rx=0 tx=0).stop 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 shutdown_connections 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x563c53f4eda0 0x563c543ecfb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c53fbb070 0x563c54370720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563c53f9a390 0x563c54375eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 --2- 172.21.15.84:0/158819847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563c53f921b0 0x563c54375970 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 >> 172.21.15.84:0/158819847 conn(0x563c53faf460 msgr2=0x563c5435e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc3aa00640 0 client.17295 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 shutdown_connections 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 1 -- 172.21.15.84:0/158819847 wait complete. 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.526+0000 7fbc62c4a740 20 client.17295 trim_cache size 0 max 16384 2024-09-21T07:59:25.531 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc3c0b6590 msgr2=0x7fbc3c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc3c0b6590 0x7fbc3c0b8aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x563c543609b0 tx=0x7fbc48005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc541092d0 msgr2=0x7fbc54075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc541092d0 0x7fbc54075c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009230 tx=0x7fbc40003b90 comp rx=0 tx=0).stop 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 shutdown_connections 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc3c0b6590 0x7fbc3c0b8aa0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc54109c20 0x7fbc54076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc541092d0 0x7fbc54075c50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 --2- 172.21.15.84:0/2815613293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc54103990 0x7fbc54075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 >> 172.21.15.84:0/2815613293 conn(0x7fbc540ff3e0 msgr2=0x7fbc54101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 shutdown_connections 2024-09-21T07:59:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:25.527+0000 7fbc5aa00640 1 -- 172.21.15.84:0/2815613293 wait complete. 2024-09-21T07:59:25.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:25 smithi084 ceph-mon[30411]: pgmap v648: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 52 GiB data, 112 GiB used, 961 GiB / 1.0 TiB avail; 34 KiB/s rd, 168 MiB/s wr, 1.46k op/s 2024-09-21T07:59:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:25 smithi191 ceph-mon[34667]: pgmap v648: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 52 GiB data, 112 GiB used, 961 GiB / 1.0 TiB avail; 34 KiB/s rd, 168 MiB/s wr, 1.46k op/s 2024-09-21T07:59:26.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:25 smithi162 ceph-mon[34833]: pgmap v648: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 52 GiB data, 112 GiB used, 961 GiB / 1.0 TiB avail; 34 KiB/s rd, 168 MiB/s wr, 1.46k op/s 2024-09-21T07:59:26.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T07:59:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 -- 172.21.15.84:0/1641614293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f998410ff10 msgr2=0x7f9984112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 --2- 172.21.15.84:0/1641614293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f998410ff10 0x7f9984112350 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f997c009ca0 tx=0x7f997c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 -- 172.21.15.84:0/1641614293 shutdown_connections 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 --2- 172.21.15.84:0/1641614293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f998410ff10 0x7f9984112350 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 --2- 172.21.15.84:0/1641614293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9984076100 0x7f998410f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 --2- 172.21.15.84:0/1641614293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99840757b0 0x7f9984075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 -- 172.21.15.84:0/1641614293 >> 172.21.15.84:0/1641614293 conn(0x7f99840ff440 msgr2=0x7f9984101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 -- 172.21.15.84:0/1641614293 shutdown_connections 2024-09-21T07:59:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.320+0000 7f9983200640 1 -- 172.21.15.84:0/1641614293 wait complete. 2024-09-21T07:59:27.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.322+0000 7f9983200640 1 Processor -- start 2024-09-21T07:59:27.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.322+0000 7f9983200640 1 -- start start 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.322+0000 7f9983200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840757b0 0x7f998419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.322+0000 7f9983200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9984076100 0x7f998419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9983200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998410ff10 0x7f99841a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9983200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9984115b10 con 0x7f99840757b0 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9983200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9984115990 con 0x7f998410ff10 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9983200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9984115c90 con 0x7f9984076100 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840757b0 0x7f998419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840757b0 0x7f998419c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40508/0 (socket says 172.21.15.84:40508) 2024-09-21T07:59:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 -- 172.21.15.84:0/437575931 learned_addr learned my addr 172.21.15.84:0/437575931 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9982800640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998410ff10 0x7f99841a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981400640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9984076100 0x7f998419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 -- 172.21.15.84:0/437575931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9984076100 msgr2=0x7f998419ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9984076100 0x7f998419ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 -- 172.21.15.84:0/437575931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998410ff10 msgr2=0x7f99841a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998410ff10 0x7f99841a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.323+0000 7f9981e00640 1 -- 172.21.15.84:0/437575931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99841a2410 con 0x7f99840757b0 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.324+0000 7f9981e00640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840757b0 0x7f998419c4a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f997400d950 tx=0x7f997400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.324+0000 7f997aa00640 1 -- 172.21.15.84:0/437575931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974017070 con 0x7f99840757b0 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.324+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99841a2700 con 0x7f99840757b0 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.324+0000 7f997aa00640 1 -- 172.21.15.84:0/437575931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9974009c30 con 0x7f99840757b0 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.324+0000 7f997aa00640 1 -- 172.21.15.84:0/437575931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997400f620 con 0x7f99840757b0 2024-09-21T07:59:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.324+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99841a8e60 con 0x7f99840757b0 2024-09-21T07:59:27.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.327+0000 7f998f86d740 1 Processor -- start 2024-09-21T07:59:27.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.327+0000 7f998f86d740 1 -- start start 2024-09-21T07:59:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f998f86d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f998f86d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f998f86d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f998f86d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b548160fb0 con 0x55b547e22390 2024-09-21T07:59:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f998f86d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5481503e0 con 0x55b547e1a1b0 2024-09-21T07:59:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f998f86d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b5481541f0 con 0x55b547e43070 2024-09-21T07:59:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f997aa00640 1 -- 172.21.15.84:0/437575931 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9974010460 con 0x7f99840757b0 2024-09-21T07:59:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f9981400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f9981400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481ea9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40522/0 (socket says 172.21.15.84:40522) 2024-09-21T07:59:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f9981400640 1 -- 172.21.15.84:0/1420552555 learned_addr learned my addr 172.21.15.84:0/1420552555 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.328+0000 7f9982800640 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9981e00640 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9982800640 1 -- 172.21.15.84:0/1420552555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 msgr2=0x55b5481ea4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9982800640 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481ea4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9982800640 1 -- 172.21.15.84:0/1420552555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 msgr2=0x55b5481ea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9982800640 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481ea9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9982800640 1 -- 172.21.15.84:0/1420552555 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54811acd0 con 0x55b547e43070 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9981e00640 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f9982800640 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481e9f70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f997c005e30 tx=0x7f997c02f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89ad459b76e8cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f996f000640 1 -- 172.21.15.84:0/1420552555 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c031db0 con 0x55b547e43070 2024-09-21T07:59:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.329+0000 7f996f000640 1 -- 172.21.15.84:0/1420552555 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f997c036030 con 0x55b547e43070 2024-09-21T07:59:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.330+0000 7f996f000640 1 -- 172.21.15.84:0/1420552555 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c0042a0 con 0x55b547e43070 2024-09-21T07:59:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.330+0000 7f997aa00640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99680b6700 0x7f99680b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.330+0000 7f998f86d740 1 -- 172.21.15.84:0/1420552555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 msgr2=0x55b5481e9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.330+0000 7f998f86d740 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481e9f70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f997c005e30 tx=0x7f997c02f310 comp rx=0 tx=0).stop 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.330+0000 7f997aa00640 1 -- 172.21.15.84:0/437575931 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f99740e7640 con 0x7f99840757b0 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.330+0000 7f9981e00640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99680b6700 0x7f99680b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 -- 172.21.15.84:0/1420552555 shutdown_connections 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481ea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 --2- 172.21.15.84:0/1420552555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481e9f70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 -- 172.21.15.84:0/1420552555 >> 172.21.15.84:0/1420552555 conn(0x55b547e37460 msgr2=0x55b5481e7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 -- 172.21.15.84:0/1420552555 shutdown_connections 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 -- 172.21.15.84:0/1420552555 wait complete. 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f9981e00640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99680b6700 0x7f99680b8c10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55b5481e8bf0 tx=0x7f9974000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.331+0000 7f998f86d740 1 -- start start 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 1 Processor -- start 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481f5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e22390 0x55b5481f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e43070 0x55b548201860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b547fb1700 con 0x55b547e43070 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b5480eb580 con 0x55b547e1a1b0 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b5481f8570 con 0x55b547e22390 2024-09-21T07:59:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f998f86d740 10 client.0 _ll_register_callbacks cb 0x55b5480fb470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f9982800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f9982800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e43070 0x55b548201860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.332+0000 7f9981400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e22390 0x55b5481f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e22390 0x55b5481f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36600/0 (socket says 172.21.15.84:36600) 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 -- 172.21.15.84:0/1560179958 learned_addr learned my addr 172.21.15.84:0/1560179958 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9982800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e43070 0x55b548201860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40524/0 (socket says 172.21.15.84:40524) 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 -- 172.21.15.84:0/1560179958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 msgr2=0x55b5481f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 -- 172.21.15.84:0/1560179958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e43070 msgr2=0x55b548201860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e43070 0x55b548201860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 -- 172.21.15.84:0/1560179958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b547eae650 con 0x55b547e22390 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9981400640 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e22390 0x55b5481f5bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9970012840 tx=0x7f9970012d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6283533f2d90fa81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9963400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.333+0000 7f9963400640 1 -- 172.21.15.84:0/1560179958 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970004050 con 0x55b547e22390 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5480edb90 con 0x55b547e22390 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f9963400640 1 -- 172.21.15.84:0/1560179958 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f99700041f0 con 0x55b547e22390 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f9963400640 1 -- 172.21.15.84:0/1560179958 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99700043f0 con 0x55b547e22390 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f998f86d740 10 client.27682 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b548108950 con 0x55b547e22390 2024-09-21T07:59:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f9963400640 1 -- 172.21.15.84:0/1560179958 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b5480edb90 con 0x55b547e22390 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f9963400640 1 -- 172.21.15.84:0/1560179958 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9970003b50 con 0x55b547e22390 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f998f86d740 10 client.27682 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.334+0000 7f998f86d740 10 client.27682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.335+0000 7f998f86d740 20 client.27682 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.335+0000 7f998f86d740 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547e019f0 0x55b548207650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.335+0000 7f998f86d740 4 client.27682 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.335+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b548162f00 con 0x55b547e019f0 2024-09-21T07:59:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.335+0000 7f9982800640 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547e019f0 0x55b548207650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.336+0000 7f9982800640 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547e019f0 0x55b548207650 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad93e2ded9fedad server_cookie=a13cf62dcd9b243b in_seq=0 out_seq=0 2024-09-21T07:59:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.336+0000 7f9963400640 10 client.27682 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.336+0000 7f9963400640 1 -- 172.21.15.84:0/1560179958 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b548162f00 con 0x55b547e019f0 2024-09-21T07:59:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f9963400640 10 client.27682 handle_command_reply: tid=0 2024-09-21T07:59:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 client.27682 shutdown 2024-09-21T07:59:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e22390 msgr2=0x55b5481f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e22390 0x55b5481f5bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9970012840 tx=0x7f9970012d00 comp rx=0 tx=0).stop 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 shutdown_connections 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e43070 0x55b548201860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547e019f0 0x55b548207650 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e22390 0x55b5481f5bd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 --2- 172.21.15.84:0/1560179958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f9963400640 0 client.27682 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 >> 172.21.15.84:0/1560179958 conn(0x55b547e37460 msgr2=0x55b5481ed100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 shutdown_connections 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 1 -- 172.21.15.84:0/1560179958 wait complete. 2024-09-21T07:59:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.337+0000 7f998f86d740 20 client.27682 trim_cache size 0 max 16384 2024-09-21T07:59:27.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 Processor -- start 2024-09-21T07:59:27.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 -- start start 2024-09-21T07:59:27.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b548201760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b548201ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481f2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99841b2ef0 con 0x55b547e22390 2024-09-21T07:59:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99841b4a30 con 0x55b547e1a1b0 2024-09-21T07:59:27.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.351+0000 7f998f86d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f99841b35c0 con 0x55b547e43070 2024-09-21T07:59:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b548201ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b548201ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40532/0 (socket says 172.21.15.84:40532) 2024-09-21T07:59:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 -- 172.21.15.84:0/99590651 learned_addr learned my addr 172.21.15.84:0/99590651 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9982800640 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b548201760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9982800640 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 -- 172.21.15.84:0/99590651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 msgr2=0x55b5481f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 -- 172.21.15.84:0/99590651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 msgr2=0x55b548201760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b548201760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 -- 172.21.15.84:0/99590651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5481f02a0 con 0x55b547e22390 2024-09-21T07:59:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.352+0000 7f9981400640 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b548201ca0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9970000c00 tx=0x7f9970010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b1eb0c78b7c04f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.353+0000 7f996e600640 1 -- 172.21.15.84:0/99590651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997002d020 con 0x55b547e22390 2024-09-21T07:59:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.353+0000 7f996e600640 1 -- 172.21.15.84:0/99590651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9970010dd0 con 0x55b547e22390 2024-09-21T07:59:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.353+0000 7f996e600640 1 -- 172.21.15.84:0/99590651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970005040 con 0x55b547e22390 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.353+0000 7f998f86d740 1 -- 172.21.15.84:0/99590651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 msgr2=0x55b548201ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b548201ca0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9970000c00 tx=0x7f9970010830 comp rx=0 tx=0).stop 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 -- 172.21.15.84:0/99590651 shutdown_connections 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b548201ca0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 --2- 172.21.15.84:0/99590651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b548201760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 -- 172.21.15.84:0/99590651 >> 172.21.15.84:0/99590651 conn(0x55b547e37460 msgr2=0x55b5481f3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 -- 172.21.15.84:0/99590651 shutdown_connections 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 -- 172.21.15.84:0/99590651 wait complete. 2024-09-21T07:59:27.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 -- start start 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.354+0000 7f998f86d740 1 Processor -- start 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f998f86d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481fdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f998f86d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f998f86d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f998f86d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99841b4360 con 0x55b547e22390 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f998f86d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99841b3c90 con 0x55b547e1a1b0 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f998f86d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f99841b0ed0 con 0x55b547e43070 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f998f86d740 10 client.0 _ll_register_callbacks cb 0x7f9970012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f9981400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f9981400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481fb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40534/0 (socket says 172.21.15.84:40534) 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f9981400640 1 -- 172.21.15.84:0/340250538 learned_addr learned my addr 172.21.15.84:0/340250538 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f9982800640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481fdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.355+0000 7f9982800640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9981400640 1 -- 172.21.15.84:0/340250538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 msgr2=0x55b5481fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9981400640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481fbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9981400640 1 -- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 msgr2=0x55b5481fdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9981400640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481fdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9981400640 1 -- 172.21.15.84:0/340250538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5481fc270 con 0x55b547e22390 2024-09-21T07:59:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9982800640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9981400640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481fb7f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9970012d40 tx=0x7f997000fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39326af4554ec625 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9963400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9963400640 1 -- 172.21.15.84:0/340250538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970036020 con 0x55b547e22390 2024-09-21T07:59:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f9963400640 1 -- 172.21.15.84:0/340250538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9520+0+0 (secure 0 0 0) 0x7f99700035f0 con 0x55b547e22390 2024-09-21T07:59:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.356+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9970010dd0 con 0x55b547e22390 2024-09-21T07:59:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f9963400640 1 -- 172.21.15.84:0/340250538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f997002d040 con 0x55b547e22390 2024-09-21T07:59:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 10 client.17313 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b548272ce0 con 0x55b547e22390 2024-09-21T07:59:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f9963400640 1 -- 172.21.15.84:0/340250538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9970010dd0 con 0x55b547e22390 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f9963400640 1 -- 172.21.15.84:0/340250538 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f99700050a0 con 0x55b547e22390 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 10 client.17313 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 10 client.17313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 20 client.17313 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547dd6da0 0x55b5482753d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 4 client.17313 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.357+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b54815e9b0 con 0x55b547dd6da0 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.358+0000 7f9982800640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547dd6da0 0x55b5482753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.358+0000 7f9982800640 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547dd6da0 0x55b5482753d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79bf8e1e371a7572 server_cookie=694d897b9dc5a475 in_seq=0 out_seq=0 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.358+0000 7f9963400640 10 client.17313 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.358+0000 7f9963400640 1 -- 172.21.15.84:0/340250538 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b54815e9b0 con 0x55b547dd6da0 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.358+0000 7f9963400640 10 client.17313 handle_command_reply: tid=0 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.358+0000 7f998f86d740 1 client.17313 shutdown 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 msgr2=0x55b5481fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481fb7f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9970012d40 tx=0x7f997000fd80 comp rx=0 tx=0).stop 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 shutdown_connections 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55b547dd6da0 0x55b5482753d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b547e43070 0x55b5481fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b547e22390 0x55b5481fb7f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 --2- 172.21.15.84:0/340250538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b547e1a1b0 0x55b5481fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 >> 172.21.15.84:0/340250538 conn(0x55b547e37460 msgr2=0x55b5481f6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f9963400640 0 client.17313 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 shutdown_connections 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 1 -- 172.21.15.84:0/340250538 wait complete. 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.359+0000 7f998f86d740 20 client.17313 trim_cache size 0 max 16384 2024-09-21T07:59:27.364 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T07:59:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99680b6700 msgr2=0x7f99680b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99680b6700 0x7f99680b8c10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55b5481e8bf0 tx=0x7f9974000bc0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840757b0 msgr2=0x7f998419c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840757b0 0x7f998419c4a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f997400d950 tx=0x7f997400de10 comp rx=0 tx=0).stop 2024-09-21T07:59:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 shutdown_connections 2024-09-21T07:59:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f99680b6700 0x7f99680b8c10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998410ff10 0x7f99841a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9984076100 0x7f998419ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 --2- 172.21.15.84:0/437575931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840757b0 0x7f998419c4a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 >> 172.21.15.84:0/437575931 conn(0x7f99840ff440 msgr2=0x7f9984109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 shutdown_connections 2024-09-21T07:59:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:27.360+0000 7f9983200640 1 -- 172.21.15.84:0/437575931 wait complete. 2024-09-21T07:59:27.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:27 smithi191 ceph-mon[34667]: pgmap v649: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 46 KiB/s rd, 139 MiB/s wr, 1.19k op/s 2024-09-21T07:59:27.992 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:27 smithi084 ceph-mon[30411]: pgmap v649: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 46 KiB/s rd, 139 MiB/s wr, 1.19k op/s 2024-09-21T07:59:28.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:27 smithi162 ceph-mon[34833]: pgmap v649: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 46 KiB/s rd, 139 MiB/s wr, 1.19k op/s 2024-09-21T07:59:29.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:28 smithi162 ceph-mon[34833]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T07:59:29.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:28 smithi162 ceph-mon[34833]: pgmap v651: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 35 KiB/s rd, 79 MiB/s wr, 650 op/s 2024-09-21T07:59:29.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:28 smithi084 ceph-mon[30411]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T07:59:29.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:28 smithi084 ceph-mon[30411]: pgmap v651: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 35 KiB/s rd, 79 MiB/s wr, 650 op/s 2024-09-21T07:59:29.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:28 smithi191 ceph-mon[34667]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T07:59:29.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:28 smithi191 ceph-mon[34667]: pgmap v651: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 35 KiB/s rd, 79 MiB/s wr, 650 op/s 2024-09-21T07:59:29.535 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T07:59:29.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T07:59:29.616 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T07:59:29.616 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T07:59:29.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:59:29.927 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:30.229 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 -- 172.21.15.84:0/2709691978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010be50 msgr2=0x7ff140112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 --2- 172.21.15.84:0/2709691978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010be50 0x7ff140112680 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff138009ca0 tx=0x7ff13802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 -- 172.21.15.84:0/2709691978 shutdown_connections 2024-09-21T07:59:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 --2- 172.21.15.84:0/2709691978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010be50 0x7ff140112680 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 --2- 172.21.15.84:0/2709691978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff14010b500 0x7ff14010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 --2- 172.21.15.84:0/2709691978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff140105bc0 0x7ff140105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 -- 172.21.15.84:0/2709691978 >> 172.21.15.84:0/2709691978 conn(0x7ff140101670 msgr2=0x7ff140103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 -- 172.21.15.84:0/2709691978 shutdown_connections 2024-09-21T07:59:30.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.535+0000 7ff13f200640 1 -- 172.21.15.84:0/2709691978 wait complete. 2024-09-21T07:59:30.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 Processor -- start 2024-09-21T07:59:30.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 -- start start 2024-09-21T07:59:30.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140105bc0 0x7ff14019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010b500 0x7ff14019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff14010be50 0x7ff1401a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff140115b60 con 0x7ff14010b500 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401159e0 con 0x7ff14010be50 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.537+0000 7ff13f200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff140115ce0 con 0x7ff140105bc0 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140105bc0 0x7ff14019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff135400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010b500 0x7ff14019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140105bc0 0x7ff14019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:41660/0 (socket says 172.21.15.84:41660) 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 -- 172.21.15.84:0/3776725180 learned_addr learned my addr 172.21.15.84:0/3776725180 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13e800640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff14010be50 0x7ff1401a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 -- 172.21.15.84:0/3776725180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff14010be50 msgr2=0x7ff1401a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff14010be50 0x7ff1401a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 -- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010b500 msgr2=0x7ff14019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010b500 0x7ff14019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 -- 172.21.15.84:0/3776725180 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1401a2460 con 0x7ff140105bc0 2024-09-21T07:59:30.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff135400640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010b500 0x7ff14019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:30.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.538+0000 7ff13de00640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140105bc0 0x7ff14019c4f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff13000d950 tx=0x7ff13000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.539+0000 7ff137400640 1 -- 172.21.15.84:0/3776725180 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130017070 con 0x7ff140105bc0 2024-09-21T07:59:30.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.539+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1401a2750 con 0x7ff140105bc0 2024-09-21T07:59:30.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.539+0000 7ff137400640 1 -- 172.21.15.84:0/3776725180 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff130009c30 con 0x7ff140105bc0 2024-09-21T07:59:30.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.539+0000 7ff137400640 1 -- 172.21.15.84:0/3776725180 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13000f620 con 0x7ff140105bc0 2024-09-21T07:59:30.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.539+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1401a8eb0 con 0x7ff140105bc0 2024-09-21T07:59:30.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.543+0000 7ff14bbd5740 1 Processor -- start 2024-09-21T07:59:30.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff14bbd5740 1 -- start start 2024-09-21T07:59:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564daea0b350 0x564daedb2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9e2490 0x564daedb3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9ea670 0x564daedb3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564daed28e90 con 0x564daea0b350 2024-09-21T07:59:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564daed182c0 con 0x564dae9e2490 2024-09-21T07:59:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564daed1c0d0 con 0x564dae9ea670 2024-09-21T07:59:30.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.544+0000 7ff137400640 1 -- 172.21.15.84:0/3776725180 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff130010460 con 0x7ff140105bc0 2024-09-21T07:59:30.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff13e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564daea0b350 0x564daedb2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9ea670 0x564daedb3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9ea670 0x564daedb3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:41670/0 (socket says 172.21.15.84:41670) 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 -- 172.21.15.84:0/2535759647 learned_addr learned my addr 172.21.15.84:0/2535759647 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff13de00640 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9e2490 0x564daedb3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 -- 172.21.15.84:0/2535759647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9e2490 msgr2=0x564daedb3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9e2490 0x564daedb3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 -- 172.21.15.84:0/2535759647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564daea0b350 msgr2=0x564daedb2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564daea0b350 0x564daedb2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff135400640 1 -- 172.21.15.84:0/2535759647 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daea76930 con 0x564dae9ea670 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.545+0000 7ff13e800640 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564daea0b350 0x564daedb2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.546+0000 7ff135400640 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9ea670 0x564daedb3980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff128011470 tx=0x7ff128011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891e6af7b389ea3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.546+0000 7ff12f400640 1 -- 172.21.15.84:0/2535759647 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12801e070 con 0x564dae9ea670 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.546+0000 7ff12f400640 1 -- 172.21.15.84:0/2535759647 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1280035f0 con 0x564dae9ea670 2024-09-21T07:59:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.546+0000 7ff12f400640 1 -- 172.21.15.84:0/2535759647 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12800f7a0 con 0x564dae9ea670 2024-09-21T07:59:30.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff137400640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff1240b6680 0x7ff1240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff137400640 1 -- 172.21.15.84:0/3776725180 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7ff1300e76d0 con 0x7ff140105bc0 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff13e800640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff1240b6680 0x7ff1240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 -- 172.21.15.84:0/2535759647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9ea670 msgr2=0x564daedb3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9ea670 0x564daedb3980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff128011470 tx=0x7ff128011930 comp rx=0 tx=0).stop 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 -- 172.21.15.84:0/2535759647 shutdown_connections 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9ea670 0x564daedb3980 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9e2490 0x564daedb3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/2535759647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564daea0b350 0x564daedb2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 -- 172.21.15.84:0/2535759647 >> 172.21.15.84:0/2535759647 conn(0x564dae9ff740 msgr2=0x564daedb0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.547+0000 7ff14bbd5740 1 -- 172.21.15.84:0/2535759647 shutdown_connections 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.548+0000 7ff14bbd5740 1 -- 172.21.15.84:0/2535759647 wait complete. 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.548+0000 7ff13e800640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff1240b6680 0x7ff1240b8b90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff138006010 tx=0x7ff138005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.548+0000 7ff14bbd5740 1 -- start start 2024-09-21T07:59:30.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.548+0000 7ff14bbd5740 1 Processor -- start 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9e2490 0x564daedbeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9ea670 0x564daedbf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564daea0b350 0x564daedca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564daeb79890 con 0x564dae9ea670 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564daecb3160 con 0x564daea0b350 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564daedc16e0 con 0x564dae9e2490 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff14bbd5740 10 client.0 _ll_register_callbacks cb 0x564daeccfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff135400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9ea670 0x564daedbf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff135400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9ea670 0x564daedbf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46514/0 (socket says 172.21.15.84:46514) 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff135400640 1 -- 172.21.15.84:0/3322085883 learned_addr learned my addr 172.21.15.84:0/3322085883 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff13e800640 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564daea0b350 0x564daedca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.549+0000 7ff13de00640 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9e2490 0x564daedbeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff135400640 1 -- 172.21.15.84:0/3322085883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9e2490 msgr2=0x564daedbeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff135400640 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9e2490 0x564daedbeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff135400640 1 -- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564daea0b350 msgr2=0x564daedca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff135400640 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564daea0b350 0x564daedca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff135400640 1 -- 172.21.15.84:0/3322085883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564daedcafc0 con 0x564dae9ea670 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff135400640 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9ea670 0x564daedbf0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff128004000 tx=0x7ff1280039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac5514735a278e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff123e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff123e00640 1 -- 172.21.15.84:0/3322085883 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12801e070 con 0x564dae9ea670 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.550+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1280035f0 con 0x564dae9ea670 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff123e00640 1 -- 172.21.15.84:0/3322085883 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7ff128016040 con 0x564dae9ea670 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff123e00640 1 -- 172.21.15.84:0/3322085883 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff128031050 con 0x564dae9ea670 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff14bbd5740 10 client.17325 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564daedcd8f0 con 0x564dae9ea670 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff123e00640 1 -- 172.21.15.84:0/3322085883 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1280035f0 con 0x564dae9ea670 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff123e00640 1 -- 172.21.15.84:0/3322085883 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff128004990 con 0x564dae9ea670 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff14bbd5740 10 client.17325 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff14bbd5740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff14bbd5740 20 client.17325 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.551+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae9c9cd0 0x564daedd0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.552+0000 7ff14bbd5740 4 client.17325 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.552+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564daed2ade0 con 0x564dae9c9cd0 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.552+0000 7ff13de00640 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae9c9cd0 0x564daedd0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.553+0000 7ff123e00640 10 client.17325 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.553+0000 7ff13de00640 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae9c9cd0 0x564daedd0cb0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c584a6567979b399 server_cookie=73bd75f6e8233d5d in_seq=0 out_seq=0 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff123e00640 1 -- 172.21.15.84:0/3322085883 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564daed2ade0 con 0x564dae9c9cd0 2024-09-21T07:59:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff123e00640 10 client.17325 handle_command_reply: tid=0 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 client.17325 shutdown 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9ea670 msgr2=0x564daedbf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9ea670 0x564daedbf0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff128004000 tx=0x7ff1280039d0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 shutdown_connections 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564daea0b350 0x564daedca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9ea670 0x564daedbf0a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae9c9cd0 0x564daedd0cb0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/3322085883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dae9e2490 0x564daedbeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 >> 172.21.15.84:0/3322085883 conn(0x564dae9ff740 msgr2=0x564daedb60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff123e00640 0 client.17325 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 shutdown_connections 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.554+0000 7ff14bbd5740 1 -- 172.21.15.84:0/3322085883 wait complete. 2024-09-21T07:59:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.555+0000 7ff14bbd5740 20 client.17325 trim_cache size 0 max 16384 2024-09-21T07:59:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.573+0000 7ff14bbd5740 1 Processor -- start 2024-09-21T07:59:30.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.573+0000 7ff14bbd5740 1 -- start start 2024-09-21T07:59:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedbd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedbd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401b2e80 con 0x564dae9e2490 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401b49c0 con 0x564dae9ea670 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401b3550 con 0x564daea0b350 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46524/0 (socket says 172.21.15.84:46524) 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 -- 172.21.15.84:0/1539682414 learned_addr learned my addr 172.21.15.84:0/1539682414 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff135400640 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedbd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13e800640 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedbd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 -- 172.21.15.84:0/1539682414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 msgr2=0x564daedbd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedbd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 -- 172.21.15.84:0/1539682414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 msgr2=0x564daedbd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedbd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13de00640 1 -- 172.21.15.84:0/1539682414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daedbf220 con 0x564dae9e2490 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.574+0000 7ff13e800640 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedbd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.575+0000 7ff13de00640 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedca8d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff1300aa450 tx=0x7ff1300b4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b07aabf1cce87a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.575+0000 7ff12ea00640 1 -- 172.21.15.84:0/1539682414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130020040 con 0x564dae9e2490 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.575+0000 7ff12ea00640 1 -- 172.21.15.84:0/1539682414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1300e6030 con 0x564dae9e2490 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.575+0000 7ff12ea00640 1 -- 172.21.15.84:0/1539682414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1300e7280 con 0x564dae9e2490 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 -- 172.21.15.84:0/1539682414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 msgr2=0x564daedca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedca8d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff1300aa450 tx=0x7ff1300b4f90 comp rx=0 tx=0).stop 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 -- 172.21.15.84:0/1539682414 shutdown_connections 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedbd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedbd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/1539682414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedca8d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 -- 172.21.15.84:0/1539682414 >> 172.21.15.84:0/1539682414 conn(0x564dae9ff740 msgr2=0x564daedb9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 -- 172.21.15.84:0/1539682414 shutdown_connections 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 -- 172.21.15.84:0/1539682414 wait complete. 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.576+0000 7ff14bbd5740 1 -- start start 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 1 Processor -- start 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedc7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedc24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedc29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401b42f0 con 0x564dae9e2490 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401b3c20 con 0x564dae9ea670 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401b0e80 con 0x564daea0b350 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff14bbd5740 10 client.0 _ll_register_callbacks cb 0x7ff12801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff13de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedc7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff13de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedc7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46530/0 (socket says 172.21.15.84:46530) 2024-09-21T07:59:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff13de00640 1 -- 172.21.15.84:0/422706378 learned_addr learned my addr 172.21.15.84:0/422706378 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.577+0000 7ff135400640 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedc24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff13e800640 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedc29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff13de00640 1 -- 172.21.15.84:0/422706378 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 msgr2=0x564daedc29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff13de00640 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedc29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff13de00640 1 -- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 msgr2=0x564daedc24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff13de00640 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedc24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff13de00640 1 -- 172.21.15.84:0/422706378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564daedc3060 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff13de00640 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedc7000 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff1300ad170 tx=0x7ff130010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd943b04472aad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff123e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff123e00640 1 -- 172.21.15.84:0/422706378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130020040 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff123e00640 1 -- 172.21.15.84:0/422706378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7ff1300e7280 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.578+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1300e6030 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff123e00640 1 -- 172.21.15.84:0/422706378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff1300e4eb0 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 10 client.17331 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564daee3b370 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff123e00640 1 -- 172.21.15.84:0/422706378 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1300e6030 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff123e00640 1 -- 172.21.15.84:0/422706378 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff130010750 con 0x564dae9e2490 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 10 client.17331 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 20 client.17331 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae99f080 0x564daee3db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 4 client.17331 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T07:59:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.579+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564daed26890 con 0x564dae99f080 2024-09-21T07:59:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.580+0000 7ff135400640 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae99f080 0x564daee3db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.580+0000 7ff135400640 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae99f080 0x564daee3db00 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85c087032ebfe49b server_cookie=e3ab501b7986f61e in_seq=0 out_seq=0 2024-09-21T07:59:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.580+0000 7ff123e00640 10 client.17331 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.582+0000 7ff123e00640 1 -- 172.21.15.84:0/422706378 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564daed26890 con 0x564dae99f080 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.582+0000 7ff123e00640 10 client.17331 handle_command_reply: tid=0 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.582+0000 7ff14bbd5740 1 client.17331 shutdown 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.582+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 msgr2=0x564daedc7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.582+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedc7000 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff1300ad170 tx=0x7ff130010cb0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 shutdown_connections 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x564dae99f080 0x564daee3db00 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564daea0b350 0x564daedc29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564dae9ea670 0x564daedc24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 --2- 172.21.15.84:0/422706378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dae9e2490 0x564daedc7000 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 >> 172.21.15.84:0/422706378 conn(0x564dae9ff740 msgr2=0x564daedbd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff123e00640 0 client.17331 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 shutdown_connections 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 1 -- 172.21.15.84:0/422706378 wait complete. 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.583+0000 7ff14bbd5740 20 client.17331 trim_cache size 0 max 16384 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "150c51d9-ea54-433e-a9e2-a91577daa093", 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T07:59:30.586 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:59:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff1240b6680 msgr2=0x7ff1240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff1240b6680 0x7ff1240b8b90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff138006010 tx=0x7ff138005d80 comp rx=0 tx=0).stop 2024-09-21T07:59:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140105bc0 msgr2=0x7ff14019c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140105bc0 0x7ff14019c4f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff13000d950 tx=0x7ff13000de10 comp rx=0 tx=0).stop 2024-09-21T07:59:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 shutdown_connections 2024-09-21T07:59:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff1240b6680 0x7ff1240b8b90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff14010be50 0x7ff1401a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff14010b500 0x7ff14019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 --2- 172.21.15.84:0/3776725180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140105bc0 0x7ff14019c4f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 >> 172.21.15.84:0/3776725180 conn(0x7ff140101670 msgr2=0x7ff14010ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 shutdown_connections 2024-09-21T07:59:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:30.584+0000 7ff13f200640 1 -- 172.21.15.84:0/3776725180 wait complete. 2024-09-21T07:59:31.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T07:59:31.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:31 smithi162 ceph-mon[34833]: pgmap v652: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 36 KiB/s rd, 30 MiB/s wr, 234 op/s 2024-09-21T07:59:31.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:31 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T07:59:31.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:31 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:59:31.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:31 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T07:59:31.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:31 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T07:59:31.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:31 smithi084 ceph-mon[30411]: pgmap v652: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 36 KiB/s rd, 30 MiB/s wr, 234 op/s 2024-09-21T07:59:31.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:31 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T07:59:31.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:31 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:59:31.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:31 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T07:59:31.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:31 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 -- 172.21.15.84:0/1752731177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 msgr2=0x7f3524109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 --2- 172.21.15.84:0/1752731177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 0x7f3524109700 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3510009900 tx=0x7f351002a410 comp rx=0 tx=0).stop 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 -- 172.21.15.84:0/1752731177 shutdown_connections 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 --2- 172.21.15.84:0/1752731177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3524109c40 0x7f3524110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 --2- 172.21.15.84:0/1752731177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 0x7f3524109700 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 --2- 172.21.15.84:0/1752731177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 0x7f3524103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 -- 172.21.15.84:0/1752731177 >> 172.21.15.84:0/1752731177 conn(0x7f35240ff440 msgr2=0x7f3524101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 -- 172.21.15.84:0/1752731177 shutdown_connections 2024-09-21T07:59:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.819+0000 7f3523200640 1 -- 172.21.15.84:0/1752731177 wait complete. 2024-09-21T07:59:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.820+0000 7f3523200640 1 Processor -- start 2024-09-21T07:59:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.820+0000 7f3523200640 1 -- start start 2024-09-21T07:59:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3523200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 0x7f352419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3523200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 0x7f352419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3523200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3524109c40 0x7f352419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3523200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3524113900 con 0x7f35241092f0 2024-09-21T07:59:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3523200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3524113780 con 0x7f35241039b0 2024-09-21T07:59:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3523200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3524113a80 con 0x7f3524109c40 2024-09-21T07:59:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3521e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 0x7f352419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3522800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3524109c40 0x7f352419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3521e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 0x7f352419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57518/0 (socket says 172.21.15.84:57518) 2024-09-21T07:59:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3521e00640 1 -- 172.21.15.84:0/348561491 learned_addr learned my addr 172.21.15.84:0/348561491 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.821+0000 7f3521400640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 0x7f352419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.822+0000 7f3521e00640 1 -- 172.21.15.84:0/348561491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3524109c40 msgr2=0x7f352419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.822+0000 7f3521e00640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3524109c40 0x7f352419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.822+0000 7f3521e00640 1 -- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 msgr2=0x7f352419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.822+0000 7f3521e00640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 0x7f352419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.822+0000 7f3521e00640 1 -- 172.21.15.84:0/348561491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35241a02e0 con 0x7f35241039b0 2024-09-21T07:59:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.822+0000 7f3522800640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3524109c40 0x7f352419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.822+0000 7f3521e00640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 0x7f352419a370 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f351400e9f0 tx=0x7f351400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.823+0000 7f351aa00640 1 -- 172.21.15.84:0/348561491 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351400cd80 con 0x7f35241039b0 2024-09-21T07:59:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.823+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35241a05d0 con 0x7f35241039b0 2024-09-21T07:59:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.823+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35241a6d30 con 0x7f35241039b0 2024-09-21T07:59:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.823+0000 7f351aa00640 1 -- 172.21.15.84:0/348561491 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35140108e0 con 0x7f35241039b0 2024-09-21T07:59:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.823+0000 7f351aa00640 1 -- 172.21.15.84:0/348561491 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514018980 con 0x7f35241039b0 2024-09-21T07:59:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.824+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35040052c0 con 0x7f35241039b0 2024-09-21T07:59:31.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.827+0000 7f351aa00640 1 -- 172.21.15.84:0/348561491 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3514010430 con 0x7f35241039b0 2024-09-21T07:59:31.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.828+0000 7f351aa00640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35080b6700 0x7f35080b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:31.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.829+0000 7f351aa00640 1 -- 172.21.15.84:0/348561491 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f35140e7dc0 con 0x7f35241039b0 2024-09-21T07:59:31.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.829+0000 7f3521400640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35080b6700 0x7f35080b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:31.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.830+0000 7f3521400640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35080b6700 0x7f35080b8c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3510009230 tx=0x7f3510031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:31.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:31.830+0000 7f351aa00640 1 -- 172.21.15.84:0/348561491 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35140b2300 con 0x7f35241039b0 2024-09-21T07:59:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:31 smithi191 ceph-mon[34667]: pgmap v652: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 36 KiB/s rd, 30 MiB/s wr, 234 op/s 2024-09-21T07:59:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:31 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T07:59:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:31 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:59:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:31 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T07:59:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:31 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T07:59:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:32.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.072+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35040055b0 con 0x7f35241039b0 2024-09-21T07:59:32.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.073+0000 7f351aa00640 1 -- 172.21.15.84:0/348561491 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f35140b7240 con 0x7f35241039b0 2024-09-21T07:59:32.075 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:59:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:59:32.076 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:59:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35080b6700 msgr2=0x7f35080b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35080b6700 0x7f35080b8c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3510009230 tx=0x7f3510031400 comp rx=0 tx=0).stop 2024-09-21T07:59:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 msgr2=0x7f352419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 0x7f352419a370 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f351400e9f0 tx=0x7f351400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 shutdown_connections 2024-09-21T07:59:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f35080b6700 0x7f35080b8c10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3524109c40 0x7f352419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35241092f0 0x7f352419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 --2- 172.21.15.84:0/348561491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35241039b0 0x7f352419a370 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 >> 172.21.15.84:0/348561491 conn(0x7f35240ff440 msgr2=0x7f3524101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 shutdown_connections 2024-09-21T07:59:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.076+0000 7f3523200640 1 -- 172.21.15.84:0/348561491 wait complete. 2024-09-21T07:59:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 -- 172.21.15.84:0/846270436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 msgr2=0x7f10e8075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 --2- 172.21.15.84:0/846270436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e8075bc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009900 tx=0x7f10dc02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 -- 172.21.15.84:0/846270436 shutdown_connections 2024-09-21T07:59:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 --2- 172.21.15.84:0/846270436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e810fef0 0x7f10e8112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 --2- 172.21.15.84:0/846270436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e8076100 0x7f10e810f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 --2- 172.21.15.84:0/846270436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e8075bc0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 -- 172.21.15.84:0/846270436 >> 172.21.15.84:0/846270436 conn(0x7f10e80ff3e0 msgr2=0x7f10e8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 -- 172.21.15.84:0/846270436 shutdown_connections 2024-09-21T07:59:32.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.725+0000 7f10ee600640 1 -- 172.21.15.84:0/846270436 wait complete. 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 Processor -- start 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 -- start start 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e8076100 0x7f10e819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e810fef0 0x7f10e81a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8115aa0 con 0x7f10e80757b0 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8115920 con 0x7f10e8076100 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.726+0000 7f10ee600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8115c20 con 0x7f10e810fef0 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10ed200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10ed200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46590/0 (socket says 172.21.15.84:46590) 2024-09-21T07:59:32.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10ed200640 1 -- 172.21.15.84:0/2538304036 learned_addr learned my addr 172.21.15.84:0/2538304036 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:32.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10e7e00640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e8076100 0x7f10e819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10edc00640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e810fef0 0x7f10e81a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10e7e00640 1 -- 172.21.15.84:0/2538304036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e810fef0 msgr2=0x7f10e81a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10e7e00640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e810fef0 0x7f10e81a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10e7e00640 1 -- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 msgr2=0x7f10e819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10e7e00640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10e7e00640 1 -- 172.21.15.84:0/2538304036 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e81a2440 con 0x7f10e8076100 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.727+0000 7f10ed200640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.728+0000 7f10e7e00640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e8076100 0x7f10e819ca70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f10d400e9c0 tx=0x7f10d400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.728+0000 7f10e5600640 1 -- 172.21.15.84:0/2538304036 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d400ccc0 con 0x7f10e8076100 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.728+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e81a2730 con 0x7f10e8076100 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.728+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e81a8e90 con 0x7f10e8076100 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.728+0000 7f10e5600640 1 -- 172.21.15.84:0/2538304036 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d40035f0 con 0x7f10e8076100 2024-09-21T07:59:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.728+0000 7f10e5600640 1 -- 172.21.15.84:0/2538304036 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d400ce60 con 0x7f10e8076100 2024-09-21T07:59:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.732+0000 7f10f6811740 1 Processor -- start 2024-09-21T07:59:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.732+0000 7f10f6811740 1 -- start start 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10f6811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f2627cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10f6811740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2628230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10f6811740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f2628770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10f6811740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5587f259ef70 con 0x5587f2260390 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10f6811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5587f258e3a0 con 0x5587f2281070 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10f6811740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5587f25921b0 con 0x5587f22581b0 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10edc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f2627cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10edc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f2627cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57542/0 (socket says 172.21.15.84:57542) 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10edc00640 1 -- 172.21.15.84:0/23646078 learned_addr learned my addr 172.21.15.84:0/23646078 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10ed200640 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2628230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10edc00640 1 -- 172.21.15.84:0/23646078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 msgr2=0x5587f2628230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:32.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10e5600640 1 -- 172.21.15.84:0/2538304036 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f10d4010650 con 0x7f10e8076100 2024-09-21T07:59:32.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10edc00640 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2628230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10edc00640 1 -- 172.21.15.84:0/23646078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 msgr2=0x5587f2628770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:59:32.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.733+0000 7f10edc00640 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f2628770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.734+0000 7f10edc00640 1 -- 172.21.15.84:0/23646078 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587f2558c90 con 0x5587f2281070 2024-09-21T07:59:32.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.734+0000 7f10edc00640 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f2627cf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009fd0 tx=0x7f10e00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f74b940f28a83c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.734+0000 7f10da000640 1 -- 172.21.15.84:0/23646078 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0004d20 con 0x5587f2281070 2024-09-21T07:59:32.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.734+0000 7f10da000640 1 -- 172.21.15.84:0/23646078 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e0004050 con 0x5587f2281070 2024-09-21T07:59:32.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.734+0000 7f10da000640 1 -- 172.21.15.84:0/23646078 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0005280 con 0x5587f2281070 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 -- 172.21.15.84:0/23646078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 msgr2=0x5587f2627cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f2627cf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009fd0 tx=0x7f10e00118d0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10e5600640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10d00b6700 0x7f10d00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 -- 172.21.15.84:0/23646078 shutdown_connections 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f2628770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2628230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 --2- 172.21.15.84:0/23646078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f2627cf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 -- 172.21.15.84:0/23646078 >> 172.21.15.84:0/23646078 conn(0x5587f2275460 msgr2=0x5587f2625b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10e5600640 1 -- 172.21.15.84:0/2538304036 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f10d40e7b40 con 0x7f10e8076100 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10f6811740 1 -- 172.21.15.84:0/23646078 shutdown_connections 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.735+0000 7f10ed200640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10d00b6700 0x7f10d00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.736+0000 7f10f6811740 1 -- 172.21.15.84:0/23646078 wait complete. 2024-09-21T07:59:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.736+0000 7f10ed200640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10d00b6700 0x7f10d00b8c10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f10dc031440 tx=0x7f10dc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.736+0000 7f10f6811740 1 -- start start 2024-09-21T07:59:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 1 Processor -- start 2024-09-21T07:59:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f26338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2633e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f263f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5587f23ef700 con 0x5587f2281070 2024-09-21T07:59:32.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5587f2529540 con 0x5587f22581b0 2024-09-21T07:59:32.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5587f26364d0 con 0x5587f2260390 2024-09-21T07:59:32.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10f6811740 10 client.0 _ll_register_callbacks cb 0x5587f2539430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10ed200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f26338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10e7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2633e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10edc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f263f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10ed200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f26338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57552/0 (socket says 172.21.15.84:57552) 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.737+0000 7f10ed200640 1 -- 172.21.15.84:0/3404601233 learned_addr learned my addr 172.21.15.84:0/3404601233 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10e7e00640 1 -- 172.21.15.84:0/3404601233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 msgr2=0x5587f26338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10e7e00640 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f26338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10e7e00640 1 -- 172.21.15.84:0/3404601233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 msgr2=0x5587f263f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10e7e00640 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f263f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10e7e00640 1 -- 172.21.15.84:0/3404601233 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587f22ec650 con 0x5587f2260390 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10e7e00640 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2633e00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f10d40e4f00 tx=0x7f10d40b6f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5e35f5c4d896289 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10cea00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.738+0000 7f10cea00640 1 -- 172.21.15.84:0/3404601233 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d40add00 con 0x5587f2260390 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10cea00640 1 -- 172.21.15.84:0/3404601233 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f10d40ac2d0 con 0x5587f2260390 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587f252bb50 con 0x5587f2260390 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10cea00640 1 -- 172.21.15.84:0/3404601233 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f10d40c8050 con 0x5587f2260390 2024-09-21T07:59:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 10 client.27721 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5587f2546910 con 0x5587f2260390 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10cea00640 1 -- 172.21.15.84:0/3404601233 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5587f252bb50 con 0x5587f2260390 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10cea00640 1 -- 172.21.15.84:0/3404601233 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f10d40b6560 con 0x5587f2260390 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 10 client.27721 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 10 client.27721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 20 client.27721 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f223f9f0 0x5587f2645950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 4 client.27721 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.739+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587f25a0ec0 con 0x5587f223f9f0 2024-09-21T07:59:32.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.740+0000 7f10ed200640 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f223f9f0 0x5587f2645950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.741+0000 7f10cea00640 10 client.27721 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:32.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.741+0000 7f10ed200640 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f223f9f0 0x5587f2645950 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d8d626ac43d4f06 server_cookie=69ab466cb08d957f in_seq=0 out_seq=0 2024-09-21T07:59:32.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.741+0000 7f10cea00640 1 -- 172.21.15.84:0/3404601233 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5587f25a0ec0 con 0x5587f223f9f0 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.741+0000 7f10cea00640 10 client.27721 handle_command_reply: tid=0 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.741+0000 7f10f6811740 1 client.27721 shutdown 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 msgr2=0x5587f2633e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2633e00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f10d40e4f00 tx=0x7f10d40b6f30 comp rx=0 tx=0).stop 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 shutdown_connections 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f263f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f223f9f0 0x5587f2645950 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2633e00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 --2- 172.21.15.84:0/3404601233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f26338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 >> 172.21.15.84:0/3404601233 conn(0x5587f2275460 msgr2=0x5587f262ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10cea00640 0 client.27721 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 shutdown_connections 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 1 -- 172.21.15.84:0/3404601233 wait complete. 2024-09-21T07:59:32.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.742+0000 7f10f6811740 20 client.27721 trim_cache size 0 max 16384 2024-09-21T07:59:32.748 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:32 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/348561491' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:32.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.761+0000 7f10f6811740 1 Processor -- start 2024-09-21T07:59:32.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.761+0000 7f10f6811740 1 -- start start 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10f6811740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2625b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10f6811740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f263f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10f6811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f263fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10f6811740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10c800feb0 con 0x5587f2260390 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10f6811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80119f0 con 0x5587f2281070 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10f6811740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8010580 con 0x5587f22581b0 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f263f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10ed200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2625b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f263f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46600/0 (socket says 172.21.15.84:46600) 2024-09-21T07:59:32.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10e7e00640 1 -- 172.21.15.84:0/2207823398 learned_addr learned my addr 172.21.15.84:0/2207823398 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:32.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10edc00640 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f263fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10e7e00640 1 -- 172.21.15.84:0/2207823398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 msgr2=0x5587f2625b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10e7e00640 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2625b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10e7e00640 1 -- 172.21.15.84:0/2207823398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 msgr2=0x5587f263fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.762+0000 7f10e7e00640 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f263fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.763+0000 7f10e7e00640 1 -- 172.21.15.84:0/2207823398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587f261fd80 con 0x5587f2260390 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.763+0000 7f10ed200640 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2625b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.763+0000 7f10e7e00640 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f263f720 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f10d40ad300 tx=0x7f10d40ad4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17a9799c90707e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.763+0000 7f10d9600640 1 -- 172.21.15.84:0/2207823398 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d40cc030 con 0x5587f2260390 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.763+0000 7f10d9600640 1 -- 172.21.15.84:0/2207823398 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d40add00 con 0x5587f2260390 2024-09-21T07:59:32.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.763+0000 7f10d9600640 1 -- 172.21.15.84:0/2207823398 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d40ac2d0 con 0x5587f2260390 2024-09-21T07:59:32.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 -- 172.21.15.84:0/2207823398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 msgr2=0x5587f263f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f263f720 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f10d40ad300 tx=0x7f10d40ad4a0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 -- 172.21.15.84:0/2207823398 shutdown_connections 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f2281070 0x5587f263fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2260390 0x5587f263f720 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 --2- 172.21.15.84:0/2207823398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f22581b0 0x5587f2625b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 -- 172.21.15.84:0/2207823398 >> 172.21.15.84:0/2207823398 conn(0x5587f2275460 msgr2=0x5587f2625410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 -- 172.21.15.84:0/2207823398 shutdown_connections 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.764+0000 7f10f6811740 1 -- 172.21.15.84:0/2207823398 wait complete. 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.765+0000 7f10f6811740 1 -- start start 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.765+0000 7f10f6811740 1 Processor -- start 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.765+0000 7f10f6811740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f263be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.765+0000 7f10f6811740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2636740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.765+0000 7f10f6811740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f2636c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10f6811740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8011320 con 0x5587f2281070 2024-09-21T07:59:32.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10f6811740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8010c50 con 0x5587f22581b0 2024-09-21T07:59:32.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10f6811740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f10c800deb0 con 0x5587f2260390 2024-09-21T07:59:32.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10f6811740 10 client.0 _ll_register_callbacks cb 0x7f10d40a9aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10ed200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f263be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10ed200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f263be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57580/0 (socket says 172.21.15.84:57580) 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10ed200640 1 -- 172.21.15.84:0/3616071566 learned_addr learned my addr 172.21.15.84:0/3616071566 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10edc00640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f2636c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10e7e00640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2636740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10edc00640 1 -- 172.21.15.84:0/3616071566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 msgr2=0x5587f2636740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10edc00640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2636740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10edc00640 1 -- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 msgr2=0x5587f263be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10edc00640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f263be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10edc00640 1 -- 172.21.15.84:0/3616071566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587f26372c0 con 0x5587f2281070 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10ed200640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f263be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.766+0000 7f10e7e00640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2636740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10edc00640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f2636c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009fa0 tx=0x7f10e0004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1030408b5f34d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10cea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10cea00640 1 -- 172.21.15.84:0/3616071566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0009c50 con 0x5587f2281070 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10cea00640 1 -- 172.21.15.84:0/3616071566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f10e0004050 con 0x5587f2281070 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10d40add00 con 0x5587f2281070 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10cea00640 1 -- 172.21.15.84:0/3616071566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f10e0004250 con 0x5587f2281070 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10f6811740 10 client.17352 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.767+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5587f26b10d0 con 0x5587f2281070 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10cea00640 1 -- 172.21.15.84:0/3616071566 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d40add00 con 0x5587f2281070 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10cea00640 1 -- 172.21.15.84:0/3616071566 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f10e00056d0 con 0x5587f2281070 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10f6811740 10 client.17352 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10f6811740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10f6811740 20 client.17352 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10f6811740 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f2214da0 0x5587f26b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10f6811740 4 client.17352 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5587f259c970 con 0x5587f2214da0 2024-09-21T07:59:32.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.768+0000 7f10ed200640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f2214da0 0x5587f26b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:32.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10ed200640 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f2214da0 0x5587f26b35b0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a4e1996d1ac69d server_cookie=eeb25e7345e82ede in_seq=0 out_seq=0 2024-09-21T07:59:32.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10cea00640 10 client.17352 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10cea00640 1 -- 172.21.15.84:0/3616071566 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x5587f259c970 con 0x5587f2214da0 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10cea00640 10 client.17352 handle_command_reply: tid=0 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10f6811740 1 client.17352 shutdown 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 msgr2=0x5587f2636c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10f6811740 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f2636c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009fa0 tx=0x7f10e0004c30 comp rx=0 tx=0).stop 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 shutdown_connections 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10f6811740 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5587f2281070 0x5587f2636c80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.769+0000 7f10f6811740 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5587f2214da0 0x5587f26b35b0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.770+0000 7f10f6811740 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587f2260390 0x5587f2636740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.770+0000 7f10f6811740 1 --2- 172.21.15.84:0/3616071566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5587f22581b0 0x5587f263be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.770+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 >> 172.21.15.84:0/3616071566 conn(0x5587f2275460 msgr2=0x5587f2628c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.770+0000 7f10cea00640 0 client.17352 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.770+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 shutdown_connections 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.770+0000 7f10f6811740 1 -- 172.21.15.84:0/3616071566 wait complete. 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.770+0000 7f10f6811740 20 client.17352 trim_cache size 0 max 16384 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "150c51d9-ea54-433e-a9e2-a91577daa093", 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:32.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.776 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.777 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T07:59:32.778 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.779 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T07:59:32.781 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10d00b6700 msgr2=0x7f10d00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10d00b6700 0x7f10d00b8c10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f10dc031440 tx=0x7f10dc0058d0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e8076100 msgr2=0x7f10e819ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:32.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e8076100 0x7f10e819ca70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f10d400e9c0 tx=0x7f10d400ee80 comp rx=0 tx=0).stop 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 shutdown_connections 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10d00b6700 0x7f10d00b8c10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e810fef0 0x7f10e81a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e8076100 0x7f10e819ca70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 --2- 172.21.15.84:0/2538304036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10e80757b0 0x7f10e819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 >> 172.21.15.84:0/2538304036 conn(0x7f10e80ff3e0 msgr2=0x7f10e8109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 shutdown_connections 2024-09-21T07:59:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:32.771+0000 7f10ee600640 1 -- 172.21.15.84:0/2538304036 wait complete. 2024-09-21T07:59:32.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:32 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/348561491' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:32.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:32 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/348561491' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:33.502 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T07:59:33.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T07:59:33.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:33 smithi162 ceph-mon[34833]: pgmap v653: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 21 KiB/s rd, 4.1 MiB/s wr, 48 op/s 2024-09-21T07:59:33.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:33 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T07:59:33.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:33 smithi084 ceph-mon[30411]: pgmap v653: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 21 KiB/s rd, 4.1 MiB/s wr, 48 op/s 2024-09-21T07:59:33.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:33 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T07:59:33.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:33 smithi191 ceph-mon[34667]: pgmap v653: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 21 KiB/s rd, 4.1 MiB/s wr, 48 op/s 2024-09-21T07:59:33.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:33 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T07:59:34.030 INFO:tasks.cephfs.filesystem:scrub status for tag:150c51d9-ea54-433e-a9e2-a91577daa093 - {'path': '/', 'tag': '150c51d9-ea54-433e-a9e2-a91577daa093', 'options': 'recursive,force'} 2024-09-21T07:59:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:34.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 -- 172.21.15.84:0/2525814239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 msgr2=0x7fe2341061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 --2- 172.21.15.84:0/2525814239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 0x7fe2341061d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe224009900 tx=0x7fe22402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 -- 172.21.15.84:0/2525814239 shutdown_connections 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 --2- 172.21.15.84:0/2525814239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe23410c050 0x7fe234112880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 --2- 172.21.15.84:0/2525814239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe23410b700 0x7fe23410bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 --2- 172.21.15.84:0/2525814239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 0x7fe2341061d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 -- 172.21.15.84:0/2525814239 >> 172.21.15.84:0/2525814239 conn(0x7fe2341017d0 msgr2=0x7fe234103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 -- 172.21.15.84:0/2525814239 shutdown_connections 2024-09-21T07:59:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.837+0000 7fe23bc00640 1 -- 172.21.15.84:0/2525814239 wait complete. 2024-09-21T07:59:34.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.838+0000 7fe23bc00640 1 Processor -- start 2024-09-21T07:59:34.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.838+0000 7fe23bc00640 1 -- start start 2024-09-21T07:59:34.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe23bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 0x7fe23419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe23bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe23410b700 0x7fe23419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe23bc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe23410c050 0x7fe2341a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe23bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe234115d60 con 0x7fe234105dc0 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe23bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe234115be0 con 0x7fe23410b700 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe23bc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe234115ee0 con 0x7fe23410c050 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe239200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 0x7fe23419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe239200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 0x7fe23419c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46622/0 (socket says 172.21.15.84:46622) 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe22be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe23410b700 0x7fe23419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe239200640 1 -- 172.21.15.84:0/473673999 learned_addr learned my addr 172.21.15.84:0/473673999 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.839+0000 7fe239c00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe23410c050 0x7fe2341a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe22be00640 1 -- 172.21.15.84:0/473673999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe23410c050 msgr2=0x7fe2341a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe22be00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe23410c050 0x7fe2341a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe22be00640 1 -- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 msgr2=0x7fe23419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe22be00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 0x7fe23419c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe22be00640 1 -- 172.21.15.84:0/473673999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2341a2660 con 0x7fe23410b700 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe22be00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe23410b700 0x7fe23419cc90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe23406c940 tx=0x7fe21c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe232000640 1 -- 172.21.15.84:0/473673999 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00cc40 con 0x7fe23410b700 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe232000640 1 -- 172.21.15.84:0/473673999 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c00cde0 con 0x7fe23410b700 2024-09-21T07:59:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe232000640 1 -- 172.21.15.84:0/473673999 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c018780 con 0x7fe23410b700 2024-09-21T07:59:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.840+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2341a2950 con 0x7fe23410b700 2024-09-21T07:59:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.841+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2341a90b0 con 0x7fe23410b700 2024-09-21T07:59:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 Processor -- start 2024-09-21T07:59:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 -- start start 2024-09-21T07:59:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae57c850 0x55bcae9239b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae923ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe232000640 1 -- 172.21.15.84:0/473673999 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe21c010a90 con 0x7fe23410b700 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae55bb70 0x55bcae924430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bcae899a90 con 0x55bcae57c850 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bcae888ec0 con 0x55bcae553990 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe24281b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55bcae88ccd0 con 0x55bcae55bb70 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe239c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae57c850 0x55bcae9239b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe239c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae57c850 0x55bcae9239b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46638/0 (socket says 172.21.15.84:46638) 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.844+0000 7fe239c00640 1 -- 172.21.15.84:0/1302676282 learned_addr learned my addr 172.21.15.84:0/1302676282 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.845+0000 7fe22be00640 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae55bb70 0x55bcae924430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.845+0000 7fe239200640 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae923ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.845+0000 7fe239c00640 1 -- 172.21.15.84:0/1302676282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae55bb70 msgr2=0x55bcae924430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.845+0000 7fe239c00640 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae55bb70 0x55bcae924430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.845+0000 7fe239c00640 1 -- 172.21.15.84:0/1302676282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 msgr2=0x55bcae923ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.845+0000 7fe239c00640 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae923ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.845+0000 7fe239c00640 1 -- 172.21.15.84:0/1302676282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcae82e9d0 con 0x55bcae57c850 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.846+0000 7fe239c00640 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae57c850 0x55bcae9239b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe22c010370 tx=0x7fe22c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b869aacde0f593e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.846+0000 7fe22a000640 1 -- 172.21.15.84:0/1302676282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c016070 con 0x55bcae57c850 2024-09-21T07:59:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.846+0000 7fe232000640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2180b6680 0x7fe2180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.846+0000 7fe22a000640 1 -- 172.21.15.84:0/1302676282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe22c004d20 con 0x55bcae57c850 2024-09-21T07:59:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.846+0000 7fe22a000640 1 -- 172.21.15.84:0/1302676282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c005420 con 0x55bcae57c850 2024-09-21T07:59:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.846+0000 7fe232000640 1 -- 172.21.15.84:0/473673999 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7fe21c0e7d50 con 0x7fe23410b700 2024-09-21T07:59:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.846+0000 7fe239200640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2180b6680 0x7fe2180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 -- 172.21.15.84:0/1302676282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae57c850 msgr2=0x55bcae9239b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae57c850 0x55bcae9239b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe22c010370 tx=0x7fe22c010830 comp rx=0 tx=0).stop 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe239200640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2180b6680 0x7fe2180b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55bcae922630 tx=0x7fe224005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 -- 172.21.15.84:0/1302676282 shutdown_connections 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae55bb70 0x55bcae924430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae923ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 --2- 172.21.15.84:0/1302676282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae57c850 0x55bcae9239b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 -- 172.21.15.84:0/1302676282 >> 172.21.15.84:0/1302676282 conn(0x55bcae570c40 msgr2=0x55bcae9218a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 -- 172.21.15.84:0/1302676282 shutdown_connections 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.847+0000 7fe24281b740 1 -- 172.21.15.84:0/1302676282 wait complete. 2024-09-21T07:59:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.848+0000 7fe24281b740 1 -- start start 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.848+0000 7fe24281b740 1 Processor -- start 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe24281b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae92f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe24281b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae92fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe24281b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae57c850 0x55bcae93b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe24281b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bcae6ea7b0 con 0x55bcae55bb70 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe24281b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bcae82d650 con 0x55bcae553990 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe24281b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55bcae932190 con 0x55bcae57c850 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe24281b740 10 client.0 _ll_register_callbacks cb 0x55bcae5940a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe22be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae92fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe22be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae92fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46648/0 (socket says 172.21.15.84:46648) 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe22be00640 1 -- 172.21.15.84:0/4195257008 learned_addr learned my addr 172.21.15.84:0/4195257008 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe239c00640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae57c850 0x55bcae93b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.849+0000 7fe239200640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae92f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe22be00640 1 -- 172.21.15.84:0/4195257008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae57c850 msgr2=0x55bcae93b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe22be00640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae57c850 0x55bcae93b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe22be00640 1 -- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 msgr2=0x55bcae92f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe22be00640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae92f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe22be00640 1 -- 172.21.15.84:0/4195257008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcae5f6ba0 con 0x55bcae55bb70 2024-09-21T07:59:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe239200640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae92f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:59:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe22be00640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae92fa90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00c6a0 tx=0x7fe21c009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ea7fb83327c3d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe222a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe222a00640 1 -- 172.21.15.84:0/4195257008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0a9760 con 0x55bcae55bb70 2024-09-21T07:59:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe222a00640 1 -- 172.21.15.84:0/4195257008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7fe21c0ac590 con 0x55bcae55bb70 2024-09-21T07:59:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.850+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe22c004d20 con 0x55bcae55bb70 2024-09-21T07:59:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe222a00640 1 -- 172.21.15.84:0/4195257008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe21c0ad030 con 0x55bcae55bb70 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 10 client.17364 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bcae93e180 con 0x55bcae55bb70 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe222a00640 1 -- 172.21.15.84:0/4195257008 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe22c004d20 con 0x55bcae55bb70 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe222a00640 1 -- 172.21.15.84:0/4195257008 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe21c0ac790 con 0x55bcae55bb70 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 10 client.17364 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 10 client.17364 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 20 client.17364 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae53b1d0 0x55bcae941630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 4 client.17364 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.851+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcae89b9e0 con 0x55bcae53b1d0 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.852+0000 7fe239200640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae53b1d0 0x55bcae941630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.852+0000 7fe239200640 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae53b1d0 0x55bcae941630 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc20f2e73dee5b8 server_cookie=986acc42b568814 in_seq=0 out_seq=0 2024-09-21T07:59:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.852+0000 7fe222a00640 10 client.17364 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.853+0000 7fe222a00640 1 -- 172.21.15.84:0/4195257008 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcae89b9e0 con 0x55bcae53b1d0 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.853+0000 7fe222a00640 10 client.17364 handle_command_reply: tid=0 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.853+0000 7fe24281b740 1 client.17364 shutdown 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.853+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 msgr2=0x55bcae92fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.853+0000 7fe24281b740 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae92fa90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00c6a0 tx=0x7fe21c009700 comp rx=0 tx=0).stop 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 shutdown_connections 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae53b1d0 0x55bcae941630 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae57c850 0x55bcae93b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae92fa90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 --2- 172.21.15.84:0/4195257008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae553990 0x55bcae92f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 >> 172.21.15.84:0/4195257008 conn(0x55bcae570c40 msgr2=0x55bcae926b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe222a00640 0 client.17364 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 shutdown_connections 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 1 -- 172.21.15.84:0/4195257008 wait complete. 2024-09-21T07:59:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.854+0000 7fe24281b740 20 client.17364 trim_cache size 0 max 16384 2024-09-21T07:59:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 Processor -- start 2024-09-21T07:59:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 -- start start 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae931230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae93b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae93b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe2341b3130 con 0x55bcae55bb70 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2341b4c70 con 0x55bcae57c850 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.872+0000 7fe24281b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe2341b3800 con 0x55bcae553990 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe22be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae93b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae931230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae931230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:41830/0 (socket says 172.21.15.84:41830) 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 -- 172.21.15.84:0/1129067657 learned_addr learned my addr 172.21.15.84:0/1129067657 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239c00640 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae93b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 -- 172.21.15.84:0/1129067657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 msgr2=0x55bcae93b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae93b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 -- 172.21.15.84:0/1129067657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 msgr2=0x55bcae93b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae93b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 -- 172.21.15.84:0/1129067657 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcae92d850 con 0x55bcae553990 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.873+0000 7fe239200640 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae931230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe22402a9e0 tx=0x7fe224040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=130fff6bb2542cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.874+0000 7fe229600640 1 -- 172.21.15.84:0/1129067657 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224056070 con 0x55bcae553990 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.874+0000 7fe229600640 1 -- 172.21.15.84:0/1129067657 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe224031950 con 0x55bcae553990 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.874+0000 7fe229600640 1 -- 172.21.15.84:0/1129067657 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224035040 con 0x55bcae553990 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.874+0000 7fe24281b740 1 -- 172.21.15.84:0/1129067657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 msgr2=0x55bcae931230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.874+0000 7fe24281b740 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae931230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe22402a9e0 tx=0x7fe224040000 comp rx=0 tx=0).stop 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 -- 172.21.15.84:0/1129067657 shutdown_connections 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae93b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae93b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 --2- 172.21.15.84:0/1129067657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae931230 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 -- 172.21.15.84:0/1129067657 >> 172.21.15.84:0/1129067657 conn(0x55bcae570c40 msgr2=0x55bcae91ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 -- 172.21.15.84:0/1129067657 shutdown_connections 2024-09-21T07:59:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 -- 172.21.15.84:0/1129067657 wait complete. 2024-09-21T07:59:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 -- start start 2024-09-21T07:59:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.875+0000 7fe24281b740 1 Processor -- start 2024-09-21T07:59:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe24281b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae937900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe24281b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae933e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe24281b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae934350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe24281b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe2341b45a0 con 0x55bcae55bb70 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe24281b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2341b3ed0 con 0x55bcae57c850 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe24281b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe2341b1130 con 0x55bcae553990 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe24281b740 10 client.0 _ll_register_callbacks cb 0x7fe21c0eb590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe239200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae937900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe239200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae937900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:41840/0 (socket says 172.21.15.84:41840) 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe239200640 1 -- 172.21.15.84:0/3131544425 learned_addr learned my addr 172.21.15.84:0/3131544425 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe22be00640 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae933e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.876+0000 7fe239c00640 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae934350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe239200640 1 -- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 msgr2=0x55bcae934350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe239200640 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae934350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe239200640 1 -- 172.21.15.84:0/3131544425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 msgr2=0x55bcae933e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe239200640 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae933e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe239200640 1 -- 172.21.15.84:0/3131544425 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcae934890 con 0x55bcae553990 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe239200640 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae937900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe2240095d0 tx=0x7fe22402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d9978c69757bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe222a00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe222a00640 1 -- 172.21.15.84:0/3131544425 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22405f060 con 0x55bcae553990 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe222a00640 1 -- 172.21.15.84:0/3131544425 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7fe2240316b0 con 0x55bcae553990 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.877+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe224031950 con 0x55bcae553990 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe222a00640 1 -- 172.21.15.84:0/3131544425 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe224056070 con 0x55bcae553990 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 10 client.27745 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bcae9b5430 con 0x55bcae553990 2024-09-21T07:59:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe222a00640 1 -- 172.21.15.84:0/3131544425 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe224031950 con 0x55bcae553990 2024-09-21T07:59:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe222a00640 1 -- 172.21.15.84:0/3131544425 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe224044040 con 0x55bcae553990 2024-09-21T07:59:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 10 client.27745 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 10 client.27745 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:59:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 20 client.27745 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae510580 0x55bcae9b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 4 client.27745 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T07:59:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.878+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x55bcae897490 con 0x55bcae510580 2024-09-21T07:59:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.879+0000 7fe22be00640 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae510580 0x55bcae9b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.879+0000 7fe222a00640 10 client.27745 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.879+0000 7fe22be00640 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae510580 0x55bcae9b7be0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0d6c4c664edd2d server_cookie=c6e6a5858562859a in_seq=0 out_seq=0 2024-09-21T07:59:34.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe222a00640 1 -- 172.21.15.84:0/3131544425 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bcae897490 con 0x55bcae510580 2024-09-21T07:59:34.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe222a00640 10 client.27745 handle_command_reply: tid=0 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 client.27745 shutdown 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 msgr2=0x55bcae937900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae937900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe2240095d0 tx=0x7fe22402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 shutdown_connections 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcae57c850 0x55bcae934350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcae55bb70 0x55bcae933e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55bcae510580 0x55bcae9b7be0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 --2- 172.21.15.84:0/3131544425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bcae553990 0x55bcae937900 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe222a00640 0 client.27745 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 >> 172.21.15.84:0/3131544425 conn(0x55bcae570c40 msgr2=0x55bcae930650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 shutdown_connections 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 1 -- 172.21.15.84:0/3131544425 wait complete. 2024-09-21T07:59:34.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.897+0000 7fe24281b740 20 client.27745 trim_cache size 0 max 16384 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 30, 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "3a7006d1": { 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 30, 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:59:34.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 141.1, 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:34.902 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2180b6680 msgr2=0x7fe2180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2180b6680 0x7fe2180b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55bcae922630 tx=0x7fe224005a20 comp rx=0 tx=0).stop 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe23410b700 msgr2=0x7fe23419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe23410b700 0x7fe23419cc90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe23406c940 tx=0x7fe21c00ee50 comp rx=0 tx=0).stop 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 shutdown_connections 2024-09-21T07:59:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe2180b6680 0x7fe2180b8b90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe23410c050 0x7fe2341a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe23410b700 0x7fe23419cc90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 --2- 172.21.15.84:0/473673999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe234105dc0 0x7fe23419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 >> 172.21.15.84:0/473673999 conn(0x7fe2341017d0 msgr2=0x7fe234104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 shutdown_connections 2024-09-21T07:59:34.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:34.898+0000 7fe23bc00640 1 -- 172.21.15.84:0/473673999 wait complete. 2024-09-21T07:59:35.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:35 smithi162 ceph-mon[34833]: pgmap v654: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-09-21T07:59:35.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:35 smithi084 ceph-mon[30411]: pgmap v654: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-09-21T07:59:35.861 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3a7006d1', quiesce took 6.2 seconds. Will release after: 14.850000000000001 2024-09-21T07:59:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:35 smithi191 ceph-mon[34667]: pgmap v654: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-09-21T07:59:37.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:37 smithi162 ceph-mon[34833]: pgmap v655: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 KiB/s wr, 15 op/s 2024-09-21T07:59:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:37 smithi084 ceph-mon[30411]: pgmap v655: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 KiB/s wr, 15 op/s 2024-09-21T07:59:37.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:37 smithi191 ceph-mon[34667]: pgmap v655: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 KiB/s wr, 15 op/s 2024-09-21T07:59:39.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:39 smithi162 ceph-mon[34833]: pgmap v656: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2024-09-21T07:59:39.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:39 smithi084 ceph-mon[30411]: pgmap v656: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2024-09-21T07:59:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:39 smithi191 ceph-mon[34667]: pgmap v656: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2024-09-21T07:59:41.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:41 smithi162 ceph-mon[34833]: pgmap v657: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-09-21T07:59:41.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:41 smithi084 ceph-mon[30411]: pgmap v657: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-09-21T07:59:41.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:41 smithi191 ceph-mon[34667]: pgmap v657: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-09-21T07:59:43.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:43 smithi162 ceph-mon[34833]: pgmap v658: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 8.1 KiB/s wr, 13 op/s 2024-09-21T07:59:43.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:43 smithi084 ceph-mon[30411]: pgmap v658: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 8.1 KiB/s wr, 13 op/s 2024-09-21T07:59:43.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:43 smithi191 ceph-mon[34667]: pgmap v658: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 8.1 KiB/s wr, 13 op/s 2024-09-21T07:59:45.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:45 smithi162 ceph-mon[34833]: pgmap v659: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-09-21T07:59:45.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:45 smithi084 ceph-mon[30411]: pgmap v659: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-09-21T07:59:45.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:45 smithi191 ceph-mon[34667]: pgmap v659: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-09-21T07:59:47.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:47 smithi162 ceph-mon[34833]: pgmap v660: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 13 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:59:47.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:47 smithi084 ceph-mon[30411]: pgmap v660: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 13 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:59:47.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:47 smithi191 ceph-mon[34667]: pgmap v660: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 13 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:59:49.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:49 smithi084 ceph-mon[30411]: pgmap v661: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T07:59:49.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:49 smithi191 ceph-mon[34667]: pgmap v661: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T07:59:50.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:49 smithi162 ceph-mon[34833]: pgmap v661: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T07:59:50.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:59:51.093 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:51.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 -- 172.21.15.84:0/4132983404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 msgr2=0x7fbc6c110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 --2- 172.21.15.84:0/4132983404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 0x7fbc6c110660 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009ca0 tx=0x7fbc6402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 -- 172.21.15.84:0/4132983404 shutdown_connections 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 --2- 172.21.15.84:0/4132983404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 0x7fbc6c110660 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 --2- 172.21.15.84:0/4132983404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c1094e0 0x7fbc6c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 --2- 172.21.15.84:0/4132983404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 0x7fbc6c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 -- 172.21.15.84:0/4132983404 >> 172.21.15.84:0/4132983404 conn(0x7fbc6c0ff5f0 msgr2=0x7fbc6c101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 -- 172.21.15.84:0/4132983404 shutdown_connections 2024-09-21T07:59:51.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.710+0000 7fbc71c00640 1 -- 172.21.15.84:0/4132983404 wait complete. 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.711+0000 7fbc71c00640 1 Processor -- start 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc71c00640 1 -- start start 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc71c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 0x7fbc6c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc71c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c1094e0 0x7fbc6c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc71c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 0x7fbc6c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc71c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c113b40 con 0x7fbc6c109e30 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc71c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1139c0 con 0x7fbc6c1094e0 2024-09-21T07:59:51.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc71c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c113cc0 con 0x7fbc6c103ba0 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc6aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 0x7fbc6c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc62000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c1094e0 0x7fbc6c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc6b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 0x7fbc6c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc6aa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 0x7fbc6c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39376/0 (socket says 172.21.15.84:39376) 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.712+0000 7fbc6aa00640 1 -- 172.21.15.84:0/3304722466 learned_addr learned my addr 172.21.15.84:0/3304722466 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.713+0000 7fbc6aa00640 1 -- 172.21.15.84:0/3304722466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c1094e0 msgr2=0x7fbc6c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.713+0000 7fbc6aa00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c1094e0 0x7fbc6c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.713+0000 7fbc6aa00640 1 -- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 msgr2=0x7fbc6c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.713+0000 7fbc6aa00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 0x7fbc6c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.713+0000 7fbc6aa00640 1 -- 172.21.15.84:0/3304722466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c1a03c0 con 0x7fbc6c103ba0 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.713+0000 7fbc62000640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c1094e0 0x7fbc6c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.713+0000 7fbc6aa00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 0x7fbc6c19a450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e9f0 tx=0x7fbc5c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.714+0000 7fbc63e00640 1 -- 172.21.15.84:0/3304722466 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00cd80 con 0x7fbc6c103ba0 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.714+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6c1a06b0 con 0x7fbc6c103ba0 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.714+0000 7fbc63e00640 1 -- 172.21.15.84:0/3304722466 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc5c0054d0 con 0x7fbc6c103ba0 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.714+0000 7fbc63e00640 1 -- 172.21.15.84:0/3304722466 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c010690 con 0x7fbc6c103ba0 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.714+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6c0755f0 con 0x7fbc6c103ba0 2024-09-21T07:59:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.715+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc6c103fb0 con 0x7fbc6c103ba0 2024-09-21T07:59:51.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.718+0000 7fbc63e00640 1 -- 172.21.15.84:0/3304722466 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fbc5c004e30 con 0x7fbc6c103ba0 2024-09-21T07:59:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.719+0000 7fbc63e00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc500b6680 0x7fbc500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.719+0000 7fbc63e00640 1 -- 172.21.15.84:0/3304722466 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7fbc5c0e80f0 con 0x7fbc6c103ba0 2024-09-21T07:59:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.719+0000 7fbc62000640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc500b6680 0x7fbc500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:51.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.720+0000 7fbc62000640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc500b6680 0x7fbc500b8b90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c102cf0 tx=0x7fbc54005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:51.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.721+0000 7fbc63e00640 1 -- 172.21.15.84:0/3304722466 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc5c0ae250 con 0x7fbc6c103ba0 2024-09-21T07:59:51.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:51 smithi084 ceph-mon[30411]: pgmap v662: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:59:51.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:51 smithi191 ceph-mon[34667]: pgmap v662: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:59:51.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.946+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc6c19b580 con 0x7fbc6c103ba0 2024-09-21T07:59:51.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.947+0000 7fbc63e00640 1 -- 172.21.15.84:0/3304722466 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fbc5c0b2630 con 0x7fbc6c103ba0 2024-09-21T07:59:51.949 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:59:51.949 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:59:51.950 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.949+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc500b6680 msgr2=0x7fbc500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.949+0000 7fbc71c00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc500b6680 0x7fbc500b8b90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c102cf0 tx=0x7fbc54005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.949+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 msgr2=0x7fbc6c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.949+0000 7fbc71c00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 0x7fbc6c19a450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e9f0 tx=0x7fbc5c00edf0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 shutdown_connections 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fbc500b6680 0x7fbc500b8b90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbc6c109e30 0x7fbc6c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c1094e0 0x7fbc6c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 --2- 172.21.15.84:0/3304722466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc6c103ba0 0x7fbc6c19a450 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 >> 172.21.15.84:0/3304722466 conn(0x7fbc6c0ff5f0 msgr2=0x7fbc6c106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 shutdown_connections 2024-09-21T07:59:51.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:51.950+0000 7fbc71c00640 1 -- 172.21.15.84:0/3304722466 wait complete. 2024-09-21T07:59:52.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:51 smithi162 ceph-mon[34833]: pgmap v662: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T07:59:52.785 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:52 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3304722466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:52.822 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 3a7006d1 --release --await' 2024-09-21T07:59:52.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 3a7006d1 --release --await 2024-09-21T07:59:52.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:52 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3304722466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:53.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:52 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3304722466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:53.656 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:53 smithi084 ceph-mon[30411]: pgmap v663: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-21T07:59:53.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 -- 172.21.15.84:0/4073423122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010b6c0 msgr2=0x7f727010bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 --2- 172.21.15.84:0/4073423122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010b6c0 0x7f727010bad0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7258009900 tx=0x7f725802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 -- 172.21.15.84:0/4073423122 shutdown_connections 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 --2- 172.21.15.84:0/4073423122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010c010 0x7f7270112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 --2- 172.21.15.84:0/4073423122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010b6c0 0x7f727010bad0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 --2- 172.21.15.84:0/4073423122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7270105d80 0x7f7270106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 -- 172.21.15.84:0/4073423122 >> 172.21.15.84:0/4073423122 conn(0x7f7270101810 msgr2=0x7f7270103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 -- 172.21.15.84:0/4073423122 shutdown_connections 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.835+0000 7f7275200640 1 -- 172.21.15.84:0/4073423122 wait complete. 2024-09-21T07:59:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 Processor -- start 2024-09-21T07:59:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 -- start start 2024-09-21T07:59:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7270105d80 0x7f727019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010b6c0 0x7f727019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010c010 0x7f72701a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7270115cd0 con 0x7f727010c010 2024-09-21T07:59:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7270115b50 con 0x7f7270105d80 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.837+0000 7f7275200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7270115e50 con 0x7f727010b6c0 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010b6c0 0x7f727019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010b6c0 0x7f727019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39384/0 (socket says 172.21.15.84:39384) 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 -- 172.21.15.84:0/3201179932 learned_addr learned my addr 172.21.15.84:0/3201179932 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f726de00640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7270105d80 0x7f727019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f726e800640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010c010 0x7f72701a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 -- 172.21.15.84:0/3201179932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7270105d80 msgr2=0x7f727019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7270105d80 0x7f727019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 -- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010c010 msgr2=0x7f72701a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010c010 0x7f72701a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.838+0000 7f7265400640 1 -- 172.21.15.84:0/3201179932 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72701a2610 con 0x7f727010b6c0 2024-09-21T07:59:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.839+0000 7f7265400640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010b6c0 0x7f727019cc40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f725802a930 tx=0x7f7258031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.839+0000 7f7267400640 1 -- 172.21.15.84:0/3201179932 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725803f030 con 0x7f727010b6c0 2024-09-21T07:59:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.839+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72701a28a0 con 0x7f727010b6c0 2024-09-21T07:59:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.839+0000 7f7267400640 1 -- 172.21.15.84:0/3201179932 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7258004490 con 0x7f727010b6c0 2024-09-21T07:59:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.839+0000 7f7267400640 1 -- 172.21.15.84:0/3201179932 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258035070 con 0x7f727010b6c0 2024-09-21T07:59:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.839+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72701a9060 con 0x7f727010b6c0 2024-09-21T07:59:53.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 Processor -- start 2024-09-21T07:59:53.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 -- start start 2024-09-21T07:59:53.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd2791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd279700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd279c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560ddd1f0290 con 0x560ddcea9660 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560ddd1df6c0 con 0x560ddced2520 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.843+0000 7f727bfc1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560ddd1e34d0 con 0x560ddceb1840 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd279700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd279700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46562/0 (socket says 172.21.15.84:46562) 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 -- 172.21.15.84:0/2600599576 learned_addr learned my addr 172.21.15.84:0/2600599576 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726e800640 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd2791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 -- 172.21.15.84:0/2600599576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 msgr2=0x560ddd279c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:59:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd279c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 -- 172.21.15.84:0/2600599576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 msgr2=0x560ddd2791c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd2791c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f726de00640 1 -- 172.21.15.84:0/2600599576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ddd16c460 con 0x560ddcea9660 2024-09-21T07:59:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.844+0000 7f7267400640 1 -- 172.21.15.84:0/3201179932 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f7258042030 con 0x7f727010b6c0 2024-09-21T07:59:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.845+0000 7f726de00640 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd279700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7260009cf0 tx=0x7f7260011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb481ce009a2cca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.845+0000 7f725f400640 1 -- 172.21.15.84:0/2600599576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260004230 con 0x560ddcea9660 2024-09-21T07:59:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.846+0000 7f725f400640 1 -- 172.21.15.84:0/2600599576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72600043d0 con 0x560ddcea9660 2024-09-21T07:59:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.846+0000 7f725f400640 1 -- 172.21.15.84:0/2600599576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260019880 con 0x560ddcea9660 2024-09-21T07:59:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.846+0000 7f727bfc1740 1 -- 172.21.15.84:0/2600599576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 msgr2=0x560ddd279700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.846+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd279700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7260009cf0 tx=0x7f7260011810 comp rx=0 tx=0).stop 2024-09-21T07:59:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.846+0000 7f7267400640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72540b6700 0x7f72540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f7267400640 1 -- 172.21.15.84:0/3201179932 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f7258107d60 con 0x7f727010b6c0 2024-09-21T07:59:53.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 -- 172.21.15.84:0/2600599576 shutdown_connections 2024-09-21T07:59:53.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd279c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd279700 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2600599576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd2791c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 -- 172.21.15.84:0/2600599576 >> 172.21.15.84:0/2600599576 conn(0x560ddcec6910 msgr2=0x560ddd2770b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f726e800640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72540b6700 0x7f72540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 -- 172.21.15.84:0/2600599576 shutdown_connections 2024-09-21T07:59:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 -- 172.21.15.84:0/2600599576 wait complete. 2024-09-21T07:59:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f727bfc1740 1 -- start start 2024-09-21T07:59:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.847+0000 7f726e800640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72540b6700 0x7f72540b8c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7268005fd0 tx=0x7f7268009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 1 Processor -- start 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd284df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd285330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd290c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560ddd040bb0 con 0x560ddcea9660 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560ddd17a6c0 con 0x560ddced2520 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560ddd2879a0 con 0x560ddceb1840 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f727bfc1740 10 client.0 _ll_register_callbacks cb 0x560ddd195490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f726de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd284df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.848+0000 7f726de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd284df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46570/0 (socket says 172.21.15.84:46570) 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726de00640 1 -- 172.21.15.84:0/2174404839 learned_addr learned my addr 172.21.15.84:0/2174404839 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726e800640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd290c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f7265400640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd285330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726de00640 1 -- 172.21.15.84:0/2174404839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 msgr2=0x560ddd285330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726de00640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd285330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726de00640 1 -- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 msgr2=0x560ddd290c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726de00640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd290c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726de00640 1 -- 172.21.15.84:0/2174404839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ddcf3db00 con 0x560ddcea9660 2024-09-21T07:59:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f7265400640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd285330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f726de00640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd284df0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7260019520 tx=0x7f7260003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7583d77a6f9fc8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.849+0000 7f7253e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.850+0000 7f7253e00640 1 -- 172.21.15.84:0/2174404839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260027070 con 0x560ddcea9660 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.850+0000 7f7253e00640 1 -- 172.21.15.84:0/2174404839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f7260005240 con 0x560ddcea9660 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.850+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72600043d0 con 0x560ddcea9660 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.850+0000 7f7253e00640 1 -- 172.21.15.84:0/2174404839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7260033050 con 0x560ddcea9660 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.850+0000 7f727bfc1740 10 client.17388 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.850+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560ddcfb4960 con 0x560ddcea9660 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.850+0000 7f7253e00640 1 -- 172.21.15.84:0/2174404839 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72600043d0 con 0x560ddcea9660 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f7253e00640 1 -- 172.21.15.84:0/2174404839 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7260004b70 con 0x560ddcea9660 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f727bfc1740 10 client.17388 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f727bfc1740 10 client.17388 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f727bfc1740 20 client.17388 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce90ea0 0x560ddd296bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f727bfc1740 4 client.17388 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ddd1f21e0 con 0x560ddce90ea0 2024-09-21T07:59:53.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.851+0000 7f7265400640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce90ea0 0x560ddd296bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.852+0000 7f7265400640 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce90ea0 0x560ddd296bb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac66fe0c89c89325 server_cookie=ad0746e23d62e200 in_seq=0 out_seq=0 2024-09-21T07:59:53.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.852+0000 7f7253e00640 10 client.17388 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f7253e00640 1 -- 172.21.15.84:0/2174404839 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ddd1f21e0 con 0x560ddce90ea0 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f7253e00640 10 client.17388 handle_command_reply: tid=0 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 client.17388 shutdown 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 msgr2=0x560ddd284df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd284df0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7260019520 tx=0x7f7260003820 comp rx=0 tx=0).stop 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 shutdown_connections 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd290c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce90ea0 0x560ddd296bb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd285330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 --2- 172.21.15.84:0/2174404839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd284df0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 >> 172.21.15.84:0/2174404839 conn(0x560ddcec6910 msgr2=0x560ddd27c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f7253e00640 0 client.17388 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:53.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 shutdown_connections 2024-09-21T07:59:53.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.853+0000 7f727bfc1740 1 -- 172.21.15.84:0/2174404839 wait complete. 2024-09-21T07:59:53.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.854+0000 7f727bfc1740 20 client.17388 trim_cache size 0 max 16384 2024-09-21T07:59:53.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.871+0000 7f727bfc1740 1 Processor -- start 2024-09-21T07:59:53.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.871+0000 7f727bfc1740 1 -- start start 2024-09-21T07:59:53.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd27e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd27e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd27a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f727bfc1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b3090 con 0x560ddcea9660 2024-09-21T07:59:53.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f727bfc1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b4bd0 con 0x560ddced2520 2024-09-21T07:59:53.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f727bfc1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b3760 con 0x560ddceb1840 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd27e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd27e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46576/0 (socket says 172.21.15.84:46576) 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 -- 172.21.15.84:0/3625421377 learned_addr learned my addr 172.21.15.84:0/3625421377 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f7265400640 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd27e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726e800640 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd27a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 -- 172.21.15.84:0/3625421377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 msgr2=0x560ddd27e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd27e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 -- 172.21.15.84:0/3625421377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 msgr2=0x560ddd27a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd27a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.872+0000 7f726de00640 1 -- 172.21.15.84:0/3625421377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ddd2854b0 con 0x560ddcea9660 2024-09-21T07:59:53.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.873+0000 7f726de00640 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd27e440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7260005c20 tx=0x7f7260005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e3cc80e5807efd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.873+0000 7f725ea00640 1 -- 172.21.15.84:0/3625421377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726003c070 con 0x560ddcea9660 2024-09-21T07:59:53.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.873+0000 7f725ea00640 1 -- 172.21.15.84:0/3625421377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7260011d10 con 0x560ddcea9660 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.873+0000 7f725ea00640 1 -- 172.21.15.84:0/3625421377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260027070 con 0x560ddcea9660 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 -- 172.21.15.84:0/3625421377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 msgr2=0x560ddd27e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd27e440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7260005c20 tx=0x7f7260005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 -- 172.21.15.84:0/3625421377 shutdown_connections 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd27a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd27e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3625421377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd27e440 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 -- 172.21.15.84:0/3625421377 >> 172.21.15.84:0/3625421377 conn(0x560ddcec6910 msgr2=0x560ddd2769d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 -- 172.21.15.84:0/3625421377 shutdown_connections 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.874+0000 7f727bfc1740 1 -- 172.21.15.84:0/3625421377 wait complete. 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 -- start start 2024-09-21T07:59:53.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 Processor -- start 2024-09-21T07:59:53.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd28d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd29c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd29c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b4500 con 0x560ddcea9660 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b3e30 con 0x560ddced2520 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b1090 con 0x560ddceb1840 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.875+0000 7f727bfc1740 10 client.0 _ll_register_callbacks cb 0x7f7268009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f726de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd28d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd29c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f726e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd29c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd29c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:39408/0 (socket says 172.21.15.84:39408) 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 -- 172.21.15.84:0/3518490334 learned_addr learned my addr 172.21.15.84:0/3518490334 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 -- 172.21.15.84:0/3518490334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 msgr2=0x560ddd29c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd29c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 -- 172.21.15.84:0/3518490334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 msgr2=0x560ddd28d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd28d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 -- 172.21.15.84:0/3518490334 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ddd289030 con 0x560ddceb1840 2024-09-21T07:59:53.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7265400640 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd29c0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f72580cd570 tx=0x7f7258009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15fc3ac46d39f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.876+0000 7f7253e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f7253e00640 1 -- 172.21.15.84:0/3518490334 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258049030 con 0x560ddceb1840 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f7253e00640 1 -- 172.21.15.84:0/3518490334 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f725803ba30 con 0x560ddceb1840 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7260011d10 con 0x560ddceb1840 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f7253e00640 1 -- 172.21.15.84:0/3518490334 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f72580cd380 con 0x560ddceb1840 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 10 client.27766 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560ddd301650 con 0x560ddceb1840 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f7253e00640 1 -- 172.21.15.84:0/3518490334 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7260011d10 con 0x560ddceb1840 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f7253e00640 1 -- 172.21.15.84:0/3518490334 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f72580d6d50 con 0x560ddceb1840 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 10 client.27766 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 10 client.27766 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 20 client.27766 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce66250 0x560ddd303e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:53.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 4 client.27766 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3a7006d1", "release": true, "await": true}] 2024-09-21T07:59:53.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.877+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3a7006d1", "release": true, "await": true}) -- 0x560ddd1edc90 con 0x560ddce66250 2024-09-21T07:59:53.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.878+0000 7f726de00640 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce66250 0x560ddd303e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:53.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.879+0000 7f726de00640 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce66250 0x560ddd303e10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47ffc28e307e377f server_cookie=3ff560300d27646d in_seq=0 out_seq=0 2024-09-21T07:59:53.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.879+0000 7f7253e00640 10 client.27766 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.882+0000 7f7253e00640 1 -- 172.21.15.84:0/3518490334 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560ddd1edc90 con 0x560ddce66250 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.882+0000 7f7253e00640 10 client.27766 handle_command_reply: tid=0 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.882+0000 7f727bfc1740 1 client.27766 shutdown 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 msgr2=0x560ddd29c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd29c0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f72580cd570 tx=0x7f7258009260 comp rx=0 tx=0).stop 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 shutdown_connections 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560ddced2520 0x560ddd29c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x560ddce66250 0x560ddd303e10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560ddceb1840 0x560ddd29c0c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 --2- 172.21.15.84:0/3518490334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560ddcea9660 0x560ddd28d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f7253e00640 0 client.27766 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 >> 172.21.15.84:0/3518490334 conn(0x560ddcec6910 msgr2=0x560ddd27a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 shutdown_connections 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 1 -- 172.21.15.84:0/3518490334 wait complete. 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.883+0000 7f727bfc1740 20 client.27766 trim_cache size 0 max 16384 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:59:53.886 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 32, 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "3a7006d1": { 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 32, 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 141.1, 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:59:53.887 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:53.888 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72540b6700 msgr2=0x7f72540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72540b6700 0x7f72540b8c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7268005fd0 tx=0x7f7268009500 comp rx=0 tx=0).stop 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010b6c0 msgr2=0x7f727019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010b6c0 0x7f727019cc40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f725802a930 tx=0x7f7258031a20 comp rx=0 tx=0).stop 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 shutdown_connections 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f72540b6700 0x7f72540b8c10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f727010c010 0x7f72701a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727010b6c0 0x7f727019cc40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 --2- 172.21.15.84:0/3201179932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7270105d80 0x7f727019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 >> 172.21.15.84:0/3201179932 conn(0x7f7270101810 msgr2=0x7f7270103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:53.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 shutdown_connections 2024-09-21T07:59:53.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:53.884+0000 7f7275200640 1 -- 172.21.15.84:0/3201179932 wait complete. 2024-09-21T07:59:53.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:53 smithi191 ceph-mon[34667]: pgmap v663: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-21T07:59:54.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:53 smithi162 ceph-mon[34833]: pgmap v663: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-21T07:59:54.776 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3a7006d1', total seconds elapsed: 25.2 2024-09-21T07:59:54.776 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T07:59:54.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:59:55.144 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.828+0000 7f21a1200640 1 -- 172.21.15.84:0/2701309622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 msgr2=0x7f219c112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.828+0000 7f21a1200640 1 --2- 172.21.15.84:0/2701309622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 0x7f219c112670 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2194009900 tx=0x7f219402a3f0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.829+0000 7f21a1200640 1 -- 172.21.15.84:0/2701309622 shutdown_connections 2024-09-21T07:59:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.829+0000 7f21a1200640 1 --2- 172.21.15.84:0/2701309622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 0x7f219c112670 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.829+0000 7f21a1200640 1 --2- 172.21.15.84:0/2701309622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c10b4f0 0x7f219c10b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.829+0000 7f21a1200640 1 --2- 172.21.15.84:0/2701309622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f219c105bb0 0x7f219c105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.829+0000 7f21a1200640 1 -- 172.21.15.84:0/2701309622 >> 172.21.15.84:0/2701309622 conn(0x7f219c101680 msgr2=0x7f219c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:55.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.829+0000 7f21a1200640 1 -- 172.21.15.84:0/2701309622 shutdown_connections 2024-09-21T07:59:55.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.829+0000 7f21a1200640 1 -- 172.21.15.84:0/2701309622 wait complete. 2024-09-21T07:59:55.832 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:55 smithi084 ceph-mon[30411]: pgmap v664: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-21T07:59:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.830+0000 7f21a1200640 1 Processor -- start 2024-09-21T07:59:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.830+0000 7f21a1200640 1 -- start start 2024-09-21T07:59:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f21a1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c105bb0 0x7f219c19c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f21a1200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f219c10b4f0 0x7f219c19ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f21a1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 0x7f219c1a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f21a1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f219c115b50 con 0x7f219c10be40 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f21a1200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1159d0 con 0x7f219c105bb0 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f21a1200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f219c115cd0 con 0x7f219c10b4f0 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f219be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 0x7f219c1a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f219b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c105bb0 0x7f219c19c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f219be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 0x7f219c1a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46596/0 (socket says 172.21.15.84:46596) 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f219be00640 1 -- 172.21.15.84:0/2578438507 learned_addr learned my addr 172.21.15.84:0/2578438507 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f219b400640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c105bb0 0x7f219c19c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:55552/0 (socket says 172.21.15.84:55552) 2024-09-21T07:59:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.831+0000 7f2192a00640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f219c10b4f0 0x7f219c19ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2192a00640 1 -- 172.21.15.84:0/2578438507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c105bb0 msgr2=0x7f219c19c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2192a00640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c105bb0 0x7f219c19c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2192a00640 1 -- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 msgr2=0x7f219c1a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:55.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2192a00640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 0x7f219c1a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:55.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2192a00640 1 -- 172.21.15.84:0/2578438507 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c1a2450 con 0x7f219c10b4f0 2024-09-21T07:59:55.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f219b400640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c105bb0 0x7f219c19c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:55.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2192a00640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f219c10b4f0 0x7f219c19ca80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f219c06c8c0 tx=0x7f218400df40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:55.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2198c00640 1 -- 172.21.15.84:0/2578438507 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184017030 con 0x7f219c10b4f0 2024-09-21T07:59:55.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c1a2740 con 0x7f219c10b4f0 2024-09-21T07:59:55.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2198c00640 1 -- 172.21.15.84:0/2578438507 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2184003e20 con 0x7f219c10b4f0 2024-09-21T07:59:55.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.832+0000 7f2198c00640 1 -- 172.21.15.84:0/2578438507 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2184010460 con 0x7f219c10b4f0 2024-09-21T07:59:55.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.833+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c1a8ea0 con 0x7f219c10b4f0 2024-09-21T07:59:55.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.834+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c105fc0 con 0x7f219c10b4f0 2024-09-21T07:59:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.836+0000 7f2198c00640 1 -- 172.21.15.84:0/2578438507 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f218401a070 con 0x7f219c10b4f0 2024-09-21T07:59:55.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.838+0000 7f2198c00640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21800b6680 0x7f21800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:55.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.838+0000 7f2198c00640 1 -- 172.21.15.84:0/2578438507 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f21840e7b40 con 0x7f219c10b4f0 2024-09-21T07:59:55.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.839+0000 7f219b400640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21800b6680 0x7f21800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:55.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.839+0000 7f219b400640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21800b6680 0x7f21800b8b90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f218c009fc0 tx=0x7f218c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:55.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:55.840+0000 7f2198c00640 1 -- 172.21.15.84:0/2578438507 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21840adca0 con 0x7f219c10b4f0 2024-09-21T07:59:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:55 smithi191 ceph-mon[34667]: pgmap v664: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-21T07:59:56.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:55 smithi162 ceph-mon[34833]: pgmap v664: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-21T07:59:56.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.064+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f219c19d610 con 0x7f219c10b4f0 2024-09-21T07:59:56.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.066+0000 7f2198c00640 1 -- 172.21.15.84:0/2578438507 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f219c19d610 con 0x7f219c10b4f0 2024-09-21T07:59:56.068 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T07:59:56.068 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T07:59:56.068 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21800b6680 msgr2=0x7f21800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21800b6680 0x7f21800b8b90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f218c009fc0 tx=0x7f218c005f90 comp rx=0 tx=0).stop 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f219c10b4f0 msgr2=0x7f219c19ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f219c10b4f0 0x7f219c19ca80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f219c06c8c0 tx=0x7f218400df40 comp rx=0 tx=0).stop 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 shutdown_connections 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21800b6680 0x7f21800b8b90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f219c10be40 0x7f219c1a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f219c10b4f0 0x7f219c19ca80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 --2- 172.21.15.84:0/2578438507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f219c105bb0 0x7f219c19c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 >> 172.21.15.84:0/2578438507 conn(0x7f219c101680 msgr2=0x7f219c108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 shutdown_connections 2024-09-21T07:59:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:56.069+0000 7f21a1200640 1 -- 172.21.15.84:0/2578438507 wait complete. 2024-09-21T07:59:56.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:56 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2578438507' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:57.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:56 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2578438507' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:57.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:56 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2578438507' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:59:57.203 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T07:59:57.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T07:59:57.576 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:57.884 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:57 smithi084 ceph-mon[30411]: pgmap v665: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-21T07:59:57.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:57 smithi191 ceph-mon[34667]: pgmap v665: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-21T07:59:58.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:57 smithi162 ceph-mon[34833]: pgmap v665: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 -- 172.21.15.84:0/1569040244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3981049d0 msgr2=0x7fb398104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 --2- 172.21.15.84:0/1569040244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3981049d0 0x7fb398104de0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb388009900 tx=0x7fb38802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 -- 172.21.15.84:0/1569040244 shutdown_connections 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 --2- 172.21.15.84:0/1569040244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb39810df10 0x7fb398110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 --2- 172.21.15.84:0/1569040244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb398105400 0x7fb39810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 --2- 172.21.15.84:0/1569040244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3981049d0 0x7fb398104de0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 -- 172.21.15.84:0/1569040244 >> 172.21.15.84:0/1569040244 conn(0x7fb398079720 msgr2=0x7fb398079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 -- 172.21.15.84:0/1569040244 shutdown_connections 2024-09-21T07:59:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.224+0000 7fb39e800640 1 -- 172.21.15.84:0/1569040244 wait complete. 2024-09-21T07:59:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.225+0000 7fb39e800640 1 Processor -- start 2024-09-21T07:59:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb39e800640 1 -- start start 2024-09-21T07:59:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb39e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3981049d0 0x7fb39819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb39e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb398105400 0x7fb39819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb39e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb39810df10 0x7fb39819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb39e800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb398113b90 con 0x7fb398105400 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb39e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb398113a10 con 0x7fb39810df10 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb39e800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb398113d10 con 0x7fb3981049d0 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb396a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb398105400 0x7fb39819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb396a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb398105400 0x7fb39819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48364/0 (socket says 172.21.15.84:48364) 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb396a00640 1 -- 172.21.15.84:0/3373614387 learned_addr learned my addr 172.21.15.84:0/3373614387 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb397400640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3981049d0 0x7fb39819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.226+0000 7fb397e00640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb39810df10 0x7fb39819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb396a00640 1 -- 172.21.15.84:0/3373614387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3981049d0 msgr2=0x7fb39819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb396a00640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3981049d0 0x7fb39819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb396a00640 1 -- 172.21.15.84:0/3373614387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb39810df10 msgr2=0x7fb39819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb396a00640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb39810df10 0x7fb39819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb396a00640 1 -- 172.21.15.84:0/3373614387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3981a0530 con 0x7fb398105400 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb397400640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3981049d0 0x7fb39819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb396a00640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb398105400 0x7fb39819ab60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb38400e9f0 tx=0x7fb38400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.227+0000 7fb38fe00640 1 -- 172.21.15.84:0/3373614387 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38400ccc0 con 0x7fb398105400 2024-09-21T07:59:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.228+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3981a0820 con 0x7fb398105400 2024-09-21T07:59:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.228+0000 7fb38fe00640 1 -- 172.21.15.84:0/3373614387 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3840054d0 con 0x7fb398105400 2024-09-21T07:59:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.228+0000 7fb38fe00640 1 -- 172.21.15.84:0/3373614387 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384010430 con 0x7fb398105400 2024-09-21T07:59:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.228+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3981a6f80 con 0x7fb398105400 2024-09-21T07:59:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.232+0000 7fb3a5449740 1 Processor -- start 2024-09-21T07:59:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.232+0000 7fb3a5449740 1 -- start start 2024-09-21T07:59:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282be1850 0x563282f889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f88ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f89430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb3a5449740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563282efea90 con 0x563282bc0b70 2024-09-21T07:59:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb3a5449740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563282eedec0 con 0x563282be1850 2024-09-21T07:59:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb3a5449740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563282ef1cd0 con 0x563282bb8990 2024-09-21T07:59:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb397e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282be1850 0x563282f889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb397400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f88ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb397400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f88ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55364/0 (socket says 172.21.15.84:55364) 2024-09-21T07:59:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb397e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282be1850 0x563282f889b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36396/0 (socket says 172.21.15.84:36396) 2024-09-21T07:59:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.233+0000 7fb397400640 1 -- 172.21.15.84:0/1556597307 learned_addr learned my addr 172.21.15.84:0/1556597307 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb397400640 1 -- 172.21.15.84:0/1556597307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282be1850 msgr2=0x563282f889b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:58.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb397400640 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282be1850 0x563282f889b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb397400640 1 -- 172.21.15.84:0/1556597307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 msgr2=0x563282f89430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T07:59:58.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb397400640 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f89430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb397400640 1 -- 172.21.15.84:0/1556597307 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563282e939d0 con 0x563282bb8990 2024-09-21T07:59:58.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb397e00640 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282be1850 0x563282f889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:58.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb397400640 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f88ef0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb388033000 tx=0x7fb388005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9063a2bd39162148 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.234+0000 7fb38fe00640 1 -- 172.21.15.84:0/3373614387 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb3840046c0 con 0x7fb398105400 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.235+0000 7fb38cc00640 1 -- 172.21.15.84:0/1556597307 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388035040 con 0x563282bb8990 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.235+0000 7fb38cc00640 1 -- 172.21.15.84:0/1556597307 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3880317a0 con 0x563282bb8990 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.235+0000 7fb38cc00640 1 -- 172.21.15.84:0/1556597307 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3880049b0 con 0x563282bb8990 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 -- 172.21.15.84:0/1556597307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 msgr2=0x563282f88ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f88ef0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb388033000 tx=0x7fb388005e20 comp rx=0 tx=0).stop 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 -- 172.21.15.84:0/1556597307 shutdown_connections 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f89430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f88ef0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1556597307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282be1850 0x563282f889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 -- 172.21.15.84:0/1556597307 >> 172.21.15.84:0/1556597307 conn(0x563282bd5c40 msgr2=0x563282f868a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 -- 172.21.15.84:0/1556597307 shutdown_connections 2024-09-21T07:59:58.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb3a5449740 1 -- 172.21.15.84:0/1556597307 wait complete. 2024-09-21T07:59:58.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.236+0000 7fb38fe00640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb37c0b6610 0x7fb37c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.237+0000 7fb397400640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb37c0b6610 0x7fb37c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.237+0000 7fb38fe00640 1 -- 172.21.15.84:0/3373614387 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7fb3840e7d90 con 0x7fb398105400 2024-09-21T07:59:58.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.237+0000 7fb3a5449740 1 -- start start 2024-09-21T07:59:58.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.237+0000 7fb3a5449740 1 Processor -- start 2024-09-21T07:59:58.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.237+0000 7fb397400640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb37c0b6610 0x7fb37c0b8b20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb388009900 tx=0x7fb388031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282f98680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f98c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282fa47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb3a5449740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563282d4f7b0 con 0x563282bc0b70 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb3a5449740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563282e92650 con 0x563282bb8990 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb3a5449740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563282f9b460 con 0x563282be1850 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb3a5449740 10 client.0 _ll_register_callbacks cb 0x563282bf90a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f98c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f98c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48376/0 (socket says 172.21.15.84:48376) 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 -- 172.21.15.84:0/3901996759 learned_addr learned my addr 172.21.15.84:0/3901996759 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb397400640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282f98680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb397e00640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282fa47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 -- 172.21.15.84:0/3901996759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 msgr2=0x563282fa47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282fa47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 -- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 msgr2=0x563282f98680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:58.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282f98680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb396a00640 1 -- 172.21.15.84:0/3901996759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563282c5bba0 con 0x563282bc0b70 2024-09-21T07:59:58.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.238+0000 7fb397e00640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282fa47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:58.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb396a00640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f98c40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb3840e5750 tx=0x7fb3840ad750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5632f7407f42d929 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb381600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T07:59:58.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb381600640 1 -- 172.21.15.84:0/3901996759 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384005680 con 0x563282bc0b70 2024-09-21T07:59:58.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb381600640 1 -- 172.21.15.84:0/3901996759 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7fb3840accc0 con 0x563282bc0b70 2024-09-21T07:59:58.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3880317a0 con 0x563282bc0b70 2024-09-21T07:59:58.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb381600640 1 -- 172.21.15.84:0/3901996759 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb3840ad360 con 0x563282bc0b70 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb3a5449740 10 client.17409 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.239+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563282fa73d0 con 0x563282bc0b70 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb381600640 1 -- 172.21.15.84:0/3901996759 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3880317a0 con 0x563282bc0b70 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb381600640 1 -- 172.21.15.84:0/3901996759 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb3840aeca0 con 0x563282bc0b70 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb3a5449740 10 client.17409 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb3a5449740 10 client.17409 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb3a5449740 20 client.17409 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb3a5449740 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282ba01d0 0x563282faa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb3a5449740 4 client.17409 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563282f009e0 con 0x563282ba01d0 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.240+0000 7fb397400640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282ba01d0 0x563282faa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.241+0000 7fb397400640 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282ba01d0 0x563282faa890 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a48f9a700d8caa5d server_cookie=57561b45ceda146b in_seq=0 out_seq=0 2024-09-21T07:59:58.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.241+0000 7fb381600640 10 client.17409 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:58.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb381600640 1 -- 172.21.15.84:0/3901996759 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563282f009e0 con 0x563282ba01d0 2024-09-21T07:59:58.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb381600640 10 client.17409 handle_command_reply: tid=0 2024-09-21T07:59:58.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 client.17409 shutdown 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 msgr2=0x563282f98c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f98c40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb3840e5750 tx=0x7fb3840ad750 comp rx=0 tx=0).stop 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 shutdown_connections 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282ba01d0 0x563282faa890 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282fa47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282f98c40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 --2- 172.21.15.84:0/3901996759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282f98680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 >> 172.21.15.84:0/3901996759 conn(0x563282bd5c40 msgr2=0x563282f8bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.242+0000 7fb381600640 0 client.17409 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.243+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 shutdown_connections 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.243+0000 7fb3a5449740 1 -- 172.21.15.84:0/3901996759 wait complete. 2024-09-21T07:59:58.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.243+0000 7fb3a5449740 20 client.17409 trim_cache size 0 max 16384 2024-09-21T07:59:58.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.261+0000 7fb3a5449740 1 Processor -- start 2024-09-21T07:59:58.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.261+0000 7fb3a5449740 1 -- start start 2024-09-21T07:59:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282fa46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282fa4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282f95890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb3a5449740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981aebe0 con 0x563282bc0b70 2024-09-21T07:59:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb3a5449740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981b0720 con 0x563282bb8990 2024-09-21T07:59:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb3a5449740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981af2b0 con 0x563282be1850 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb396a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282fa4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb396a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282fa4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48388/0 (socket says 172.21.15.84:48388) 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb396a00640 1 -- 172.21.15.84:0/2193341994 learned_addr learned my addr 172.21.15.84:0/2193341994 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb397e00640 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282f95890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb397400640 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282fa46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb396a00640 1 -- 172.21.15.84:0/2193341994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 msgr2=0x563282f95890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb396a00640 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282f95890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb396a00640 1 -- 172.21.15.84:0/2193341994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 msgr2=0x563282fa46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.262+0000 7fb396a00640 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282fa46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.263+0000 7fb396a00640 1 -- 172.21.15.84:0/2193341994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563282f93320 con 0x563282bc0b70 2024-09-21T07:59:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.263+0000 7fb396a00640 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282fa4c00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb3840ad500 tx=0x7fb3840b21c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ce90bec3ca06c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.263+0000 7fb383e00640 1 -- 172.21.15.84:0/2193341994 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3840a9ea0 con 0x563282bc0b70 2024-09-21T07:59:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.263+0000 7fb383e00640 1 -- 172.21.15.84:0/2193341994 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3840adf50 con 0x563282bc0b70 2024-09-21T07:59:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.263+0000 7fb383e00640 1 -- 172.21.15.84:0/2193341994 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3840b3590 con 0x563282bc0b70 2024-09-21T07:59:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 -- 172.21.15.84:0/2193341994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 msgr2=0x563282fa4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282fa4c00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb3840ad500 tx=0x7fb3840b21c0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 -- 172.21.15.84:0/2193341994 shutdown_connections 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282be1850 0x563282f95890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282bc0b70 0x563282fa4c00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 --2- 172.21.15.84:0/2193341994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bb8990 0x563282fa46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 -- 172.21.15.84:0/2193341994 >> 172.21.15.84:0/2193341994 conn(0x563282bd5c40 msgr2=0x563282f99ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 -- 172.21.15.84:0/2193341994 shutdown_connections 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.264+0000 7fb3a5449740 1 -- 172.21.15.84:0/2193341994 wait complete. 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.265+0000 7fb3a5449740 1 -- start start 2024-09-21T07:59:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.265+0000 7fb3a5449740 1 Processor -- start 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.265+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f9d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.265+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bc0b70 0x563282f9d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.265+0000 7fb3a5449740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282be1850 0x56328300e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.265+0000 7fb3a5449740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981b0050 con 0x563282be1850 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb3a5449740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981af980 con 0x563282bc0b70 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb3a5449740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981acbe0 con 0x563282bb8990 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb3a5449740 10 client.0 _ll_register_callbacks cb 0x7fb38400cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f9d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282be1850 0x56328300e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f9d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55380/0 (socket says 172.21.15.84:55380) 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 -- 172.21.15.84:0/1607623636 learned_addr learned my addr 172.21.15.84:0/1607623636 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb396a00640 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bc0b70 0x563282f9d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 -- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bc0b70 msgr2=0x563282f9d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bc0b70 0x563282f9d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 -- 172.21.15.84:0/1607623636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282be1850 msgr2=0x56328300e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282be1850 0x56328300e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397400640 1 -- 172.21.15.84:0/1607623636 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328300e920 con 0x563282bb8990 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.266+0000 7fb397e00640 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282be1850 0x56328300e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb397400640 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f9d170 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb388033000 tx=0x7fb3880054a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d5d97fa01fe1fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb381600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb381600640 1 -- 172.21.15.84:0/1607623636 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38805f060 con 0x563282bb8990 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3840adf50 con 0x563282bb8990 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb381600640 1 -- 172.21.15.84:0/1607623636 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7fb388004240 con 0x563282bb8990 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb381600640 1 -- 172.21.15.84:0/1607623636 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb388066050 con 0x563282bb8990 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb3a5449740 10 client.27790 fetch_fsmap learned FSMap version 29 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563283015cd0 con 0x563282bb8990 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.267+0000 7fb381600640 1 -- 172.21.15.84:0/1607623636 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3840adf50 con 0x563282bb8990 2024-09-21T07:59:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb381600640 1 -- 172.21.15.84:0/1607623636 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb3880035f0 con 0x563282bb8990 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb3a5449740 10 client.27790 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb3a5449740 10 client.27790 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb3a5449740 20 client.27790 populate_metadata read hostname 'smithi084' 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282b75580 0x5632830180c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb3a5449740 4 client.27790 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x563282efc490 con 0x563282b75580 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.268+0000 7fb396a00640 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282b75580 0x5632830180c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.269+0000 7fb396a00640 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282b75580 0x5632830180c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26dba0929ea80d01 server_cookie=64c767862b9f2e5a in_seq=0 out_seq=0 2024-09-21T07:59:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.269+0000 7fb381600640 10 client.27790 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:58.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.285+0000 7fb381600640 1 -- 172.21.15.84:0/1607623636 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563282efc490 con 0x563282b75580 2024-09-21T07:59:58.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.285+0000 7fb381600640 10 client.27790 handle_command_reply: tid=0 2024-09-21T07:59:58.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.285+0000 7fb3a5449740 1 client.27790 shutdown 2024-09-21T07:59:58.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 msgr2=0x563282f9d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f9d170 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb388033000 tx=0x7fb3880054a0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 shutdown_connections 2024-09-21T07:59:58.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563282be1850 0x56328300e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563282bc0b70 0x563282f9d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x563282b75580 0x5632830180c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 --2- 172.21.15.84:0/1607623636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563282bb8990 0x563282f9d170 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb381600640 0 client.27790 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T07:59:58.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 >> 172.21.15.84:0/1607623636 conn(0x563282bd5c40 msgr2=0x563282f8bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 shutdown_connections 2024-09-21T07:59:58.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 1 -- 172.21.15.84:0/1607623636 wait complete. 2024-09-21T07:59:58.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.286+0000 7fb3a5449740 20 client.27790 trim_cache size 0 max 16384 2024-09-21T07:59:58.291 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T07:59:58.292 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T07:59:58.292 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T07:59:58.292 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 34, 2024-09-21T07:59:58.292 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T07:59:58.292 INFO:teuthology.orchestra.run.smithi084.stdout: "385a5f69": { 2024-09-21T07:59:58.292 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 34, 2024-09-21T07:59:58.293 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T07:59:58.293 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:59:58.293 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:59:58.293 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:59:58.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T07:59:58.293 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T07:59:58.293 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 141.1, 2024-09-21T07:59:58.294 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T07:59:58.294 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T07:59:58.294 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T07:59:58.294 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T07:59:58.294 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T07:59:58.294 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T07:59:58.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:58.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:58.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:58.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:58.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T07:59:58.295 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T07:59:58.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb37c0b6610 msgr2=0x7fb37c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb37c0b6610 0x7fb37c0b8b20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb388009900 tx=0x7fb388031400 comp rx=0 tx=0).stop 2024-09-21T07:59:58.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb398105400 msgr2=0x7fb39819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:58.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb398105400 0x7fb39819ab60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb38400e9f0 tx=0x7fb38400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 shutdown_connections 2024-09-21T07:59:58.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb37c0b6610 0x7fb37c0b8b20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb39810df10 0x7fb39819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb398105400 0x7fb39819ab60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 --2- 172.21.15.84:0/3373614387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3981049d0 0x7fb39819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:58.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 >> 172.21.15.84:0/3373614387 conn(0x7fb398079720 msgr2=0x7fb3981007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:58.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 shutdown_connections 2024-09-21T07:59:58.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T07:59:58.287+0000 7fb39e800640 1 -- 172.21.15.84:0/3373614387 wait complete. 2024-09-21T07:59:59.116 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '385a5f69', quiesce took 4.3 seconds. Will release after: 16.75 2024-09-21T07:59:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 07:59:59 smithi191 ceph-mon[34667]: pgmap v666: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T08:00:00.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 07:59:59 smithi162 ceph-mon[34833]: pgmap v666: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T08:00:00.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 07:59:59 smithi084 ceph-mon[30411]: pgmap v666: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T08:00:00.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:00 smithi191 ceph-mon[34667]: overall HEALTH_OK 2024-09-21T08:00:00.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:00 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:00.913 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:00 smithi084 ceph-mon[30411]: overall HEALTH_OK 2024-09-21T08:00:00.913 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:00 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:01.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:00 smithi162 ceph-mon[34833]: overall HEALTH_OK 2024-09-21T08:00:01.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:00 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:01.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:01 smithi191 ceph-mon[34667]: pgmap v667: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T08:00:01.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:01.907 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:01 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:01.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:01 smithi084 ceph-mon[30411]: pgmap v667: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T08:00:01.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:01.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:01 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:02.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:01 smithi162 ceph-mon[34833]: pgmap v667: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T08:00:02.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:02.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:01 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:02 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:02 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:02 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:02 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:02 smithi162 ceph-mon[34833]: pgmap v668: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T08:00:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:02 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:02 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:02 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:02 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:02 smithi084 ceph-mon[30411]: pgmap v668: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T08:00:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:02 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:02 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:02 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:02 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:03.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:02 smithi191 ceph-mon[34667]: pgmap v668: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T08:00:04.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:00:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:04.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:04.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:04.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.401 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:04.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:00:05.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 -- 172.21.15.84:0/1414251933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888110190 msgr2=0x7f98881125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 --2- 172.21.15.84:0/1414251933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888110190 0x7f98881125b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9880009ca0 tx=0x7f988002a950 comp rx=0 tx=0).stop 2024-09-21T08:00:05.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 -- 172.21.15.84:0/1414251933 shutdown_connections 2024-09-21T08:00:05.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 --2- 172.21.15.84:0/1414251933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888110190 0x7f98881125b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 --2- 172.21.15.84:0/1414251933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9888102f30 0x7f988810fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 --2- 172.21.15.84:0/1414251933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98881025e0 0x7f98881029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 -- 172.21.15.84:0/1414251933 >> 172.21.15.84:0/1414251933 conn(0x7f9888079730 msgr2=0x7f9888079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:05.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.048+0000 7f988e800640 1 -- 172.21.15.84:0/1414251933 shutdown_connections 2024-09-21T08:00:05.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.049+0000 7f988e800640 1 -- 172.21.15.84:0/1414251933 wait complete. 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 Processor -- start 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 -- start start 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98881025e0 0x7f988819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888102f30 0x7f988819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9888110190 0x7f98881a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9888115cd0 con 0x7f9888102f30 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9888115b50 con 0x7f98881025e0 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.050+0000 7f988e800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9888115e50 con 0x7f9888110190 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98881025e0 0x7f988819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9886a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888102f30 0x7f988819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98881025e0 0x7f988819c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36430/0 (socket says 172.21.15.84:36430) 2024-09-21T08:00:05.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 -- 172.21.15.84:0/2598833806 learned_addr learned my addr 172.21.15.84:0/2598833806 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:05.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887e00640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9888110190 0x7f98881a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 -- 172.21.15.84:0/2598833806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9888110190 msgr2=0x7f98881a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9888110190 0x7f98881a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 -- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888102f30 msgr2=0x7f988819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888102f30 0x7f988819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9887400640 1 -- 172.21.15.84:0/2598833806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98881a2630 con 0x7f98881025e0 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.051+0000 7f9886a00640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888102f30 0x7f988819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.052+0000 7f9887400640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98881025e0 0x7f988819c6c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f987800e9f0 tx=0x7f987800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.052+0000 7f987fe00640 1 -- 172.21.15.84:0/2598833806 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987800cd80 con 0x7f98881025e0 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.052+0000 7f987fe00640 1 -- 172.21.15.84:0/2598833806 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98780108e0 con 0x7f98881025e0 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.052+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98881a2920 con 0x7f98881025e0 2024-09-21T08:00:05.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.052+0000 7f987fe00640 1 -- 172.21.15.84:0/2598833806 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878018980 con 0x7f98881025e0 2024-09-21T08:00:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.052+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98881a9080 con 0x7f98881025e0 2024-09-21T08:00:05.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.055+0000 7f98955ef740 1 Processor -- start 2024-09-21T08:00:05.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f98955ef740 1 -- start start 2024-09-21T08:00:05.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f987fe00640 1 -- 172.21.15.84:0/2598833806 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9878010430 con 0x7f98881025e0 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f98955ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c5522d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f98955ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c51531b0 0x5605c55232a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f98955ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c515b390 0x5605c55237e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f98955ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5605c5499f70 con 0x5605c51531b0 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f98955ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5605c54893a0 con 0x5605c515b390 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f98955ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5605c548d1b0 con 0x5605c517c070 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f9887e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c5522d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f9887e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c5522d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:55416/0 (socket says 172.21.15.84:55416) 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f9887e00640 1 -- 172.21.15.84:0/2667735375 learned_addr learned my addr 172.21.15.84:0/2667735375 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f9886a00640 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c515b390 0x5605c55237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.056+0000 7f9887400640 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c51531b0 0x5605c55232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f9887e00640 1 -- 172.21.15.84:0/2667735375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c515b390 msgr2=0x5605c55237e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f9887e00640 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c515b390 0x5605c55237e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f9887e00640 1 -- 172.21.15.84:0/2667735375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c51531b0 msgr2=0x5605c55232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f9887e00640 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c51531b0 0x5605c55232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f9887e00640 1 -- 172.21.15.84:0/2667735375 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c5453c90 con 0x5605c517c070 2024-09-21T08:00:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f9887400640 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c51531b0 0x5605c55232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f9887e00640 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c5522d60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9880009bf0 tx=0x7f9880009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54479778ff38a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.057+0000 7f987cc00640 1 -- 172.21.15.84:0/2667735375 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880048070 con 0x5605c517c070 2024-09-21T08:00:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.058+0000 7f987cc00640 1 -- 172.21.15.84:0/2667735375 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9880003e20 con 0x5605c517c070 2024-09-21T08:00:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.058+0000 7f987cc00640 1 -- 172.21.15.84:0/2667735375 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880034040 con 0x5605c517c070 2024-09-21T08:00:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.058+0000 7f987fe00640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f986c0b6700 0x7f986c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.058+0000 7f9887400640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f986c0b6700 0x7f986c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.058+0000 7f987fe00640 1 -- 172.21.15.84:0/2598833806 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f98780e7dc0 con 0x7f98881025e0 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 -- 172.21.15.84:0/2667735375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 msgr2=0x5605c5522d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c5522d60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9880009bf0 tx=0x7f9880009450 comp rx=0 tx=0).stop 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 -- 172.21.15.84:0/2667735375 shutdown_connections 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c515b390 0x5605c55237e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c51531b0 0x5605c55232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 --2- 172.21.15.84:0/2667735375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c5522d60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 -- 172.21.15.84:0/2667735375 >> 172.21.15.84:0/2667735375 conn(0x5605c5170460 msgr2=0x5605c5520c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 -- 172.21.15.84:0/2667735375 shutdown_connections 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f9887400640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f986c0b6700 0x7f986c0b8c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x5605c55219e0 tx=0x7f9878000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.059+0000 7f98955ef740 1 -- 172.21.15.84:0/2667735375 wait complete. 2024-09-21T08:00:05.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 -- start start 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 Processor -- start 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c552e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c552ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c553a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5605c52ea700 con 0x5605c515b390 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5605c5424540 con 0x5605c51531b0 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.060+0000 7f98955ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5605c55314e0 con 0x5605c517c070 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f98955ef740 10 client.0 _ll_register_callbacks cb 0x5605c5434430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c552ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c552ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48422/0 (socket says 172.21.15.84:48422) 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 -- 172.21.15.84:0/1053767915 learned_addr learned my addr 172.21.15.84:0/1053767915 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9887e00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c552e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9887e00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c553a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 -- 172.21.15.84:0/1053767915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 msgr2=0x5605c553a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c553a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 -- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 msgr2=0x5605c552e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c552e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9886a00640 1 -- 172.21.15.84:0/1053767915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c51e7650 con 0x5605c515b390 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.061+0000 7f9887e00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c552e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.062+0000 7f9886a00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c552ea90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9874012d20 tx=0x7f987400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c206bbbb880b6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.062+0000 7f9871600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.062+0000 7f9871600640 1 -- 172.21.15.84:0/1053767915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874012110 con 0x5605c515b390 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.062+0000 7f9871600640 1 -- 172.21.15.84:0/1053767915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f9874004050 con 0x5605c515b390 2024-09-21T08:00:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.062+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605c5426b50 con 0x5605c515b390 2024-09-21T08:00:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.062+0000 7f9871600640 1 -- 172.21.15.84:0/1053767915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9874025050 con 0x5605c515b390 2024-09-21T08:00:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 10 client.17427 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605c5441910 con 0x5605c515b390 2024-09-21T08:00:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f9871600640 1 -- 172.21.15.84:0/1053767915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5605c5426b50 con 0x5605c515b390 2024-09-21T08:00:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f9871600640 1 -- 172.21.15.84:0/1053767915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9874010430 con 0x5605c515b390 2024-09-21T08:00:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 10 client.17427 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:05.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 10 client.17427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 20 client.17427 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c513a9f0 0x5605c5540720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 4 client.17427 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.063+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605c549bec0 con 0x5605c513a9f0 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.064+0000 7f9887e00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c513a9f0 0x5605c5540720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.064+0000 7f9871600640 10 client.17427 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.064+0000 7f9887e00640 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c513a9f0 0x5605c5540720 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=116a80d408b60ccc server_cookie=e55023814b5903a4 in_seq=0 out_seq=0 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.065+0000 7f9871600640 1 -- 172.21.15.84:0/1053767915 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605c549bec0 con 0x5605c513a9f0 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.065+0000 7f9871600640 10 client.17427 handle_command_reply: tid=0 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.065+0000 7f98955ef740 1 client.17427 shutdown 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 msgr2=0x5605c552ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c552ea90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9874012d20 tx=0x7f987400f790 comp rx=0 tx=0).stop 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 shutdown_connections 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c513a9f0 0x5605c5540720 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c553a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c552ea90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 --2- 172.21.15.84:0/1053767915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c552e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 >> 172.21.15.84:0/1053767915 conn(0x5605c5170460 msgr2=0x5605c5525ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f9871600640 0 client.17427 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 shutdown_connections 2024-09-21T08:00:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 1 -- 172.21.15.84:0/1053767915 wait complete. 2024-09-21T08:00:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.066+0000 7f98955ef740 20 client.17427 trim_cache size 0 max 16384 2024-09-21T08:00:05.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.084+0000 7f98955ef740 1 Processor -- start 2024-09-21T08:00:05.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.084+0000 7f98955ef740 1 -- start start 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f98955ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5525e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f98955ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55263a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f98955ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c552b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f98955ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b3010 con 0x5605c515b390 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f98955ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b4b50 con 0x5605c51531b0 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f98955ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b36e0 con 0x5605c517c070 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f9886a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f9886a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55263a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48436/0 (socket says 172.21.15.84:48436) 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f9886a00640 1 -- 172.21.15.84:0/3051902281 learned_addr learned my addr 172.21.15.84:0/3051902281 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f9887e00640 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5525e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.085+0000 7f9887e00640 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c552b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9886a00640 1 -- 172.21.15.84:0/3051902281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 msgr2=0x5605c552b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9886a00640 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c552b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9886a00640 1 -- 172.21.15.84:0/3051902281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 msgr2=0x5605c5525e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9886a00640 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5525e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9886a00640 1 -- 172.21.15.84:0/3051902281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c513ac20 con 0x5605c515b390 2024-09-21T08:00:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9887e00640 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5525e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9886a00640 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55263a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9874010800 tx=0x7f98740123a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46edf7cbc69812ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9873e00640 1 -- 172.21.15.84:0/3051902281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874010570 con 0x5605c515b390 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9873e00640 1 -- 172.21.15.84:0/3051902281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9874010a70 con 0x5605c515b390 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.086+0000 7f9873e00640 1 -- 172.21.15.84:0/3051902281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98740038a0 con 0x5605c515b390 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.087+0000 7f98955ef740 1 -- 172.21.15.84:0/3051902281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 msgr2=0x5605c55263a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.087+0000 7f98955ef740 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55263a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9874010800 tx=0x7f98740123a0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.087+0000 7f98955ef740 1 -- 172.21.15.84:0/3051902281 shutdown_connections 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.087+0000 7f98955ef740 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c552b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.087+0000 7f98955ef740 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55263a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.087+0000 7f98955ef740 1 --2- 172.21.15.84:0/3051902281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5525e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.087+0000 7f98955ef740 1 -- 172.21.15.84:0/3051902281 >> 172.21.15.84:0/3051902281 conn(0x5605c5170460 msgr2=0x5605c552e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.088+0000 7f98955ef740 1 -- 172.21.15.84:0/3051902281 shutdown_connections 2024-09-21T08:00:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.088+0000 7f98955ef740 1 -- 172.21.15.84:0/3051902281 wait complete. 2024-09-21T08:00:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.088+0000 7f98955ef740 1 -- start start 2024-09-21T08:00:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.088+0000 7f98955ef740 1 Processor -- start 2024-09-21T08:00:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f98955ef740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5532e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f98955ef740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55333d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f98955ef740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c55aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f98955ef740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b4480 con 0x5605c515b390 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f98955ef740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b3db0 con 0x5605c51531b0 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f98955ef740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f98881b1010 con 0x5605c517c070 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f98955ef740 10 client.0 _ll_register_callbacks cb 0x7f9874012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f9886a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f9886a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55333d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48452/0 (socket says 172.21.15.84:48452) 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f9886a00640 1 -- 172.21.15.84:0/4088088092 learned_addr learned my addr 172.21.15.84:0/4088088092 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f9887e00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5532e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.089+0000 7f9887e00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c55aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9886a00640 1 -- 172.21.15.84:0/4088088092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 msgr2=0x5605c55aa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9886a00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c55aa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9886a00640 1 -- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 msgr2=0x5605c5532e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9886a00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5532e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9886a00640 1 -- 172.21.15.84:0/4088088092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c55aa650 con 0x5605c515b390 2024-09-21T08:00:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9887e00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5532e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9886a00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55333d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f987400f7d0 tx=0x7f9874012c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cc65295cd9ded1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9871600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9871600640 1 -- 172.21.15.84:0/4088088092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874005250 con 0x5605c515b390 2024-09-21T08:00:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9874010a70 con 0x5605c515b390 2024-09-21T08:00:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.090+0000 7f9871600640 1 -- 172.21.15.84:0/4088088092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f98740053f0 con 0x5605c515b390 2024-09-21T08:00:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f9871600640 1 -- 172.21.15.84:0/4088088092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f98740055f0 con 0x5605c515b390 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 10 client.17433 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605c55ab8e0 con 0x5605c515b390 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f9871600640 1 -- 172.21.15.84:0/4088088092 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9874010a70 con 0x5605c515b390 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f9871600640 1 -- 172.21.15.84:0/4088088092 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9874032590 con 0x5605c515b390 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 10 client.17433 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 10 client.17433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 20 client.17433 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c510fda0 0x5605c55adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 4 client.17433 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.091+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5605c552a100 con 0x5605c510fda0 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.092+0000 7f9887e00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c510fda0 0x5605c55adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.092+0000 7f9871600640 10 client.17433 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.092+0000 7f9887e00640 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c510fda0 0x5605c55adea0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce8dea6dd3ff7229 server_cookie=3b3723e2554e0703 in_seq=0 out_seq=0 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f9871600640 1 -- 172.21.15.84:0/4088088092 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5605c552a100 con 0x5605c510fda0 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f9871600640 10 client.17433 handle_command_reply: tid=0 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 client.17433 shutdown 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 msgr2=0x5605c55333d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55333d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f987400f7d0 tx=0x7f9874012c80 comp rx=0 tx=0).stop 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 shutdown_connections 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5605c510fda0 0x5605c55adea0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605c517c070 0x5605c55aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5605c515b390 0x5605c55333d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 --2- 172.21.15.84:0/4088088092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605c51531b0 0x5605c5532e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 >> 172.21.15.84:0/4088088092 conn(0x5605c5170460 msgr2=0x5605c552c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f9871600640 0 client.17433 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 shutdown_connections 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 1 -- 172.21.15.84:0/4088088092 wait complete. 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.093+0000 7f98955ef740 20 client.17433 trim_cache size 0 max 16384 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T08:00:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T08:00:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T08:00:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f986c0b6700 msgr2=0x7f986c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f986c0b6700 0x7f986c0b8c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x5605c55219e0 tx=0x7f9878000bc0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98881025e0 msgr2=0x7f988819c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98881025e0 0x7f988819c6c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f987800e9f0 tx=0x7f987800eeb0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 shutdown_connections 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f986c0b6700 0x7f986c0b8c10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9888110190 0x7f98881a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9888102f30 0x7f988819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 --2- 172.21.15.84:0/2598833806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98881025e0 0x7f988819c6c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 >> 172.21.15.84:0/2598833806 conn(0x7f9888079730 msgr2=0x7f9888109ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 shutdown_connections 2024-09-21T08:00:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:05.094+0000 7f988e800640 1 -- 172.21.15.84:0/2598833806 wait complete. 2024-09-21T08:00:05.163 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:05 smithi084 ceph-mon[30411]: pgmap v669: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-09-21T08:00:05.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:05 smithi162 ceph-mon[34833]: pgmap v669: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-09-21T08:00:05.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:05 smithi191 ceph-mon[34667]: pgmap v669: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 27 op/s 2024-09-21T08:00:06.095 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:00:06.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 -- 172.21.15.84:0/1536240026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311010c020 msgr2=0x7f3110112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 --2- 172.21.15.84:0/1536240026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311010c020 0x7f3110112850 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3108009ca0 tx=0x7f310802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 -- 172.21.15.84:0/1536240026 shutdown_connections 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 --2- 172.21.15.84:0/1536240026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f311010c020 0x7f3110112850 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 --2- 172.21.15.84:0/1536240026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f311010b6d0 0x7f311010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 --2- 172.21.15.84:0/1536240026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3110105d90 0x7f31101061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 -- 172.21.15.84:0/1536240026 >> 172.21.15.84:0/1536240026 conn(0x7f3110101860 msgr2=0x7f3110103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 -- 172.21.15.84:0/1536240026 shutdown_connections 2024-09-21T08:00:07.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.106+0000 7f3117400640 1 -- 172.21.15.84:0/1536240026 wait complete. 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.107+0000 7f3117400640 1 Processor -- start 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3117400640 1 -- start start 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3117400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3110105d90 0x7f311019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3117400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f311010b6d0 0x7f311019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3117400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f311010c020 0x7f31101a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3117400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3110115ce0 con 0x7f3110105d90 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3117400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3110115b60 con 0x7f311010b6d0 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3117400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3110115e60 con 0x7f311010c020 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f310fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f311010b6d0 0x7f311019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f3114a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3110105d90 0x7f311019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f310fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f311010b6d0 0x7f311019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:36472/0 (socket says 172.21.15.84:36472) 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.108+0000 7f310fe00640 1 -- 172.21.15.84:0/3179470646 learned_addr learned my addr 172.21.15.84:0/3179470646 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f3115400640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f311010c020 0x7f31101a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f3114a00640 1 -- 172.21.15.84:0/3179470646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f311010c020 msgr2=0x7f31101a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f3114a00640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f311010c020 0x7f31101a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f3114a00640 1 -- 172.21.15.84:0/3179470646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f311010b6d0 msgr2=0x7f311019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f3114a00640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f311010b6d0 0x7f311019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f3114a00640 1 -- 172.21.15.84:0/3179470646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31101a2600 con 0x7f3110105d90 2024-09-21T08:00:07.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f3114a00640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3110105d90 0x7f311019c690 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f310000e9f0 tx=0x7f310000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.109+0000 7f310d600640 1 -- 172.21.15.84:0/3179470646 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310000ccc0 con 0x7f3110105d90 2024-09-21T08:00:07.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.110+0000 7f310d600640 1 -- 172.21.15.84:0/3179470646 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31000108e0 con 0x7f3110105d90 2024-09-21T08:00:07.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.110+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31101a28f0 con 0x7f3110105d90 2024-09-21T08:00:07.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.110+0000 7f310d600640 1 -- 172.21.15.84:0/3179470646 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100018880 con 0x7f3110105d90 2024-09-21T08:00:07.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.110+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31101a9050 con 0x7f3110105d90 2024-09-21T08:00:07.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.111+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31101061a0 con 0x7f3110105d90 2024-09-21T08:00:07.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.113+0000 7f310d600640 1 -- 172.21.15.84:0/3179470646 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3100010430 con 0x7f3110105d90 2024-09-21T08:00:07.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.116+0000 7f310d600640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30f40b6700 0x7f30f40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:07.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.116+0000 7f310d600640 1 -- 172.21.15.84:0/3179470646 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9432+0+0 (secure 0 0 0) 0x7f31000e8270 con 0x7f3110105d90 2024-09-21T08:00:07.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.116+0000 7f310fe00640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30f40b6700 0x7f30f40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:07.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.117+0000 7f310fe00640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30f40b6700 0x7f30f40b8c10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31101050b0 tx=0x7f30fc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:07.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.118+0000 7f310d600640 1 -- 172.21.15.84:0/3179470646 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31000b27b0 con 0x7f3110105d90 2024-09-21T08:00:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.343+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f311019d7c0 con 0x7f3110105d90 2024-09-21T08:00:07.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.343+0000 7f310d600640 1 -- 172.21.15.84:0/3179470646 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f31000b76f0 con 0x7f3110105d90 2024-09-21T08:00:07.346 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:00:07.346 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:00:07.346 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:00:07.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30f40b6700 msgr2=0x7f30f40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30f40b6700 0x7f30f40b8c10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31101050b0 tx=0x7f30fc005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:07.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3110105d90 msgr2=0x7f311019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:07.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3110105d90 0x7f311019c690 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f310000e9f0 tx=0x7f310000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 shutdown_connections 2024-09-21T08:00:07.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30f40b6700 0x7f30f40b8c10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f311010c020 0x7f31101a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f311010b6d0 0x7f311019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 --2- 172.21.15.84:0/3179470646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3110105d90 0x7f311019c690 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:07.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 >> 172.21.15.84:0/3179470646 conn(0x7f3110101860 msgr2=0x7f311010ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:07.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 shutdown_connections 2024-09-21T08:00:07.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:07.346+0000 7f3117400640 1 -- 172.21.15.84:0/3179470646 wait complete. 2024-09-21T08:00:07.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:07 smithi084 ceph-mon[30411]: pgmap v670: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:00:07.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:07 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3179470646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:07.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:07 smithi162 ceph-mon[34833]: pgmap v670: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:00:07.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:07 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3179470646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:07.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:07 smithi191 ceph-mon[34667]: pgmap v670: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:00:07.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:07 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3179470646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:08.181 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T08:00:08.569 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:09.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.449+0000 7f6096c00640 1 -- 172.21.15.84:0/3912730771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60901046b0 msgr2=0x7f6090104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.449+0000 7f6096c00640 1 --2- 172.21.15.84:0/3912730771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60901046b0 0x7f6090104ac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f607c009900 tx=0x7f607c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:09.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.449+0000 7f6096c00640 1 -- 172.21.15.84:0/3912730771 shutdown_connections 2024-09-21T08:00:09.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.449+0000 7f6096c00640 1 --2- 172.21.15.84:0/3912730771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609010dc60 0x7f6090110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.449+0000 7f6096c00640 1 --2- 172.21.15.84:0/3912730771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60901050e0 0x7f609010d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.449+0000 7f6096c00640 1 --2- 172.21.15.84:0/3912730771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60901046b0 0x7f6090104ac0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.449+0000 7f6096c00640 1 -- 172.21.15.84:0/3912730771 >> 172.21.15.84:0/3912730771 conn(0x7f60900fe2c0 msgr2=0x7f6090100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:09.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.450+0000 7f6096c00640 1 -- 172.21.15.84:0/3912730771 shutdown_connections 2024-09-21T08:00:09.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.450+0000 7f6096c00640 1 -- 172.21.15.84:0/3912730771 wait complete. 2024-09-21T08:00:09.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.451+0000 7f6096c00640 1 Processor -- start 2024-09-21T08:00:09.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.451+0000 7f6096c00640 1 -- start start 2024-09-21T08:00:09.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.452+0000 7f6096c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60901046b0 0x7f6090103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.452+0000 7f6096c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60901050e0 0x7f60901025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.452+0000 7f6096c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609010dc60 0x7f6090102b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.452+0000 7f6096c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6090113940 con 0x7f60901046b0 2024-09-21T08:00:09.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.452+0000 7f6096c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60901137c0 con 0x7f609010dc60 2024-09-21T08:00:09.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.452+0000 7f6096c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6090113ac0 con 0x7f60901050e0 2024-09-21T08:00:09.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.454+0000 7f6096200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609010dc60 0x7f6090102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.454+0000 7f6096200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609010dc60 0x7f6090102b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34152/0 (socket says 172.21.15.84:34152) 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.454+0000 7f6096200640 1 -- 172.21.15.84:0/1705511370 learned_addr learned my addr 172.21.15.84:0/1705511370 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.454+0000 7f6094e00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60901050e0 0x7f60901025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.454+0000 7f6095800640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60901046b0 0x7f6090103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.454+0000 7f6096200640 1 -- 172.21.15.84:0/1705511370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60901050e0 msgr2=0x7f60901025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.454+0000 7f6096200640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60901050e0 0x7f60901025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.455+0000 7f6096200640 1 -- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60901046b0 msgr2=0x7f6090103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.455+0000 7f6096200640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60901046b0 0x7f6090103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.455+0000 7f6096200640 1 -- 172.21.15.84:0/1705511370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6090103360 con 0x7f609010dc60 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.455+0000 7f6095800640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60901046b0 0x7f6090103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.455+0000 7f6096200640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609010dc60 0x7f6090102b40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f608800eb10 tx=0x7f608800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.456+0000 7f608e000640 1 -- 172.21.15.84:0/1705511370 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088004b20 con 0x7f609010dc60 2024-09-21T08:00:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.456+0000 7f608e000640 1 -- 172.21.15.84:0/1705511370 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6088004cc0 con 0x7f609010dc60 2024-09-21T08:00:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.456+0000 7f608e000640 1 -- 172.21.15.84:0/1705511370 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088010690 con 0x7f609010dc60 2024-09-21T08:00:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.456+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609019e4b0 con 0x7f609010dc60 2024-09-21T08:00:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.456+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609019e9c0 con 0x7f609010dc60 2024-09-21T08:00:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.465+0000 7f608e000640 1 -- 172.21.15.84:0/1705511370 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f6088005020 con 0x7f609010dc60 2024-09-21T08:00:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.467+0000 7f609ee5a740 1 Processor -- start 2024-09-21T08:00:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f609ee5a740 1 -- start start 2024-09-21T08:00:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb28c070 0x55f3bb632d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb633270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb26b390 0x55f3bb6337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f609ee5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3bb5a9fb0 con 0x55f3bb28c070 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f609ee5a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f3bb5993e0 con 0x55f3bb2631b0 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f609ee5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f3bb59d1f0 con 0x55f3bb26b390 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.468+0000 7f608e000640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60780b6700 0x7f60780b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.469+0000 7f608e000640 1 -- 172.21.15.84:0/1705511370 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7f60880e8160 con 0x7f609010dc60 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.469+0000 7f6096200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb26b390 0x55f3bb6337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.469+0000 7f6094e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb633270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.469+0000 7f6096200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb26b390 0x55f3bb6337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49412/0 (socket says 172.21.15.84:49412) 2024-09-21T08:00:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6096200640 1 -- 172.21.15.84:0/4046483144 learned_addr learned my addr 172.21.15.84:0/4046483144 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6095800640 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb28c070 0x55f3bb632d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6096200640 1 -- 172.21.15.84:0/4046483144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 msgr2=0x55f3bb633270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:09.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6096200640 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb633270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6096200640 1 -- 172.21.15.84:0/4046483144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb28c070 msgr2=0x55f3bb632d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:09.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6094e00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60780b6700 0x7f60780b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6096200640 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb28c070 0x55f3bb632d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.470+0000 7f6096200640 1 -- 172.21.15.84:0/4046483144 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bb563cd0 con 0x55f3bb26b390 2024-09-21T08:00:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.471+0000 7f6095800640 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb28c070 0x55f3bb632d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.471+0000 7f6096200640 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb26b390 0x55f3bb6337b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f608800f010 tx=0x7f60880aa350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0d2ac038aee983 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.472+0000 7f6094e00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60780b6700 0x7f60780b8c10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6084006fd0 tx=0x7f6084006b20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.472+0000 7f6082a00640 1 -- 172.21.15.84:0/4046483144 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60880ad6e0 con 0x55f3bb26b390 2024-09-21T08:00:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.472+0000 7f6082a00640 1 -- 172.21.15.84:0/4046483144 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60880ae2d0 con 0x55f3bb26b390 2024-09-21T08:00:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.472+0000 7f6082a00640 1 -- 172.21.15.84:0/4046483144 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60880cfbe0 con 0x55f3bb26b390 2024-09-21T08:00:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.473+0000 7f609ee5a740 1 -- 172.21.15.84:0/4046483144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb26b390 msgr2=0x55f3bb6337b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.473+0000 7f609ee5a740 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb26b390 0x55f3bb6337b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f608800f010 tx=0x7f60880aa350 comp rx=0 tx=0).stop 2024-09-21T08:00:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.475+0000 7f609ee5a740 1 -- 172.21.15.84:0/4046483144 shutdown_connections 2024-09-21T08:00:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.475+0000 7f609ee5a740 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb26b390 0x55f3bb6337b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.476+0000 7f609ee5a740 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb633270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.476+0000 7f609ee5a740 1 --2- 172.21.15.84:0/4046483144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb28c070 0x55f3bb632d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.476+0000 7f609ee5a740 1 -- 172.21.15.84:0/4046483144 >> 172.21.15.84:0/4046483144 conn(0x55f3bb280460 msgr2=0x55f3bb630bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.476+0000 7f609ee5a740 1 -- 172.21.15.84:0/4046483144 shutdown_connections 2024-09-21T08:00:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.476+0000 7f609ee5a740 1 -- 172.21.15.84:0/4046483144 wait complete. 2024-09-21T08:00:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.477+0000 7f609ee5a740 1 -- start start 2024-09-21T08:00:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.477+0000 7f609ee5a740 1 Processor -- start 2024-09-21T08:00:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.478+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb63e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.478+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb63ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.478+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb64a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.478+0000 7f609ee5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3bb3fa700 con 0x55f3bb26b390 2024-09-21T08:00:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.478+0000 7f609ee5a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f3bb534580 con 0x55f3bb28c070 2024-09-21T08:00:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.478+0000 7f609ee5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f3bb641510 con 0x55f3bb2631b0 2024-09-21T08:00:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.478+0000 7f609ee5a740 10 client.0 _ll_register_callbacks cb 0x55f3bb544470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.479+0000 7f6096200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb64a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.479+0000 7f6094e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb63ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.479+0000 7f6095800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb63e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.479+0000 7f6095800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb63e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49418/0 (socket says 172.21.15.84:49418) 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.479+0000 7f6095800640 1 -- 172.21.15.84:0/3102708444 learned_addr learned my addr 172.21.15.84:0/3102708444 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.480+0000 7f6095800640 1 -- 172.21.15.84:0/3102708444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 msgr2=0x55f3bb64a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.480+0000 7f6095800640 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb64a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.480+0000 7f6095800640 1 -- 172.21.15.84:0/3102708444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 msgr2=0x55f3bb63ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.480+0000 7f6095800640 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb63ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.480+0000 7f6095800640 1 -- 172.21.15.84:0/3102708444 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3bb2f7650 con 0x55f3bb2631b0 2024-09-21T08:00:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.481+0000 7f6095800640 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb63e8a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f609019e200 tx=0x7f607c005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afba0ceb0066be5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.481+0000 7f6077400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:00:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.482+0000 7f6077400640 1 -- 172.21.15.84:0/3102708444 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c035030 con 0x55f3bb2631b0 2024-09-21T08:00:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.482+0000 7f6077400640 1 -- 172.21.15.84:0/3102708444 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7f607c0048c0 con 0x55f3bb2631b0 2024-09-21T08:00:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.482+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3bb536b90 con 0x55f3bb2631b0 2024-09-21T08:00:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.483+0000 7f6077400640 1 -- 172.21.15.84:0/3102708444 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f607c004ac0 con 0x55f3bb2631b0 2024-09-21T08:00:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.483+0000 7f609ee5a740 10 client.27823 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.483+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f3bb551950 con 0x55f3bb2631b0 2024-09-21T08:00:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.483+0000 7f6077400640 1 -- 172.21.15.84:0/3102708444 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f3bb536b90 con 0x55f3bb2631b0 2024-09-21T08:00:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.485+0000 7f6077400640 1 -- 172.21.15.84:0/3102708444 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f607c003cd0 con 0x55f3bb2631b0 2024-09-21T08:00:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.485+0000 7f609ee5a740 10 client.27823 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.485+0000 7f609ee5a740 10 client.27823 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:00:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.485+0000 7f609ee5a740 20 client.27823 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.485+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb24a9f0 0x55f3bb6507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.485+0000 7f609ee5a740 4 client.27823 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.485+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3bb5abf00 con 0x55f3bb24a9f0 2024-09-21T08:00:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.486+0000 7f6094e00640 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb24a9f0 0x55f3bb6507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.487+0000 7f6094e00640 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb24a9f0 0x55f3bb6507d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5de50d70da181c93 server_cookie=ed12fcb5bed1b247 in_seq=0 out_seq=0 2024-09-21T08:00:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.487+0000 7f6077400640 10 client.27823 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:00:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.490+0000 7f6077400640 1 -- 172.21.15.84:0/3102708444 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3bb5abf00 con 0x55f3bb24a9f0 2024-09-21T08:00:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.490+0000 7f6077400640 10 client.27823 handle_command_reply: tid=0 2024-09-21T08:00:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.490+0000 7f609ee5a740 1 client.27823 shutdown 2024-09-21T08:00:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 msgr2=0x55f3bb63e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb63e8a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f609019e200 tx=0x7f607c005270 comp rx=0 tx=0).stop 2024-09-21T08:00:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 shutdown_connections 2024-09-21T08:00:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb24a9f0 0x55f3bb6507d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb64a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb63ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3102708444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb63e8a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 >> 172.21.15.84:0/3102708444 conn(0x55f3bb280460 msgr2=0x55f3bb635f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.491+0000 7f6077400640 0 client.27823 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:00:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.492+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 shutdown_connections 2024-09-21T08:00:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.493+0000 7f609ee5a740 1 -- 172.21.15.84:0/3102708444 wait complete. 2024-09-21T08:00:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.494+0000 7f609ee5a740 20 client.27823 trim_cache size 0 max 16384 2024-09-21T08:00:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.519+0000 7f609ee5a740 1 Processor -- start 2024-09-21T08:00:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.519+0000 7f609ee5a740 1 -- start start 2024-09-21T08:00:09.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.520+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb64a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.521+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb638e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.521+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb28c070 0x55f3bb630b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.521+0000 7f609ee5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60901bfda0 con 0x55f3bb26b390 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.521+0000 7f609ee5a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60901c18e0 con 0x55f3bb2631b0 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.521+0000 7f609ee5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f60901c0470 con 0x55f3bb28c070 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.521+0000 7f6095800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb64a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6095800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb64a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34178/0 (socket says 172.21.15.84:34178) 2024-09-21T08:00:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6095800640 1 -- 172.21.15.84:0/3041234256 learned_addr learned my addr 172.21.15.84:0/3041234256 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6094e00640 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb638e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6095800640 1 -- 172.21.15.84:0/3041234256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb28c070 msgr2=0x55f3bb630b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6095800640 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb28c070 0x55f3bb630b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6095800640 1 -- 172.21.15.84:0/3041234256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 msgr2=0x55f3bb638e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6095800640 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb638e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.522+0000 7f6095800640 1 -- 172.21.15.84:0/3041234256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bb635020 con 0x55f3bb2631b0 2024-09-21T08:00:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.523+0000 7f6094e00640 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb638e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:09.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.527+0000 7f6095800640 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb64a700 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f607c005ab0 tx=0x7f607c003aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5071bc9df466b8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.527+0000 7f6082000640 1 -- 172.21.15.84:0/3041234256 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c052070 con 0x55f3bb2631b0 2024-09-21T08:00:09.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.528+0000 7f6082000640 1 -- 172.21.15.84:0/3041234256 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f3bb536b90 con 0x55f3bb2631b0 2024-09-21T08:00:09.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.528+0000 7f6082000640 1 -- 172.21.15.84:0/3041234256 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c004ac0 con 0x55f3bb2631b0 2024-09-21T08:00:09.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.529+0000 7f609ee5a740 1 -- 172.21.15.84:0/3041234256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 msgr2=0x55f3bb64a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.529+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb64a700 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f607c005ab0 tx=0x7f607c003aa0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.530+0000 7f609ee5a740 1 -- 172.21.15.84:0/3041234256 shutdown_connections 2024-09-21T08:00:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.530+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb28c070 0x55f3bb630b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.530+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb638e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.530+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3041234256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb2631b0 0x55f3bb64a700 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.530+0000 7f609ee5a740 1 -- 172.21.15.84:0/3041234256 >> 172.21.15.84:0/3041234256 conn(0x55f3bb280460 msgr2=0x55f3bb630450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:09.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.531+0000 7f609ee5a740 1 -- 172.21.15.84:0/3041234256 shutdown_connections 2024-09-21T08:00:09.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.531+0000 7f609ee5a740 1 -- 172.21.15.84:0/3041234256 wait complete. 2024-09-21T08:00:09.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.532+0000 7f609ee5a740 1 -- start start 2024-09-21T08:00:09.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.532+0000 7f609ee5a740 1 Processor -- start 2024-09-21T08:00:09.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.533+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb642fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.534+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb643590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.534+0000 7f609ee5a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb6ba190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.534+0000 7f609ee5a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60901c1210 con 0x55f3bb26b390 2024-09-21T08:00:09.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.534+0000 7f6096200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb6ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.534+0000 7f6096200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb6ba190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34188/0 (socket says 172.21.15.84:34188) 2024-09-21T08:00:09.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.535+0000 7f6096200640 1 -- 172.21.15.84:0/3219436568 learned_addr learned my addr 172.21.15.84:0/3219436568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:09.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.535+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60901c0b40 con 0x55f3bb28c070 2024-09-21T08:00:09.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.535+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f60901a6560 con 0x55f3bb2631b0 2024-09-21T08:00:09.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.535+0000 7f609ee5a740 10 client.0 _ll_register_callbacks cb 0x7f607c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:09.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.535+0000 7f6096200640 1 -- 172.21.15.84:0/3219436568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 msgr2=0x55f3bb642fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:00:09.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.535+0000 7f6096200640 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb642fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.535+0000 7f6096200640 1 -- 172.21.15.84:0/3219436568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 msgr2=0x55f3bb643590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:00:09.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.536+0000 7f6096200640 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb643590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.536+0000 7f6096200640 1 -- 172.21.15.84:0/3219436568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3bb6ba800 con 0x55f3bb28c070 2024-09-21T08:00:09.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.536+0000 7f6096200640 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb6ba190 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f60880e8130 tx=0x7f60880aa050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a34c608949a01ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:09.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.536+0000 7f6077400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:00:09.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.537+0000 7f6077400640 1 -- 172.21.15.84:0/3219436568 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60880ad6e0 con 0x55f3bb28c070 2024-09-21T08:00:09.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.537+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3bb536b90 con 0x55f3bb28c070 2024-09-21T08:00:09.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.537+0000 7f6077400640 1 -- 172.21.15.84:0/3219436568 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7f60880b21c0 con 0x55f3bb28c070 2024-09-21T08:00:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.542+0000 7f6077400640 1 -- 172.21.15.84:0/3219436568 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f60880ae2d0 con 0x55f3bb28c070 2024-09-21T08:00:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.542+0000 7f609ee5a740 10 client.27815 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.542+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f3bb6bba00 con 0x55f3bb28c070 2024-09-21T08:00:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.543+0000 7f6077400640 1 -- 172.21.15.84:0/3219436568 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f3bb536b90 con 0x55f3bb28c070 2024-09-21T08:00:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.543+0000 7f6077400640 1 -- 172.21.15.84:0/3219436568 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f60880cc030 con 0x55f3bb28c070 2024-09-21T08:00:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.543+0000 7f609ee5a740 10 client.27815 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.543+0000 7f609ee5a740 10 client.27815 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:00:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.543+0000 7f609ee5a740 20 client.27815 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.543+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb21fda0 0x55f3bb6bdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.544+0000 7f609ee5a740 4 client.27815 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:00:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.544+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3bb5a79b0 con 0x55f3bb21fda0 2024-09-21T08:00:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.548+0000 7f6095800640 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb21fda0 0x55f3bb6bdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.550+0000 7f6095800640 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb21fda0 0x55f3bb6bdc40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2d13d452ad6248e2 server_cookie=73b54d55b8fd1bcb in_seq=0 out_seq=0 2024-09-21T08:00:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.550+0000 7f6077400640 10 client.27815 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:00:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.551+0000 7f6077400640 1 -- 172.21.15.84:0/3219436568 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3bb5a79b0 con 0x55f3bb21fda0 2024-09-21T08:00:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.551+0000 7f6077400640 10 client.27815 handle_command_reply: tid=0 2024-09-21T08:00:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.551+0000 7f609ee5a740 1 client.27815 shutdown 2024-09-21T08:00:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.551+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 msgr2=0x55f3bb6ba190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.551+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb6ba190 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f60880e8130 tx=0x7f60880aa050 comp rx=0 tx=0).stop 2024-09-21T08:00:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.552+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 shutdown_connections 2024-09-21T08:00:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.552+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x55f3bb21fda0 0x55f3bb6bdc40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.552+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f3bb28c070 0x55f3bb6ba190 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.552+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3bb26b390 0x55f3bb643590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.552+0000 7f609ee5a740 1 --2- 172.21.15.84:0/3219436568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3bb2631b0 0x55f3bb642fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.552+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 >> 172.21.15.84:0/3219436568 conn(0x55f3bb280460 msgr2=0x55f3bb633d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.552+0000 7f6077400640 0 client.27815 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:00:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.553+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 shutdown_connections 2024-09-21T08:00:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.553+0000 7f609ee5a740 1 -- 172.21.15.84:0/3219436568 wait complete. 2024-09-21T08:00:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.554+0000 7f609ee5a740 20 client.27815 trim_cache size 0 max 16384 2024-09-21T08:00:09.559 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:00:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60780b6700 msgr2=0x7f60780b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60780b6700 0x7f60780b8c10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6084006fd0 tx=0x7f6084006b20 comp rx=0 tx=0).stop 2024-09-21T08:00:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609010dc60 msgr2=0x7f6090102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609010dc60 0x7f6090102b40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f608800eb10 tx=0x7f608800c2d0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 shutdown_connections 2024-09-21T08:00:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f60780b6700 0x7f60780b8c10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609010dc60 0x7f6090102b40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60901050e0 0x7f60901025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 --2- 172.21.15.84:0/1705511370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60901046b0 0x7f6090103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.559+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 >> 172.21.15.84:0/1705511370 conn(0x7f60900fe2c0 msgr2=0x7f6090106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.561+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 shutdown_connections 2024-09-21T08:00:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:09.561+0000 7f6096c00640 1 -- 172.21.15.84:0/1705511370 wait complete. 2024-09-21T08:00:09.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:09 smithi162 ceph-mon[34833]: pgmap v671: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T08:00:09.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:09 smithi162 ceph-mon[34833]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T08:00:09.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:09 smithi084 ceph-mon[30411]: pgmap v671: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T08:00:09.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:09 smithi084 ceph-mon[30411]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T08:00:09.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:09 smithi191 ceph-mon[34667]: pgmap v671: 129 pgs: 129 active+clean; 52 GiB data, 110 GiB used, 963 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T08:00:09.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:09 smithi191 ceph-mon[34667]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T08:00:10.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T08:00:11.277 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:11.719 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:11 smithi084 ceph-mon[30411]: pgmap v673: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 51 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:00:11.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:11 smithi162 ceph-mon[34833]: pgmap v673: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 51 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:00:11.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:11 smithi191 ceph-mon[34667]: pgmap v673: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 51 GiB data, 109 GiB used, 964 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:00:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.077+0000 7f0c8dc00640 1 -- 172.21.15.84:0/2457360031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c880757b0 msgr2=0x7f0c88075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.077+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/2457360031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c880757b0 0x7f0c88075bc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009900 tx=0x7f0c7002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.077+0000 7f0c8dc00640 1 -- 172.21.15.84:0/2457360031 shutdown_connections 2024-09-21T08:00:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.077+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/2457360031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c8810ff10 0x7f0c88112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.077+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/2457360031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c88076100 0x7f0c8810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.077+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/2457360031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c880757b0 0x7f0c88075bc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.077+0000 7f0c8dc00640 1 -- 172.21.15.84:0/2457360031 >> 172.21.15.84:0/2457360031 conn(0x7f0c880ff440 msgr2=0x7f0c88101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.078+0000 7f0c8dc00640 1 -- 172.21.15.84:0/2457360031 shutdown_connections 2024-09-21T08:00:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.079+0000 7f0c8dc00640 1 -- 172.21.15.84:0/2457360031 wait complete. 2024-09-21T08:00:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.080+0000 7f0c8dc00640 1 Processor -- start 2024-09-21T08:00:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.080+0000 7f0c8dc00640 1 -- start start 2024-09-21T08:00:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.081+0000 7f0c8dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c880757b0 0x7f0c881073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.081+0000 7f0c8dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c88076100 0x7f0c88103680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.081+0000 7f0c8dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8810ff10 0x7f0c88103da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.081+0000 7f0c8dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88115b10 con 0x7f0c8810ff10 2024-09-21T08:00:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.081+0000 7f0c8dc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88115990 con 0x7f0c88076100 2024-09-21T08:00:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.081+0000 7f0c8dc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88115c90 con 0x7f0c880757b0 2024-09-21T08:00:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.082+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c880757b0 0x7f0c881073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.082+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c880757b0 0x7f0c881073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49446/0 (socket says 172.21.15.84:49446) 2024-09-21T08:00:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.082+0000 7f0c87e00640 1 -- 172.21.15.84:0/673411910 learned_addr learned my addr 172.21.15.84:0/673411910 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.082+0000 7f0c8d200640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8810ff10 0x7f0c88103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.082+0000 7f0c87400640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c88076100 0x7f0c88103680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.083+0000 7f0c87400640 1 -- 172.21.15.84:0/673411910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c880757b0 msgr2=0x7f0c881073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.083+0000 7f0c87400640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c880757b0 0x7f0c881073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.083+0000 7f0c87400640 1 -- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8810ff10 msgr2=0x7f0c88103da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.083+0000 7f0c87400640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8810ff10 0x7f0c88103da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.083+0000 7f0c87400640 1 -- 172.21.15.84:0/673411910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c881aca10 con 0x7f0c88076100 2024-09-21T08:00:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.083+0000 7f0c8d200640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8810ff10 0x7f0c88103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.083+0000 7f0c87400640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c88076100 0x7f0c88103680 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800e9c0 tx=0x7f0c7800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.084+0000 7f0c84c00640 1 -- 172.21.15.84:0/673411910 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800ccc0 con 0x7f0c88076100 2024-09-21T08:00:12.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.084+0000 7f0c84c00640 1 -- 172.21.15.84:0/673411910 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c780035f0 con 0x7f0c88076100 2024-09-21T08:00:12.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.084+0000 7f0c84c00640 1 -- 172.21.15.84:0/673411910 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800ce60 con 0x7f0c88076100 2024-09-21T08:00:12.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.084+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c881acc40 con 0x7f0c88076100 2024-09-21T08:00:12.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.084+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c881ad130 con 0x7f0c88076100 2024-09-21T08:00:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.087+0000 7f0c95e6f740 1 Processor -- start 2024-09-21T08:00:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.088+0000 7f0c95e6f740 1 -- start start 2024-09-21T08:00:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.089+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079884f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.089+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794b51b0 0x5650798854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.089+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794bd390 0x5650798859f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.089+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5650797fbfb0 con 0x5650794de070 2024-09-21T08:00:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.089+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5650797eb3e0 con 0x5650794bd390 2024-09-21T08:00:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.089+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5650797ef1f0 con 0x5650794b51b0 2024-09-21T08:00:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.090+0000 7f0c8d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079884f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.090+0000 7f0c8d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079884f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51424/0 (socket says 172.21.15.84:51424) 2024-09-21T08:00:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.090+0000 7f0c8d200640 1 -- 172.21.15.84:0/3613748 learned_addr learned my addr 172.21.15.84:0/3613748 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.091+0000 7f0c8d200640 1 -- 172.21.15.84:0/3613748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794b51b0 msgr2=0x5650798854b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.091+0000 7f0c87e00640 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794b51b0 0x5650798854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.091+0000 7f0c8d200640 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794b51b0 0x5650798854b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.091+0000 7f0c8d200640 1 -- 172.21.15.84:0/3613748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794bd390 msgr2=0x5650798859f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:00:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.091+0000 7f0c8d200640 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794bd390 0x5650798859f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.091+0000 7f0c8d200640 1 -- 172.21.15.84:0/3613748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650797b5cd0 con 0x5650794de070 2024-09-21T08:00:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.091+0000 7f0c87e00640 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794b51b0 0x5650798854b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.092+0000 7f0c8d200640 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079884f70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0c80010750 tx=0x7f0c80010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1393e178d5206db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.092+0000 7f0c84c00640 1 -- 172.21.15.84:0/673411910 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0c78004000 con 0x7f0c88076100 2024-09-21T08:00:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.093+0000 7f0c7d600640 1 -- 172.21.15.84:0/3613748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000ead0 con 0x5650794de070 2024-09-21T08:00:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.093+0000 7f0c7d600640 1 -- 172.21.15.84:0/3613748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c80010e60 con 0x5650794de070 2024-09-21T08:00:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.093+0000 7f0c7d600640 1 -- 172.21.15.84:0/3613748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80011640 con 0x5650794de070 2024-09-21T08:00:12.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.094+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3613748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 msgr2=0x565079884f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.094+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079884f70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0c80010750 tx=0x7f0c80010c10 comp rx=0 tx=0).stop 2024-09-21T08:00:12.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3613748 shutdown_connections 2024-09-21T08:00:12.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794bd390 0x5650798859f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794b51b0 0x5650798854b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3613748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079884f70 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3613748 >> 172.21.15.84:0/3613748 conn(0x5650794d2460 msgr2=0x565079882e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3613748 shutdown_connections 2024-09-21T08:00:12.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3613748 wait complete. 2024-09-21T08:00:12.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.095+0000 7f0c84c00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c6c0b6690 0x7f0c6c0b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.096+0000 7f0c84c00640 1 -- 172.21.15.84:0/673411910 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7f0c780e7e10 con 0x7f0c88076100 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.096+0000 7f0c87e00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c6c0b6690 0x7f0c6c0b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.096+0000 7f0c95e6f740 1 -- start start 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.096+0000 7f0c95e6f740 1 Processor -- start 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798909d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794bd390 0x565079890f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794de070 0x56507989ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56507964c700 con 0x5650794bd390 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565079786580 con 0x5650794b51b0 2024-09-21T08:00:12.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x565079893750 con 0x5650794de070 2024-09-21T08:00:12.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c95e6f740 10 client.0 _ll_register_callbacks cb 0x565079796470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:12.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.097+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798909d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.098+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798909d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34198/0 (socket says 172.21.15.84:34198) 2024-09-21T08:00:12.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.098+0000 7f0c87e00640 1 -- 172.21.15.84:0/171632120 learned_addr learned my addr 172.21.15.84:0/171632120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:12.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.098+0000 7f0c8d200640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794de070 0x56507989ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87400640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794bd390 0x565079890f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87e00640 1 -- 172.21.15.84:0/171632120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794de070 msgr2=0x56507989ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:12.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87e00640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794de070 0x56507989ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87e00640 1 -- 172.21.15.84:0/171632120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794bd390 msgr2=0x565079890f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:12.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87e00640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794bd390 0x565079890f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87e00640 1 -- 172.21.15.84:0/171632120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565079549650 con 0x5650794b51b0 2024-09-21T08:00:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87400640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794bd390 0x565079890f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87e00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c6c0b6690 0x7f0c6c0b8ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005ec0 tx=0x7f0c70005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c87e00640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798909d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0c700096c0 tx=0x7f0c70009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce4f52863a2bd0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c76000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:00:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.099+0000 7f0c76000640 1 -- 172.21.15.84:0/171632120 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7004d070 con 0x5650794b51b0 2024-09-21T08:00:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.100+0000 7f0c76000640 1 -- 172.21.15.84:0/171632120 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7f0c700314a0 con 0x5650794b51b0 2024-09-21T08:00:12.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.100+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565079788b90 con 0x5650794b51b0 2024-09-21T08:00:12.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.100+0000 7f0c76000640 1 -- 172.21.15.84:0/171632120 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0c70059050 con 0x5650794b51b0 2024-09-21T08:00:12.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.100+0000 7f0c95e6f740 10 client.27824 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:12.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.100+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650797a3950 con 0x5650794b51b0 2024-09-21T08:00:12.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c76000640 1 -- 172.21.15.84:0/171632120 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x565079788b90 con 0x5650794b51b0 2024-09-21T08:00:12.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c76000640 1 -- 172.21.15.84:0/171632120 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0c70049670 con 0x5650794b51b0 2024-09-21T08:00:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c95e6f740 10 client.27824 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c95e6f740 10 client.27824 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:00:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c95e6f740 20 client.27824 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56507949c9f0 0x5650798a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c95e6f740 4 client.27824 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.101+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650797fdf00 con 0x56507949c9f0 2024-09-21T08:00:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.102+0000 7f0c87400640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56507949c9f0 0x5650798a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.102+0000 7f0c76000640 10 client.27824 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:00:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.103+0000 7f0c87400640 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56507949c9f0 0x5650798a2900 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9a516a9f451ada71 server_cookie=a570ca198a082ec3 in_seq=0 out_seq=0 2024-09-21T08:00:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c76000640 1 -- 172.21.15.84:0/171632120 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650797fdf00 con 0x56507949c9f0 2024-09-21T08:00:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c76000640 10 client.27824 handle_command_reply: tid=0 2024-09-21T08:00:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 client.27824 shutdown 2024-09-21T08:00:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 msgr2=0x5650798909d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798909d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0c700096c0 tx=0x7f0c70009260 comp rx=0 tx=0).stop 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 shutdown_connections 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56507949c9f0 0x5650798a2900 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794de070 0x56507989ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794bd390 0x565079890f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/171632120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798909d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.104+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 >> 172.21.15.84:0/171632120 conn(0x5650794d2460 msgr2=0x565079881600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.105+0000 7f0c76000640 0 client.27824 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:00:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.105+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 shutdown_connections 2024-09-21T08:00:12.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.105+0000 7f0c95e6f740 1 -- 172.21.15.84:0/171632120 wait complete. 2024-09-21T08:00:12.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.105+0000 7f0c95e6f740 20 client.27824 trim_cache size 0 max 16384 2024-09-21T08:00:12.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.123+0000 7f0c95e6f740 1 Processor -- start 2024-09-21T08:00:12.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.123+0000 7f0c95e6f740 1 -- start start 2024-09-21T08:00:12.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.123+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794b51b0 0x56507988bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.123+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079881fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794de070 0x5650798866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881b7420 con 0x5650794b51b0 2024-09-21T08:00:12.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881b8f60 con 0x5650794de070 2024-09-21T08:00:12.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881b7af0 con 0x5650794bd390 2024-09-21T08:00:12.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794b51b0 0x56507988bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c87400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079881fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c87400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079881fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49464/0 (socket says 172.21.15.84:49464) 2024-09-21T08:00:12.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794b51b0 0x56507988bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51440/0 (socket says 172.21.15.84:51440) 2024-09-21T08:00:12.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.124+0000 7f0c87400640 1 -- 172.21.15.84:0/3240010421 learned_addr learned my addr 172.21.15.84:0/3240010421 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:12.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.125+0000 7f0c8d200640 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794de070 0x5650798866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.125+0000 7f0c87400640 1 -- 172.21.15.84:0/3240010421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794de070 msgr2=0x5650798866b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.125+0000 7f0c87400640 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794de070 0x5650798866b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.125+0000 7f0c87400640 1 -- 172.21.15.84:0/3240010421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794b51b0 msgr2=0x56507988bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.125+0000 7f0c87400640 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794b51b0 0x56507988bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.125+0000 7f0c87400640 1 -- 172.21.15.84:0/3240010421 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565079891ab0 con 0x5650794bd390 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.125+0000 7f0c87e00640 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794b51b0 0x56507988bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.126+0000 7f0c87400640 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079881fc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0c780a9e10 tx=0x7f0c780ad250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a06303db07b0edd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.127+0000 7f0c7cc00640 1 -- 172.21.15.84:0/3240010421 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780b20e0 con 0x5650794bd390 2024-09-21T08:00:12.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.127+0000 7f0c7cc00640 1 -- 172.21.15.84:0/3240010421 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c780b2320 con 0x5650794bd390 2024-09-21T08:00:12.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.127+0000 7f0c7cc00640 1 -- 172.21.15.84:0/3240010421 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780e53c0 con 0x5650794bd390 2024-09-21T08:00:12.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3240010421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 msgr2=0x565079881fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079881fc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0c780a9e10 tx=0x7f0c780ad250 comp rx=0 tx=0).stop 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3240010421 shutdown_connections 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794de070 0x5650798866b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079881fc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3240010421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794b51b0 0x56507988bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3240010421 >> 172.21.15.84:0/3240010421 conn(0x5650794d2460 msgr2=0x565079885fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3240010421 shutdown_connections 2024-09-21T08:00:12.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.128+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3240010421 wait complete. 2024-09-21T08:00:12.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.129+0000 7f0c95e6f740 1 -- start start 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.129+0000 7f0c95e6f740 1 Processor -- start 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798989b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079898ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c95e6f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079893960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881b8890 con 0x5650794de070 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881b81c0 con 0x5650794b51b0 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c95e6f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c881b5400 con 0x5650794bd390 2024-09-21T08:00:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c95e6f740 10 client.0 _ll_register_callbacks cb 0x7f0c700043c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:12.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.131+0000 7f0c87e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:34210/0 (socket says 172.21.15.84:34210) 2024-09-21T08:00:12.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.131+0000 7f0c87e00640 1 -- 172.21.15.84:0/3702407890 learned_addr learned my addr 172.21.15.84:0/3702407890 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:12.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.130+0000 7f0c87400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079898ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.131+0000 7f0c8d200640 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079893960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.132+0000 7f0c87e00640 1 -- 172.21.15.84:0/3702407890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 msgr2=0x565079898ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:12.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.132+0000 7f0c87e00640 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079898ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.132+0000 7f0c87e00640 1 -- 172.21.15.84:0/3702407890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 msgr2=0x565079893960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:12.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.132+0000 7f0c87e00640 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079893960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.132+0000 7f0c87e00640 1 -- 172.21.15.84:0/3702407890 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565079893ea0 con 0x5650794b51b0 2024-09-21T08:00:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.133+0000 7f0c87e00640 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798989b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0c70049b10 tx=0x7f0c7002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d1d9de4125cf7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.133+0000 7f0c76000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:00:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.133+0000 7f0c76000640 1 -- 172.21.15.84:0/3702407890 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70062060 con 0x5650794b51b0 2024-09-21T08:00:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.133+0000 7f0c76000640 1 -- 172.21.15.84:0/3702407890 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7f0c70049640 con 0x5650794b51b0 2024-09-21T08:00:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.133+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c780b2320 con 0x5650794b51b0 2024-09-21T08:00:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.134+0000 7f0c76000640 1 -- 172.21.15.84:0/3702407890 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0c7004d040 con 0x5650794b51b0 2024-09-21T08:00:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.134+0000 7f0c95e6f740 10 client.27830 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.134+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56507990d9d0 con 0x5650794b51b0 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c76000640 1 -- 172.21.15.84:0/3702407890 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c780b2320 con 0x5650794b51b0 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c76000640 1 -- 172.21.15.84:0/3702407890 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0c7003c440 con 0x5650794b51b0 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c95e6f740 10 client.27830 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c95e6f740 10 client.27830 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c95e6f740 20 client.27830 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x565079471da0 0x565079910170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c95e6f740 4 client.27830 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:00:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.135+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5650797f99b0 con 0x565079471da0 2024-09-21T08:00:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.136+0000 7f0c87400640 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x565079471da0 0x565079910170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.136+0000 7f0c87400640 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x565079471da0 0x565079910170 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4f225eb4f6675717 server_cookie=cc7fa33aed6fc24f in_seq=0 out_seq=0 2024-09-21T08:00:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.136+0000 7f0c76000640 10 client.27830 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:00:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.137+0000 7f0c76000640 1 -- 172.21.15.84:0/3702407890 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5650797f99b0 con 0x565079471da0 2024-09-21T08:00:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.137+0000 7f0c76000640 10 client.27830 handle_command_reply: tid=0 2024-09-21T08:00:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.137+0000 7f0c95e6f740 1 client.27830 shutdown 2024-09-21T08:00:12.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 msgr2=0x5650798989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798989b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0c70049b10 tx=0x7f0c7002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 shutdown_connections 2024-09-21T08:00:12.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x565079471da0 0x565079910170 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5650794de070 0x565079893960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5650794bd390 0x565079898ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 --2- 172.21.15.84:0/3702407890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5650794b51b0 0x5650798989b0 secure :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0c70049b10 tx=0x7f0c7002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 >> 172.21.15.84:0/3702407890 conn(0x5650794d2460 msgr2=0x565079881d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c76000640 0 client.27830 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:00:12.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 shutdown_connections 2024-09-21T08:00:12.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.139+0000 7f0c95e6f740 1 -- 172.21.15.84:0/3702407890 wait complete. 2024-09-21T08:00:12.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.140+0000 7f0c95e6f740 20 client.27830 trim_cache size 0 max 16384 2024-09-21T08:00:12.142 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:00:12.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c6c0b6690 msgr2=0x7f0c6c0b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c6c0b6690 0x7f0c6c0b8ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005ec0 tx=0x7f0c70005a20 comp rx=0 tx=0).stop 2024-09-21T08:00:12.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c88076100 msgr2=0x7f0c88103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:12.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c88076100 0x7f0c88103680 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800e9c0 tx=0x7f0c7800ee80 comp rx=0 tx=0).stop 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 shutdown_connections 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0c6c0b6690 0x7f0c6c0b8ba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8810ff10 0x7f0c88103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c88076100 0x7f0c88103680 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 --2- 172.21.15.84:0/673411910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c880757b0 0x7f0c881073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.141+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 >> 172.21.15.84:0/673411910 conn(0x7f0c880ff440 msgr2=0x7f0c88107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.142+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 shutdown_connections 2024-09-21T08:00:12.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:12.142+0000 7f0c8dc00640 1 -- 172.21.15.84:0/673411910 wait complete. 2024-09-21T08:00:12.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T08:00:13.241 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:13.707 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:13 smithi084 ceph-mon[30411]: pgmap v674: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 48 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:00:13.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:13 smithi162 ceph-mon[34833]: pgmap v674: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 48 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:00:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.881+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3737810889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc109c40 msgr2=0x7fe9cc110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.881+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3737810889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc109c40 0x7fe9cc110470 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009ca0 tx=0x7fe9c402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.882+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3737810889 shutdown_connections 2024-09-21T08:00:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.882+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3737810889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc109c40 0x7fe9cc110470 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.882+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3737810889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9cc1092f0 0x7fe9cc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.882+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3737810889 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc1039b0 0x7fe9cc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.882+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3737810889 >> 172.21.15.84:0/3737810889 conn(0x7fe9cc0ff440 msgr2=0x7fe9cc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.882+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3737810889 shutdown_connections 2024-09-21T08:00:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.882+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3737810889 wait complete. 2024-09-21T08:00:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 Processor -- start 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 -- start start 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9cc1039b0 0x7fe9cc19c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc1092f0 0x7fe9cc19ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc109c40 0x7fe9cc1a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc113950 con 0x7fe9cc1092f0 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1137d0 con 0x7fe9cc1039b0 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.883+0000 7fe9cbe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc113ad0 con 0x7fe9cc109c40 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9ca000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc1092f0 0x7fe9cc19ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9cb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc109c40 0x7fe9cc1a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9ca000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc1092f0 0x7fe9cc19ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51470/0 (socket says 172.21.15.84:51470) 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9cb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc109c40 0x7fe9cc1a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49490/0 (socket says 172.21.15.84:49490) 2024-09-21T08:00:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9ca000640 1 -- 172.21.15.84:0/3860555683 learned_addr learned my addr 172.21.15.84:0/3860555683 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9caa00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9cc1039b0 0x7fe9cc19c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9cb400640 1 -- 172.21.15.84:0/3860555683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9cc1039b0 msgr2=0x7fe9cc19c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9cb400640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9cc1039b0 0x7fe9cc19c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9cb400640 1 -- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc1092f0 msgr2=0x7fe9cc19ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9cb400640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc1092f0 0x7fe9cc19ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9cb400640 1 -- 172.21.15.84:0/3860555683 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc1a2450 con 0x7fe9cc109c40 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.884+0000 7fe9ca000640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc1092f0 0x7fe9cc19ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.885+0000 7fe9cb400640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc109c40 0x7fe9cc1a1d20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4005e30 tx=0x7fe9c40317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.885+0000 7fe9d0a00640 1 -- 172.21.15.84:0/3860555683 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4003b70 con 0x7fe9cc109c40 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.885+0000 7fe9d0a00640 1 -- 172.21.15.84:0/3860555683 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9c4003d10 con 0x7fe9cc109c40 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.885+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc1a26e0 con 0x7fe9cc109c40 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.885+0000 7fe9d0a00640 1 -- 172.21.15.84:0/3860555683 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c402f970 con 0x7fe9cc109c40 2024-09-21T08:00:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.885+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc1a8ea0 con 0x7fe9cc109c40 2024-09-21T08:00:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.888+0000 7fe9d8a67740 1 Processor -- start 2024-09-21T08:00:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.889+0000 7fe9d0a00640 1 -- 172.21.15.84:0/3860555683 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe9c402fb10 con 0x7fe9cc109c40 2024-09-21T08:00:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.889+0000 7fe9d8a67740 1 -- start start 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.889+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9ac070 0x5564acd52f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.889+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9831b0 0x5564acd534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac98b390 0x5564acd539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5564accc9fb0 con 0x5564ac98b390 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5564accb93e0 con 0x5564ac9ac070 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5564accbd1f0 con 0x5564ac9831b0 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9831b0 0x5564acd534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9831b0 0x5564acd534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49502/0 (socket says 172.21.15.84:49502) 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 -- 172.21.15.84:0/2021927565 learned_addr learned my addr 172.21.15.84:0/2021927565 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9ca000640 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9ac070 0x5564acd52f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9ca000640 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac98b390 0x5564acd539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 -- 172.21.15.84:0/2021927565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9ac070 msgr2=0x5564acd52f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9ac070 0x5564acd52f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 -- 172.21.15.84:0/2021927565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac98b390 msgr2=0x5564acd539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac98b390 0x5564acd539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9caa00640 1 -- 172.21.15.84:0/2021927565 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564acc83cd0 con 0x5564ac9831b0 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.890+0000 7fe9ca000640 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9ac070 0x5564acd52f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.891+0000 7fe9d0a00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe9b00b6680 0x7fe9b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.891+0000 7fe9caa00640 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9831b0 0x5564acd534b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009cf0 tx=0x7fe9bc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98a2c595ea2b4778 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.891+0000 7fe9d0a00640 1 -- 172.21.15.84:0/3860555683 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7fe9c4108ad0 con 0x7fe9cc109c40 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.891+0000 7fe9b7e00640 1 -- 172.21.15.84:0/2021927565 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc01e070 con 0x5564ac9831b0 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.891+0000 7fe9ca000640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe9b00b6680 0x7fe9b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.891+0000 7fe9b7e00640 1 -- 172.21.15.84:0/2021927565 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9bc019ae0 con 0x5564ac9831b0 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.891+0000 7fe9b7e00640 1 -- 172.21.15.84:0/2021927565 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00e970 con 0x5564ac9831b0 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2021927565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9831b0 msgr2=0x5564acd534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9ca000640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe9b00b6680 0x7fe9b00b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80095c0 tx=0x7fe9b8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9831b0 0x5564acd534b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009cf0 tx=0x7fe9bc011810 comp rx=0 tx=0).stop 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2021927565 shutdown_connections 2024-09-21T08:00:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac98b390 0x5564acd539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9831b0 0x5564acd534b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2021927565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9ac070 0x5564acd52f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2021927565 >> 172.21.15.84:0/2021927565 conn(0x5564ac9a0460 msgr2=0x5564acd50e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2021927565 shutdown_connections 2024-09-21T08:00:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.892+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2021927565 wait complete. 2024-09-21T08:00:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 -- start start 2024-09-21T08:00:13.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 Processor -- start 2024-09-21T08:00:13.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9831b0 0x5564acd5e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac98b390 0x5564acd5ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9ac070 0x5564acd6aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5564acb1a700 con 0x5564ac9ac070 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5564acc54580 con 0x5564ac9831b0 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5564acd61750 con 0x5564ac98b390 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.893+0000 7fe9d8a67740 10 client.0 _ll_register_callbacks cb 0x5564acc64470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9cb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9ac070 0x5564acd6aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac98b390 0x5564acd5ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac98b390 0x5564acd5ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49518/0 (socket says 172.21.15.84:49518) 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9cb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9ac070 0x5564acd6aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51480/0 (socket says 172.21.15.84:51480) 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 -- 172.21.15.84:0/1874246757 learned_addr learned my addr 172.21.15.84:0/1874246757 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9831b0 0x5564acd5e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 -- 172.21.15.84:0/1874246757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9831b0 msgr2=0x5564acd5e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9831b0 0x5564acd5e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 -- 172.21.15.84:0/1874246757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9ac070 msgr2=0x5564acd6aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9ac070 0x5564acd6aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.894+0000 7fe9ca000640 1 -- 172.21.15.84:0/1874246757 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564aca17650 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9ca000640 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac98b390 0x5564acd5ebd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80105c0 tx=0x7fe9b8009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a596a695f4e2245 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9b4c00640 1 -- 172.21.15.84:0/1874246757 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80200d0 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564acc56b90 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9b4c00640 1 -- 172.21.15.84:0/1874246757 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7fe9b8004020 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9b4c00640 1 -- 172.21.15.84:0/1874246757 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe9b8034050 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9d8a67740 10 client.27850 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564acc71950 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.895+0000 7fe9b4c00640 1 -- 172.21.15.84:0/1874246757 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5564acc56b90 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9b4c00640 1 -- 172.21.15.84:0/1874246757 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe9b8003cd0 con 0x5564ac98b390 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9d8a67740 10 client.27850 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9d8a67740 10 client.27850 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:00:13.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9d8a67740 20 client.27850 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac96a9f0 0x5564acd708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9d8a67740 4 client.27850 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564acccbf00 con 0x5564ac96a9f0 2024-09-21T08:00:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.896+0000 7fe9caa00640 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac96a9f0 0x5564acd708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.897+0000 7fe9caa00640 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac96a9f0 0x5564acd708a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2873dea97c6fc64a server_cookie=d38f896e9ad4aef0 in_seq=0 out_seq=0 2024-09-21T08:00:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.897+0000 7fe9b4c00640 10 client.27850 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.897+0000 7fe9b4c00640 1 -- 172.21.15.84:0/1874246757 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564acccbf00 con 0x5564ac96a9f0 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.897+0000 7fe9b4c00640 10 client.27850 handle_command_reply: tid=0 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 client.27850 shutdown 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac98b390 msgr2=0x5564acd5ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac98b390 0x5564acd5ebd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80105c0 tx=0x7fe9b8009530 comp rx=0 tx=0).stop 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 shutdown_connections 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac96a9f0 0x5564acd708a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9ac070 0x5564acd6aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac98b390 0x5564acd5ebd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9b4c00640 0 client.27850 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:00:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/1874246757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac9831b0 0x5564acd5e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 >> 172.21.15.84:0/1874246757 conn(0x5564ac9a0460 msgr2=0x5564acd4f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 shutdown_connections 2024-09-21T08:00:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 1 -- 172.21.15.84:0/1874246757 wait complete. 2024-09-21T08:00:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.898+0000 7fe9d8a67740 20 client.27850 trim_cache size 0 max 16384 2024-09-21T08:00:13.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:13 smithi191 ceph-mon[34667]: pgmap v674: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 48 GiB data, 104 GiB used, 969 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:00:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 Processor -- start 2024-09-21T08:00:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 -- start start 2024-09-21T08:00:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd6a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd5b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1b3060 con 0x5564ac9831b0 2024-09-21T08:00:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1b4ba0 con 0x5564ac98b390 2024-09-21T08:00:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1b3730 con 0x5564ac9ac070 2024-09-21T08:00:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.912+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51484/0 (socket says 172.21.15.84:51484) 2024-09-21T08:00:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9caa00640 1 -- 172.21.15.84:0/348642284 learned_addr learned my addr 172.21.15.84:0/348642284 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9cb400640 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd5b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9ca000640 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd6a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9caa00640 1 -- 172.21.15.84:0/348642284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 msgr2=0x5564acd5b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9caa00640 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd5b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9caa00640 1 -- 172.21.15.84:0/348642284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 msgr2=0x5564acd6a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9caa00640 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd6a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9caa00640 1 -- 172.21.15.84:0/348642284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564acd5f950 con 0x5564ac9831b0 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9cb400640 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd5b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9ca000640 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd6a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.913+0000 7fe9caa00640 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd546b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0097e0 tx=0x7fe9bc0051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfda976cf0da009 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9b7400640 1 -- 172.21.15.84:0/348642284 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc033070 con 0x5564ac9831b0 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9b7400640 1 -- 172.21.15.84:0/348642284 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9bc01f040 con 0x5564ac9831b0 2024-09-21T08:00:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9b7400640 1 -- 172.21.15.84:0/348642284 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc01e040 con 0x5564ac9831b0 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9d8a67740 1 -- 172.21.15.84:0/348642284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 msgr2=0x5564acd546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd546b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0097e0 tx=0x7fe9bc0051d0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9d8a67740 1 -- 172.21.15.84:0/348642284 shutdown_connections 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd5b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd6a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/348642284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd546b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.914+0000 7fe9d8a67740 1 -- 172.21.15.84:0/348642284 >> 172.21.15.84:0/348642284 conn(0x5564ac9a0460 msgr2=0x5564acd53fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.915+0000 7fe9d8a67740 1 -- 172.21.15.84:0/348642284 shutdown_connections 2024-09-21T08:00:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.915+0000 7fe9d8a67740 1 -- 172.21.15.84:0/348642284 wait complete. 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.915+0000 7fe9d8a67740 1 -- start start 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.915+0000 7fe9d8a67740 1 Processor -- start 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd66fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd61990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9d8a67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd61ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1b44d0 con 0x5564ac9831b0 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1b3e00 con 0x5564ac98b390 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9d8a67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc1b1040 con 0x5564ac9ac070 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9d8a67740 10 client.0 _ll_register_callbacks cb 0x7fe9b800faf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd66fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd66fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51490/0 (socket says 172.21.15.84:51490) 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 -- 172.21.15.84:0/2059397506 learned_addr learned my addr 172.21.15.84:0/2059397506 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9cb400640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd61ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9ca000640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd61990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 -- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 msgr2=0x5564acd61ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd61ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 -- 172.21.15.84:0/2059397506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 msgr2=0x5564acd61990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd61990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9caa00640 1 -- 172.21.15.84:0/2059397506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564acd62460 con 0x5564ac9831b0 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.916+0000 7fe9cb400640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd61ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9caa00640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd66fc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e7d0 tx=0x7fe9bc005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb41e6b7da1fa675 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9b4c00640 1 -- 172.21.15.84:0/2059397506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc033070 con 0x5564ac9831b0 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9b4c00640 1 -- 172.21.15.84:0/2059397506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7fe9bc0052c0 con 0x5564ac9831b0 2024-09-21T08:00:13.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9bc01f040 con 0x5564ac9831b0 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9b4c00640 1 -- 172.21.15.84:0/2059397506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe9bc041050 con 0x5564ac9831b0 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9d8a67740 10 client.17478 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.917+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564acddbfe0 con 0x5564ac9831b0 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9b4c00640 1 -- 172.21.15.84:0/2059397506 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9bc01f040 con 0x5564ac9831b0 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9b4c00640 1 -- 172.21.15.84:0/2059397506 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe9bc0038f0 con 0x5564ac9831b0 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9d8a67740 10 client.17478 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9d8a67740 10 client.17478 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9d8a67740 20 client.17478 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac93fda0 0x5564acdde540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9d8a67740 4 client.17478 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:00:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564acd5f000 con 0x5564ac93fda0 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.918+0000 7fe9ca000640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac93fda0 0x5564acdde540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9ca000640 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac93fda0 0x5564acdde540 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cec814dba885be8b server_cookie=f670d8ddfb9c1918 in_seq=0 out_seq=0 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9b4c00640 10 client.17478 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9b4c00640 1 -- 172.21.15.84:0/2059397506 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564acd5f000 con 0x5564ac93fda0 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9b4c00640 10 client.17478 handle_command_reply: tid=0 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 client.17478 shutdown 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 msgr2=0x5564acd66fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd66fc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e7d0 tx=0x7fe9bc005dc0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 shutdown_connections 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5564ac93fda0 0x5564acdde540 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564ac9ac070 0x5564acd61ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564ac98b390 0x5564acd61990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 --2- 172.21.15.84:0/2059397506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564ac9831b0 0x5564acd66fc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 >> 172.21.15.84:0/2059397506 conn(0x5564ac9a0460 msgr2=0x5564acd5fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9b4c00640 0 client.17478 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:00:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 shutdown_connections 2024-09-21T08:00:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.919+0000 7fe9d8a67740 1 -- 172.21.15.84:0/2059397506 wait complete. 2024-09-21T08:00:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9d8a67740 20 client.17478 trim_cache size 0 max 16384 2024-09-21T08:00:13.926 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe9b00b6680 msgr2=0x7fe9b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe9b00b6680 0x7fe9b00b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80095c0 tx=0x7fe9b8005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc109c40 msgr2=0x7fe9cc1a1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc109c40 0x7fe9cc1a1d20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4005e30 tx=0x7fe9c40317c0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 shutdown_connections 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe9b00b6680 0x7fe9b00b8b90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9cc109c40 0x7fe9cc1a1d20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9cc1092f0 0x7fe9cc19ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 --2- 172.21.15.84:0/3860555683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9cc1039b0 0x7fe9cc19c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.920+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 >> 172.21.15.84:0/3860555683 conn(0x7fe9cc0ff440 msgr2=0x7fe9cc108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.921+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 shutdown_connections 2024-09-21T08:00:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:13.921+0000 7fe9cbe00640 1 -- 172.21.15.84:0/3860555683 wait complete. 2024-09-21T08:00:15.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:15 smithi162 ceph-mon[34833]: pgmap v675: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 44 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-09-21T08:00:15.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:15 smithi084 ceph-mon[30411]: pgmap v675: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 44 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-09-21T08:00:15.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:15.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:15 smithi191 ceph-mon[34667]: pgmap v675: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 44 GiB data, 97 GiB used, 976 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-09-21T08:00:16.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T08:00:16.422 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:17.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 -- 172.21.15.84:0/915881867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 msgr2=0x7fc89c10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 --2- 172.21.15.84:0/915881867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 0x7fc89c10d870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc888009900 tx=0x7fc88802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 -- 172.21.15.84:0/915881867 shutdown_connections 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 --2- 172.21.15.84:0/915881867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc89c10de30 0x7fc89c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 --2- 172.21.15.84:0/915881867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 0x7fc89c10d870 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 --2- 172.21.15.84:0/915881867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 0x7fc89c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 -- 172.21.15.84:0/915881867 >> 172.21.15.84:0/915881867 conn(0x7fc89c079740 msgr2=0x7fc89c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 -- 172.21.15.84:0/915881867 shutdown_connections 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.239+0000 7fc8a4200640 1 -- 172.21.15.84:0/915881867 wait complete. 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.240+0000 7fc8a4200640 1 Processor -- start 2024-09-21T08:00:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a4200640 1 -- start start 2024-09-21T08:00:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a4200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 0x7fc89c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a4200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 0x7fc89c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a4200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc89c10de30 0x7fc89c1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a4200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c113ae0 con 0x7fc89c105320 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a4200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c113960 con 0x7fc89c10de30 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a4200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c113c60 con 0x7fc89c1049d0 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a1800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 0x7fc89c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a1800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 0x7fc89c19c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49570/0 (socket says 172.21.15.84:49570) 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 0x7fc89c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.241+0000 7fc8a1800640 1 -- 172.21.15.84:0/2472861162 learned_addr learned my addr 172.21.15.84:0/2472861162 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.242+0000 7fc8a2200640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc89c10de30 0x7fc89c1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.242+0000 7fc8a1800640 1 -- 172.21.15.84:0/2472861162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc89c10de30 msgr2=0x7fc89c1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.242+0000 7fc8a1800640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc89c10de30 0x7fc89c1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.242+0000 7fc8a1800640 1 -- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 msgr2=0x7fc89c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.242+0000 7fc8a1800640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 0x7fc89c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.242+0000 7fc8a1800640 1 -- 172.21.15.84:0/2472861162 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c1a2660 con 0x7fc89c1049d0 2024-09-21T08:00:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.242+0000 7fc8a1800640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 0x7fc89c19c6f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e9c0 tx=0x7fc89000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.243+0000 7fc89a000640 1 -- 172.21.15.84:0/2472861162 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89000cd80 con 0x7fc89c1049d0 2024-09-21T08:00:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.243+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c1a2950 con 0x7fc89c1049d0 2024-09-21T08:00:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.243+0000 7fc89a000640 1 -- 172.21.15.84:0/2472861162 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8900035f0 con 0x7fc89c1049d0 2024-09-21T08:00:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.243+0000 7fc89a000640 1 -- 172.21.15.84:0/2472861162 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890010690 con 0x7fc89c1049d0 2024-09-21T08:00:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.243+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c1a90b0 con 0x7fc89c1049d0 2024-09-21T08:00:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.244+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89c06c240 con 0x7fc89c1049d0 2024-09-21T08:00:17.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.247+0000 7fc89a000640 1 -- 172.21.15.84:0/2472861162 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fc890004000 con 0x7fc89c1049d0 2024-09-21T08:00:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.248+0000 7fc89a000640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8840b6700 0x7fc8840b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.248+0000 7fc89a000640 1 -- 172.21.15.84:0/2472861162 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9520+0+0 (secure 0 0 0) 0x7fc8900e80e0 con 0x7fc89c1049d0 2024-09-21T08:00:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.248+0000 7fc8a0e00640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8840b6700 0x7fc8840b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.249+0000 7fc8a0e00640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8840b6700 0x7fc8840b8c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc88802a9e0 tx=0x7fc888005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.250+0000 7fc89a000640 1 -- 172.21.15.84:0/2472861162 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8900ae210 con 0x7fc89c1049d0 2024-09-21T08:00:17.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.477+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc89c104de0 con 0x7fc89c1049d0 2024-09-21T08:00:17.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.479+0000 7fc89a000640 1 -- 172.21.15.84:0/2472861162 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fc8900b25f0 con 0x7fc89c1049d0 2024-09-21T08:00:17.481 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:00:17.481 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:00:17.481 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:00:17.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8840b6700 msgr2=0x7fc8840b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8840b6700 0x7fc8840b8c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc88802a9e0 tx=0x7fc888005a20 comp rx=0 tx=0).stop 2024-09-21T08:00:17.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 msgr2=0x7fc89c19c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 0x7fc89c19c6f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e9c0 tx=0x7fc89000ee80 comp rx=0 tx=0).stop 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 shutdown_connections 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fc8840b6700 0x7fc8840b8c10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc89c10de30 0x7fc89c1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc89c105320 0x7fc89c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 --2- 172.21.15.84:0/2472861162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc89c1049d0 0x7fc89c19c6f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.481+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 >> 172.21.15.84:0/2472861162 conn(0x7fc89c079740 msgr2=0x7fc89c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.482+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 shutdown_connections 2024-09-21T08:00:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.482+0000 7fc8a4200640 1 -- 172.21.15.84:0/2472861162 wait complete. 2024-09-21T08:00:17.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:17 smithi084 ceph-mon[30411]: pgmap v676: 129 pgs: 129 active+clean; 43 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:17.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:17 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2472861162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:17.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:17 smithi191 ceph-mon[34667]: pgmap v676: 129 pgs: 129 active+clean; 43 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:17.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:17 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2472861162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.996+0000 7fa116600640 1 -- 172.21.15.84:0/2224821580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 msgr2=0x7fa110077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.996+0000 7fa116600640 1 --2- 172.21.15.84:0/2224821580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 0x7fa110077d50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa100009ca0 tx=0x7fa10002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.996+0000 7fa116600640 1 -- 172.21.15.84:0/2224821580 shutdown_connections 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.996+0000 7fa116600640 1 --2- 172.21.15.84:0/2224821580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 0x7fa110116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.996+0000 7fa116600640 1 --2- 172.21.15.84:0/2224821580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110078290 0x7fa110114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.996+0000 7fa116600640 1 --2- 172.21.15.84:0/2224821580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 0x7fa110077d50 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.996+0000 7fa116600640 1 -- 172.21.15.84:0/2224821580 >> 172.21.15.84:0/2224821580 conn(0x7fa110101810 msgr2=0x7fa110103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.997+0000 7fa116600640 1 -- 172.21.15.84:0/2224821580 shutdown_connections 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.997+0000 7fa116600640 1 -- 172.21.15.84:0/2224821580 wait complete. 2024-09-21T08:00:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 Processor -- start 2024-09-21T08:00:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 -- start start 2024-09-21T08:00:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 0x7fa1101a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110078290 0x7fa1101a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 0x7fa1101a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa11011a120 con 0x7fa110077940 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa110119fa0 con 0x7fa110078290 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.998+0000 7fa116600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa11011a2a0 con 0x7fa110114740 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 0x7fa1101a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110078290 0x7fa1101a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 0x7fa1101a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110078290 0x7fa1101a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56274/0 (socket says 172.21.15.84:56274) 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 0x7fa1101a6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48942/0 (socket says 172.21.15.84:48942) 2024-09-21T08:00:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10ea00640 1 -- 172.21.15.84:0/3110164194 learned_addr learned my addr 172.21.15.84:0/3110164194 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 -- 172.21.15.84:0/3110164194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110078290 msgr2=0x7fa1101a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110078290 0x7fa1101a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 -- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 msgr2=0x7fa1101a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 0x7fa1101a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 -- 172.21.15.84:0/3110164194 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1101a6a40 con 0x7fa110114740 2024-09-21T08:00:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:17.999+0000 7fa10fe00640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 0x7fa1101a6310 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e970 tx=0x7fa10800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.000+0000 7fa107e00640 1 -- 172.21.15.84:0/3110164194 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10800ccc0 con 0x7fa110114740 2024-09-21T08:00:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.000+0000 7fa107e00640 1 -- 172.21.15.84:0/3110164194 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa108005020 con 0x7fa110114740 2024-09-21T08:00:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.000+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1101a6d30 con 0x7fa110114740 2024-09-21T08:00:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.000+0000 7fa107e00640 1 -- 172.21.15.84:0/3110164194 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108004a00 con 0x7fa110114740 2024-09-21T08:00:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.000+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1101ad490 con 0x7fa110114740 2024-09-21T08:00:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.003+0000 7fa11d283740 1 Processor -- start 2024-09-21T08:00:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.003+0000 7fa107e00640 1 -- 172.21.15.84:0/3110164194 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa108004ba0 con 0x7fa110114740 2024-09-21T08:00:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa11d283740 1 -- start start 2024-09-21T08:00:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa11d283740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e01ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa11d283740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e01b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa11d283740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc53390 0x55879e01b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa11d283740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55879df91fb0 con 0x55879dc53390 2024-09-21T08:00:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa11d283740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55879df813e0 con 0x55879dc4b1b0 2024-09-21T08:00:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa11d283740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55879df851f0 con 0x55879dc74070 2024-09-21T08:00:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa10f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e01b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc53390 0x55879e01b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa10f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e01b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56278/0 (socket says 172.21.15.84:56278) 2024-09-21T08:00:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa10f400640 1 -- 172.21.15.84:0/2561035780 learned_addr learned my addr 172.21.15.84:0/2561035780 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.004+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e01ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa10f400640 1 -- 172.21.15.84:0/2561035780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 msgr2=0x55879e01ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa10f400640 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e01ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa10f400640 1 -- 172.21.15.84:0/2561035780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc53390 msgr2=0x55879e01b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa10f400640 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc53390 0x55879e01b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa10f400640 1 -- 172.21.15.84:0/2561035780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55879df4bcd0 con 0x55879dc4b1b0 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc53390 0x55879e01b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa107e00640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0f40b6680 0x7fa0f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.005+0000 7fa10f400640 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e01b2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa10002ade0 tx=0x7fa10002f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fe74353108745f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.006+0000 7fa107e00640 1 -- 172.21.15.84:0/3110164194 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7fa1080e7a30 con 0x7fa110114740 2024-09-21T08:00:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.006+0000 7fa10ea00640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0f40b6680 0x7fa0f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.006+0000 7fa104c00640 1 -- 172.21.15.84:0/2561035780 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100031cf0 con 0x55879dc4b1b0 2024-09-21T08:00:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.006+0000 7fa104c00640 1 -- 172.21.15.84:0/2561035780 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa100036030 con 0x55879dc4b1b0 2024-09-21T08:00:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.006+0000 7fa104c00640 1 -- 172.21.15.84:0/2561035780 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1000042a0 con 0x55879dc4b1b0 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 -- 172.21.15.84:0/2561035780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 msgr2=0x55879e01b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e01b2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa10002ade0 tx=0x7fa10002f310 comp rx=0 tx=0).stop 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa10ea00640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0f40b6680 0x7fa0f40b8b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009fd0 tx=0x7fa0fc004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 -- 172.21.15.84:0/2561035780 shutdown_connections 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc53390 0x55879e01b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e01b2e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 --2- 172.21.15.84:0/2561035780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e01ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 -- 172.21.15.84:0/2561035780 >> 172.21.15.84:0/2561035780 conn(0x55879dc68460 msgr2=0x55879e018c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 -- 172.21.15.84:0/2561035780 shutdown_connections 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.007+0000 7fa11d283740 1 -- 172.21.15.84:0/2561035780 wait complete. 2024-09-21T08:00:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 -- start start 2024-09-21T08:00:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 Processor -- start 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e026490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc74070 0x55879e0326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55879dde2700 con 0x55879dc74070 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55879df1c580 con 0x55879dc4b1b0 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55879e0293a0 con 0x55879dc53390 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.008+0000 7fa11d283740 10 client.0 _ll_register_callbacks cb 0x55879df2c470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc74070 0x55879e0326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e026490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e026490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56294/0 (socket says 172.21.15.84:56294) 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc74070 0x55879e0326c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46928/0 (socket says 172.21.15.84:46928) 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 -- 172.21.15.84:0/2933094161 learned_addr learned my addr 172.21.15.84:0/2933094161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 -- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 msgr2=0x55879e0269d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0269d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 -- 172.21.15.84:0/2933094161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc74070 msgr2=0x55879e0326c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc74070 0x55879e0326c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10f400640 1 -- 172.21.15.84:0/2933094161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55879dcdf650 con 0x55879dc4b1b0 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.009+0000 7fa10fe00640 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc74070 0x55879e0326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa10f400640 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e026490 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa100009890 tx=0x7fa100003bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00461ceff53a284 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa0f9600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa0f9600640 1 -- 172.21.15.84:0/2933094161 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100031e40 con 0x55879dc4b1b0 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55879df1eb90 con 0x55879dc4b1b0 2024-09-21T08:00:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa0f9600640 1 -- 172.21.15.84:0/2933094161 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7fa100031660 con 0x55879dc4b1b0 2024-09-21T08:00:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa0f9600640 1 -- 172.21.15.84:0/2933094161 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa100031860 con 0x55879dc4b1b0 2024-09-21T08:00:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa11d283740 10 client.27866 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.010+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55879df39950 con 0x55879dc4b1b0 2024-09-21T08:00:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa0f9600640 1 -- 172.21.15.84:0/2933094161 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55879df1eb90 con 0x55879dc4b1b0 2024-09-21T08:00:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa0f9600640 1 -- 172.21.15.84:0/2933094161 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa10004e070 con 0x55879dc4b1b0 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa11d283740 10 client.27866 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa11d283740 10 client.27866 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa11d283740 20 client.27866 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa11d283740 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc329f0 0x55879e0382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa11d283740 4 client.27866 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55879df93f00 con 0x55879dc329f0 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.011+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc329f0 0x55879e0382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.012+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc329f0 0x55879e0382a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97e2289622272658 server_cookie=13c065fd29ce480b in_seq=0 out_seq=0 2024-09-21T08:00:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.012+0000 7fa0f9600640 10 client.27866 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:00:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.013+0000 7fa0f9600640 1 -- 172.21.15.84:0/2933094161 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55879df93f00 con 0x55879dc329f0 2024-09-21T08:00:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.013+0000 7fa0f9600640 10 client.27866 handle_command_reply: tid=0 2024-09-21T08:00:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.013+0000 7fa11d283740 1 client.27866 shutdown 2024-09-21T08:00:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 msgr2=0x55879e026490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e026490 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa100009890 tx=0x7fa100003bd0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 shutdown_connections 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc329f0 0x55879e0382a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc74070 0x55879e0326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0269d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa0f9600640 0 client.27866 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 --2- 172.21.15.84:0/2933094161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc4b1b0 0x55879e026490 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 >> 172.21.15.84:0/2933094161 conn(0x55879dc68460 msgr2=0x55879e01df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 shutdown_connections 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 1 -- 172.21.15.84:0/2933094161 wait complete. 2024-09-21T08:00:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.014+0000 7fa11d283740 20 client.27866 trim_cache size 0 max 16384 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 Processor -- start 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 -- start start 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e01c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc74070 0x55879e018260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b7400 con 0x55879dc4b1b0 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b8f40 con 0x55879dc74070 2024-09-21T08:00:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa11d283740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b7ad0 con 0x55879dc53390 2024-09-21T08:00:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa10f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e01c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48974/0 (socket says 172.21.15.84:48974) 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.028+0000 7fa10ea00640 1 -- 172.21.15.84:0/561649458 learned_addr learned my addr 172.21.15.84:0/561649458 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa10fe00640 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc74070 0x55879e018260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa10ea00640 1 -- 172.21.15.84:0/561649458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc74070 msgr2=0x55879e018260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa10ea00640 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc74070 0x55879e018260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa10ea00640 1 -- 172.21.15.84:0/561649458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 msgr2=0x55879e01c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa10ea00640 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e01c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa10ea00640 1 -- 172.21.15.84:0/561649458 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55879e01d090 con 0x55879dc53390 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa10ea00640 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0280c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55879e038840 tx=0x7fa0fc013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c207764de7be2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.029+0000 7fa0fbe00640 1 -- 172.21.15.84:0/561649458 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00eda0 con 0x55879dc53390 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa0fbe00640 1 -- 172.21.15.84:0/561649458 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0fc01fdc0 con 0x55879dc53390 2024-09-21T08:00:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa0fbe00640 1 -- 172.21.15.84:0/561649458 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc02ac60 con 0x55879dc53390 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 -- 172.21.15.84:0/561649458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 msgr2=0x55879e0280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0280c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55879e038840 tx=0x7fa0fc013040 comp rx=0 tx=0).stop 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 -- 172.21.15.84:0/561649458 shutdown_connections 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc74070 0x55879e018260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc53390 0x55879e0280c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 --2- 172.21.15.84:0/561649458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e01c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 -- 172.21.15.84:0/561649458 >> 172.21.15.84:0/561649458 conn(0x55879dc68460 msgr2=0x55879e0279b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 -- 172.21.15.84:0/561649458 shutdown_connections 2024-09-21T08:00:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.030+0000 7fa11d283740 1 -- 172.21.15.84:0/561649458 wait complete. 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.031+0000 7fa11d283740 1 -- start start 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.031+0000 7fa11d283740 1 Processor -- start 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa11d283740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e02a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa11d283740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc53390 0x55879e02ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa11d283740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e0a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa11d283740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b8870 con 0x55879dc4b1b0 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa11d283740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b81a0 con 0x55879dc53390 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa11d283740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1101b5400 con 0x55879dc74070 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa11d283740 10 client.0 _ll_register_callbacks cb 0x7fa100009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e02a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e02a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46940/0 (socket says 172.21.15.84:46940) 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 -- 172.21.15.84:0/2971083415 learned_addr learned my addr 172.21.15.84:0/2971083415 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10fe00640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e0a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc53390 0x55879e02ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 -- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 msgr2=0x55879e0a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e0a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 -- 172.21.15.84:0/2971083415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc53390 msgr2=0x55879e02ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc53390 0x55879e02ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10f400640 1 -- 172.21.15.84:0/2971083415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55879e02b610 con 0x55879dc4b1b0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10fe00640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e0a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.032+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc53390 0x55879e02ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa10f400640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e02a8a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa100002230 tx=0x7fa100009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9db4b56310d5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa0f9600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa0f9600640 1 -- 172.21.15.84:0/2971083415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100066060 con 0x55879dc4b1b0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0fc01fdc0 con 0x55879dc4b1b0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa0f9600640 1 -- 172.21.15.84:0/2971083415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7fa10004a040 con 0x55879dc4b1b0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa0f9600640 1 -- 172.21.15.84:0/2971083415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa10002f3d0 con 0x55879dc4b1b0 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa11d283740 10 client.17502 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.033+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55879e0a2fc0 con 0x55879dc4b1b0 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa0f9600640 1 -- 172.21.15.84:0/2971083415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0fc01fdc0 con 0x55879dc4b1b0 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa0f9600640 1 -- 172.21.15.84:0/2971083415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa100043070 con 0x55879dc4b1b0 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa11d283740 10 client.17502 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa11d283740 10 client.17502 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa11d283740 20 client.17502 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa11d283740 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc07da0 0x55879e0a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa11d283740 4 client.17502 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55879df8f9b0 con 0x55879dc07da0 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.034+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc07da0 0x55879e0a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa0f9600640 10 client.17502 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa10ea00640 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc07da0 0x55879e0a55f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2ff68fe709159dd server_cookie=9bfea1d0646cf09 in_seq=0 out_seq=0 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa0f9600640 1 -- 172.21.15.84:0/2971083415 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55879df8f9b0 con 0x55879dc07da0 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa0f9600640 10 client.17502 handle_command_reply: tid=0 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 client.17502 shutdown 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 msgr2=0x55879e02a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e02a8a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa100002230 tx=0x7fa100009450 comp rx=0 tx=0).stop 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 shutdown_connections 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55879dc07da0 0x55879e0a55f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55879dc74070 0x55879e0a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55879dc53390 0x55879e02ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 --2- 172.21.15.84:0/2971083415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55879dc4b1b0 0x55879e02a8a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.035+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 >> 172.21.15.84:0/2971083415 conn(0x55879dc68460 msgr2=0x55879e01c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa0f9600640 0 client.17502 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 shutdown_connections 2024-09-21T08:00:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa11d283740 1 -- 172.21.15.84:0/2971083415 wait complete. 2024-09-21T08:00:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa11d283740 20 client.17502 trim_cache size 0 max 16384 2024-09-21T08:00:18.041 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:00:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0f40b6680 msgr2=0x7fa0f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa116600640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0f40b6680 0x7fa0f40b8b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009fd0 tx=0x7fa0fc004730 comp rx=0 tx=0).stop 2024-09-21T08:00:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 msgr2=0x7fa1101a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.036+0000 7fa116600640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 0x7fa1101a6310 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e970 tx=0x7fa10800ee30 comp rx=0 tx=0).stop 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 shutdown_connections 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0f40b6680 0x7fa0f40b8b90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa110114740 0x7fa1101a6310 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110078290 0x7fa1101a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 --2- 172.21.15.84:0/3110164194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa110077940 0x7fa1101a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 >> 172.21.15.84:0/3110164194 conn(0x7fa110101810 msgr2=0x7fa1101167d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 shutdown_connections 2024-09-21T08:00:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:18.037+0000 7fa116600640 1 -- 172.21.15.84:0/3110164194 wait complete. 2024-09-21T08:00:18.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:17 smithi162 ceph-mon[34833]: pgmap v676: 129 pgs: 129 active+clean; 43 GiB data, 93 GiB used, 980 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:18.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:17 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2472861162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:18.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:18 smithi084 ceph-mon[30411]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T08:00:18.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:18 smithi084 ceph-mon[30411]: pgmap v678: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 9 op/s 2024-09-21T08:00:18.983 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 385a5f69 --release --await' 2024-09-21T08:00:18.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 385a5f69 --release --await 2024-09-21T08:00:19.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:18 smithi162 ceph-mon[34833]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T08:00:19.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:18 smithi162 ceph-mon[34833]: pgmap v678: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 9 op/s 2024-09-21T08:00:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:18 smithi191 ceph-mon[34667]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T08:00:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:18 smithi191 ceph-mon[34667]: pgmap v678: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 9 op/s 2024-09-21T08:00:19.384 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:00:19.466 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:20.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 -- 172.21.15.84:0/101936596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f40757b0 msgr2=0x7f26f4075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 --2- 172.21.15.84:0/101936596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f40757b0 0x7f26f4075bc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009900 tx=0x7f26e402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:20.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 -- 172.21.15.84:0/101936596 shutdown_connections 2024-09-21T08:00:20.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 --2- 172.21.15.84:0/101936596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26f41100d0 0x7f26f4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 --2- 172.21.15.84:0/101936596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f4076100 0x7f26f410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 --2- 172.21.15.84:0/101936596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f40757b0 0x7f26f4075bc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 -- 172.21.15.84:0/101936596 >> 172.21.15.84:0/101936596 conn(0x7f26f40ff5e0 msgr2=0x7f26f4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 -- 172.21.15.84:0/101936596 shutdown_connections 2024-09-21T08:00:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.099+0000 7f26f8c00640 1 -- 172.21.15.84:0/101936596 wait complete. 2024-09-21T08:00:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.100+0000 7f26f8c00640 1 Processor -- start 2024-09-21T08:00:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.100+0000 7f26f8c00640 1 -- start start 2024-09-21T08:00:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f40757b0 0x7f26f419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f4076100 0x7f26f419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f8c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26f41100d0 0x7f26f41a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f8c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4115cd0 con 0x7f26f4076100 2024-09-21T08:00:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4115b50 con 0x7f26f40757b0 2024-09-21T08:00:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f8c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4115e50 con 0x7f26f41100d0 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f40757b0 0x7f26f419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f40757b0 0x7f26f419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56330/0 (socket says 172.21.15.84:56330) 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26f41100d0 0x7f26f41a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f1e00640 1 -- 172.21.15.84:0/1901748016 learned_addr learned my addr 172.21.15.84:0/1901748016 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.101+0000 7f26f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f4076100 0x7f26f419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.102+0000 7f26f1e00640 1 -- 172.21.15.84:0/1901748016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26f41100d0 msgr2=0x7f26f41a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.102+0000 7f26f1e00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26f41100d0 0x7f26f41a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.102+0000 7f26f1e00640 1 -- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f4076100 msgr2=0x7f26f419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.102+0000 7f26f1e00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f4076100 0x7f26f419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.102+0000 7f26f1e00640 1 -- 172.21.15.84:0/1901748016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f41a2600 con 0x7f26f40757b0 2024-09-21T08:00:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.102+0000 7f26f1e00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f40757b0 0x7f26f419c690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f26e4005ab0 tx=0x7f26e4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.102+0000 7f26eaa00640 1 -- 172.21.15.84:0/1901748016 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e403f070 con 0x7f26f40757b0 2024-09-21T08:00:20.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.103+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f41a2890 con 0x7f26f40757b0 2024-09-21T08:00:20.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.103+0000 7f26eaa00640 1 -- 172.21.15.84:0/1901748016 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26e4031b60 con 0x7f26f40757b0 2024-09-21T08:00:20.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.103+0000 7f26eaa00640 1 -- 172.21.15.84:0/1901748016 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4035030 con 0x7f26f40757b0 2024-09-21T08:00:20.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.103+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f41a9050 con 0x7f26f40757b0 2024-09-21T08:00:20.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 Processor -- start 2024-09-21T08:00:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 -- start start 2024-09-21T08:00:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f0821c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f082700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f082c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a80eff9290 con 0x55a80ecba840 2024-09-21T08:00:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a80efe86c0 con 0x55a80ecb2660 2024-09-21T08:00:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.106+0000 7f26ff85f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a80efec4d0 con 0x55a80ecdb520 2024-09-21T08:00:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26eaa00640 1 -- 172.21.15.84:0/1901748016 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f26e4042070 con 0x7f26f40757b0 2024-09-21T08:00:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f0821c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f082c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f0821c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49008/0 (socket says 172.21.15.84:49008) 2024-09-21T08:00:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 -- 172.21.15.84:0/2378779972 learned_addr learned my addr 172.21.15.84:0/2378779972 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 -- 172.21.15.84:0/2378779972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 msgr2=0x55a80f082700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 --2- 172.21.15.84:0/2378779972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f082700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 -- 172.21.15.84:0/2378779972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 msgr2=0x55a80f082c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 --2- 172.21.15.84:0/2378779972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f082c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.107+0000 7f26f2800640 1 -- 172.21.15.84:0/2378779972 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a80ef75460 con 0x55a80ecdb520 2024-09-21T08:00:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.108+0000 7f26f2800640 1 --2- 172.21.15.84:0/2378779972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f0821c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009fd0 tx=0x7f26ec0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321f86341eca1dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.108+0000 7f26df000640 1 -- 172.21.15.84:0/2378779972 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec004d20 con 0x55a80ecdb520 2024-09-21T08:00:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.108+0000 7f26df000640 1 -- 172.21.15.84:0/2378779972 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26ec004050 con 0x55a80ecdb520 2024-09-21T08:00:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.108+0000 7f26df000640 1 -- 172.21.15.84:0/2378779972 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec005280 con 0x55a80ecdb520 2024-09-21T08:00:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26eaa00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f26d80b6700 0x7f26d80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 -- 172.21.15.84:0/2378779972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 msgr2=0x55a80f0821c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2378779972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f0821c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009fd0 tx=0x7f26ec0118d0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 -- 172.21.15.84:0/2378779972 shutdown_connections 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2378779972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f082c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2378779972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f082700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2378779972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f0821c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 -- 172.21.15.84:0/2378779972 >> 172.21.15.84:0/2378779972 conn(0x55a80eccf910 msgr2=0x55a80f0800b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26ff85f740 1 -- 172.21.15.84:0/2378779972 shutdown_connections 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26eaa00640 1 -- 172.21.15.84:0/1901748016 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f26e4108150 con 0x7f26f40757b0 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.109+0000 7f26f1e00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f26d80b6700 0x7f26d80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.110+0000 7f26ff85f740 1 -- 172.21.15.84:0/2378779972 wait complete. 2024-09-21T08:00:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.110+0000 7f26f1e00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f26d80b6700 0x7f26d80b8c10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55a80f080e40 tx=0x7f26e4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.110+0000 7f26ff85f740 1 -- start start 2024-09-21T08:00:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.111+0000 7f26ff85f740 1 Processor -- start 2024-09-21T08:00:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.111+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecb2660 0x55a80f08dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.111+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecba840 0x55a80f08e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.111+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f099cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.111+0000 7f26ff85f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a80ee49bb0 con 0x55a80ecb2660 2024-09-21T08:00:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.111+0000 7f26ff85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a80ef836c0 con 0x55a80ecba840 2024-09-21T08:00:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.111+0000 7f26ff85f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a80f0909a0 con 0x55a80ecdb520 2024-09-21T08:00:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26ff85f740 10 client.0 _ll_register_callbacks cb 0x55a80ef9e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecb2660 0x55a80f08dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecb2660 0x55a80f08dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46986/0 (socket says 172.21.15.84:46986) 2024-09-21T08:00:20.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 -- 172.21.15.84:0/4095973203 learned_addr learned my addr 172.21.15.84:0/4095973203 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f099cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 -- 172.21.15.84:0/4095973203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 msgr2=0x55a80f099cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f099cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 -- 172.21.15.84:0/4095973203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecba840 msgr2=0x55a80f08e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecba840 0x55a80f08e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.112+0000 7f26f2800640 1 -- 172.21.15.84:0/4095973203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a80ed46b00 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.113+0000 7f26f2800640 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecb2660 0x55a80f08dcd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f26ec01b040 tx=0x7f26ec003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd218fe4585854be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.113+0000 7f26d3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.113+0000 7f26d3400640 1 -- 172.21.15.84:0/4095973203 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec004a40 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.113+0000 7f26d3400640 1 -- 172.21.15.84:0/4095973203 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f26ec004be0 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.113+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26ec004050 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26d3400640 1 -- 172.21.15.84:0/4095973203 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f26ec036050 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 10 client.17514 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a80edbd960 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26d3400640 1 -- 172.21.15.84:0/4095973203 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26ec004050 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26d3400640 1 -- 172.21.15.84:0/4095973203 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f26ec00f4e0 con 0x55a80ecb2660 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 10 client.17514 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 10 client.17514 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 20 client.17514 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:20.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec99ea0 0x55a80f09fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 4 client.17514 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:20.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.114+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a80effb1e0 con 0x55a80ec99ea0 2024-09-21T08:00:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.115+0000 7f26f1400640 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec99ea0 0x55a80f09fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.116+0000 7f26f1400640 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec99ea0 0x55a80f09fb50 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32a3ae38e5783eb8 server_cookie=68bfa515d8e16c67 in_seq=0 out_seq=0 2024-09-21T08:00:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.116+0000 7f26d3400640 10 client.17514 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.116+0000 7f26d3400640 1 -- 172.21.15.84:0/4095973203 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a80effb1e0 con 0x55a80ec99ea0 2024-09-21T08:00:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.116+0000 7f26d3400640 10 client.17514 handle_command_reply: tid=0 2024-09-21T08:00:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.116+0000 7f26ff85f740 1 client.17514 shutdown 2024-09-21T08:00:20.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecb2660 msgr2=0x55a80f08dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecb2660 0x55a80f08dcd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f26ec01b040 tx=0x7f26ec003f50 comp rx=0 tx=0).stop 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 shutdown_connections 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec99ea0 0x55a80f09fb50 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f099cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecba840 0x55a80f08e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 --2- 172.21.15.84:0/4095973203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecb2660 0x55a80f08dcd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26d3400640 0 client.17514 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 >> 172.21.15.84:0/4095973203 conn(0x55a80eccf910 msgr2=0x55a80f085350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 shutdown_connections 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 1 -- 172.21.15.84:0/4095973203 wait complete. 2024-09-21T08:00:20.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.117+0000 7f26ff85f740 20 client.17514 trim_cache size 0 max 16384 2024-09-21T08:00:20.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 Processor -- start 2024-09-21T08:00:20.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 -- start start 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f08f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f099bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f09a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41b3030 con 0x55a80ecba840 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41b4b70 con 0x55a80ecb2660 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26ff85f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41b3700 con 0x55a80ecdb520 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f099bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.136+0000 7f26f2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f09a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f099bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46998/0 (socket says 172.21.15.84:46998) 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f1400640 1 -- 172.21.15.84:0/3147781504 learned_addr learned my addr 172.21.15.84:0/3147781504 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f2800640 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f08f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f2800640 1 -- 172.21.15.84:0/3147781504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 msgr2=0x55a80f09a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f2800640 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f09a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f2800640 1 -- 172.21.15.84:0/3147781504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 msgr2=0x55a80f099bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f2800640 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f099bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f2800640 1 -- 172.21.15.84:0/3147781504 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a80f09ffb0 con 0x55a80ecb2660 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f1400640 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f099bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:20.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.137+0000 7f26f2800640 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f08f9b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26ec002230 tx=0x7f26ec000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f418dd1648563886 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.138+0000 7f26de600640 1 -- 172.21.15.84:0/3147781504 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec009b30 con 0x55a80ecb2660 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.138+0000 7f26de600640 1 -- 172.21.15.84:0/3147781504 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26ec02d070 con 0x55a80ecb2660 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.138+0000 7f26de600640 1 -- 172.21.15.84:0/3147781504 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec028480 con 0x55a80ecb2660 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.138+0000 7f26ff85f740 1 -- 172.21.15.84:0/3147781504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 msgr2=0x55a80f08f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.138+0000 7f26ff85f740 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f08f9b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26ec002230 tx=0x7f26ec000f40 comp rx=0 tx=0).stop 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 -- 172.21.15.84:0/3147781504 shutdown_connections 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecdb520 0x55a80f09a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f099bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 --2- 172.21.15.84:0/3147781504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecb2660 0x55a80f08f9b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 -- 172.21.15.84:0/3147781504 >> 172.21.15.84:0/3147781504 conn(0x55a80eccf910 msgr2=0x55a80f0852c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 -- 172.21.15.84:0/3147781504 shutdown_connections 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 -- 172.21.15.84:0/3147781504 wait complete. 2024-09-21T08:00:20.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 -- start start 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.139+0000 7f26ff85f740 1 Processor -- start 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecb2660 0x55a80f092600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f092be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26ff85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecdb520 0x55a80f103480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26ff85f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41b44a0 con 0x55a80ecba840 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26ff85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41b3dd0 con 0x55a80ecdb520 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26ff85f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41b1030 con 0x55a80ecb2660 2024-09-21T08:00:20.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26ff85f740 10 client.0 _ll_register_callbacks cb 0x7f26e00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:20.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f092be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f092be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47012/0 (socket says 172.21.15.84:47012) 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26f1400640 1 -- 172.21.15.84:0/2615265145 learned_addr learned my addr 172.21.15.84:0/2615265145 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26f2800640 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecdb520 0x55a80f103480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.140+0000 7f26f2800640 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecb2660 0x55a80f092600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26f1400640 1 -- 172.21.15.84:0/2615265145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecb2660 msgr2=0x55a80f092600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26f1400640 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecb2660 0x55a80f092600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26f1400640 1 -- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecdb520 msgr2=0x55a80f103480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26f1400640 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecdb520 0x55a80f103480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26f1400640 1 -- 172.21.15.84:0/2615265145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a80f103af0 con 0x55a80ecba840 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26f1400640 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f092be0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55a80f0a01e0 tx=0x7f26e00108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27097ba1a3020c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26d3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26d3400640 1 -- 172.21.15.84:0/2615265145 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e001c7e0 con 0x55a80ecba840 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26ec02d070 con 0x55a80ecba840 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26d3400640 1 -- 172.21.15.84:0/2615265145 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f26e001c980 con 0x55a80ecba840 2024-09-21T08:00:20.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26d3400640 1 -- 172.21.15.84:0/2615265145 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f26e002e050 con 0x55a80ecba840 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.141+0000 7f26ff85f740 10 client.17520 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a80f10af90 con 0x55a80ecba840 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26d3400640 1 -- 172.21.15.84:0/2615265145 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26ec02d070 con 0x55a80ecba840 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26d3400640 1 -- 172.21.15.84:0/2615265145 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f26e00223d0 con 0x55a80ecba840 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26ff85f740 10 client.17520 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26ff85f740 10 client.17520 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26ff85f740 20 client.17520 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec6f250 0x55a80f10d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26ff85f740 4 client.17520 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "385a5f69", "release": true, "await": true}] 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.142+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "385a5f69", "release": true, "await": true}) -- 0x55a80eff6c90 con 0x55a80ec6f250 2024-09-21T08:00:20.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.143+0000 7f26f2800640 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec6f250 0x55a80f10d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.143+0000 7f26f2800640 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec6f250 0x55a80f10d7b0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2832d9e0a43188ed server_cookie=60ad1c9887adf8fe in_seq=0 out_seq=0 2024-09-21T08:00:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.143+0000 7f26d3400640 10 client.17520 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26d3400640 1 -- 172.21.15.84:0/2615265145 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a80eff6c90 con 0x55a80ec6f250 2024-09-21T08:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26d3400640 10 client.17520 handle_command_reply: tid=0 2024-09-21T08:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 client.17520 shutdown 2024-09-21T08:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 msgr2=0x55a80f092be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f092be0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55a80f0a01e0 tx=0x7f26e00108c0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 shutdown_connections 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a80ecdb520 0x55a80f103480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a80ecba840 0x55a80f092be0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a80ec6f250 0x55a80f10d7b0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 --2- 172.21.15.84:0/2615265145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a80ecb2660 0x55a80f092600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.147+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 >> 172.21.15.84:0/2615265145 conn(0x55a80eccf910 msgr2=0x55a80f08f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26d3400640 0 client.17520 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 shutdown_connections 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26ff85f740 1 -- 172.21.15.84:0/2615265145 wait complete. 2024-09-21T08:00:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26ff85f740 20 client.17520 trim_cache size 0 max 16384 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 36, 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "385a5f69": { 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 36, 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T08:00:20.151 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 141.1, 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f26d80b6700 msgr2=0x7f26d80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26f8c00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f26d80b6700 0x7f26d80b8c10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55a80f080e40 tx=0x7f26e4000bc0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f40757b0 msgr2=0x7f26f419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.148+0000 7f26f8c00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f40757b0 0x7f26f419c690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f26e4005ab0 tx=0x7f26e4003c10 comp rx=0 tx=0).stop 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 shutdown_connections 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f26d80b6700 0x7f26d80b8c10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26f41100d0 0x7f26f41a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f4076100 0x7f26f419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 --2- 172.21.15.84:0/1901748016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f40757b0 0x7f26f419c690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 >> 172.21.15.84:0/1901748016 conn(0x7f26f40ff5e0 msgr2=0x7f26f4109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 shutdown_connections 2024-09-21T08:00:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:20.149+0000 7f26f8c00640 1 -- 172.21.15.84:0/1901748016 wait complete. 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 -- 172.21.15.84:0/1611864444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc076100 msgr2=0x7f63fc10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 --2- 172.21.15.84:0/1611864444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc076100 0x7f63fc10f9d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009900 tx=0x7f63e802a410 comp rx=0 tx=0).stop 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 -- 172.21.15.84:0/1611864444 shutdown_connections 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 --2- 172.21.15.84:0/1611864444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63fc10ff10 0x7f63fc112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 --2- 172.21.15.84:0/1611864444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc076100 0x7f63fc10f9d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 --2- 172.21.15.84:0/1611864444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63fc0757b0 0x7f63fc075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 -- 172.21.15.84:0/1611864444 >> 172.21.15.84:0/1611864444 conn(0x7f63fc0ff440 msgr2=0x7f63fc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.668+0000 7f6400a00640 1 -- 172.21.15.84:0/1611864444 shutdown_connections 2024-09-21T08:00:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.669+0000 7f6400a00640 1 -- 172.21.15.84:0/1611864444 wait complete. 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.669+0000 7f6400a00640 1 Processor -- start 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f6400a00640 1 -- start start 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f6400a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63fc0757b0 0x7f63fc19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f6400a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63fc076100 0x7f63fc19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f6400a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc10ff10 0x7f63fc1a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f6400a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc115b10 con 0x7f63fc10ff10 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f6400a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc115990 con 0x7f63fc0757b0 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f6400a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc115c90 con 0x7f63fc076100 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f63fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc10ff10 0x7f63fc1a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f63faa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63fc076100 0x7f63fc19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f63fb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63fc0757b0 0x7f63fc19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f63faa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63fc076100 0x7f63fc19caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49076/0 (socket says 172.21.15.84:49076) 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f63fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc10ff10 0x7f63fc1a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47028/0 (socket says 172.21.15.84:47028) 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.670+0000 7f63faa00640 1 -- 172.21.15.84:0/2596862341 learned_addr learned my addr 172.21.15.84:0/2596862341 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.671+0000 7f63fbe00640 1 -- 172.21.15.84:0/2596862341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63fc076100 msgr2=0x7f63fc19caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.671+0000 7f63fbe00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63fc076100 0x7f63fc19caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.671+0000 7f63fbe00640 1 -- 172.21.15.84:0/2596862341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63fc0757b0 msgr2=0x7f63fc19c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.671+0000 7f63fbe00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63fc0757b0 0x7f63fc19c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.671+0000 7f63fbe00640 1 -- 172.21.15.84:0/2596862341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc1a2470 con 0x7f63fc10ff10 2024-09-21T08:00:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.671+0000 7f63fbe00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc10ff10 0x7f63fc1a1d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009fd0 tx=0x7f63f400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.672+0000 7f63f3e00640 1 -- 172.21.15.84:0/2596862341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f400ce20 con 0x7f63fc10ff10 2024-09-21T08:00:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.672+0000 7f63f3e00640 1 -- 172.21.15.84:0/2596862341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63f4005020 con 0x7f63fc10ff10 2024-09-21T08:00:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.672+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc1a2760 con 0x7f63fc10ff10 2024-09-21T08:00:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.672+0000 7f63f3e00640 1 -- 172.21.15.84:0/2596862341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4010690 con 0x7f63fc10ff10 2024-09-21T08:00:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.672+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1a8ec0 con 0x7f63fc10ff10 2024-09-21T08:00:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.675+0000 7f6408e18740 1 Processor -- start 2024-09-21T08:00:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f63f3e00640 1 -- 172.21.15.84:0/2596862341 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f63f40054d0 con 0x7f63fc10ff10 2024-09-21T08:00:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f6408e18740 1 -- start start 2024-09-21T08:00:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f6408e18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93158b070 0x55f931931d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f6408e18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f931932270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f6408e18740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93156a390 0x55f9319327b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f6408e18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f9318a8fb0 con 0x55f93158b070 2024-09-21T08:00:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f6408e18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f9318983e0 con 0x55f9315621b0 2024-09-21T08:00:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.676+0000 7f6408e18740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f93189c1f0 con 0x55f93156a390 2024-09-21T08:00:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f931932270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f931932270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56412/0 (socket says 172.21.15.84:56412) 2024-09-21T08:00:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 -- 172.21.15.84:0/2685155025 learned_addr learned my addr 172.21.15.84:0/2685155025 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63faa00640 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93158b070 0x55f931931d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63faa00640 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93156a390 0x55f9319327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 -- 172.21.15.84:0/2685155025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93156a390 msgr2=0x55f9319327b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93156a390 0x55f9319327b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 -- 172.21.15.84:0/2685155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93158b070 msgr2=0x55f931931d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93158b070 0x55f931931d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63fb400640 1 -- 172.21.15.84:0/2685155025 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f931862cd0 con 0x55f9315621b0 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.677+0000 7f63faa00640 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93158b070 0x55f931931d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.678+0000 7f63fb400640 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f931932270 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009d20 tx=0x7f63ec011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c7783a72321e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.678+0000 7f63e7e00640 1 -- 172.21.15.84:0/2685155025 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec01e070 con 0x55f9315621b0 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.678+0000 7f63f3e00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f63e00b6700 0x7f63e00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.678+0000 7f63e7e00640 1 -- 172.21.15.84:0/2685155025 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec019ae0 con 0x55f9315621b0 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.678+0000 7f63e7e00640 1 -- 172.21.15.84:0/2685155025 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec00eac0 con 0x55f9315621b0 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.678+0000 7f63f3e00640 1 -- 172.21.15.84:0/2596862341 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f63f40e8190 con 0x7f63fc10ff10 2024-09-21T08:00:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f63faa00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f63e00b6700 0x7f63e00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f6408e18740 1 -- 172.21.15.84:0/2685155025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 msgr2=0x55f931932270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f63faa00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f63e00b6700 0x7f63e00b8c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f63e8000c00 tx=0x7f63e8005d70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f6408e18740 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f931932270 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009d20 tx=0x7f63ec011810 comp rx=0 tx=0).stop 2024-09-21T08:00:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f6408e18740 1 -- 172.21.15.84:0/2685155025 shutdown_connections 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f6408e18740 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93156a390 0x55f9319327b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f6408e18740 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f931932270 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f6408e18740 1 --2- 172.21.15.84:0/2685155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93158b070 0x55f931931d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.679+0000 7f6408e18740 1 -- 172.21.15.84:0/2685155025 >> 172.21.15.84:0/2685155025 conn(0x55f93157f460 msgr2=0x55f93192fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.680+0000 7f6408e18740 1 -- 172.21.15.84:0/2685155025 shutdown_connections 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.680+0000 7f6408e18740 1 -- 172.21.15.84:0/2685155025 wait complete. 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.680+0000 7f6408e18740 1 -- start start 2024-09-21T08:00:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.680+0000 7f6408e18740 1 Processor -- start 2024-09-21T08:00:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f6408e18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f93193d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f6408e18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93156a390 0x55f93193de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f6408e18740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f931949800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f6408e18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f9316f9700 con 0x55f93156a390 2024-09-21T08:00:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f6408e18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f931833580 con 0x55f9315621b0 2024-09-21T08:00:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f6408e18740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f931940510 con 0x55f93158b070 2024-09-21T08:00:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f6408e18740 10 client.0 _ll_register_callbacks cb 0x55f931843470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f63faa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93156a390 0x55f93193de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f63faa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93156a390 0x55f93193de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47050/0 (socket says 172.21.15.84:47050) 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f63faa00640 1 -- 172.21.15.84:0/3653182407 learned_addr learned my addr 172.21.15.84:0/3653182407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f63fb400640 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f93193d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.681+0000 7f63fbe00640 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f931949800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63fb400640 1 -- 172.21.15.84:0/3653182407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 msgr2=0x55f931949800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63fb400640 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f931949800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63fb400640 1 -- 172.21.15.84:0/3653182407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93156a390 msgr2=0x55f93193de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63fb400640 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93156a390 0x55f93193de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63fb400640 1 -- 172.21.15.84:0/3653182407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9315f6650 con 0x55f9315621b0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63fb400640 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f93193d940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f63ec005890 tx=0x7f63ec00ea30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536d2aff7a908887 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63e4c00640 1 -- 172.21.15.84:0/3653182407 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec01e030 con 0x55f9315621b0 2024-09-21T08:00:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f931835b90 con 0x55f9315621b0 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.682+0000 7f63e4c00640 1 -- 172.21.15.84:0/3653182407 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f63ec005050 con 0x55f9315621b0 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f63e4c00640 1 -- 172.21.15.84:0/3653182407 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f63ec031050 con 0x55f9315621b0 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 10 client.27896 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f931850950 con 0x55f9315621b0 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f63e4c00640 1 -- 172.21.15.84:0/3653182407 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f931835b90 con 0x55f9315621b0 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f63e4c00640 1 -- 172.21.15.84:0/3653182407 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f63ec004880 con 0x55f9315621b0 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 10 client.27896 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 10 client.27896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 20 client.27896 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f9315499f0 0x55f93194f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 4 client.27896 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.683+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9318aaf00 con 0x55f9315499f0 2024-09-21T08:00:21.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.684+0000 7f63faa00640 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f9315499f0 0x55f93194f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.684+0000 7f63faa00640 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f9315499f0 0x55f93194f7c0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30495cb97fa86ef3 server_cookie=9dcef2de841c7d3b in_seq=0 out_seq=0 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.684+0000 7f63e4c00640 10 client.27896 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f63e4c00640 1 -- 172.21.15.84:0/3653182407 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9318aaf00 con 0x55f9315499f0 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f63e4c00640 10 client.27896 handle_command_reply: tid=0 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 client.27896 shutdown 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 msgr2=0x55f93193d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f93193d940 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f63ec005890 tx=0x7f63ec00ea30 comp rx=0 tx=0).stop 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 shutdown_connections 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f9315499f0 0x55f93194f7c0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f931949800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f93156a390 0x55f93193de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f63e4c00640 0 client.27896 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 --2- 172.21.15.84:0/3653182407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9315621b0 0x55f93193d940 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.685+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 >> 172.21.15.84:0/3653182407 conn(0x55f93157f460 msgr2=0x55f931934f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.686+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 shutdown_connections 2024-09-21T08:00:21.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.686+0000 7f6408e18740 1 -- 172.21.15.84:0/3653182407 wait complete. 2024-09-21T08:00:21.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.686+0000 7f6408e18740 20 client.27896 trim_cache size 0 max 16384 2024-09-21T08:00:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.699+0000 7f6408e18740 1 Processor -- start 2024-09-21T08:00:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.699+0000 7f6408e18740 1 -- start start 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f6408e18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931936e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f6408e18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931937380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f6408e18740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f93192f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f6408e18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1b2d60 con 0x55f9315621b0 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f6408e18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1b48a0 con 0x55f93156a390 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f6408e18740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1b3430 con 0x55f93158b070 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931936e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931936e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47062/0 (socket says 172.21.15.84:47062) 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 -- 172.21.15.84:0/3460021669 learned_addr learned my addr 172.21.15.84:0/3460021669 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fbe00640 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f93192f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63faa00640 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931937380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 -- 172.21.15.84:0/3460021669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 msgr2=0x55f93192f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f93192f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 -- 172.21.15.84:0/3460021669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 msgr2=0x55f931937380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931937380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.700+0000 7f63fb400640 1 -- 172.21.15.84:0/3460021669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f931934020 con 0x55f9315621b0 2024-09-21T08:00:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.701+0000 7f63fb400640 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931936e40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f63ec004c20 tx=0x7f63ec011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecdd9b21de85ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.701+0000 7f63e7400640 1 -- 172.21.15.84:0/3460021669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec01e040 con 0x55f9315621b0 2024-09-21T08:00:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.701+0000 7f63e7400640 1 -- 172.21.15.84:0/3460021669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec03a070 con 0x55f9315621b0 2024-09-21T08:00:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.701+0000 7f63e7400640 1 -- 172.21.15.84:0/3460021669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec003840 con 0x55f9315621b0 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 -- 172.21.15.84:0/3460021669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 msgr2=0x55f931936e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931936e40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f63ec004c20 tx=0x7f63ec011e40 comp rx=0 tx=0).stop 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 -- 172.21.15.84:0/3460021669 shutdown_connections 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f93192f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931937380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 --2- 172.21.15.84:0/3460021669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931936e40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 -- 172.21.15.84:0/3460021669 >> 172.21.15.84:0/3460021669 conn(0x55f93157f460 msgr2=0x55f9319388f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 -- 172.21.15.84:0/3460021669 shutdown_connections 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.702+0000 7f6408e18740 1 -- 172.21.15.84:0/3460021669 wait complete. 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 -- start start 2024-09-21T08:00:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 Processor -- start 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931941fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931942590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f9319b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1b41d0 con 0x55f9315621b0 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1b3b00 con 0x55f93156a390 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.703+0000 7f6408e18740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1b0d60 con 0x55f93158b070 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f6408e18740 10 client.0 _ll_register_callbacks cb 0x7f63ec0043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931941fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931941fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47078/0 (socket says 172.21.15.84:47078) 2024-09-21T08:00:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 -- 172.21.15.84:0/3687883030 learned_addr learned my addr 172.21.15.84:0/3687883030 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63faa00640 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931942590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fbe00640 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f9319b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 -- 172.21.15.84:0/3687883030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 msgr2=0x55f9319b9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f9319b9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 -- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 msgr2=0x55f931942590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931942590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.704+0000 7f63fb400640 1 -- 172.21.15.84:0/3687883030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9319b9700 con 0x55f9315621b0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f63fb400640 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931941fb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009800 tx=0x7f63ec005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ae9c93f29ac1ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f63e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f63e4c00640 1 -- 172.21.15.84:0/3687883030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec044020 con 0x55f9315621b0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f63e4c00640 1 -- 172.21.15.84:0/3687883030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f63ec004490 con 0x55f9315621b0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63ec03a070 con 0x55f9315621b0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f63e4c00640 1 -- 172.21.15.84:0/3687883030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f63ec04f050 con 0x55f9315621b0 2024-09-21T08:00:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f6408e18740 10 client.17538 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.705+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f9319ba9b0 con 0x55f9315621b0 2024-09-21T08:00:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f63e4c00640 1 -- 172.21.15.84:0/3687883030 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec03a070 con 0x55f9315621b0 2024-09-21T08:00:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f63e4c00640 1 -- 172.21.15.84:0/3687883030 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f63ec005340 con 0x55f9315621b0 2024-09-21T08:00:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f6408e18740 10 client.17538 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f6408e18740 10 client.17538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f6408e18740 20 client.17538 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f6408e18740 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f93151eda0 0x55f9319bd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f6408e18740 4 client.17538 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9318a69b0 con 0x55f93151eda0 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.706+0000 7f63faa00640 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f93151eda0 0x55f9319bd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f63faa00640 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f93151eda0 0x55f9319bd190 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a96660465ec992 server_cookie=e66762ae01654ec5 in_seq=0 out_seq=0 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f63e4c00640 10 client.17538 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f63e4c00640 1 -- 172.21.15.84:0/3687883030 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9318a69b0 con 0x55f93151eda0 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f63e4c00640 10 client.17538 handle_command_reply: tid=0 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f6408e18740 1 client.17538 shutdown 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 msgr2=0x55f931941fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f6408e18740 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931941fb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009800 tx=0x7f63ec005c50 comp rx=0 tx=0).stop 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 shutdown_connections 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f6408e18740 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f93151eda0 0x55f9319bd190 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.707+0000 7f6408e18740 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f93158b070 0x55f9319b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6408e18740 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f93156a390 0x55f931942590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6408e18740 1 --2- 172.21.15.84:0/3687883030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9315621b0 0x55f931941fb0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 >> 172.21.15.84:0/3687883030 conn(0x55f93157f460 msgr2=0x55f931936e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f63e4c00640 0 client.17538 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 shutdown_connections 2024-09-21T08:00:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6408e18740 1 -- 172.21.15.84:0/3687883030 wait complete. 2024-09-21T08:00:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6408e18740 20 client.17538 trim_cache size 0 max 16384 2024-09-21T08:00:21.712 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f63e00b6700 msgr2=0x7f63e00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6400a00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f63e00b6700 0x7f63e00b8c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f63e8000c00 tx=0x7f63e8005d70 comp rx=0 tx=0).stop 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc10ff10 msgr2=0x7f63fc1a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.708+0000 7f6400a00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc10ff10 0x7f63fc1a1d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009fd0 tx=0x7f63f400ef10 comp rx=0 tx=0).stop 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 shutdown_connections 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f63e00b6700 0x7f63e00b8c10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63fc10ff10 0x7f63fc1a1d40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63fc076100 0x7f63fc19caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 --2- 172.21.15.84:0/2596862341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63fc0757b0 0x7f63fc19c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 >> 172.21.15.84:0/2596862341 conn(0x7f63fc0ff440 msgr2=0x7f63fc109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 shutdown_connections 2024-09-21T08:00:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:21.709+0000 7f6400a00640 1 -- 172.21.15.84:0/2596862341 wait complete. 2024-09-21T08:00:21.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:21 smithi162 ceph-mon[34833]: pgmap v679: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:21.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:21 smithi084 ceph-mon[30411]: pgmap v679: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:21.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:21 smithi191 ceph-mon[34667]: pgmap v679: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:22.651 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '385a5f69', total seconds elapsed: 27.9 2024-09-21T08:00:23.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:23 smithi162 ceph-mon[34833]: pgmap v680: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:23.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:23 smithi084 ceph-mon[30411]: pgmap v680: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:23.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:23 smithi191 ceph-mon[34667]: pgmap v680: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:00:23.984 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:00:23.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:00:24.364 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:25.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 -- 172.21.15.84:0/256071638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03681081f0 msgr2=0x7f0368108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 --2- 172.21.15.84:0/256071638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03681081f0 0x7f0368108600 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0354009900 tx=0x7f035402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 -- 172.21.15.84:0/256071638 shutdown_connections 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 --2- 172.21.15.84:0/256071638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0368108b40 0x7f036810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 --2- 172.21.15.84:0/256071638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03681081f0 0x7f0368108600 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 --2- 172.21.15.84:0/256071638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 0x7f0368102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 -- 172.21.15.84:0/256071638 >> 172.21.15.84:0/256071638 conn(0x7f03680fe300 msgr2=0x7f0368100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 -- 172.21.15.84:0/256071638 shutdown_connections 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.024+0000 7f0367200640 1 -- 172.21.15.84:0/256071638 wait complete. 2024-09-21T08:00:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.025+0000 7f0367200640 1 Processor -- start 2024-09-21T08:00:25.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0367200640 1 -- start start 2024-09-21T08:00:25.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0367200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 0x7f03680fe830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0367200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03681081f0 0x7f03680fed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0367200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0368108b40 0x7f03680ff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0367200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03681127a0 con 0x7f0368108b40 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0367200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0368112620 con 0x7f03681081f0 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0367200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0368112920 con 0x7f03681028b0 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0365e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 0x7f03680fe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0365e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 0x7f03680fe830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49140/0 (socket says 172.21.15.84:49140) 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0366800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0368108b40 0x7f03680ff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.026+0000 7f0365e00640 1 -- 172.21.15.84:0/2343623167 learned_addr learned my addr 172.21.15.84:0/2343623167 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:25.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.027+0000 7f0365400640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03681081f0 0x7f03680fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.027+0000 7f0365e00640 1 -- 172.21.15.84:0/2343623167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03681081f0 msgr2=0x7f03680fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.027+0000 7f0365e00640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03681081f0 0x7f03680fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.027+0000 7f0365e00640 1 -- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0368108b40 msgr2=0x7f03680ff2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.027+0000 7f0365e00640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0368108b40 0x7f03680ff2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.027+0000 7f0365e00640 1 -- 172.21.15.84:0/2343623167 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03681a85a0 con 0x7f03681028b0 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.027+0000 7f0365e00640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 0x7f03680fe830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f035800ea60 tx=0x7f035800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.028+0000 7f035ea00640 1 -- 172.21.15.84:0/2343623167 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035800cde0 con 0x7f03681028b0 2024-09-21T08:00:25.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.028+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03681a8890 con 0x7f03681028b0 2024-09-21T08:00:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.028+0000 7f035ea00640 1 -- 172.21.15.84:0/2343623167 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03580035f0 con 0x7f03681028b0 2024-09-21T08:00:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.028+0000 7f035ea00640 1 -- 172.21.15.84:0/2343623167 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358010690 con 0x7f03681028b0 2024-09-21T08:00:25.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.028+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03681a8df0 con 0x7f03681028b0 2024-09-21T08:00:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.031+0000 7f0373ddd740 1 Processor -- start 2024-09-21T08:00:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.031+0000 7f0373ddd740 1 -- start start 2024-09-21T08:00:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.031+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.031+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3bb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.031+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3bb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0373ddd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5640ca330e90 con 0x5640c9ff2670 2024-09-21T08:00:25.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0373ddd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5640ca3202c0 con 0x5640c9fea490 2024-09-21T08:00:25.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0373ddd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5640ca3240d0 con 0x5640ca013350 2024-09-21T08:00:25.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0366800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0365400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3bb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0366800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49144/0 (socket says 172.21.15.84:49144) 2024-09-21T08:00:25.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0366800640 1 -- 172.21.15.84:0/2144496128 learned_addr learned my addr 172.21.15.84:0/2144496128 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0365400640 1 -- 172.21.15.84:0/2144496128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 msgr2=0x5640ca3baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0365400640 1 --2- 172.21.15.84:0/2144496128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3baf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0365400640 1 -- 172.21.15.84:0/2144496128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 msgr2=0x5640ca3bb440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0365400640 1 --2- 172.21.15.84:0/2144496128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3bb440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.032+0000 7f0365400640 1 -- 172.21.15.84:0/2144496128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ca07e930 con 0x5640c9ff2670 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.033+0000 7f035ea00640 1 -- 172.21.15.84:0/2343623167 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f03580037a0 con 0x7f03681028b0 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.033+0000 7f0365400640 1 --2- 172.21.15.84:0/2144496128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3bb980 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f035402a910 tx=0x7f0354000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7db8d5bbf0117c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.033+0000 7f0353400640 1 -- 172.21.15.84:0/2144496128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0354040070 con 0x5640c9ff2670 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.033+0000 7f0353400640 1 -- 172.21.15.84:0/2144496128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0354004030 con 0x5640c9ff2670 2024-09-21T08:00:25.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.033+0000 7f0353400640 1 -- 172.21.15.84:0/2144496128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0354035040 con 0x5640c9ff2670 2024-09-21T08:00:25.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 -- 172.21.15.84:0/2144496128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 msgr2=0x5640ca3bb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 --2- 172.21.15.84:0/2144496128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3bb980 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f035402a910 tx=0x7f0354000bc0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 -- 172.21.15.84:0/2144496128 shutdown_connections 2024-09-21T08:00:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 --2- 172.21.15.84:0/2144496128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3bb980 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 --2- 172.21.15.84:0/2144496128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 --2- 172.21.15.84:0/2144496128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 -- 172.21.15.84:0/2144496128 >> 172.21.15.84:0/2144496128 conn(0x5640ca007740 msgr2=0x5640ca3b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 -- 172.21.15.84:0/2144496128 shutdown_connections 2024-09-21T08:00:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f0373ddd740 1 -- 172.21.15.84:0/2144496128 wait complete. 2024-09-21T08:00:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f035ea00640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f034c0b6610 0x7f034c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.034+0000 7f035ea00640 1 -- 172.21.15.84:0/2343623167 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f03580e7d60 con 0x7f03681028b0 2024-09-21T08:00:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.035+0000 7f0365400640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f034c0b6610 0x7f034c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.035+0000 7f0373ddd740 1 -- start start 2024-09-21T08:00:25.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.035+0000 7f0373ddd740 1 Processor -- start 2024-09-21T08:00:25.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.035+0000 7f0365400640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f034c0b6610 0x7f034c0b8b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0354005f70 tx=0x7f035402a3f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9ff2670 0x5640ca3c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640ca013350 0x5640ca3d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0373ddd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5640ca181890 con 0x5640ca013350 2024-09-21T08:00:25.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0373ddd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5640ca2bb160 con 0x5640c9fea490 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0373ddd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5640ca3c9680 con 0x5640c9ff2670 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0373ddd740 10 client.0 _ll_register_callbacks cb 0x5640ca2d7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0365e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0365e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56452/0 (socket says 172.21.15.84:56452) 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0365e00640 1 -- 172.21.15.84:0/498711370 learned_addr learned my addr 172.21.15.84:0/498711370 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.036+0000 7f0365400640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9ff2670 0x5640ca3c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0366800640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640ca013350 0x5640ca3d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0365e00640 1 -- 172.21.15.84:0/498711370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9ff2670 msgr2=0x5640ca3c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0365e00640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9ff2670 0x5640ca3c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0365e00640 1 -- 172.21.15.84:0/498711370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640ca013350 msgr2=0x5640ca3d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0365e00640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640ca013350 0x5640ca3d2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0365e00640 1 -- 172.21.15.84:0/498711370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640ca3d2f60 con 0x5640c9fea490 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0366800640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640ca013350 0x5640ca3d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:25.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0365e00640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3c6ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f035800c760 tx=0x7f0358004280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba4bae129407c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0347e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0347e00640 1 -- 172.21.15.84:0/498711370 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580acf30 con 0x5640c9fea490 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0354004030 con 0x5640c9fea490 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0347e00640 1 -- 172.21.15.84:0/498711370 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f03580aeaf0 con 0x5640c9fea490 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0347e00640 1 -- 172.21.15.84:0/498711370 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f03580ad2d0 con 0x5640c9fea490 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0373ddd740 10 client.27911 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.037+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5640ca3d5920 con 0x5640c9fea490 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0347e00640 1 -- 172.21.15.84:0/498711370 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0354004030 con 0x5640c9fea490 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0347e00640 1 -- 172.21.15.84:0/498711370 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f03580ac490 con 0x5640c9fea490 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0373ddd740 10 client.27911 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0373ddd740 10 client.27911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0373ddd740 20 client.27911 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0373ddd740 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fd1cd0 0x5640ca3d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0373ddd740 4 client.27911 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:25.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640ca332de0 con 0x5640c9fd1cd0 2024-09-21T08:00:25.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.038+0000 7f0365400640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fd1cd0 0x5640ca3d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.039+0000 7f0347e00640 10 client.27911 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.039+0000 7f0365400640 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fd1cd0 0x5640ca3d8d40 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c31c2711ce4b512 server_cookie=d05bed1944e9fc16 in_seq=0 out_seq=0 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0347e00640 1 -- 172.21.15.84:0/498711370 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640ca332de0 con 0x5640c9fd1cd0 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0347e00640 10 client.27911 handle_command_reply: tid=0 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 client.27911 shutdown 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 msgr2=0x5640ca3c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3c6ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f035800c760 tx=0x7f0358004280 comp rx=0 tx=0).stop 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 shutdown_connections 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640ca013350 0x5640ca3d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fd1cd0 0x5640ca3d8d40 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9ff2670 0x5640ca3c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 --2- 172.21.15.84:0/498711370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3c6ad0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 >> 172.21.15.84:0/498711370 conn(0x5640ca007740 msgr2=0x5640ca3be0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0347e00640 0 client.27911 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:25.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 shutdown_connections 2024-09-21T08:00:25.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 1 -- 172.21.15.84:0/498711370 wait complete. 2024-09-21T08:00:25.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.040+0000 7f0373ddd740 20 client.27911 trim_cache size 0 max 16384 2024-09-21T08:00:25.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 Processor -- start 2024-09-21T08:00:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 -- start start 2024-09-21T08:00:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9fea490 0x5640ca3d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640ca013350 0x5640ca3b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b2e70 con 0x5640c9ff2670 2024-09-21T08:00:25.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b49b0 con 0x5640ca013350 2024-09-21T08:00:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0373ddd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b3540 con 0x5640c9fea490 2024-09-21T08:00:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.059+0000 7f0365400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9fea490 0x5640ca3d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0366800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640ca013350 0x5640ca3b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3b85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47138/0 (socket says 172.21.15.84:47138) 2024-09-21T08:00:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365400640 1 -- 172.21.15.84:0/1788213765 learned_addr learned my addr 172.21.15.84:0/1788213765 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:25.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9fea490 0x5640ca3d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49158/0 (socket says 172.21.15.84:49158) 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 -- 172.21.15.84:0/1788213765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640ca013350 msgr2=0x5640ca3b8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640ca013350 0x5640ca3b8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 -- 172.21.15.84:0/1788213765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 msgr2=0x5640ca3b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 -- 172.21.15.84:0/1788213765 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ca3c5850 con 0x5640c9fea490 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365400640 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0365e00640 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9fea490 0x5640ca3d2870 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f035800d010 tx=0x7f0358003e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa6c706160de33b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.060+0000 7f0352a00640 1 -- 172.21.15.84:0/1788213765 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580acf30 con 0x5640c9fea490 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0352a00640 1 -- 172.21.15.84:0/1788213765 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03580adec0 con 0x5640c9fea490 2024-09-21T08:00:25.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0352a00640 1 -- 172.21.15.84:0/1788213765 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580b3430 con 0x5640c9fea490 2024-09-21T08:00:25.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 -- 172.21.15.84:0/1788213765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9fea490 msgr2=0x5640ca3d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9fea490 0x5640ca3d2870 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f035800d010 tx=0x7f0358003e00 comp rx=0 tx=0).stop 2024-09-21T08:00:25.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 -- 172.21.15.84:0/1788213765 shutdown_connections 2024-09-21T08:00:25.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640ca013350 0x5640ca3b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1788213765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640c9fea490 0x5640ca3d2870 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 -- 172.21.15.84:0/1788213765 >> 172.21.15.84:0/1788213765 conn(0x5640ca007740 msgr2=0x5640ca3c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.061+0000 7f0373ddd740 1 -- 172.21.15.84:0/1788213765 shutdown_connections 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.062+0000 7f0373ddd740 1 -- 172.21.15.84:0/1788213765 wait complete. 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.062+0000 7f0373ddd740 1 -- start start 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.062+0000 7f0373ddd740 1 Processor -- start 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0373ddd740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0373ddd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b42e0 con 0x5640c9ff2670 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0373ddd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b3c10 con 0x5640c9fea490 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0373ddd740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b0e70 con 0x5640ca013350 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0373ddd740 10 client.0 _ll_register_callbacks cb 0x7f03580a9660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:25.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0365400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0365400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47146/0 (socket says 172.21.15.84:47146) 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0365e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0365400640 1 -- 172.21.15.84:0/1551210338 learned_addr learned my addr 172.21.15.84:0/1551210338 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0366800640 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0365e00640 1 -- 172.21.15.84:0/1551210338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 msgr2=0x5640ca3c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.063+0000 7f0365e00640 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0365e00640 1 -- 172.21.15.84:0/1551210338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 msgr2=0x5640ca3cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0365e00640 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0365e00640 1 -- 172.21.15.84:0/1551210338 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640ca3ca0c0 con 0x5640c9fea490 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0365e00640 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3cec40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f03580ad470 tx=0x7f0358003e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59aea8294c8b3b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0347e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:00:25.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0347e00640 1 -- 172.21.15.84:0/1551210338 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580cc020 con 0x5640c9fea490 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0347e00640 1 -- 172.21.15.84:0/1551210338 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f03580aecf0 con 0x5640c9fea490 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03580adec0 con 0x5640c9fea490 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0347e00640 1 -- 172.21.15.84:0/1551210338 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f035808c050 con 0x5640c9fea490 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0373ddd740 10 client.27917 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.064+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5640ca3ca0c0 con 0x5640c9fea490 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0347e00640 1 -- 172.21.15.84:0/1551210338 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03580adec0 con 0x5640c9fea490 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0347e00640 1 -- 172.21.15.84:0/1551210338 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f03580cf390 con 0x5640c9fea490 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0373ddd740 10 client.27917 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0373ddd740 10 client.27917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0373ddd740 20 client.27917 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fa7080 0x5640ca4464b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0373ddd740 4 client.27917 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5640ca32e890 con 0x5640c9fa7080 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.065+0000 7f0365400640 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fa7080 0x5640ca4464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.066+0000 7f0365400640 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fa7080 0x5640ca4464b0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e28e64d05d385b server_cookie=f1077ad680090ee0 in_seq=0 out_seq=0 2024-09-21T08:00:25.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.066+0000 7f0347e00640 10 client.27917 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:25.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0347e00640 1 -- 172.21.15.84:0/1551210338 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5640ca32e890 con 0x5640c9fa7080 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0347e00640 10 client.27917 handle_command_reply: tid=0 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 client.27917 shutdown 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 msgr2=0x5640ca3cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3cec40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f03580ad470 tx=0x7f0358003e90 comp rx=0 tx=0).stop 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 shutdown_connections 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5640c9fa7080 0x5640ca4464b0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5640ca013350 0x5640ca3c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640c9ff2670 0x5640ca3cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 --2- 172.21.15.84:0/1551210338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640c9fea490 0x5640ca3cec40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0347e00640 0 client.27917 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 >> 172.21.15.84:0/1551210338 conn(0x5640ca007740 msgr2=0x5640ca3c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 shutdown_connections 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.068+0000 7f0373ddd740 1 -- 172.21.15.84:0/1551210338 wait complete. 2024-09-21T08:00:25.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0373ddd740 20 client.27917 trim_cache size 0 max 16384 2024-09-21T08:00:25.072 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:00:25.072 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T08:00:25.072 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "63a41a05-d44f-45b2-983d-1fa6b7559a20", 2024-09-21T08:00:25.072 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T08:00:25.072 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f034c0b6610 msgr2=0x7f034c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f034c0b6610 0x7f034c0b8b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0354005f70 tx=0x7f035402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 msgr2=0x7f03680fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 0x7f03680fe830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f035800ea60 tx=0x7f035800ef20 comp rx=0 tx=0).stop 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 shutdown_connections 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f034c0b6610 0x7f034c0b8b20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0368108b40 0x7f03680ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03681081f0 0x7f03680fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 --2- 172.21.15.84:0/2343623167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03681028b0 0x7f03680fe830 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.069+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 >> 172.21.15.84:0/2343623167 conn(0x7f03680fe300 msgr2=0x7f03681068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.070+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 shutdown_connections 2024-09-21T08:00:25.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:25.070+0000 7f0367200640 1 -- 172.21.15.84:0/2343623167 wait complete. 2024-09-21T08:00:25.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:25 smithi084 ceph-mon[30411]: pgmap v681: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:00:25.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:25 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T08:00:25.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:25 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T08:00:25.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:25 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T08:00:25.781 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:25 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T08:00:25.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:25 smithi162 ceph-mon[34833]: pgmap v681: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:00:25.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:25 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T08:00:25.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:25 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T08:00:25.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:25 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T08:00:25.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:25 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T08:00:25.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:00:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:25 smithi191 ceph-mon[34667]: pgmap v681: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:00:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:25 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T08:00:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:25 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T08:00:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:25 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T08:00:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:25 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T08:00:26.185 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 -- 172.21.15.84:0/3879987332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10be30 msgr2=0x7f06ec112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 --2- 172.21.15.84:0/3879987332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10be30 0x7f06ec112660 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009ca0 tx=0x7f06e402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 -- 172.21.15.84:0/3879987332 shutdown_connections 2024-09-21T08:00:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 --2- 172.21.15.84:0/3879987332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10be30 0x7f06ec112660 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 --2- 172.21.15.84:0/3879987332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06ec10b4e0 0x7f06ec10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 --2- 172.21.15.84:0/3879987332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec105ba0 0x7f06ec105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 -- 172.21.15.84:0/3879987332 >> 172.21.15.84:0/3879987332 conn(0x7f06ec101610 msgr2=0x7f06ec103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 -- 172.21.15.84:0/3879987332 shutdown_connections 2024-09-21T08:00:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.825+0000 7f06eb200640 1 -- 172.21.15.84:0/3879987332 wait complete. 2024-09-21T08:00:26.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.826+0000 7f06eb200640 1 Processor -- start 2024-09-21T08:00:26.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06eb200640 1 -- start start 2024-09-21T08:00:26.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06eb200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06ec105ba0 0x7f06ec19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06eb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10b4e0 0x7f06ec19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06eb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec10be30 0x7f06ec1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06eb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec115af0 con 0x7f06ec10b4e0 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06eb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec115970 con 0x7f06ec10be30 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06eb200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec115c70 con 0x7f06ec105ba0 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06e1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10b4e0 0x7f06ec19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06ea800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec10be30 0x7f06ec1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06ea800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec10be30 0x7f06ec1a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56482/0 (socket says 172.21.15.84:56482) 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06ea800640 1 -- 172.21.15.84:0/3906852800 learned_addr learned my addr 172.21.15.84:0/3906852800 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:26.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.827+0000 7f06e9e00640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06ec105ba0 0x7f06ec19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06ea800640 1 -- 172.21.15.84:0/3906852800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06ec105ba0 msgr2=0x7f06ec19c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06ea800640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06ec105ba0 0x7f06ec19c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06ea800640 1 -- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10b4e0 msgr2=0x7f06ec19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06ea800640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10b4e0 0x7f06ec19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06ea800640 1 -- 172.21.15.84:0/3906852800 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec1a23d0 con 0x7f06ec10be30 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06e9e00640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06ec105ba0 0x7f06ec19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06ea800640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec10be30 0x7f06ec1a1ca0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f06e4005cc0 tx=0x7f06e4031700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06e3400640 1 -- 172.21.15.84:0/3906852800 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4003b70 con 0x7f06ec10be30 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.828+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec1a2660 con 0x7f06ec10be30 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.829+0000 7f06e3400640 1 -- 172.21.15.84:0/3906852800 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e40318f0 con 0x7f06ec10be30 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.829+0000 7f06e3400640 1 -- 172.21.15.84:0/3906852800 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e402f950 con 0x7f06ec10be30 2024-09-21T08:00:26.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.829+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec1a8e20 con 0x7f06ec10be30 2024-09-21T08:00:26.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.832+0000 7f06f7a88740 1 Processor -- start 2024-09-21T08:00:26.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.832+0000 7f06e3400640 1 -- 172.21.15.84:0/3906852800 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f06e402fb50 con 0x7f06ec10be30 2024-09-21T08:00:26.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.832+0000 7f06f7a88740 1 -- start start 2024-09-21T08:00:26.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184eb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218123390 0x5612184eb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06f7a88740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561218461f70 con 0x561218123390 2024-09-21T08:00:26.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06f7a88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5612184513a0 con 0x56121811b1b0 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06f7a88740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5612184551b0 con 0x561218144070 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06e1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218123390 0x5612184eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06e1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218123390 0x5612184eb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47170/0 (socket says 172.21.15.84:47170) 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06e1400640 1 -- 172.21.15.84:0/2168171299 learned_addr learned my addr 172.21.15.84:0/2168171299 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06e1400640 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.833+0000 7f06e9e00640 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06e1400640 1 -- 172.21.15.84:0/2168171299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 msgr2=0x5612184eacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06e1400640 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184eacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06e1400640 1 -- 172.21.15.84:0/2168171299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 msgr2=0x5612184eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06e1400640 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06e1400640 1 -- 172.21.15.84:0/2168171299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121841bc90 con 0x561218123390 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06e1400640 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218123390 0x5612184eb770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f06d40058c0 tx=0x7f06d4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a22dc29e4e1657 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06db400640 1 -- 172.21.15.84:0/2168171299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4005020 con 0x561218123390 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06e3400640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06d00b6680 0x7f06d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06db400640 1 -- 172.21.15.84:0/2168171299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06d40047a0 con 0x561218123390 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.834+0000 7f06db400640 1 -- 172.21.15.84:0/2168171299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d400fa20 con 0x561218123390 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06e9e00640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06d00b6680 0x7f06d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06e3400640 1 -- 172.21.15.84:0/3906852800 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f06e4108be0 con 0x7f06ec10be30 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 -- 172.21.15.84:0/2168171299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218123390 msgr2=0x5612184eb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218123390 0x5612184eb770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f06d40058c0 tx=0x7f06d4005850 comp rx=0 tx=0).stop 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06e9e00640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06d00b6680 0x7f06d00b8b90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5612184e9970 tx=0x7f06dc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 -- 172.21.15.84:0/2168171299 shutdown_connections 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218123390 0x5612184eb770 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2168171299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184eacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 -- 172.21.15.84:0/2168171299 >> 172.21.15.84:0/2168171299 conn(0x561218138460 msgr2=0x5612184e8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.835+0000 7f06f7a88740 1 -- 172.21.15.84:0/2168171299 shutdown_connections 2024-09-21T08:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.836+0000 7f06f7a88740 1 -- 172.21.15.84:0/2168171299 wait complete. 2024-09-21T08:00:26.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.836+0000 7f06f7a88740 1 -- start start 2024-09-21T08:00:26.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.836+0000 7f06f7a88740 1 Processor -- start 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218123390 0x5612184f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184fc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06f7a88740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5612182b2700 con 0x56121811b1b0 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06f7a88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5612183ec540 con 0x561218123390 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06f7a88740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5612184f94d0 con 0x561218144070 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06f7a88740 10 client.0 _ll_register_callbacks cb 0x5612183fc430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:26.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47186/0 (socket says 172.21.15.84:47186) 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06e9e00640 1 -- 172.21.15.84:0/1381390723 learned_addr learned my addr 172.21.15.84:0/1381390723 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06ea800640 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.837+0000 7f06e1400640 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218123390 0x5612184f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06e9e00640 1 -- 172.21.15.84:0/1381390723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 msgr2=0x5612184fc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06e9e00640 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184fc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06e9e00640 1 -- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218123390 msgr2=0x5612184f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06e9e00640 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218123390 0x5612184f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06e9e00640 1 -- 172.21.15.84:0/1381390723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612181af650 con 0x56121811b1b0 2024-09-21T08:00:26.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06e9e00640 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f69d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009f70 tx=0x7f06dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444d2c363befb644 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06cfe00640 1 -- 172.21.15.84:0/1381390723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00f8b0 con 0x56121811b1b0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06cfe00640 1 -- 172.21.15.84:0/1381390723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f06dc00fa50 con 0x56121811b1b0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5612183eeb50 con 0x56121811b1b0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06cfe00640 1 -- 172.21.15.84:0/1381390723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f06dc00fc50 con 0x56121811b1b0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.838+0000 7f06f7a88740 10 client.17565 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561218409910 con 0x56121811b1b0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06cfe00640 1 -- 172.21.15.84:0/1381390723 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5612183eeb50 con 0x56121811b1b0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06cfe00640 1 -- 172.21.15.84:0/1381390723 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f06dc027070 con 0x56121811b1b0 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06f7a88740 10 client.17565 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06f7a88740 10 client.17565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06f7a88740 20 client.17565 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06f7a88740 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612181029f0 0x561218508a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06f7a88740 4 client.17565 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:26.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.839+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561218463ec0 con 0x5612181029f0 2024-09-21T08:00:26.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.840+0000 7f06e1400640 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612181029f0 0x561218508a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.840+0000 7f06e1400640 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612181029f0 0x561218508a20 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d99500afa46fb28d server_cookie=df466ec7950fd354 in_seq=0 out_seq=0 2024-09-21T08:00:26.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.840+0000 7f06cfe00640 10 client.17565 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06cfe00640 1 -- 172.21.15.84:0/1381390723 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561218463ec0 con 0x5612181029f0 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06cfe00640 10 client.17565 handle_command_reply: tid=0 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 client.17565 shutdown 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 msgr2=0x5612184f69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f69d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009f70 tx=0x7f06dc004730 comp rx=0 tx=0).stop 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 shutdown_connections 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612181029f0 0x561218508a20 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218144070 0x5612184fc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218123390 0x5612184f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.841+0000 7f06f7a88740 1 --2- 172.21.15.84:0/1381390723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f69d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.842+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 >> 172.21.15.84:0/1381390723 conn(0x561218138460 msgr2=0x5612184ede80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:26.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.842+0000 7f06cfe00640 0 client.17565 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:26.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.842+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 shutdown_connections 2024-09-21T08:00:26.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.842+0000 7f06f7a88740 1 -- 172.21.15.84:0/1381390723 wait complete. 2024-09-21T08:00:26.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.842+0000 7f06f7a88740 20 client.17565 trim_cache size 0 max 16384 2024-09-21T08:00:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.859+0000 7f06f7a88740 1 Processor -- start 2024-09-21T08:00:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06f7a88740 1 -- start start 2024-09-21T08:00:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184e8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218144070 0x5612184e8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06f7a88740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b2de0 con 0x56121811b1b0 2024-09-21T08:00:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06f7a88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b4920 con 0x561218144070 2024-09-21T08:00:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06f7a88740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b34b0 con 0x561218123390 2024-09-21T08:00:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47202/0 (socket says 172.21.15.84:47202) 2024-09-21T08:00:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06e9e00640 1 -- 172.21.15.84:0/2234258406 learned_addr learned my addr 172.21.15.84:0/2234258406 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06ea800640 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218144070 0x5612184e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.860+0000 7f06e1400640 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06e9e00640 1 -- 172.21.15.84:0/2234258406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 msgr2=0x5612184e8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06e9e00640 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184e8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06e9e00640 1 -- 172.21.15.84:0/2234258406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218144070 msgr2=0x5612184e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06e9e00640 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218144070 0x5612184e8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06e9e00640 1 -- 172.21.15.84:0/2234258406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612184f5730 con 0x56121811b1b0 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06e9e00640 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f0510 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f06dc01f650 tx=0x7f06dc003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c36c5c60f0ad202 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06daa00640 1 -- 172.21.15.84:0/2234258406 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00fab0 con 0x56121811b1b0 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06daa00640 1 -- 172.21.15.84:0/2234258406 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06dc01fcf0 con 0x56121811b1b0 2024-09-21T08:00:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.861+0000 7f06daa00640 1 -- 172.21.15.84:0/2234258406 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc029c50 con 0x56121811b1b0 2024-09-21T08:00:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 -- 172.21.15.84:0/2234258406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 msgr2=0x5612184f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f0510 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f06dc01f650 tx=0x7f06dc003f00 comp rx=0 tx=0).stop 2024-09-21T08:00:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 -- 172.21.15.84:0/2234258406 shutdown_connections 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561218144070 0x5612184e8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184e8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 --2- 172.21.15.84:0/2234258406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56121811b1b0 0x5612184f0510 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 -- 172.21.15.84:0/2234258406 >> 172.21.15.84:0/2234258406 conn(0x561218138460 msgr2=0x5612184efe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 -- 172.21.15.84:0/2234258406 shutdown_connections 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.862+0000 7f06f7a88740 1 -- 172.21.15.84:0/2234258406 wait complete. 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 -- start start 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 Processor -- start 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184fd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184fda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218144070 0x5612185005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b4250 con 0x561218144070 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b3b80 con 0x56121811b1b0 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b0de0 con 0x561218123390 2024-09-21T08:00:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.863+0000 7f06f7a88740 10 client.0 _ll_register_callbacks cb 0x7f06dc004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184fd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:56520/0 (socket says 172.21.15.84:56520) 2024-09-21T08:00:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e9e00640 1 -- 172.21.15.84:0/648248855 learned_addr learned my addr 172.21.15.84:0/648248855 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06ea800640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218144070 0x5612185005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e1400640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e1400640 1 -- 172.21.15.84:0/648248855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 msgr2=0x5612184fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e1400640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184fd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e1400640 1 -- 172.21.15.84:0/648248855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218144070 msgr2=0x5612185005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:26.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e1400640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218144070 0x5612185005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e1400640 1 -- 172.21.15.84:0/648248855 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561218500b30 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06ea800640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218144070 0x5612185005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.864+0000 7f06e1400640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184fda50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x561218509180 tx=0x7f06d4009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9abce80ae55b1e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.865+0000 7f06cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.865+0000 7f06cfe00640 1 -- 172.21.15.84:0/648248855 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d40053a0 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.865+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06dc01fcf0 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.865+0000 7f06cfe00640 1 -- 172.21.15.84:0/648248855 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f06d4019040 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.865+0000 7f06cfe00640 1 -- 172.21.15.84:0/648248855 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f06d403f050 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.865+0000 7f06f7a88740 10 client.27952 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.865+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561218573af0 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06cfe00640 1 -- 172.21.15.84:0/648248855 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06dc01fcf0 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06cfe00640 1 -- 172.21.15.84:0/648248855 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f06d401d030 con 0x561218123390 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06f7a88740 10 client.27952 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06f7a88740 10 client.27952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06f7a88740 20 client.27952 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06f7a88740 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612180d7da0 0x561218575f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:26.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06f7a88740 4 client.27952 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:00:26.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56121845f970 con 0x5612180d7da0 2024-09-21T08:00:26.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.866+0000 7f06e9e00640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612180d7da0 0x561218575f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06e9e00640 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612180d7da0 0x561218575f20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af17142d6c063a8 server_cookie=d265df0cf2998910 in_seq=0 out_seq=0 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06cfe00640 10 client.27952 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06cfe00640 1 -- 172.21.15.84:0/648248855 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x56121845f970 con 0x5612180d7da0 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06cfe00640 10 client.27952 handle_command_reply: tid=0 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 client.27952 shutdown 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 msgr2=0x5612184fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184fda50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x561218509180 tx=0x7f06d4009ac0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 shutdown_connections 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561218144070 0x5612185005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5612180d7da0 0x561218575f20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561218123390 0x5612184fda50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06cfe00640 0 client.27952 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 --2- 172.21.15.84:0/648248855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56121811b1b0 0x5612184fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.867+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 >> 172.21.15.84:0/648248855 conn(0x561218138460 msgr2=0x5612184e8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.868+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 shutdown_connections 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.868+0000 7f06f7a88740 1 -- 172.21.15.84:0/648248855 wait complete. 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.868+0000 7f06f7a88740 20 client.27952 trim_cache size 0 max 16384 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stdout: "63a41a05-d44f-45b2-983d-1fa6b7559a20": { 2024-09-21T08:00:26.872 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "63a41a05-d44f-45b2-983d-1fa6b7559a20", 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "63a41a05-d44f-45b2-983d-1fa6b7559a20": { 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:00:25.066675+0000", 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.873 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.876 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.877 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:26.879 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.868+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06d00b6680 msgr2=0x7f06d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.868+0000 7f06eb200640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06d00b6680 0x7f06d00b8b90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5612184e9970 tx=0x7f06dc005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.868+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec10be30 msgr2=0x7f06ec1a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.868+0000 7f06eb200640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec10be30 0x7f06ec1a1ca0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f06e4005cc0 tx=0x7f06e4031700 comp rx=0 tx=0).stop 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 shutdown_connections 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f06d00b6680 0x7f06d00b8b90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ec10be30 0x7f06ec1a1ca0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06ec10b4e0 0x7f06ec19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 --2- 172.21.15.84:0/3906852800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06ec105ba0 0x7f06ec19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 >> 172.21.15.84:0/3906852800 conn(0x7f06ec101610 msgr2=0x7f06ec103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 shutdown_connections 2024-09-21T08:00:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:26.869+0000 7f06eb200640 1 -- 172.21.15.84:0/3906852800 wait complete. 2024-09-21T08:00:27.578 INFO:tasks.cephfs.filesystem:scrub status for tag:63a41a05-d44f-45b2-983d-1fa6b7559a20 - {'path': '/', 'tag': '63a41a05-d44f-45b2-983d-1fa6b7559a20', 'options': 'recursive,force'} 2024-09-21T08:00:27.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:27 smithi162 ceph-mon[34833]: pgmap v682: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.4 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T08:00:27.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:27 smithi084 ceph-mon[30411]: pgmap v682: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.4 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T08:00:27.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:27 smithi191 ceph-mon[34667]: pgmap v682: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.4 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T08:00:28.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:28 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T08:00:28.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:28 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T08:00:29.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:28 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T08:00:29.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:29 smithi084 ceph-mon[30411]: pgmap v683: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 7.2 KiB/s rd, 574 B/s wr, 11 op/s 2024-09-21T08:00:29.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:29 smithi191 ceph-mon[34667]: pgmap v683: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 7.2 KiB/s rd, 574 B/s wr, 11 op/s 2024-09-21T08:00:30.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:29 smithi162 ceph-mon[34833]: pgmap v683: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 7.2 KiB/s rd, 574 B/s wr, 11 op/s 2024-09-21T08:00:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:31 smithi191 ceph-mon[34667]: pgmap v684: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 511 B/s wr, 14 op/s 2024-09-21T08:00:32.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:31 smithi162 ceph-mon[34833]: pgmap v684: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 511 B/s wr, 14 op/s 2024-09-21T08:00:32.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:31 smithi084 ceph-mon[30411]: pgmap v684: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 511 B/s wr, 14 op/s 2024-09-21T08:00:33.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:33 smithi191 ceph-mon[34667]: pgmap v685: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 7.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T08:00:34.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:33 smithi162 ceph-mon[34833]: pgmap v685: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 7.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T08:00:34.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:33 smithi084 ceph-mon[30411]: pgmap v685: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 7.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-21T08:00:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:35 smithi191 ceph-mon[34667]: pgmap v686: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T08:00:36.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:35 smithi162 ceph-mon[34833]: pgmap v686: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T08:00:36.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:35 smithi084 ceph-mon[30411]: pgmap v686: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T08:00:37.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:37 smithi191 ceph-mon[34667]: pgmap v687: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T08:00:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:37 smithi162 ceph-mon[34833]: pgmap v687: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T08:00:38.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:37 smithi084 ceph-mon[30411]: pgmap v687: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T08:00:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:39 smithi191 ceph-mon[34667]: pgmap v688: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T08:00:40.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:39 smithi162 ceph-mon[34833]: pgmap v688: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T08:00:40.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:39 smithi084 ceph-mon[30411]: pgmap v688: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T08:00:41.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:41 smithi191 ceph-mon[34667]: pgmap v689: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s 2024-09-21T08:00:42.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:41 smithi162 ceph-mon[34833]: pgmap v689: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s 2024-09-21T08:00:42.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:41 smithi084 ceph-mon[30411]: pgmap v689: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s 2024-09-21T08:00:43.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:43 smithi191 ceph-mon[34667]: pgmap v690: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-21T08:00:44.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:43 smithi162 ceph-mon[34833]: pgmap v690: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-21T08:00:44.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:43 smithi084 ceph-mon[30411]: pgmap v690: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-21T08:00:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:45 smithi191 ceph-mon[34667]: pgmap v691: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T08:00:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:45 smithi162 ceph-mon[34833]: pgmap v691: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T08:00:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:45 smithi084 ceph-mon[30411]: pgmap v691: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-21T08:00:47.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:47 smithi191 ceph-mon[34667]: pgmap v692: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T08:00:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:47 smithi162 ceph-mon[34833]: pgmap v692: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T08:00:48.280 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:47 smithi084 ceph-mon[30411]: pgmap v692: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T08:00:49.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:49 smithi191 ceph-mon[34667]: pgmap v693: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T08:00:50.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:49 smithi162 ceph-mon[34833]: pgmap v693: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T08:00:50.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:49 smithi084 ceph-mon[30411]: pgmap v693: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T08:00:51.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:51 smithi162 ceph-mon[34833]: pgmap v694: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-21T08:00:51.858 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:51 smithi084 ceph-mon[30411]: pgmap v694: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-21T08:00:51.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:51 smithi191 ceph-mon[34667]: pgmap v694: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-21T08:00:53.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:53 smithi191 ceph-mon[34667]: pgmap v695: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:00:54.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:53 smithi162 ceph-mon[34833]: pgmap v695: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:00:54.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:53 smithi084 ceph-mon[30411]: pgmap v695: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:00:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:55 smithi191 ceph-mon[34667]: pgmap v696: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T08:00:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:55 smithi162 ceph-mon[34833]: pgmap v696: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T08:00:56.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:55 smithi084 ceph-mon[30411]: pgmap v696: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T08:00:57.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:00:57.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:57 smithi191 ceph-mon[34667]: pgmap v697: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-21T08:00:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:58.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:57 smithi162 ceph-mon[34833]: pgmap v697: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-21T08:00:58.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:57 smithi084 ceph-mon[30411]: pgmap v697: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-21T08:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.749+0000 7f518e600640 1 -- 172.21.15.84:0/493837666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 msgr2=0x7f5188075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.749+0000 7f518e600640 1 --2- 172.21.15.84:0/493837666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f5188075bc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f517c009860 tx=0x7f517c02a340 comp rx=0 tx=0).stop 2024-09-21T08:00:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.750+0000 7f518e600640 1 -- 172.21.15.84:0/493837666 shutdown_connections 2024-09-21T08:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.750+0000 7f518e600640 1 --2- 172.21.15.84:0/493837666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f518810ff10 0x7f5188112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.750+0000 7f518e600640 1 --2- 172.21.15.84:0/493837666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5188076100 0x7f518810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.750+0000 7f518e600640 1 --2- 172.21.15.84:0/493837666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f5188075bc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.750+0000 7f518e600640 1 -- 172.21.15.84:0/493837666 >> 172.21.15.84:0/493837666 conn(0x7f51880ff440 msgr2=0x7f5188101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.750+0000 7f518e600640 1 -- 172.21.15.84:0/493837666 shutdown_connections 2024-09-21T08:00:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.750+0000 7f518e600640 1 -- 172.21.15.84:0/493837666 wait complete. 2024-09-21T08:00:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.751+0000 7f518e600640 1 Processor -- start 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.751+0000 7f518e600640 1 -- start start 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f518819c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518e600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5188076100 0x7f518819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f518810ff10 0x7f51881a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518e600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5188115ac0 con 0x7f51880757b0 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5188115940 con 0x7f518810ff10 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518e600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5188115c40 con 0x7f5188076100 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f518819c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f518819c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44366/0 (socket says 172.21.15.84:44366) 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518d200640 1 -- 172.21.15.84:0/421639682 learned_addr learned my addr 172.21.15.84:0/421639682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f5187e00640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5188076100 0x7f518819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.752+0000 7f518dc00640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f518810ff10 0x7f51881a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518d200640 1 -- 172.21.15.84:0/421639682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5188076100 msgr2=0x7f518819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518d200640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5188076100 0x7f518819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518d200640 1 -- 172.21.15.84:0/421639682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f518810ff10 msgr2=0x7f51881a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518d200640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f518810ff10 0x7f51881a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518d200640 1 -- 172.21.15.84:0/421639682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51881a2420 con 0x7f51880757b0 2024-09-21T08:00:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518d200640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f518819c4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f517c0303f0 tx=0x7f517c032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f5185600640 1 -- 172.21.15.84:0/421639682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c040020 con 0x7f51880757b0 2024-09-21T08:00:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f5185600640 1 -- 172.21.15.84:0/421639682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f517c030dd0 con 0x7f51880757b0 2024-09-21T08:00:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51881a26b0 con 0x7f51880757b0 2024-09-21T08:00:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f5185600640 1 -- 172.21.15.84:0/421639682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c037040 con 0x7f51880757b0 2024-09-21T08:00:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.753+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881a8e70 con 0x7f51880757b0 2024-09-21T08:00:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 Processor -- start 2024-09-21T08:00:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 -- start start 2024-09-21T08:00:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5185600640 1 -- 172.21.15.84:0/421639682 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f517c043020 con 0x7f51880757b0 2024-09-21T08:00:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154982df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154982e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154982e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5615497a4f70 con 0x561549466390 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5615497943a0 con 0x56154945e1b0 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.757+0000 7f5196869740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5615497981b0 con 0x561549487070 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154982df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154982df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36138/0 (socket says 172.21.15.84:36138) 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 -- 172.21.15.84:0/3214604052 learned_addr learned my addr 172.21.15.84:0/3214604052 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518d200640 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154982e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f5187e00640 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154982e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 -- 172.21.15.84:0/3214604052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 msgr2=0x56154982e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154982e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 -- 172.21.15.84:0/3214604052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 msgr2=0x56154982e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154982e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 -- 172.21.15.84:0/3214604052 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154975ec90 con 0x561549487070 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.758+0000 7f518dc00640 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154982df30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5180009fd0 tx=0x7f51800118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ca3486c5542d3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.759+0000 7f5185600640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f51700b6700 0x7f51700b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.759+0000 7f517a000640 1 -- 172.21.15.84:0/3214604052 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180004d20 con 0x561549487070 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.759+0000 7f5185600640 1 -- 172.21.15.84:0/421639682 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f517c1075d0 con 0x7f51880757b0 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.759+0000 7f518d200640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f51700b6700 0x7f51700b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.759+0000 7f517a000640 1 -- 172.21.15.84:0/3214604052 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5180004050 con 0x561549487070 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.759+0000 7f517a000640 1 -- 172.21.15.84:0/3214604052 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180005280 con 0x561549487070 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 -- 172.21.15.84:0/3214604052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 msgr2=0x56154982df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f518d200640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f51700b6700 0x7f51700b8c10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f517c104a40 tx=0x7f517c10d550 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154982df30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5180009fd0 tx=0x7f51800118d0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 -- 172.21.15.84:0/3214604052 shutdown_connections 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154982e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154982e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 --2- 172.21.15.84:0/3214604052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154982df30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 -- 172.21.15.84:0/3214604052 >> 172.21.15.84:0/3214604052 conn(0x56154947b460 msgr2=0x56154982be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 -- 172.21.15.84:0/3214604052 shutdown_connections 2024-09-21T08:00:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.760+0000 7f5196869740 1 -- 172.21.15.84:0/3214604052 wait complete. 2024-09-21T08:00:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 -- start start 2024-09-21T08:00:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 Processor -- start 2024-09-21T08:00:58.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x5615498395d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x561549839b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x561549845a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5615495f5700 con 0x561549466390 2024-09-21T08:00:58.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56154972f540 con 0x56154945e1b0 2024-09-21T08:00:58.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.761+0000 7f5196869740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56154983c760 con 0x561549487070 2024-09-21T08:00:58.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5196869740 10 client.0 _ll_register_callbacks cb 0x56154973f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x561549839b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f518dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x5615498395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x561549839b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44376/0 (socket says 172.21.15.84:44376) 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 -- 172.21.15.84:0/2473218464 learned_addr learned my addr 172.21.15.84:0/2473218464 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f518dc00640 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x561549845a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 -- 172.21.15.84:0/2473218464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 msgr2=0x561549845a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x561549845a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 -- 172.21.15.84:0/2473218464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 msgr2=0x5615498395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x5615498395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f5187e00640 1 -- 172.21.15.84:0/2473218464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615494f2650 con 0x561549466390 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.762+0000 7f518dc00640 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x561549845a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f5187e00640 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x561549839b10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f51740116d0 tx=0x7f5174011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb26daba9b2c0a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f516ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f516ea00640 1 -- 172.21.15.84:0/2473218464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517401e020 con 0x561549466390 2024-09-21T08:00:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561549731b50 con 0x561549466390 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f516ea00640 1 -- 172.21.15.84:0/2473218464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f517400fbf0 con 0x561549466390 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f516ea00640 1 -- 172.21.15.84:0/2473218464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5174026050 con 0x561549466390 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f5196869740 10 client.17583 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56154974c910 con 0x561549466390 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.763+0000 7f516ea00640 1 -- 172.21.15.84:0/2473218464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561549731b50 con 0x561549466390 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f516ea00640 1 -- 172.21.15.84:0/2473218464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5174019070 con 0x561549466390 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f5196869740 10 client.17583 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f5196869740 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f5196869740 20 client.17583 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f5196869740 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5615494459f0 0x56154984b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f5196869740 4 client.17583 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615497a6ec0 con 0x5615494459f0 2024-09-21T08:00:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.764+0000 7f518dc00640 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5615494459f0 0x56154984b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.765+0000 7f518dc00640 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5615494459f0 0x56154984b8d0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9010a795aa945108 server_cookie=9f127f4e728066e7 in_seq=0 out_seq=0 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.765+0000 7f516ea00640 10 client.17583 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f516ea00640 1 -- 172.21.15.84:0/2473218464 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615497a6ec0 con 0x5615494459f0 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f516ea00640 10 client.17583 handle_command_reply: tid=0 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 client.17583 shutdown 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 msgr2=0x561549839b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x561549839b10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f51740116d0 tx=0x7f5174011b90 comp rx=0 tx=0).stop 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 shutdown_connections 2024-09-21T08:00:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5615494459f0 0x56154984b8d0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x561549845a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x561549839b10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 --2- 172.21.15.84:0/2473218464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x5615498395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 >> 172.21.15.84:0/2473218464 conn(0x56154947b460 msgr2=0x5615498310c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f516ea00640 0 client.17583 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 shutdown_connections 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.766+0000 7f5196869740 1 -- 172.21.15.84:0/2473218464 wait complete. 2024-09-21T08:00:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.767+0000 7f5196869740 20 client.17583 trim_cache size 0 max 16384 2024-09-21T08:00:58.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.784+0000 7f5196869740 1 Processor -- start 2024-09-21T08:00:58.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.784+0000 7f5196869740 1 -- start start 2024-09-21T08:00:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f5196869740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56154945e1b0 0x56154983b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f5196869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561549466390 0x56154982b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f5196869740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549487070 0x56154982bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f5196869740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51881b2e20 con 0x561549487070 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f5196869740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51881b4960 con 0x561549466390 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f5196869740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f51881b34f0 con 0x56154945e1b0 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f518dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549487070 0x56154982bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f518dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549487070 0x56154982bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44382/0 (socket says 172.21.15.84:44382) 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f518dc00640 1 -- 172.21.15.84:0/3978595361 learned_addr learned my addr 172.21.15.84:0/3978595361 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f518dc00640 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56154945e1b0 0x56154983b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f5187e00640 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561549466390 0x56154982b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.785+0000 7f518dc00640 1 -- 172.21.15.84:0/3978595361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56154945e1b0 msgr2=0x56154983b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f518dc00640 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56154945e1b0 0x56154983b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f518dc00640 1 -- 172.21.15.84:0/3978595361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561549466390 msgr2=0x56154982b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f518dc00640 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561549466390 0x56154982b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f518dc00640 1 -- 172.21.15.84:0/3978595361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615498483c0 con 0x561549487070 2024-09-21T08:00:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f518dc00640 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549487070 0x56154982bb10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5180009540 tx=0x7f5180005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cc2997fc4f321c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f5179600640 1 -- 172.21.15.84:0/3978595361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180004cc0 con 0x561549487070 2024-09-21T08:00:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f5179600640 1 -- 172.21.15.84:0/3978595361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5180004500 con 0x561549487070 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.786+0000 7f5179600640 1 -- 172.21.15.84:0/3978595361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180005620 con 0x561549487070 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 -- 172.21.15.84:0/3978595361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549487070 msgr2=0x56154982bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549487070 0x56154982bb10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5180009540 tx=0x7f5180005fd0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 -- 172.21.15.84:0/3978595361 shutdown_connections 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549487070 0x56154982bb10 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561549466390 0x56154982b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 --2- 172.21.15.84:0/3978595361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56154945e1b0 0x56154983b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 -- 172.21.15.84:0/3978595361 >> 172.21.15.84:0/3978595361 conn(0x56154947b460 msgr2=0x56154983aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 -- 172.21.15.84:0/3978595361 shutdown_connections 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.787+0000 7f5196869740 1 -- 172.21.15.84:0/3978595361 wait complete. 2024-09-21T08:00:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 -- start start 2024-09-21T08:00:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 Processor -- start 2024-09-21T08:00:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154983daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154983dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154983e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51881b4290 con 0x561549466390 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51881b3bc0 con 0x56154945e1b0 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f51881b0e20 con 0x561549487070 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.788+0000 7f5196869740 10 client.0 _ll_register_callbacks cb 0x7f5174009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154983dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154983dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44386/0 (socket says 172.21.15.84:44386) 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 -- 172.21.15.84:0/3360394587 learned_addr learned my addr 172.21.15.84:0/3360394587 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f518dc00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154983e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f518dc00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154983daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 -- 172.21.15.84:0/3360394587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 msgr2=0x56154983e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154983e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 -- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 msgr2=0x56154983daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154983daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 -- 172.21.15.84:0/3360394587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615498b5320 con 0x561549466390 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f518dc00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154983daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f5187e00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154983dfe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f51740116d0 tx=0x7f5174005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a74e3d836626558 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f516ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.789+0000 7f516ea00640 1 -- 172.21.15.84:0/3360394587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517402e070 con 0x561549466390 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f516ea00640 1 -- 172.21.15.84:0/3360394587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f51740196d0 con 0x561549466390 2024-09-21T08:00:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5180004500 con 0x561549466390 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f516ea00640 1 -- 172.21.15.84:0/3360394587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f517403a050 con 0x561549466390 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f5196869740 10 client.17589 fetch_fsmap learned FSMap version 29 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5615498b65b0 con 0x561549466390 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f516ea00640 1 -- 172.21.15.84:0/3360394587 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5180004500 con 0x561549466390 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f516ea00640 1 -- 172.21.15.84:0/3360394587 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5174019040 con 0x561549466390 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f5196869740 10 client.17589 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.790+0000 7f5196869740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.791+0000 7f5196869740 20 client.17589 populate_metadata read hostname 'smithi084' 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.791+0000 7f5196869740 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56154941ada0 0x5615498b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.791+0000 7f5196869740 4 client.17589 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.791+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5615497a2970 con 0x56154941ada0 2024-09-21T08:00:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.791+0000 7f518dc00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56154941ada0 0x5615498b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:58.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.791+0000 7f518dc00640 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56154941ada0 0x5615498b8da0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb9ae2d09cd9a31b server_cookie=4009273eb1bb9bd9 in_seq=0 out_seq=0 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.791+0000 7f516ea00640 10 client.17589 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f516ea00640 1 -- 172.21.15.84:0/3360394587 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x5615497a2970 con 0x56154941ada0 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f516ea00640 10 client.17589 handle_command_reply: tid=0 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 client.17589 shutdown 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 msgr2=0x56154983dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154983dfe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f51740116d0 tx=0x7f5174005880 comp rx=0 tx=0).stop 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 shutdown_connections 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56154941ada0 0x5615498b8da0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561549487070 0x56154983e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561549466390 0x56154983dfe0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 --2- 172.21.15.84:0/3360394587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56154945e1b0 0x56154983daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f516ea00640 0 client.17589 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:00:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 >> 172.21.15.84:0/3360394587 conn(0x56154947b460 msgr2=0x561549838810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 shutdown_connections 2024-09-21T08:00:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.792+0000 7f5196869740 1 -- 172.21.15.84:0/3360394587 wait complete. 2024-09-21T08:00:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f5196869740 20 client.17589 trim_cache size 0 max 16384 2024-09-21T08:00:58.798 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:00:58.798 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T08:00:58.798 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T08:00:58.798 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "63a41a05-d44f-45b2-983d-1fa6b7559a20": { 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:00:25.066675+0000", 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.799 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.800 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.802 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.803 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.804 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:00:58.805 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f51700b6700 msgr2=0x7f51700b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f51700b6700 0x7f51700b8c10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f517c104a40 tx=0x7f517c10d550 comp rx=0 tx=0).stop 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 msgr2=0x7f518819c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f518819c4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f517c0303f0 tx=0x7f517c032da0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 shutdown_connections 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f51700b6700 0x7f51700b8c10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f518810ff10 0x7f51881a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5188076100 0x7f518819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 --2- 172.21.15.84:0/421639682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51880757b0 0x7f518819c4b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.793+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 >> 172.21.15.84:0/421639682 conn(0x7f51880ff440 msgr2=0x7f5188109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.794+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 shutdown_connections 2024-09-21T08:00:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:00:58.794+0000 7f518e600640 1 -- 172.21.15.84:0/421639682 wait complete. 2024-09-21T08:00:59.760 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:00:59.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:59.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:00:59 smithi191 ceph-mon[34667]: pgmap v698: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T08:01:00.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:00:59 smithi162 ceph-mon[34833]: pgmap v698: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T08:01:00.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:00:59 smithi084 ceph-mon[30411]: pgmap v698: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T08:01:00.132 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:00.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 -- 172.21.15.84:0/3051057403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d94109c40 msgr2=0x7f5d94110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 --2- 172.21.15.84:0/3051057403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d94109c40 0x7f5d94110470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009be0 tx=0x7f5d8c02a6c0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 -- 172.21.15.84:0/3051057403 shutdown_connections 2024-09-21T08:01:00.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 --2- 172.21.15.84:0/3051057403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d94109c40 0x7f5d94110470 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 --2- 172.21.15.84:0/3051057403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941092f0 0x7f5d94109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 --2- 172.21.15.84:0/3051057403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d941039b0 0x7f5d94103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 -- 172.21.15.84:0/3051057403 >> 172.21.15.84:0/3051057403 conn(0x7f5d940ff440 msgr2=0x7f5d94101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:00.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 -- 172.21.15.84:0/3051057403 shutdown_connections 2024-09-21T08:01:00.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.795+0000 7f5d9a200640 1 -- 172.21.15.84:0/3051057403 wait complete. 2024-09-21T08:01:00.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.796+0000 7f5d9a200640 1 Processor -- start 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.796+0000 7f5d9a200640 1 -- start start 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d9a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941039b0 0x7f5d9419c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d9a200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d941092f0 0x7f5d9419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d9a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d94109c40 0x7f5d941a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d9a200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94113900 con 0x7f5d941039b0 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d9a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94113780 con 0x7f5d94109c40 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d9a200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94113a80 con 0x7f5d941092f0 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941039b0 0x7f5d9419c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941039b0 0x7f5d9419c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44404/0 (socket says 172.21.15.84:44404) 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d98e00640 1 -- 172.21.15.84:0/1637542983 learned_addr learned my addr 172.21.15.84:0/1637542983 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d8be00640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d941092f0 0x7f5d9419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.797+0000 7f5d99800640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d94109c40 0x7f5d941a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d98e00640 1 -- 172.21.15.84:0/1637542983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d941092f0 msgr2=0x7f5d9419ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d98e00640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d941092f0 0x7f5d9419ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d98e00640 1 -- 172.21.15.84:0/1637542983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d94109c40 msgr2=0x7f5d941a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d98e00640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d94109c40 0x7f5d941a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d98e00640 1 -- 172.21.15.84:0/1637542983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d941a2420 con 0x7f5d941039b0 2024-09-21T08:01:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d98e00640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941039b0 0x7f5d9419c4b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9f0 tx=0x7f5d8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d92000640 1 -- 172.21.15.84:0/1637542983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400cd80 con 0x7f5d941039b0 2024-09-21T08:01:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d92000640 1 -- 172.21.15.84:0/1637542983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d840054d0 con 0x7f5d941039b0 2024-09-21T08:01:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d941a2710 con 0x7f5d941039b0 2024-09-21T08:01:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d92000640 1 -- 172.21.15.84:0/1637542983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84010690 con 0x7f5d941039b0 2024-09-21T08:01:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.798+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d941a8e70 con 0x7f5d941039b0 2024-09-21T08:01:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.800+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d94103dc0 con 0x7f5d941039b0 2024-09-21T08:01:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.802+0000 7f5d92000640 1 -- 172.21.15.84:0/1637542983 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5d84004e90 con 0x7f5d941039b0 2024-09-21T08:01:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.803+0000 7f5d92000640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d780b6680 0x7f5d780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.803+0000 7f5d92000640 1 -- 172.21.15.84:0/1637542983 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f5d840e7ee0 con 0x7f5d941039b0 2024-09-21T08:01:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.804+0000 7f5d8be00640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d780b6680 0x7f5d780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.804+0000 7f5d8be00640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d780b6680 0x7f5d780b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5d94109ad0 tx=0x7f5d7c009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:00.807+0000 7f5d92000640 1 -- 172.21.15.84:0/1637542983 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d840ae040 con 0x7f5d941039b0 2024-09-21T08:01:01.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.060+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d941a91e0 con 0x7f5d941039b0 2024-09-21T08:01:01.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.060+0000 7f5d92000640 1 -- 172.21.15.84:0/1637542983 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f5d840b2420 con 0x7f5d941039b0 2024-09-21T08:01:01.062 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:01:01.063 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:01:01.063 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:01:01.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d780b6680 msgr2=0x7f5d780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:01.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d780b6680 0x7f5d780b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5d94109ad0 tx=0x7f5d7c009260 comp rx=0 tx=0).stop 2024-09-21T08:01:01.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941039b0 msgr2=0x7f5d9419c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:01.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941039b0 0x7f5d9419c4b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9f0 tx=0x7f5d8400edf0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 shutdown_connections 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5d780b6680 0x7f5d780b8b90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d94109c40 0x7f5d941a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d941092f0 0x7f5d9419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 --2- 172.21.15.84:0/1637542983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d941039b0 0x7f5d9419c4b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 >> 172.21.15.84:0/1637542983 conn(0x7f5d940ff440 msgr2=0x7f5d94106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.063+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 shutdown_connections 2024-09-21T08:01:01.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:01.064+0000 7f5d9a200640 1 -- 172.21.15.84:0/1637542983 wait complete. 2024-09-21T08:01:01.750 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:01 smithi084 ceph-mon[30411]: pgmap v699: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-09-21T08:01:01.751 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:01 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1637542983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:01.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:01 smithi162 ceph-mon[34833]: pgmap v699: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-09-21T08:01:01.802 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:01 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1637542983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:01.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:01 smithi191 ceph-mon[34667]: pgmap v699: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-09-21T08:01:01.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:01 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1637542983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:01.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T08:01:02.302 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 -- 172.21.15.84:0/4293422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda58105d80 msgr2=0x7fda58106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 --2- 172.21.15.84:0/4293422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda58105d80 0x7fda58106190 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fda48009900 tx=0x7fda4802a410 comp rx=0 tx=0).stop 2024-09-21T08:01:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 -- 172.21.15.84:0/4293422919 shutdown_connections 2024-09-21T08:01:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 --2- 172.21.15.84:0/4293422919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5810c010 0x7fda58112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 --2- 172.21.15.84:0/4293422919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5810b6c0 0x7fda5810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 --2- 172.21.15.84:0/4293422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda58105d80 0x7fda58106190 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 -- 172.21.15.84:0/4293422919 >> 172.21.15.84:0/4293422919 conn(0x7fda58101810 msgr2=0x7fda58103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 -- 172.21.15.84:0/4293422919 shutdown_connections 2024-09-21T08:01:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.945+0000 7fda5ca00640 1 -- 172.21.15.84:0/4293422919 wait complete. 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.946+0000 7fda5ca00640 1 Processor -- start 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.946+0000 7fda5ca00640 1 -- start start 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda5ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda58105d80 0x7fda5819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda5ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda5810b6c0 0x7fda5819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda5ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5810c010 0x7fda581a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda5ca00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fda58115cd0 con 0x7fda5810b6c0 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda5ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda58115b50 con 0x7fda58105d80 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda5ca00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fda58115e50 con 0x7fda5810c010 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda55400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda5810b6c0 0x7fda5819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda55e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda58105d80 0x7fda5819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda55e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda58105d80 0x7fda5819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33462/0 (socket says 172.21.15.84:33462) 2024-09-21T08:01:02.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda55e00640 1 -- 172.21.15.84:0/1543775532 learned_addr learned my addr 172.21.15.84:0/1543775532 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:02.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.947+0000 7fda56800640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5810c010 0x7fda581a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda55400640 1 -- 172.21.15.84:0/1543775532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5810c010 msgr2=0x7fda581a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda55400640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5810c010 0x7fda581a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda55400640 1 -- 172.21.15.84:0/1543775532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda58105d80 msgr2=0x7fda5819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda55400640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda58105d80 0x7fda5819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda55400640 1 -- 172.21.15.84:0/1543775532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda581a2650 con 0x7fda5810b6c0 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda55e00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda58105d80 0x7fda5819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda55400640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda5810b6c0 0x7fda5819cc80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fda5806caa0 tx=0x7fda4400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda4ea00640 1 -- 172.21.15.84:0/1543775532 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4400cc40 con 0x7fda5810b6c0 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda4ea00640 1 -- 172.21.15.84:0/1543775532 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda4400cde0 con 0x7fda5810b6c0 2024-09-21T08:01:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda581a2940 con 0x7fda5810b6c0 2024-09-21T08:01:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda4ea00640 1 -- 172.21.15.84:0/1543775532 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44018780 con 0x7fda5810b6c0 2024-09-21T08:01:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.948+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda581a90a0 con 0x7fda5810b6c0 2024-09-21T08:01:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 Processor -- start 2024-09-21T08:01:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 -- start start 2024-09-21T08:01:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda4ea00640 1 -- 172.21.15.84:0/1543775532 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fda44010a90 con 0x7fda5810b6c0 2024-09-21T08:01:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b2488dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244be1b0 0x560b2488e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b2488e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560b24804fb0 con 0x560b244be1b0 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560b247f43e0 con 0x560b244c6390 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.952+0000 7fda6368d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560b247f81f0 con 0x560b244e7070 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda55e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244be1b0 0x560b2488e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda56800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b2488dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda55e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244be1b0 0x560b2488e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44436/0 (socket says 172.21.15.84:44436) 2024-09-21T08:01:02.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda55e00640 1 -- 172.21.15.84:0/1267752107 learned_addr learned my addr 172.21.15.84:0/1267752107 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda55400640 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b2488e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda56800640 1 -- 172.21.15.84:0/1267752107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 msgr2=0x560b2488e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda56800640 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b2488e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda56800640 1 -- 172.21.15.84:0/1267752107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244be1b0 msgr2=0x560b2488e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda56800640 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244be1b0 0x560b2488e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda56800640 1 -- 172.21.15.84:0/1267752107 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b247becd0 con 0x560b244e7070 2024-09-21T08:01:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.953+0000 7fda55e00640 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244be1b0 0x560b2488e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.954+0000 7fda56800640 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b2488dda0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fda50009f00 tx=0x7fda50011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=880abcb8d1af4deb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.954+0000 7fda43000640 1 -- 172.21.15.84:0/1267752107 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50004d20 con 0x560b244e7070 2024-09-21T08:01:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.954+0000 7fda43000640 1 -- 172.21.15.84:0/1267752107 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda50004030 con 0x560b244e7070 2024-09-21T08:01:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.954+0000 7fda43000640 1 -- 172.21.15.84:0/1267752107 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50005260 con 0x560b244e7070 2024-09-21T08:01:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.954+0000 7fda4ea00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda3c0b6680 0x7fda3c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda4ea00640 1 -- 172.21.15.84:0/1543775532 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7fda440e7db0 con 0x7fda5810b6c0 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda55e00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda3c0b6680 0x7fda3c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 -- 172.21.15.84:0/1267752107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 msgr2=0x560b2488dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b2488dda0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fda50009f00 tx=0x7fda50011810 comp rx=0 tx=0).stop 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 -- 172.21.15.84:0/1267752107 shutdown_connections 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b2488e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244be1b0 0x560b2488e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 --2- 172.21.15.84:0/1267752107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b2488dda0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 -- 172.21.15.84:0/1267752107 >> 172.21.15.84:0/1267752107 conn(0x560b244db460 msgr2=0x560b2488bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.955+0000 7fda6368d740 1 -- 172.21.15.84:0/1267752107 shutdown_connections 2024-09-21T08:01:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.956+0000 7fda6368d740 1 -- 172.21.15.84:0/1267752107 wait complete. 2024-09-21T08:01:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.956+0000 7fda55e00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda3c0b6680 0x7fda3c0b8b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x560b2488ca20 tx=0x7fda480058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.956+0000 7fda6368d740 1 -- start start 2024-09-21T08:01:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.956+0000 7fda6368d740 1 Processor -- start 2024-09-21T08:01:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda6368d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b24899450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda6368d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b24899990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda6368d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b248a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda6368d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560b24655700 con 0x560b244e7070 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda6368d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560b2478f580 con 0x560b244c6390 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda6368d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560b2489c580 con 0x560b244be1b0 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda6368d740 10 client.0 _ll_register_callbacks cb 0x560b2479f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda55e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b24899450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda55e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b24899450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36218/0 (socket says 172.21.15.84:36218) 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda55e00640 1 -- 172.21.15.84:0/3783772980 learned_addr learned my addr 172.21.15.84:0/3783772980 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda56800640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b248a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.957+0000 7fda55400640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b24899990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda56800640 1 -- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 msgr2=0x560b24899450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda56800640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b24899450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda56800640 1 -- 172.21.15.84:0/3783772980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 msgr2=0x560b24899990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda56800640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b24899990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda56800640 1 -- 172.21.15.84:0/3783772980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b24552650 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda55400640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b24899990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda55e00640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b24899450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda56800640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b248a5870 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fda50009270 tx=0x7fda50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874d2d2c9a6f2ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.958+0000 7fda37400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda37400640 1 -- 172.21.15.84:0/3783772980 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50027020 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda37400640 1 -- 172.21.15.84:0/3783772980 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7fda50005390 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b24791b90 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda37400640 1 -- 172.21.15.84:0/3783772980 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda50032050 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda6368d740 10 client.17607 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b247ac950 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda37400640 1 -- 172.21.15.84:0/3783772980 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560b24791b90 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda37400640 1 -- 172.21.15.84:0/3783772980 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fda50018070 con 0x560b244e7070 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda6368d740 10 client.17607 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.959+0000 7fda6368d740 10 client.17607 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:01:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.960+0000 7fda6368d740 20 client.17607 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:02.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.960+0000 7fda6368d740 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b244a59f0 0x560b248ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.960+0000 7fda6368d740 4 client.17607 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:02.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.960+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b24806f00 con 0x560b244a59f0 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.960+0000 7fda55e00640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b244a59f0 0x560b248ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.961+0000 7fda55e00640 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b244a59f0 0x560b248ab4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c32c892ab513be79 server_cookie=3657897a80a827f3 in_seq=0 out_seq=0 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.961+0000 7fda37400640 10 client.17607 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda37400640 1 -- 172.21.15.84:0/3783772980 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b24806f00 con 0x560b244a59f0 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda37400640 10 client.17607 handle_command_reply: tid=0 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 client.17607 shutdown 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 msgr2=0x560b248a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b248a5870 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fda50009270 tx=0x7fda50009c00 comp rx=0 tx=0).stop 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 shutdown_connections 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b244a59f0 0x560b248ab4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b248a5870 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b24899990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 --2- 172.21.15.84:0/3783772980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b24899450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 >> 172.21.15.84:0/3783772980 conn(0x560b244db460 msgr2=0x560b24890f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda37400640 0 client.17607 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 shutdown_connections 2024-09-21T08:01:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.962+0000 7fda6368d740 1 -- 172.21.15.84:0/3783772980 wait complete. 2024-09-21T08:01:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.963+0000 7fda6368d740 20 client.17607 trim_cache size 0 max 16384 2024-09-21T08:01:02.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.976+0000 7fda6368d740 1 Processor -- start 2024-09-21T08:01:02.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.976+0000 7fda6368d740 1 -- start start 2024-09-21T08:01:02.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda6368d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244be1b0 0x560b2488ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda6368d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244c6390 0x560b2489b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda6368d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b248a5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda6368d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fda581b3060 con 0x560b244c6390 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda6368d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda581b4ba0 con 0x560b244be1b0 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda6368d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fda581b3730 con 0x560b244e7070 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244c6390 0x560b2489b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244c6390 0x560b2489b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44448/0 (socket says 172.21.15.84:44448) 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 -- 172.21.15.84:0/3908506909 learned_addr learned my addr 172.21.15.84:0/3908506909 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda56800640 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b248a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55e00640 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244be1b0 0x560b2488ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 -- 172.21.15.84:0/3908506909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 msgr2=0x560b248a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b248a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 -- 172.21.15.84:0/3908506909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244be1b0 msgr2=0x560b2488ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244be1b0 0x560b2488ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.977+0000 7fda55400640 1 -- 172.21.15.84:0/3908506909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b2489a710 con 0x560b244c6390 2024-09-21T08:01:02.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.978+0000 7fda55400640 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244c6390 0x560b2489b080 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fda440e8050 tx=0x7fda4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91286fd926eec02a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.978+0000 7fda42600640 1 -- 172.21.15.84:0/3908506909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda440e55a0 con 0x560b244c6390 2024-09-21T08:01:02.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.978+0000 7fda42600640 1 -- 172.21.15.84:0/3908506909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda440ad3d0 con 0x560b244c6390 2024-09-21T08:01:02.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.978+0000 7fda42600640 1 -- 172.21.15.84:0/3908506909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda440b3800 con 0x560b244c6390 2024-09-21T08:01:02.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 -- 172.21.15.84:0/3908506909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244c6390 msgr2=0x560b2489b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244c6390 0x560b2489b080 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fda440e8050 tx=0x7fda4400cf90 comp rx=0 tx=0).stop 2024-09-21T08:01:02.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 -- 172.21.15.84:0/3908506909 shutdown_connections 2024-09-21T08:01:02.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244e7070 0x560b248a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244c6390 0x560b2489b080 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 --2- 172.21.15.84:0/3908506909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244be1b0 0x560b2488ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 -- 172.21.15.84:0/3908506909 >> 172.21.15.84:0/3908506909 conn(0x560b244db460 msgr2=0x560b2489a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 -- 172.21.15.84:0/3908506909 shutdown_connections 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 -- 172.21.15.84:0/3908506909 wait complete. 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.979+0000 7fda6368d740 1 -- start start 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 1 Processor -- start 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b248a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b248a2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b24896050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fda581b44d0 con 0x560b244e7070 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda581b3e00 con 0x560b244c6390 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fda581b1060 con 0x560b244be1b0 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda6368d740 10 client.0 _ll_register_callbacks cb 0x7fda50004e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda56800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b24896050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda55e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b248a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda56800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b24896050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44456/0 (socket says 172.21.15.84:44456) 2024-09-21T08:01:02.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda56800640 1 -- 172.21.15.84:0/2168190655 learned_addr learned my addr 172.21.15.84:0/2168190655 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:02.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.980+0000 7fda55400640 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b248a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda55e00640 1 -- 172.21.15.84:0/2168190655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 msgr2=0x560b248a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda55e00640 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b248a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda55e00640 1 -- 172.21.15.84:0/2168190655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 msgr2=0x560b24896050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda55e00640 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b24896050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda55e00640 1 -- 172.21.15.84:0/2168190655 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b248967c0 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda56800640 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b24896050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda55e00640 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b248a1c00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fda48031440 tx=0x7fda48009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3812f1c467322d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.981+0000 7fda37400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.982+0000 7fda37400640 1 -- 172.21.15.84:0/2168190655 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48043070 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.982+0000 7fda37400640 1 -- 172.21.15.84:0/2168190655 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7fda48004450 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.982+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda440ad3d0 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.982+0000 7fda37400640 1 -- 172.21.15.84:0/2168190655 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda48035040 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.982+0000 7fda6368d740 10 client.27991 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.982+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560b248a1350 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.982+0000 7fda37400640 1 -- 172.21.15.84:0/2168190655 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda440ad3d0 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda37400640 1 -- 172.21.15.84:0/2168190655 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fda48003960 con 0x560b244be1b0 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda6368d740 10 client.27991 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda6368d740 10 client.27991 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:01:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda6368d740 20 client.27991 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda6368d740 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b2447ada0 0x560b24918090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda6368d740 4 client.27991 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b248029b0 con 0x560b2447ada0 2024-09-21T08:01:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.983+0000 7fda55400640 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b2447ada0 0x560b24918090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda55400640 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b2447ada0 0x560b24918090 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f3ccc7b5c367a8d3 server_cookie=e0eaa54d966e29bf in_seq=0 out_seq=0 2024-09-21T08:01:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda37400640 10 client.27991 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda37400640 1 -- 172.21.15.84:0/2168190655 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b248029b0 con 0x560b2447ada0 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda37400640 10 client.27991 handle_command_reply: tid=0 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 client.27991 shutdown 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 msgr2=0x560b248a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b248a1c00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fda48031440 tx=0x7fda48009260 comp rx=0 tx=0).stop 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 shutdown_connections 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560b2447ada0 0x560b24918090 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560b244e7070 0x560b24896050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b244c6390 0x560b248a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 --2- 172.21.15.84:0/2168190655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b244be1b0 0x560b248a1c00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 >> 172.21.15.84:0/2168190655 conn(0x560b244db460 msgr2=0x560b2488a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda37400640 0 client.27991 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 shutdown_connections 2024-09-21T08:01:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.984+0000 7fda6368d740 1 -- 172.21.15.84:0/2168190655 wait complete. 2024-09-21T08:01:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda6368d740 20 client.27991 trim_cache size 0 max 16384 2024-09-21T08:01:02.989 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda3c0b6680 msgr2=0x7fda3c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda3c0b6680 0x7fda3c0b8b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x560b2488ca20 tx=0x7fda480058d0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda5810b6c0 msgr2=0x7fda5819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda5810b6c0 0x7fda5819cc80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fda5806caa0 tx=0x7fda4400ee50 comp rx=0 tx=0).stop 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 shutdown_connections 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fda3c0b6680 0x7fda3c0b8b90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5810c010 0x7fda581a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda5810b6c0 0x7fda5819cc80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 --2- 172.21.15.84:0/1543775532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda58105d80 0x7fda5819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 >> 172.21.15.84:0/1543775532 conn(0x7fda58101810 msgr2=0x7fda58103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:02.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.985+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 shutdown_connections 2024-09-21T08:01:02.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:02.986+0000 7fda5ca00640 1 -- 172.21.15.84:0/1543775532 wait complete. 2024-09-21T08:01:03.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:03 smithi084 ceph-mon[30411]: pgmap v700: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:03.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:03 smithi191 ceph-mon[34667]: pgmap v700: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:04.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:03 smithi162 ceph-mon[34833]: pgmap v700: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:04.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T08:01:04.486 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:04.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:01:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:01:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:01:04.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:01:04.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:05.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:01:05.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:05.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:05.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:05.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:05.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:01:05.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:01:05.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:01:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 -- 172.21.15.84:0/1614053373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 msgr2=0x7f34cc1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 --2- 172.21.15.84:0/1614053373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 0x7f34cc1098e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009900 tx=0x7f34b802a410 comp rx=0 tx=0).stop 2024-09-21T08:01:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 -- 172.21.15.84:0/1614053373 shutdown_connections 2024-09-21T08:01:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 --2- 172.21.15.84:0/1614053373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc109e20 0x7f34cc110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 --2- 172.21.15.84:0/1614053373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 0x7f34cc1098e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 --2- 172.21.15.84:0/1614053373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34cc103b90 0x7f34cc103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 -- 172.21.15.84:0/1614053373 >> 172.21.15.84:0/1614053373 conn(0x7f34cc0ff600 msgr2=0x7f34cc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 -- 172.21.15.84:0/1614053373 shutdown_connections 2024-09-21T08:01:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.089+0000 7f34d2400640 1 -- 172.21.15.84:0/1614053373 wait complete. 2024-09-21T08:01:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.090+0000 7f34d2400640 1 Processor -- start 2024-09-21T08:01:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.090+0000 7f34d2400640 1 -- start start 2024-09-21T08:01:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34d2400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34cc103b90 0x7f34cc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34d2400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 0x7f34cc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34d2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc109e20 0x7f34cc19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34d2400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc113b20 con 0x7f34cc1094d0 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34d2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1139a0 con 0x7f34cc109e20 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34d2400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc113ca0 con 0x7f34cc103b90 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 0x7f34cc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34cb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34cc103b90 0x7f34cc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 0x7f34cc19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44482/0 (socket says 172.21.15.84:44482) 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34caa00640 1 -- 172.21.15.84:0/236786276 learned_addr learned my addr 172.21.15.84:0/236786276 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34cbe00640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc109e20 0x7f34cc19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34cb400640 1 -- 172.21.15.84:0/236786276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc109e20 msgr2=0x7f34cc19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34cb400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc109e20 0x7f34cc19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34cb400640 1 -- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 msgr2=0x7f34cc19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.091+0000 7f34cb400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 0x7f34cc19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34cb400640 1 -- 172.21.15.84:0/236786276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc1a04a0 con 0x7f34cc103b90 2024-09-21T08:01:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34cbe00640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc109e20 0x7f34cc19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34cb400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34cc103b90 0x7f34cc19a530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d720 tx=0x7f34bc00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34c3e00640 1 -- 172.21.15.84:0/236786276 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc017070 con 0x7f34cc103b90 2024-09-21T08:01:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34c3e00640 1 -- 172.21.15.84:0/236786276 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34bc00de30 con 0x7f34cc103b90 2024-09-21T08:01:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc1a0790 con 0x7f34cc103b90 2024-09-21T08:01:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34c3e00640 1 -- 172.21.15.84:0/236786276 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0047a0 con 0x7f34cc103b90 2024-09-21T08:01:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.092+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc1a6ef0 con 0x7f34cc103b90 2024-09-21T08:01:05.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.096+0000 7f34d9046740 1 Processor -- start 2024-09-21T08:01:05.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.096+0000 7f34d9046740 1 -- start start 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34d9046740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f7d070 0x56435a323da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34d9046740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f541b0 0x56435a3242e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34d9046740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a324820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34d9046740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56435a29afb0 con 0x564359f5c390 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34d9046740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56435a28a3e0 con 0x564359f541b0 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34d9046740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56435a28e1f0 con 0x564359f7d070 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a324820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a324820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44486/0 (socket says 172.21.15.84:44486) 2024-09-21T08:01:05.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34caa00640 1 -- 172.21.15.84:0/3109089077 learned_addr learned my addr 172.21.15.84:0/3109089077 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:05.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34cbe00640 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f7d070 0x56435a323da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.097+0000 7f34c3e00640 1 -- 172.21.15.84:0/236786276 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f34bc0099d0 con 0x7f34cc103b90 2024-09-21T08:01:05.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34cbe00640 1 -- 172.21.15.84:0/3109089077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f541b0 msgr2=0x56435a3242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34cbe00640 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f541b0 0x56435a3242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34cbe00640 1 -- 172.21.15.84:0/3109089077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 msgr2=0x56435a324820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34cbe00640 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a324820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34cbe00640 1 -- 172.21.15.84:0/3109089077 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435a254cd0 con 0x564359f7d070 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34cbe00640 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f7d070 0x56435a323da0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009ee0 tx=0x7f34c400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f31e441ec4288c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34c0c00640 1 -- 172.21.15.84:0/3109089077 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c401a070 con 0x564359f7d070 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34c0c00640 1 -- 172.21.15.84:0/3109089077 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34c40158c0 con 0x564359f7d070 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.098+0000 7f34c0c00640 1 -- 172.21.15.84:0/3109089077 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c400a930 con 0x564359f7d070 2024-09-21T08:01:05.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.099+0000 7f34c3e00640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34b00b6700 0x7f34b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.099+0000 7f34c3e00640 1 -- 172.21.15.84:0/236786276 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f34bc0e7730 con 0x7f34cc103b90 2024-09-21T08:01:05.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.099+0000 7f34d9046740 1 -- 172.21.15.84:0/3109089077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f7d070 msgr2=0x56435a323da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.099+0000 7f34d9046740 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f7d070 0x56435a323da0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009ee0 tx=0x7f34c400c7f0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.099+0000 7f34cb400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34b00b6700 0x7f34b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 -- 172.21.15.84:0/3109089077 shutdown_connections 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a324820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f541b0 0x56435a3242e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 --2- 172.21.15.84:0/3109089077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f7d070 0x56435a323da0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 -- 172.21.15.84:0/3109089077 >> 172.21.15.84:0/3109089077 conn(0x564359f71460 msgr2=0x56435a321c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 -- 172.21.15.84:0/3109089077 shutdown_connections 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 -- 172.21.15.84:0/3109089077 wait complete. 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34cb400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34b00b6700 0x7f34b00b8c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x56435a322a20 tx=0x7f34bc005bf0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.100+0000 7f34d9046740 1 -- start start 2024-09-21T08:01:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 1 Processor -- start 2024-09-21T08:01:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a32f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a32f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f7d070 0x56435a33b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56435a0eb700 con 0x564359f5c390 2024-09-21T08:01:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56435a225580 con 0x564359f7d070 2024-09-21T08:01:05.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56435a332580 con 0x564359f541b0 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34d9046740 10 client.0 _ll_register_callbacks cb 0x56435a235470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a32f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34cbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a32f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a32f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44496/0 (socket says 172.21.15.84:44496) 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.101+0000 7f34caa00640 1 -- 172.21.15.84:0/2490014105 learned_addr learned my addr 172.21.15.84:0/2490014105 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34cbe00640 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f7d070 0x56435a33b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34caa00640 1 -- 172.21.15.84:0/2490014105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 msgr2=0x56435a32f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34caa00640 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a32f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34caa00640 1 -- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f7d070 msgr2=0x56435a33b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34caa00640 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f7d070 0x56435a33b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34caa00640 1 -- 172.21.15.84:0/2490014105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564359fe8650 con 0x564359f5c390 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34cbe00640 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f7d070 0x56435a33b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34caa00640 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a32f9d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f34b80316d0 tx=0x7f34b8031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f8c675a97da92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:05.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34b5600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.102+0000 7f34b5600640 1 -- 172.21.15.84:0/2490014105 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8035040 con 0x564359f5c390 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34b5600640 1 -- 172.21.15.84:0/2490014105 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f34b8005040 con 0x564359f5c390 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56435a227b90 con 0x564359f5c390 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34b5600640 1 -- 172.21.15.84:0/2490014105 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f34b8005240 con 0x564359f5c390 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34d9046740 10 client.17625 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56435a242950 con 0x564359f5c390 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34b5600640 1 -- 172.21.15.84:0/2490014105 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56435a227b90 con 0x564359f5c390 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34b5600640 1 -- 172.21.15.84:0/2490014105 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f34b8046510 con 0x564359f5c390 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34d9046740 10 client.17625 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34d9046740 10 client.17625 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34d9046740 20 client.17625 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.103+0000 7f34d9046740 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f3b9f0 0x56435a341670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.104+0000 7f34d9046740 4 client.17625 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:05.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.104+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56435a29cf00 con 0x564359f3b9f0 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.104+0000 7f34cbe00640 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f3b9f0 0x56435a341670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.104+0000 7f34cbe00640 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f3b9f0 0x56435a341670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ccaec8d09b6e3b8 server_cookie=27258e5188af8383 in_seq=0 out_seq=0 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.104+0000 7f34b5600640 10 client.17625 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.105+0000 7f34b5600640 1 -- 172.21.15.84:0/2490014105 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56435a29cf00 con 0x564359f3b9f0 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.105+0000 7f34b5600640 10 client.17625 handle_command_reply: tid=0 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.105+0000 7f34d9046740 1 client.17625 shutdown 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 msgr2=0x56435a32f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a32f9d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f34b80316d0 tx=0x7f34b8031700 comp rx=0 tx=0).stop 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 shutdown_connections 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f3b9f0 0x56435a341670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f7d070 0x56435a33b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a32f9d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 --2- 172.21.15.84:0/2490014105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a32f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 >> 172.21.15.84:0/2490014105 conn(0x564359f71460 msgr2=0x56435a326f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:05.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34b5600640 0 client.17625 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:05.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 shutdown_connections 2024-09-21T08:01:05.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 1 -- 172.21.15.84:0/2490014105 wait complete. 2024-09-21T08:01:05.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.106+0000 7f34d9046740 20 client.17625 trim_cache size 0 max 16384 2024-09-21T08:01:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 Processor -- start 2024-09-21T08:01:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 -- start start 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3275b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a33b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a3215d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1b0e50 con 0x564359f5c390 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1b2990 con 0x564359f71460 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.120+0000 7f34d9046740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1b1520 con 0x564359f541b0 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a3215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a3215d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44502/0 (socket says 172.21.15.84:44502) 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34cbe00640 1 -- 172.21.15.84:0/3318013347 learned_addr learned my addr 172.21.15.84:0/3318013347 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34caa00640 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a33b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34cbe00640 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3275b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34caa00640 1 -- 172.21.15.84:0/3318013347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 msgr2=0x56435a3275b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34caa00640 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3275b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34caa00640 1 -- 172.21.15.84:0/3318013347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 msgr2=0x56435a3215d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34caa00640 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a3215d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34caa00640 1 -- 172.21.15.84:0/3318013347 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435a326c00 con 0x564359f541b0 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.121+0000 7f34cbe00640 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a3215d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.122+0000 7f34caa00640 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a33b7a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34b8031440 tx=0x7f34b8005f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=546ab78802c50280 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.122+0000 7f34b7e00640 1 -- 172.21.15.84:0/3318013347 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8035030 con 0x564359f541b0 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.122+0000 7f34b7e00640 1 -- 172.21.15.84:0/3318013347 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34b8046ab0 con 0x564359f541b0 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.122+0000 7f34b7e00640 1 -- 172.21.15.84:0/3318013347 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8046480 con 0x564359f541b0 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 -- 172.21.15.84:0/3318013347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 msgr2=0x56435a33b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a33b7a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34b8031440 tx=0x7f34b8005f30 comp rx=0 tx=0).stop 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 -- 172.21.15.84:0/3318013347 shutdown_connections 2024-09-21T08:01:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a3215d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a33b7a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 --2- 172.21.15.84:0/3318013347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3275b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 -- 172.21.15.84:0/3318013347 >> 172.21.15.84:0/3318013347 conn(0x56435a3419b0 msgr2=0x56435a326ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:05.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 -- 172.21.15.84:0/3318013347 shutdown_connections 2024-09-21T08:01:05.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 -- 172.21.15.84:0/3318013347 wait complete. 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.123+0000 7f34d9046740 1 -- start start 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 1 Processor -- start 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a333b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a334090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3ab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1b22c0 con 0x564359f5c390 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1b1bf0 con 0x564359f71460 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1aee50 con 0x564359f541b0 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34d9046740 10 client.0 _ll_register_callbacks cb 0x7f34b8031db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a334090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a334090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44510/0 (socket says 172.21.15.84:44510) 2024-09-21T08:01:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34cbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a333b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.124+0000 7f34caa00640 1 -- 172.21.15.84:0/134245663 learned_addr learned my addr 172.21.15.84:0/134245663 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34cbe00640 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34caa00640 1 -- 172.21.15.84:0/134245663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 msgr2=0x56435a333b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34caa00640 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a333b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34caa00640 1 -- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 msgr2=0x56435a3ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34caa00640 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34caa00640 1 -- 172.21.15.84:0/134245663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435a3ab590 con 0x564359f5c390 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34caa00640 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a334090 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f34b8046a00 tx=0x7f34b80056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616b5c061921165 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34b5600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34b5600640 1 -- 172.21.15.84:0/134245663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8046680 con 0x564359f5c390 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34b5600640 1 -- 172.21.15.84:0/134245663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f34b8004020 con 0x564359f5c390 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.125+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34b8046ab0 con 0x564359f5c390 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34b5600640 1 -- 172.21.15.84:0/134245663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f34b806b050 con 0x564359f5c390 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 10 client.17631 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56435a3ac650 con 0x564359f5c390 2024-09-21T08:01:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34b5600640 1 -- 172.21.15.84:0/134245663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34b8046ab0 con 0x564359f5c390 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34b5600640 1 -- 172.21.15.84:0/134245663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f34b80046c0 con 0x564359f5c390 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 10 client.17631 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 10 client.17631 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 20 client.17631 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f7d070 0x56435a3aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 4 client.17631 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.126+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56435a2989b0 con 0x564359f7d070 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.127+0000 7f34cbe00640 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f7d070 0x56435a3aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.127+0000 7f34cbe00640 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f7d070 0x56435a3aeda0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2ef1b2e6406a1bef server_cookie=3502e939503090cc in_seq=0 out_seq=0 2024-09-21T08:01:05.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.127+0000 7f34b5600640 10 client.17631 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34b5600640 1 -- 172.21.15.84:0/134245663 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56435a2989b0 con 0x564359f7d070 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34b5600640 10 client.17631 handle_command_reply: tid=0 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 client.17631 shutdown 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 msgr2=0x56435a334090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a334090 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f34b8046a00 tx=0x7f34b80056b0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 shutdown_connections 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x564359f7d070 0x56435a3aeda0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564359f71460 0x56435a3ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564359f5c390 0x56435a334090 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 --2- 172.21.15.84:0/134245663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564359f541b0 0x56435a333b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 >> 172.21.15.84:0/134245663 conn(0x56435a3419b0 msgr2=0x56435a3215d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34b5600640 0 client.17631 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 shutdown_connections 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 1 -- 172.21.15.84:0/134245663 wait complete. 2024-09-21T08:01:05.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.128+0000 7f34d9046740 20 client.17631 trim_cache size 0 max 16384 2024-09-21T08:01:05.134 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:05.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34b00b6700 msgr2=0x7f34b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34b00b6700 0x7f34b00b8c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x56435a322a20 tx=0x7f34bc005bf0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34cc103b90 msgr2=0x7f34cc19a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34cc103b90 0x7f34cc19a530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d720 tx=0x7f34bc00dbe0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 shutdown_connections 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34b00b6700 0x7f34b00b8c10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc109e20 0x7f34cc19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34cc1094d0 0x7f34cc19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 --2- 172.21.15.84:0/236786276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34cc103b90 0x7f34cc19a530 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 >> 172.21.15.84:0/236786276 conn(0x7f34cc0ff600 msgr2=0x7f34cc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 shutdown_connections 2024-09-21T08:01:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:05.129+0000 7f34d2400640 1 -- 172.21.15.84:0/236786276 wait complete. 2024-09-21T08:01:05.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:05 smithi084 ceph-mon[30411]: pgmap v701: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:01:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:05 smithi191 ceph-mon[34667]: pgmap v701: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:01:06.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T08:01:06.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:05 smithi162 ceph-mon[34833]: pgmap v701: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:01:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 -- 172.21.15.84:0/2219579446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964114740 msgr2=0x7f4964116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 --2- 172.21.15.84:0/2219579446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964114740 0x7f4964116b60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f495c009ca0 tx=0x7f495c02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 -- 172.21.15.84:0/2219579446 shutdown_connections 2024-09-21T08:01:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 --2- 172.21.15.84:0/2219579446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964114740 0x7f4964116b60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 --2- 172.21.15.84:0/2219579446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4964078290 0x7f4964114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 --2- 172.21.15.84:0/2219579446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4964077940 0x7f4964077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 -- 172.21.15.84:0/2219579446 >> 172.21.15.84:0/2219579446 conn(0x7f49641017d0 msgr2=0x7f4964103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 -- 172.21.15.84:0/2219579446 shutdown_connections 2024-09-21T08:01:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.040+0000 7f496ba00640 1 -- 172.21.15.84:0/2219579446 wait complete. 2024-09-21T08:01:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.041+0000 7f496ba00640 1 Processor -- start 2024-09-21T08:01:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.041+0000 7f496ba00640 1 -- start start 2024-09-21T08:01:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f496ba00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4964077940 0x7f49641a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f496ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964078290 0x7f49641a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f496ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4964114740 0x7f49641a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f496ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f496411a0d0 con 0x7f4964078290 2024-09-21T08:01:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f496ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4964119f50 con 0x7f4964114740 2024-09-21T08:01:07.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f496ba00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f496411a250 con 0x7f4964077940 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f4963e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964078290 0x7f49641a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f4963e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964078290 0x7f49641a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44532/0 (socket says 172.21.15.84:44532) 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f4963e00640 1 -- 172.21.15.84:0/1881732843 learned_addr learned my addr 172.21.15.84:0/1881732843 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f4969000640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4964077940 0x7f49641a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.042+0000 7f4969a00640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4964114740 0x7f49641a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4969000640 1 -- 172.21.15.84:0/1881732843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4964114740 msgr2=0x7f49641a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4969000640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4964114740 0x7f49641a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4969000640 1 -- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964078290 msgr2=0x7f49641a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4969000640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964078290 0x7f49641a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4969000640 1 -- 172.21.15.84:0/1881732843 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49641a69d0 con 0x7f4964077940 2024-09-21T08:01:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4969000640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4964077940 0x7f49641a0a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f495400e9f0 tx=0x7f495400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4961600640 1 -- 172.21.15.84:0/1881732843 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495400ccc0 con 0x7f4964077940 2024-09-21T08:01:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49641a6cc0 con 0x7f4964077940 2024-09-21T08:01:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4961600640 1 -- 172.21.15.84:0/1881732843 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49540108e0 con 0x7f4964077940 2024-09-21T08:01:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f4961600640 1 -- 172.21.15.84:0/1881732843 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4954018880 con 0x7f4964077940 2024-09-21T08:01:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.043+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49641ad420 con 0x7f4964077940 2024-09-21T08:01:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.046+0000 7f49727fc740 1 Processor -- start 2024-09-21T08:01:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f49727fc740 1 -- start start 2024-09-21T08:01:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f49727fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed4387070 0x559ed472dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f49727fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed435e1b0 0x559ed472e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f49727fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed472e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f49727fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559ed46a4fb0 con 0x559ed4366390 2024-09-21T08:01:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f49727fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559ed46943e0 con 0x559ed4387070 2024-09-21T08:01:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f49727fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ed46981f0 con 0x559ed435e1b0 2024-09-21T08:01:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f4961600640 1 -- 172.21.15.84:0/1881732843 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4954010430 con 0x7f4964077940 2024-09-21T08:01:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f4963e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed472e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f4969a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed4387070 0x559ed472dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f4963e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed472e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44540/0 (socket says 172.21.15.84:44540) 2024-09-21T08:01:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.047+0000 7f4963e00640 1 -- 172.21.15.84:0/2057906061 learned_addr learned my addr 172.21.15.84:0/2057906061 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f4969000640 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed435e1b0 0x559ed472e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f4969a00640 1 -- 172.21.15.84:0/2057906061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed435e1b0 msgr2=0x559ed472e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f4969a00640 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed435e1b0 0x559ed472e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f4969a00640 1 -- 172.21.15.84:0/2057906061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 msgr2=0x559ed472e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f4969a00640 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed472e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f4969a00640 1 -- 172.21.15.84:0/2057906061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed465ecd0 con 0x559ed4387070 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f4969a00640 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed4387070 0x559ed472dda0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f495c005e30 tx=0x7f495c02f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c90d7a66049d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.048+0000 7f495a000640 1 -- 172.21.15.84:0/2057906061 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c031cf0 con 0x559ed4387070 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f495a000640 1 -- 172.21.15.84:0/2057906061 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495c036030 con 0x559ed4387070 2024-09-21T08:01:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f495a000640 1 -- 172.21.15.84:0/2057906061 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c004040 con 0x559ed4387070 2024-09-21T08:01:07.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f4961600640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f49480b6680 0x7f49480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f49727fc740 1 -- 172.21.15.84:0/2057906061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed4387070 msgr2=0x559ed472dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f49727fc740 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed4387070 0x559ed472dda0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f495c005e30 tx=0x7f495c02f410 comp rx=0 tx=0).stop 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f4961600640 1 -- 172.21.15.84:0/1881732843 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f49540e7e40 con 0x7f4964077940 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f4969000640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f49480b6680 0x7f49480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.049+0000 7f49727fc740 1 -- 172.21.15.84:0/2057906061 shutdown_connections 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f49727fc740 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed472e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f49727fc740 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed435e1b0 0x559ed472e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f49727fc740 1 --2- 172.21.15.84:0/2057906061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed4387070 0x559ed472dda0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f49727fc740 1 -- 172.21.15.84:0/2057906061 >> 172.21.15.84:0/2057906061 conn(0x559ed437b460 msgr2=0x559ed472bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f49727fc740 1 -- 172.21.15.84:0/2057906061 shutdown_connections 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f49727fc740 1 -- 172.21.15.84:0/2057906061 wait complete. 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f4969000640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f49480b6680 0x7f49480b8b90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x559ed472ca20 tx=0x7f4954009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.050+0000 7f49727fc740 1 -- start start 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 1 Processor -- start 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed4739540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4366390 0x559ed4739a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4387070 0x559ed4745690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559ed44f5700 con 0x559ed4387070 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559ed462f580 con 0x559ed435e1b0 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ed473c3a0 con 0x559ed4366390 2024-09-21T08:01:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f49727fc740 10 client.0 _ll_register_callbacks cb 0x559ed463f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.051+0000 7f4963e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4366390 0x559ed4739a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4366390 0x559ed4739a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:36342/0 (socket says 172.21.15.84:36342) 2024-09-21T08:01:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 -- 172.21.15.84:0/1948185398 learned_addr learned my addr 172.21.15.84:0/1948185398 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4969a00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed4739540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4969a00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4387070 0x559ed4745690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 -- 172.21.15.84:0/1948185398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 msgr2=0x559ed4739540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed4739540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 -- 172.21.15.84:0/1948185398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4387070 msgr2=0x559ed4745690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4387070 0x559ed4745690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 -- 172.21.15.84:0/1948185398 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed43f2650 con 0x559ed4366390 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4969a00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4387070 0x559ed4745690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f4963e00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4366390 0x559ed4739a80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49500127f0 tx=0x7f4950012cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a174177b13956d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.052+0000 7f494ea00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f494ea00640 1 -- 172.21.15.84:0/1948185398 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495000f920 con 0x559ed4366390 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ed4631b90 con 0x559ed4366390 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f494ea00640 1 -- 172.21.15.84:0/1948185398 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f495000fac0 con 0x559ed4366390 2024-09-21T08:01:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f494ea00640 1 -- 172.21.15.84:0/1948185398 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f495000fd00 con 0x559ed4366390 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f49727fc740 10 client.28021 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ed464c950 con 0x559ed4366390 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f494ea00640 1 -- 172.21.15.84:0/1948185398 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559ed4631b90 con 0x559ed4366390 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.053+0000 7f494ea00640 1 -- 172.21.15.84:0/1948185398 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f495001c420 con 0x559ed4366390 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.054+0000 7f49727fc740 10 client.28021 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.054+0000 7f49727fc740 10 client.28021 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.054+0000 7f49727fc740 20 client.28021 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.054+0000 7f49727fc740 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed43459f0 0x559ed474b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.054+0000 7f49727fc740 4 client.28021 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.054+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ed46a6f00 con 0x559ed43459f0 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.054+0000 7f4969a00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed43459f0 0x559ed474b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.055+0000 7f4969a00640 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed43459f0 0x559ed474b640 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9dda1b0c3ce5a4a server_cookie=452fefc1078c5e5b in_seq=0 out_seq=0 2024-09-21T08:01:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.055+0000 7f494ea00640 10 client.28021 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f494ea00640 1 -- 172.21.15.84:0/1948185398 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ed46a6f00 con 0x559ed43459f0 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f494ea00640 10 client.28021 handle_command_reply: tid=0 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 client.28021 shutdown 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4366390 msgr2=0x559ed4739a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4366390 0x559ed4739a80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49500127f0 tx=0x7f4950012cb0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 shutdown_connections 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed43459f0 0x559ed474b640 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4387070 0x559ed4745690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4366390 0x559ed4739a80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 --2- 172.21.15.84:0/1948185398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed4739540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f494ea00640 0 client.28021 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 >> 172.21.15.84:0/1948185398 conn(0x559ed437b460 msgr2=0x559ed4730f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 shutdown_connections 2024-09-21T08:01:07.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 1 -- 172.21.15.84:0/1948185398 wait complete. 2024-09-21T08:01:07.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.056+0000 7f49727fc740 20 client.28021 trim_cache size 0 max 16384 2024-09-21T08:01:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 Processor -- start 2024-09-21T08:01:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 -- start start 2024-09-21T08:01:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed47315b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed4745590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed4745ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f49641b7360 con 0x559ed4366390 2024-09-21T08:01:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49641b8ea0 con 0x559ed435e1b0 2024-09-21T08:01:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.070+0000 7f49727fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49641b7a30 con 0x559ed4387070 2024-09-21T08:01:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed4745590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed4745590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44556/0 (socket says 172.21.15.84:44556) 2024-09-21T08:01:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 -- 172.21.15.84:0/2329231802 learned_addr learned my addr 172.21.15.84:0/2329231802 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4969a00640 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed4745ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4969a00640 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed47315b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 -- 172.21.15.84:0/2329231802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 msgr2=0x559ed4745ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed4745ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 -- 172.21.15.84:0/2329231802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 msgr2=0x559ed47315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed47315b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.071+0000 7f4963e00640 1 -- 172.21.15.84:0/2329231802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed4730090 con 0x559ed4366390 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.072+0000 7f4963e00640 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed4745590 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4950012560 tx=0x7f495000ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6238ad15e4f5b5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.072+0000 7f4959600640 1 -- 172.21.15.84:0/2329231802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495002f070 con 0x559ed4366390 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.072+0000 7f4959600640 1 -- 172.21.15.84:0/2329231802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495001cb00 con 0x559ed4366390 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.072+0000 7f4959600640 1 -- 172.21.15.84:0/2329231802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495002a8f0 con 0x559ed4366390 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 -- 172.21.15.84:0/2329231802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 msgr2=0x559ed4745590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed4745590 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4950012560 tx=0x7f495000ff20 comp rx=0 tx=0).stop 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 -- 172.21.15.84:0/2329231802 shutdown_connections 2024-09-21T08:01:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed4745ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed4745590 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 --2- 172.21.15.84:0/2329231802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed47315b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 -- 172.21.15.84:0/2329231802 >> 172.21.15.84:0/2329231802 conn(0x559ed437b460 msgr2=0x559ed4730ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 -- 172.21.15.84:0/2329231802 shutdown_connections 2024-09-21T08:01:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 -- 172.21.15.84:0/2329231802 wait complete. 2024-09-21T08:01:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.073+0000 7f49727fc740 1 -- start start 2024-09-21T08:01:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 1 Processor -- start 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed473da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed473dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed47b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f49641b87d0 con 0x559ed4366390 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49641b8100 con 0x559ed435e1b0 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49641b5360 con 0x559ed4387070 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f49727fc740 10 client.0 _ll_register_callbacks cb 0x7f4950012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f4963e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed473dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f4969a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed473da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f4969a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed473da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:33594/0 (socket says 172.21.15.84:33594) 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f4969a00640 1 -- 172.21.15.84:0/4091964154 learned_addr learned my addr 172.21.15.84:0/4091964154 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.074+0000 7f4969a00640 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed47b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f4969a00640 1 -- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 msgr2=0x559ed47b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f4969a00640 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed47b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f4969a00640 1 -- 172.21.15.84:0/4091964154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 msgr2=0x559ed473dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f4969a00640 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed473dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f4969a00640 1 -- 172.21.15.84:0/4091964154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed47b5560 con 0x559ed435e1b0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f4963e00640 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed473dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f4969a00640 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed473da20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f495c02ade0 tx=0x7f495c02f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff1035b706630bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.075+0000 7f494ea00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f494ea00640 1 -- 172.21.15.84:0/4091964154 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c04a040 con 0x559ed435e1b0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f495001cb00 con 0x559ed435e1b0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f494ea00640 1 -- 172.21.15.84:0/4091964154 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9432+0+0 (secure 0 0 0) 0x7f495c032e40 con 0x559ed435e1b0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f494ea00640 1 -- 172.21.15.84:0/4091964154 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f495c031450 con 0x559ed435e1b0 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 10 client.28004 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ed47b6740 con 0x559ed435e1b0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f494ea00640 1 -- 172.21.15.84:0/4091964154 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495001cb00 con 0x559ed435e1b0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f494ea00640 1 -- 172.21.15.84:0/4091964154 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f495c050040 con 0x559ed435e1b0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 10 client.28004 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 10 client.28004 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 20 client.28004 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed431ada0 0x559ed47b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 4 client.28004 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.076+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559ed46a29b0 con 0x559ed431ada0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.077+0000 7f4963e00640 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed431ada0 0x559ed47b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.077+0000 7f4963e00640 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed431ada0 0x559ed47b8ba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83bf5322fcdb43cd server_cookie=93657c0f89d42db7 in_seq=0 out_seq=0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.077+0000 7f494ea00640 10 client.28004 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f494ea00640 1 -- 172.21.15.84:0/4091964154 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559ed46a29b0 con 0x559ed431ada0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f494ea00640 10 client.28004 handle_command_reply: tid=0 2024-09-21T08:01:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 client.28004 shutdown 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 msgr2=0x559ed473da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed473da20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f495c02ade0 tx=0x7f495c02f410 comp rx=0 tx=0).stop 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 shutdown_connections 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x559ed431ada0 0x559ed47b8ba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ed4387070 0x559ed47b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ed4366390 0x559ed473dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 --2- 172.21.15.84:0/4091964154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ed435e1b0 0x559ed473da20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f494ea00640 0 client.28004 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 >> 172.21.15.84:0/4091964154 conn(0x559ed437b460 msgr2=0x559ed472edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 shutdown_connections 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 1 -- 172.21.15.84:0/4091964154 wait complete. 2024-09-21T08:01:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.078+0000 7f49727fc740 20 client.28004 trim_cache size 0 max 16384 2024-09-21T08:01:07.086 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f49480b6680 msgr2=0x7f49480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f49480b6680 0x7f49480b8b90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x559ed472ca20 tx=0x7f4954009700 comp rx=0 tx=0).stop 2024-09-21T08:01:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4964077940 msgr2=0x7f49641a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4964077940 0x7f49641a0a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f495400e9f0 tx=0x7f495400eeb0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 shutdown_connections 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f49480b6680 0x7f49480b8b90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4964114740 0x7f49641a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4964078290 0x7f49641a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 --2- 172.21.15.84:0/1881732843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4964077940 0x7f49641a0a60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 >> 172.21.15.84:0/1881732843 conn(0x7f49641017d0 msgr2=0x7f4964116790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 shutdown_connections 2024-09-21T08:01:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:07.079+0000 7f496ba00640 1 -- 172.21.15.84:0/1881732843 wait complete. 2024-09-21T08:01:07.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:07 smithi084 ceph-mon[30411]: pgmap v702: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:01:07.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T08:01:07.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:07 smithi191 ceph-mon[34667]: pgmap v702: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:01:08.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:07 smithi162 ceph-mon[34833]: pgmap v702: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-21T08:01:08.218 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.975+0000 7fca76400640 1 -- 172.21.15.84:0/1334294040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092f0 msgr2=0x7fca70109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.975+0000 7fca76400640 1 --2- 172.21.15.84:0/1334294040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092f0 0x7fca70109700 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fca60009ca0 tx=0x7fca6002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.975+0000 7fca76400640 1 -- 172.21.15.84:0/1334294040 shutdown_connections 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.975+0000 7fca76400640 1 --2- 172.21.15.84:0/1334294040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca70109c40 0x7fca70110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.975+0000 7fca76400640 1 --2- 172.21.15.84:0/1334294040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca701092f0 0x7fca70109700 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.975+0000 7fca76400640 1 --2- 172.21.15.84:0/1334294040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701039b0 0x7fca70103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.975+0000 7fca76400640 1 -- 172.21.15.84:0/1334294040 >> 172.21.15.84:0/1334294040 conn(0x7fca700ff440 msgr2=0x7fca70101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.977+0000 7fca76400640 1 -- 172.21.15.84:0/1334294040 shutdown_connections 2024-09-21T08:01:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.977+0000 7fca76400640 1 -- 172.21.15.84:0/1334294040 wait complete. 2024-09-21T08:01:08.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.978+0000 7fca76400640 1 Processor -- start 2024-09-21T08:01:08.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.979+0000 7fca76400640 1 -- start start 2024-09-21T08:01:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.980+0000 7fca76400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca701039b0 0x7fca70198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.981+0000 7fca76400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701092f0 0x7fca70199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.981+0000 7fca76400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca70109c40 0x7fca7019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.981+0000 7fca75000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca701039b0 0x7fca70198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.981+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701092f0 0x7fca70199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.981+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701092f0 0x7fca70199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52298/0 (socket says 172.21.15.84:52298) 2024-09-21T08:01:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.982+0000 7fca6fe00640 1 -- 172.21.15.84:0/947167710 learned_addr learned my addr 172.21.15.84:0/947167710 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.982+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca70113950 con 0x7fca701039b0 2024-09-21T08:01:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.983+0000 7fca75a00640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca70109c40 0x7fca7019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.983+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca701137d0 con 0x7fca701092f0 2024-09-21T08:01:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.983+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca70113ad0 con 0x7fca70109c40 2024-09-21T08:01:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.984+0000 7fca75000640 1 -- 172.21.15.84:0/947167710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca70109c40 msgr2=0x7fca7019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.984+0000 7fca75000640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca70109c40 0x7fca7019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.984+0000 7fca75000640 1 -- 172.21.15.84:0/947167710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701092f0 msgr2=0x7fca70199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:08.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.984+0000 7fca75000640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701092f0 0x7fca70199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:08.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.985+0000 7fca75000640 1 -- 172.21.15.84:0/947167710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca701a0360 con 0x7fca701039b0 2024-09-21T08:01:08.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.987+0000 7fca75000640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca701039b0 0x7fca70198dc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fca58005fd0 tx=0x7fca5800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.988+0000 7fca6d600640 1 -- 172.21.15.84:0/947167710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58009c30 con 0x7fca701039b0 2024-09-21T08:01:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.988+0000 7fca6d600640 1 -- 172.21.15.84:0/947167710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca58009dd0 con 0x7fca701039b0 2024-09-21T08:01:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.988+0000 7fca6d600640 1 -- 172.21.15.84:0/947167710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58003e20 con 0x7fca701039b0 2024-09-21T08:01:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.988+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca701a0650 con 0x7fca701039b0 2024-09-21T08:01:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.988+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca701a0be0 con 0x7fca701039b0 2024-09-21T08:01:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.993+0000 7fca7e5f3740 1 Processor -- start 2024-09-21T08:01:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.994+0000 7fca7e5f3740 1 -- start start 2024-09-21T08:01:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.995+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f83f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.995+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f844b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.996+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f849f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.996+0000 7fca75a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f83f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.996+0000 7fca75a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f83f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60120/0 (socket says 172.21.15.84:60120) 2024-09-21T08:01:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.996+0000 7fca75a00640 1 -- 172.21.15.84:0/145771665 learned_addr learned my addr 172.21.15.84:0/145771665 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.996+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555611efafb0 con 0x555611bb41b0 2024-09-21T08:01:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.996+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555611eea3e0 con 0x555611bbc390 2024-09-21T08:01:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.996+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555611eee1f0 con 0x555611bdd070 2024-09-21T08:01:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.997+0000 7fca6d600640 1 -- 172.21.15.84:0/947167710 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fca58004000 con 0x7fca701039b0 2024-09-21T08:01:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.997+0000 7fca6fe00640 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f849f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.997+0000 7fca75a00640 1 -- 172.21.15.84:0/145771665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 msgr2=0x555611f849f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.997+0000 7fca75a00640 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f849f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.997+0000 7fca75a00640 1 -- 172.21.15.84:0/145771665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 msgr2=0x555611f844b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.997+0000 7fca75000640 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.998+0000 7fca75a00640 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f844b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.998+0000 7fca75a00640 1 -- 172.21.15.84:0/145771665 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555611eb4cd0 con 0x555611bdd070 2024-09-21T08:01:09.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.998+0000 7fca75000640 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f844b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:09.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:08.999+0000 7fca6d600640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b6700 0x7fca540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.000+0000 7fca6d600640 1 -- 172.21.15.84:0/947167710 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7fca580e7770 con 0x7fca701039b0 2024-09-21T08:01:09.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.000+0000 7fca75000640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b6700 0x7fca540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.000+0000 7fca75a00640 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f83f70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fca6800dbb0 tx=0x7fca6800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0205f435a1d83ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.001+0000 7fca66000640 1 -- 172.21.15.84:0/145771665 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6800dea0 con 0x555611bdd070 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.001+0000 7fca66000640 1 -- 172.21.15.84:0/145771665 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca680035f0 con 0x555611bdd070 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.001+0000 7fca66000640 1 -- 172.21.15.84:0/145771665 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68011660 con 0x555611bdd070 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.003+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 msgr2=0x555611f83f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.003+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f83f70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fca6800dbb0 tx=0x7fca6800f730 comp rx=0 tx=0).stop 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.002+0000 7fca75000640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b6700 0x7fca540b8c10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x555611f82bf0 tx=0x7fca580b6040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.003+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 shutdown_connections 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.003+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f849f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.003+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f844b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.003+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/145771665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f83f70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.003+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 >> 172.21.15.84:0/145771665 conn(0x555611bd1460 msgr2=0x555611f81e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:09.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.004+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 shutdown_connections 2024-09-21T08:01:09.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.004+0000 7fca7e5f3740 1 -- 172.21.15.84:0/145771665 wait complete. 2024-09-21T08:01:09.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.006+0000 7fca7e5f3740 1 -- start start 2024-09-21T08:01:09.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.006+0000 7fca7e5f3740 1 Processor -- start 2024-09-21T08:01:09.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.007+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bb41b0 0x555611f8f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.008+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bbc390 0x555611f8fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.010+0000 7fca75a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bb41b0 0x555611f8f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.012+0000 7fca75a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bb41b0 0x555611f8f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52330/0 (socket says 172.21.15.84:52330) 2024-09-21T08:01:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.012+0000 7fca75a00640 1 -- 172.21.15.84:0/2884453278 learned_addr learned my addr 172.21.15.84:0/2884453278 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.012+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f9bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.012+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555611d4b700 con 0x555611bbc390 2024-09-21T08:01:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.012+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555611e85580 con 0x555611bb41b0 2024-09-21T08:01:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.012+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555611f927a0 con 0x555611bdd070 2024-09-21T08:01:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.012+0000 7fca7e5f3740 10 client.0 _ll_register_callbacks cb 0x555611e95470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.013+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bbc390 0x555611f8fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.014+0000 7fca6fe00640 1 -- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 msgr2=0x555611f9bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.014+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f9bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.014+0000 7fca6fe00640 1 -- 172.21.15.84:0/2884453278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bb41b0 msgr2=0x555611f8f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.014+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bb41b0 0x555611f8f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.014+0000 7fca6fe00640 1 -- 172.21.15.84:0/2884453278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555611c48650 con 0x555611bbc390 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.015+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bbc390 0x555611f8fbf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fca70108d10 tx=0x7fca60031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54de0115a2bbae5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.015+0000 7fca5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.015+0000 7fca5ea00640 1 -- 172.21.15.84:0/2884453278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60003970 con 0x555611bbc390 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.015+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555611e87b90 con 0x555611bbc390 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.017+0000 7fca5ea00640 1 -- 172.21.15.84:0/2884453278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7fca60003b10 con 0x555611bbc390 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.018+0000 7fca5ea00640 1 -- 172.21.15.84:0/2884453278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca60003d10 con 0x555611bbc390 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.018+0000 7fca7e5f3740 10 client.17658 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.018+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555611ea2950 con 0x555611bbc390 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca5ea00640 1 -- 172.21.15.84:0/2884453278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555611e87b90 con 0x555611bbc390 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca5ea00640 1 -- 172.21.15.84:0/2884453278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fca6002f960 con 0x555611bbc390 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca7e5f3740 10 client.17658 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca7e5f3740 10 client.17658 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca7e5f3740 20 client.17658 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b9b9f0 0x555611fa17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca7e5f3740 4 client.17658 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.019+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555611efcf00 con 0x555611b9b9f0 2024-09-21T08:01:09.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.020+0000 7fca75a00640 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b9b9f0 0x555611fa17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.025+0000 7fca5ea00640 10 client.17658 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.025+0000 7fca75a00640 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b9b9f0 0x555611fa17e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=84af4ddc8f86aae2 server_cookie=4ea73749cda230ab in_seq=0 out_seq=0 2024-09-21T08:01:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.026+0000 7fca5ea00640 1 -- 172.21.15.84:0/2884453278 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555611efcf00 con 0x555611b9b9f0 2024-09-21T08:01:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.026+0000 7fca5ea00640 10 client.17658 handle_command_reply: tid=0 2024-09-21T08:01:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.026+0000 7fca7e5f3740 1 client.17658 shutdown 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bbc390 msgr2=0x555611f8fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bbc390 0x555611f8fbf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fca70108d10 tx=0x7fca60031450 comp rx=0 tx=0).stop 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 shutdown_connections 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b9b9f0 0x555611fa17e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x555611f9bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bbc390 0x555611f8fbf0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca5ea00640 0 client.17658 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2884453278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bb41b0 0x555611f8f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.027+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 >> 172.21.15.84:0/2884453278 conn(0x555611bd1460 msgr2=0x555611f87100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.028+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 shutdown_connections 2024-09-21T08:01:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.028+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2884453278 wait complete. 2024-09-21T08:01:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.029+0000 7fca7e5f3740 20 client.17658 trim_cache size 0 max 16384 2024-09-21T08:01:09.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.056+0000 7fca7e5f3740 1 Processor -- start 2024-09-21T08:01:09.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.057+0000 7fca7e5f3740 1 -- start start 2024-09-21T08:01:09.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.057+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bb41b0 0x555611f85960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.057+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f90bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.057+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bdd070 0x555611f9ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.057+0000 7fca7e5f3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca701bfc90 con 0x555611bdd070 2024-09-21T08:01:09.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.057+0000 7fca7e5f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca701c17d0 con 0x555611bbc390 2024-09-21T08:01:09.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.057+0000 7fca7e5f3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca701c0360 con 0x555611bb41b0 2024-09-21T08:01:09.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f90bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca75a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bb41b0 0x555611f85960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f90bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52332/0 (socket says 172.21.15.84:52332) 2024-09-21T08:01:09.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca6fe00640 1 -- 172.21.15.84:0/2789583989 learned_addr learned my addr 172.21.15.84:0/2789583989 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:09.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca6fe00640 1 -- 172.21.15.84:0/2789583989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bb41b0 msgr2=0x555611f85960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bb41b0 0x555611f85960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca6fe00640 1 -- 172.21.15.84:0/2789583989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bdd070 msgr2=0x555611f9ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.058+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bdd070 0x555611f9ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.059+0000 7fca6fe00640 1 -- 172.21.15.84:0/2789583989 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555611f91a80 con 0x555611bbc390 2024-09-21T08:01:09.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.059+0000 7fca75a00640 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bb41b0 0x555611f85960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:09.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.060+0000 7fca6fe00640 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f90bd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fca60002230 tx=0x7fca60031540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c580f90996bb3453 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:09.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.064+0000 7fca65600640 1 -- 172.21.15.84:0/2789583989 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60003970 con 0x555611bbc390 2024-09-21T08:01:09.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.064+0000 7fca65600640 1 -- 172.21.15.84:0/2789583989 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca60055070 con 0x555611bbc390 2024-09-21T08:01:09.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.064+0000 7fca65600640 1 -- 172.21.15.84:0/2789583989 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600307d0 con 0x555611bbc390 2024-09-21T08:01:09.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.065+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2789583989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 msgr2=0x555611f90bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:09.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.065+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f90bd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fca60002230 tx=0x7fca60031540 comp rx=0 tx=0).stop 2024-09-21T08:01:09.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.066+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2789583989 shutdown_connections 2024-09-21T08:01:09.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.066+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bdd070 0x555611f9ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.066+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f90bd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.066+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/2789583989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bb41b0 0x555611f85960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.066+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2789583989 >> 172.21.15.84:0/2789583989 conn(0x555611bd1460 msgr2=0x555611f8df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:09.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.066+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2789583989 shutdown_connections 2024-09-21T08:01:09.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.066+0000 7fca7e5f3740 1 -- 172.21.15.84:0/2789583989 wait complete. 2024-09-21T08:01:09.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.067+0000 7fca7e5f3740 1 -- start start 2024-09-21T08:01:09.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.067+0000 7fca7e5f3740 1 Processor -- start 2024-09-21T08:01:09.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.068+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f93d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.068+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f94250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.069+0000 7fca7e5f3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x55561200b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.069+0000 7fca7e5f3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca701c1100 con 0x555611bb41b0 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.069+0000 7fca7e5f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca701c0a30 con 0x555611bbc390 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.069+0000 7fca7e5f3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca701bdc70 con 0x555611bdd070 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.069+0000 7fca7e5f3740 10 client.0 _ll_register_callbacks cb 0x7fca6002f3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.069+0000 7fca75a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f93d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.072+0000 7fca75a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f93d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50494/0 (socket says 172.21.15.84:50494) 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.072+0000 7fca75a00640 1 -- 172.21.15.84:0/3289161246 learned_addr learned my addr 172.21.15.84:0/3289161246 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:09.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.069+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f94250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.073+0000 7fca75a00640 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x55561200b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.075+0000 7fca75a00640 1 -- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 msgr2=0x55561200b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.075+0000 7fca75a00640 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x55561200b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.075+0000 7fca75a00640 1 -- 172.21.15.84:0/3289161246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 msgr2=0x555611f94250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.075+0000 7fca75a00640 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f94250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.075+0000 7fca75a00640 1 -- 172.21.15.84:0/3289161246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555611f94a60 con 0x555611bb41b0 2024-09-21T08:01:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.075+0000 7fca6fe00640 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f94250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.076+0000 7fca75a00640 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f93d10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fca68005b90 tx=0x7fca6800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1930b05f327b303 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:09.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.076+0000 7fca5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:09.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.077+0000 7fca5ea00640 1 -- 172.21.15.84:0/3289161246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68005210 con 0x555611bb41b0 2024-09-21T08:01:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.077+0000 7fca5ea00640 1 -- 172.21.15.84:0/3289161246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7fca680053b0 con 0x555611bb41b0 2024-09-21T08:01:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.077+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca60055070 con 0x555611bb41b0 2024-09-21T08:01:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.077+0000 7fca5ea00640 1 -- 172.21.15.84:0/3289161246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca680055b0 con 0x555611bb41b0 2024-09-21T08:01:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.077+0000 7fca7e5f3740 10 client.17661 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.077+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55561200c650 con 0x555611bb41b0 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca5ea00640 1 -- 172.21.15.84:0/3289161246 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca60055070 con 0x555611bb41b0 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca5ea00640 1 -- 172.21.15.84:0/3289161246 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fca680287c0 con 0x555611bb41b0 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca7e5f3740 10 client.17661 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca7e5f3740 10 client.17661 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca7e5f3740 20 client.17661 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b70da0 0x55561200ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca7e5f3740 4 client.17661 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.079+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555611ef89b0 con 0x555611b70da0 2024-09-21T08:01:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.080+0000 7fca6fe00640 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b70da0 0x55561200ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.082+0000 7fca6fe00640 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b70da0 0x55561200ebe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f86eb667f75bc307 server_cookie=c7a73626470e7644 in_seq=0 out_seq=0 2024-09-21T08:01:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.082+0000 7fca5ea00640 10 client.17661 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.082+0000 7fca5ea00640 1 -- 172.21.15.84:0/3289161246 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555611ef89b0 con 0x555611b70da0 2024-09-21T08:01:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.082+0000 7fca5ea00640 10 client.17661 handle_command_reply: tid=0 2024-09-21T08:01:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.082+0000 7fca7e5f3740 1 client.17661 shutdown 2024-09-21T08:01:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 msgr2=0x555611f93d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f93d10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fca68005b90 tx=0x7fca6800ddc0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 shutdown_connections 2024-09-21T08:01:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x555611b70da0 0x55561200ebe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555611bdd070 0x55561200b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555611bbc390 0x555611f94250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca5ea00640 0 client.17661 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 --2- 172.21.15.84:0/3289161246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555611bb41b0 0x555611f93d10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 >> 172.21.15.84:0/3289161246 conn(0x555611bd1460 msgr2=0x555611f85730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 shutdown_connections 2024-09-21T08:01:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 1 -- 172.21.15.84:0/3289161246 wait complete. 2024-09-21T08:01:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.083+0000 7fca7e5f3740 20 client.17661 trim_cache size 0 max 16384 2024-09-21T08:01:09.086 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.084+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b6700 msgr2=0x7fca540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.084+0000 7fca76400640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b6700 0x7fca540b8c10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x555611f82bf0 tx=0x7fca580b6040 comp rx=0 tx=0).stop 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca701039b0 msgr2=0x7fca70198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca701039b0 0x7fca70198dc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fca58005fd0 tx=0x7fca5800dde0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 shutdown_connections 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fca540b6700 0x7fca540b8c10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca70109c40 0x7fca7019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701092f0 0x7fca70199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 --2- 172.21.15.84:0/947167710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca701039b0 0x7fca70198dc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 >> 172.21.15.84:0/947167710 conn(0x7fca700ff440 msgr2=0x7fca700ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 shutdown_connections 2024-09-21T08:01:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:09.085+0000 7fca76400640 1 -- 172.21.15.84:0/947167710 wait complete. 2024-09-21T08:01:09.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:09 smithi084 ceph-mon[30411]: pgmap v703: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T08:01:09.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:09 smithi084 ceph-mon[30411]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T08:01:09.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:09 smithi191 ceph-mon[34667]: pgmap v703: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T08:01:09.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:09 smithi191 ceph-mon[34667]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T08:01:09.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:01:10.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:09 smithi162 ceph-mon[34833]: pgmap v703: 129 pgs: 129 active+clean; 43 GiB data, 92 GiB used, 981 GiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T08:01:10.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:09 smithi162 ceph-mon[34833]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T08:01:10.584 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:11.799 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:11 smithi084 ceph-mon[30411]: pgmap v705: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 42 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.795+0000 7f4592c00640 1 -- 172.21.15.84:0/3098415377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 msgr2=0x7f458c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.795+0000 7f4592c00640 1 --2- 172.21.15.84:0/3098415377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 0x7f458c105fd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4584009ca0 tx=0x7f458402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.797+0000 7f4592c00640 1 -- 172.21.15.84:0/3098415377 shutdown_connections 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.797+0000 7f4592c00640 1 --2- 172.21.15.84:0/3098415377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c10be50 0x7f458c112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.797+0000 7f4592c00640 1 --2- 172.21.15.84:0/3098415377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 0x7f458c10b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.797+0000 7f4592c00640 1 --2- 172.21.15.84:0/3098415377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 0x7f458c105fd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.797+0000 7f4592c00640 1 -- 172.21.15.84:0/3098415377 >> 172.21.15.84:0/3098415377 conn(0x7f458c101630 msgr2=0x7f458c103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.797+0000 7f4592c00640 1 -- 172.21.15.84:0/3098415377 shutdown_connections 2024-09-21T08:01:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.798+0000 7f4592c00640 1 -- 172.21.15.84:0/3098415377 wait complete. 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.799+0000 7f4592c00640 1 Processor -- start 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.799+0000 7f4592c00640 1 -- start start 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.800+0000 7f4592c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 0x7f458c07b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.800+0000 7f4592c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 0x7f458c077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.800+0000 7f4592c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c10be50 0x7f458c078040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.800+0000 7f4592c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f458c115b60 con 0x7f458c10b500 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.800+0000 7f4592c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1159e0 con 0x7f458c10be50 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.800+0000 7f4592c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f458c115ce0 con 0x7f458c105bc0 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.800+0000 7f4590e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 0x7f458c077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4591800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 0x7f458c07b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4590e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 0x7f458c077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50514/0 (socket says 172.21.15.84:50514) 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4590e00640 1 -- 172.21.15.84:0/3389498212 learned_addr learned my addr 172.21.15.84:0/3389498212 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4592200640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c10be50 0x7f458c078040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4592200640 1 -- 172.21.15.84:0/3389498212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 msgr2=0x7f458c07b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4592200640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 0x7f458c07b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4592200640 1 -- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 msgr2=0x7f458c077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4592200640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 0x7f458c077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.801+0000 7f4592200640 1 -- 172.21.15.84:0/3389498212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c19c220 con 0x7f458c10be50 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.802+0000 7f4590e00640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 0x7f458c077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.802+0000 7f4591800640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 0x7f458c07b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.802+0000 7f4592200640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c10be50 0x7f458c078040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f457c00d680 tx=0x7f457c00db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.803+0000 7f458a000640 1 -- 172.21.15.84:0/3389498212 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c017070 con 0x7f458c10be50 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.803+0000 7f458a000640 1 -- 172.21.15.84:0/3389498212 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f457c009820 con 0x7f458c10be50 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.803+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c19c510 con 0x7f458c10be50 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.803+0000 7f458a000640 1 -- 172.21.15.84:0/3389498212 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c004ce0 con 0x7f458c10be50 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.804+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c19ca50 con 0x7f458c10be50 2024-09-21T08:01:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.809+0000 7f458a000640 1 -- 172.21.15.84:0/3389498212 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f457c0099d0 con 0x7f458c10be50 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.811+0000 7f458a000640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f45740b6700 0x7f45740b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.812+0000 7f458a000640 1 -- 172.21.15.84:0/3389498212 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f457c0e6bc0 con 0x7f458c10be50 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.812+0000 7f4591800640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f45740b6700 0x7f45740b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.813+0000 7f459ae76740 1 Processor -- start 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.813+0000 7f459ae76740 1 -- start start 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f459ae76740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c9e070 0x555eb4044f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f459ae76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb40454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f459ae76740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb40459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f4591800640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f45740b6700 0x7f45740b8c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4584000f80 tx=0x7f45840099c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f4590e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb40454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f4590e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb40454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60166/0 (socket says 172.21.15.84:60166) 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f459ae76740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555eb3fbbfb0 con 0x555eb3c7d390 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f459ae76740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555eb3fab3e0 con 0x555eb3c9e070 2024-09-21T08:01:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f459ae76740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555eb3faf1f0 con 0x555eb3c751b0 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.814+0000 7f4590e00640 1 -- 172.21.15.84:0/2444799508 learned_addr learned my addr 172.21.15.84:0/2444799508 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.815+0000 7f4592200640 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb40459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.815+0000 7f4590e00640 1 -- 172.21.15.84:0/2444799508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c9e070 msgr2=0x555eb4044f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.815+0000 7f4590e00640 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c9e070 0x555eb4044f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.815+0000 7f4590e00640 1 -- 172.21.15.84:0/2444799508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 msgr2=0x555eb40459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.815+0000 7f4590e00640 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb40459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.815+0000 7f4590e00640 1 -- 172.21.15.84:0/2444799508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb3f75cd0 con 0x555eb3c751b0 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.815+0000 7f4592200640 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb40459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.816+0000 7f4590e00640 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb40454b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4580008c70 tx=0x7f458000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e5187c17c0bb05f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.816+0000 7f457aa00640 1 -- 172.21.15.84:0/2444799508 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580014070 con 0x555eb3c751b0 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.816+0000 7f457aa00640 1 -- 172.21.15.84:0/2444799508 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45800047a0 con 0x555eb3c751b0 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.818+0000 7f459ae76740 1 -- 172.21.15.84:0/2444799508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 msgr2=0x555eb40454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.818+0000 7f459ae76740 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb40454b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4580008c70 tx=0x7f458000e720 comp rx=0 tx=0).stop 2024-09-21T08:01:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.820+0000 7f459ae76740 1 -- 172.21.15.84:0/2444799508 shutdown_connections 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.820+0000 7f459ae76740 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb40459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.820+0000 7f459ae76740 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb40454b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.820+0000 7f459ae76740 1 --2- 172.21.15.84:0/2444799508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c9e070 0x555eb4044f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.820+0000 7f459ae76740 1 -- 172.21.15.84:0/2444799508 >> 172.21.15.84:0/2444799508 conn(0x555eb3c92460 msgr2=0x555eb4042e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.820+0000 7f459ae76740 1 -- 172.21.15.84:0/2444799508 shutdown_connections 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.821+0000 7f459ae76740 1 -- 172.21.15.84:0/2444799508 wait complete. 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.821+0000 7f459ae76740 1 -- start start 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.822+0000 7f459ae76740 1 Processor -- start 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.823+0000 7f459ae76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb4050630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.823+0000 7f459ae76740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4050b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f4590e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4050b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f4590e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4050b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52372/0 (socket says 172.21.15.84:52372) 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f4590e00640 1 -- 172.21.15.84:0/3458562974 learned_addr learned my addr 172.21.15.84:0/3458562974 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f4591800640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb4050630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f459ae76740 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c9e070 0x555eb405cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555eb3e0c700 con 0x555eb3c9e070 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555eb3f46580 con 0x555eb3c7d390 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555eb40537f0 con 0x555eb3c751b0 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.824+0000 7f459ae76740 10 client.0 _ll_register_callbacks cb 0x555eb3f56470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.825+0000 7f4590e00640 1 -- 172.21.15.84:0/3458562974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 msgr2=0x555eb4050630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.825+0000 7f4590e00640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb4050630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.825+0000 7f4590e00640 1 -- 172.21.15.84:0/3458562974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c9e070 msgr2=0x555eb405cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.825+0000 7f4592200640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c9e070 0x555eb405cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.825+0000 7f4590e00640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c9e070 0x555eb405cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.825+0000 7f4590e00640 1 -- 172.21.15.84:0/3458562974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb3d09650 con 0x555eb3c7d390 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.825+0000 7f4592200640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c9e070 0x555eb405cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.826+0000 7f4590e00640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4050b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4580008a10 tx=0x7f4580005530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a9824044a6a7ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.826+0000 7f456f400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:01:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.826+0000 7f456f400640 1 -- 172.21.15.84:0/3458562974 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580014070 con 0x555eb3c7d390 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.826+0000 7f456f400640 1 -- 172.21.15.84:0/3458562974 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f4580010bc0 con 0x555eb3c7d390 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.827+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555eb3f48b90 con 0x555eb3c7d390 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.827+0000 7f456f400640 1 -- 172.21.15.84:0/3458562974 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4580010dc0 con 0x555eb3c7d390 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.827+0000 7f459ae76740 10 client.28031 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.827+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555eb3f63950 con 0x555eb3c7d390 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.828+0000 7f456f400640 1 -- 172.21.15.84:0/3458562974 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555eb3f48b90 con 0x555eb3c7d390 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.828+0000 7f456f400640 1 -- 172.21.15.84:0/3458562974 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f458002d6c0 con 0x555eb3c7d390 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.828+0000 7f459ae76740 10 client.28031 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.829+0000 7f459ae76740 10 client.28031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.829+0000 7f459ae76740 20 client.28031 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.829+0000 7f459ae76740 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c5c9f0 0x555eb4062740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.829+0000 7f459ae76740 4 client.28031 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.829+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eb3fbdf00 con 0x555eb3c5c9f0 2024-09-21T08:01:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.829+0000 7f4591800640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c5c9f0 0x555eb4062740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.831+0000 7f456f400640 10 client.28031 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.831+0000 7f4591800640 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c5c9f0 0x555eb4062740 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c665af796239279 server_cookie=d72b4663d78af21b in_seq=0 out_seq=0 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.832+0000 7f456f400640 1 -- 172.21.15.84:0/3458562974 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555eb3fbdf00 con 0x555eb3c5c9f0 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.832+0000 7f456f400640 10 client.28031 handle_command_reply: tid=0 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.833+0000 7f459ae76740 1 client.28031 shutdown 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.833+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 msgr2=0x555eb4050b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.833+0000 7f459ae76740 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4050b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4580008a10 tx=0x7f4580005530 comp rx=0 tx=0).stop 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 shutdown_connections 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c9e070 0x555eb405cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4050b70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c5c9f0 0x555eb4062740 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 --2- 172.21.15.84:0/3458562974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c751b0 0x555eb4050630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 >> 172.21.15.84:0/3458562974 conn(0x555eb3c92460 msgr2=0x555eb4041600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f456f400640 0 client.28031 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 shutdown_connections 2024-09-21T08:01:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 1 -- 172.21.15.84:0/3458562974 wait complete. 2024-09-21T08:01:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.834+0000 7f459ae76740 20 client.28031 trim_cache size 0 max 16384 2024-09-21T08:01:11.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.861+0000 7f459ae76740 1 Processor -- start 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.862+0000 7f459ae76740 1 -- start start 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f459ae76740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c751b0 0x555eb4052510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f459ae76740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4045fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f459ae76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb405caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f459ae76740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1bfc20 con 0x555eb3c751b0 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f459ae76740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1c1760 con 0x555eb3c7d390 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f459ae76740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1c02f0 con 0x555eb3c9e070 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f4591800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c751b0 0x555eb4052510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f4590e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4045fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f4590e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4045fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:52376/0 (socket says 172.21.15.84:52376) 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f4590e00640 1 -- 172.21.15.84:0/1321249455 learned_addr learned my addr 172.21.15.84:0/1321249455 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.863+0000 7f4592200640 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb405caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.864+0000 7f4591800640 1 -- 172.21.15.84:0/1321249455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 msgr2=0x555eb405caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.864+0000 7f4591800640 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb405caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.864+0000 7f4591800640 1 -- 172.21.15.84:0/1321249455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 msgr2=0x555eb4045fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.864+0000 7f4591800640 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4045fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.864+0000 7f4591800640 1 -- 172.21.15.84:0/1321249455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb403e2c0 con 0x555eb3c751b0 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.864+0000 7f4592200640 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb405caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.866+0000 7f4591800640 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c751b0 0x555eb4052510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f458c07b390 tx=0x7f458403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f79985df21fdfc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.867+0000 7f457a000640 1 -- 172.21.15.84:0/1321249455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4584056020 con 0x555eb3c751b0 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.867+0000 7f457a000640 1 -- 172.21.15.84:0/1321249455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4584036040 con 0x555eb3c751b0 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.867+0000 7f457a000640 1 -- 172.21.15.84:0/1321249455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458402f870 con 0x555eb3c751b0 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.868+0000 7f459ae76740 1 -- 172.21.15.84:0/1321249455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c751b0 msgr2=0x555eb4052510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.868+0000 7f459ae76740 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c751b0 0x555eb4052510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f458c07b390 tx=0x7f458403e000 comp rx=0 tx=0).stop 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.868+0000 7f459ae76740 1 -- 172.21.15.84:0/1321249455 shutdown_connections 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.868+0000 7f459ae76740 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb405caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.868+0000 7f459ae76740 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c7d390 0x555eb4045fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.868+0000 7f459ae76740 1 --2- 172.21.15.84:0/1321249455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c751b0 0x555eb4052510 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.869+0000 7f459ae76740 1 -- 172.21.15.84:0/1321249455 >> 172.21.15.84:0/1321249455 conn(0x555eb3c92460 msgr2=0x555eb404eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.869+0000 7f459ae76740 1 -- 172.21.15.84:0/1321249455 shutdown_connections 2024-09-21T08:01:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.869+0000 7f459ae76740 1 -- 172.21.15.84:0/1321249455 wait complete. 2024-09-21T08:01:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.870+0000 7f459ae76740 1 -- start start 2024-09-21T08:01:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.870+0000 7f459ae76740 1 Processor -- start 2024-09-21T08:01:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f459ae76740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c751b0 0x555eb4063700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f459ae76740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb4063c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f459ae76740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb4064180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f459ae76740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1c1090 con 0x555eb3c7d390 2024-09-21T08:01:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f459ae76740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1c09c0 con 0x555eb3c751b0 2024-09-21T08:01:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f459ae76740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1bdc20 con 0x555eb3c9e070 2024-09-21T08:01:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f4592200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb4064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f4592200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb4064180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60190/0 (socket says 172.21.15.84:60190) 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.876+0000 7f4592200640 1 -- 172.21.15.84:0/3461003022 learned_addr learned my addr 172.21.15.84:0/3461003022 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.877+0000 7f4592200640 1 -- 172.21.15.84:0/3461003022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c751b0 msgr2=0x555eb4063700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.877+0000 7f4592200640 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c751b0 0x555eb4063700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.877+0000 7f4592200640 1 -- 172.21.15.84:0/3461003022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 msgr2=0x555eb4063c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.877+0000 7f4592200640 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb4063c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.877+0000 7f459ae76740 10 client.0 _ll_register_callbacks cb 0x7f45800053f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.877+0000 7f4592200640 1 -- 172.21.15.84:0/3461003022 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb40cbec0 con 0x555eb3c9e070 2024-09-21T08:01:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.877+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4584036040 con 0x555eb3c9e070 2024-09-21T08:01:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.878+0000 7f4592200640 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb4064180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f457c0ac5c0 tx=0x7f457c004f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35049ff4313113dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.879+0000 7f456f400640 10 client.28057 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:01:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.879+0000 7f456f400640 1 -- 172.21.15.84:0/3461003022 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0b5240 con 0x555eb3c9e070 2024-09-21T08:01:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.879+0000 7f456f400640 1 -- 172.21.15.84:0/3461003022 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f457c0a7f80 con 0x555eb3c9e070 2024-09-21T08:01:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.879+0000 7f456f400640 1 -- 172.21.15.84:0/3461003022 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f457c0a81e0 con 0x555eb3c9e070 2024-09-21T08:01:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.879+0000 7f459ae76740 10 client.28057 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.879+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555eb40ccfa0 con 0x555eb3c9e070 2024-09-21T08:01:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f456f400640 1 -- 172.21.15.84:0/3461003022 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f457c0ab300 con 0x555eb3c9e070 2024-09-21T08:01:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f459ae76740 10 client.28057 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f459ae76740 10 client.28057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f459ae76740 20 client.28057 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f459ae76740 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c31da0 0x555eb40cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f459ae76740 4 client.28057 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555eb3fb99b0 con 0x555eb3c31da0 2024-09-21T08:01:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.881+0000 7f4591800640 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c31da0 0x555eb40cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.882+0000 7f4591800640 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c31da0 0x555eb40cf640 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f88c1d178b68ca5 server_cookie=8ea17239d821109d in_seq=0 out_seq=0 2024-09-21T08:01:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.882+0000 7f456f400640 10 client.28057 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.882+0000 7f456f400640 1 -- 172.21.15.84:0/3461003022 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555eb3fb99b0 con 0x555eb3c31da0 2024-09-21T08:01:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.882+0000 7f456f400640 10 client.28057 handle_command_reply: tid=0 2024-09-21T08:01:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.883+0000 7f459ae76740 1 client.28057 shutdown 2024-09-21T08:01:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.883+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 msgr2=0x555eb4064180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.883+0000 7f459ae76740 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb4064180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f457c0ac5c0 tx=0x7f457c004f40 comp rx=0 tx=0).stop 2024-09-21T08:01:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.885+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 shutdown_connections 2024-09-21T08:01:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.885+0000 7f459ae76740 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x555eb3c31da0 0x555eb40cf640 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.885+0000 7f459ae76740 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555eb3c9e070 0x555eb4064180 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.885+0000 7f459ae76740 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555eb3c7d390 0x555eb4063c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.885+0000 7f459ae76740 1 --2- 172.21.15.84:0/3461003022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555eb3c751b0 0x555eb4063700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.885+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 >> 172.21.15.84:0/3461003022 conn(0x555eb3c92460 msgr2=0x555eb4051870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.885+0000 7f456f400640 0 client.28057 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.886+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 shutdown_connections 2024-09-21T08:01:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.886+0000 7f459ae76740 1 -- 172.21.15.84:0/3461003022 wait complete. 2024-09-21T08:01:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.887+0000 7f459ae76740 20 client.28057 trim_cache size 0 max 16384 2024-09-21T08:01:11.890 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:11.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.890+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f45740b6700 msgr2=0x7f45740b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.890+0000 7f4592c00640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f45740b6700 0x7f45740b8c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4584000f80 tx=0x7f45840099c0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.890+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c10be50 msgr2=0x7f458c078040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.890+0000 7f4592c00640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c10be50 0x7f458c078040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f457c00d680 tx=0x7f457c00db40 comp rx=0 tx=0).stop 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.891+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 shutdown_connections 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.891+0000 7f4592c00640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f45740b6700 0x7f45740b8c10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.891+0000 7f4592c00640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458c10be50 0x7f458c078040 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.891+0000 7f4592c00640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f458c10b500 0x7f458c077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.891+0000 7f4592c00640 1 --2- 172.21.15.84:0/3389498212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f458c105bc0 0x7f458c07b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.891+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 >> 172.21.15.84:0/3389498212 conn(0x7f458c101630 msgr2=0x7f458c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.892+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 shutdown_connections 2024-09-21T08:01:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:11.892+0000 7f4592c00640 1 -- 172.21.15.84:0/3389498212 wait complete. 2024-09-21T08:01:11.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:11 smithi191 ceph-mon[34667]: pgmap v705: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 42 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:01:12.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:11 smithi162 ceph-mon[34833]: pgmap v705: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 42 GiB data, 91 GiB used, 982 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:01:13.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:13 smithi191 ceph-mon[34667]: pgmap v706: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 39 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:01:14.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:13 smithi162 ceph-mon[34833]: pgmap v706: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 39 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:01:14.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:13 smithi084 ceph-mon[30411]: pgmap v706: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 39 GiB data, 86 GiB used, 986 GiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-21T08:01:14.315 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:01:14.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:01:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 -- 172.21.15.84:0/3109953040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 msgr2=0x7f77f4112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 --2- 172.21.15.84:0/3109953040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 0x7f77f4112840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009ca0 tx=0x7f77ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 -- 172.21.15.84:0/3109953040 shutdown_connections 2024-09-21T08:01:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 --2- 172.21.15.84:0/3109953040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 0x7f77f4112840 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 --2- 172.21.15.84:0/3109953040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f410b6c0 0x7f77f410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 --2- 172.21.15.84:0/3109953040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 0x7f77f4106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 -- 172.21.15.84:0/3109953040 >> 172.21.15.84:0/3109953040 conn(0x7f77f4101810 msgr2=0x7f77f4103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 -- 172.21.15.84:0/3109953040 shutdown_connections 2024-09-21T08:01:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.340+0000 7f77fa200640 1 -- 172.21.15.84:0/3109953040 wait complete. 2024-09-21T08:01:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.341+0000 7f77fa200640 1 Processor -- start 2024-09-21T08:01:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.341+0000 7f77fa200640 1 -- start start 2024-09-21T08:01:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77fa200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 0x7f77f419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77fa200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f410b6c0 0x7f77f419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77fa200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 0x7f77f41a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77fa200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4115d20 con 0x7f77f410c010 2024-09-21T08:01:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77fa200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4115ba0 con 0x7f77f410b6c0 2024-09-21T08:01:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77fa200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4115ea0 con 0x7f77f4105d80 2024-09-21T08:01:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 0x7f77f41a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77f3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 0x7f77f419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f410b6c0 0x7f77f419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77f3400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 0x7f77f419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60206/0 (socket says 172.21.15.84:60206) 2024-09-21T08:01:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.342+0000 7f77f3400640 1 -- 172.21.15.84:0/1146342010 learned_addr learned my addr 172.21.15.84:0/1146342010 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f3400640 1 -- 172.21.15.84:0/1146342010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f410b6c0 msgr2=0x7f77f419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f3400640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f410b6c0 0x7f77f419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f3400640 1 -- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 msgr2=0x7f77f41a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f3400640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 0x7f77f41a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f3400640 1 -- 172.21.15.84:0/1146342010 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f41a25e0 con 0x7f77f4105d80 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77eaa00640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f410b6c0 0x7f77f419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f3400640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 0x7f77f419c670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9f0 tx=0x7f77e400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f0c00640 1 -- 172.21.15.84:0/1146342010 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e400cd80 con 0x7f77f4105d80 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f41a28d0 con 0x7f77f4105d80 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.343+0000 7f77f0c00640 1 -- 172.21.15.84:0/1146342010 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77e40054d0 con 0x7f77f4105d80 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.344+0000 7f77f0c00640 1 -- 172.21.15.84:0/1146342010 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4010690 con 0x7f77f4105d80 2024-09-21T08:01:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.344+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f41a9030 con 0x7f77f4105d80 2024-09-21T08:01:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.346+0000 7f7800ed3740 1 Processor -- start 2024-09-21T08:01:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f7800ed3740 1 -- start start 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba5ac350 0x55f5ba953d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba583490 0x55f5ba954250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba58b670 0x55f5ba954790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f7800ed3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5ba8c9e90 con 0x55f5ba5ac350 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f7800ed3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5ba8b92c0 con 0x55f5ba58b670 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f7800ed3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f5ba8bd0d0 con 0x55f5ba583490 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba5ac350 0x55f5ba953d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba5ac350 0x55f5ba953d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50578/0 (socket says 172.21.15.84:50578) 2024-09-21T08:01:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f77f3e00640 1 -- 172.21.15.84:0/125579585 learned_addr learned my addr 172.21.15.84:0/125579585 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:15.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.347+0000 7f77eaa00640 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba58b670 0x55f5ba954790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77f3e00640 1 -- 172.21.15.84:0/125579585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba583490 msgr2=0x55f5ba954250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77f3e00640 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba583490 0x55f5ba954250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77f3e00640 1 -- 172.21.15.84:0/125579585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba58b670 msgr2=0x55f5ba954790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77f3e00640 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba58b670 0x55f5ba954790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77f3e00640 1 -- 172.21.15.84:0/125579585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ba617930 con 0x55f5ba5ac350 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77eaa00640 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba58b670 0x55f5ba954790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77f0c00640 1 -- 172.21.15.84:0/1146342010 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f77e4004e90 con 0x7f77f4105d80 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77f3e00640 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba5ac350 0x55f5ba953d10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009ca0 tx=0x7f77ec009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1187248f38fcb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77e3e00640 1 -- 172.21.15.84:0/125579585 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec031cf0 con 0x55f5ba5ac350 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.348+0000 7f77e3e00640 1 -- 172.21.15.84:0/125579585 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77ec036030 con 0x55f5ba5ac350 2024-09-21T08:01:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f77e3e00640 1 -- 172.21.15.84:0/125579585 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec004240 con 0x55f5ba5ac350 2024-09-21T08:01:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 -- 172.21.15.84:0/125579585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba5ac350 msgr2=0x55f5ba953d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba5ac350 0x55f5ba953d10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009ca0 tx=0x7f77ec009430 comp rx=0 tx=0).stop 2024-09-21T08:01:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 -- 172.21.15.84:0/125579585 shutdown_connections 2024-09-21T08:01:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba58b670 0x55f5ba954790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba583490 0x55f5ba954250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 --2- 172.21.15.84:0/125579585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba5ac350 0x55f5ba953d10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 -- 172.21.15.84:0/125579585 >> 172.21.15.84:0/125579585 conn(0x55f5ba5a0740 msgr2=0x55f5ba951c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.349+0000 7f7800ed3740 1 -- 172.21.15.84:0/125579585 shutdown_connections 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.350+0000 7f7800ed3740 1 -- 172.21.15.84:0/125579585 wait complete. 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.350+0000 7f77f0c00640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77d80b6590 0x7f77d80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.350+0000 7f77f0c00640 1 -- 172.21.15.84:0/1146342010 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f77e40e7ed0 con 0x7f77f4105d80 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.350+0000 7f77eaa00640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77d80b6590 0x7f77d80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.350+0000 7f7800ed3740 1 -- start start 2024-09-21T08:01:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 1 Processor -- start 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f77eaa00640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77d80b6590 0x7f77d80b8aa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f77f41050c0 tx=0x7f77dc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba95f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba95fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba96b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5ba71a890 con 0x55f5ba583490 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5ba854160 con 0x55f5ba5ac350 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f5ba962310 con 0x55f5ba58b670 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.351+0000 7f7800ed3740 10 client.0 _ll_register_callbacks cb 0x55f5ba870a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba95f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba95f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50588/0 (socket says 172.21.15.84:50588) 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 -- 172.21.15.84:0/15068796 learned_addr learned my addr 172.21.15.84:0/15068796 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77eaa00640 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba95fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3e00640 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba96b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 -- 172.21.15.84:0/15068796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 msgr2=0x55f5ba95fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba95fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 -- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 msgr2=0x55f5ba96b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba96b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 -- 172.21.15.84:0/15068796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ba96bb90 con 0x55f5ba583490 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77f3400640 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba95f890 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f77e40e52a0 tx=0x7f77e40a97e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb96cf4c85af72ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.352+0000 7f77e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f77e0c00640 1 -- 172.21.15.84:0/15068796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40b2070 con 0x55f5ba583490 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f77e0c00640 1 -- 172.21.15.84:0/15068796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f77e40a9290 con 0x55f5ba583490 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77ec036030 con 0x55f5ba583490 2024-09-21T08:01:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f77e0c00640 1 -- 172.21.15.84:0/15068796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77e40ad0b0 con 0x55f5ba583490 2024-09-21T08:01:15.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f7800ed3740 10 client.17682 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:15.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5ba96e570 con 0x55f5ba583490 2024-09-21T08:01:15.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f77e0c00640 1 -- 172.21.15.84:0/15068796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77ec036030 con 0x55f5ba583490 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.353+0000 7f77e0c00640 1 -- 172.21.15.84:0/15068796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f77e40a9490 con 0x55f5ba583490 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.354+0000 7f7800ed3740 10 client.17682 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.354+0000 7f7800ed3740 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.354+0000 7f7800ed3740 20 client.17682 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.354+0000 7f7800ed3740 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba56acd0 0x55f5ba971a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.354+0000 7f7800ed3740 4 client.17682 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.354+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5ba8cbde0 con 0x55f5ba56acd0 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.354+0000 7f77eaa00640 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba56acd0 0x55f5ba971a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.355+0000 7f77eaa00640 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba56acd0 0x55f5ba971a40 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3839c1d74ee40bc4 server_cookie=557693c461e6679 in_seq=0 out_seq=0 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.355+0000 7f77e0c00640 10 client.17682 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f77e0c00640 1 -- 172.21.15.84:0/15068796 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f5ba8cbde0 con 0x55f5ba56acd0 2024-09-21T08:01:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f77e0c00640 10 client.17682 handle_command_reply: tid=0 2024-09-21T08:01:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 client.17682 shutdown 2024-09-21T08:01:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 msgr2=0x55f5ba95f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba95f890 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f77e40e52a0 tx=0x7f77e40a97e0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 shutdown_connections 2024-09-21T08:01:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba96b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba56acd0 0x55f5ba971a40 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba95fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 --2- 172.21.15.84:0/15068796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba95f890 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f77e0c00640 0 client.17682 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 >> 172.21.15.84:0/15068796 conn(0x55f5ba5a0740 msgr2=0x55f5ba950280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 shutdown_connections 2024-09-21T08:01:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.356+0000 7f7800ed3740 1 -- 172.21.15.84:0/15068796 wait complete. 2024-09-21T08:01:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.357+0000 7f7800ed3740 20 client.17682 trim_cache size 0 max 16384 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 Processor -- start 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 -- start start 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba583490 0x55f5ba9508f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba58b670 0x55f5ba959e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba5ac350 0x55f5ba9612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41b3050 con 0x55f5ba58b670 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41b4b90 con 0x55f5ba583490 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f7800ed3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41b3720 con 0x55f5ba5ac350 2024-09-21T08:01:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba58b670 0x55f5ba959e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba58b670 0x55f5ba959e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50598/0 (socket says 172.21.15.84:50598) 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f77eaa00640 1 -- 172.21.15.84:0/2192886635 learned_addr learned my addr 172.21.15.84:0/2192886635 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.375+0000 7f77f3400640 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba583490 0x55f5ba9508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3e00640 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba5ac350 0x55f5ba9612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3400640 1 -- 172.21.15.84:0/2192886635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba5ac350 msgr2=0x55f5ba9612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3400640 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba5ac350 0x55f5ba9612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3400640 1 -- 172.21.15.84:0/2192886635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba58b670 msgr2=0x55f5ba959e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3400640 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba58b670 0x55f5ba959e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3400640 1 -- 172.21.15.84:0/2192886635 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ba956460 con 0x55f5ba583490 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3e00640 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba5ac350 0x55f5ba9612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77eaa00640 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba58b670 0x55f5ba959e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77f3400640 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba583490 0x55f5ba9508f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f77e40b25e0 tx=0x7f77e4004a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecda430ba76a08e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77e3400640 1 -- 172.21.15.84:0/2192886635 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40b2070 con 0x55f5ba583490 2024-09-21T08:01:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77e3400640 1 -- 172.21.15.84:0/2192886635 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77e40cc020 con 0x55f5ba583490 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.376+0000 7f77e3400640 1 -- 172.21.15.84:0/2192886635 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4005180 con 0x55f5ba583490 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 -- 172.21.15.84:0/2192886635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba583490 msgr2=0x55f5ba9508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba583490 0x55f5ba9508f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f77e40b25e0 tx=0x7f77e4004a90 comp rx=0 tx=0).stop 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 -- 172.21.15.84:0/2192886635 shutdown_connections 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba5ac350 0x55f5ba9612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba58b670 0x55f5ba959e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 --2- 172.21.15.84:0/2192886635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba583490 0x55f5ba9508f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 -- 172.21.15.84:0/2192886635 >> 172.21.15.84:0/2192886635 conn(0x55f5ba5a0740 msgr2=0x55f5ba960bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 -- 172.21.15.84:0/2192886635 shutdown_connections 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.377+0000 7f7800ed3740 1 -- 172.21.15.84:0/2192886635 wait complete. 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 -- start start 2024-09-21T08:01:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 Processor -- start 2024-09-21T08:01:15.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba963b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba964050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba964590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41b44c0 con 0x55f5ba583490 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41b3df0 con 0x55f5ba5ac350 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.378+0000 7f7800ed3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41b1030 con 0x55f5ba58b670 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f7800ed3740 10 client.0 _ll_register_callbacks cb 0x7f77e400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba963b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba964050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba963b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50612/0 (socket says 172.21.15.84:50612) 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 -- 172.21.15.84:0/3909073100 learned_addr learned my addr 172.21.15.84:0/3909073100 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3e00640 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba964590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 -- 172.21.15.84:0/3909073100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 msgr2=0x55f5ba964050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba964050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 -- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 msgr2=0x55f5ba964590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba964590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77f3400640 1 -- 172.21.15.84:0/3909073100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ba95a370 con 0x55f5ba583490 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.379+0000 7f77eaa00640 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba964050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f77f3400640 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba963b10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009350 tx=0x7f77e40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e34d00ac1ddca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f77e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f77e0c00640 1 -- 172.21.15.84:0/3909073100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40b2040 con 0x55f5ba583490 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f77e0c00640 1 -- 172.21.15.84:0/3909073100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f77e40c3d00 con 0x55f5ba583490 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77e40cc020 con 0x55f5ba583490 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f77e0c00640 1 -- 172.21.15.84:0/3909073100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f77e4005180 con 0x55f5ba583490 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f7800ed3740 10 client.17688 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5ba95a370 con 0x55f5ba583490 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.380+0000 7f77e0c00640 1 -- 172.21.15.84:0/3909073100 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77e40cc020 con 0x55f5ba583490 2024-09-21T08:01:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f77e0c00640 1 -- 172.21.15.84:0/3909073100 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f77e40ac610 con 0x55f5ba583490 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f7800ed3740 10 client.17688 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f7800ed3740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f7800ed3740 20 client.17688 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f7800ed3740 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba540080 0x55f5ba9df790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f7800ed3740 4 client.17688 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f5ba8c7890 con 0x55f5ba540080 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.381+0000 7f77eaa00640 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba540080 0x55f5ba9df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.382+0000 7f77eaa00640 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba540080 0x55f5ba9df790 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73679bcc60ae6d3c server_cookie=7015936170a939e6 in_seq=0 out_seq=0 2024-09-21T08:01:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.382+0000 7f77e0c00640 10 client.17688 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.383+0000 7f77e0c00640 1 -- 172.21.15.84:0/3909073100 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f5ba8c7890 con 0x55f5ba540080 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.383+0000 7f77e0c00640 10 client.17688 handle_command_reply: tid=0 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 client.17688 shutdown 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 msgr2=0x55f5ba963b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba963b10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009350 tx=0x7f77e40057c0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 shutdown_connections 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5ba5ac350 0x55f5ba964590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55f5ba540080 0x55f5ba9df790 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f5ba58b670 0x55f5ba964050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 --2- 172.21.15.84:0/3909073100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ba583490 0x55f5ba963b10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f77e0c00640 0 client.17688 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 >> 172.21.15.84:0/3909073100 conn(0x55f5ba5a0740 msgr2=0x55f5ba9554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 shutdown_connections 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 1 -- 172.21.15.84:0/3909073100 wait complete. 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.384+0000 7f7800ed3740 20 client.17688 trim_cache size 0 max 16384 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "73eff468-1da5-4975-a63e-c0f57a3f64cd", 2024-09-21T08:01:15.389 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77d80b6590 msgr2=0x7f77d80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77d80b6590 0x7f77d80b8aa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f77f41050c0 tx=0x7f77dc005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 msgr2=0x7f77f419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 0x7f77f419c670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9f0 tx=0x7f77e400edf0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 shutdown_connections 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77d80b6590 0x7f77d80b8aa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f410c010 0x7f77f41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f410b6c0 0x7f77f419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 --2- 172.21.15.84:0/1146342010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4105d80 0x7f77f419c670 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:15.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 >> 172.21.15.84:0/1146342010 conn(0x7f77f4101810 msgr2=0x7f77f4108c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:15.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.385+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 shutdown_connections 2024-09-21T08:01:15.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:15.386+0000 7f77fa200640 1 -- 172.21.15.84:0/1146342010 wait complete. 2024-09-21T08:01:16.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:15 smithi162 ceph-mon[34833]: pgmap v707: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 36 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 9 op/s 2024-09-21T08:01:16.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:15 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T08:01:16.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:15 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:16.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:15 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T08:01:16.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:15 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:16.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:15 smithi084 ceph-mon[30411]: pgmap v707: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 36 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 9 op/s 2024-09-21T08:01:16.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:15 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T08:01:16.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:15 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:16.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:15 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T08:01:16.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:15 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:16.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:15 smithi191 ceph-mon[34667]: pgmap v707: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 36 GiB data, 81 GiB used, 992 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 9 op/s 2024-09-21T08:01:16.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:15 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T08:01:16.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:15 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:16.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:15 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T08:01:16.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:15 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T08:01:16.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:01:16.742 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 -- 172.21.15.84:0/2457552928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 msgr2=0x7f01a81061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 --2- 172.21.15.84:0/2457552928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a81061c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0198009900 tx=0x7f019802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 -- 172.21.15.84:0/2457552928 shutdown_connections 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 --2- 172.21.15.84:0/2457552928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01a810c040 0x7f01a8112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 --2- 172.21.15.84:0/2457552928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a810b6f0 0x7f01a810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 --2- 172.21.15.84:0/2457552928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a81061c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 -- 172.21.15.84:0/2457552928 >> 172.21.15.84:0/2457552928 conn(0x7f01a81017e0 msgr2=0x7f01a8103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 -- 172.21.15.84:0/2457552928 shutdown_connections 2024-09-21T08:01:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.384+0000 7f01ad600640 1 -- 172.21.15.84:0/2457552928 wait complete. 2024-09-21T08:01:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.385+0000 7f01ad600640 1 Processor -- start 2024-09-21T08:01:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.385+0000 7f01ad600640 1 -- start start 2024-09-21T08:01:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01ad600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01ad600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01a810b6f0 0x7f01a819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01ad600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a810c040 0x7f01a81a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01ad600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8115d50 con 0x7f01a8105db0 2024-09-21T08:01:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01ad600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8115bd0 con 0x7f01a810b6f0 2024-09-21T08:01:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01ad600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01a8115ed0 con 0x7f01a810c040 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a819c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50630/0 (socket says 172.21.15.84:50630) 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6a00640 1 -- 172.21.15.84:0/894929620 learned_addr learned my addr 172.21.15.84:0/894929620 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6000640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01a810b6f0 0x7f01a819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a7400640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a810c040 0x7f01a81a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6a00640 1 -- 172.21.15.84:0/894929620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a810c040 msgr2=0x7f01a81a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6a00640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a810c040 0x7f01a81a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6a00640 1 -- 172.21.15.84:0/894929620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01a810b6f0 msgr2=0x7f01a819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.386+0000 7f01a6a00640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01a810b6f0 0x7f01a819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f01a6a00640 1 -- 172.21.15.84:0/894929620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a81a26b0 con 0x7f01a8105db0 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f01a7400640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a810c040 0x7f01a81a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f01a6a00640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a819c740 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0198005ab0 tx=0x7f0198003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f019f400640 1 -- 172.21.15.84:0/894929620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019803f070 con 0x7f01a8105db0 2024-09-21T08:01:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a81a2940 con 0x7f01a8105db0 2024-09-21T08:01:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f019f400640 1 -- 172.21.15.84:0/894929620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0198031d60 con 0x7f01a8105db0 2024-09-21T08:01:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f019f400640 1 -- 172.21.15.84:0/894929620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198035030 con 0x7f01a8105db0 2024-09-21T08:01:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.387+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a81a9100 con 0x7f01a8105db0 2024-09-21T08:01:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.390+0000 7f01b4225740 1 Processor -- start 2024-09-21T08:01:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01b4225740 1 -- start start 2024-09-21T08:01:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01b4225740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039ebb4070 0x56039ef5ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01b4225740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef5b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01b4225740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f019f400640 1 -- 172.21.15.84:0/894929620 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0198042070 con 0x7f01a8105db0 2024-09-21T08:01:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01b4225740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56039eed1f70 con 0x56039eb93390 2024-09-21T08:01:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01b4225740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56039eec13a0 con 0x56039eb8b1b0 2024-09-21T08:01:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01b4225740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56039eec51b0 con 0x56039ebb4070 2024-09-21T08:01:17.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01a6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef5b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50644/0 (socket says 172.21.15.84:50644) 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01a6000640 1 -- 172.21.15.84:0/3384766227 learned_addr learned my addr 172.21.15.84:0/3384766227 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.391+0000 7f01a7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039ebb4070 0x56039ef5ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f01a7400640 1 -- 172.21.15.84:0/3384766227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 msgr2=0x56039ef5b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f01a7400640 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef5b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f01a7400640 1 -- 172.21.15.84:0/3384766227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 msgr2=0x56039ef5b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f01a7400640 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f01a7400640 1 -- 172.21.15.84:0/3384766227 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039ee8bc90 con 0x56039ebb4070 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f01a6000640 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f01a7400640 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039ebb4070 0x56039ef5ad60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009f80 tx=0x7f01a000f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1de00e1249fa79b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.392+0000 7f0193400640 1 -- 172.21.15.84:0/3384766227 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0015070 con 0x56039ebb4070 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.393+0000 7f0193400640 1 -- 172.21.15.84:0/3384766227 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01a0011bb0 con 0x56039ebb4070 2024-09-21T08:01:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.393+0000 7f0193400640 1 -- 172.21.15.84:0/3384766227 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a001abb0 con 0x56039ebb4070 2024-09-21T08:01:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.393+0000 7f019f400640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f018c0b6680 0x7f018c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.393+0000 7f019f400640 1 -- 172.21.15.84:0/894929620 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f01981083b0 con 0x7f01a8105db0 2024-09-21T08:01:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.393+0000 7f01a6a00640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f018c0b6680 0x7f018c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 -- 172.21.15.84:0/3384766227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039ebb4070 msgr2=0x56039ef5ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039ebb4070 0x56039ef5ad60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009f80 tx=0x7f01a000f7f0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 -- 172.21.15.84:0/3384766227 shutdown_connections 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef5b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 --2- 172.21.15.84:0/3384766227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039ebb4070 0x56039ef5ad60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 -- 172.21.15.84:0/3384766227 >> 172.21.15.84:0/3384766227 conn(0x56039eba8460 msgr2=0x56039ef58c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 -- 172.21.15.84:0/3384766227 shutdown_connections 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01b4225740 1 -- 172.21.15.84:0/3384766227 wait complete. 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.394+0000 7f01a6a00640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f018c0b6680 0x7f018c0b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f019810bfd0 tx=0x7f019810be60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 -- start start 2024-09-21T08:01:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 Processor -- start 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef66550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef66ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039ebb4070 0x56039ef72830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56039ed22700 con 0x56039ebb4070 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56039ee5c540 con 0x56039eb8b1b0 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.395+0000 7f01b4225740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56039ef69540 con 0x56039eb93390 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01b4225740 10 client.0 _ll_register_callbacks cb 0x56039ee6c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039ebb4070 0x56039ef72830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a6000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef66ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a6000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef66ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:60246/0 (socket says 172.21.15.84:60246) 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a6000640 1 -- 172.21.15.84:0/4190060043 learned_addr learned my addr 172.21.15.84:0/4190060043 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a7400640 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef66550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a7400640 1 -- 172.21.15.84:0/4190060043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 msgr2=0x56039ef66ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a7400640 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef66ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a7400640 1 -- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 msgr2=0x56039ef66550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a7400640 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef66550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a7400640 1 -- 172.21.15.84:0/4190060043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56039ec1f650 con 0x56039ebb4070 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.396+0000 7f01a6000640 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef66ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f01a7400640 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039ebb4070 0x56039ef72830 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f01a001a890 tx=0x7f01a001a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9eeba95487ff029 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f0187e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f0187e00640 1 -- 172.21.15.84:0/4190060043 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0015030 con 0x56039ebb4070 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f0187e00640 1 -- 172.21.15.84:0/4190060043 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f01a001ad40 con 0x56039ebb4070 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56039ee5eb50 con 0x56039ebb4070 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f0187e00640 1 -- 172.21.15.84:0/4190060043 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01a0003970 con 0x56039ebb4070 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f01b4225740 10 client.17700 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:17.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.397+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56039ee79910 con 0x56039ebb4070 2024-09-21T08:01:17.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f0187e00640 1 -- 172.21.15.84:0/4190060043 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56039ee5eb50 con 0x56039ebb4070 2024-09-21T08:01:17.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f0187e00640 1 -- 172.21.15.84:0/4190060043 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f01a00044c0 con 0x56039ebb4070 2024-09-21T08:01:17.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f01b4225740 10 client.17700 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:17.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f01b4225740 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:17.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f01b4225740 20 client.17700 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:17.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f01b4225740 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb729f0 0x56039ef78590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f01b4225740 4 client.17700 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56039eed3ec0 con 0x56039eb729f0 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.398+0000 7f01a6000640 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb729f0 0x56039ef78590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.399+0000 7f01a6000640 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb729f0 0x56039ef78590 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35409c20f492be76 server_cookie=f27e247c2525cab7 in_seq=0 out_seq=0 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.399+0000 7f0187e00640 10 client.17700 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f0187e00640 1 -- 172.21.15.84:0/4190060043 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56039eed3ec0 con 0x56039eb729f0 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f0187e00640 10 client.17700 handle_command_reply: tid=0 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 client.17700 shutdown 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039ebb4070 msgr2=0x56039ef72830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039ebb4070 0x56039ef72830 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f01a001a890 tx=0x7f01a001a790 comp rx=0 tx=0).stop 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 shutdown_connections 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039ebb4070 0x56039ef72830 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb729f0 0x56039ef78590 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef66ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 --2- 172.21.15.84:0/4190060043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039eb8b1b0 0x56039ef66550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f0187e00640 0 client.17700 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:17.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 >> 172.21.15.84:0/4190060043 conn(0x56039eba8460 msgr2=0x56039ef5def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 shutdown_connections 2024-09-21T08:01:17.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.400+0000 7f01b4225740 1 -- 172.21.15.84:0/4190060043 wait complete. 2024-09-21T08:01:17.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.401+0000 7f01b4225740 20 client.17700 trim_cache size 0 max 16384 2024-09-21T08:01:17.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 Processor -- start 2024-09-21T08:01:17.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 -- start start 2024-09-21T08:01:17.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb8b1b0 0x56039ef68430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef72730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b31c0 con 0x56039eb93390 2024-09-21T08:01:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b4d00 con 0x56039ebb4070 2024-09-21T08:01:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.419+0000 7f01b4225740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b3890 con 0x56039eb8b1b0 2024-09-21T08:01:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a7400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb8b1b0 0x56039ef68430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50658/0 (socket says 172.21.15.84:50658) 2024-09-21T08:01:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 -- 172.21.15.84:0/1686050606 learned_addr learned my addr 172.21.15.84:0/1686050606 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:17.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a7400640 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef72730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 -- 172.21.15.84:0/1686050606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb8b1b0 msgr2=0x56039ef68430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb8b1b0 0x56039ef68430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 -- 172.21.15.84:0/1686050606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 msgr2=0x56039ef72730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef72730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 -- 172.21.15.84:0/1686050606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039ef5d300 con 0x56039eb93390 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a7400640 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb8b1b0 0x56039ef68430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.420+0000 7f01a6000640 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5c4a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x56039ef78ad0 tx=0x7f01940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3eac3910434dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.421+0000 7f0192a00640 1 -- 172.21.15.84:0/1686050606 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01940122d0 con 0x56039eb93390 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.421+0000 7f0192a00640 1 -- 172.21.15.84:0/1686050606 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01940054d0 con 0x56039eb93390 2024-09-21T08:01:17.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.421+0000 7f0192a00640 1 -- 172.21.15.84:0/1686050606 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019400fcb0 con 0x56039eb93390 2024-09-21T08:01:17.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 -- 172.21.15.84:0/1686050606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 msgr2=0x56039ef5c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5c4a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x56039ef78ad0 tx=0x7f01940046c0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 -- 172.21.15.84:0/1686050606 shutdown_connections 2024-09-21T08:01:17.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef72730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb93390 0x56039ef5c4a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 --2- 172.21.15.84:0/1686050606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb8b1b0 0x56039ef68430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 -- 172.21.15.84:0/1686050606 >> 172.21.15.84:0/1686050606 conn(0x56039eba8460 msgr2=0x56039ef5bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 -- 172.21.15.84:0/1686050606 shutdown_connections 2024-09-21T08:01:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 -- 172.21.15.84:0/1686050606 wait complete. 2024-09-21T08:01:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.422+0000 7f01b4225740 1 -- start start 2024-09-21T08:01:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 1 Processor -- start 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb8b1b0 0x56039ef6c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef6ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef6d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b4630 con 0x56039eb8b1b0 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b3f60 con 0x56039ebb4070 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01a81b11a0 con 0x56039eb93390 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01b4225740 10 client.0 _ll_register_callbacks cb 0x7f01a001bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01a7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb8b1b0 0x56039ef6c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01a6000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef6ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01a7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb8b1b0 0x56039ef6c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50668/0 (socket says 172.21.15.84:50668) 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.423+0000 7f01a7400640 1 -- 172.21.15.84:0/1729339622 learned_addr learned my addr 172.21.15.84:0/1729339622 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:17.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a7400640 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef6d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a6000640 1 -- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 msgr2=0x56039ef6d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a6000640 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef6d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a6000640 1 -- 172.21.15.84:0/1729339622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb8b1b0 msgr2=0x56039ef6c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a6000640 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb8b1b0 0x56039ef6c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a6000640 1 -- 172.21.15.84:0/1729339622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56039efe1e40 con 0x56039eb93390 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a7400640 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb8b1b0 0x56039ef6c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f01a6000640 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef6ce40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f019400f830 tx=0x7f01940127d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0ca3ade169760b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.424+0000 7f0187e00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f0187e00640 1 -- 172.21.15.84:0/1729339622 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194033020 con 0x56039eb93390 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f0187e00640 1 -- 172.21.15.84:0/1729339622 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9520+0+0 (secure 0 0 0) 0x7f019400fc30 con 0x56039eb93390 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01940054d0 con 0x56039eb93390 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f0187e00640 1 -- 172.21.15.84:0/1729339622 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f019403e050 con 0x56039eb93390 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f01b4225740 10 client.28090 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56039efe3040 con 0x56039eb93390 2024-09-21T08:01:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f0187e00640 1 -- 172.21.15.84:0/1729339622 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01940054d0 con 0x56039eb93390 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.425+0000 7f0187e00640 1 -- 172.21.15.84:0/1729339622 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0194010a20 con 0x56039eb93390 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.426+0000 7f01b4225740 10 client.28090 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.426+0000 7f01b4225740 10 client.28090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.426+0000 7f01b4225740 20 client.28090 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.426+0000 7f01b4225740 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb47da0 0x56039efe57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.426+0000 7f01b4225740 4 client.28090 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.426+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56039eecf970 con 0x56039eb47da0 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.426+0000 7f01a7400640 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb47da0 0x56039efe57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01a7400640 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb47da0 0x56039efe57a0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f44d8adf4c7e4fd6 server_cookie=6d4106f15b5b4e9f in_seq=0 out_seq=0 2024-09-21T08:01:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f0187e00640 10 client.28090 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f0187e00640 1 -- 172.21.15.84:0/1729339622 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x56039eecf970 con 0x56039eb47da0 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f0187e00640 10 client.28090 handle_command_reply: tid=0 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 client.28090 shutdown 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 msgr2=0x56039ef6ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef6ce40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f019400f830 tx=0x7f01940127d0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 shutdown_connections 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56039ebb4070 0x56039ef6d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56039eb47da0 0x56039efe57a0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56039eb93390 0x56039ef6ce40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 --2- 172.21.15.84:0/1729339622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56039eb8b1b0 0x56039ef6c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 >> 172.21.15.84:0/1729339622 conn(0x56039eba8460 msgr2=0x56039ef681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f0187e00640 0 client.28090 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.427+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 shutdown_connections 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01b4225740 1 -- 172.21.15.84:0/1729339622 wait complete. 2024-09-21T08:01:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01b4225740 20 client.28090 trim_cache size 0 max 16384 2024-09-21T08:01:17.432 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:01:17.432 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:01:17.432 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T08:01:17.432 INFO:teuthology.orchestra.run.smithi084.stdout: "73eff468-1da5-4975-a63e-c0f57a3f64cd": { 2024-09-21T08:01:17.432 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.432 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "73eff468-1da5-4975-a63e-c0f57a3f64cd", 2024-09-21T08:01:17.432 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "73eff468-1da5-4975-a63e-c0f57a3f64cd": { 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:01:15.381648+0000", 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "63a41a05-d44f-45b2-983d-1fa6b7559a20": { 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:00:25.066675+0000", 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.433 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T08:01:17.434 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T08:01:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.436 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.437 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.438 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f018c0b6680 msgr2=0x7f018c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f018c0b6680 0x7f018c0b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f019810bfd0 tx=0x7f019810be60 comp rx=0 tx=0).stop 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 msgr2=0x7f01a819c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a819c740 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0198005ab0 tx=0x7f0198003c80 comp rx=0 tx=0).stop 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 shutdown_connections 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f018c0b6680 0x7f018c0b8b90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a810c040 0x7f01a81a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01a810b6f0 0x7f01a819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 --2- 172.21.15.84:0/894929620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8105db0 0x7f01a819c740 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:17.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.428+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 >> 172.21.15.84:0/894929620 conn(0x7f01a81017e0 msgr2=0x7f01a810add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:17.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.429+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 shutdown_connections 2024-09-21T08:01:17.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:17.429+0000 7f01ad600640 1 -- 172.21.15.84:0/894929620 wait complete. 2024-09-21T08:01:18.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:17 smithi162 ceph-mon[34833]: pgmap v708: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T08:01:18.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:17 smithi084 ceph-mon[30411]: pgmap v708: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T08:01:18.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:17 smithi191 ceph-mon[34667]: pgmap v708: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 997 GiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 11 op/s 2024-09-21T08:01:18.585 INFO:tasks.cephfs.filesystem:scrub status for tag:73eff468-1da5-4975-a63e-c0f57a3f64cd - {'path': '/', 'tag': '73eff468-1da5-4975-a63e-c0f57a3f64cd', 'options': 'recursive,force'} 2024-09-21T08:01:19.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:18 smithi162 ceph-mon[34833]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T08:01:19.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:18 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T08:01:19.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:18 smithi162 ceph-mon[34833]: pgmap v710: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.3 KiB/s rd, 207 B/s wr, 12 op/s 2024-09-21T08:01:19.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:18 smithi084 ceph-mon[30411]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T08:01:19.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:18 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T08:01:19.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:18 smithi084 ceph-mon[30411]: pgmap v710: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.3 KiB/s rd, 207 B/s wr, 12 op/s 2024-09-21T08:01:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:18 smithi191 ceph-mon[34667]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T08:01:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:18 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T08:01:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:18 smithi191 ceph-mon[34667]: pgmap v710: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.3 KiB/s rd, 207 B/s wr, 12 op/s 2024-09-21T08:01:21.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:21 smithi084 ceph-mon[30411]: pgmap v711: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-21T08:01:21.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:21 smithi191 ceph-mon[34667]: pgmap v711: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-21T08:01:22.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:21 smithi162 ceph-mon[34833]: pgmap v711: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-21T08:01:23.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:23 smithi084 ceph-mon[30411]: pgmap v712: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-21T08:01:23.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:23 smithi191 ceph-mon[34667]: pgmap v712: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-21T08:01:24.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:23 smithi162 ceph-mon[34833]: pgmap v712: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.9 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-21T08:01:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:25 smithi191 ceph-mon[34667]: pgmap v713: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.8 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T08:01:26.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:25 smithi162 ceph-mon[34833]: pgmap v713: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.8 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T08:01:26.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:25 smithi084 ceph-mon[30411]: pgmap v713: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.8 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-21T08:01:27.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:27 smithi191 ceph-mon[34667]: pgmap v714: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-09-21T08:01:28.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:27 smithi162 ceph-mon[34833]: pgmap v714: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-09-21T08:01:28.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:27 smithi084 ceph-mon[30411]: pgmap v714: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-09-21T08:01:29.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:29 smithi191 ceph-mon[34667]: pgmap v715: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 95 B/s wr, 12 op/s 2024-09-21T08:01:30.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:29 smithi162 ceph-mon[34833]: pgmap v715: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 95 B/s wr, 12 op/s 2024-09-21T08:01:30.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:29 smithi084 ceph-mon[30411]: pgmap v715: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 95 B/s wr, 12 op/s 2024-09-21T08:01:31.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:31 smithi191 ceph-mon[34667]: pgmap v716: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 op/s 2024-09-21T08:01:32.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:31 smithi162 ceph-mon[34833]: pgmap v716: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 op/s 2024-09-21T08:01:32.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:31 smithi084 ceph-mon[30411]: pgmap v716: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 op/s 2024-09-21T08:01:33.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:33 smithi191 ceph-mon[34667]: pgmap v717: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:34.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:33 smithi162 ceph-mon[34833]: pgmap v717: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:34.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:33 smithi084 ceph-mon[30411]: pgmap v717: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:35 smithi191 ceph-mon[34667]: pgmap v718: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T08:01:36.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:35 smithi162 ceph-mon[34833]: pgmap v718: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T08:01:36.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:35 smithi084 ceph-mon[30411]: pgmap v718: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T08:01:37.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:37 smithi191 ceph-mon[34667]: pgmap v719: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:37 smithi162 ceph-mon[34833]: pgmap v719: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:38.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:37 smithi084 ceph-mon[30411]: pgmap v719: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:39 smithi191 ceph-mon[34667]: pgmap v720: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:40.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:39 smithi162 ceph-mon[34833]: pgmap v720: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:40.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:39 smithi084 ceph-mon[30411]: pgmap v720: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:40.838 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T08:01:40.839 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T08:01:40.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:41.225 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:41.718 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:41 smithi084 ceph-mon[30411]: pgmap v721: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.892+0000 7f34fb200640 1 -- 172.21.15.84:0/4224219458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 msgr2=0x7f34fc109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.892+0000 7f34fb200640 1 --2- 172.21.15.84:0/4224219458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 0x7f34fc109700 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009900 tx=0x7f34e402a410 comp rx=0 tx=0).stop 2024-09-21T08:01:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.893+0000 7f34fb200640 1 -- 172.21.15.84:0/4224219458 shutdown_connections 2024-09-21T08:01:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.893+0000 7f34fb200640 1 --2- 172.21.15.84:0/4224219458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc109c40 0x7f34fc110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.893+0000 7f34fb200640 1 --2- 172.21.15.84:0/4224219458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 0x7f34fc109700 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.893+0000 7f34fb200640 1 --2- 172.21.15.84:0/4224219458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc1039b0 0x7f34fc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.893+0000 7f34fb200640 1 -- 172.21.15.84:0/4224219458 >> 172.21.15.84:0/4224219458 conn(0x7f34fc0ff440 msgr2=0x7f34fc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.893+0000 7f34fb200640 1 -- 172.21.15.84:0/4224219458 shutdown_connections 2024-09-21T08:01:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.893+0000 7f34fb200640 1 -- 172.21.15.84:0/4224219458 wait complete. 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.894+0000 7f34fb200640 1 Processor -- start 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.894+0000 7f34fb200640 1 -- start start 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.894+0000 7f34fb200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc1039b0 0x7f34fc19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.894+0000 7f34fb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 0x7f34fc19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.894+0000 7f34fb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc109c40 0x7f34fc19fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34fb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc113900 con 0x7f34fc1092f0 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34fb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc113780 con 0x7f34fc109c40 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34fb200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc113a80 con 0x7f34fc1039b0 2024-09-21T08:01:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 0x7f34fc19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc1039b0 0x7f34fc19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc1039b0 0x7f34fc19a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:57742/0 (socket says 172.21.15.84:57742) 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 -- 172.21.15.84:0/1159160251 learned_addr learned my addr 172.21.15.84:0/1159160251 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34fa800640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc109c40 0x7f34fc19fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 -- 172.21.15.84:0/1159160251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc109c40 msgr2=0x7f34fc19fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc109c40 0x7f34fc19fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 -- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 msgr2=0x7f34fc19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 0x7f34fc19a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f9e00640 1 -- 172.21.15.84:0/1159160251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc1a0300 con 0x7f34fc1039b0 2024-09-21T08:01:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.895+0000 7f34f3e00640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 0x7f34fc19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.896+0000 7f34f9e00640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc1039b0 0x7f34fc19a390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00d950 tx=0x7f34ec00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.896+0000 7f34f2a00640 1 -- 172.21.15.84:0/1159160251 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec017070 con 0x7f34fc1039b0 2024-09-21T08:01:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.896+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34fc1a05f0 con 0x7f34fc1039b0 2024-09-21T08:01:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.896+0000 7f34f2a00640 1 -- 172.21.15.84:0/1159160251 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34ec009c30 con 0x7f34fc1039b0 2024-09-21T08:01:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.896+0000 7f34f2a00640 1 -- 172.21.15.84:0/1159160251 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00f620 con 0x7f34fc1039b0 2024-09-21T08:01:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.896+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34fc0755f0 con 0x7f34fc1039b0 2024-09-21T08:01:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.897+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34fc103dc0 con 0x7f34fc1039b0 2024-09-21T08:01:41.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.900+0000 7f34f2a00640 1 -- 172.21.15.84:0/1159160251 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f34ec010460 con 0x7f34fc1039b0 2024-09-21T08:01:41.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.901+0000 7f34f2a00640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34e00b6680 0x7f34e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:41.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.901+0000 7f34f2a00640 1 -- 172.21.15.84:0/1159160251 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f34ec0e76c0 con 0x7f34fc1039b0 2024-09-21T08:01:41.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.902+0000 7f34f3e00640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34e00b6680 0x7f34e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:41.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.902+0000 7f34f3e00640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34e00b6680 0x7f34e00b8b90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009230 tx=0x7f34e4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:41.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:41 smithi191 ceph-mon[34667]: pgmap v721: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:41.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:41.903+0000 7f34f2a00640 1 -- 172.21.15.84:0/1159160251 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34ec009de0 con 0x7f34fc1039b0 2024-09-21T08:01:42.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:41 smithi162 ceph-mon[34833]: pgmap v721: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:42.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.127+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34fc19b4c0 con 0x7f34fc1039b0 2024-09-21T08:01:42.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.130+0000 7f34f2a00640 1 -- 172.21.15.84:0/1159160251 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f34ec0b1c00 con 0x7f34fc1039b0 2024-09-21T08:01:42.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:01:42.131 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:01:42.131 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34e00b6680 msgr2=0x7f34e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34e00b6680 0x7f34e00b8b90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009230 tx=0x7f34e4031400 comp rx=0 tx=0).stop 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc1039b0 msgr2=0x7f34fc19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc1039b0 0x7f34fc19a390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00d950 tx=0x7f34ec00de10 comp rx=0 tx=0).stop 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 shutdown_connections 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f34e00b6680 0x7f34e00b8b90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc109c40 0x7f34fc19fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34fc1092f0 0x7f34fc19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 --2- 172.21.15.84:0/1159160251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34fc1039b0 0x7f34fc19a390 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 >> 172.21.15.84:0/1159160251 conn(0x7f34fc0ff440 msgr2=0x7f34fc101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 shutdown_connections 2024-09-21T08:01:42.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:42.132+0000 7f34fb200640 1 -- 172.21.15.84:0/1159160251 wait complete. 2024-09-21T08:01:42.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:42 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1159160251' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:42.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:42 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1159160251' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:42.928 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T08:01:42.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T08:01:43.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:42 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1159160251' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:43.298 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:43.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:43 smithi084 ceph-mon[30411]: pgmap v722: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:43.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:43 smithi191 ceph-mon[34667]: pgmap v722: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:44.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:43 smithi162 ceph-mon[34833]: pgmap v722: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 -- 172.21.15.84:0/4273950457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac810c050 msgr2=0x7f8ac8112880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 --2- 172.21.15.84:0/4273950457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac810c050 0x7f8ac8112880 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009ca0 tx=0x7f8ac002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 -- 172.21.15.84:0/4273950457 shutdown_connections 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 --2- 172.21.15.84:0/4273950457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac810c050 0x7f8ac8112880 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 --2- 172.21.15.84:0/4273950457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ac810b700 0x7f8ac810bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 --2- 172.21.15.84:0/4273950457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ac8105dc0 0x7f8ac81061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 -- 172.21.15.84:0/4273950457 >> 172.21.15.84:0/4273950457 conn(0x7f8ac81017d0 msgr2=0x7f8ac8103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 -- 172.21.15.84:0/4273950457 shutdown_connections 2024-09-21T08:01:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.062+0000 7f8acda00640 1 -- 172.21.15.84:0/4273950457 wait complete. 2024-09-21T08:01:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.063+0000 7f8acda00640 1 Processor -- start 2024-09-21T08:01:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8acda00640 1 -- start start 2024-09-21T08:01:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8acda00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac8105dc0 0x7f8ac819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8acda00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ac810b700 0x7f8ac819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8acda00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ac810c050 0x7f8ac81a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8acda00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8115d10 con 0x7f8ac8105dc0 2024-09-21T08:01:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8acda00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8115b90 con 0x7f8ac810c050 2024-09-21T08:01:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8acda00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8115e90 con 0x7f8ac810b700 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8ac6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac8105dc0 0x7f8ac819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8ac6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac8105dc0 0x7f8ac819c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35436/0 (socket says 172.21.15.84:35436) 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8ac6a00640 1 -- 172.21.15.84:0/3951968069 learned_addr learned my addr 172.21.15.84:0/3951968069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.064+0000 7f8abe000640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ac810b700 0x7f8ac819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.065+0000 7f8ac7400640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ac810c050 0x7f8ac81a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.065+0000 7f8ac6a00640 1 -- 172.21.15.84:0/3951968069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ac810b700 msgr2=0x7f8ac819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.065+0000 7f8ac6a00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ac810b700 0x7f8ac819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.065+0000 7f8ac6a00640 1 -- 172.21.15.84:0/3951968069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ac810c050 msgr2=0x7f8ac81a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.065+0000 7f8ac6a00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ac810c050 0x7f8ac81a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.065+0000 7f8ac6a00640 1 -- 172.21.15.84:0/3951968069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac81a25d0 con 0x7f8ac8105dc0 2024-09-21T08:01:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.065+0000 7f8ac6a00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac8105dc0 0x7f8ac819c660 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800e9f0 tx=0x7f8ab800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.066+0000 7f8abfe00640 1 -- 172.21.15.84:0/3951968069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800cd80 con 0x7f8ac8105dc0 2024-09-21T08:01:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.066+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac81a28c0 con 0x7f8ac8105dc0 2024-09-21T08:01:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.066+0000 7f8abfe00640 1 -- 172.21.15.84:0/3951968069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ab80108e0 con 0x7f8ac8105dc0 2024-09-21T08:01:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.066+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac81a9020 con 0x7f8ac8105dc0 2024-09-21T08:01:44.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.066+0000 7f8abfe00640 1 -- 172.21.15.84:0/3951968069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8026060 con 0x7f8ac8105dc0 2024-09-21T08:01:44.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.069+0000 7f8ad46ac740 1 Processor -- start 2024-09-21T08:01:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.069+0000 7f8ad46ac740 1 -- start start 2024-09-21T08:01:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.069+0000 7f8abfe00640 1 -- 172.21.15.84:0/3951968069 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8ab8010430 con 0x7f8ac8105dc0 2024-09-21T08:01:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.069+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x558427211350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.069+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e40980 0x558427211890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.069+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e48b60 0x558427211dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558427186ca0 con 0x558426e48b60 2024-09-21T08:01:44.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5584271760d0 con 0x558426e40980 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558427179ee0 con 0x558426e69840 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e40980 0x558427211890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8abe000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e48b60 0x558427211dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8abe000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e48b60 0x558427211dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35444/0 (socket says 172.21.15.84:35444) 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8abe000640 1 -- 172.21.15.84:0/1474092787 learned_addr learned my addr 172.21.15.84:0/1474092787 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e40980 0x558427211890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45876/0 (socket says 172.21.15.84:45876) 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x558427211350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac7400640 1 -- 172.21.15.84:0/1474092787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e40980 msgr2=0x558427211890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e40980 0x558427211890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac7400640 1 -- 172.21.15.84:0/1474092787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e48b60 msgr2=0x558427211dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e48b60 0x558427211dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.070+0000 7f8ac7400640 1 -- 172.21.15.84:0/1474092787 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558427128400 con 0x558426e69840 2024-09-21T08:01:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.071+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x558427211350 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0005e30 tx=0x7f8ac002f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aea4853cabd588c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.071+0000 7f8ab7e00640 1 -- 172.21.15.84:0/1474092787 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0031cf0 con 0x558426e69840 2024-09-21T08:01:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.071+0000 7f8abfe00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8aac0b6680 0x7f8aac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.071+0000 7f8ab7e00640 1 -- 172.21.15.84:0/1474092787 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ac0036030 con 0x558426e69840 2024-09-21T08:01:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.071+0000 7f8ab7e00640 1 -- 172.21.15.84:0/1474092787 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0004040 con 0x558426e69840 2024-09-21T08:01:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8abfe00640 1 -- 172.21.15.84:0/3951968069 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f8ab80e7e80 con 0x7f8ac8105dc0 2024-09-21T08:01:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ac6a00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8aac0b6680 0x7f8aac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1474092787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 msgr2=0x558427211350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x558427211350 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0005e30 tx=0x7f8ac002f410 comp rx=0 tx=0).stop 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1474092787 shutdown_connections 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e48b60 0x558427211dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e40980 0x558427211890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1474092787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x558427211350 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1474092787 >> 172.21.15.84:0/1474092787 conn(0x558426e5d990 msgr2=0x55842720f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ac6a00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8aac0b6680 0x7f8aac0b8b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55842720ffd0 tx=0x7f8ab80eb930 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.072+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1474092787 shutdown_connections 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.073+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1474092787 wait complete. 2024-09-21T08:01:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.073+0000 7f8ad46ac740 1 -- start start 2024-09-21T08:01:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.073+0000 7f8ad46ac740 1 Processor -- start 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x55842721c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x55842721cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842721d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558426fd77a0 con 0x558426e40980 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55842711ba10 con 0x558426e48b60 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55842721f950 con 0x558426e69840 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ad46ac740 10 client.0 _ll_register_callbacks cb 0x55842712bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ac7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x55842721c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ac7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x55842721c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35460/0 (socket says 172.21.15.84:35460) 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ac7400640 1 -- 172.21.15.84:0/4149861085 learned_addr learned my addr 172.21.15.84:0/4149861085 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8abe000640 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x55842721cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.074+0000 7f8ac7400640 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842721d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8abe000640 1 -- 172.21.15.84:0/4149861085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 msgr2=0x55842721d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8abe000640 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842721d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8abe000640 1 -- 172.21.15.84:0/4149861085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 msgr2=0x55842721c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8abe000640 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x55842721c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8abe000640 1 -- 172.21.15.84:0/4149861085 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558426ee3b90 con 0x558426e48b60 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8abe000640 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x55842721cec0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00126e0 tx=0x7f8ab0012ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df4c14587a72107 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8ab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8ab4c00640 1 -- 172.21.15.84:0/4149861085 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000f920 con 0x558426e48b60 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac0036030 con 0x558426e48b60 2024-09-21T08:01:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.075+0000 7f8ab4c00640 1 -- 172.21.15.84:0/4149861085 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f8ab000fac0 con 0x558426e48b60 2024-09-21T08:01:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.076+0000 7f8ab4c00640 1 -- 172.21.15.84:0/4149861085 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ab000fcc0 con 0x558426e48b60 2024-09-21T08:01:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.076+0000 7f8ad46ac740 10 client.28088 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.076+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55842722b6d0 con 0x558426e48b60 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.076+0000 7f8ab4c00640 1 -- 172.21.15.84:0/4149861085 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ac0036030 con 0x558426e48b60 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ab4c00640 1 -- 172.21.15.84:0/4149861085 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8ab0005360 con 0x558426e48b60 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ad46ac740 10 client.28088 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ad46ac740 10 client.28088 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ad46ac740 20 client.28088 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426e281c0 0x55842722ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ad46ac740 4 client.28088 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558427188bf0 con 0x558426e281c0 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.077+0000 7f8ac7400640 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426e281c0 0x55842722ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.078+0000 7f8ac7400640 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426e281c0 0x55842722ebb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4db4154b9d2cc66 server_cookie=95e6ef1c011ed766 in_seq=0 out_seq=0 2024-09-21T08:01:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.078+0000 7f8ab4c00640 10 client.28088 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.078+0000 7f8ab4c00640 1 -- 172.21.15.84:0/4149861085 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558427188bf0 con 0x558426e281c0 2024-09-21T08:01:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.078+0000 7f8ab4c00640 10 client.28088 handle_command_reply: tid=0 2024-09-21T08:01:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 client.28088 shutdown 2024-09-21T08:01:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 msgr2=0x55842721cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x55842721cec0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00126e0 tx=0x7f8ab0012ba0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 shutdown_connections 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426e281c0 0x55842722ebb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842721d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x55842721cec0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4149861085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x55842721c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ab4c00640 0 client.28088 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 >> 172.21.15.84:0/4149861085 conn(0x558426e5d990 msgr2=0x55842720d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 shutdown_connections 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4149861085 wait complete. 2024-09-21T08:01:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.079+0000 7f8ad46ac740 20 client.28088 trim_cache size 0 max 16384 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 Processor -- start 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 -- start start 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x558427228270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x5584272287b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842720e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b2f90 con 0x558426e40980 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b4ad0 con 0x558426e48b60 2024-09-21T08:01:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b3660 con 0x558426e69840 2024-09-21T08:01:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.097+0000 7f8ac7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x558427228270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x558427228270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35462/0 (socket says 172.21.15.84:35462) 2024-09-21T08:01:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 -- 172.21.15.84:0/4143009652 learned_addr learned my addr 172.21.15.84:0/4143009652 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8abe000640 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x5584272287b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842720e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 -- 172.21.15.84:0/4143009652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 msgr2=0x55842720e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842720e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 -- 172.21.15.84:0/4143009652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 msgr2=0x5584272287b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x5584272287b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 -- 172.21.15.84:0/4143009652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842720ac50 con 0x558426e40980 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.098+0000 7f8ac7400640 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x558427228270 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0003bc0 tx=0x7f8ac0003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa90eae8964ef70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.099+0000 7f8ab7400640 1 -- 172.21.15.84:0/4143009652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0031450 con 0x558426e40980 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.099+0000 7f8ab7400640 1 -- 172.21.15.84:0/4143009652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ac0036070 con 0x558426e40980 2024-09-21T08:01:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.099+0000 7f8ab7400640 1 -- 172.21.15.84:0/4143009652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00305c0 con 0x558426e40980 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.099+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4143009652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 msgr2=0x558427228270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.099+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x558427228270 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0003bc0 tx=0x7f8ac0003bf0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4143009652 shutdown_connections 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e69840 0x55842720e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x5584272287b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/4143009652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e40980 0x558427228270 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4143009652 >> 172.21.15.84:0/4143009652 conn(0x558426e5d990 msgr2=0x558427227b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4143009652 shutdown_connections 2024-09-21T08:01:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 -- 172.21.15.84:0/4143009652 wait complete. 2024-09-21T08:01:44.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 -- start start 2024-09-21T08:01:44.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.100+0000 7f8ad46ac740 1 Processor -- start 2024-09-21T08:01:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e40980 0x5584272234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x558427223a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ad46ac740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e69840 0x558427292590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b4400 con 0x558426e69840 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b3d30 con 0x558426e48b60 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ad46ac740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b0f90 con 0x558426e40980 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ad46ac740 10 client.0 _ll_register_callbacks cb 0x7f8ab0009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8abe000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x558427223a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8abe000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x558427223a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45896/0 (socket says 172.21.15.84:45896) 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8abe000640 1 -- 172.21.15.84:0/1909818684 learned_addr learned my addr 172.21.15.84:0/1909818684 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e69840 0x558427292590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.101+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e40980 0x5584272234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8abe000640 1 -- 172.21.15.84:0/1909818684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e40980 msgr2=0x5584272234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8abe000640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e40980 0x5584272234a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8abe000640 1 -- 172.21.15.84:0/1909818684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e69840 msgr2=0x558427292590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8abe000640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e69840 0x558427292590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8abe000640 1 -- 172.21.15.84:0/1909818684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558427292c00 con 0x558426e48b60 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e40980 0x5584272234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8abe000640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x558427223a80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8ab001c510 tx=0x7f8ab000f830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ddbfcd293f822cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8ab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8ab4c00640 1 -- 172.21.15.84:0/1909818684 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00053a0 con 0x558426e48b60 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac0036070 con 0x558426e48b60 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.102+0000 7f8ab4c00640 1 -- 172.21.15.84:0/1909818684 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f8ab00035f0 con 0x558426e48b60 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ab4c00640 1 -- 172.21.15.84:0/1909818684 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ab0005540 con 0x558426e48b60 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ad46ac740 10 client.28094 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558427299f30 con 0x558426e48b60 2024-09-21T08:01:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ab4c00640 1 -- 172.21.15.84:0/1909818684 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ac0036070 con 0x558426e48b60 2024-09-21T08:01:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ab4c00640 1 -- 172.21.15.84:0/1909818684 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8ab001c9e0 con 0x558426e48b60 2024-09-21T08:01:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ad46ac740 10 client.28094 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ad46ac740 10 client.28094 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:01:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.103+0000 7f8ad46ac740 20 client.28094 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.104+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426dfd570 0x55842729c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.104+0000 7f8ad46ac740 4 client.28094 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T08:01:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.104+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x5584271846a0 con 0x558426dfd570 2024-09-21T08:01:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.104+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426dfd570 0x55842729c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.104+0000 7f8ac7400640 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426dfd570 0x55842729c7e0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bcb9023739a9565 server_cookie=aa32a99d1f731a27 in_seq=0 out_seq=0 2024-09-21T08:01:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.104+0000 7f8ab4c00640 10 client.28094 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:44.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ab4c00640 1 -- 172.21.15.84:0/1909818684 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5584271846a0 con 0x558426dfd570 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ab4c00640 10 client.28094 handle_command_reply: tid=0 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 client.28094 shutdown 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 msgr2=0x558427223a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x558427223a80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8ab001c510 tx=0x7f8ab000f830 comp rx=0 tx=0).stop 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 shutdown_connections 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558426e69840 0x558427292590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558426e48b60 0x558427223a80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x558426dfd570 0x55842729c7e0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 --2- 172.21.15.84:0/1909818684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558426e40980 0x5584272234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ab4c00640 0 client.28094 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 >> 172.21.15.84:0/1909818684 conn(0x558426e5d990 msgr2=0x558427228520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 shutdown_connections 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.122+0000 7f8ad46ac740 1 -- 172.21.15.84:0/1909818684 wait complete. 2024-09-21T08:01:44.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8ad46ac740 20 client.28094 trim_cache size 0 max 16384 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 38, 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "741934d5": { 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 38, 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:01:44.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 144.5, 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:44.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8aac0b6680 msgr2=0x7f8aac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8aac0b6680 0x7f8aac0b8b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55842720ffd0 tx=0x7f8ab80eb930 comp rx=0 tx=0).stop 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac8105dc0 msgr2=0x7f8ac819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac8105dc0 0x7f8ac819c660 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800e9f0 tx=0x7f8ab800eeb0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 shutdown_connections 2024-09-21T08:01:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8aac0b6680 0x7f8aac0b8b90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ac810c050 0x7f8ac81a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ac810b700 0x7f8ac819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 --2- 172.21.15.84:0/3951968069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac8105dc0 0x7f8ac819c660 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.123+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 >> 172.21.15.84:0/3951968069 conn(0x7f8ac81017d0 msgr2=0x7f8ac8108c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.124+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 shutdown_connections 2024-09-21T08:01:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:44.124+0000 7f8acda00640 1 -- 172.21.15.84:0/3951968069 wait complete. 2024-09-21T08:01:44.884 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '741934d5', quiesce took 4.0 seconds. Will release after: 20.5 2024-09-21T08:01:45.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:45 smithi191 ceph-mon[34667]: pgmap v723: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:45 smithi162 ceph-mon[34833]: pgmap v723: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:46.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:45 smithi084 ceph-mon[30411]: pgmap v723: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:47.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:47 smithi191 ceph-mon[34667]: pgmap v724: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T08:01:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:47 smithi162 ceph-mon[34833]: pgmap v724: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T08:01:48.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:47 smithi084 ceph-mon[30411]: pgmap v724: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T08:01:48.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:01:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:49.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 -- 172.21.15.84:0/3977281098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184078290 msgr2=0x7f2184114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 --2- 172.21.15.84:0/3977281098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184078290 0x7f2184114200 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f216c009900 tx=0x7f216c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 -- 172.21.15.84:0/3977281098 shutdown_connections 2024-09-21T08:01:49.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 --2- 172.21.15.84:0/3977281098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2184114740 0x7f2184116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 --2- 172.21.15.84:0/3977281098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184078290 0x7f2184114200 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 --2- 172.21.15.84:0/3977281098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184077940 0x7f2184077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 -- 172.21.15.84:0/3977281098 >> 172.21.15.84:0/3977281098 conn(0x7f2184101810 msgr2=0x7f2184103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:49.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 -- 172.21.15.84:0/3977281098 shutdown_connections 2024-09-21T08:01:49.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.597+0000 7f218bc00640 1 -- 172.21.15.84:0/3977281098 wait complete. 2024-09-21T08:01:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.598+0000 7f218bc00640 1 Processor -- start 2024-09-21T08:01:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f218bc00640 1 -- start start 2024-09-21T08:01:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f218bc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2184077940 0x7f21841a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f218bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184078290 0x7f21841a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f218bc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184114740 0x7f21841a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f218bc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f218411a090 con 0x7f2184114740 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f218bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2184119f10 con 0x7f2184078290 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f218bc00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f218411a210 con 0x7f2184077940 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f2189c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184114740 0x7f21841a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f217be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184078290 0x7f21841a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f2189200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2184077940 0x7f21841a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f217be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184078290 0x7f21841a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60654/0 (socket says 172.21.15.84:60654) 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.599+0000 7f217be00640 1 -- 172.21.15.84:0/7075706 learned_addr learned my addr 172.21.15.84:0/7075706 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f217be00640 1 -- 172.21.15.84:0/7075706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2184077940 msgr2=0x7f21841a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f217be00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2184077940 0x7f21841a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f217be00640 1 -- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184114740 msgr2=0x7f21841a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f217be00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184114740 0x7f21841a6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f217be00640 1 -- 172.21.15.84:0/7075706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21841a6a90 con 0x7f2184078290 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f2189c00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184114740 0x7f21841a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f217be00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184078290 0x7f21841a10c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f216c02a910 tx=0x7f216c031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f2182000640 1 -- 172.21.15.84:0/7075706 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c03f030 con 0x7f2184078290 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.600+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21841a6d20 con 0x7f2184078290 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.601+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21841ad4e0 con 0x7f2184078290 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.601+0000 7f2182000640 1 -- 172.21.15.84:0/7075706 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c004490 con 0x7f2184078290 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.601+0000 7f2182000640 1 -- 172.21.15.84:0/7075706 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c035070 con 0x7f2184078290 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 Processor -- start 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 -- start start 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5560a5828f70 con 0x5560a550b070 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5560a58183a0 con 0x5560a54e21b0 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.604+0000 7f2192522740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5560a581c1b0 con 0x5560a54ea390 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2182000640 1 -- 172.21.15.84:0/7075706 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f216c042030 con 0x7f2184078290 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47666/0 (socket says 172.21.15.84:47666) 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 -- 172.21.15.84:0/2795858994 learned_addr learned my addr 172.21.15.84:0/2795858994 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189200640 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f217be00640 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 -- 172.21.15.84:0/2795858994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 msgr2=0x5560a58b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 -- 172.21.15.84:0/2795858994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 msgr2=0x5560a58b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f2189c00640 1 -- 172.21.15.84:0/2795858994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a57e2c90 con 0x5560a550b070 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.605+0000 7f217be00640 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.606+0000 7f2189c00640 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58b1d60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f217c011790 tx=0x7f217c011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d830e1f781c6664a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.607+0000 7f2182000640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21680b6700 0x7f21680b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.607+0000 7f2182000640 1 -- 172.21.15.84:0/7075706 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f216c107db0 con 0x7f2184078290 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.607+0000 7f2189200640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21680b6700 0x7f21680b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.608+0000 7f2189200640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21680b6700 0x7f21680b8c10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x5560a58b09e0 tx=0x7f2174005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.609+0000 7f217a000640 1 -- 172.21.15.84:0/2795858994 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c003c30 con 0x5560a550b070 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.609+0000 7f217a000640 1 -- 172.21.15.84:0/2795858994 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f217c00fe50 con 0x5560a550b070 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.609+0000 7f217a000640 1 -- 172.21.15.84:0/2795858994 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c0193e0 con 0x5560a550b070 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 -- 172.21.15.84:0/2795858994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 msgr2=0x5560a58b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58b1d60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f217c011790 tx=0x7f217c011c50 comp rx=0 tx=0).stop 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 -- 172.21.15.84:0/2795858994 shutdown_connections 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 --2- 172.21.15.84:0/2795858994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58b1d60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 -- 172.21.15.84:0/2795858994 >> 172.21.15.84:0/2795858994 conn(0x5560a54ff460 msgr2=0x5560a58afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 -- 172.21.15.84:0/2795858994 shutdown_connections 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.610+0000 7f2192522740 1 -- 172.21.15.84:0/2795858994 wait complete. 2024-09-21T08:01:49.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.611+0000 7f2192522740 1 -- start start 2024-09-21T08:01:49.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.611+0000 7f2192522740 1 Processor -- start 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2192522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2192522740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2192522740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a550b070 0x5560a58c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2192522740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5560a5679700 con 0x5560a54ea390 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2192522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5560a57b3540 con 0x5560a54e21b0 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2192522740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5560a58c0540 con 0x5560a550b070 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2192522740 10 client.0 _ll_register_callbacks cb 0x5560a57c3430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2189200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f2189c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a550b070 0x5560a58c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58bdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47674/0 (socket says 172.21.15.84:47674) 2024-09-21T08:01:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 -- 172.21.15.84:0/1780360347 learned_addr learned my addr 172.21.15.84:0/1780360347 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 -- 172.21.15.84:0/1780360347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a550b070 msgr2=0x5560a58c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a550b070 0x5560a58c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 -- 172.21.15.84:0/1780360347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 msgr2=0x5560a58bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58bd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.612+0000 7f217be00640 1 -- 172.21.15.84:0/1780360347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a5576650 con 0x5560a54ea390 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2189c00640 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a550b070 0x5560a58c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f217be00640 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58bdaa0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f216c006010 tx=0x7f216c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aac9008e39790cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2172a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2172a00640 1 -- 172.21.15.84:0/1780360347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c049070 con 0x5560a54ea390 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2172a00640 1 -- 172.21.15.84:0/1780360347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f216c0ccd20 con 0x5560a54ea390 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5560a57b5b50 con 0x5560a54ea390 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2172a00640 1 -- 172.21.15.84:0/1780360347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f216c0cd030 con 0x5560a54ea390 2024-09-21T08:01:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2192522740 10 client.17742 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.613+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5560a57d0910 con 0x5560a54ea390 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2172a00640 1 -- 172.21.15.84:0/1780360347 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5560a57b5b50 con 0x5560a54ea390 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2172a00640 1 -- 172.21.15.84:0/1780360347 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f216c0c9210 con 0x5560a54ea390 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2192522740 10 client.17742 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2192522740 10 client.17742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2192522740 20 client.17742 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2192522740 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a54c99f0 0x5560a58cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2192522740 4 client.17742 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560a582aec0 con 0x5560a54c99f0 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.614+0000 7f2189200640 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a54c99f0 0x5560a58cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.615+0000 7f2189200640 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a54c99f0 0x5560a58cf6c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b9d6e5e2afd349 server_cookie=f19b2eee3fe36668 in_seq=0 out_seq=0 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.615+0000 7f2172a00640 10 client.17742 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.616+0000 7f2172a00640 1 -- 172.21.15.84:0/1780360347 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560a582aec0 con 0x5560a54c99f0 2024-09-21T08:01:49.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.616+0000 7f2172a00640 10 client.17742 handle_command_reply: tid=0 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.616+0000 7f2192522740 1 client.17742 shutdown 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.616+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 msgr2=0x5560a58bdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.616+0000 7f2192522740 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58bdaa0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f216c006010 tx=0x7f216c003f60 comp rx=0 tx=0).stop 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.616+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 shutdown_connections 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.616+0000 7f2192522740 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a54c99f0 0x5560a58cf6c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2192522740 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a550b070 0x5560a58c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2192522740 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58bdaa0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2192522740 1 --2- 172.21.15.84:0/1780360347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 >> 172.21.15.84:0/1780360347 conn(0x5560a54ff460 msgr2=0x5560a58b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2172a00640 0 client.17742 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 shutdown_connections 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2192522740 1 -- 172.21.15.84:0/1780360347 wait complete. 2024-09-21T08:01:49.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.617+0000 7f2192522740 20 client.17742 trim_cache size 0 max 16384 2024-09-21T08:01:49.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 Processor -- start 2024-09-21T08:01:49.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 -- start start 2024-09-21T08:01:49.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58c9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21841b7490 con 0x5560a550b070 2024-09-21T08:01:49.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21841b8fd0 con 0x5560a54e21b0 2024-09-21T08:01:49.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.635+0000 7f2192522740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21841b7b60 con 0x5560a54ea390 2024-09-21T08:01:49.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60682/0 (socket says 172.21.15.84:60682) 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 -- 172.21.15.84:0/706433865 learned_addr learned my addr 172.21.15.84:0/706433865 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189c00640 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f217be00640 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 -- 172.21.15.84:0/706433865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 msgr2=0x5560a58c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 -- 172.21.15.84:0/706433865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 msgr2=0x5560a58c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 -- 172.21.15.84:0/706433865 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a58be820 con 0x5560a54e21b0 2024-09-21T08:01:49.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.636+0000 7f2189200640 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b34a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2174009b80 tx=0x7f217401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51257f2824e99365 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:49.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2179600640 1 -- 172.21.15.84:0/706433865 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217402b420 con 0x5560a54e21b0 2024-09-21T08:01:49.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2179600640 1 -- 172.21.15.84:0/706433865 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f217402ba70 con 0x5560a54e21b0 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2179600640 1 -- 172.21.15.84:0/706433865 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740329f0 con 0x5560a54e21b0 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2192522740 1 -- 172.21.15.84:0/706433865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 msgr2=0x5560a58b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2192522740 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b34a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2174009b80 tx=0x7f217401b000 comp rx=0 tx=0).stop 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2192522740 1 -- 172.21.15.84:0/706433865 shutdown_connections 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2192522740 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a550b070 0x5560a58c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2192522740 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54ea390 0x5560a58c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2192522740 1 --2- 172.21.15.84:0/706433865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a54e21b0 0x5560a58b34a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.637+0000 7f2192522740 1 -- 172.21.15.84:0/706433865 >> 172.21.15.84:0/706433865 conn(0x5560a54ff460 msgr2=0x5560a58b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.638+0000 7f2192522740 1 -- 172.21.15.84:0/706433865 shutdown_connections 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.638+0000 7f2192522740 1 -- 172.21.15.84:0/706433865 wait complete. 2024-09-21T08:01:49.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.638+0000 7f2192522740 1 -- start start 2024-09-21T08:01:49.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.638+0000 7f2192522740 1 Processor -- start 2024-09-21T08:01:49.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2192522740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54e21b0 0x5560a58c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2192522740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58c2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2192522740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a550b070 0x5560a58c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2192522740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21841b8900 con 0x5560a54ea390 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2192522740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21841b8230 con 0x5560a550b070 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2192522740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21841b5490 con 0x5560a54e21b0 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2192522740 10 client.0 _ll_register_callbacks cb 0x7f216c0c9fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f217be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f217be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58c2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47682/0 (socket says 172.21.15.84:47682) 2024-09-21T08:01:49.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2189c00640 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a550b070 0x5560a58c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f217be00640 1 -- 172.21.15.84:0/3043418742 learned_addr learned my addr 172.21.15.84:0/3043418742 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f2189200640 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54e21b0 0x5560a58c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f217be00640 1 -- 172.21.15.84:0/3043418742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54e21b0 msgr2=0x5560a58c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.639+0000 7f217be00640 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54e21b0 0x5560a58c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f217be00640 1 -- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a550b070 msgr2=0x5560a58c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f217be00640 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a550b070 0x5560a58c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f217be00640 1 -- 172.21.15.84:0/3043418742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a58c2d90 con 0x5560a54ea390 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f217be00640 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58c2290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f216c03b510 tx=0x7f216c0c94a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c687cdc0e51a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f2172a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f2172a00640 1 -- 172.21.15.84:0/3043418742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c049070 con 0x5560a54ea390 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f2172a00640 1 -- 172.21.15.84:0/3043418742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f216c0ccb20 con 0x5560a54ea390 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f217402ba70 con 0x5560a54ea390 2024-09-21T08:01:49.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f2172a00640 1 -- 172.21.15.84:0/3043418742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f216c1055a0 con 0x5560a54ea390 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f2192522740 10 client.17748 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.640+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5560a58c2d90 con 0x5560a54ea390 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2172a00640 1 -- 172.21.15.84:0/3043418742 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c07a020 con 0x5560a54ea390 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2172a00640 1 -- 172.21.15.84:0/3043418742 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f216c0d3480 con 0x5560a54ea390 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2192522740 10 client.17748 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2192522740 10 client.17748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2192522740 20 client.17748 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2192522740 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a549eda0 0x5560a593d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2192522740 4 client.17748 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:01:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560a5826970 con 0x5560a549eda0 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.641+0000 7f2189200640 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a549eda0 0x5560a593d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.642+0000 7f2189200640 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a549eda0 0x5560a593d1e0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f855a90e9e491a8e server_cookie=6cca8ca098847fbb in_seq=0 out_seq=0 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.642+0000 7f2172a00640 10 client.17748 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.642+0000 7f2172a00640 1 -- 172.21.15.84:0/3043418742 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x5560a5826970 con 0x5560a549eda0 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.642+0000 7f2172a00640 10 client.17748 handle_command_reply: tid=0 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.642+0000 7f2192522740 1 client.17748 shutdown 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.642+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 msgr2=0x5560a58c2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.642+0000 7f2192522740 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58c2290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f216c03b510 tx=0x7f216c0c94a0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 shutdown_connections 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560a550b070 0x5560a58c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5560a54ea390 0x5560a58c2290 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5560a549eda0 0x5560a593d1e0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 --2- 172.21.15.84:0/3043418742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5560a54e21b0 0x5560a58c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 >> 172.21.15.84:0/3043418742 conn(0x5560a54ff460 msgr2=0x5560a58bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2172a00640 0 client.17748 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 shutdown_connections 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 1 -- 172.21.15.84:0/3043418742 wait complete. 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f2192522740 20 client.17748 trim_cache size 0 max 16384 2024-09-21T08:01:49.649 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "73eff468-1da5-4975-a63e-c0f57a3f64cd": { 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:01:15.381648+0000", 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "63a41a05-d44f-45b2-983d-1fa6b7559a20": { 2024-09-21T08:01:49.650 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:00:25.066675+0000", 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.652 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T08:01:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.654 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.655 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T08:01:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:01:49.657 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21680b6700 msgr2=0x7f21680b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f218bc00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21680b6700 0x7f21680b8c10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x5560a58b09e0 tx=0x7f2174005f90 comp rx=0 tx=0).stop 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184078290 msgr2=0x7f21841a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.643+0000 7f218bc00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184078290 0x7f21841a10c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f216c02a910 tx=0x7f216c031a20 comp rx=0 tx=0).stop 2024-09-21T08:01:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 shutdown_connections 2024-09-21T08:01:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f21680b6700 0x7f21680b8c10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2184114740 0x7f21841a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2184078290 0x7f21841a10c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 --2- 172.21.15.84:0/7075706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2184077940 0x7f21841a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 >> 172.21.15.84:0/7075706 conn(0x7f2184101810 msgr2=0x7f21841167d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 shutdown_connections 2024-09-21T08:01:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:49.644+0000 7f218bc00640 1 -- 172.21.15.84:0/7075706 wait complete. 2024-09-21T08:01:49.813 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:49 smithi084 ceph-mon[30411]: pgmap v725: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:49.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:49 smithi191 ceph-mon[34667]: pgmap v725: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:50.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:49 smithi162 ceph-mon[34833]: pgmap v725: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:50.498 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:01:50.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:01:50.877 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 -- 172.21.15.84:0/1297624888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 msgr2=0x7f3408104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 --2- 172.21.15.84:0/1297624888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f3408104bd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009900 tx=0x7f33f802a400 comp rx=0 tx=0).stop 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 -- 172.21.15.84:0/1297624888 shutdown_connections 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 --2- 172.21.15.84:0/1297624888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f340810dc20 0x7f3408110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 --2- 172.21.15.84:0/1297624888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3408105110 0x7f340810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 --2- 172.21.15.84:0/1297624888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f3408104bd0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 -- 172.21.15.84:0/1297624888 >> 172.21.15.84:0/1297624888 conn(0x7f34080fe2c0 msgr2=0x7f3408100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 -- 172.21.15.84:0/1297624888 shutdown_connections 2024-09-21T08:01:51.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.543+0000 7f3407200640 1 -- 172.21.15.84:0/1297624888 wait complete. 2024-09-21T08:01:51.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.544+0000 7f3407200640 1 Processor -- start 2024-09-21T08:01:51.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3407200640 1 -- start start 2024-09-21T08:01:51.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3407200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f340819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3407200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3408105110 0x7f340819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3407200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f340810dc20 0x7f340819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3407200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f34081138d0 con 0x7f34081047c0 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3407200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3408113750 con 0x7f340810dc20 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3407200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3408113a50 con 0x7f3408105110 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3405e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f340819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3405e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f340819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47686/0 (socket says 172.21.15.84:47686) 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3405e00640 1 -- 172.21.15.84:0/588142874 learned_addr learned my addr 172.21.15.84:0/588142874 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f33fd400640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3408105110 0x7f340819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.545+0000 7f3406800640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f340810dc20 0x7f340819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f3405e00640 1 -- 172.21.15.84:0/588142874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3408105110 msgr2=0x7f340819a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f3405e00640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3408105110 0x7f340819a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f3405e00640 1 -- 172.21.15.84:0/588142874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f340810dc20 msgr2=0x7f340819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:51.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f3405e00640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f340810dc20 0x7f340819fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f3405e00640 1 -- 172.21.15.84:0/588142874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34081a0270 con 0x7f34081047c0 2024-09-21T08:01:51.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f3405e00640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f340819a300 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f33f8005ab0 tx=0x7f33f8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:51.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f33ff400640 1 -- 172.21.15.84:0/588142874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f803f070 con 0x7f34081047c0 2024-09-21T08:01:51.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34081a0500 con 0x7f34081047c0 2024-09-21T08:01:51.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.546+0000 7f33ff400640 1 -- 172.21.15.84:0/588142874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33f8031d60 con 0x7f34081047c0 2024-09-21T08:01:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.547+0000 7f33ff400640 1 -- 172.21.15.84:0/588142874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8035030 con 0x7f34081047c0 2024-09-21T08:01:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.547+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081a6cc0 con 0x7f34081047c0 2024-09-21T08:01:51.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.548+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3408104bd0 con 0x7f34081047c0 2024-09-21T08:01:51.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.550+0000 7f33ff400640 1 -- 172.21.15.84:0/588142874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f33f8042070 con 0x7f34081047c0 2024-09-21T08:01:51.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.552+0000 7f33ff400640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33ec0b6680 0x7f33ec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:51.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.553+0000 7f33ff400640 1 -- 172.21.15.84:0/588142874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f33f81088f0 con 0x7f34081047c0 2024-09-21T08:01:51.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.553+0000 7f33fd400640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33ec0b6680 0x7f33ec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:51.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.553+0000 7f33fd400640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33ec0b6680 0x7f33ec0b8b90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3408110220 tx=0x7f33f000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:51.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.555+0000 7f33ff400640 1 -- 172.21.15.84:0/588142874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33f80d2e30 con 0x7f34081047c0 2024-09-21T08:01:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.783+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34081a6ec0 con 0x7f34081047c0 2024-09-21T08:01:51.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.784+0000 7f33ff400640 1 -- 172.21.15.84:0/588142874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f33f80d7030 con 0x7f34081047c0 2024-09-21T08:01:51.786 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:01:51.786 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:01:51.786 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33ec0b6680 msgr2=0x7f33ec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33ec0b6680 0x7f33ec0b8b90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3408110220 tx=0x7f33f000b390 comp rx=0 tx=0).stop 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 msgr2=0x7f340819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f340819a300 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f33f8005ab0 tx=0x7f33f8003cd0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 shutdown_connections 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f33ec0b6680 0x7f33ec0b8b90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f340810dc20 0x7f340819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3408105110 0x7f340819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 --2- 172.21.15.84:0/588142874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34081047c0 0x7f340819a300 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:51.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 >> 172.21.15.84:0/588142874 conn(0x7f34080fe2c0 msgr2=0x7f3408107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:51.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 shutdown_connections 2024-09-21T08:01:51.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:51.786+0000 7f3407200640 1 -- 172.21.15.84:0/588142874 wait complete. 2024-09-21T08:01:51.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:51 smithi084 ceph-mon[30411]: pgmap v726: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:51.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:51 smithi191 ceph-mon[34667]: pgmap v726: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:51 smithi162 ceph-mon[34833]: pgmap v726: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:52.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T08:01:52.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:52 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/588142874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:52.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:52 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/588142874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:52.916 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:53.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:52 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/588142874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:01:53.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 -- 172.21.15.84:0/4084790433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac18103b60 msgr2=0x7fac18103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 --2- 172.21.15.84:0/4084790433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac18103b60 0x7fac18103f70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fac08009be0 tx=0x7fac0802a6c0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 -- 172.21.15.84:0/4084790433 shutdown_connections 2024-09-21T08:01:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 --2- 172.21.15.84:0/4084790433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18109df0 0x7fac18110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 --2- 172.21.15.84:0/4084790433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac181094a0 0x7fac181098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 --2- 172.21.15.84:0/4084790433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac18103b60 0x7fac18103f70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 -- 172.21.15.84:0/4084790433 >> 172.21.15.84:0/4084790433 conn(0x7fac1807b850 msgr2=0x7fac1807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 -- 172.21.15.84:0/4084790433 shutdown_connections 2024-09-21T08:01:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.554+0000 7fac1da00640 1 -- 172.21.15.84:0/4084790433 wait complete. 2024-09-21T08:01:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.555+0000 7fac1da00640 1 Processor -- start 2024-09-21T08:01:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac1da00640 1 -- start start 2024-09-21T08:01:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac1da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18103b60 0x7fac1819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac1da00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac181094a0 0x7fac1819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac1da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac18109df0 0x7fac1819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac1da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fac18113ab0 con 0x7fac18103b60 2024-09-21T08:01:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac1da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac18113930 con 0x7fac18109df0 2024-09-21T08:01:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac1da00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac18113c30 con 0x7fac181094a0 2024-09-21T08:01:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac16a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18103b60 0x7fac1819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac0e000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac181094a0 0x7fac1819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac16a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18103b60 0x7fac1819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47706/0 (socket says 172.21.15.84:47706) 2024-09-21T08:01:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac16a00640 1 -- 172.21.15.84:0/2440548881 learned_addr learned my addr 172.21.15.84:0/2440548881 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.556+0000 7fac17400640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac18109df0 0x7fac1819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac16a00640 1 -- 172.21.15.84:0/2440548881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac181094a0 msgr2=0x7fac1819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac16a00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac181094a0 0x7fac1819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac16a00640 1 -- 172.21.15.84:0/2440548881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac18109df0 msgr2=0x7fac1819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac16a00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac18109df0 0x7fac1819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac16a00640 1 -- 172.21.15.84:0/2440548881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac181a0490 con 0x7fac18103b60 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac0e000640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac181094a0 0x7fac1819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac17400640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac18109df0 0x7fac1819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac16a00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18103b60 0x7fac1819a520 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fac08004af0 tx=0x7fac08003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.557+0000 7fac0fe00640 1 -- 172.21.15.84:0/2440548881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08040020 con 0x7fac18103b60 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.558+0000 7fac0fe00640 1 -- 172.21.15.84:0/2440548881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac08030970 con 0x7fac18103b60 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.558+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac181a0720 con 0x7fac18103b60 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.558+0000 7fac0fe00640 1 -- 172.21.15.84:0/2440548881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08036040 con 0x7fac18103b60 2024-09-21T08:01:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.558+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac181a6ee0 con 0x7fac18103b60 2024-09-21T08:01:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 Processor -- start 2024-09-21T08:01:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 -- start start 2024-09-21T08:01:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac0fe00640 1 -- 172.21.15.84:0/2440548881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fac08043020 con 0x7fac18103b60 2024-09-21T08:01:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6523070 0x556ea68c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556ea6840fb0 con 0x556ea6523070 2024-09-21T08:01:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556ea68303e0 con 0x556ea6502390 2024-09-21T08:01:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.561+0000 7fac245d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556ea68341f0 con 0x556ea64fa1b0 2024-09-21T08:01:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6523070 0x556ea68c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6523070 0x556ea68c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47718/0 (socket says 172.21.15.84:47718) 2024-09-21T08:01:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 -- 172.21.15.84:0/2646380514 learned_addr learned my addr 172.21.15.84:0/2646380514 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac16a00640 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac0e000640 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 -- 172.21.15.84:0/2646380514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 msgr2=0x556ea68ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 -- 172.21.15.84:0/2646380514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 msgr2=0x556ea68ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.562+0000 7fac17400640 1 -- 172.21.15.84:0/2646380514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ea67facd0 con 0x556ea6523070 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.563+0000 7fac17400640 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6523070 0x556ea68c9ba0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fac10009fb0 tx=0x7fac100118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270aaa8ebe5ce409 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.563+0000 7fac07e00640 1 -- 172.21.15.84:0/2646380514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1001e070 con 0x556ea6523070 2024-09-21T08:01:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.563+0000 7fac07e00640 1 -- 172.21.15.84:0/2646380514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac100035f0 con 0x556ea6523070 2024-09-21T08:01:53.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.563+0000 7fac07e00640 1 -- 172.21.15.84:0/2646380514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100044e0 con 0x556ea6523070 2024-09-21T08:01:53.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.563+0000 7fac0fe00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fabfc0b6700 0x7fabfc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac0fe00640 1 -- 172.21.15.84:0/2440548881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7fac08108620 con 0x7fac18103b60 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac16a00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fabfc0b6700 0x7fabfc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 -- 172.21.15.84:0/2646380514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6523070 msgr2=0x556ea68c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6523070 0x556ea68c9ba0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fac10009fb0 tx=0x7fac100118d0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 -- 172.21.15.84:0/2646380514 shutdown_connections 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 --2- 172.21.15.84:0/2646380514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6523070 0x556ea68c9ba0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 -- 172.21.15.84:0/2646380514 >> 172.21.15.84:0/2646380514 conn(0x556ea6517460 msgr2=0x556ea68c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 -- 172.21.15.84:0/2646380514 shutdown_connections 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac16a00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fabfc0b6700 0x7fabfc0b8c10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x556ea68c8820 tx=0x7fac0810e530 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.564+0000 7fac245d3740 1 -- 172.21.15.84:0/2646380514 wait complete. 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.565+0000 7fac245d3740 1 -- start start 2024-09-21T08:01:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.565+0000 7fac245d3740 1 Processor -- start 2024-09-21T08:01:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.565+0000 7fac245d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.565+0000 7fac245d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6502390 0x556ea68da060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.565+0000 7fac245d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6523070 0x556ea68e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac245d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556ea6691700 con 0x556ea6502390 2024-09-21T08:01:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac245d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556ea67cb580 con 0x556ea6523070 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac245d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556ea68dc6e0 con 0x556ea64fa1b0 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac245d3740 10 client.0 _ll_register_callbacks cb 0x556ea67db470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6502390 0x556ea68da060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac17400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6502390 0x556ea68da060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47722/0 (socket says 172.21.15.84:47722) 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 -- 172.21.15.84:0/1427672203 learned_addr learned my addr 172.21.15.84:0/1427672203 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac17400640 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6523070 0x556ea68e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 -- 172.21.15.84:0/1427672203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 msgr2=0x556ea68d9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68d9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 -- 172.21.15.84:0/1427672203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6523070 msgr2=0x556ea68e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6523070 0x556ea68e5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.566+0000 7fac0e000640 1 -- 172.21.15.84:0/1427672203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ea658e650 con 0x556ea6502390 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac0e000640 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6502390 0x556ea68da060 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fac00012d20 tx=0x7fac0000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd126db01577d5a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac04c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac04c00640 1 -- 172.21.15.84:0/1427672203 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00012110 con 0x556ea6502390 2024-09-21T08:01:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ea67cdb90 con 0x556ea6502390 2024-09-21T08:01:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac04c00640 1 -- 172.21.15.84:0/1427672203 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7fac00004050 con 0x556ea6502390 2024-09-21T08:01:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac04c00640 1 -- 172.21.15.84:0/1427672203 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fac000122b0 con 0x556ea6502390 2024-09-21T08:01:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac245d3740 10 client.17766 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.567+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ea67e8950 con 0x556ea6502390 2024-09-21T08:01:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac04c00640 1 -- 172.21.15.84:0/1427672203 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556ea67cdb90 con 0x556ea6502390 2024-09-21T08:01:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac04c00640 1 -- 172.21.15.84:0/1427672203 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fac00010430 con 0x556ea6502390 2024-09-21T08:01:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac245d3740 10 client.17766 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac245d3740 10 client.17766 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:01:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac245d3740 20 client.17766 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac245d3740 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64e19f0 0x556ea68eba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac245d3740 4 client.17766 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ea6842f00 con 0x556ea64e19f0 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.568+0000 7fac17400640 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64e19f0 0x556ea68eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.569+0000 7fac17400640 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64e19f0 0x556ea68eba60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=326872de04f9852d server_cookie=c641a2856526654b in_seq=0 out_seq=0 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.569+0000 7fac04c00640 10 client.17766 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac04c00640 1 -- 172.21.15.84:0/1427672203 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ea6842f00 con 0x556ea64e19f0 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac04c00640 10 client.17766 handle_command_reply: tid=0 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 client.17766 shutdown 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6502390 msgr2=0x556ea68da060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6502390 0x556ea68da060 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fac00012d20 tx=0x7fac0000f790 comp rx=0 tx=0).stop 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 shutdown_connections 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64e19f0 0x556ea68eba60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6523070 0x556ea68e5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea6502390 0x556ea68da060 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac04c00640 0 client.17766 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 --2- 172.21.15.84:0/1427672203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea64fa1b0 0x556ea68d9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.570+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 >> 172.21.15.84:0/1427672203 conn(0x556ea6517460 msgr2=0x556ea68c6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.571+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 shutdown_connections 2024-09-21T08:01:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.571+0000 7fac245d3740 1 -- 172.21.15.84:0/1427672203 wait complete. 2024-09-21T08:01:53.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.571+0000 7fac245d3740 20 client.17766 trim_cache size 0 max 16384 2024-09-21T08:01:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 Processor -- start 2024-09-21T08:01:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 -- start start 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68d81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68d86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fac181aecc0 con 0x556ea64fa1b0 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac181b0800 con 0x556ea6502390 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac245d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac181af390 con 0x556ea6523070 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68d81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47732/0 (socket says 172.21.15.84:47732) 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac17400640 1 -- 172.21.15.84:0/865599017 learned_addr learned my addr 172.21.15.84:0/865599017 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.585+0000 7fac0e000640 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68d86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac17400640 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac17400640 1 -- 172.21.15.84:0/865599017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 msgr2=0x556ea68c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac17400640 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac17400640 1 -- 172.21.15.84:0/865599017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 msgr2=0x556ea68d86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac17400640 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68d86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac17400640 1 -- 172.21.15.84:0/865599017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ea68cc9d0 con 0x556ea64fa1b0 2024-09-21T08:01:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac0e000640 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68d86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac17400640 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68d81a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fac10003f00 tx=0x7fac10000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73af30639668a62b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac07400640 1 -- 172.21.15.84:0/865599017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1001e040 con 0x556ea64fa1b0 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac07400640 1 -- 172.21.15.84:0/865599017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac1001f040 con 0x556ea64fa1b0 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.586+0000 7fac07400640 1 -- 172.21.15.84:0/865599017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10004660 con 0x556ea64fa1b0 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 -- 172.21.15.84:0/865599017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 msgr2=0x556ea68d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68d81a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fac10003f00 tx=0x7fac10000bc0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 -- 172.21.15.84:0/865599017 shutdown_connections 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68d86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 --2- 172.21.15.84:0/865599017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68d81a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 -- 172.21.15.84:0/865599017 >> 172.21.15.84:0/865599017 conn(0x556ea6517460 msgr2=0x556ea68d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 -- 172.21.15.84:0/865599017 shutdown_connections 2024-09-21T08:01:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.587+0000 7fac245d3740 1 -- 172.21.15.84:0/865599017 wait complete. 2024-09-21T08:01:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.588+0000 7fac245d3740 1 -- start start 2024-09-21T08:01:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.588+0000 7fac245d3740 1 Processor -- start 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.588+0000 7fac245d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac245d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68e22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac245d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68dca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac245d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fac181b0130 con 0x556ea64fa1b0 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac245d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac181afa60 con 0x556ea6502390 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac245d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac181accc0 con 0x556ea6523070 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac245d3740 10 client.0 _ll_register_callbacks cb 0x7fac00012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68e1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47736/0 (socket says 172.21.15.84:47736) 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 -- 172.21.15.84:0/3432445772 learned_addr learned my addr 172.21.15.84:0/3432445772 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac0e000640 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68e22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68dca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 -- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 msgr2=0x556ea68dca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68dca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 -- 172.21.15.84:0/3432445772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 msgr2=0x556ea68e22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68e22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.589+0000 7fac17400640 1 -- 172.21.15.84:0/3432445772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ea68dd190 con 0x556ea64fa1b0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.590+0000 7fac17400640 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68e1cf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fac10009820 tx=0x7fac100097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7201970d44c34f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.590+0000 7fac04c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.590+0000 7fac04c00640 1 -- 172.21.15.84:0/3432445772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1001e070 con 0x556ea64fa1b0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.590+0000 7fac04c00640 1 -- 172.21.15.84:0/3432445772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7fac10005530 con 0x556ea64fa1b0 2024-09-21T08:01:53.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.590+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac1001f040 con 0x556ea64fa1b0 2024-09-21T08:01:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac04c00640 1 -- 172.21.15.84:0/3432445772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fac100035f0 con 0x556ea64fa1b0 2024-09-21T08:01:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 10 client.17772 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ea6956ec0 con 0x556ea64fa1b0 2024-09-21T08:01:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac04c00640 1 -- 172.21.15.84:0/3432445772 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac1001f040 con 0x556ea64fa1b0 2024-09-21T08:01:53.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac04c00640 1 -- 172.21.15.84:0/3432445772 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fac10004c00 con 0x556ea64fa1b0 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 10 client.17772 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 10 client.17772 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 20 client.17772 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64b6da0 0x556ea6959400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 4 client.17772 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.591+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ea683e9b0 con 0x556ea64b6da0 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.592+0000 7fac0e000640 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64b6da0 0x556ea6959400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.592+0000 7fac04c00640 10 client.17772 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.592+0000 7fac0e000640 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64b6da0 0x556ea6959400 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=23bbf23e814aa985 server_cookie=ad4b366c1499be2a in_seq=0 out_seq=0 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac04c00640 1 -- 172.21.15.84:0/3432445772 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ea683e9b0 con 0x556ea64b6da0 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac04c00640 10 client.17772 handle_command_reply: tid=0 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 client.17772 shutdown 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 msgr2=0x556ea68e1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68e1cf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fac10009820 tx=0x7fac100097b0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 shutdown_connections 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x556ea64b6da0 0x556ea6959400 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556ea6523070 0x556ea68dca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ea6502390 0x556ea68e22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 --2- 172.21.15.84:0/3432445772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ea64fa1b0 0x556ea68e1cf0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 >> 172.21.15.84:0/3432445772 conn(0x556ea6517460 msgr2=0x556ea68d8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.593+0000 7fac04c00640 0 client.17772 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 shutdown_connections 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac245d3740 1 -- 172.21.15.84:0/3432445772 wait complete. 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac245d3740 20 client.17772 trim_cache size 0 max 16384 2024-09-21T08:01:53.597 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fabfc0b6700 msgr2=0x7fabfc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fabfc0b6700 0x7fabfc0b8c10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x556ea68c8820 tx=0x7fac0810e530 comp rx=0 tx=0).stop 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18103b60 msgr2=0x7fac1819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18103b60 0x7fac1819a520 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fac08004af0 tx=0x7fac08003c20 comp rx=0 tx=0).stop 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 shutdown_connections 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fabfc0b6700 0x7fabfc0b8c10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac18109df0 0x7fac1819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac181094a0 0x7fac1819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 --2- 172.21.15.84:0/2440548881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac18103b60 0x7fac1819a520 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.594+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 >> 172.21.15.84:0/2440548881 conn(0x7fac1807b850 msgr2=0x7fac181075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:53.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.595+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 shutdown_connections 2024-09-21T08:01:53.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:53.595+0000 7fac1da00640 1 -- 172.21.15.84:0/2440548881 wait complete. 2024-09-21T08:01:53.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:53 smithi084 ceph-mon[30411]: pgmap v727: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:53.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:53 smithi191 ceph-mon[34667]: pgmap v727: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:54.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:53 smithi162 ceph-mon[34833]: pgmap v727: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:01:54.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T08:01:54.848 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 -- 172.21.15.84:0/1513624064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec10b4f0 msgr2=0x7f91ec10b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 --2- 172.21.15.84:0/1513624064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec10b4f0 0x7f91ec10b900 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009900 tx=0x7f91d802a410 comp rx=0 tx=0).stop 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 -- 172.21.15.84:0/1513624064 shutdown_connections 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 --2- 172.21.15.84:0/1513624064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91ec10be40 0x7f91ec112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 --2- 172.21.15.84:0/1513624064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec10b4f0 0x7f91ec10b900 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 --2- 172.21.15.84:0/1513624064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ec105bb0 0x7f91ec105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 -- 172.21.15.84:0/1513624064 >> 172.21.15.84:0/1513624064 conn(0x7f91ec101680 msgr2=0x7f91ec103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 -- 172.21.15.84:0/1513624064 shutdown_connections 2024-09-21T08:01:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.458+0000 7f91eb200640 1 -- 172.21.15.84:0/1513624064 wait complete. 2024-09-21T08:01:55.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.459+0000 7f91eb200640 1 Processor -- start 2024-09-21T08:01:55.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.459+0000 7f91eb200640 1 -- start start 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91eb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec105bb0 0x7f91ec19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91eb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ec10b4f0 0x7f91ec19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91eb200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91ec10be40 0x7f91ec1a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91eb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec115b00 con 0x7f91ec105bb0 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91eb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec115980 con 0x7f91ec10b4f0 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91eb200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec115c80 con 0x7f91ec10be40 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec105bb0 0x7f91ec19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec105bb0 0x7f91ec19c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47758/0 (socket says 172.21.15.84:47758) 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91e9e00640 1 -- 172.21.15.84:0/3275112669 learned_addr learned my addr 172.21.15.84:0/3275112669 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91e9400640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ec10b4f0 0x7f91ec19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91ea800640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91ec10be40 0x7f91ec1a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91e9e00640 1 -- 172.21.15.84:0/3275112669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91ec10be40 msgr2=0x7f91ec1a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91e9e00640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91ec10be40 0x7f91ec1a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.460+0000 7f91e9e00640 1 -- 172.21.15.84:0/3275112669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ec10b4f0 msgr2=0x7f91ec19cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91e9e00640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ec10b4f0 0x7f91ec19cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91e9e00640 1 -- 172.21.15.84:0/3275112669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ec1a24e0 con 0x7f91ec105bb0 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91e9400640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ec10b4f0 0x7f91ec19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91e9e00640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec105bb0 0x7f91ec19c570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00d950 tx=0x7f91dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91e2a00640 1 -- 172.21.15.84:0/3275112669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc017030 con 0x7f91ec105bb0 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91e2a00640 1 -- 172.21.15.84:0/3275112669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc004020 con 0x7f91ec105bb0 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91e2a00640 1 -- 172.21.15.84:0/3275112669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0047a0 con 0x7f91ec105bb0 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ec1a27d0 con 0x7f91ec105bb0 2024-09-21T08:01:55.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.461+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ec1a8f30 con 0x7f91ec105bb0 2024-09-21T08:01:55.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 Processor -- start 2024-09-21T08:01:55.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 -- start start 2024-09-21T08:01:55.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91e2a00640 1 -- 172.21.15.84:0/3275112669 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f91dc009a30 con 0x7f91ec105bb0 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2dbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df0c1b0 0x56328e2dc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56328e252fb0 con 0x56328df14390 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56328e2423e0 con 0x56328df0c1b0 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.465+0000 7f91f7859740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56328e2461f0 con 0x56328df35070 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df0c1b0 0x56328e2dc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91ea800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2dbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df0c1b0 0x56328e2dc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60808/0 (socket says 172.21.15.84:60808) 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91ea800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2dbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34006/0 (socket says 172.21.15.84:34006) 2024-09-21T08:01:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 -- 172.21.15.84:0/584769498 learned_addr learned my addr 172.21.15.84:0/584769498 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 -- 172.21.15.84:0/584769498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 msgr2=0x56328e2dbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 --2- 172.21.15.84:0/584769498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2dbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 -- 172.21.15.84:0/584769498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 msgr2=0x56328e2dc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 --2- 172.21.15.84:0/584769498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2dc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.466+0000 7f91e9e00640 1 -- 172.21.15.84:0/584769498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328e20ccd0 con 0x56328df0c1b0 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.467+0000 7f91e9e00640 1 --2- 172.21.15.84:0/584769498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df0c1b0 0x56328e2dc4b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0e47e0 tx=0x7f91dc0ed990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c94b46a7b4f5750 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.467+0000 7f91d7000640 1 -- 172.21.15.84:0/584769498 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0fa070 con 0x56328df0c1b0 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.467+0000 7f91d7000640 1 -- 172.21.15.84:0/584769498 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc0e7d70 con 0x56328df0c1b0 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.467+0000 7f91d7000640 1 -- 172.21.15.84:0/584769498 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0f5a00 con 0x56328df0c1b0 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.467+0000 7f91e2a00640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f91d00b6680 0x7f91d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.467+0000 7f91e2a00640 1 -- 172.21.15.84:0/3275112669 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f91dc0e74b0 con 0x7f91ec105bb0 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.467+0000 7f91ea800640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f91d00b6680 0x7f91d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 -- 172.21.15.84:0/584769498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df0c1b0 msgr2=0x56328e2dc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 --2- 172.21.15.84:0/584769498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df0c1b0 0x56328e2dc4b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0e47e0 tx=0x7f91dc0ed990 comp rx=0 tx=0).stop 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 -- 172.21.15.84:0/584769498 shutdown_connections 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 --2- 172.21.15.84:0/584769498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2dc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 --2- 172.21.15.84:0/584769498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df0c1b0 0x56328e2dc4b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 --2- 172.21.15.84:0/584769498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2dbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 -- 172.21.15.84:0/584769498 >> 172.21.15.84:0/584769498 conn(0x56328df29460 msgr2=0x56328e2d9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91ea800640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f91d00b6680 0x7f91d00b8b90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005fd0 tx=0x7f91e4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 -- 172.21.15.84:0/584769498 shutdown_connections 2024-09-21T08:01:55.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.468+0000 7f91f7859740 1 -- 172.21.15.84:0/584769498 wait complete. 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.469+0000 7f91f7859740 1 -- start start 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.469+0000 7f91f7859740 1 Processor -- start 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.469+0000 7f91f7859740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df0c1b0 0x56328e2e7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.469+0000 7f91f7859740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91f7859740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91f7859740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56328e0a3700 con 0x56328df14390 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91f7859740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56328e1dd580 con 0x56328df35070 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91f7859740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56328e2ea750 con 0x56328df0c1b0 2024-09-21T08:01:55.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91f7859740 10 client.0 _ll_register_callbacks cb 0x56328e1ed470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df0c1b0 0x56328e2e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df0c1b0 0x56328e2e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:34020/0 (socket says 172.21.15.84:34020) 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 -- 172.21.15.84:0/837657399 learned_addr learned my addr 172.21.15.84:0/837657399 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91ea800640 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 -- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 msgr2=0x56328e2f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 -- 172.21.15.84:0/837657399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 msgr2=0x56328e2e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2e7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9e00640 1 -- 172.21.15.84:0/837657399 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328dfa0650 con 0x56328df0c1b0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.470+0000 7f91e9400640 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91e9e00640 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df0c1b0 0x56328e2e7770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005fd0 tx=0x7f91dc009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54ff8e0957c3db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91cb400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91cb400640 1 -- 172.21.15.84:0/837657399 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0a95c0 con 0x56328df0c1b0 2024-09-21T08:01:55.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91cb400640 1 -- 172.21.15.84:0/837657399 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f91dc0a91e0 con 0x56328df0c1b0 2024-09-21T08:01:55.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56328e1dfb90 con 0x56328df0c1b0 2024-09-21T08:01:55.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91cb400640 1 -- 172.21.15.84:0/837657399 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f91dc0ac6e0 con 0x56328df0c1b0 2024-09-21T08:01:55.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91f7859740 10 client.28165 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:55.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56328e1fa950 con 0x56328df0c1b0 2024-09-21T08:01:55.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.471+0000 7f91cb400640 1 -- 172.21.15.84:0/837657399 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56328e1dfb90 con 0x56328df0c1b0 2024-09-21T08:01:55.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91cb400640 1 -- 172.21.15.84:0/837657399 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f91dc0e7150 con 0x56328df0c1b0 2024-09-21T08:01:55.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91f7859740 10 client.28165 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:55.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91f7859740 10 client.28165 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:01:55.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91f7859740 20 client.28165 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:55.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91f7859740 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328def39f0 0x56328e2f9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91f7859740 4 client.28165 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56328e254f00 con 0x56328def39f0 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.472+0000 7f91e9400640 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328def39f0 0x56328e2f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.473+0000 7f91e9400640 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328def39f0 0x56328e2f9740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3bcb69f16003f4f1 server_cookie=4aa3e436f129700f in_seq=0 out_seq=0 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.473+0000 7f91cb400640 10 client.28165 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.473+0000 7f91cb400640 1 -- 172.21.15.84:0/837657399 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56328e254f00 con 0x56328def39f0 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.473+0000 7f91cb400640 10 client.28165 handle_command_reply: tid=0 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 client.28165 shutdown 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df0c1b0 msgr2=0x56328e2e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df0c1b0 0x56328e2e7770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005fd0 tx=0x7f91dc009f50 comp rx=0 tx=0).stop 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 shutdown_connections 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328def39f0 0x56328e2f9740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df14390 0x56328e2e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 --2- 172.21.15.84:0/837657399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df0c1b0 0x56328e2e7770 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91cb400640 0 client.28165 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:55.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 >> 172.21.15.84:0/837657399 conn(0x56328df29460 msgr2=0x56328e2df100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 shutdown_connections 2024-09-21T08:01:55.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 1 -- 172.21.15.84:0/837657399 wait complete. 2024-09-21T08:01:55.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.474+0000 7f91f7859740 20 client.28165 trim_cache size 0 max 16384 2024-09-21T08:01:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 Processor -- start 2024-09-21T08:01:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 -- start start 2024-09-21T08:01:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2d9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df14390 0x56328e2e4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec1b2f80 con 0x56328df0c1b0 2024-09-21T08:01:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec1b4ac0 con 0x56328df35070 2024-09-21T08:01:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.488+0000 7f91f7859740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec1b3650 con 0x56328df14390 2024-09-21T08:01:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2d9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2d9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47794/0 (socket says 172.21.15.84:47794) 2024-09-21T08:01:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 -- 172.21.15.84:0/1942080782 learned_addr learned my addr 172.21.15.84:0/1942080782 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9400640 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df14390 0x56328e2e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91ea800640 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 -- 172.21.15.84:0/1942080782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df14390 msgr2=0x56328e2e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df14390 0x56328e2e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 -- 172.21.15.84:0/1942080782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 msgr2=0x56328e2e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2e4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 -- 172.21.15.84:0/1942080782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328e2e8150 con 0x56328df0c1b0 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91ea800640 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.489+0000 7f91e9e00640 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2d9d80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0ed450 tx=0x7f91dc0043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e83cd16c40c6e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91d6600640 1 -- 172.21.15.84:0/1942080782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0ac8c0 con 0x56328df0c1b0 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91d6600640 1 -- 172.21.15.84:0/1942080782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc0b6990 con 0x56328df0c1b0 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91d6600640 1 -- 172.21.15.84:0/1942080782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0acd40 con 0x56328df0c1b0 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91f7859740 1 -- 172.21.15.84:0/1942080782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 msgr2=0x56328e2d9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91f7859740 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2d9d80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0ed450 tx=0x7f91dc0043e0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91f7859740 1 -- 172.21.15.84:0/1942080782 shutdown_connections 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91f7859740 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df35070 0x56328e2e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91f7859740 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df14390 0x56328e2e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91f7859740 1 --2- 172.21.15.84:0/1942080782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2d9d80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.490+0000 7f91f7859740 1 -- 172.21.15.84:0/1942080782 >> 172.21.15.84:0/1942080782 conn(0x56328df29460 msgr2=0x56328e2e5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.491+0000 7f91f7859740 1 -- 172.21.15.84:0/1942080782 shutdown_connections 2024-09-21T08:01:55.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.491+0000 7f91f7859740 1 -- 172.21.15.84:0/1942080782 wait complete. 2024-09-21T08:01:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.491+0000 7f91f7859740 1 -- start start 2024-09-21T08:01:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.491+0000 7f91f7859740 1 Processor -- start 2024-09-21T08:01:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91f7859740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91f7859740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df14390 0x56328e2f8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91f7859740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91f7859740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec1b43f0 con 0x56328df0c1b0 2024-09-21T08:01:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91f7859740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec1b3d20 con 0x56328df14390 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91f7859740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec1b0f80 con 0x56328df35070 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91f7859740 10 client.0 _ll_register_callbacks cb 0x7f91e4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91e9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2fcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47800/0 (socket says 172.21.15.84:47800) 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91e9e00640 1 -- 172.21.15.84:0/3222688871 learned_addr learned my addr 172.21.15.84:0/3222688871 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91e9400640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df14390 0x56328e2f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91ea800640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91e9e00640 1 -- 172.21.15.84:0/3222688871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 msgr2=0x56328e2f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.492+0000 7f91e9e00640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2f8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91e9e00640 1 -- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df14390 msgr2=0x56328e2f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91e9e00640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df14390 0x56328e2f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91e9e00640 1 -- 172.21.15.84:0/3222688871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328e2f91e0 con 0x56328df0c1b0 2024-09-21T08:01:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91e9400640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df14390 0x56328e2f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91e9e00640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2fcfe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0aa1e0 tx=0x7f91dc0ed990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad9b48d6a535911 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91cb400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91cb400640 1 -- 172.21.15.84:0/3222688871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0a8e10 con 0x56328df0c1b0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91cb400640 1 -- 172.21.15.84:0/3222688871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f91dc0b6700 con 0x56328df0c1b0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91dc0b6990 con 0x56328df0c1b0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91cb400640 1 -- 172.21.15.84:0/3222688871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f91dc0a95c0 con 0x56328df0c1b0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91f7859740 10 client.17790 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.493+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56328e2f91e0 con 0x56328df0c1b0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91cb400640 1 -- 172.21.15.84:0/3222688871 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc0b6990 con 0x56328df0c1b0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91cb400640 1 -- 172.21.15.84:0/3222688871 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f91dc0941a0 con 0x56328df0c1b0 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91f7859740 10 client.17790 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91f7859740 10 client.17790 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91f7859740 20 client.17790 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91f7859740 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328dec8da0 0x56328e366120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91f7859740 4 client.17790 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56328e2509b0 con 0x56328dec8da0 2024-09-21T08:01:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.494+0000 7f91e9400640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328dec8da0 0x56328e366120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91e9400640 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328dec8da0 0x56328e366120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=af7e0560b730b098 server_cookie=1f67c6962e9eccdf in_seq=0 out_seq=0 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91cb400640 10 client.17790 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91cb400640 1 -- 172.21.15.84:0/3222688871 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56328e2509b0 con 0x56328dec8da0 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91cb400640 10 client.17790 handle_command_reply: tid=0 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 client.17790 shutdown 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 msgr2=0x56328e2fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2fcfe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0aa1e0 tx=0x7f91dc0ed990 comp rx=0 tx=0).stop 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 shutdown_connections 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x56328dec8da0 0x56328e366120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56328df35070 0x56328e2f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56328df14390 0x56328e2f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 --2- 172.21.15.84:0/3222688871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56328df0c1b0 0x56328e2fcfe0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 >> 172.21.15.84:0/3222688871 conn(0x56328df29460 msgr2=0x56328e2e5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.495+0000 7f91cb400640 0 client.17790 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:01:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.496+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 shutdown_connections 2024-09-21T08:01:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.496+0000 7f91f7859740 1 -- 172.21.15.84:0/3222688871 wait complete. 2024-09-21T08:01:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.496+0000 7f91f7859740 20 client.17790 trim_cache size 0 max 16384 2024-09-21T08:01:55.501 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.496+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f91d00b6680 msgr2=0x7f91d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.496+0000 7f91eb200640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f91d00b6680 0x7f91d00b8b90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005fd0 tx=0x7f91e4009500 comp rx=0 tx=0).stop 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.496+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec105bb0 msgr2=0x7f91ec19c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.496+0000 7f91eb200640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec105bb0 0x7f91ec19c570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00d950 tx=0x7f91dc00de10 comp rx=0 tx=0).stop 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 shutdown_connections 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f91d00b6680 0x7f91d00b8b90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91ec10be40 0x7f91ec1a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ec10b4f0 0x7f91ec19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 --2- 172.21.15.84:0/3275112669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91ec105bb0 0x7f91ec19c570 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 >> 172.21.15.84:0/3275112669 conn(0x7f91ec101680 msgr2=0x7f91ec103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 shutdown_connections 2024-09-21T08:01:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:55.497+0000 7f91eb200640 1 -- 172.21.15.84:0/3275112669 wait complete. 2024-09-21T08:01:55.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:55 smithi191 ceph-mon[34667]: pgmap v728: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T08:01:55.999 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:55 smithi084 ceph-mon[30411]: pgmap v728: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T08:01:56.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:55 smithi162 ceph-mon[34833]: pgmap v728: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-21T08:01:56.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T08:01:56.744 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 -- 172.21.15.84:0/3562874990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 msgr2=0x7f28bc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 --2- 172.21.15.84:0/3562874990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 0x7f28bc1098d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009860 tx=0x7f28a802a340 comp rx=0 tx=0).stop 2024-09-21T08:01:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 -- 172.21.15.84:0/3562874990 shutdown_connections 2024-09-21T08:01:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 --2- 172.21.15.84:0/3562874990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28bc109e10 0x7f28bc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 --2- 172.21.15.84:0/3562874990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 0x7f28bc1098d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 --2- 172.21.15.84:0/3562874990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 0x7f28bc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 -- 172.21.15.84:0/3562874990 >> 172.21.15.84:0/3562874990 conn(0x7f28bc0ff5d0 msgr2=0x7f28bc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 -- 172.21.15.84:0/3562874990 shutdown_connections 2024-09-21T08:01:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.354+0000 7f28c1200640 1 -- 172.21.15.84:0/3562874990 wait complete. 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.355+0000 7f28c1200640 1 Processor -- start 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.355+0000 7f28c1200640 1 -- start start 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28c1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 0x7f28bc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28c1200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 0x7f28bc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28c1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28bc109e10 0x7f28bc19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28c1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc113ad0 con 0x7f28bc103b80 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28c1200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc113950 con 0x7f28bc109e10 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28c1200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc113c50 con 0x7f28bc1094c0 2024-09-21T08:01:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28b9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 0x7f28bc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28b9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 0x7f28bc19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47828/0 (socket says 172.21.15.84:47828) 2024-09-21T08:01:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28b9e00640 1 -- 172.21.15.84:0/1438579184 learned_addr learned my addr 172.21.15.84:0/1438579184 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28b9400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 0x7f28bc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.356+0000 7f28ba800640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28bc109e10 0x7f28bc19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b9e00640 1 -- 172.21.15.84:0/1438579184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 msgr2=0x7f28bc19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b9e00640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 0x7f28bc19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b9e00640 1 -- 172.21.15.84:0/1438579184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28bc109e10 msgr2=0x7f28bc19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b9e00640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28bc109e10 0x7f28bc19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b9e00640 1 -- 172.21.15.84:0/1438579184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc1a03f0 con 0x7f28bc103b80 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28ba800640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28bc109e10 0x7f28bc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b9e00640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 0x7f28bc19a480 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00e9c0 tx=0x7f28ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b2a00640 1 -- 172.21.15.84:0/1438579184 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac00cde0 con 0x7f28bc103b80 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28b2a00640 1 -- 172.21.15.84:0/1438579184 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28ac0035f0 con 0x7f28bc103b80 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.357+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc1a06e0 con 0x7f28bc103b80 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.358+0000 7f28b2a00640 1 -- 172.21.15.84:0/1438579184 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac010690 con 0x7f28bc103b80 2024-09-21T08:01:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.358+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc1a6e40 con 0x7f28bc103b80 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.361+0000 7f28c7e47740 1 Processor -- start 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.361+0000 7f28c7e47740 1 -- start start 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.361+0000 7f28b2a00640 1 -- 172.21.15.84:0/1438579184 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f28ac004000 con 0x7f28bc103b80 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x559650504da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x5596505052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650505820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28c7e47740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55965047bfb0 con 0x55965013d390 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28c7e47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55965046b3e0 con 0x5596501351b0 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28c7e47740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55965046f1f0 con 0x55965015e070 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28b9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650505820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28b9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x5596505052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28b9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650505820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47840/0 (socket says 172.21.15.84:47840) 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28b9400640 1 -- 172.21.15.84:0/646992158 learned_addr learned my addr 172.21.15.84:0/646992158 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.362+0000 7f28ba800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x559650504da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28b9400640 1 -- 172.21.15.84:0/646992158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 msgr2=0x559650504da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28b9400640 1 --2- 172.21.15.84:0/646992158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x559650504da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28b9400640 1 -- 172.21.15.84:0/646992158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 msgr2=0x5596505052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28b9400640 1 --2- 172.21.15.84:0/646992158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x5596505052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28b9400640 1 -- 172.21.15.84:0/646992158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559650435cd0 con 0x55965013d390 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28b9400640 1 --2- 172.21.15.84:0/646992158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650505820 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f28bc06ca10 tx=0x7f28a8005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c57e9562df7094 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28a7400640 1 -- 172.21.15.84:0/646992158 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8037040 con 0x55965013d390 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28a7400640 1 -- 172.21.15.84:0/646992158 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28a8030450 con 0x55965013d390 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28a7400640 1 -- 172.21.15.84:0/646992158 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8003910 con 0x55965013d390 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.363+0000 7f28b2a00640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a00b6680 0x7f28a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28b2a00640 1 -- 172.21.15.84:0/1438579184 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f28ac0e7e30 con 0x7f28bc103b80 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28ba800640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a00b6680 0x7f28a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 -- 172.21.15.84:0/646992158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 msgr2=0x559650505820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 --2- 172.21.15.84:0/646992158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650505820 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f28bc06ca10 tx=0x7f28a8005d30 comp rx=0 tx=0).stop 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28ba800640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a00b6680 0x7f28a00b8b90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009fd0 tx=0x7f28b4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 -- 172.21.15.84:0/646992158 shutdown_connections 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 --2- 172.21.15.84:0/646992158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650505820 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 --2- 172.21.15.84:0/646992158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x5596505052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 --2- 172.21.15.84:0/646992158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x559650504da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 -- 172.21.15.84:0/646992158 >> 172.21.15.84:0/646992158 conn(0x559650152460 msgr2=0x559650502c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.364+0000 7f28c7e47740 1 -- 172.21.15.84:0/646992158 shutdown_connections 2024-09-21T08:01:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.365+0000 7f28c7e47740 1 -- 172.21.15.84:0/646992158 wait complete. 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.365+0000 7f28c7e47740 1 -- start start 2024-09-21T08:01:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.365+0000 7f28c7e47740 1 Processor -- start 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650514880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965013d390 0x559650514dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965015e070 0x559650520be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28c7e47740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5596502cc700 con 0x55965015e070 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28c7e47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559650406580 con 0x55965013d390 2024-09-21T08:01:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28c7e47740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559650517850 con 0x5596501351b0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28c7e47740 10 client.0 _ll_register_callbacks cb 0x559650416470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28b9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965013d390 0x559650514dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28ba800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965015e070 0x559650520be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28b9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965013d390 0x559650514dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:60882/0 (socket says 172.21.15.84:60882) 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28b9400640 1 -- 172.21.15.84:0/3155980439 learned_addr learned my addr 172.21.15.84:0/3155980439 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.366+0000 7f28b9e00640 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650514880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f28b9400640 1 -- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 msgr2=0x559650514880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f28b9400640 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650514880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f28b9400640 1 -- 172.21.15.84:0/3155980439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965015e070 msgr2=0x559650520be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f28b9400640 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965015e070 0x559650520be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f28b9400640 1 -- 172.21.15.84:0/3155980439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596501c9650 con 0x55965013d390 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f28b9400640 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965013d390 0x559650514dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f28a802d020 tx=0x7f28a802aac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21d9c5f63940c121 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f289be00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:01:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f289be00640 1 -- 172.21.15.84:0/3155980439 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8037030 con 0x55965013d390 2024-09-21T08:01:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559650408b90 con 0x55965013d390 2024-09-21T08:01:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.367+0000 7f289be00640 1 -- 172.21.15.84:0/3155980439 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f28a803d480 con 0x55965013d390 2024-09-21T08:01:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f289be00640 1 -- 172.21.15.84:0/3155980439 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f28a8056050 con 0x55965013d390 2024-09-21T08:01:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 10 client.28166 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559650423950 con 0x55965013d390 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f289be00640 1 -- 172.21.15.84:0/3155980439 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559650408b90 con 0x55965013d390 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f289be00640 1 -- 172.21.15.84:0/3155980439 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f28a8032850 con 0x55965013d390 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 10 client.28166 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 10 client.28166 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:01:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 20 client.28166 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55965011c9f0 0x5596505267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 4 client.28166 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.368+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55965047df00 con 0x55965011c9f0 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.369+0000 7f28b9e00640 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55965011c9f0 0x5596505267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.369+0000 7f28b9e00640 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55965011c9f0 0x5596505267a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b8a6f863d161c381 server_cookie=cdc162466f33df6c in_seq=0 out_seq=0 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.369+0000 7f289be00640 10 client.28166 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f289be00640 1 -- 172.21.15.84:0/3155980439 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55965047df00 con 0x55965011c9f0 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f289be00640 10 client.28166 handle_command_reply: tid=0 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f28c7e47740 1 client.28166 shutdown 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965013d390 msgr2=0x559650514dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965013d390 0x559650514dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f28a802d020 tx=0x7f28a802aac0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 shutdown_connections 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x55965011c9f0 0x5596505267a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965015e070 0x559650520be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.370+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965013d390 0x559650514dc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.371+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3155980439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650514880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.371+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 >> 172.21.15.84:0/3155980439 conn(0x559650152460 msgr2=0x559650507f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.371+0000 7f289be00640 0 client.28166 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.371+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 shutdown_connections 2024-09-21T08:01:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.371+0000 7f28c7e47740 1 -- 172.21.15.84:0/3155980439 wait complete. 2024-09-21T08:01:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.371+0000 7f28c7e47740 20 client.28166 trim_cache size 0 max 16384 2024-09-21T08:01:57.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.384+0000 7f28c7e47740 1 Processor -- start 2024-09-21T08:01:57.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28c7e47740 1 -- start start 2024-09-21T08:01:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x559650514d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650520b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x5596505025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28c7e47740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc1aebb0 con 0x55965013d390 2024-09-21T08:01:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28c7e47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc1b06f0 con 0x5596501351b0 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28c7e47740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc1af280 con 0x55965015e070 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28b9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650520b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28b9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650520b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47868/0 (socket says 172.21.15.84:47868) 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28b9400640 1 -- 172.21.15.84:0/2496621869 learned_addr learned my addr 172.21.15.84:0/2496621869 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28ba800640 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x5596505025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.385+0000 7f28b9e00640 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x559650514d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28b9400640 1 -- 172.21.15.84:0/2496621869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 msgr2=0x5596505025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28b9400640 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x5596505025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28b9400640 1 -- 172.21.15.84:0/2496621869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 msgr2=0x559650514d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28b9400640 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x559650514d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28b9400640 1 -- 172.21.15.84:0/2496621869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596505073b0 con 0x55965013d390 2024-09-21T08:01:57.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28b9400640 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650520b50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f28a802a860 tx=0x7f28a8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ea72503a47a6a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28a6a00640 1 -- 172.21.15.84:0/2496621869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8037050 con 0x55965013d390 2024-09-21T08:01:57.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28a6a00640 1 -- 172.21.15.84:0/2496621869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28a8032440 con 0x55965013d390 2024-09-21T08:01:57.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.386+0000 7f28a6a00640 1 -- 172.21.15.84:0/2496621869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8005260 con 0x55965013d390 2024-09-21T08:01:57.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 -- 172.21.15.84:0/2496621869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 msgr2=0x559650520b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650520b50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f28a802a860 tx=0x7f28a8005850 comp rx=0 tx=0).stop 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 -- 172.21.15.84:0/2496621869 shutdown_connections 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55965015e070 0x5596505025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x559650520b50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 --2- 172.21.15.84:0/2496621869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596501351b0 0x559650514d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 -- 172.21.15.84:0/2496621869 >> 172.21.15.84:0/2496621869 conn(0x559650152460 msgr2=0x559650514630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.387+0000 7f28c7e47740 1 -- 172.21.15.84:0/2496621869 shutdown_connections 2024-09-21T08:01:57.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.388+0000 7f28c7e47740 1 -- 172.21.15.84:0/2496621869 wait complete. 2024-09-21T08:01:57.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.388+0000 7f28c7e47740 1 -- start start 2024-09-21T08:01:57.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.388+0000 7f28c7e47740 1 Processor -- start 2024-09-21T08:01:57.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650528130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x5596505286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28c7e47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965015e070 0x559650589f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28c7e47740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc1b0020 con 0x55965013d390 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28c7e47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc1af950 con 0x55965015e070 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28c7e47740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc1acbb0 con 0x5596501351b0 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28c7e47740 10 client.0 _ll_register_callbacks cb 0x7f28b40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x5596505286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x5596505286d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47882/0 (socket says 172.21.15.84:47882) 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 -- 172.21.15.84:0/3131235337 learned_addr learned my addr 172.21.15.84:0/3131235337 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9e00640 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650528130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28ba800640 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965015e070 0x559650589f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 -- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 msgr2=0x559650528130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650528130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 -- 172.21.15.84:0/3131235337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965015e070 msgr2=0x559650589f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:57.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965015e070 0x559650589f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.389+0000 7f28b9400640 1 -- 172.21.15.84:0/3131235337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55965058a5d0 con 0x55965013d390 2024-09-21T08:01:57.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f28b9400640 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x5596505286d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f28a8032c20 tx=0x7f28a8032ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffaa91e6301dd8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:57.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f289be00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f289be00640 1 -- 172.21.15.84:0/3131235337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8060070 con 0x55965013d390 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f289be00640 1 -- 172.21.15.84:0/3131235337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f28a8004030 con 0x55965013d390 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28a8032440 con 0x55965013d390 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f289be00640 1 -- 172.21.15.84:0/3131235337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f28a806d050 con 0x55965013d390 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f28c7e47740 10 client.17808 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.390+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596505918f0 con 0x55965013d390 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f289be00640 1 -- 172.21.15.84:0/3131235337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28a8032440 con 0x55965013d390 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f289be00640 1 -- 172.21.15.84:0/3131235337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f28a803d480 con 0x55965013d390 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f28c7e47740 10 client.17808 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f28c7e47740 10 client.17808 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f28c7e47740 20 client.17808 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5596500f1da0 0x559650593f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:57.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f28c7e47740 4 client.17808 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596504799b0 con 0x5596500f1da0 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.391+0000 7f28b9e00640 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5596500f1da0 0x559650593f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28b9e00640 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5596500f1da0 0x559650593f40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e61c1aa2e5d5023 server_cookie=667d60bfc8c4bb1 in_seq=0 out_seq=0 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f289be00640 10 client.17808 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f289be00640 1 -- 172.21.15.84:0/3131235337 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596504799b0 con 0x5596500f1da0 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f289be00640 10 client.17808 handle_command_reply: tid=0 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 client.17808 shutdown 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 msgr2=0x5596505286d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x5596505286d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f28a8032c20 tx=0x7f28a8032ca0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 shutdown_connections 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5596500f1da0 0x559650593f40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55965015e070 0x559650589f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55965013d390 0x5596505286d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 --2- 172.21.15.84:0/3131235337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5596501351b0 0x559650528130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.392+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 >> 172.21.15.84:0/3131235337 conn(0x559650152460 msgr2=0x559650502590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f289be00640 0 client.17808 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:01:57.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 shutdown_connections 2024-09-21T08:01:57.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f28c7e47740 1 -- 172.21.15.84:0/3131235337 wait complete. 2024-09-21T08:01:57.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f28c7e47740 20 client.17808 trim_cache size 0 max 16384 2024-09-21T08:01:57.397 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a00b6680 msgr2=0x7f28a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f28c1200640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a00b6680 0x7f28a00b8b90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009fd0 tx=0x7f28b4009500 comp rx=0 tx=0).stop 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 msgr2=0x7f28bc19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.393+0000 7f28c1200640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 0x7f28bc19a480 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00e9c0 tx=0x7f28ac00ee80 comp rx=0 tx=0).stop 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 shutdown_connections 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f28a00b6680 0x7f28a00b8b90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28bc109e10 0x7f28bc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28bc1094c0 0x7f28bc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 --2- 172.21.15.84:0/1438579184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28bc103b80 0x7f28bc19a480 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 >> 172.21.15.84:0/1438579184 conn(0x7f28bc0ff5d0 msgr2=0x7f28bc1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 shutdown_connections 2024-09-21T08:01:57.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:57.394+0000 7f28c1200640 1 -- 172.21.15.84:0/1438579184 wait complete. 2024-09-21T08:01:57.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:57 smithi191 ceph-mon[34667]: pgmap v729: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:57.912 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:57 smithi084 ceph-mon[30411]: pgmap v729: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:58.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:57 smithi162 ceph-mon[34833]: pgmap v729: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:01:58.274 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T08:01:58.646 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:01:59.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 -- 172.21.15.84:0/576697879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca4110440 msgr2=0x7f1ca4116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 --2- 172.21.15.84:0/576697879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca4110440 0x7f1ca4116c70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009900 tx=0x7f1c9c02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 -- 172.21.15.84:0/576697879 shutdown_connections 2024-09-21T08:01:59.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 --2- 172.21.15.84:0/576697879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca4110440 0x7f1ca4116c70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 --2- 172.21.15.84:0/576697879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ca410faf0 0x7f1ca410ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 --2- 172.21.15.84:0/576697879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 0x7f1ca410a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 -- 172.21.15.84:0/576697879 >> 172.21.15.84:0/576697879 conn(0x7f1ca40780e0 msgr2=0x7f1ca41081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 -- 172.21.15.84:0/576697879 shutdown_connections 2024-09-21T08:01:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.285+0000 7f1caba00640 1 -- 172.21.15.84:0/576697879 wait complete. 2024-09-21T08:01:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 Processor -- start 2024-09-21T08:01:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 -- start start 2024-09-21T08:01:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 0x7f1ca41a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca410faf0 0x7f1ca41a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ca4110440 0x7f1ca41a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca411a110 con 0x7f1ca410faf0 2024-09-21T08:01:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4119f90 con 0x7f1ca410a1b0 2024-09-21T08:01:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.287+0000 7f1caba00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca411a290 con 0x7f1ca4110440 2024-09-21T08:01:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 0x7f1ca41a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 0x7f1ca41a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38152/0 (socket says 172.21.15.84:38152) 2024-09-21T08:01:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca9000640 1 -- 172.21.15.84:0/1869469099 learned_addr learned my addr 172.21.15.84:0/1869469099 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca410faf0 0x7f1ca41a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ca4110440 0x7f1ca41a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca3e00640 1 -- 172.21.15.84:0/1869469099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ca4110440 msgr2=0x7f1ca41a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ca4110440 0x7f1ca41a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca3e00640 1 -- 172.21.15.84:0/1869469099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 msgr2=0x7f1ca41a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 0x7f1ca41a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca3e00640 1 -- 172.21.15.84:0/1869469099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca41a6a70 con 0x7f1ca410faf0 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca9000640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 0x7f1ca41a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.288+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca410faf0 0x7f1ca41a10a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1ca406ca20 tx=0x7f1c9000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.289+0000 7f1ca1600640 1 -- 172.21.15.84:0/1869469099 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000cc40 con 0x7f1ca410faf0 2024-09-21T08:01:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.289+0000 7f1ca1600640 1 -- 172.21.15.84:0/1869469099 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c9000cde0 con 0x7f1ca410faf0 2024-09-21T08:01:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.289+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca41a6d60 con 0x7f1ca410faf0 2024-09-21T08:01:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.289+0000 7f1ca1600640 1 -- 172.21.15.84:0/1869469099 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90018780 con 0x7f1ca410faf0 2024-09-21T08:01:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.289+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca41ad4c0 con 0x7f1ca410faf0 2024-09-21T08:01:59.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.292+0000 7f1cb2691740 1 Processor -- start 2024-09-21T08:01:59.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.292+0000 7f1cb2691740 1 -- start start 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b46ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b470e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d79977f390 0x55d799b47620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1cb2691740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d799abdfb0 con 0x55d7997771b0 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1cb2691740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d799aad3e0 con 0x55d7997a0070 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1cb2691740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d799ab11f0 con 0x55d79977f390 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca1600640 1 -- 172.21.15.84:0/1869469099 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f1c90010a90 con 0x7f1ca410faf0 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b46ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b46ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38168/0 (socket says 172.21.15.84:38168) 2024-09-21T08:01:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39566/0 (socket says 172.21.15.84:39566) 2024-09-21T08:01:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9a00640 1 -- 172.21.15.84:0/1235737868 learned_addr learned my addr 172.21.15.84:0/1235737868 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d79977f390 0x55d799b47620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9a00640 1 -- 172.21.15.84:0/1235737868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d79977f390 msgr2=0x55d799b47620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d79977f390 0x55d799b47620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9a00640 1 -- 172.21.15.84:0/1235737868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 msgr2=0x55d799b470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.293+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.294+0000 7f1ca9a00640 1 -- 172.21.15.84:0/1235737868 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d799a77cd0 con 0x55d7997a0070 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.294+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d79977f390 0x55d799b47620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.294+0000 7f1ca9000640 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.294+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b46ba0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009900 tx=0x7f1c9c032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13309cef6c5c412 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.294+0000 7f1c9a000640 1 -- 172.21.15.84:0/1235737868 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c040070 con 0x55d7997a0070 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.294+0000 7f1c9a000640 1 -- 172.21.15.84:0/1235737868 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c9c004030 con 0x55d7997a0070 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.294+0000 7f1c9a000640 1 -- 172.21.15.84:0/1235737868 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c035040 con 0x55d7997a0070 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1ca1600640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1c880b6680 0x7f1c880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1ca1600640 1 -- 172.21.15.84:0/1869469099 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f1c900e7d50 con 0x7f1ca410faf0 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1ca9000640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1c880b6680 0x7f1c880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1cb2691740 1 -- 172.21.15.84:0/1235737868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 msgr2=0x55d799b46ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1cb2691740 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b46ba0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009900 tx=0x7f1c9c032b20 comp rx=0 tx=0).stop 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1cb2691740 1 -- 172.21.15.84:0/1235737868 shutdown_connections 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1cb2691740 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d79977f390 0x55d799b47620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1cb2691740 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.295+0000 7f1cb2691740 1 --2- 172.21.15.84:0/1235737868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b46ba0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.296+0000 7f1cb2691740 1 -- 172.21.15.84:0/1235737868 >> 172.21.15.84:0/1235737868 conn(0x55d799794460 msgr2=0x55d799b44a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.296+0000 7f1cb2691740 1 -- 172.21.15.84:0/1235737868 shutdown_connections 2024-09-21T08:01:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.296+0000 7f1cb2691740 1 -- 172.21.15.84:0/1235737868 wait complete. 2024-09-21T08:01:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.296+0000 7f1ca9000640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1c880b6680 0x7f1c880b8b90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55d799b45820 tx=0x7f1c94009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.296+0000 7f1cb2691740 1 -- start start 2024-09-21T08:01:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.296+0000 7f1cb2691740 1 Processor -- start 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d79977f390 0x55d799b52cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799b5e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1cb2691740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d79990e700 con 0x55d7997771b0 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1cb2691740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d799a48580 con 0x55d79977f390 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1cb2691740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d799b55320 con 0x55d7997a0070 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1cb2691740 10 client.0 _ll_register_callbacks cb 0x55d799a58470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39574/0 (socket says 172.21.15.84:39574) 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1ca9000640 1 -- 172.21.15.84:0/3456388224 learned_addr learned my addr 172.21.15.84:0/3456388224 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:59.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d79977f390 0x55d799b52cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.297+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799b5e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 msgr2=0x55d799b5e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799b5e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3456388224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 msgr2=0x55d799b527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3456388224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79980b650 con 0x55d79977f390 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d79977f390 0x55d799b52cf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1c900e50b0 tx=0x7f1c900b7100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95d841f4fa7cf78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1c8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3456388224 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900ad1b0 con 0x55d79977f390 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d799a4ab90 con 0x55d79977f390 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.298+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3456388224 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f1c900aeae0 con 0x55d79977f390 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3456388224 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c900acfd0 con 0x55d79977f390 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 10 client.28184 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d799a65950 con 0x55d79977f390 2024-09-21T08:01:59.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3456388224 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d799a4ab90 con 0x55d79977f390 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3456388224 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1c900b67a0 con 0x55d79977f390 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 10 client.28184 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 10 client.28184 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 20 client.28184 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d79975e9f0 0x55d799b64610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 4 client.28184 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.299+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d799abff00 con 0x55d79975e9f0 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.300+0000 7f1ca9000640 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d79975e9f0 0x55d799b64610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.300+0000 7f1ca9000640 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d79975e9f0 0x55d799b64610 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c9637076195801d server_cookie=c4bab5b8e8f94b1d in_seq=0 out_seq=0 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.300+0000 7f1c8ea00640 10 client.28184 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.301+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3456388224 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d799abff00 con 0x55d79975e9f0 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.301+0000 7f1c8ea00640 10 client.28184 handle_command_reply: tid=0 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.301+0000 7f1cb2691740 1 client.28184 shutdown 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d79977f390 msgr2=0x55d799b52cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d79977f390 0x55d799b52cf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1c900e50b0 tx=0x7f1c900b7100 comp rx=0 tx=0).stop 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 shutdown_connections 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d79975e9f0 0x55d799b64610 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799b5e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d79977f390 0x55d799b52cf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1c8ea00640 0 client.28184 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3456388224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7997771b0 0x55d799b527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 >> 172.21.15.84:0/3456388224 conn(0x55d799794460 msgr2=0x55d799b49d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 shutdown_connections 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 1 -- 172.21.15.84:0/3456388224 wait complete. 2024-09-21T08:01:59.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.302+0000 7f1cb2691740 20 client.28184 trim_cache size 0 max 16384 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 Processor -- start 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 -- start start 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997771b0 0x55d799b48590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b4ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca41b7510 con 0x55d79977f390 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca41b9050 con 0x55d7997a0070 2024-09-21T08:01:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.316+0000 7f1cb2691740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca41b7be0 con 0x55d7997771b0 2024-09-21T08:01:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b4ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b4ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39584/0 (socket says 172.21.15.84:39584) 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3348731918 learned_addr learned my addr 172.21.15.84:0/3348731918 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca9000640 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997771b0 0x55d799b48590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3348731918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997771b0 msgr2=0x55d799b48590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997771b0 0x55d799b48590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3348731918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 msgr2=0x55d799b541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3348731918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d799b49430 con 0x55d79977f390 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b4ccc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a9e30 tx=0x7f1c900e7fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a814d0573cac2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.317+0000 7f1c99600640 1 -- 172.21.15.84:0/3348731918 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900a9700 con 0x55d79977f390 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1c99600640 1 -- 172.21.15.84:0/3348731918 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c900d3050 con 0x55d79977f390 2024-09-21T08:01:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1c99600640 1 -- 172.21.15.84:0/3348731918 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900b71d0 con 0x55d79977f390 2024-09-21T08:01:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 -- 172.21.15.84:0/3348731918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 msgr2=0x55d799b4ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b4ccc0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a9e30 tx=0x7f1c900e7fd0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 -- 172.21.15.84:0/3348731918 shutdown_connections 2024-09-21T08:01:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997a0070 0x55d799b541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b4ccc0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3348731918 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997771b0 0x55d799b48590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 -- 172.21.15.84:0/3348731918 >> 172.21.15.84:0/3348731918 conn(0x55d799794460 msgr2=0x55d799b53ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.318+0000 7f1cb2691740 1 -- 172.21.15.84:0/3348731918 shutdown_connections 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.319+0000 7f1cb2691740 1 -- 172.21.15.84:0/3348731918 wait complete. 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.319+0000 7f1cb2691740 1 -- start start 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.319+0000 7f1cb2691740 1 Processor -- start 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997771b0 0x55d799b56c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b57160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1cb2691740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799bcdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1cb2691740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca41b8980 con 0x55d79977f390 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1cb2691740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca41b82b0 con 0x55d7997771b0 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1cb2691740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca41b5510 con 0x55d7997a0070 2024-09-21T08:01:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1cb2691740 10 client.0 _ll_register_callbacks cb 0x7f1c900e5560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997771b0 0x55d799b56c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b57160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997771b0 0x55d799b56c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38206/0 (socket says 172.21.15.84:38206) 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca9000640 1 -- 172.21.15.84:0/3293215671 learned_addr learned my addr 172.21.15.84:0/3293215671 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca9a00640 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799bcdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 msgr2=0x55d799bcdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799bcdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3293215671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997771b0 msgr2=0x55d799b56c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997771b0 0x55d799b56c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.320+0000 7f1ca3e00640 1 -- 172.21.15.84:0/3293215671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d799bce510 con 0x55d79977f390 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1ca3e00640 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b57160 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a9de0 tx=0x7f1c9000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1145a107a0eaa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:01:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1c8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3293215671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c900a9700 con 0x55d79977f390 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3293215671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f1c900aece0 con 0x55d79977f390 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c900d3050 con 0x55d79977f390 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3293215671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c900b6920 con 0x55d79977f390 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1cb2691740 10 client.17826 fetch_fsmap learned FSMap version 29 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d799bcf720 con 0x55d79977f390 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.321+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3293215671 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c900d3050 con 0x55d79977f390 2024-09-21T08:01:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3293215671 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1c900cf270 con 0x55d79977f390 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1cb2691740 10 client.17826 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1cb2691740 10 client.17826 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1cb2691740 20 client.17826 populate_metadata read hostname 'smithi084' 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d799733da0 0x55d799bd1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1cb2691740 4 client.17826 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d799abb9b0 con 0x55d799733da0 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.322+0000 7f1ca9000640 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d799733da0 0x55d799bd1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1c8ea00640 10 client.17826 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1ca9000640 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d799733da0 0x55d799bd1aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0a47f39bca9f580 server_cookie=837c348490c94e37 in_seq=0 out_seq=0 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1c8ea00640 1 -- 172.21.15.84:0/3293215671 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d799abb9b0 con 0x55d799733da0 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1c8ea00640 10 client.17826 handle_command_reply: tid=0 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 client.17826 shutdown 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 msgr2=0x55d799b57160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b57160 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a9de0 tx=0x7f1c9000cf90 comp rx=0 tx=0).stop 2024-09-21T08:01:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 shutdown_connections 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d799733da0 0x55d799bd1aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d7997a0070 0x55d799bcdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d79977f390 0x55d799b57160 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 --2- 172.21.15.84:0/3293215671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7997771b0 0x55d799b56c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 >> 172.21.15.84:0/3293215671 conn(0x55d799794460 msgr2=0x55d799b482c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.323+0000 7f1c8ea00640 0 client.17826 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 shutdown_connections 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1cb2691740 1 -- 172.21.15.84:0/3293215671 wait complete. 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1cb2691740 20 client.17826 trim_cache size 0 max 16384 2024-09-21T08:01:59.328 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:01:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1c880b6680 msgr2=0x7f1c880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1c880b6680 0x7f1c880b8b90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55d799b45820 tx=0x7f1c94009500 comp rx=0 tx=0).stop 2024-09-21T08:01:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca410faf0 msgr2=0x7f1ca41a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:01:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca410faf0 0x7f1ca41a10a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1ca406ca20 tx=0x7f1c9000ee50 comp rx=0 tx=0).stop 2024-09-21T08:01:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 shutdown_connections 2024-09-21T08:01:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f1c880b6680 0x7f1c880b8b90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ca4110440 0x7f1ca41a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ca410faf0 0x7f1ca41a10a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 --2- 172.21.15.84:0/1869469099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca410a1b0 0x7f1ca41a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:01:59.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.324+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 >> 172.21.15.84:0/1869469099 conn(0x7f1ca40780e0 msgr2=0x7f1ca4078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:01:59.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.325+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 shutdown_connections 2024-09-21T08:01:59.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:01:59.325+0000 7f1caba00640 1 -- 172.21.15.84:0/1869469099 wait complete. 2024-09-21T08:01:59.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:01:59 smithi191 ceph-mon[34667]: pgmap v730: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:01:59.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:01:59 smithi084 ceph-mon[30411]: pgmap v730: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:02:00.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:01:59 smithi162 ceph-mon[34833]: pgmap v730: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:02:00.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:02:00.692 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 -- 172.21.15.84:0/1379889375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc077380 msgr2=0x7fa1cc0757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 --2- 172.21.15.84:0/1379889375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc077380 0x7fa1cc0757b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009860 tx=0x7fa1bc02a340 comp rx=0 tx=0).stop 2024-09-21T08:02:01.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 -- 172.21.15.84:0/1379889375 shutdown_connections 2024-09-21T08:02:01.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 --2- 172.21.15.84:0/1379889375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1cc114280 0x7fa1cc116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 --2- 172.21.15.84:0/1379889375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1cc075dd0 0x7fa1cc0761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 --2- 172.21.15.84:0/1379889375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc077380 0x7fa1cc0757b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 -- 172.21.15.84:0/1379889375 >> 172.21.15.84:0/1379889375 conn(0x7fa1cc0ff440 msgr2=0x7fa1cc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:01.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 -- 172.21.15.84:0/1379889375 shutdown_connections 2024-09-21T08:02:01.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.322+0000 7fa1cb200640 1 -- 172.21.15.84:0/1379889375 wait complete. 2024-09-21T08:02:01.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.323+0000 7fa1cb200640 1 Processor -- start 2024-09-21T08:02:01.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1cb200640 1 -- start start 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1cb200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1cc075dd0 0x7fa1cc1a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1cb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1cc077380 0x7fa1cc1a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1cb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc114280 0x7fa1cc1a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1cb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc119ec0 con 0x7fa1cc077380 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1cb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc119d40 con 0x7fa1cc114280 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1cb200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc11a040 con 0x7fa1cc075dd0 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1ca800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc114280 0x7fa1cc1a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1cc075dd0 0x7fa1cc1a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1cc077380 0x7fa1cc1a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1ca800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc114280 0x7fa1cc1a6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38234/0 (socket says 172.21.15.84:38234) 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1cc075dd0 0x7fa1cc1a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35328/0 (socket says 172.21.15.84:35328) 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.324+0000 7fa1ca800640 1 -- 172.21.15.84:0/2698841695 learned_addr learned my addr 172.21.15.84:0/2698841695 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1ca800640 1 -- 172.21.15.84:0/2698841695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1cc075dd0 msgr2=0x7fa1cc1a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1ca800640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1cc075dd0 0x7fa1cc1a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1ca800640 1 -- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1cc077380 msgr2=0x7fa1cc1a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1ca800640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1cc077380 0x7fa1cc1a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1ca800640 1 -- 172.21.15.84:0/2698841695 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc1a6860 con 0x7fa1cc114280 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1ca800640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc114280 0x7fa1cc1a6130 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400efc0 tx=0x7fa1c400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1c2a00640 1 -- 172.21.15.84:0/2698841695 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4003970 con 0x7fa1cc114280 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1c2a00640 1 -- 172.21.15.84:0/2698841695 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1c4004020 con 0x7fa1cc114280 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.325+0000 7fa1c2a00640 1 -- 172.21.15.84:0/2698841695 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c400b940 con 0x7fa1cc114280 2024-09-21T08:02:01.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.326+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1cc1a6b50 con 0x7fa1cc114280 2024-09-21T08:02:01.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.326+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1cc1ad2b0 con 0x7fa1cc114280 2024-09-21T08:02:01.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.329+0000 7fa1d77f0740 1 Processor -- start 2024-09-21T08:02:01.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.329+0000 7fa1c2a00640 1 -- 172.21.15.84:0/2698841695 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa1c401d020 con 0x7fa1cc114280 2024-09-21T08:02:01.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.330+0000 7fa1d77f0740 1 -- start start 2024-09-21T08:02:01.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.330+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.330+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.330+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.330+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fa0a625fb0 con 0x55fa0a308070 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.330+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fa0a6153e0 con 0x55fa0a2df1b0 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.330+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fa0a6191f0 con 0x55fa0a2e7390 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.331+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.331+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39608/0 (socket says 172.21.15.84:39608) 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.331+0000 7fa1c9400640 1 -- 172.21.15.84:0/659733264 learned_addr learned my addr 172.21.15.84:0/659733264 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.331+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.331+0000 7fa1c9400640 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.331+0000 7fa1c9e00640 1 -- 172.21.15.84:0/659733264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 msgr2=0x55fa0a6af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.331+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c9e00640 1 -- 172.21.15.84:0/659733264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 msgr2=0x55fa0a6aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c9e00640 1 -- 172.21.15.84:0/659733264 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0a5dfcd0 con 0x55fa0a2df1b0 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c9400640 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c2a00640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1b00b6700 0x7fa1b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6af4b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc035040 tx=0x7fa1bc005d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126c06269a5fcf2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c2a00640 1 -- 172.21.15.84:0/2698841695 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7fa1c40e78d0 con 0x7fa1cc114280 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1c9400640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1b00b6700 0x7fa1b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1b7000640 1 -- 172.21.15.84:0/659733264 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc041020 con 0x55fa0a2df1b0 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1b7000640 1 -- 172.21.15.84:0/659733264 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1bc030450 con 0x55fa0a2df1b0 2024-09-21T08:02:01.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.332+0000 7fa1b7000640 1 -- 172.21.15.84:0/659733264 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc037040 con 0x55fa0a2df1b0 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 -- 172.21.15.84:0/659733264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2df1b0 msgr2=0x55fa0a6af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1c9400640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1b00b6700 0x7fa1b00b8c10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009730 tx=0x7fa1b80099d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6af4b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc035040 tx=0x7fa1bc005d10 comp rx=0 tx=0).stop 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 -- 172.21.15.84:0/659733264 shutdown_connections 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6af4b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/659733264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 -- 172.21.15.84:0/659733264 >> 172.21.15.84:0/659733264 conn(0x55fa0a2fc460 msgr2=0x55fa0a6ace60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:01.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 -- 172.21.15.84:0/659733264 shutdown_connections 2024-09-21T08:02:01.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.334+0000 7fa1d77f0740 1 -- 172.21.15.84:0/659733264 wait complete. 2024-09-21T08:02:01.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.335+0000 7fa1d77f0740 1 -- start start 2024-09-21T08:02:01.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.335+0000 7fa1d77f0740 1 Processor -- start 2024-09-21T08:02:01.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.336+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6ba740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.336+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6bac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.336+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.336+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fa0a476700 con 0x55fa0a308070 2024-09-21T08:02:01.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.336+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fa0a5b0580 con 0x55fa0a2e7390 2024-09-21T08:02:01.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.336+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fa0a6bd6f0 con 0x55fa0a2df1b0 2024-09-21T08:02:01.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.336+0000 7fa1d77f0740 10 client.0 _ll_register_callbacks cb 0x55fa0a5c0470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:01.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6ba740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6ba740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35356/0 (socket says 172.21.15.84:35356) 2024-09-21T08:02:01.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 -- 172.21.15.84:0/3714017794 learned_addr learned my addr 172.21.15.84:0/3714017794 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:01.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9400640 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6bac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1ca800640 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 -- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 msgr2=0x55fa0a6bac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6bac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 -- 172.21.15.84:0/3714017794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 msgr2=0x55fa0a6c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 -- 172.21.15.84:0/3714017794 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa0a373650 con 0x55fa0a2df1b0 2024-09-21T08:02:01.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6ba740 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc030fc0 tx=0x7fa1bc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce94a256c60cd68a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:01.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.337+0000 7fa1ab400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.338+0000 7fa1ab400640 1 -- 172.21.15.84:0/3714017794 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc041030 con 0x55fa0a2df1b0 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.338+0000 7fa1ab400640 1 -- 172.21.15.84:0/3714017794 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7fa1bc004450 con 0x55fa0a2df1b0 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.338+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa0a5b2b90 con 0x55fa0a2df1b0 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.338+0000 7fa1ab400640 1 -- 172.21.15.84:0/3714017794 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1bc057050 con 0x55fa0a2df1b0 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.338+0000 7fa1d77f0740 10 client.28219 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.338+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fa0a5cd950 con 0x55fa0a2df1b0 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1ab400640 1 -- 172.21.15.84:0/3714017794 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fa0a5b2b90 con 0x55fa0a2df1b0 2024-09-21T08:02:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1ab400640 1 -- 172.21.15.84:0/3714017794 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa1bc03d480 con 0x55fa0a2df1b0 2024-09-21T08:02:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1d77f0740 10 client.28219 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1d77f0740 10 client.28219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1d77f0740 20 client.28219 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a2c69f0 0x55fa0a6cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1d77f0740 4 client.28219 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.339+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa0a627f00 con 0x55fa0a2c69f0 2024-09-21T08:02:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.340+0000 7fa1c9400640 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a2c69f0 0x55fa0a6cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.340+0000 7fa1c9400640 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a2c69f0 0x55fa0a6cc650 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5836a4b576475c4 server_cookie=88e7c01f2a4fbdef in_seq=0 out_seq=0 2024-09-21T08:02:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.340+0000 7fa1ab400640 10 client.28219 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1ab400640 1 -- 172.21.15.84:0/3714017794 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa0a627f00 con 0x55fa0a2c69f0 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1ab400640 10 client.28219 handle_command_reply: tid=0 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1d77f0740 1 client.28219 shutdown 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2df1b0 msgr2=0x55fa0a6ba740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6ba740 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc030fc0 tx=0x7fa1bc005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 shutdown_connections 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a308070 0x55fa0a6c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6bac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.341+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a2c69f0 0x55fa0a6cc650 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.342+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3714017794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6ba740 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.342+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 >> 172.21.15.84:0/3714017794 conn(0x55fa0a2fc460 msgr2=0x55fa0a6b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.342+0000 7fa1ab400640 0 client.28219 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.342+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 shutdown_connections 2024-09-21T08:02:01.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.342+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3714017794 wait complete. 2024-09-21T08:02:01.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.342+0000 7fa1d77f0740 20 client.28219 trim_cache size 0 max 16384 2024-09-21T08:02:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 Processor -- start 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 -- start start 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6ac610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a308070 0x55fa0a6acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc1b7180 con 0x55fa0a2df1b0 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc1b8cc0 con 0x55fa0a308070 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.357+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc1b7850 con 0x55fa0a2e7390 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39618/0 (socket says 172.21.15.84:39618) 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1c9e00640 1 -- 172.21.15.84:0/3402085028 learned_addr learned my addr 172.21.15.84:0/3402085028 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1c9400640 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1ca800640 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a308070 0x55fa0a6acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1ca800640 1 -- 172.21.15.84:0/3402085028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 msgr2=0x55fa0a6ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1ca800640 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1ca800640 1 -- 172.21.15.84:0/3402085028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 msgr2=0x55fa0a6b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1ca800640 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1ca800640 1 -- 172.21.15.84:0/3402085028 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0a6d2940 con 0x55fa0a308070 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.358+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.359+0000 7fa1ca800640 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a308070 0x55fa0a6acb50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40e4c90 tx=0x7fa1c40acbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ad480371f2ab73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.359+0000 7fa1b6600640 1 -- 172.21.15.84:0/3402085028 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40b6db0 con 0x55fa0a308070 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.359+0000 7fa1b6600640 1 -- 172.21.15.84:0/3402085028 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1c40e4f10 con 0x55fa0a308070 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.359+0000 7fa1b6600640 1 -- 172.21.15.84:0/3402085028 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40b6b80 con 0x55fa0a308070 2024-09-21T08:02:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3402085028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a308070 msgr2=0x55fa0a6acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a308070 0x55fa0a6acb50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40e4c90 tx=0x7fa1c40acbc0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3402085028 shutdown_connections 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a308070 0x55fa0a6acb50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a2e7390 0x55fa0a6ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3402085028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3402085028 >> 172.21.15.84:0/3402085028 conn(0x55fa0a2fc460 msgr2=0x55fa0a6b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3402085028 shutdown_connections 2024-09-21T08:02:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.360+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3402085028 wait complete. 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 -- start start 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 Processor -- start 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a308070 0x55fa0a6cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc1b85f0 con 0x55fa0a2df1b0 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc1b7f20 con 0x55fa0a2e7390 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc1b5180 con 0x55fa0a308070 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.361+0000 7fa1d77f0740 10 client.0 _ll_register_callbacks cb 0x7fa1bc0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39628/0 (socket says 172.21.15.84:39628) 2024-09-21T08:02:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9e00640 1 -- 172.21.15.84:0/3542434862 learned_addr learned my addr 172.21.15.84:0/3542434862 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1ca800640 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a308070 0x55fa0a6cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9400640 1 -- 172.21.15.84:0/3542434862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a308070 msgr2=0x55fa0a6cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9400640 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a308070 0x55fa0a6cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9400640 1 -- 172.21.15.84:0/3542434862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 msgr2=0x55fa0a6cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9400640 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9400640 1 -- 172.21.15.84:0/3542434862 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa0a6ce0d0 con 0x55fa0a2e7390 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.362+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.363+0000 7fa1c9400640 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6cd3a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55fa0a5b0650 tx=0x7fa1b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62050ec56c06c0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.363+0000 7fa1ab400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.363+0000 7fa1ab400640 1 -- 172.21.15.84:0/3542434862 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800f960 con 0x55fa0a2e7390 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.363+0000 7fa1ab400640 1 -- 172.21.15.84:0/3542434862 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7fa1b800fb00 con 0x55fa0a2e7390 2024-09-21T08:02:01.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.363+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1c40e4f10 con 0x55fa0a2e7390 2024-09-21T08:02:01.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.363+0000 7fa1ab400640 1 -- 172.21.15.84:0/3542434862 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1b800fd00 con 0x55fa0a2e7390 2024-09-21T08:02:01.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 10 client.28208 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:01.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fa0a736e10 con 0x55fa0a2e7390 2024-09-21T08:02:01.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1ab400640 1 -- 172.21.15.84:0/3542434862 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1c40e4f10 con 0x55fa0a2e7390 2024-09-21T08:02:01.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1ab400640 1 -- 172.21.15.84:0/3542434862 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa1b8034070 con 0x55fa0a2e7390 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 10 client.28208 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 10 client.28208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 20 client.28208 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a29bda0 0x55fa0a7395d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 4 client.28208 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.364+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa0a6239b0 con 0x55fa0a29bda0 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.365+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a29bda0 0x55fa0a7395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.365+0000 7fa1c9e00640 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a29bda0 0x55fa0a7395d0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17f54682effbc518 server_cookie=75acee1f81d8b48e in_seq=0 out_seq=0 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.365+0000 7fa1ab400640 10 client.28208 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1ab400640 1 -- 172.21.15.84:0/3542434862 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa0a6239b0 con 0x55fa0a29bda0 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1ab400640 10 client.28208 handle_command_reply: tid=0 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 client.28208 shutdown 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 msgr2=0x55fa0a6cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6cd3a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55fa0a5b0650 tx=0x7fa1b80046c0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 shutdown_connections 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55fa0a29bda0 0x55fa0a7395d0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fa0a308070 0x55fa0a6cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa0a2e7390 0x55fa0a6cd3a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 --2- 172.21.15.84:0/3542434862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fa0a2df1b0 0x55fa0a6cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 >> 172.21.15.84:0/3542434862 conn(0x55fa0a2fc460 msgr2=0x55fa0a6bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1ab400640 0 client.28208 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 shutdown_connections 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 1 -- 172.21.15.84:0/3542434862 wait complete. 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.366+0000 7fa1d77f0740 20 client.28208 trim_cache size 0 max 16384 2024-09-21T08:02:01.370 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1b00b6700 msgr2=0x7fa1b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1b00b6700 0x7fa1b00b8c10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009730 tx=0x7fa1b80099d0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc114280 msgr2=0x7fa1cc1a6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc114280 0x7fa1cc1a6130 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400efc0 tx=0x7fa1c400c800 comp rx=0 tx=0).stop 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 shutdown_connections 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa1b00b6700 0x7fa1b00b8c10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc114280 0x7fa1cc1a6130 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1cc077380 0x7fa1cc1a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 --2- 172.21.15.84:0/2698841695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1cc075dd0 0x7fa1cc1a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:01.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.367+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 >> 172.21.15.84:0/2698841695 conn(0x7fa1cc0ff440 msgr2=0x7fa1cc110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:01.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.368+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 shutdown_connections 2024-09-21T08:02:01.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:01.368+0000 7fa1cb200640 1 -- 172.21.15.84:0/2698841695 wait complete. 2024-09-21T08:02:01.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:01 smithi084 ceph-mon[30411]: pgmap v731: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:02:01.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:01 smithi191 ceph-mon[34667]: pgmap v731: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:02:02.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:01 smithi162 ceph-mon[34833]: pgmap v731: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:02:03.326 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T08:02:03.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T08:02:03.702 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:03.906 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:03 smithi191 ceph-mon[34667]: pgmap v732: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:02:03.994 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:03 smithi084 ceph-mon[30411]: pgmap v732: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:02:04.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:03 smithi162 ceph-mon[34833]: pgmap v732: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.518+0000 7ff86a800640 1 -- 172.21.15.84:0/1117643755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff864105d80 msgr2=0x7ff864106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.518+0000 7ff86a800640 1 --2- 172.21.15.84:0/1117643755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff864105d80 0x7ff864106190 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff854009ca0 tx=0x7ff85402a8b0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.519+0000 7ff86a800640 1 -- 172.21.15.84:0/1117643755 shutdown_connections 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.519+0000 7ff86a800640 1 --2- 172.21.15.84:0/1117643755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff86410c010 0x7ff864112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.519+0000 7ff86a800640 1 --2- 172.21.15.84:0/1117643755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff86410b6c0 0x7ff86410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.519+0000 7ff86a800640 1 --2- 172.21.15.84:0/1117643755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff864105d80 0x7ff864106190 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.519+0000 7ff86a800640 1 -- 172.21.15.84:0/1117643755 >> 172.21.15.84:0/1117643755 conn(0x7ff864101810 msgr2=0x7ff864103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.519+0000 7ff86a800640 1 -- 172.21.15.84:0/1117643755 shutdown_connections 2024-09-21T08:02:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.519+0000 7ff86a800640 1 -- 172.21.15.84:0/1117643755 wait complete. 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 Processor -- start 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 -- start start 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff864105d80 0x7ff86419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff86410b6c0 0x7ff86419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff86410c010 0x7ff8641a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff864115cf0 con 0x7ff86410b6c0 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff864115b70 con 0x7ff864105d80 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff86a800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff864115e70 con 0x7ff86410c010 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.520+0000 7ff85aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff86410b6c0 0x7ff86419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff86410b6c0 0x7ff86419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39646/0 (socket says 172.21.15.84:39646) 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 -- 172.21.15.84:0/3511253970 learned_addr learned my addr 172.21.15.84:0/3511253970 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff863400640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff864105d80 0x7ff86419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff863e00640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff86410c010 0x7ff8641a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 -- 172.21.15.84:0/3511253970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff86410c010 msgr2=0x7ff8641a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff86410c010 0x7ff8641a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 -- 172.21.15.84:0/3511253970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff864105d80 msgr2=0x7ff86419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff864105d80 0x7ff86419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 -- 172.21.15.84:0/3511253970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8641a2630 con 0x7ff86410b6c0 2024-09-21T08:02:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff863400640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff864105d80 0x7ff86419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:04.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.521+0000 7ff85aa00640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff86410b6c0 0x7ff86419cc60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00d740 tx=0x7ff84c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:04.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.522+0000 7ff860c00640 1 -- 172.21.15.84:0/3511253970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c017070 con 0x7ff86410b6c0 2024-09-21T08:02:04.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.522+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8641a2920 con 0x7ff86410b6c0 2024-09-21T08:02:04.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.522+0000 7ff860c00640 1 -- 172.21.15.84:0/3511253970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff84c00de50 con 0x7ff86410b6c0 2024-09-21T08:02:04.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.522+0000 7ff860c00640 1 -- 172.21.15.84:0/3511253970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00f620 con 0x7ff86410b6c0 2024-09-21T08:02:04.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.522+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8641a9080 con 0x7ff86410b6c0 2024-09-21T08:02:04.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.525+0000 7ff8714b0740 1 Processor -- start 2024-09-21T08:02:04.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.525+0000 7ff8714b0740 1 -- start start 2024-09-21T08:02:04.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.525+0000 7ff860c00640 1 -- 172.21.15.84:0/3511253970 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7ff84c01a070 con 0x7ff86410b6c0 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477bffcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477bffd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477bffd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff8714b0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56477bf72e90 con 0x56477bc2c490 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff8714b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56477bf622c0 con 0x56477bc34670 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff8714b0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56477bf660d0 con 0x56477bc55350 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff863400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477bffd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff863e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477bffcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff863400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477bffd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39650/0 (socket says 172.21.15.84:39650) 2024-09-21T08:02:04.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff863400640 1 -- 172.21.15.84:0/4012945540 learned_addr learned my addr 172.21.15.84:0/4012945540 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.526+0000 7ff85aa00640 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477bffd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.527+0000 7ff863400640 1 -- 172.21.15.84:0/4012945540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 msgr2=0x56477bffcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.527+0000 7ff863400640 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477bffcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.527+0000 7ff863400640 1 -- 172.21.15.84:0/4012945540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 msgr2=0x56477bffd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.527+0000 7ff863400640 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477bffd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.527+0000 7ff863400640 1 -- 172.21.15.84:0/4012945540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56477bcc0930 con 0x56477bc2c490 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.527+0000 7ff863400640 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477bffd250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff854035000 tx=0x7ff854009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ad80018caa2a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.527+0000 7ff860c00640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8480b6680 0x7ff8480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.528+0000 7ff860c00640 1 -- 172.21.15.84:0/3511253970 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7ff84c0e7410 con 0x7ff86410b6c0 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.528+0000 7ff858c00640 1 -- 172.21.15.84:0/4012945540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854030bc0 con 0x56477bc2c490 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.528+0000 7ff863e00640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8480b6680 0x7ff8480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.528+0000 7ff858c00640 1 -- 172.21.15.84:0/4012945540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff854036030 con 0x56477bc2c490 2024-09-21T08:02:04.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.528+0000 7ff858c00640 1 -- 172.21.15.84:0/4012945540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854031440 con 0x56477bc2c490 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 -- 172.21.15.84:0/4012945540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 msgr2=0x56477bffd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff863e00640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8480b6680 0x7ff8480b8b90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b7f0 tx=0x7ff85c00b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477bffd250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff854035000 tx=0x7ff854009940 comp rx=0 tx=0).stop 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 -- 172.21.15.84:0/4012945540 shutdown_connections 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477bffd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477bffd250 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 --2- 172.21.15.84:0/4012945540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477bffcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 -- 172.21.15.84:0/4012945540 >> 172.21.15.84:0/4012945540 conn(0x56477bc49740 msgr2=0x56477bffac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 -- 172.21.15.84:0/4012945540 shutdown_connections 2024-09-21T08:02:04.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 -- 172.21.15.84:0/4012945540 wait complete. 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.529+0000 7ff8714b0740 1 -- start start 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 1 Processor -- start 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c008880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477c008dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477c014780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56477bdc3890 con 0x56477bc34670 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56477befd160 con 0x56477bc55350 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56477c00b490 con 0x56477bc2c490 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.530+0000 7ff8714b0740 10 client.0 _ll_register_callbacks cb 0x56477bf19a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477c008dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477c008dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39664/0 (socket says 172.21.15.84:39664) 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 -- 172.21.15.84:0/1461148543 learned_addr learned my addr 172.21.15.84:0/1461148543 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:04.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff863400640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c008880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff863e00640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477c014780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 -- 172.21.15.84:0/1461148543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 msgr2=0x56477c008880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c008880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 -- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 msgr2=0x56477c014780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477c014780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 -- 172.21.15.84:0/1461148543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56477c014d10 con 0x56477bc34670 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff863400640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c008880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:04.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff863e00640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477c014780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:04.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff85aa00640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477c008dc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0e4830 tx=0x7ff84c0eab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4e4a127c8c45fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:04.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.531+0000 7ff851600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:04.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff851600640 1 -- 172.21.15.84:0/1461148543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c021070 con 0x56477bc34670 2024-09-21T08:02:04.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff851600640 1 -- 172.21.15.84:0/1461148543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7ff84c0942d0 con 0x56477bc34670 2024-09-21T08:02:04.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff854036030 con 0x56477bc34670 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff851600640 1 -- 172.21.15.84:0/1461148543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff84c0a95d0 con 0x56477bc34670 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff8714b0740 10 client.17856 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56477c017620 con 0x56477bc34670 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff851600640 1 -- 172.21.15.84:0/1461148543 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff854036030 con 0x56477bc34670 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.532+0000 7ff851600640 1 -- 172.21.15.84:0/1461148543 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff84c0abe50 con 0x56477bc34670 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.533+0000 7ff8714b0740 10 client.17856 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.533+0000 7ff8714b0740 10 client.17856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.533+0000 7ff8714b0740 20 client.17856 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.533+0000 7ff8714b0740 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bc13cd0 0x56477c01aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.533+0000 7ff8714b0740 4 client.17856 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.533+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56477bf74de0 con 0x56477bc13cd0 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.533+0000 7ff863400640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bc13cd0 0x56477c01aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.534+0000 7ff863400640 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bc13cd0 0x56477c01aaa0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db743dd9eb43e09c server_cookie=fb3ecea6c3eb0520 in_seq=0 out_seq=0 2024-09-21T08:02:04.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.534+0000 7ff851600640 10 client.17856 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:04.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.534+0000 7ff851600640 1 -- 172.21.15.84:0/1461148543 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56477bf74de0 con 0x56477bc13cd0 2024-09-21T08:02:04.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.534+0000 7ff851600640 10 client.17856 handle_command_reply: tid=0 2024-09-21T08:02:04.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 client.17856 shutdown 2024-09-21T08:02:04.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 msgr2=0x56477c008dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477c008dc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0e4830 tx=0x7ff84c0eab50 comp rx=0 tx=0).stop 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 shutdown_connections 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477c014780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477c008dc0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bc13cd0 0x56477c01aaa0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 --2- 172.21.15.84:0/1461148543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c008880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 >> 172.21.15.84:0/1461148543 conn(0x56477bc49740 msgr2=0x56477bff9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff851600640 0 client.17856 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 shutdown_connections 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 1 -- 172.21.15.84:0/1461148543 wait complete. 2024-09-21T08:02:04.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.535+0000 7ff8714b0740 20 client.17856 trim_cache size 0 max 16384 2024-09-21T08:02:04.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.553+0000 7ff8714b0740 1 Processor -- start 2024-09-21T08:02:04.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.553+0000 7ff8714b0740 1 -- start start 2024-09-21T08:02:04.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c002e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477bff9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477bff97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff8714b0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641b3060 con 0x56477bc34670 2024-09-21T08:02:04.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff8714b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641b4ba0 con 0x56477bc55350 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff8714b0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641b3730 con 0x56477bc2c490 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff85aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477bff9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff85aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477bff9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39680/0 (socket says 172.21.15.84:39680) 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff85aa00640 1 -- 172.21.15.84:0/2880854463 learned_addr learned my addr 172.21.15.84:0/2880854463 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff863400640 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c002e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.554+0000 7ff863e00640 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477bff97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff85aa00640 1 -- 172.21.15.84:0/2880854463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 msgr2=0x56477c002e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff85aa00640 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c002e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff85aa00640 1 -- 172.21.15.84:0/2880854463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 msgr2=0x56477bff97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff85aa00640 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477bff97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff85aa00640 1 -- 172.21.15.84:0/2880854463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56477bff6400 con 0x56477bc34670 2024-09-21T08:02:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff85aa00640 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477bff9280 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0aa1f0 tx=0x7ff84c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c331f8f4feef327 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff853e00640 1 -- 172.21.15.84:0/2880854463 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c021070 con 0x56477bc34670 2024-09-21T08:02:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff853e00640 1 -- 172.21.15.84:0/2880854463 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff84c0aca90 con 0x56477bc34670 2024-09-21T08:02:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.555+0000 7ff853e00640 1 -- 172.21.15.84:0/2880854463 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0ac6f0 con 0x56477bc34670 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 -- 172.21.15.84:0/2880854463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 msgr2=0x56477bff9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477bff9280 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0aa1f0 tx=0x7ff84c000bc0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 -- 172.21.15.84:0/2880854463 shutdown_connections 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc55350 0x56477bff97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc34670 0x56477bff9280 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 --2- 172.21.15.84:0/2880854463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc2c490 0x56477c002e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 -- 172.21.15.84:0/2880854463 >> 172.21.15.84:0/2880854463 conn(0x56477bc49740 msgr2=0x56477c006f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 -- 172.21.15.84:0/2880854463 shutdown_connections 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.556+0000 7ff8714b0740 1 -- 172.21.15.84:0/2880854463 wait complete. 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 -- start start 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 Processor -- start 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477c010c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477c0057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641b44d0 con 0x56477bc2c490 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641b3e00 con 0x56477bc34670 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff8641b1060 con 0x56477bc55350 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.557+0000 7ff8714b0740 10 client.0 _ll_register_callbacks cb 0x7ff84c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477c010c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff85aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477c010c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39688/0 (socket says 172.21.15.84:39688) 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 -- 172.21.15.84:0/541836343 learned_addr learned my addr 172.21.15.84:0/541836343 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863e00640 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477c0057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 -- 172.21.15.84:0/541836343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 msgr2=0x56477c0057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477c0057f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 -- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 msgr2=0x56477c0052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477c0052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 -- 172.21.15.84:0/541836343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56477c005d30 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff85aa00640 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477c0052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff863400640 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477c010c20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff8540049d0 tx=0x7ff854004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61461a9efe1f748 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.558+0000 7ff851600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.559+0000 7ff851600640 1 -- 172.21.15.84:0/541836343 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85405d060 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.559+0000 7ff851600640 1 -- 172.21.15.84:0/541836343 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7ff854030ba0 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.559+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff84c0aca90 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.559+0000 7ff851600640 1 -- 172.21.15.84:0/541836343 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff854030eb0 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.559+0000 7ff8714b0740 10 client.17862 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.559+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56477c00e390 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.559+0000 7ff851600640 1 -- 172.21.15.84:0/541836343 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff84c0aca90 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff851600640 1 -- 172.21.15.84:0/541836343 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff854043070 con 0x56477bc2c490 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff8714b0740 10 client.17862 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff8714b0740 10 client.17862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff8714b0740 20 client.17862 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff8714b0740 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bbe9080 0x56477c087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff8714b0740 4 client.17862 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56477bf70890 con 0x56477bbe9080 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.560+0000 7ff85aa00640 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bbe9080 0x56477c087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.561+0000 7ff85aa00640 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bbe9080 0x56477c087440 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39443b52784ece5 server_cookie=d64038464b5fc423 in_seq=0 out_seq=0 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.561+0000 7ff851600640 10 client.17862 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.562+0000 7ff851600640 1 -- 172.21.15.84:0/541836343 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56477bf70890 con 0x56477bbe9080 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.562+0000 7ff851600640 10 client.17862 handle_command_reply: tid=0 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.562+0000 7ff8714b0740 1 client.17862 shutdown 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 msgr2=0x56477c010c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477c010c20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff8540049d0 tx=0x7ff854004480 comp rx=0 tx=0).stop 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 shutdown_connections 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x56477bbe9080 0x56477c087440 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56477bc55350 0x56477c0057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56477bc34670 0x56477c0052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 --2- 172.21.15.84:0/541836343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477bc2c490 0x56477c010c20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 >> 172.21.15.84:0/541836343 conn(0x56477bc49740 msgr2=0x56477c006e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff851600640 0 client.17862 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 shutdown_connections 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 1 -- 172.21.15.84:0/541836343 wait complete. 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.563+0000 7ff8714b0740 20 client.17862 trim_cache size 0 max 16384 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "30d95146-ffef-488a-bb0c-cb0c8fb5e5d0", 2024-09-21T08:02:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T08:02:04.570 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:02:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8480b6680 msgr2=0x7ff8480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8480b6680 0x7ff8480b8b90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b7f0 tx=0x7ff85c00b2e0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff86410b6c0 msgr2=0x7ff86419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff86410b6c0 0x7ff86419cc60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00d740 tx=0x7ff84c00dc00 comp rx=0 tx=0).stop 2024-09-21T08:02:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 shutdown_connections 2024-09-21T08:02:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7ff8480b6680 0x7ff8480b8b90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff86410c010 0x7ff8641a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff86410b6c0 0x7ff86419cc60 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 --2- 172.21.15.84:0/3511253970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff864105d80 0x7ff86419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:04.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 >> 172.21.15.84:0/3511253970 conn(0x7ff864101810 msgr2=0x7ff864103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:04.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 shutdown_connections 2024-09-21T08:02:04.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:04.564+0000 7ff86a800640 1 -- 172.21.15.84:0/3511253970 wait complete. 2024-09-21T08:02:04.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:04 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:02:05.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:04 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:02:05.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:04 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:02:05.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:05.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:02:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:05.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: pgmap v733: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T08:02:05.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: scrub queued for path: / 2024-09-21T08:02:05.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:05.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: scrub summary: active paths [/] 2024-09-21T08:02:05.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:05.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:02:05.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:02:05.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:05 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:02:05.854 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: pgmap v733: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: scrub queued for path: / 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: scrub summary: active paths [/] 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:02:05.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:05 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:02:06.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: pgmap v733: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-21T08:02:06.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: scrub queued for path: / 2024-09-21T08:02:06.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:06.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: scrub summary: active paths [/] 2024-09-21T08:02:06.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: scrub summary: idle+waiting paths [/] 2024-09-21T08:02:06.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:02:06.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:02:06.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:05 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.598+0000 7f5252c00640 1 -- 172.21.15.84:0/1768568161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c1092d0 msgr2=0x7f524c1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.598+0000 7f5252c00640 1 --2- 172.21.15.84:0/1768568161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c1092d0 0x7f524c1096e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5238009900 tx=0x7f523802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.599+0000 7f5252c00640 1 -- 172.21.15.84:0/1768568161 shutdown_connections 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.599+0000 7f5252c00640 1 --2- 172.21.15.84:0/1768568161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c109c20 0x7f524c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.599+0000 7f5252c00640 1 --2- 172.21.15.84:0/1768568161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c1092d0 0x7f524c1096e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.599+0000 7f5252c00640 1 --2- 172.21.15.84:0/1768568161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c103990 0x7f524c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.599+0000 7f5252c00640 1 -- 172.21.15.84:0/1768568161 >> 172.21.15.84:0/1768568161 conn(0x7f524c0ff3e0 msgr2=0x7f524c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.599+0000 7f5252c00640 1 -- 172.21.15.84:0/1768568161 shutdown_connections 2024-09-21T08:02:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.599+0000 7f5252c00640 1 -- 172.21.15.84:0/1768568161 wait complete. 2024-09-21T08:02:06.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 Processor -- start 2024-09-21T08:02:06.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 -- start start 2024-09-21T08:02:06.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c103990 0x7f524c19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c1092d0 0x7f524c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c109c20 0x7f524c1a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f524c113930 con 0x7f524c103990 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f524c1137b0 con 0x7f524c109c20 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.600+0000 7f5252c00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f524c113ab0 con 0x7f524c1092d0 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c103990 0x7f524c19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c103990 0x7f524c19c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39694/0 (socket says 172.21.15.84:39694) 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 -- 172.21.15.84:0/3875400226 learned_addr learned my addr 172.21.15.84:0/3875400226 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5252200640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c109c20 0x7f524c1a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5250e00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c1092d0 0x7f524c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 -- 172.21.15.84:0/3875400226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c1092d0 msgr2=0x7f524c19cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c1092d0 0x7f524c19cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 -- 172.21.15.84:0/3875400226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c109c20 msgr2=0x7f524c1a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c109c20 0x7f524c1a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 -- 172.21.15.84:0/3875400226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c1a24d0 con 0x7f524c103990 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5252200640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c109c20 0x7f524c1a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.601+0000 7f5251800640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c103990 0x7f524c19c560 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f524000e9f0 tx=0x7f524000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.602+0000 7f524a000640 1 -- 172.21.15.84:0/3875400226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524000cd80 con 0x7f524c103990 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.602+0000 7f524a000640 1 -- 172.21.15.84:0/3875400226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52400108e0 con 0x7f524c103990 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.602+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524c1a27c0 con 0x7f524c103990 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.602+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524c1a8f20 con 0x7f524c103990 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.602+0000 7f524a000640 1 -- 172.21.15.84:0/3875400226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240018980 con 0x7f524c103990 2024-09-21T08:02:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.603+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522c0052c0 con 0x7f524c103990 2024-09-21T08:02:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.605+0000 7f524a000640 1 -- 172.21.15.84:0/3875400226 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5240010430 con 0x7f524c103990 2024-09-21T08:02:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.607+0000 7f524a000640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52340b6700 0x7f52340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.607+0000 7f524a000640 1 -- 172.21.15.84:0/3875400226 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f52400e7b60 con 0x7f524c103990 2024-09-21T08:02:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.607+0000 7f5250e00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52340b6700 0x7f52340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.608+0000 7f5250e00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52340b6700 0x7f52340b8c10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f523802a9e0 tx=0x7f5238005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.611+0000 7f524a000640 1 -- 172.21.15.84:0/3875400226 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5240018420 con 0x7f524c103990 2024-09-21T08:02:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 -- 172.21.15.84:0/4248467928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc1092f0 msgr2=0x7f8cbc109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/4248467928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc109700 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009900 tx=0x7f8ca802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 -- 172.21.15.84:0/4248467928 shutdown_connections 2024-09-21T08:02:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/4248467928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc109c40 0x7f8cbc110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/4248467928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc109700 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/4248467928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 0x7f8cbc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 -- 172.21.15.84:0/4248467928 >> 172.21.15.84:0/4248467928 conn(0x7f8cbc0ff440 msgr2=0x7f8cbc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 -- 172.21.15.84:0/4248467928 shutdown_connections 2024-09-21T08:02:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.827+0000 7f8cbbe00640 1 -- 172.21.15.84:0/4248467928 wait complete. 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.828+0000 7f8cbbe00640 1 Processor -- start 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbbe00640 1 -- start start 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 0x7f8cbc19c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc109c40 0x7f8cbc1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc113900 con 0x7f8cbc109c40 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc113780 con 0x7f8cbc1092f0 2024-09-21T08:02:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbbe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc113a80 con 0x7f8cbc1039b0 2024-09-21T08:02:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc109c40 0x7f8cbc1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbaa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 0x7f8cbc19c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cba000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbaa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 0x7f8cbc19c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35458/0 (socket says 172.21.15.84:35458) 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cba000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc19caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38310/0 (socket says 172.21.15.84:38310) 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.829+0000 7f8cbaa00640 1 -- 172.21.15.84:0/3673242558 learned_addr learned my addr 172.21.15.84:0/3673242558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.830+0000 7f8cbaa00640 1 -- 172.21.15.84:0/3673242558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc1092f0 msgr2=0x7f8cbc19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.830+0000 7f8cbaa00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc19caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.830+0000 7f8cbaa00640 1 -- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc109c40 msgr2=0x7f8cbc1a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.830+0000 7f8cbaa00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc109c40 0x7f8cbc1a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.830+0000 7f8cbaa00640 1 -- 172.21.15.84:0/3673242558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc1a24c0 con 0x7f8cbc1039b0 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.830+0000 7f8cba000640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.830+0000 7f8cbaa00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 0x7f8cbc19c550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00e9f0 tx=0x7f8cac00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.831+0000 7f8cb3400640 1 -- 172.21.15.84:0/3673242558 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00ccc0 con 0x7f8cbc1039b0 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.831+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc1a27b0 con 0x7f8cbc1039b0 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.831+0000 7f8cb3400640 1 -- 172.21.15.84:0/3673242558 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cac00ce60 con 0x7f8cbc1039b0 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.831+0000 7f8cb3400640 1 -- 172.21.15.84:0/3673242558 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac010430 con 0x7f8cbc1039b0 2024-09-21T08:02:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.831+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc1a8f10 con 0x7f8cbc1039b0 2024-09-21T08:02:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 Processor -- start 2024-09-21T08:02:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 -- start start 2024-09-21T08:02:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184e6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391811e390 0x5639184e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56391845cf70 con 0x5639181161b0 2024-09-21T08:02:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56391844c3a0 con 0x56391811e390 2024-09-21T08:02:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.834+0000 7f8cc8883740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5639184501b0 con 0x56391813f070 2024-09-21T08:02:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cb3400640 1 -- 172.21.15.84:0/3673242558 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8cac0046c0 con 0x7f8cbc1039b0 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184e5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35466/0 (socket says 172.21.15.84:35466) 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 -- 172.21.15.84:0/3490493967 learned_addr learned my addr 172.21.15.84:0/3490493967 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cba000640 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391811e390 0x5639184e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbaa00640 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 -- 172.21.15.84:0/3490493967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391811e390 msgr2=0x5639184e6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391811e390 0x5639184e6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 -- 172.21.15.84:0/3490493967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 msgr2=0x5639184e6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184e6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.835+0000 7f8cbb400640 1 -- 172.21.15.84:0/3490493967 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563918416c90 con 0x56391813f070 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.836+0000 7f8cbb400640 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184e5cf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4011440 tx=0x7f8cb4011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1065d880db9885 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.836+0000 7f8ca7e00640 1 -- 172.21.15.84:0/3490493967 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4003c30 con 0x56391813f070 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.836+0000 7f8ca7e00640 1 -- 172.21.15.84:0/3490493967 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cb4003dd0 con 0x56391813f070 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.836+0000 7f8ca7e00640 1 -- 172.21.15.84:0/3490493967 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400fae0 con 0x56391813f070 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cb3400640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8ca00b6680 0x7f8ca00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cb3400640 1 -- 172.21.15.84:0/3673242558 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f8cac0e7f20 con 0x7f8cbc1039b0 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cbaa00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8ca00b6680 0x7f8ca00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 -- 172.21.15.84:0/3490493967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 msgr2=0x5639184e5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184e5cf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4011440 tx=0x7f8cb4011900 comp rx=0 tx=0).stop 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 -- 172.21.15.84:0/3490493967 shutdown_connections 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391811e390 0x5639184e6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184e6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3490493967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184e5cf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 -- 172.21.15.84:0/3490493967 >> 172.21.15.84:0/3490493967 conn(0x563918133460 msgr2=0x5639184e3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.837+0000 7f8cc8883740 1 -- 172.21.15.84:0/3490493967 shutdown_connections 2024-09-21T08:02:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.838+0000 7f8cc8883740 1 -- 172.21.15.84:0/3490493967 wait complete. 2024-09-21T08:02:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.838+0000 7f8cbaa00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8ca00b6680 0x7f8ca00b8b90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5639184e4970 tx=0x7f8cac009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.838+0000 7f8cc8883740 1 -- start start 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.838+0000 7f8cc8883740 1 Processor -- start 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5639181161b0 0x5639184f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cc8883740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639182ad700 con 0x56391811e390 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cc8883740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5639183e7540 con 0x5639181161b0 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cc8883740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5639184f44d0 con 0x56391813f070 2024-09-21T08:02:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cc8883740 10 client.0 _ll_register_callbacks cb 0x5639183f7430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5639181161b0 0x5639184f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cba000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5639181161b0 0x5639184f18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:38332/0 (socket says 172.21.15.84:38332) 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cbb400640 1 -- 172.21.15.84:0/3194576949 learned_addr learned my addr 172.21.15.84:0/3194576949 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.839+0000 7f8cbb400640 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.840+0000 7f8cba000640 1 -- 172.21.15.84:0/3194576949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 msgr2=0x5639184fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.840+0000 7f8cba000640 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.840+0000 7f8cba000640 1 -- 172.21.15.84:0/3194576949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5639181161b0 msgr2=0x5639184f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.840+0000 7f8cba000640 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5639181161b0 0x5639184f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.840+0000 7f8cba000640 1 -- 172.21.15.84:0/3194576949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639181aa650 con 0x56391811e390 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.840+0000 7f8cba000640 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184f1e60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ca802a910 tx=0x7f8ca80316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97d15f7a0690d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.840+0000 7f8ca4c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.841+0000 7f8ca4c00640 1 -- 172.21.15.84:0/3194576949 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8035040 con 0x56391811e390 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.841+0000 7f8ca4c00640 1 -- 172.21.15.84:0/3194576949 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f8ca8004240 con 0x56391811e390 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.841+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5639183e9b50 con 0x56391811e390 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.841+0000 7f8ca4c00640 1 -- 172.21.15.84:0/3194576949 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ca8031900 con 0x56391811e390 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.841+0000 7f8cc8883740 10 client.17880 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.841+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563918404910 con 0x56391811e390 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.841+0000 7f8ca4c00640 1 -- 172.21.15.84:0/3194576949 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5639183e9b50 con 0x56391811e390 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8ca4c00640 1 -- 172.21.15.84:0/3194576949 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8ca8004a40 con 0x56391811e390 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8cc8883740 10 client.17880 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8cc8883740 10 client.17880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8cc8883740 20 client.17880 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180fd9f0 0x563918503830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8cc8883740 4 client.17880 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56391845eec0 con 0x5639180fd9f0 2024-09-21T08:02:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.842+0000 7f8cbb400640 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180fd9f0 0x563918503830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.843+0000 7f8ca4c00640 10 client.17880 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.843+0000 7f8cbb400640 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180fd9f0 0x563918503830 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=108d4b6d16722f7 server_cookie=b21e8d561f2aa0c1 in_seq=0 out_seq=0 2024-09-21T08:02:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8ca4c00640 1 -- 172.21.15.84:0/3194576949 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56391845eec0 con 0x5639180fd9f0 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8ca4c00640 10 client.17880 handle_command_reply: tid=0 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 client.17880 shutdown 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 msgr2=0x5639184f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184f1e60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ca802a910 tx=0x7f8ca80316d0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 shutdown_connections 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180fd9f0 0x563918503830 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391813f070 0x5639184fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184f1e60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 --2- 172.21.15.84:0/3194576949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5639181161b0 0x5639184f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8ca4c00640 0 client.17880 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 >> 172.21.15.84:0/3194576949 conn(0x563918133460 msgr2=0x5639184e8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.844+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 shutdown_connections 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.845+0000 7f8cc8883740 1 -- 172.21.15.84:0/3194576949 wait complete. 2024-09-21T08:02:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.845+0000 7f8cc8883740 20 client.17880 trim_cache size 0 max 16384 2024-09-21T08:02:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.854+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f522c005880 con 0x7f524c103990 2024-09-21T08:02:06.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.854+0000 7f524a000640 1 -- 172.21.15.84:0/3875400226 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f52400b20a0 con 0x7f524c103990 2024-09-21T08:02:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:02:06.857 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:02:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:02:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52340b6700 msgr2=0x7f52340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52340b6700 0x7f52340b8c10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f523802a9e0 tx=0x7f5238005a20 comp rx=0 tx=0).stop 2024-09-21T08:02:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c103990 msgr2=0x7f524c19c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c103990 0x7f524c19c560 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f524000e9f0 tx=0x7f524000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 shutdown_connections 2024-09-21T08:02:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f52340b6700 0x7f52340b8c10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f524c109c20 0x7f524c1a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c1092d0 0x7f524c19cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 --2- 172.21.15.84:0/3875400226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524c103990 0x7f524c19c560 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 >> 172.21.15.84:0/3875400226 conn(0x7f524c0ff3e0 msgr2=0x7f524c106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 shutdown_connections 2024-09-21T08:02:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.857+0000 7f5252c00640 1 -- 172.21.15.84:0/3875400226 wait complete. 2024-09-21T08:02:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.863+0000 7f8cc8883740 1 Processor -- start 2024-09-21T08:02:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.863+0000 7f8cc8883740 1 -- start start 2024-09-21T08:02:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5639181161b0 0x5639184e7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184eee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cc8883740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1b2ea0 con 0x56391811e390 2024-09-21T08:02:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cc8883740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1b49e0 con 0x56391813f070 2024-09-21T08:02:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cc8883740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1b3570 con 0x5639181161b0 2024-09-21T08:02:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cba000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cba000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184ee8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39742/0 (socket says 172.21.15.84:39742) 2024-09-21T08:02:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cba000640 1 -- 172.21.15.84:0/579644521 learned_addr learned my addr 172.21.15.84:0/579644521 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cbb400640 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.864+0000 7f8cbb400640 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5639181161b0 0x5639184e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8cba000640 1 -- 172.21.15.84:0/579644521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5639181161b0 msgr2=0x5639184e7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8cba000640 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5639181161b0 0x5639184e7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8cba000640 1 -- 172.21.15.84:0/579644521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 msgr2=0x5639184eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8cba000640 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184eee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8cba000640 1 -- 172.21.15.84:0/579644521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639184f29a0 con 0x56391811e390 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8cbb400640 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5639181161b0 0x5639184e7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8cba000640 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184ee8d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8005f30 tx=0x7f8ca8032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf71091d8e83cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8ca7400640 1 -- 172.21.15.84:0/579644521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8000e60 con 0x56391811e390 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8ca7400640 1 -- 172.21.15.84:0/579644521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca8005490 con 0x56391811e390 2024-09-21T08:02:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.865+0000 7f8ca7400640 1 -- 172.21.15.84:0/579644521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8035070 con 0x56391811e390 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.866+0000 7f8cc8883740 1 -- 172.21.15.84:0/579644521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 msgr2=0x5639184ee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.866+0000 7f8cc8883740 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184ee8d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8005f30 tx=0x7f8ca8032fc0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 -- 172.21.15.84:0/579644521 shutdown_connections 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56391811e390 0x5639184ee8d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 --2- 172.21.15.84:0/579644521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5639181161b0 0x5639184e7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 -- 172.21.15.84:0/579644521 >> 172.21.15.84:0/579644521 conn(0x563918133460 msgr2=0x5639184e6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 -- 172.21.15.84:0/579644521 shutdown_connections 2024-09-21T08:02:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 -- 172.21.15.84:0/579644521 wait complete. 2024-09-21T08:02:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.867+0000 7f8cc8883740 1 -- start start 2024-09-21T08:02:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 1 Processor -- start 2024-09-21T08:02:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184f9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391811e390 0x5639184f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1b4310 con 0x5639181161b0 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1b3c40 con 0x56391813f070 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1b0ea0 con 0x56391811e390 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.868+0000 7f8cc8883740 10 client.0 _ll_register_callbacks cb 0x7f8ca8005e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391811e390 0x5639184f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391811e390 0x5639184f9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:35476/0 (socket says 172.21.15.84:35476) 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 -- 172.21.15.84:0/485162768 learned_addr learned my addr 172.21.15.84:0/485162768 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cbb400640 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 -- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 msgr2=0x5639184f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 -- 172.21.15.84:0/485162768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 msgr2=0x5639184f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 -- 172.21.15.84:0/485162768 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639184fa360 con 0x56391811e390 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8cba000640 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391811e390 0x5639184f9c70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ca802a910 tx=0x7f8ca8005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6617e49abce4d520 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.869+0000 7f8ca4c00640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.870+0000 7f8ca4c00640 1 -- 172.21.15.84:0/485162768 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8035040 con 0x56391811e390 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.870+0000 7f8ca4c00640 1 -- 172.21.15.84:0/485162768 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9432+0+0 (secure 0 0 0) 0x7f8ca8046470 con 0x56391811e390 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.870+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca8005490 con 0x56391811e390 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.870+0000 7f8ca4c00640 1 -- 172.21.15.84:0/485162768 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ca8005640 con 0x56391811e390 2024-09-21T08:02:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.870+0000 7f8cc8883740 10 client.28267 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.870+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56391856e660 con 0x56391811e390 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.870+0000 7f8ca4c00640 1 -- 172.21.15.84:0/485162768 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca8005490 con 0x56391811e390 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8ca4c00640 1 -- 172.21.15.84:0/485162768 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8ca80504b0 con 0x56391811e390 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8cc8883740 10 client.28267 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8cc8883740 10 client.28267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8cc8883740 20 client.28267 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8cc8883740 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180d2da0 0x563918570cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8cc8883740 4 client.28267 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56391845a970 con 0x5639180d2da0 2024-09-21T08:02:06.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.871+0000 7f8cbb400640 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180d2da0 0x563918570cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cbb400640 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180d2da0 0x563918570cd0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73bea10d0185f3ba server_cookie=5fae87d877f876d3 in_seq=0 out_seq=0 2024-09-21T08:02:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8ca4c00640 10 client.28267 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8ca4c00640 1 -- 172.21.15.84:0/485162768 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x56391845a970 con 0x5639180d2da0 2024-09-21T08:02:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8ca4c00640 10 client.28267 handle_command_reply: tid=0 2024-09-21T08:02:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 client.28267 shutdown 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391811e390 msgr2=0x5639184f9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391811e390 0x5639184f9c70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ca802a910 tx=0x7f8ca8005fd0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 shutdown_connections 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56391813f070 0x5639184f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5639180d2da0 0x563918570cd0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56391811e390 0x5639184f9c70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 --2- 172.21.15.84:0/485162768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639181161b0 0x5639184f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8ca4c00640 0 client.28267 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.872+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 >> 172.21.15.84:0/485162768 conn(0x563918133460 msgr2=0x5639184e8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.873+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 shutdown_connections 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.873+0000 7f8cc8883740 1 -- 172.21.15.84:0/485162768 wait complete. 2024-09-21T08:02:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.873+0000 7f8cc8883740 20 client.28267 trim_cache size 0 max 16384 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "30d95146-ffef-488a-bb0c-cb0c8fb5e5d0": { 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "30d95146-ffef-488a-bb0c-cb0c8fb5e5d0", 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T08:02:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "30d95146-ffef-488a-bb0c-cb0c8fb5e5d0": { 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:02:04.560637+0000", 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "63a41a05-d44f-45b2-983d-1fa6b7559a20": { 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:00:25.066675+0000", 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "73eff468-1da5-4975-a63e-c0f57a3f64cd": { 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:01:15.381648+0000", 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:06.885 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.873+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8ca00b6680 msgr2=0x7f8ca00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.873+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8ca00b6680 0x7f8ca00b8b90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5639184e4970 tx=0x7f8cac009310 comp rx=0 tx=0).stop 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.873+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 msgr2=0x7f8cbc19c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.873+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 0x7f8cbc19c550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00e9f0 tx=0x7f8cac00edf0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 shutdown_connections 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8ca00b6680 0x7f8ca00b8b90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cbc109c40 0x7f8cbc1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cbc1092f0 0x7f8cbc19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 --2- 172.21.15.84:0/3673242558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cbc1039b0 0x7f8cbc19c550 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 >> 172.21.15.84:0/3673242558 conn(0x7f8cbc0ff440 msgr2=0x7f8cbc108a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 shutdown_connections 2024-09-21T08:02:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:06.874+0000 7f8cbbe00640 1 -- 172.21.15.84:0/3673242558 wait complete. 2024-09-21T08:02:07.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:07 smithi191 ceph-mon[34667]: pgmap v734: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T08:02:07.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:07 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3875400226' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:07.951 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:07 smithi084 ceph-mon[30411]: pgmap v734: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T08:02:07.951 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:07 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3875400226' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:07.989 INFO:tasks.cephfs.filesystem:scrub status for tag:30d95146-ffef-488a-bb0c-cb0c8fb5e5d0 - {'path': '/', 'tag': '30d95146-ffef-488a-bb0c-cb0c8fb5e5d0', 'options': 'recursive,force'} 2024-09-21T08:02:08.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:07 smithi162 ceph-mon[34833]: pgmap v734: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T08:02:08.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:07 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3875400226' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:08.512 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 741934d5 --release --await' 2024-09-21T08:02:08.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 741934d5 --release --await 2024-09-21T08:02:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:09.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:09 smithi084 ceph-mon[30411]: pgmap v735: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T08:02:09.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:09 smithi084 ceph-mon[30411]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T08:02:10.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:09 smithi162 ceph-mon[34833]: pgmap v735: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T08:02:10.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:09 smithi162 ceph-mon[34833]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T08:02:10.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:09 smithi191 ceph-mon[34667]: pgmap v735: 129 pgs: 129 active+clean; 35 GiB data, 75 GiB used, 998 GiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T08:02:10.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:09 smithi191 ceph-mon[34667]: osdmap e99: 12 total, 12 up, 12 in 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.196+0000 7f75cec00640 1 -- 172.21.15.84:0/2777255165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810b6c0 msgr2=0x7f75c810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.196+0000 7f75cec00640 1 --2- 172.21.15.84:0/2777255165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810b6c0 0x7f75c810bad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009860 tx=0x7f75b402a380 comp rx=0 tx=0).stop 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.197+0000 7f75cec00640 1 -- 172.21.15.84:0/2777255165 shutdown_connections 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.197+0000 7f75cec00640 1 --2- 172.21.15.84:0/2777255165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810c010 0x7f75c8112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.198+0000 7f75cec00640 1 --2- 172.21.15.84:0/2777255165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810b6c0 0x7f75c810bad0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.198+0000 7f75cec00640 1 --2- 172.21.15.84:0/2777255165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c8105d80 0x7f75c8106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.198+0000 7f75cec00640 1 -- 172.21.15.84:0/2777255165 >> 172.21.15.84:0/2777255165 conn(0x7f75c8101790 msgr2=0x7f75c8103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.198+0000 7f75cec00640 1 -- 172.21.15.84:0/2777255165 shutdown_connections 2024-09-21T08:02:10.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.198+0000 7f75cec00640 1 -- 172.21.15.84:0/2777255165 wait complete. 2024-09-21T08:02:10.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.200+0000 7f75cec00640 1 Processor -- start 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.201+0000 7f75cec00640 1 -- start start 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75cec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c8105d80 0x7f75c807b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75cec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810b6c0 0x7f75c8077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75cec00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810c010 0x7f75c8078040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75cec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8115d40 con 0x7f75c8105d80 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75cec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8115bc0 con 0x7f75c810b6c0 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75cec00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8115ec0 con 0x7f75c810c010 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75c7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810b6c0 0x7f75c8077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75c7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810b6c0 0x7f75c8077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57530/0 (socket says 172.21.15.84:57530) 2024-09-21T08:02:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75c7400640 1 -- 172.21.15.84:0/2678828002 learned_addr learned my addr 172.21.15.84:0/2678828002 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.202+0000 7f75ccc00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810c010 0x7f75c8078040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.203+0000 7f75c7e00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c8105d80 0x7f75c807b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.203+0000 7f75c7400640 1 -- 172.21.15.84:0/2678828002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810c010 msgr2=0x7f75c8078040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.203+0000 7f75c7400640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810c010 0x7f75c8078040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.203+0000 7f75c7400640 1 -- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c8105d80 msgr2=0x7f75c807b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.203+0000 7f75c7400640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c8105d80 0x7f75c807b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.203+0000 7f75c7400640 1 -- 172.21.15.84:0/2678828002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c81acd00 con 0x7f75c810b6c0 2024-09-21T08:02:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.204+0000 7f75c7400640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810b6c0 0x7f75c8077920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f75b4035040 tx=0x7f75b4030d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.205+0000 7f75c4c00640 1 -- 172.21.15.84:0/2678828002 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4037050 con 0x7f75c810b6c0 2024-09-21T08:02:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.205+0000 7f75c4c00640 1 -- 172.21.15.84:0/2678828002 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b4043070 con 0x7f75c810b6c0 2024-09-21T08:02:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.205+0000 7f75c4c00640 1 -- 172.21.15.84:0/2678828002 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4003c10 con 0x7f75c810b6c0 2024-09-21T08:02:10.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.205+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c81aced0 con 0x7f75c810b6c0 2024-09-21T08:02:10.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.206+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c81ad2d0 con 0x7f75c810b6c0 2024-09-21T08:02:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.212+0000 7f75d5838740 1 Processor -- start 2024-09-21T08:02:10.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.213+0000 7f75d5838740 1 -- start start 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.214+0000 7f75d5838740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.214+0000 7f75d5838740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547911700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.214+0000 7f75d5838740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547911c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.214+0000 7f75d5838740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557547888290 con 0x557547549840 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.214+0000 7f75d5838740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575478776c0 con 0x557547541660 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.214+0000 7f75d5838740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55754787b4d0 con 0x55754756a520 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.214+0000 7f75c4c00640 1 -- 172.21.15.84:0/2678828002 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f75b4004040 con 0x7f75c810b6c0 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.215+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547911700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.215+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547911700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57538/0 (socket says 172.21.15.84:57538) 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.215+0000 7f75c7e00640 1 -- 172.21.15.84:0/3114505554 learned_addr learned my addr 172.21.15.84:0/3114505554 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.215+0000 7f75ccc00640 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.215+0000 7f75c7400640 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547911c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.216+0000 7f75c7400640 1 -- 172.21.15.84:0/3114505554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 msgr2=0x5575479111c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.216+0000 7f75c7400640 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479111c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.216+0000 7f75c7400640 1 -- 172.21.15.84:0/3114505554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 msgr2=0x557547911700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.216+0000 7f75c7400640 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547911700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.216+0000 7f75c7400640 1 -- 172.21.15.84:0/3114505554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557547804460 con 0x557547549840 2024-09-21T08:02:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.216+0000 7f75c7400640 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547911c40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f75b4105470 tx=0x7f75b4110270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d222899c6a697fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.217+0000 7f75c4c00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75ac0b6800 0x7f75ac0b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.217+0000 7f75c4c00640 1 -- 172.21.15.84:0/2678828002 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9520+0+0 (secure 0 0 0) 0x7f75b4108100 con 0x7f75c810b6c0 2024-09-21T08:02:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.217+0000 7f75bd200640 1 -- 172.21.15.84:0/3114505554 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40ca1c0 con 0x557547549840 2024-09-21T08:02:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.217+0000 7f75bd200640 1 -- 172.21.15.84:0/3114505554 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b4115030 con 0x557547549840 2024-09-21T08:02:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.217+0000 7f75bd200640 1 -- 172.21.15.84:0/3114505554 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40cd2e0 con 0x557547549840 2024-09-21T08:02:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.217+0000 7f75ccc00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75ac0b6800 0x7f75ac0b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75ccc00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75ac0b6800 0x7f75ac0b8d10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f75b8004610 tx=0x7f75b800b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75d5838740 1 -- 172.21.15.84:0/3114505554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 msgr2=0x557547911c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75d5838740 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547911c40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f75b4105470 tx=0x7f75b4110270 comp rx=0 tx=0).stop 2024-09-21T08:02:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75d5838740 1 -- 172.21.15.84:0/3114505554 shutdown_connections 2024-09-21T08:02:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75d5838740 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547911c40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75d5838740 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547911700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75d5838740 1 --2- 172.21.15.84:0/3114505554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.219+0000 7f75d5838740 1 -- 172.21.15.84:0/3114505554 >> 172.21.15.84:0/3114505554 conn(0x55754755e910 msgr2=0x55754790f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.220+0000 7f75d5838740 1 -- 172.21.15.84:0/3114505554 shutdown_connections 2024-09-21T08:02:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.220+0000 7f75d5838740 1 -- 172.21.15.84:0/3114505554 wait complete. 2024-09-21T08:02:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.221+0000 7f75d5838740 1 -- start start 2024-09-21T08:02:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.221+0000 7f75d5838740 1 Processor -- start 2024-09-21T08:02:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.223+0000 7f75d5838740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557547541660 0x55754791cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.223+0000 7f75d5838740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x55754791d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.223+0000 7f75d5838740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55754756a520 0x557547939a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75d5838740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5575476d8bb0 con 0x55754756a520 2024-09-21T08:02:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75d5838740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575478126c0 con 0x557547549840 2024-09-21T08:02:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75c7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x55754791d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75d5838740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557547930770 con 0x557547541660 2024-09-21T08:02:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75c7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x55754791d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57554/0 (socket says 172.21.15.84:57554) 2024-09-21T08:02:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75c7400640 1 -- 172.21.15.84:0/64244012 learned_addr learned my addr 172.21.15.84:0/64244012 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75d5838740 10 client.0 _ll_register_callbacks cb 0x55754782d490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:10.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557547541660 0x55754791cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.224+0000 7f75ccc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55754756a520 0x557547939a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.226+0000 7f75ccc00640 1 -- 172.21.15.84:0/64244012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557547541660 msgr2=0x55754791cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.226+0000 7f75ccc00640 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557547541660 0x55754791cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.226+0000 7f75ccc00640 1 -- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 msgr2=0x55754791d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.226+0000 7f75ccc00640 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x55754791d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.226+0000 7f75ccc00640 1 -- 172.21.15.84:0/64244012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575475d5b00 con 0x55754756a520 2024-09-21T08:02:10.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.226+0000 7f75c7400640 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x55754791d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.229+0000 7f75ccc00640 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55754756a520 0x557547939a20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f75b80039c0 tx=0x7f75b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2307e6092affc0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:10.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.229+0000 7f75b1600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:10.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.230+0000 7f75b1600640 1 -- 172.21.15.84:0/64244012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b802c060 con 0x55754756a520 2024-09-21T08:02:10.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.231+0000 7f75b1600640 1 -- 172.21.15.84:0/64244012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9520+0+0 (secure 0 0 0) 0x7f75b8017030 con 0x55754756a520 2024-09-21T08:02:10.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.234+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b4115030 con 0x55754756a520 2024-09-21T08:02:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.234+0000 7f75b1600640 1 -- 172.21.15.84:0/64244012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75b801fc00 con 0x55754756a520 2024-09-21T08:02:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.234+0000 7f75d5838740 10 client.17895 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.234+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55754764c960 con 0x55754756a520 2024-09-21T08:02:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.235+0000 7f75b1600640 1 -- 172.21.15.84:0/64244012 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b4115030 con 0x55754756a520 2024-09-21T08:02:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.235+0000 7f75b1600640 1 -- 172.21.15.84:0/64244012 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f75b801c3f0 con 0x55754756a520 2024-09-21T08:02:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.236+0000 7f75d5838740 10 client.17895 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.236+0000 7f75d5838740 10 client.17895 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.236+0000 7f75d5838740 20 client.17895 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.236+0000 7f75d5838740 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557547528ea0 0x55754793fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.236+0000 7f75d5838740 4 client.17895 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.236+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55754788a1e0 con 0x557547528ea0 2024-09-21T08:02:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.237+0000 7f75c7e00640 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557547528ea0 0x55754793fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.238+0000 7f75c7e00640 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557547528ea0 0x55754793fa70 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c9083f01564ed6 server_cookie=b3b5a8d067e8434c in_seq=0 out_seq=0 2024-09-21T08:02:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.238+0000 7f75b1600640 10 client.17895 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.238+0000 7f75b1600640 1 -- 172.21.15.84:0/64244012 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55754788a1e0 con 0x557547528ea0 2024-09-21T08:02:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.238+0000 7f75b1600640 10 client.17895 handle_command_reply: tid=0 2024-09-21T08:02:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.239+0000 7f75d5838740 1 client.17895 shutdown 2024-09-21T08:02:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.239+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55754756a520 msgr2=0x557547939a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.239+0000 7f75d5838740 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55754756a520 0x557547939a20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f75b80039c0 tx=0x7f75b8004730 comp rx=0 tx=0).stop 2024-09-21T08:02:10.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.241+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 shutdown_connections 2024-09-21T08:02:10.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.241+0000 7f75d5838740 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55754756a520 0x557547939a20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.241+0000 7f75d5838740 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x55754791d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.241+0000 7f75d5838740 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x557547528ea0 0x55754793fa70 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.241+0000 7f75d5838740 1 --2- 172.21.15.84:0/64244012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557547541660 0x55754791cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.242+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 >> 172.21.15.84:0/64244012 conn(0x55754755e910 msgr2=0x557547914350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.242+0000 7f75b1600640 0 client.17895 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.242+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 shutdown_connections 2024-09-21T08:02:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.242+0000 7f75d5838740 1 -- 172.21.15.84:0/64244012 wait complete. 2024-09-21T08:02:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.242+0000 7f75d5838740 20 client.17895 trim_cache size 0 max 16384 2024-09-21T08:02:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.279+0000 7f75d5838740 1 Processor -- start 2024-09-21T08:02:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.279+0000 7f75d5838740 1 -- start start 2024-09-21T08:02:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75d5838740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547914c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75d5838740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547912900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75d5838740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x557547919c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75d5838740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81aed40 con 0x557547549840 2024-09-21T08:02:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75d5838740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81b0880 con 0x557547541660 2024-09-21T08:02:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75d5838740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81af410 con 0x55754756a520 2024-09-21T08:02:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547914c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.280+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547914c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57556/0 (socket says 172.21.15.84:57556) 2024-09-21T08:02:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.281+0000 7f75ccc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x557547919c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.281+0000 7f75ccc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x557547919c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48938/0 (socket says 172.21.15.84:48938) 2024-09-21T08:02:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.281+0000 7f75ccc00640 1 -- 172.21.15.84:0/1281856239 learned_addr learned my addr 172.21.15.84:0/1281856239 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.281+0000 7f75c7400640 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547912900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75ccc00640 1 -- 172.21.15.84:0/1281856239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 msgr2=0x557547914c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75ccc00640 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547914c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75ccc00640 1 -- 172.21.15.84:0/1281856239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 msgr2=0x557547912900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75ccc00640 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547912900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75ccc00640 1 -- 172.21.15.84:0/1281856239 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754793a990 con 0x55754756a520 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75ccc00640 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x557547919c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f75b801c840 tx=0x7f75b800bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3a695524c9378e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75b3e00640 1 -- 172.21.15.84:0/1281856239 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8036080 con 0x55754756a520 2024-09-21T08:02:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75b3e00640 1 -- 172.21.15.84:0/1281856239 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b801c4f0 con 0x55754756a520 2024-09-21T08:02:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.282+0000 7f75b3e00640 1 -- 172.21.15.84:0/1281856239 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8031e30 con 0x55754756a520 2024-09-21T08:02:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.284+0000 7f75d5838740 1 -- 172.21.15.84:0/1281856239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 msgr2=0x557547919c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.284+0000 7f75d5838740 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x557547919c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f75b801c840 tx=0x7f75b800bde0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.285+0000 7f75d5838740 1 -- 172.21.15.84:0/1281856239 shutdown_connections 2024-09-21T08:02:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.285+0000 7f75d5838740 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x557547919c90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.285+0000 7f75d5838740 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547549840 0x557547912900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.285+0000 7f75d5838740 1 --2- 172.21.15.84:0/1281856239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547541660 0x557547914c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.285+0000 7f75d5838740 1 -- 172.21.15.84:0/1281856239 >> 172.21.15.84:0/1281856239 conn(0x55754755e910 msgr2=0x5575479121f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.286+0000 7f75d5838740 1 -- 172.21.15.84:0/1281856239 shutdown_connections 2024-09-21T08:02:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.286+0000 7f75d5838740 1 -- 172.21.15.84:0/1281856239 wait complete. 2024-09-21T08:02:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.287+0000 7f75d5838740 1 -- start start 2024-09-21T08:02:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.287+0000 7f75d5838740 1 Processor -- start 2024-09-21T08:02:10.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.290+0000 7f75d5838740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547541660 0x557547932d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.290+0000 7f75d5838740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x5575479332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.290+0000 7f75d5838740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.290+0000 7f75c7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547541660 0x557547932d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75c7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x5575479332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75d5838740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81b01b0 con 0x557547541660 2024-09-21T08:02:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75d5838740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81afae0 con 0x557547549840 2024-09-21T08:02:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75d5838740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8074eb0 con 0x55754756a520 2024-09-21T08:02:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75c7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x5575479332c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57562/0 (socket says 172.21.15.84:57562) 2024-09-21T08:02:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75c7400640 1 -- 172.21.15.84:0/3271974607 learned_addr learned my addr 172.21.15.84:0/3271974607 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75d5838740 10 client.0 _ll_register_callbacks cb 0x7f75b8005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75ccc00640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75ccc00640 1 -- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 msgr2=0x5575479332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75ccc00640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x5575479332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.291+0000 7f75ccc00640 1 -- 172.21.15.84:0/3271974607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547541660 msgr2=0x557547932d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.292+0000 7f75ccc00640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547541660 0x557547932d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.293+0000 7f75ccc00640 1 -- 172.21.15.84:0/3271974607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575479aa980 con 0x55754756a520 2024-09-21T08:02:10.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.293+0000 7f75c7400640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x5575479332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:10.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.293+0000 7f75c7e00640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547541660 0x557547932d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T08:02:10.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.293+0000 7f75ccc00640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479aa440 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f75b801c7c0 tx=0x7f75b8031c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2431acdae1d06f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:10.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.293+0000 7f75b1600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:10.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.294+0000 7f75b1600640 1 -- 172.21.15.84:0/3271974607 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b803e020 con 0x55754756a520 2024-09-21T08:02:10.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.294+0000 7f75b1600640 1 -- 172.21.15.84:0/3271974607 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9520+0+0 (secure 0 0 0) 0x7f75b8031630 con 0x55754756a520 2024-09-21T08:02:10.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.294+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b801c4f0 con 0x55754756a520 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.294+0000 7f75b1600640 1 -- 172.21.15.84:0/3271974607 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75b8036070 con 0x55754756a520 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.294+0000 7f75d5838740 10 client.28285 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.294+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5575479abae0 con 0x55754756a520 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75b1600640 1 -- 172.21.15.84:0/3271974607 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b801c4f0 con 0x55754756a520 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75b1600640 1 -- 172.21.15.84:0/3271974607 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f75b8004890 con 0x55754756a520 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75d5838740 10 client.28285 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75d5838740 10 client.28285 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75d5838740 20 client.28285 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75d5838740 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5575474fe250 0x5575479ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:10.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75d5838740 4 client.28285 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "741934d5", "release": true, "await": true}] 2024-09-21T08:02:10.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "741934d5", "release": true, "await": true}) -- 0x557547885c90 con 0x5575474fe250 2024-09-21T08:02:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.296+0000 7f75c7e00640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5575474fe250 0x5575479ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.297+0000 7f75b1600640 10 client.28285 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:10.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.299+0000 7f75c7e00640 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5575474fe250 0x5575479ae0a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c3678ee67ad9dc server_cookie=4a1c812282534e17 in_seq=0 out_seq=0 2024-09-21T08:02:10.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.315+0000 7f75b1600640 1 -- 172.21.15.84:0/3271974607 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557547885c90 con 0x5575474fe250 2024-09-21T08:02:10.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.315+0000 7f75b1600640 10 client.28285 handle_command_reply: tid=0 2024-09-21T08:02:10.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.316+0000 7f75d5838740 1 client.28285 shutdown 2024-09-21T08:02:10.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.316+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 msgr2=0x5575479aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.316+0000 7f75d5838740 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479aa440 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f75b801c7c0 tx=0x7f75b8031c30 comp rx=0 tx=0).stop 2024-09-21T08:02:10.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 shutdown_connections 2024-09-21T08:02:10.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75d5838740 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5575474fe250 0x5575479ae0a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75d5838740 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55754756a520 0x5575479aa440 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75d5838740 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557547549840 0x5575479332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75d5838740 1 --2- 172.21.15.84:0/3271974607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557547541660 0x557547932d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 >> 172.21.15.84:0/3271974607 conn(0x55754755e910 msgr2=0x5575479121f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:10.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75b1600640 0 client.28285 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:10.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.317+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 shutdown_connections 2024-09-21T08:02:10.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.318+0000 7f75d5838740 1 -- 172.21.15.84:0/3271974607 wait complete. 2024-09-21T08:02:10.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.318+0000 7f75d5838740 20 client.28285 trim_cache size 0 max 16384 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 40, 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "741934d5": { 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 40, 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:02:10.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 144.5, 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:10.322 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:02:10.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.320+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75ac0b6800 msgr2=0x7f75ac0b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.320+0000 7f75cec00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75ac0b6800 0x7f75ac0b8d10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f75b8004610 tx=0x7f75b800b2e0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.320+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810b6c0 msgr2=0x7f75c8077920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:10.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.320+0000 7f75cec00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810b6c0 0x7f75c8077920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f75b4035040 tx=0x7f75b4030d70 comp rx=0 tx=0).stop 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 shutdown_connections 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f75ac0b6800 0x7f75ac0b8d10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f75c810c010 0x7f75c8078040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75c810b6c0 0x7f75c8077920 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 --2- 172.21.15.84:0/2678828002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c8105d80 0x7f75c807b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 >> 172.21.15.84:0/2678828002 conn(0x7f75c8101790 msgr2=0x7f75c8109e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 shutdown_connections 2024-09-21T08:02:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:10.321+0000 7f75cec00640 1 -- 172.21.15.84:0/2678828002 wait complete. 2024-09-21T08:02:11.251 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '741934d5', total seconds elapsed: 30.4 2024-09-21T08:02:11.252 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T08:02:11.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:11.956 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:11 smithi191 ceph-mon[34667]: pgmap v737: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 34 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 34 op/s 2024-09-21T08:02:12.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:11 smithi162 ceph-mon[34833]: pgmap v737: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 34 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 34 op/s 2024-09-21T08:02:12.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:11 smithi084 ceph-mon[30411]: pgmap v737: 129 pgs: 7 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 101 active+clean; 34 GiB data, 74 GiB used, 999 GiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 34 op/s 2024-09-21T08:02:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T08:02:12.803+0000 7f156aa00640 1 -- 172.21.15.84:0/1159304236 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f15480034f0 con 0x7f1574109400 2024-09-21T08:02:12.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T08:02:12.804+0000 7f1578a00640 1 -- 172.21.15.84:0/1159304236 <== mon.2 v2:172.21.15.162:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f15480034f0 con 0x7f1574109400 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 -- 172.21.15.84:0/2275440639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 msgr2=0x7f2c0010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 --2- 172.21.15.84:0/2275440639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 0x7f2c0010d870 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009900 tx=0x7f2bec02a410 comp rx=0 tx=0).stop 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 -- 172.21.15.84:0/2275440639 shutdown_connections 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 --2- 172.21.15.84:0/2275440639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c0010de30 0x7f2c00110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 --2- 172.21.15.84:0/2275440639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 0x7f2c0010d870 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 --2- 172.21.15.84:0/2275440639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c001049d0 0x7f2c00104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 -- 172.21.15.84:0/2275440639 >> 172.21.15.84:0/2275440639 conn(0x7f2c00079740 msgr2=0x7f2c00079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 -- 172.21.15.84:0/2275440639 shutdown_connections 2024-09-21T08:02:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.815+0000 7f2c05a00640 1 -- 172.21.15.84:0/2275440639 wait complete. 2024-09-21T08:02:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 Processor -- start 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 -- start start 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c001049d0 0x7f2c0019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 0x7f2c0019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c0010de30 0x7f2c0019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00113a90 con 0x7f2c00105320 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00113910 con 0x7f2c0010de30 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.816+0000 7f2c05a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00113c10 con 0x7f2c001049d0 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c001049d0 0x7f2c0019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfe000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 0x7f2c0019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c001049d0 0x7f2c0019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:48956/0 (socket says 172.21.15.84:48956) 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bff400640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c0010de30 0x7f2c0019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfea00640 1 -- 172.21.15.84:0/3411906525 learned_addr learned my addr 172.21.15.84:0/3411906525 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfe000640 1 -- 172.21.15.84:0/3411906525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c001049d0 msgr2=0x7f2c0019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfe000640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c001049d0 0x7f2c0019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfe000640 1 -- 172.21.15.84:0/3411906525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c0010de30 msgr2=0x7f2c0019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfe000640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c0010de30 0x7f2c0019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.817+0000 7f2bfe000640 1 -- 172.21.15.84:0/3411906525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c001a0430 con 0x7f2c00105320 2024-09-21T08:02:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.818+0000 7f2bfe000640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 0x7f2c0019aa60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2bec02a930 tx=0x7f2bec004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:12.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.818+0000 7f2bf7400640 1 -- 172.21.15.84:0/3411906525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec03f070 con 0x7f2c00105320 2024-09-21T08:02:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.818+0000 7f2bf7400640 1 -- 172.21.15.84:0/3411906525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bec003ca0 con 0x7f2c00105320 2024-09-21T08:02:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.818+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c001a06c0 con 0x7f2c00105320 2024-09-21T08:02:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.818+0000 7f2bf7400640 1 -- 172.21.15.84:0/3411906525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec035070 con 0x7f2c00105320 2024-09-21T08:02:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.818+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c001a6e80 con 0x7f2c00105320 2024-09-21T08:02:12.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.819+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0006c240 con 0x7f2c00105320 2024-09-21T08:02:12.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.825+0000 7f2bf7400640 1 -- 172.21.15.84:0/3411906525 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2bec03b460 con 0x7f2c00105320 2024-09-21T08:02:12.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.826+0000 7f2bf7400640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2be40b6680 0x7f2be40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:12.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.826+0000 7f2bf7400640 1 -- 172.21.15.84:0/3411906525 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9520+0+0 (secure 0 0 0) 0x7f2bec1081f0 con 0x7f2c00105320 2024-09-21T08:02:12.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.826+0000 7f2bfea00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2be40b6680 0x7f2be40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:12.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.827+0000 7f2bfea00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2be40b6680 0x7f2be40b8b90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00058c0 tx=0x7f2bf0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:12.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:12.828+0000 7f2bf7400640 1 -- 172.21.15.84:0/3411906525 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2bec0d2700 con 0x7f2c00105320 2024-09-21T08:02:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T08:02:12.894+0000 7f1553400640 1 -- 172.21.15.84:0/1158558623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f15400034c0 con 0x563c322eb4d0 2024-09-21T08:02:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T08:02:12.894+0000 7f155cc00640 1 -- 172.21.15.84:0/1158558623 <== mon.2 v2:172.21.15.162:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f15640e6030 con 0x563c322eb4d0 2024-09-21T08:02:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.061+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c00104de0 con 0x7f2c00105320 2024-09-21T08:02:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.061+0000 7f2bf7400640 1 -- 172.21.15.84:0/3411906525 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f2bec0d7640 con 0x7f2c00105320 2024-09-21T08:02:13.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:02:13.064 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:02:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:02:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2be40b6680 msgr2=0x7f2be40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2be40b6680 0x7f2be40b8b90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00058c0 tx=0x7f2bf0005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 msgr2=0x7f2c0019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 0x7f2c0019aa60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2bec02a930 tx=0x7f2bec004060 comp rx=0 tx=0).stop 2024-09-21T08:02:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 shutdown_connections 2024-09-21T08:02:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f2be40b6680 0x7f2be40b8b90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:13.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c0010de30 0x7f2c0019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:13.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c00105320 0x7f2c0019aa60 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:13.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 --2- 172.21.15.84:0/3411906525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c001049d0 0x7f2c0019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:13.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 >> 172.21.15.84:0/3411906525 conn(0x7f2c00079740 msgr2=0x7f2c001008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:13.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 shutdown_connections 2024-09-21T08:02:13.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:13.064+0000 7f2c05a00640 1 -- 172.21.15.84:0/3411906525 wait complete. 2024-09-21T08:02:13.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:13 smithi084 ceph-mon[30411]: pgmap v738: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 31 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 34 op/s 2024-09-21T08:02:13.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:13 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3411906525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:13.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:13 smithi084 ceph-mon[30411]: scrub summary: idle 2024-09-21T08:02:13.953 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T08:02:13.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T08:02:14.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:13 smithi162 ceph-mon[34833]: pgmap v738: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 31 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 34 op/s 2024-09-21T08:02:14.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:13 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3411906525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:14.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:13 smithi162 ceph-mon[34833]: scrub summary: idle 2024-09-21T08:02:14.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:13 smithi191 ceph-mon[34667]: pgmap v738: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 31 GiB data, 70 GiB used, 1003 GiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 34 op/s 2024-09-21T08:02:14.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:13 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3411906525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:14.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:13 smithi191 ceph-mon[34667]: scrub summary: idle 2024-09-21T08:02:14.321 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:14.712 INFO:tasks.workunit.client.0.smithi084.stdout:stopping iogen 2024-09-21T08:02:14.713 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'stopping iogen' 2024-09-21T08:02:14.713 INFO:tasks.workunit.client.0.smithi084.stderr:+ ./iogen -k 2024-09-21T08:02:14.723 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-09-21T08:02:14.723 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 -- 172.21.15.84:0/576016473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10fad0 msgr2=0x7f986c10fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 --2- 172.21.15.84:0/576016473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10fad0 0x7f986c10fee0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9858009900 tx=0x7f985802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 -- 172.21.15.84:0/576016473 shutdown_connections 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 --2- 172.21.15.84:0/576016473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f986c110420 0x7f986c116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 --2- 172.21.15.84:0/576016473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10fad0 0x7f986c10fee0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 --2- 172.21.15.84:0/576016473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c10a190 0x7f986c10a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 -- 172.21.15.84:0/576016473 >> 172.21.15.84:0/576016473 conn(0x7f986c0781c0 msgr2=0x7f986c1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 -- 172.21.15.84:0/576016473 shutdown_connections 2024-09-21T08:02:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.150+0000 7f9874400640 1 -- 172.21.15.84:0/576016473 wait complete. 2024-09-21T08:02:15.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 Processor -- start 2024-09-21T08:02:15.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 -- start start 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10a190 0x7f986c1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f986c10fad0 0x7f986c1a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c110420 0x7f986c1a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f986c11a100 con 0x7f986c10a190 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986c119f80 con 0x7f986c110420 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.151+0000 7f9874400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f986c11a280 con 0x7f986c10fad0 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10a190 0x7f986c1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10a190 0x7f986c1a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52806/0 (socket says 172.21.15.84:52806) 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f986c10fad0 0x7f986c1a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9872400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c110420 0x7f986c1a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 -- 172.21.15.84:0/771275445 learned_addr learned my addr 172.21.15.84:0/771275445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 -- 172.21.15.84:0/771275445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f986c10fad0 msgr2=0x7f986c1a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f986c10fad0 0x7f986c1a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 -- 172.21.15.84:0/771275445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c110420 msgr2=0x7f986c1a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c110420 0x7f986c1a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9871a00640 1 -- 172.21.15.84:0/771275445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c1a6aa0 con 0x7f986c10a190 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.152+0000 7f9872400640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c110420 0x7f986c1a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.153+0000 7f9871a00640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10a190 0x7f986c1a0b30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f986000e9f0 tx=0x7f986000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.153+0000 7f986a000640 1 -- 172.21.15.84:0/771275445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986000cd80 con 0x7f986c10a190 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.153+0000 7f986a000640 1 -- 172.21.15.84:0/771275445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98600108e0 con 0x7f986c10a190 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.153+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c1a6d90 con 0x7f986c10a190 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.153+0000 7f986a000640 1 -- 172.21.15.84:0/771275445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860018980 con 0x7f986c10a190 2024-09-21T08:02:15.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.153+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c1ad4f0 con 0x7f986c10a190 2024-09-21T08:02:15.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.156+0000 7f987b064740 1 Processor -- start 2024-09-21T08:02:15.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.156+0000 7f987b064740 1 -- start start 2024-09-21T08:02:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f986a000640 1 -- 172.21.15.84:0/771275445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9860010430 con 0x7f986c10a190 2024-09-21T08:02:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f987b064740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b42350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f987b064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b42890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f987b064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b42dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f987b064740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592f7ab7ca0 con 0x5592f779a840 2024-09-21T08:02:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f987b064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592f7aa70d0 con 0x5592f7779b60 2024-09-21T08:02:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f987b064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592f7aaaee0 con 0x5592f7771980 2024-09-21T08:02:15.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f9872400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b42350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f9872400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b42350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52822/0 (socket says 172.21.15.84:52822) 2024-09-21T08:02:15.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f9872400640 1 -- 172.21.15.84:0/192177688 learned_addr learned my addr 172.21.15.84:0/192177688 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:15.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f9871a00640 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b42890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.157+0000 7f9871000640 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b42dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.158+0000 7f9872400640 1 -- 172.21.15.84:0/192177688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 msgr2=0x5592f7b42890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.158+0000 7f9872400640 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b42890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.158+0000 7f9872400640 1 -- 172.21.15.84:0/192177688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 msgr2=0x5592f7b42dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.158+0000 7f9872400640 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b42dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.158+0000 7f9872400640 1 -- 172.21.15.84:0/192177688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592f7a59400 con 0x5592f779a840 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.158+0000 7f9872400640 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b42350 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9864011790 tx=0x7f9864011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aaab550f0233632 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.158+0000 7f985ea00640 1 -- 172.21.15.84:0/192177688 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864003c30 con 0x5592f779a840 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.159+0000 7f985ea00640 1 -- 172.21.15.84:0/192177688 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f986400fe50 con 0x5592f779a840 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.159+0000 7f985ea00640 1 -- 172.21.15.84:0/192177688 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640193e0 con 0x5592f779a840 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.159+0000 7f986a000640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98540b6700 0x7f98540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.159+0000 7f986a000640 1 -- 172.21.15.84:0/771275445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9520+0+0 (secure 0 0 0) 0x7f98600e7df0 con 0x7f986c10a190 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.159+0000 7f9871a00640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98540b6700 0x7f98540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.159+0000 7f987b064740 1 -- 172.21.15.84:0/192177688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 msgr2=0x5592f7b42350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.159+0000 7f987b064740 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b42350 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9864011790 tx=0x7f9864011c50 comp rx=0 tx=0).stop 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 -- 172.21.15.84:0/192177688 shutdown_connections 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b42dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b42890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 --2- 172.21.15.84:0/192177688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b42350 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 -- 172.21.15.84:0/192177688 >> 172.21.15.84:0/192177688 conn(0x5592f778e990 msgr2=0x5592f7b40240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 -- 172.21.15.84:0/192177688 shutdown_connections 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f9871a00640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98540b6700 0x7f98540b8c10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x5592f7b40fd0 tx=0x7f98600eb8a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:15.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 -- 172.21.15.84:0/192177688 wait complete. 2024-09-21T08:02:15.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.160+0000 7f987b064740 1 -- start start 2024-09-21T08:02:15.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 1 Processor -- start 2024-09-21T08:02:15.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7771980 0x5592f7b4da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7779b60 0x5592f7b4df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f779a840 0x5592f7b59e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592f79087a0 con 0x5592f7779b60 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592f7a4ca10 con 0x5592f7771980 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5592f7b50b30 con 0x5592f779a840 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f987b064740 10 client.0 _ll_register_callbacks cb 0x5592f7a5cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.161+0000 7f9872400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7771980 0x5592f7b4da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9871000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7779b60 0x5592f7b4df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7771980 0x5592f7b4da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:57612/0 (socket says 172.21.15.84:57612) 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 -- 172.21.15.84:0/2227085254 learned_addr learned my addr 172.21.15.84:0/2227085254 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f779a840 0x5592f7b59e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 -- 172.21.15.84:0/2227085254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f779a840 msgr2=0x5592f7b59e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f779a840 0x5592f7b59e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 -- 172.21.15.84:0/2227085254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7779b60 msgr2=0x5592f7b4df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7779b60 0x5592f7b4df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 -- 172.21.15.84:0/2227085254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592f7814b90 con 0x5592f7771980 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9872400640 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7771980 0x5592f7b4da10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f98640115a0 tx=0x7f9864004470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f9dba1d5a09da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.162+0000 7f9853400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f9853400640 1 -- 172.21.15.84:0/2227085254 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864011260 con 0x5592f7771980 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f986400fe50 con 0x5592f7771980 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f9853400640 1 -- 172.21.15.84:0/2227085254 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9520+0+0 (secure 0 0 0) 0x7f9864004a40 con 0x5592f7771980 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f9853400640 1 -- 172.21.15.84:0/2227085254 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9864033050 con 0x5592f7771980 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f987b064740 10 client.28286 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592f7b5c810 con 0x5592f7771980 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f9853400640 1 -- 172.21.15.84:0/2227085254 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f986400fe50 con 0x5592f7771980 2024-09-21T08:02:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.163+0000 7f9853400640 1 -- 172.21.15.84:0/2227085254 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9864018070 con 0x5592f7771980 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.164+0000 7f987b064740 10 client.28286 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.164+0000 7f987b064740 10 client.28286 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.164+0000 7f987b064740 20 client.28286 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.164+0000 7f987b064740 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f77591c0 0x5592f7b5fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.164+0000 7f987b064740 4 client.28286 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.164+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592f7ab9bf0 con 0x5592f77591c0 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.164+0000 7f9871000640 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f77591c0 0x5592f7b5fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.165+0000 7f9871000640 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f77591c0 0x5592f7b5fc30 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d9214d58cfa582 server_cookie=3205379fa0f96936 in_seq=0 out_seq=0 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.165+0000 7f9853400640 10 client.28286 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f9853400640 1 -- 172.21.15.84:0/2227085254 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592f7ab9bf0 con 0x5592f77591c0 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f9853400640 10 client.28286 handle_command_reply: tid=0 2024-09-21T08:02:15.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 client.28286 shutdown 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7771980 msgr2=0x5592f7b4da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7771980 0x5592f7b4da10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f98640115a0 tx=0x7f9864004470 comp rx=0 tx=0).stop 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 shutdown_connections 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f77591c0 0x5592f7b5fc30 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f779a840 0x5592f7b59e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7779b60 0x5592f7b4df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f9853400640 0 client.28286 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 --2- 172.21.15.84:0/2227085254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7771980 0x5592f7b4da10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 >> 172.21.15.84:0/2227085254 conn(0x5592f778e990 msgr2=0x5592f7b45530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 shutdown_connections 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.166+0000 7f987b064740 1 -- 172.21.15.84:0/2227085254 wait complete. 2024-09-21T08:02:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.167+0000 7f987b064740 20 client.28286 trim_cache size 0 max 16384 2024-09-21T08:02:15.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.184+0000 7f987b064740 1 Processor -- start 2024-09-21T08:02:15.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.184+0000 7f987b064740 1 -- start start 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f987b064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b439f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f987b064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b4f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f987b064740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b59d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f987b064740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1b7600 con 0x5592f779a840 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f987b064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1b9140 con 0x5592f7779b60 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f987b064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1b7cd0 con 0x5592f7771980 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f9872400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b59d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f9872400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b59d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52844/0 (socket says 172.21.15.84:52844) 2024-09-21T08:02:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f9872400640 1 -- 172.21.15.84:0/748235265 learned_addr learned my addr 172.21.15.84:0/748235265 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f9871000640 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b4f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.185+0000 7f9872400640 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f9872400640 1 -- 172.21.15.84:0/748235265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 msgr2=0x5592f7b439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f9872400640 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f9872400640 1 -- 172.21.15.84:0/748235265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 msgr2=0x5592f7b4f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f9872400640 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b4f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f9872400640 1 -- 172.21.15.84:0/748235265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592f7b3bc50 con 0x5592f779a840 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f9871000640 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b4f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f9872400640 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b59d50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9864005d70 tx=0x7f9864011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1ac7667dca7a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f985e000640 1 -- 172.21.15.84:0/748235265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986400f790 con 0x5592f779a840 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f985e000640 1 -- 172.21.15.84:0/748235265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f986400fe50 con 0x5592f779a840 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.186+0000 7f985e000640 1 -- 172.21.15.84:0/748235265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864011260 con 0x5592f779a840 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 -- 172.21.15.84:0/748235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 msgr2=0x5592f7b59d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b59d50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9864005d70 tx=0x7f9864011c50 comp rx=0 tx=0).stop 2024-09-21T08:02:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 -- 172.21.15.84:0/748235265 shutdown_connections 2024-09-21T08:02:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f779a840 0x5592f7b59d50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f7779b60 0x5592f7b4f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 --2- 172.21.15.84:0/748235265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7771980 0x5592f7b439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 -- 172.21.15.84:0/748235265 >> 172.21.15.84:0/748235265 conn(0x5592f778e990 msgr2=0x5592f7b3e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 -- 172.21.15.84:0/748235265 shutdown_connections 2024-09-21T08:02:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.187+0000 7f987b064740 1 -- 172.21.15.84:0/748235265 wait complete. 2024-09-21T08:02:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 -- start start 2024-09-21T08:02:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 Processor -- start 2024-09-21T08:02:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7771980 0x5592f7b51e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7779b60 0x5592f7b523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f779a840 0x5592f7b528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1b8a70 con 0x5592f7771980 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1b83a0 con 0x5592f779a840 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1b55e0 con 0x5592f7779b60 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.188+0000 7f987b064740 10 client.0 _ll_register_callbacks cb 0x7f98640093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7771980 0x5592f7b51e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7771980 0x5592f7b51e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52852/0 (socket says 172.21.15.84:52852) 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 -- 172.21.15.84:0/1953214895 learned_addr learned my addr 172.21.15.84:0/1953214895 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9871000640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7779b60 0x5592f7b523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f779a840 0x5592f7b528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 -- 172.21.15.84:0/1953214895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7779b60 msgr2=0x5592f7b523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7779b60 0x5592f7b523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 -- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f779a840 msgr2=0x5592f7b528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f779a840 0x5592f7b528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9872400640 1 -- 172.21.15.84:0/1953214895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592f7b60090 con 0x5592f7771980 2024-09-21T08:02:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.189+0000 7f9871000640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7779b60 0x5592f7b523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f9872400640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7771980 0x5592f7b51e60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9864005310 tx=0x7f986400fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62b2e68213e604b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f9853400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:15.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f9853400640 1 -- 172.21.15.84:0/1953214895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864004610 con 0x5592f7771980 2024-09-21T08:02:15.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f9853400640 1 -- 172.21.15.84:0/1953214895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9520+0+0 (secure 0 0 0) 0x7f9864003a30 con 0x5592f7771980 2024-09-21T08:02:15.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f986400fe50 con 0x5592f7771980 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f9853400640 1 -- 172.21.15.84:0/1953214895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9864005960 con 0x5592f7771980 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f987b064740 10 client.17922 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.190+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592f7bca620 con 0x5592f7771980 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f9853400640 1 -- 172.21.15.84:0/1953214895 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f986400fe50 con 0x5592f7771980 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f9853400640 1 -- 172.21.15.84:0/1953214895 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9864018040 con 0x5592f7771980 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f987b064740 10 client.17922 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f987b064740 10 client.17922 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f987b064740 20 client.17922 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f987b064740 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f772e570 0x5592f7bccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f987b064740 4 client.17922 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x5592f7ab56a0 con 0x5592f772e570 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.191+0000 7f9871000640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f772e570 0x5592f7bccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.192+0000 7f9871000640 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f772e570 0x5592f7bccd90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29a415f780acae0e server_cookie=41532dc47277d042 in_seq=0 out_seq=0 2024-09-21T08:02:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.192+0000 7f9853400640 10 client.17922 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.208+0000 7f9853400640 1 -- 172.21.15.84:0/1953214895 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5592f7ab56a0 con 0x5592f772e570 2024-09-21T08:02:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.208+0000 7f9853400640 10 client.17922 handle_command_reply: tid=0 2024-09-21T08:02:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.208+0000 7f987b064740 1 client.17922 shutdown 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.208+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7771980 msgr2=0x5592f7b51e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.208+0000 7f987b064740 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7771980 0x5592f7b51e60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9864005310 tx=0x7f986400fcf0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.208+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 shutdown_connections 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592f779a840 0x5592f7b528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5592f772e570 0x5592f7bccd90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5592f7779b60 0x5592f7b523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 1 --2- 172.21.15.84:0/1953214895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592f7771980 0x5592f7b51e60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f9853400640 0 client.17922 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 >> 172.21.15.84:0/1953214895 conn(0x5592f778e990 msgr2=0x5592f7b4f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 shutdown_connections 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 1 -- 172.21.15.84:0/1953214895 wait complete. 2024-09-21T08:02:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.209+0000 7f987b064740 20 client.17922 trim_cache size 0 max 16384 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 42, 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "3e65f53d": { 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 42, 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:02:15.212 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 144.5, 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:15.213 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:15.214 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:02:15.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98540b6700 msgr2=0x7f98540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98540b6700 0x7f98540b8c10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x5592f7b40fd0 tx=0x7f98600eb8a0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10a190 msgr2=0x7f986c1a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:15.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10a190 0x7f986c1a0b30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f986000e9f0 tx=0x7f986000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 shutdown_connections 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f98540b6700 0x7f98540b8c10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c110420 0x7f986c1a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f986c10fad0 0x7f986c1a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 --2- 172.21.15.84:0/771275445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f986c10a190 0x7f986c1a0b30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 >> 172.21.15.84:0/771275445 conn(0x7f986c0781c0 msgr2=0x7f986c1085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 shutdown_connections 2024-09-21T08:02:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:15.210+0000 7f9874400640 1 -- 172.21.15.84:0/771275445 wait complete. 2024-09-21T08:02:15.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:15 smithi084 ceph-mon[30411]: pgmap v739: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 28 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 307 B/s wr, 13 op/s 2024-09-21T08:02:16.001 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3e65f53d', quiesce took 4.7 seconds. Will release after: 19.8 2024-09-21T08:02:16.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:15 smithi162 ceph-mon[34833]: pgmap v739: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 28 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 307 B/s wr, 13 op/s 2024-09-21T08:02:16.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:15 smithi191 ceph-mon[34667]: pgmap v739: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 28 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 307 B/s wr, 13 op/s 2024-09-21T08:02:16.750 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T08:02:16.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T08:02:18.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:17 smithi162 ceph-mon[34833]: pgmap v740: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 409 B/s wr, 12 op/s 2024-09-21T08:02:18.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:17 smithi084 ceph-mon[30411]: pgmap v740: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 409 B/s wr, 12 op/s 2024-09-21T08:02:18.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:17 smithi191 ceph-mon[34667]: pgmap v740: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 7.4 KiB/s rd, 409 B/s wr, 12 op/s 2024-09-21T08:02:19.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:18 smithi191 ceph-mon[34667]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T08:02:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:18 smithi191 ceph-mon[34667]: pgmap v742: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 518 B/s wr, 11 op/s 2024-09-21T08:02:19.301 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:18 smithi162 ceph-mon[34833]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T08:02:19.302 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:18 smithi162 ceph-mon[34833]: pgmap v742: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 518 B/s wr, 11 op/s 2024-09-21T08:02:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:18 smithi084 ceph-mon[30411]: osdmap e100: 12 total, 12 up, 12 in 2024-09-21T08:02:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:18 smithi084 ceph-mon[30411]: pgmap v742: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 6.2 KiB/s rd, 518 B/s wr, 11 op/s 2024-09-21T08:02:21.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:21 smithi191 ceph-mon[34667]: pgmap v743: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 614 B/s wr, 10 op/s 2024-09-21T08:02:22.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:21 smithi162 ceph-mon[34833]: pgmap v743: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 614 B/s wr, 10 op/s 2024-09-21T08:02:22.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:21 smithi084 ceph-mon[30411]: pgmap v743: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 614 B/s wr, 10 op/s 2024-09-21T08:02:23.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:23 smithi191 ceph-mon[34667]: pgmap v744: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 614 B/s wr, 11 op/s 2024-09-21T08:02:24.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:23 smithi162 ceph-mon[34833]: pgmap v744: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 614 B/s wr, 11 op/s 2024-09-21T08:02:24.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:23 smithi084 ceph-mon[30411]: pgmap v744: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 614 B/s wr, 11 op/s 2024-09-21T08:02:25.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:25 smithi191 ceph-mon[34667]: pgmap v745: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.8 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-21T08:02:26.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:25 smithi162 ceph-mon[34833]: pgmap v745: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.8 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-21T08:02:26.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:25 smithi084 ceph-mon[30411]: pgmap v745: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.8 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-21T08:02:27.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:27 smithi191 ceph-mon[34667]: pgmap v746: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T08:02:28.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:27 smithi162 ceph-mon[34833]: pgmap v746: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T08:02:28.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:27 smithi084 ceph-mon[30411]: pgmap v746: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T08:02:29.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:29 smithi191 ceph-mon[34667]: pgmap v747: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 478 B/s wr, 11 op/s 2024-09-21T08:02:30.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:29 smithi162 ceph-mon[34833]: pgmap v747: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 478 B/s wr, 11 op/s 2024-09-21T08:02:30.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:29 smithi084 ceph-mon[30411]: pgmap v747: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 478 B/s wr, 11 op/s 2024-09-21T08:02:31.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:31 smithi191 ceph-mon[34667]: pgmap v748: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T08:02:32.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:31 smithi162 ceph-mon[34833]: pgmap v748: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T08:02:32.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:31 smithi084 ceph-mon[30411]: pgmap v748: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T08:02:33.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:33 smithi191 ceph-mon[34667]: pgmap v749: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T08:02:34.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:33 smithi162 ceph-mon[34833]: pgmap v749: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T08:02:34.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:33 smithi084 ceph-mon[30411]: pgmap v749: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T08:02:35.802 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:35.856 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:35 smithi084 ceph-mon[30411]: pgmap v750: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T08:02:35.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:35 smithi191 ceph-mon[34667]: pgmap v750: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T08:02:36.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:35 smithi162 ceph-mon[34833]: pgmap v750: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T08:02:36.185 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:36.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.882+0000 7f5a69000640 1 -- 172.21.15.84:0/4154461482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 msgr2=0x7f5a64112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.882+0000 7f5a69000640 1 --2- 172.21.15.84:0/4154461482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 0x7f5a64112840 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009900 tx=0x7f5a5c02a410 comp rx=0 tx=0).stop 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.882+0000 7f5a69000640 1 -- 172.21.15.84:0/4154461482 shutdown_connections 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.882+0000 7f5a69000640 1 --2- 172.21.15.84:0/4154461482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 0x7f5a64112840 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.882+0000 7f5a69000640 1 --2- 172.21.15.84:0/4154461482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a6410b6c0 0x7f5a6410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.882+0000 7f5a69000640 1 --2- 172.21.15.84:0/4154461482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a64105d80 0x7f5a64106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.882+0000 7f5a69000640 1 -- 172.21.15.84:0/4154461482 >> 172.21.15.84:0/4154461482 conn(0x7f5a64101810 msgr2=0x7f5a64103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.883+0000 7f5a69000640 1 -- 172.21.15.84:0/4154461482 shutdown_connections 2024-09-21T08:02:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.883+0000 7f5a69000640 1 -- 172.21.15.84:0/4154461482 wait complete. 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 Processor -- start 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 -- start start 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a64105d80 0x7f5a6419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a6410b6c0 0x7f5a6419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 0x7f5a641a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a64115cd0 con 0x7f5a6410c010 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a64115b50 con 0x7f5a64105d80 2024-09-21T08:02:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.884+0000 7f5a69000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5a64115e50 con 0x7f5a6410b6c0 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a62800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 0x7f5a641a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a62800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 0x7f5a641a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41568/0 (socket says 172.21.15.84:41568) 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a64105d80 0x7f5a6419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a62800640 1 -- 172.21.15.84:0/3358192162 learned_addr learned my addr 172.21.15.84:0/3358192162 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a6410b6c0 0x7f5a6419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61e00640 1 -- 172.21.15.84:0/3358192162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a6410b6c0 msgr2=0x7f5a6419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61e00640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a6410b6c0 0x7f5a6419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61e00640 1 -- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 msgr2=0x7f5a641a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61e00640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 0x7f5a641a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61e00640 1 -- 172.21.15.84:0/3358192162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a641a2670 con 0x7f5a64105d80 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61400640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a6410b6c0 0x7f5a6419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.885+0000 7f5a61e00640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a64105d80 0x7f5a6419c700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400eb00 tx=0x7f5a5400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:36.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.886+0000 7f5a5aa00640 1 -- 172.21.15.84:0/3358192162 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54010430 con 0x7f5a64105d80 2024-09-21T08:02:36.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.886+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a641a2960 con 0x7f5a64105d80 2024-09-21T08:02:36.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.886+0000 7f5a5aa00640 1 -- 172.21.15.84:0/3358192162 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a54010a80 con 0x7f5a64105d80 2024-09-21T08:02:36.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.886+0000 7f5a5aa00640 1 -- 172.21.15.84:0/3358192162 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54017a40 con 0x7f5a64105d80 2024-09-21T08:02:36.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.886+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a641a90c0 con 0x7f5a64105d80 2024-09-21T08:02:36.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.887+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a64106190 con 0x7f5a64105d80 2024-09-21T08:02:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.889+0000 7f5a5aa00640 1 -- 172.21.15.84:0/3358192162 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5a54017d00 con 0x7f5a64105d80 2024-09-21T08:02:36.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.891+0000 7f5a5aa00640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a480b6700 0x7f5a480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:36.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.891+0000 7f5a5aa00640 1 -- 172.21.15.84:0/3358192162 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f5a540e8520 con 0x7f5a64105d80 2024-09-21T08:02:36.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.891+0000 7f5a61400640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a480b6700 0x7f5a480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:36.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.892+0000 7f5a61400640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a480b6700 0x7f5a480b8c10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5a64104f10 tx=0x7f5a50005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:36.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:36.893+0000 7f5a5aa00640 1 -- 172.21.15.84:0/3358192162 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a540ae770 con 0x7f5a64105d80 2024-09-21T08:02:37.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.121+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a6419d830 con 0x7f5a64105d80 2024-09-21T08:02:37.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.123+0000 7f5a5aa00640 1 -- 172.21.15.84:0/3358192162 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f5a6419d830 con 0x7f5a64105d80 2024-09-21T08:02:37.125 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:02:37.125 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:02:37.125 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:02:37.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a480b6700 msgr2=0x7f5a480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:37.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a480b6700 0x7f5a480b8c10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5a64104f10 tx=0x7f5a50005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:37.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a64105d80 msgr2=0x7f5a6419c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:37.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a64105d80 0x7f5a6419c700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400eb00 tx=0x7f5a5400c2d0 comp rx=0 tx=0).stop 2024-09-21T08:02:37.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 shutdown_connections 2024-09-21T08:02:37.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5a480b6700 0x7f5a480b8c10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:37.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6410c010 0x7f5a641a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:37.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a6410b6c0 0x7f5a6419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:37.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 --2- 172.21.15.84:0/3358192162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a64105d80 0x7f5a6419c700 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:37.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.125+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 >> 172.21.15.84:0/3358192162 conn(0x7f5a64101810 msgr2=0x7f5a6410ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:37.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.126+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 shutdown_connections 2024-09-21T08:02:37.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:37.126+0000 7f5a69000640 1 -- 172.21.15.84:0/3358192162 wait complete. 2024-09-21T08:02:37.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:37 smithi084 ceph-mon[30411]: pgmap v751: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T08:02:37.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:37 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3358192162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:37.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:37 smithi191 ceph-mon[34667]: pgmap v751: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T08:02:37.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:37 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3358192162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:37.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T08:02:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:37 smithi162 ceph-mon[34833]: pgmap v751: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T08:02:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:37 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3358192162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:38.305 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --set-id 3e65f53d --release --await' 2024-09-21T08:02:38.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --set-id 3e65f53d --release --await 2024-09-21T08:02:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.242+0000 7f5e03400640 1 -- 172.21.15.84:0/3892950492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc1062d0 msgr2=0x7f5dfc1066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.242+0000 7f5e03400640 1 --2- 172.21.15.84:0/3892950492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc1066e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009900 tx=0x7f5de802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.242+0000 7f5e03400640 1 -- 172.21.15.84:0/3892950492 shutdown_connections 2024-09-21T08:02:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.242+0000 7f5e03400640 1 --2- 172.21.15.84:0/3892950492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dfc106c20 0x7f5dfc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.242+0000 7f5e03400640 1 --2- 172.21.15.84:0/3892950492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc1066e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.242+0000 7f5e03400640 1 --2- 172.21.15.84:0/3892950492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc06bd50 0x7f5dfc06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.242+0000 7f5e03400640 1 -- 172.21.15.84:0/3892950492 >> 172.21.15.84:0/3892950492 conn(0x7f5dfc0799a0 msgr2=0x7f5dfc079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:39.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.243+0000 7f5e03400640 1 -- 172.21.15.84:0/3892950492 shutdown_connections 2024-09-21T08:02:39.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.243+0000 7f5e03400640 1 -- 172.21.15.84:0/3892950492 wait complete. 2024-09-21T08:02:39.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 Processor -- start 2024-09-21T08:02:39.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 -- start start 2024-09-21T08:02:39.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc06bd50 0x7f5dfc198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dfc106c20 0x7f5dfc19dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc111910 con 0x7f5dfc1062d0 2024-09-21T08:02:39.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc111790 con 0x7f5dfc06bd50 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5e03400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc111a90 con 0x7f5dfc106c20 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.244+0000 7f5dfbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42070/0 (socket says 172.21.15.84:42070) 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 -- 172.21.15.84:0/1877149882 learned_addr learned my addr 172.21.15.84:0/1877149882 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5e00a00640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc06bd50 0x7f5dfc198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5e01400640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dfc106c20 0x7f5dfc19dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 -- 172.21.15.84:0/1877149882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dfc106c20 msgr2=0x7f5dfc19dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dfc106c20 0x7f5dfc19dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 -- 172.21.15.84:0/1877149882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc06bd50 msgr2=0x7f5dfc198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc06bd50 0x7f5dfc198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 -- 172.21.15.84:0/1877149882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc19e1f0 con 0x7f5dfc1062d0 2024-09-21T08:02:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.245+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc198820 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5de8005ab0 tx=0x7f5de8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.246+0000 7f5df9600640 1 -- 172.21.15.84:0/1877149882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de803f070 con 0x7f5dfc1062d0 2024-09-21T08:02:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.246+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc19e480 con 0x7f5dfc1062d0 2024-09-21T08:02:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.246+0000 7f5df9600640 1 -- 172.21.15.84:0/1877149882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5de8031b50 con 0x7f5dfc1062d0 2024-09-21T08:02:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.246+0000 7f5df9600640 1 -- 172.21.15.84:0/1877149882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8035030 con 0x7f5dfc1062d0 2024-09-21T08:02:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.246+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc1a4c40 con 0x7f5dfc1062d0 2024-09-21T08:02:39.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 Processor -- start 2024-09-21T08:02:39.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 -- start start 2024-09-21T08:02:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5df9600640 1 -- 172.21.15.84:0/1877149882 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5de8042070 con 0x7f5dfc1062d0 2024-09-21T08:02:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb91fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb9200a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb9205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5634cb896f70 con 0x5634cb579070 2024-09-21T08:02:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5634cb8863a0 con 0x5634cb558390 2024-09-21T08:02:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5634cb88a1b0 con 0x5634cb5501b0 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.250+0000 7f5e01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb91fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e00a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb9200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb91fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42076/0 (socket says 172.21.15.84:42076) 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e01400640 1 -- 172.21.15.84:0/1698899840 learned_addr learned my addr 172.21.15.84:0/1698899840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb9205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e00a00640 1 -- 172.21.15.84:0/1698899840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 msgr2=0x5634cb9205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e00a00640 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb9205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e00a00640 1 -- 172.21.15.84:0/1698899840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 msgr2=0x5634cb91fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e00a00640 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb91fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e00a00640 1 -- 172.21.15.84:0/1698899840 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cb850c90 con 0x5634cb5501b0 2024-09-21T08:02:39.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5e00a00640 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb9200a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5df00058b0 tx=0x7f5df0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=484d1526d81c2163 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:39.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.251+0000 7f5dedc00640 1 -- 172.21.15.84:0/1698899840 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df001d030 con 0x5634cb5501b0 2024-09-21T08:02:39.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5dedc00640 1 -- 172.21.15.84:0/1698899840 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df000d2e0 con 0x5634cb5501b0 2024-09-21T08:02:39.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5dedc00640 1 -- 172.21.15.84:0/1698899840 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00047a0 con 0x5634cb5501b0 2024-09-21T08:02:39.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 -- 172.21.15.84:0/1698899840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 msgr2=0x5634cb9200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb9200a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5df00058b0 tx=0x7f5df0005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:39.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 -- 172.21.15.84:0/1698899840 shutdown_connections 2024-09-21T08:02:39.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb9205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb9200a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/1698899840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb91fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 -- 172.21.15.84:0/1698899840 >> 172.21.15.84:0/1698899840 conn(0x5634cb56d460 msgr2=0x5634cb91da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 -- 172.21.15.84:0/1698899840 shutdown_connections 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5e0a06d740 1 -- 172.21.15.84:0/1698899840 wait complete. 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.253+0000 7f5df9600640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5de40b65b0 0x7f5de40b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.254+0000 7f5df9600640 1 -- 172.21.15.84:0/1877149882 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f5de81080e0 con 0x7f5dfc1062d0 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.254+0000 7f5e00a00640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5de40b65b0 0x7f5de40b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.254+0000 7f5e0a06d740 1 -- start start 2024-09-21T08:02:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.254+0000 7f5e0a06d740 1 Processor -- start 2024-09-21T08:02:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.254+0000 7f5e00a00640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5de40b65b0 0x7f5de40b8ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5df000ddc0 tx=0x7f5df0005310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb937630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5634cb6e7700 con 0x5634cb579070 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5634cb821540 con 0x5634cb558390 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5634cb92e340 con 0x5634cb5501b0 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e0a06d740 10 client.0 _ll_register_callbacks cb 0x5634cb831430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5dfbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e00a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb937630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5dfbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48188/0 (socket says 172.21.15.84:48188) 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5e01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb937630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42090/0 (socket says 172.21.15.84:42090) 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.255+0000 7f5dfbe00640 1 -- 172.21.15.84:0/911042412 learned_addr learned my addr 172.21.15.84:0/911042412 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5dfbe00640 1 -- 172.21.15.84:0/911042412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 msgr2=0x5634cb92b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5dfbe00640 1 -- 172.21.15.84:0/911042412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 msgr2=0x5634cb937630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb937630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5dfbe00640 1 -- 172.21.15.84:0/911042412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cb5e4650 con 0x5634cb558390 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92bcd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5de8031440 tx=0x7f5de8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47ce1f42bb9560f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5de2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5de2000640 1 -- 172.21.15.84:0/911042412 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8049070 con 0x5634cb558390 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634cb823b50 con 0x5634cb558390 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.256+0000 7f5de2000640 1 -- 172.21.15.84:0/911042412 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f5de80c9e60 con 0x5634cb558390 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5de2000640 1 -- 172.21.15.84:0/911042412 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5de80c9a90 con 0x5634cb558390 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 10 client.28310 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634cb83e910 con 0x5634cb558390 2024-09-21T08:02:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5de2000640 1 -- 172.21.15.84:0/911042412 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5634cb823b50 con 0x5634cb558390 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5de2000640 1 -- 172.21.15.84:0/911042412 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5de80c9040 con 0x5634cb558390 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 10 client.28310 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 10 client.28310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 20 client.28310 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb5379f0 0x5634cb93d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 4 client.28310 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.257+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634cb898ec0 con 0x5634cb5379f0 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.258+0000 7f5e00a00640 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb5379f0 0x5634cb93d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.258+0000 7f5e00a00640 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb5379f0 0x5634cb93d690 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d04c07551dc21e2 server_cookie=2c28f44bb8d9f0eb in_seq=0 out_seq=0 2024-09-21T08:02:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.258+0000 7f5de2000640 10 client.28310 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.259+0000 7f5de2000640 1 -- 172.21.15.84:0/911042412 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5634cb898ec0 con 0x5634cb5379f0 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.259+0000 7f5de2000640 10 client.28310 handle_command_reply: tid=0 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.259+0000 7f5e0a06d740 1 client.28310 shutdown 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 msgr2=0x5634cb92bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92bcd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5de8031440 tx=0x7f5de8009260 comp rx=0 tx=0).stop 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 shutdown_connections 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb937630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92bcd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb5379f0 0x5634cb93d690 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/911042412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5de2000640 0 client.28310 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 >> 172.21.15.84:0/911042412 conn(0x5634cb56d460 msgr2=0x5634cb922d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 shutdown_connections 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 1 -- 172.21.15.84:0/911042412 wait complete. 2024-09-21T08:02:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.260+0000 7f5e0a06d740 20 client.28310 trim_cache size 0 max 16384 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 Processor -- start 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 -- start start 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb937530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb558390 0x5634cb929df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb579070 0x5634cb92a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1aec10 con 0x5634cb558390 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1b0750 con 0x5634cb579070 2024-09-21T08:02:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.279+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1af2e0 con 0x5634cb5501b0 2024-09-21T08:02:39.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5dfbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb558390 0x5634cb929df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb937530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb937530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38406/0 (socket says 172.21.15.84:38406) 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 -- 172.21.15.84:0/173055402 learned_addr learned my addr 172.21.15.84:0/173055402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e01400640 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb579070 0x5634cb92a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 -- 172.21.15.84:0/173055402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb579070 msgr2=0x5634cb92a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb579070 0x5634cb92a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 -- 172.21.15.84:0/173055402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb558390 msgr2=0x5634cb929df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb558390 0x5634cb929df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5e00a00640 1 -- 172.21.15.84:0/173055402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cb9229c0 con 0x5634cb5501b0 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.280+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb558390 0x5634cb929df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.281+0000 7f5e00a00640 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb937530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8b9701729f8e5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.281+0000 7f5ded200640 1 -- 172.21.15.84:0/173055402 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df003b020 con 0x5634cb5501b0 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.281+0000 7f5ded200640 1 -- 172.21.15.84:0/173055402 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df0003cc0 con 0x5634cb5501b0 2024-09-21T08:02:39.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.281+0000 7f5ded200640 1 -- 172.21.15.84:0/173055402 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0026070 con 0x5634cb5501b0 2024-09-21T08:02:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 -- 172.21.15.84:0/173055402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 msgr2=0x5634cb937530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb937530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df001a000 comp rx=0 tx=0).stop 2024-09-21T08:02:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 -- 172.21.15.84:0/173055402 shutdown_connections 2024-09-21T08:02:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb579070 0x5634cb92a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb558390 0x5634cb929df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/173055402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb937530 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 -- 172.21.15.84:0/173055402 >> 172.21.15.84:0/173055402 conn(0x5634cb56d460 msgr2=0x5634cb926740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 -- 172.21.15.84:0/173055402 shutdown_connections 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.282+0000 7f5e0a06d740 1 -- 172.21.15.84:0/173055402 wait complete. 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 -- start start 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 Processor -- start 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb930190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1b0080 con 0x5634cb579070 2024-09-21T08:02:39.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1af9b0 con 0x5634cb558390 2024-09-21T08:02:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.283+0000 7f5e0a06d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1acc10 con 0x5634cb5501b0 2024-09-21T08:02:39.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5e0a06d740 10 client.0 _ll_register_callbacks cb 0x7f5de8005e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48216/0 (socket says 172.21.15.84:48216) 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 -- 172.21.15.84:0/541528948 learned_addr learned my addr 172.21.15.84:0/541528948 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5e01400640 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb930190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5e00a00640 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 -- 172.21.15.84:0/541528948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 msgr2=0x5634cb92f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 -- 172.21.15.84:0/541528948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 msgr2=0x5634cb930190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb930190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.284+0000 7f5dfbe00640 1 -- 172.21.15.84:0/541528948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cb9a7210 con 0x5634cb558390 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.285+0000 7f5dfbe00640 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92fc50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5de803b6f0 tx=0x7f5de802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c47c2b3c56078d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.285+0000 7f5de2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.285+0000 7f5de2000640 1 -- 172.21.15.84:0/541528948 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8049070 con 0x5634cb558390 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.285+0000 7f5de2000640 1 -- 172.21.15.84:0/541528948 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f5de803bdb0 con 0x5634cb558390 2024-09-21T08:02:39.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.285+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df0003cc0 con 0x5634cb558390 2024-09-21T08:02:39.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.286+0000 7f5de2000640 1 -- 172.21.15.84:0/541528948 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5de80c9360 con 0x5634cb558390 2024-09-21T08:02:39.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.286+0000 7f5e0a06d740 10 client.28316 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:39.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.286+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634cb9a84d0 con 0x5634cb558390 2024-09-21T08:02:39.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5de2000640 1 -- 172.21.15.84:0/541528948 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df0003cc0 con 0x5634cb558390 2024-09-21T08:02:39.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5de2000640 1 -- 172.21.15.84:0/541528948 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5de80c9040 con 0x5634cb558390 2024-09-21T08:02:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5e0a06d740 10 client.28316 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5e0a06d740 10 client.28316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5e0a06d740 20 client.28316 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb50cda0 0x5634cb9aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5e0a06d740 4 client.28316 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T08:02:39.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.287+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5634cb894970 con 0x5634cb50cda0 2024-09-21T08:02:39.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.289+0000 7f5e00a00640 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb50cda0 0x5634cb9aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e00a00640 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb50cda0 0x5634cb9aab30 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799fae07de382b50 server_cookie=a6e8103bff661dbd in_seq=0 out_seq=0 2024-09-21T08:02:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5de2000640 10 client.28316 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:39.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5de2000640 1 -- 172.21.15.84:0/541528948 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x5634cb894970 con 0x5634cb50cda0 2024-09-21T08:02:39.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5de2000640 10 client.28316 handle_command_reply: tid=0 2024-09-21T08:02:39.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 client.28316 shutdown 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 msgr2=0x5634cb92fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92fc50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5de803b6f0 tx=0x7f5de802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 shutdown_connections 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5634cb579070 0x5634cb930190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5634cb558390 0x5634cb92fc50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5634cb50cda0 0x5634cb9aab30 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 --2- 172.21.15.84:0/541528948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5634cb5501b0 0x5634cb92f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 >> 172.21.15.84:0/541528948 conn(0x5634cb56d460 msgr2=0x5634cb924c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.291+0000 7f5de2000640 0 client.28316 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.292+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 shutdown_connections 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.292+0000 7f5e0a06d740 1 -- 172.21.15.84:0/541528948 wait complete. 2024-09-21T08:02:39.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.292+0000 7f5e0a06d740 20 client.28316 trim_cache size 0 max 16384 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "30d95146-ffef-488a-bb0c-cb0c8fb5e5d0": { 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:02:04.560637+0000", 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.296 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "098875a9-63e0-4fc5-a56f-f2c4e8928c0d": { 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:50:44.830121+0000", 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "5cf97035-fd04-41b7-9d39-d10e5b22671b": { 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:51:35.232033+0000", 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.297 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "75f4a8af-c0a2-4631-8028-838e09068109": { 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:04.973091+0000", 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "a783bb27-9ab3-4381-8718-e55ea81ab33c": { 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:53:34.206455+0000", 2024-09-21T08:02:39.298 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "f92178bd-4b3c-49f6-be89-e65981d080d0": { 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:54:51.298782+0000", 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "943a50d1-7f35-4f4f-9dc0-a41c6709e811": { 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:55:40.138725+0000", 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "008af55a-e9e2-461c-9512-4f52101e1e46": { 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:57:36.628210+0000", 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "150c51d9-ea54-433e-a9e2-a91577daa093": { 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:59:30.580803+0000", 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "cef4fe59-34a4-44db-8667-452e2c24d686": { 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:56:38.522462+0000", 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.301 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "355130ec-018e-44d4-be31-b38df69327bd": { 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:58:50.491641+0000", 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "03a9382c-3904-4e30-a4ef-a0d11c4650bc": { 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T07:52:35.606728+0000", 2024-09-21T08:02:39.302 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "63a41a05-d44f-45b2-983d-1fa6b7559a20": { 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:00:25.066675+0000", 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:39.303 INFO:teuthology.orchestra.run.smithi084.stdout: "73eff468-1da5-4975-a63e-c0f57a3f64cd": { 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T08:01:15.381648+0000", 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5de40b65b0 msgr2=0x7f5de40b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5de40b65b0 0x7f5de40b8ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5df000ddc0 tx=0x7f5df0005310 comp rx=0 tx=0).stop 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc1062d0 msgr2=0x7f5dfc198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc198820 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5de8005ab0 tx=0x7f5de8003b90 comp rx=0 tx=0).stop 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 shutdown_connections 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5de40b65b0 0x7f5de40b8ac0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dfc106c20 0x7f5dfc19dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc1062d0 0x7f5dfc198820 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 --2- 172.21.15.84:0/1877149882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc06bd50 0x7f5dfc198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.293+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 >> 172.21.15.84:0/1877149882 conn(0x7f5dfc0799a0 msgr2=0x7f5dfc107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.294+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 shutdown_connections 2024-09-21T08:02:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.294+0000 7f5e03400640 1 -- 172.21.15.84:0/1877149882 wait complete. 2024-09-21T08:02:39.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:39 smithi191 ceph-mon[34667]: pgmap v752: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:02:39.915 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:39 smithi084 ceph-mon[30411]: pgmap v752: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 -- 172.21.15.84:0/2815858785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934109e10 msgr2=0x7f8934110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 --2- 172.21.15.84:0/2815858785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934109e10 0x7f8934110640 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f892c009860 tx=0x7f892c02a340 comp rx=0 tx=0).stop 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 -- 172.21.15.84:0/2815858785 shutdown_connections 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 --2- 172.21.15.84:0/2815858785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934109e10 0x7f8934110640 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 --2- 172.21.15.84:0/2815858785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89341094c0 0x7f89341098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 --2- 172.21.15.84:0/2815858785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8934103b80 0x7f8934103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 -- 172.21.15.84:0/2815858785 >> 172.21.15.84:0/2815858785 conn(0x7f89340ff610 msgr2=0x7f8934101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 -- 172.21.15.84:0/2815858785 shutdown_connections 2024-09-21T08:02:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.997+0000 7f893b000640 1 -- 172.21.15.84:0/2815858785 wait complete. 2024-09-21T08:02:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.998+0000 7f893b000640 1 Processor -- start 2024-09-21T08:02:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.998+0000 7f893b000640 1 -- start start 2024-09-21T08:02:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f893b000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934103b80 0x7f893419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f893b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89341094c0 0x7f893419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f893b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8934109e10 0x7f893419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f893b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8934113ad0 con 0x7f8934109e10 2024-09-21T08:02:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f893b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8934113950 con 0x7f89341094c0 2024-09-21T08:02:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f893b000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8934113c50 con 0x7f8934103b80 2024-09-21T08:02:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8934109e10 0x7f893419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8934109e10 0x7f893419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42106/0 (socket says 172.21.15.84:42106) 2024-09-21T08:02:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 -- 172.21.15.84:0/346947384 learned_addr learned my addr 172.21.15.84:0/346947384 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8933e00640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934103b80 0x7f893419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8933400640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89341094c0 0x7f893419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 -- 172.21.15.84:0/346947384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934103b80 msgr2=0x7f893419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934103b80 0x7f893419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 -- 172.21.15.84:0/346947384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89341094c0 msgr2=0x7f893419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89341094c0 0x7f893419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8939000640 1 -- 172.21.15.84:0/346947384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89341a0390 con 0x7f8934109e10 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:39.999+0000 7f8933e00640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934103b80 0x7f893419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.000+0000 7f8939000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8934109e10 0x7f893419fc60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f892c02a930 tx=0x7f892c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:40.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.000+0000 7f8930c00640 1 -- 172.21.15.84:0/346947384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c040020 con 0x7f8934109e10 2024-09-21T08:02:40.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.000+0000 7f8930c00640 1 -- 172.21.15.84:0/346947384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892c030d50 con 0x7f8934109e10 2024-09-21T08:02:40.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.000+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89341a0620 con 0x7f8934109e10 2024-09-21T08:02:40.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.000+0000 7f8930c00640 1 -- 172.21.15.84:0/346947384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c037040 con 0x7f8934109e10 2024-09-21T08:02:40.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.000+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341a6de0 con 0x7f8934109e10 2024-09-21T08:02:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.003+0000 7f8941c8b740 1 Processor -- start 2024-09-21T08:02:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8930c00640 1 -- 172.21.15.84:0/346947384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f892c043020 con 0x7f8934109e10 2024-09-21T08:02:40.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8941c8b740 1 -- start start 2024-09-21T08:02:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daef0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8941c8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a5dae67290 con 0x55a5dab28840 2024-09-21T08:02:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8941c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5dae566c0 con 0x55a5dab49520 2024-09-21T08:02:40.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.004+0000 7f8941c8b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a5dae5a4d0 con 0x55a5dab20660 2024-09-21T08:02:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38422/0 (socket says 172.21.15.84:38422) 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 -- 172.21.15.84:0/211792129 learned_addr learned my addr 172.21.15.84:0/211792129 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48234/0 (socket says 172.21.15.84:48234) 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933400640 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daef0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 -- 172.21.15.84:0/211792129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 msgr2=0x55a5daef01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 -- 172.21.15.84:0/211792129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 msgr2=0x55a5daef0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daef0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.005+0000 7f8933e00640 1 -- 172.21.15.84:0/211792129 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5dade3460 con 0x55a5dab20660 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.006+0000 7f8933e00640 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef0700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f89240118a0 tx=0x7f8924011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7bccb28b88b7e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.006+0000 7f8930c00640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f89180b6700 0x7f89180b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.006+0000 7f8929600640 1 -- 172.21.15.84:0/211792129 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924011310 con 0x55a5dab20660 2024-09-21T08:02:40.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.006+0000 7f8929600640 1 -- 172.21.15.84:0/211792129 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892400fe50 con 0x55a5dab20660 2024-09-21T08:02:40.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.006+0000 7f8929600640 1 -- 172.21.15.84:0/211792129 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924019e50 con 0x55a5dab20660 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.006+0000 7f8930c00640 1 -- 172.21.15.84:0/346947384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f892c107650 con 0x7f8934109e10 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.006+0000 7f8933400640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f89180b6700 0x7f89180b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 -- 172.21.15.84:0/211792129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 msgr2=0x55a5daef0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8933400640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f89180b6700 0x7f89180b8c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8920009fd0 tx=0x7f8920009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef0700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f89240118a0 tx=0x7f8924011d60 comp rx=0 tx=0).stop 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 -- 172.21.15.84:0/211792129 shutdown_connections 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daef0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef0700 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 --2- 172.21.15.84:0/211792129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 -- 172.21.15.84:0/211792129 >> 172.21.15.84:0/211792129 conn(0x55a5dab3d910 msgr2=0x55a5daeee0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 -- 172.21.15.84:0/211792129 shutdown_connections 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.007+0000 7f8941c8b740 1 -- 172.21.15.84:0/211792129 wait complete. 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.008+0000 7f8941c8b740 1 -- start start 2024-09-21T08:02:40.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.008+0000 7f8941c8b740 1 Processor -- start 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.008+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daf00190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.008+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab28840 0x55a5daf006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab49520 0x55a5daf0c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8941c8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a5dacb7bb0 con 0x55a5dab49520 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8941c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5dadf16c0 con 0x55a5dab28840 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8941c8b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a5daf02cd0 con 0x55a5dab20660 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8941c8b740 10 client.0 _ll_register_callbacks cb 0x55a5dae0c490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab28840 0x55a5daf006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8939000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab49520 0x55a5daf0c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab28840 0x55a5daf006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:48236/0 (socket says 172.21.15.84:48236) 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 -- 172.21.15.84:0/813916328 learned_addr learned my addr 172.21.15.84:0/813916328 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:40.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933e00640 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daf00190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 -- 172.21.15.84:0/813916328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 msgr2=0x55a5daf00190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daf00190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 -- 172.21.15.84:0/813916328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab49520 msgr2=0x55a5daf0c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab49520 0x55a5daf0c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.009+0000 7f8933400640 1 -- 172.21.15.84:0/813916328 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5dabb4b00 con 0x55a5dab28840 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f8933400640 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab28840 0x55a5daf006d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8920003b10 tx=0x7f8920004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aadac3b155698b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f891e000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f891e000640 1 -- 172.21.15.84:0/813916328 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920005020 con 0x55a5dab28840 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f892400fe50 con 0x55a5dab28840 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f891e000640 1 -- 172.21.15.84:0/813916328 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f892001a050 con 0x55a5dab28840 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f891e000640 1 -- 172.21.15.84:0/813916328 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8920036050 con 0x55a5dab28840 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f8941c8b740 10 client.28328 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:40.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.010+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5dac2b960 con 0x55a5dab28840 2024-09-21T08:02:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f891e000640 1 -- 172.21.15.84:0/813916328 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892400fe50 con 0x55a5dab28840 2024-09-21T08:02:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f891e000640 1 -- 172.21.15.84:0/813916328 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f892002b510 con 0x55a5dab28840 2024-09-21T08:02:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f8941c8b740 10 client.28328 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:40.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f8941c8b740 10 client.28328 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f8941c8b740 20 client.28328 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f8941c8b740 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5dab07ea0 0x55a5daf120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f8941c8b740 4 client.28328 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5dae691e0 con 0x55a5dab07ea0 2024-09-21T08:02:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.011+0000 7f8933e00640 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5dab07ea0 0x55a5daf120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.012+0000 7f891e000640 10 client.28328 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:40.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.012+0000 7f8933e00640 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5dab07ea0 0x55a5daf120e0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a72ca4242af900a server_cookie=817e5396934c7d60 in_seq=0 out_seq=0 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f891e000640 1 -- 172.21.15.84:0/813916328 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5dae691e0 con 0x55a5dab07ea0 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f891e000640 10 client.28328 handle_command_reply: tid=0 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 client.28328 shutdown 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab28840 msgr2=0x55a5daf006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab28840 0x55a5daf006d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8920003b10 tx=0x7f8920004730 comp rx=0 tx=0).stop 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 shutdown_connections 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab49520 0x55a5daf0c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab28840 0x55a5daf006d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5dab07ea0 0x55a5daf120e0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 --2- 172.21.15.84:0/813916328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daf00190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f891e000640 0 client.28328 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 >> 172.21.15.84:0/813916328 conn(0x55a5dab3d910 msgr2=0x55a5daef3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 shutdown_connections 2024-09-21T08:02:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 1 -- 172.21.15.84:0/813916328 wait complete. 2024-09-21T08:02:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.014+0000 7f8941c8b740 20 client.28328 trim_cache size 0 max 16384 2024-09-21T08:02:40.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.032+0000 7f8941c8b740 1 Processor -- start 2024-09-21T08:02:40.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.032+0000 7f8941c8b740 1 -- start start 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daf01e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8941c8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f89341aec30 con 0x55a5dab28840 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8941c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89341b0770 con 0x55a5dab49520 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8941c8b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f89341af300 con 0x55a5dab20660 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8933400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daf01e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8933400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daf01e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42132/0 (socket says 172.21.15.84:42132) 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8939000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8933400640 1 -- 172.21.15.84:0/3130581156 learned_addr learned my addr 172.21.15.84:0/3130581156 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:40.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8933e00640 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8939000640 1 -- 172.21.15.84:0/3130581156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 msgr2=0x55a5daef39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8939000640 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8939000640 1 -- 172.21.15.84:0/3130581156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 msgr2=0x55a5daf01e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8939000640 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daf01e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8939000640 1 -- 172.21.15.84:0/3130581156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5daf01250 con 0x55a5dab49520 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8933e00640 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.033+0000 7f8933400640 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daf01e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.034+0000 7f8939000640 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef1900 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f892c104980 tx=0x7f892c004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea8204765205974 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.034+0000 7f8928c00640 1 -- 172.21.15.84:0/3130581156 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c107070 con 0x55a5dab49520 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.034+0000 7f8928c00640 1 -- 172.21.15.84:0/3130581156 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892c0ccc50 con 0x55a5dab49520 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.034+0000 7f8928c00640 1 -- 172.21.15.84:0/3130581156 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c0c93b0 con 0x55a5dab49520 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 -- 172.21.15.84:0/3130581156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 msgr2=0x55a5daef1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef1900 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f892c104980 tx=0x7f892c004610 comp rx=0 tx=0).stop 2024-09-21T08:02:40.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 -- 172.21.15.84:0/3130581156 shutdown_connections 2024-09-21T08:02:40.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daef1900 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab28840 0x55a5daf01e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 --2- 172.21.15.84:0/3130581156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab20660 0x55a5daef39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 -- 172.21.15.84:0/3130581156 >> 172.21.15.84:0/3130581156 conn(0x55a5dab3d910 msgr2=0x55a5daef11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:40.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 -- 172.21.15.84:0/3130581156 shutdown_connections 2024-09-21T08:02:40.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 -- 172.21.15.84:0/3130581156 wait complete. 2024-09-21T08:02:40.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.035+0000 7f8941c8b740 1 -- start start 2024-09-21T08:02:40.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 1 Processor -- start 2024-09-21T08:02:40.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab20660 0x55a5daf08810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab28840 0x55a5daf04cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daf052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f89341b00a0 con 0x55a5dab20660 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89341af9d0 con 0x55a5dab49520 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f89341acc30 con 0x55a5dab28840 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8941c8b740 10 client.0 _ll_register_callbacks cb 0x7f89200039d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.036+0000 7f8933e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab20660 0x55a5daf08810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab28840 0x55a5daf04cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab28840 0x55a5daf04cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:38428/0 (socket says 172.21.15.84:38428) 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 -- 172.21.15.84:0/2034514041 learned_addr learned my addr 172.21.15.84:0/2034514041 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8939000640 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daf052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 -- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 msgr2=0x55a5daf052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daf052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 -- 172.21.15.84:0/2034514041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab20660 msgr2=0x55a5daf08810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab20660 0x55a5daf08810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 -- 172.21.15.84:0/2034514041 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5daf05a30 con 0x55a5dab28840 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933e00640 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab20660 0x55a5daf08810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f8933400640 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab28840 0x55a5daf04cd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f892002bb20 tx=0x7f892002be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c51533e2d30e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.037+0000 7f891e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f891e000640 1 -- 172.21.15.84:0/2034514041 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89200053d0 con 0x55a5dab28840 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f892c0ccc50 con 0x55a5dab28840 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f891e000640 1 -- 172.21.15.84:0/2034514041 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f8920028040 con 0x55a5dab28840 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f891e000640 1 -- 172.21.15.84:0/2034514041 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8920048050 con 0x55a5dab28840 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f8941c8b740 10 client.28351 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a5daf7dac0 con 0x55a5dab28840 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f891e000640 1 -- 172.21.15.84:0/2034514041 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892c0ccc50 con 0x55a5dab28840 2024-09-21T08:02:40.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.038+0000 7f891e000640 1 -- 172.21.15.84:0/2034514041 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8920004b80 con 0x55a5dab28840 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.039+0000 7f8941c8b740 10 client.28351 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.039+0000 7f8941c8b740 10 client.28351 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.039+0000 7f8941c8b740 20 client.28351 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.039+0000 7f8941c8b740 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5daadd250 0x55a5daf80270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.039+0000 7f8941c8b740 4 client.28351 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3e65f53d", "release": true, "await": true}] 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.039+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3e65f53d", "release": true, "await": true}) -- 0x55a5dae64c90 con 0x55a5daadd250 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.039+0000 7f8933e00640 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5daadd250 0x55a5daf80270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:40.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.040+0000 7f8933e00640 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5daadd250 0x55a5daf80270 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ea58e4493aadd39 server_cookie=892ee5b2a71b155b in_seq=0 out_seq=0 2024-09-21T08:02:40.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.040+0000 7f891e000640 10 client.28351 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:40.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.044+0000 7f891e000640 1 -- 172.21.15.84:0/2034514041 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a5dae64c90 con 0x55a5daadd250 2024-09-21T08:02:40.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.044+0000 7f891e000640 10 client.28351 handle_command_reply: tid=0 2024-09-21T08:02:40.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.044+0000 7f8941c8b740 1 client.28351 shutdown 2024-09-21T08:02:40.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.044+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab28840 msgr2=0x55a5daf04cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.044+0000 7f8941c8b740 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab28840 0x55a5daf04cd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f892002bb20 tx=0x7f892002be50 comp rx=0 tx=0).stop 2024-09-21T08:02:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 shutdown_connections 2024-09-21T08:02:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5dab49520 0x55a5daf052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x55a5daadd250 0x55a5daf80270 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a5dab28840 0x55a5daf04cd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 --2- 172.21.15.84:0/2034514041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a5dab20660 0x55a5daf08810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f891e000640 0 client.28351 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 >> 172.21.15.84:0/2034514041 conn(0x55a5dab3d910 msgr2=0x55a5daeff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:40.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 shutdown_connections 2024-09-21T08:02:40.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 1 -- 172.21.15.84:0/2034514041 wait complete. 2024-09-21T08:02:40.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.045+0000 7f8941c8b740 20 client.28351 trim_cache size 0 max 16384 2024-09-21T08:02:40.049 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:02:40.049 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 44, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "3e65f53d": { 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 44, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 144.5, 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T08:02:40.050 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:02:40.051 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f89180b6700 msgr2=0x7f89180b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f89180b6700 0x7f89180b8c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8920009fd0 tx=0x7f8920009260 comp rx=0 tx=0).stop 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8934109e10 msgr2=0x7f893419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8934109e10 0x7f893419fc60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f892c02a930 tx=0x7f892c032d50 comp rx=0 tx=0).stop 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 shutdown_connections 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f89180b6700 0x7f89180b8c10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8934109e10 0x7f893419fc60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89341094c0 0x7f893419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 --2- 172.21.15.84:0/346947384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8934103b80 0x7f893419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 >> 172.21.15.84:0/346947384 conn(0x7f89340ff610 msgr2=0x7f8934106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 shutdown_connections 2024-09-21T08:02:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:40.046+0000 7f893b000640 1 -- 172.21.15.84:0/346947384 wait complete. 2024-09-21T08:02:40.053 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:39 smithi162 ceph-mon[34833]: pgmap v752: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T08:02:40.131 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-21T08:02:40.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T08:02:41.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:41 smithi191 ceph-mon[34667]: pgmap v753: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T08:02:41.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:41 smithi084 ceph-mon[30411]: pgmap v753: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T08:02:42.001 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3e65f53d', total seconds elapsed: 30.7 2024-09-21T08:02:42.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:41 smithi162 ceph-mon[34833]: pgmap v753: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T08:02:42.108 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T08:02:42.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:42.778 DEBUG:teuthology.parallel:result is None 2024-09-21T08:02:42.778 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T08:02:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:43.041 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T08:02:43.041 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T08:02:43.051 INFO:tasks.quiescer:joining Quiescers 2024-09-21T08:02:43.051 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T08:02:43.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 -- 172.21.15.84:0/1899975160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee410a9e0 msgr2=0x7fdee410adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 --2- 172.21.15.84:0/1899975160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee410a9e0 0x7fdee410adf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fded4009900 tx=0x7fded402a440 comp rx=0 tx=0).stop 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 -- 172.21.15.84:0/1899975160 shutdown_connections 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 --2- 172.21.15.84:0/1899975160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee411cc30 0x7fdee411f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 --2- 172.21.15.84:0/1899975160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee410a9e0 0x7fdee410adf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 --2- 172.21.15.84:0/1899975160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 0x7fdee410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 -- 172.21.15.84:0/1899975160 >> 172.21.15.84:0/1899975160 conn(0x7fdee4070ec0 msgr2=0x7fdee40712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 -- 172.21.15.84:0/1899975160 shutdown_connections 2024-09-21T08:02:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.669+0000 7fdee8e00640 1 -- 172.21.15.84:0/1899975160 wait complete. 2024-09-21T08:02:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.672+0000 7fdee8e00640 1 Processor -- start 2024-09-21T08:02:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.674+0000 7fdee8e00640 1 -- start start 2024-09-21T08:02:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.675+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee410a9e0 0x7fdee41a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.675+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 0x7fdee41a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee411cc30 0x7fdee41aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee8e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4122a00 con 0x7fdee4111f40 2024-09-21T08:02:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee8e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4122880 con 0x7fdee410a9e0 2024-09-21T08:02:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee8e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4122b80 con 0x7fdee411cc30 2024-09-21T08:02:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 0x7fdee41a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 0x7fdee41a9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42148/0 (socket says 172.21.15.84:42148) 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee1400640 1 -- 172.21.15.84:0/1433539492 learned_addr learned my addr 172.21.15.84:0/1433539492 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.676+0000 7fdee1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee410a9e0 0x7fdee41a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.677+0000 7fdee2800640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee411cc30 0x7fdee41aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.677+0000 7fdee1400640 1 -- 172.21.15.84:0/1433539492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee411cc30 msgr2=0x7fdee41aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.677+0000 7fdee1400640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee411cc30 0x7fdee41aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.677+0000 7fdee1400640 1 -- 172.21.15.84:0/1433539492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee410a9e0 msgr2=0x7fdee41a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.677+0000 7fdee1400640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee410a9e0 0x7fdee41a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.677+0000 7fdee1400640 1 -- 172.21.15.84:0/1433539492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee41af3e0 con 0x7fdee4111f40 2024-09-21T08:02:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.680+0000 7fdee1400640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 0x7fdee41a9a10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fded402aa30 tx=0x7fded4003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.683+0000 7fdedaa00640 1 -- 172.21.15.84:0/1433539492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded403f070 con 0x7fdee4111f40 2024-09-21T08:02:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.683+0000 7fdedaa00640 1 -- 172.21.15.84:0/1433539492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded4031d60 con 0x7fdee4111f40 2024-09-21T08:02:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.683+0000 7fdedaa00640 1 -- 172.21.15.84:0/1433539492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4035030 con 0x7fdee4111f40 2024-09-21T08:02:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.683+0000 7fdee8e00640 1 -- 172.21.15.84:0/1433539492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee41af670 con 0x7fdee4111f40 2024-09-21T08:02:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.683+0000 7fdee8e00640 1 -- 172.21.15.84:0/1433539492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee41b5e30 con 0x7fdee4111f40 2024-09-21T08:02:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.685+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc005290 con 0x7fdee4111f40 2024-09-21T08:02:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.691+0000 7fdedaa00640 1 -- 172.21.15.84:0/1433539492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fded4042070 con 0x7fdee4111f40 2024-09-21T08:02:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.694+0000 7fdedaa00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdec80b6800 0x7fdec80b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.694+0000 7fdedaa00640 1 -- 172.21.15.84:0/1433539492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fded41087a0 con 0x7fdee4111f40 2024-09-21T08:02:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.696+0000 7fdee1e00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdec80b6800 0x7fdec80b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.697+0000 7fdee1e00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdec80b6800 0x7fdec80b8d10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009f40 tx=0x7fdedc0094d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:43.707+0000 7fdedaa00640 1 -- 172.21.15.84:0/1433539492 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fded40ce9e0 con 0x7fdee4111f40 2024-09-21T08:02:43.766 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:43.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:43 smithi191 ceph-mon[34667]: pgmap v754: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 13 op/s 2024-09-21T08:02:43.947 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:43 smithi084 ceph-mon[30411]: pgmap v754: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 13 op/s 2024-09-21T08:02:44.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:43 smithi162 ceph-mon[34833]: pgmap v754: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 13 op/s 2024-09-21T08:02:44.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.155+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdebc005580 con 0x7fdee4111f40 2024-09-21T08:02:44.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.156+0000 7fdedaa00640 1 -- 172.21.15.84:0/1433539492 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fded403be20 con 0x7fdee4111f40 2024-09-21T08:02:44.157 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:02:44.158 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:02:44.158 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:02:44.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.160+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdec80b6800 msgr2=0x7fdec80b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:44.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.160+0000 7fdecfe00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdec80b6800 0x7fdec80b8d10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009f40 tx=0x7fdedc0094d0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.160+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 msgr2=0x7fdee41a9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:44.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.160+0000 7fdecfe00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 0x7fdee41a9a10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fded402aa30 tx=0x7fded4003df0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 shutdown_connections 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fdec80b6800 0x7fdec80b8d10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdee411cc30 0x7fdee41aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdee4111f40 0x7fdee41a9a10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 --2- 172.21.15.84:0/1433539492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdee410a9e0 0x7fdee41a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 >> 172.21.15.84:0/1433539492 conn(0x7fdee4070ec0 msgr2=0x7fdee411d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 shutdown_connections 2024-09-21T08:02:44.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.161+0000 7fdecfe00640 1 -- 172.21.15.84:0/1433539492 wait complete. 2024-09-21T08:02:44.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 -- 172.21.15.84:0/2993854064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470103b80 msgr2=0x7fa470103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:44.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 --2- 172.21.15.84:0/2993854064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470103b80 0x7fa470103f90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa464009900 tx=0x7fa46402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 -- 172.21.15.84:0/2993854064 shutdown_connections 2024-09-21T08:02:44.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 --2- 172.21.15.84:0/2993854064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470109e10 0x7fa470110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 --2- 172.21.15.84:0/2993854064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4701094c0 0x7fa4701098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 --2- 172.21.15.84:0/2993854064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470103b80 0x7fa470103f90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 -- 172.21.15.84:0/2993854064 >> 172.21.15.84:0/2993854064 conn(0x7fa4700ff590 msgr2=0x7fa4701019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:44.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 -- 172.21.15.84:0/2993854064 shutdown_connections 2024-09-21T08:02:44.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.695+0000 7fa478200640 1 -- 172.21.15.84:0/2993854064 wait complete. 2024-09-21T08:02:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.696+0000 7fa478200640 1 Processor -- start 2024-09-21T08:02:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa478200640 1 -- start start 2024-09-21T08:02:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa478200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470103b80 0x7fa470075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa478200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4701094c0 0x7fa470075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa478200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470109e10 0x7fa470076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa478200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa470113b20 con 0x7fa470103b80 2024-09-21T08:02:44.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa478200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701139a0 con 0x7fa4701094c0 2024-09-21T08:02:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa478200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa470113ca0 con 0x7fa470109e10 2024-09-21T08:02:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa475800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470103b80 0x7fa470075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa476200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470109e10 0x7fa470076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa475800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470103b80 0x7fa470075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42168/0 (socket says 172.21.15.84:42168) 2024-09-21T08:02:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa475800640 1 -- 172.21.15.84:0/739576998 learned_addr learned my addr 172.21.15.84:0/739576998 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.697+0000 7fa474e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4701094c0 0x7fa470075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa476200640 1 -- 172.21.15.84:0/739576998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4701094c0 msgr2=0x7fa470075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa476200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4701094c0 0x7fa470075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa476200640 1 -- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470103b80 msgr2=0x7fa470075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa476200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470103b80 0x7fa470075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa476200640 1 -- 172.21.15.84:0/739576998 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4701a8700 con 0x7fa470109e10 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa476200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470109e10 0x7fa470076190 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa46800cab0 tx=0x7fa46800cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.698+0000 7fa46e000640 1 -- 172.21.15.84:0/739576998 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46800ae20 con 0x7fa470109e10 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.699+0000 7fa46e000640 1 -- 172.21.15.84:0/739576998 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa46800f900 con 0x7fa470109e10 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.699+0000 7fa46e000640 1 -- 172.21.15.84:0/739576998 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4680189f0 con 0x7fa470109e10 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.699+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4701a89f0 con 0x7fa470109e10 2024-09-21T08:02:44.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.699+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4701a8ee0 con 0x7fa470109e10 2024-09-21T08:02:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.700+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa470103f90 con 0x7fa470109e10 2024-09-21T08:02:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.703+0000 7fa46e000640 1 -- 172.21.15.84:0/739576998 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa46800f450 con 0x7fa470109e10 2024-09-21T08:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.704+0000 7fa46e000640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4580b6700 0x7fa4580b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.705+0000 7fa46e000640 1 -- 172.21.15.84:0/739576998 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fa4680e84f0 con 0x7fa470109e10 2024-09-21T08:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.705+0000 7fa475800640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4580b6700 0x7fa4580b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:44.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.705+0000 7fa46e000640 1 -- 172.21.15.84:0/739576998 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa46801d060 con 0x7fa470109e10 2024-09-21T08:02:44.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:44.705+0000 7fa475800640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4580b6700 0x7fa4580b8c10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa464005ec0 tx=0x7fa464005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:44.801 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:44 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1433539492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:44.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:44 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1433539492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:45.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:44 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1433539492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:45.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.108+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa470076a10 con 0x7fa470109e10 2024-09-21T08:02:45.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.109+0000 7fa46e000640 1 -- 172.21.15.84:0/739576998 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fa470076a10 con 0x7fa470109e10 2024-09-21T08:02:45.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:02:45.111 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:02:45.112 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:02:45.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4580b6700 msgr2=0x7fa4580b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4580b6700 0x7fa4580b8c10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa464005ec0 tx=0x7fa464005a20 comp rx=0 tx=0).stop 2024-09-21T08:02:45.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470109e10 msgr2=0x7fa470076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:45.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470109e10 0x7fa470076190 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa46800cab0 tx=0x7fa46800cf70 comp rx=0 tx=0).stop 2024-09-21T08:02:45.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 shutdown_connections 2024-09-21T08:02:45.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa4580b6700 0x7fa4580b8c10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa470109e10 0x7fa470076190 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4701094c0 0x7fa470075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 --2- 172.21.15.84:0/739576998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470103b80 0x7fa470075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.114+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 >> 172.21.15.84:0/739576998 conn(0x7fa4700ff590 msgr2=0x7fa470102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.115+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 shutdown_connections 2024-09-21T08:02:45.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:45.115+0000 7fa478200640 1 -- 172.21.15.84:0/739576998 wait complete. 2024-09-21T08:02:45.802 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T08:02:45.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:45 smithi191 ceph-mon[34667]: pgmap v755: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 61 op/s 2024-09-21T08:02:45.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:45 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/739576998' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:45 smithi162 ceph-mon[34833]: pgmap v755: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 61 op/s 2024-09-21T08:02:46.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:45 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/739576998' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:46.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:45 smithi084 ceph-mon[30411]: pgmap v755: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 61 op/s 2024-09-21T08:02:46.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:45 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/739576998' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:02:47.669 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24746 quiesce db --cancel --all' 2024-09-21T08:02:47.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24746 quiesce db --cancel --all 2024-09-21T08:02:47.745 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:47.778 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:47 smithi084 ceph-mon[30411]: pgmap v756: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 111 op/s 2024-09-21T08:02:48.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:47 smithi162 ceph-mon[34833]: pgmap v756: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 111 op/s 2024-09-21T08:02:48.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:47 smithi191 ceph-mon[34667]: pgmap v756: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 111 op/s 2024-09-21T08:02:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 -- 172.21.15.84:0/1608326114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c109c40 msgr2=0x7f870c110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 --2- 172.21.15.84:0/1608326114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c109c40 0x7f870c110470 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8704009900 tx=0x7f870402a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 -- 172.21.15.84:0/1608326114 shutdown_connections 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 --2- 172.21.15.84:0/1608326114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c109c40 0x7f870c110470 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 --2- 172.21.15.84:0/1608326114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f870c1092f0 0x7f870c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 --2- 172.21.15.84:0/1608326114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1039b0 0x7f870c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 -- 172.21.15.84:0/1608326114 >> 172.21.15.84:0/1608326114 conn(0x7f870c0ff440 msgr2=0x7f870c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 -- 172.21.15.84:0/1608326114 shutdown_connections 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.814+0000 7f8711200640 1 -- 172.21.15.84:0/1608326114 wait complete. 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.815+0000 7f8711200640 1 Processor -- start 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8711200640 1 -- start start 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8711200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c1039b0 0x7f870c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8711200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1092f0 0x7f870c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8711200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f870c109c40 0x7f870c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8711200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f870c113950 con 0x7f870c1092f0 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8711200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1137d0 con 0x7f870c1039b0 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8711200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f870c113ad0 con 0x7f870c109c40 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8702a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1092f0 0x7f870c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8702a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1092f0 0x7f870c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43160/0 (socket says 172.21.15.84:43160) 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f8702a00640 1 -- 172.21.15.84:0/4263144242 learned_addr learned my addr 172.21.15.84:0/4263144242 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f870b400640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c1039b0 0x7f870c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.816+0000 7f870be00640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f870c109c40 0x7f870c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8702a00640 1 -- 172.21.15.84:0/4263144242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f870c109c40 msgr2=0x7f870c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8702a00640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f870c109c40 0x7f870c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8702a00640 1 -- 172.21.15.84:0/4263144242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c1039b0 msgr2=0x7f870c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8702a00640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c1039b0 0x7f870c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8702a00640 1 -- 172.21.15.84:0/4263144242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c1a8640 con 0x7f870c1092f0 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8702a00640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1092f0 0x7f870c075c50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f86f400e9c0 tx=0x7f86f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8708c00640 1 -- 172.21.15.84:0/4263144242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f400ccc0 con 0x7f870c1092f0 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8708c00640 1 -- 172.21.15.84:0/4263144242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86f40054d0 con 0x7f870c1092f0 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870c1a8930 con 0x7f870c1092f0 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.817+0000 7f8708c00640 1 -- 172.21.15.84:0/4263144242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4010430 con 0x7f870c1092f0 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.818+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f870c1a8e20 con 0x7f870c1092f0 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 Processor -- start 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 -- start start 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c74070 0x560d4301af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4301b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c53390 0x560d4301b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560d42f91fb0 con 0x560d42c74070 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560d42f813e0 con 0x560d42c4b1b0 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f87193cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560d42f851f0 con 0x560d42c53390 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.821+0000 7f870be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c74070 0x560d4301af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c74070 0x560d4301af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43174/0 (socket says 172.21.15.84:43174) 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870be00640 1 -- 172.21.15.84:0/978013515 learned_addr learned my addr 172.21.15.84:0/978013515 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4301b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870b400640 1 -- 172.21.15.84:0/978013515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c53390 msgr2=0x560d4301b9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870b400640 1 --2- 172.21.15.84:0/978013515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c53390 0x560d4301b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870b400640 1 -- 172.21.15.84:0/978013515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c74070 msgr2=0x560d4301af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870b400640 1 --2- 172.21.15.84:0/978013515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c74070 0x560d4301af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870b400640 1 -- 172.21.15.84:0/978013515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d42f4bcd0 con 0x560d42c4b1b0 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f870b400640 1 --2- 172.21.15.84:0/978013515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4301b4b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f86fc005fd0 tx=0x7f86fc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b245ed2cd0975a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.822+0000 7f8700c00640 1 -- 172.21.15.84:0/978013515 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc003c30 con 0x560d42c4b1b0 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.823+0000 7f8700c00640 1 -- 172.21.15.84:0/978013515 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86fc003dd0 con 0x560d42c4b1b0 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.823+0000 7f8700c00640 1 -- 172.21.15.84:0/978013515 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00f9e0 con 0x560d42c4b1b0 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.823+0000 7f8708c00640 1 -- 172.21.15.84:0/4263144242 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f86f40105d0 con 0x7f870c1092f0 2024-09-21T08:02:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.823+0000 7f87193cf740 1 -- 172.21.15.84:0/978013515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 msgr2=0x560d4301b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.823+0000 7f87193cf740 1 --2- 172.21.15.84:0/978013515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4301b4b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f86fc005fd0 tx=0x7f86fc0118d0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.823+0000 7f87193cf740 1 -- 172.21.15.84:0/978013515 shutdown_connections 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.823+0000 7f87193cf740 1 --2- 172.21.15.84:0/978013515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c53390 0x560d4301b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.824+0000 7f87193cf740 1 --2- 172.21.15.84:0/978013515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4301b4b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.824+0000 7f87193cf740 1 --2- 172.21.15.84:0/978013515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c74070 0x560d4301af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.824+0000 7f87193cf740 1 -- 172.21.15.84:0/978013515 >> 172.21.15.84:0/978013515 conn(0x560d42c68460 msgr2=0x560d43018e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.824+0000 7f87193cf740 1 -- 172.21.15.84:0/978013515 shutdown_connections 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.824+0000 7f87193cf740 1 -- 172.21.15.84:0/978013515 wait complete. 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.825+0000 7f8708c00640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86f00b6590 0x7f86f00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.825+0000 7f87193cf740 1 -- start start 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.825+0000 7f8708c00640 1 -- 172.21.15.84:0/4263144242 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f86f40e7da0 con 0x7f870c1092f0 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.825+0000 7f870be00640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86f00b6590 0x7f86f00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.825+0000 7f87193cf740 1 Processor -- start 2024-09-21T08:02:49.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f87193cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c4b1b0 0x560d430267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f87193cf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43026ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f870be00640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86f00b6590 0x7f86f00b8aa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f870402a910 tx=0x7f8704005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f87193cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c74070 0x560d43032a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f87193cf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560d42de2700 con 0x560d42c53390 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f87193cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560d42f1c580 con 0x560d42c74070 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f87193cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560d43029750 con 0x560d42c4b1b0 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f87193cf740 10 client.0 _ll_register_callbacks cb 0x560d42f2c470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f8702a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43026ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f8702a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43026ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43184/0 (socket says 172.21.15.84:43184) 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f8702a00640 1 -- 172.21.15.84:0/2318367087 learned_addr learned my addr 172.21.15.84:0/2318367087 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f870b400640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c4b1b0 0x560d430267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.826+0000 7f870be00640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c74070 0x560d43032a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f8702a00640 1 -- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c4b1b0 msgr2=0x560d430267a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f8702a00640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c4b1b0 0x560d430267a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f8702a00640 1 -- 172.21.15.84:0/2318367087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c74070 msgr2=0x560d43032a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f8702a00640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c74070 0x560d43032a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f8702a00640 1 -- 172.21.15.84:0/2318367087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d42cdf650 con 0x560d42c53390 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f870be00640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c74070 0x560d43032a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f8702a00640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43026ce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f86f40e51c0 tx=0x7f86f40ad6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a86cd5c86265b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f86f9600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f86f9600640 1 -- 172.21.15.84:0/2318367087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40b2070 con 0x560d42c53390 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f86f9600640 1 -- 172.21.15.84:0/2318367087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f86f4005020 con 0x560d42c53390 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.827+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d42f1eb90 con 0x560d42c53390 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f86f9600640 1 -- 172.21.15.84:0/2318367087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86f4005680 con 0x560d42c53390 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 10 client.17982 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d42f39950 con 0x560d42c53390 2024-09-21T08:02:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f86f9600640 1 -- 172.21.15.84:0/2318367087 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560d42f1eb90 con 0x560d42c53390 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f86f9600640 1 -- 172.21.15.84:0/2318367087 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f86f40a91b0 con 0x560d42c53390 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 10 client.17982 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 10 client.17982 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 20 client.17982 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c329f0 0x560d43038840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 4 client.17982 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.828+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d42f93f00 con 0x560d42c329f0 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.829+0000 7f870b400640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c329f0 0x560d43038840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.829+0000 7f870b400640 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c329f0 0x560d43038840 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=64cbe02476a327b0 server_cookie=1a55794ed9c8da80 in_seq=0 out_seq=0 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.829+0000 7f86f9600640 10 client.17982 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f86f9600640 1 -- 172.21.15.84:0/2318367087 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d42f93f00 con 0x560d42c329f0 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f86f9600640 10 client.17982 handle_command_reply: tid=0 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 client.17982 shutdown 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 msgr2=0x560d43026ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43026ce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f86f40e51c0 tx=0x7f86f40ad6f0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 shutdown_connections 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c329f0 0x560d43038840 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c74070 0x560d43032a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43026ce0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 --2- 172.21.15.84:0/2318367087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c4b1b0 0x560d430267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 >> 172.21.15.84:0/2318367087 conn(0x560d42c68460 msgr2=0x560d43017600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f86f9600640 0 client.17982 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 shutdown_connections 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.830+0000 7f87193cf740 1 -- 172.21.15.84:0/2318367087 wait complete. 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.831+0000 7f87193cf740 20 client.17982 trim_cache size 0 max 16384 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.844+0000 7f87193cf740 1 Processor -- start 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f87193cf740 1 -- start start 2024-09-21T08:02:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f87193cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d43028790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f87193cf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43032970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f87193cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43032eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f87193cf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1b2f90 con 0x560d42c53390 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f87193cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1b4ad0 con 0x560d42c4b1b0 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f87193cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1b3660 con 0x560d42c74070 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f8702a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43032970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f8702a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43032970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43194/0 (socket says 172.21.15.84:43194) 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f8702a00640 1 -- 172.21.15.84:0/3113332401 learned_addr learned my addr 172.21.15.84:0/3113332401 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f870b400640 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d43028790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.845+0000 7f870be00640 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43032eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f870b400640 1 -- 172.21.15.84:0/3113332401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 msgr2=0x560d43032eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f870b400640 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43032eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f870b400640 1 -- 172.21.15.84:0/3113332401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 msgr2=0x560d43032970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:49.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f870b400640 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43032970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f870b400640 1 -- 172.21.15.84:0/3113332401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d430197f0 con 0x560d42c4b1b0 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f8702a00640 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43032970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f870b400640 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d43028790 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00f6c0 tx=0x7f86fc00f5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b724535287261665 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f86fbe00640 1 -- 172.21.15.84:0/3113332401 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc01f040 con 0x560d42c4b1b0 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f86fbe00640 1 -- 172.21.15.84:0/3113332401 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86fc009480 con 0x560d42c4b1b0 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.846+0000 7f86fbe00640 1 -- 172.21.15.84:0/3113332401 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc005040 con 0x560d42c4b1b0 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 -- 172.21.15.84:0/3113332401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 msgr2=0x560d43028790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d43028790 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00f6c0 tx=0x7f86fc00f5c0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 -- 172.21.15.84:0/3113332401 shutdown_connections 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43032eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d43032970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 --2- 172.21.15.84:0/3113332401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d43028790 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 -- 172.21.15.84:0/3113332401 >> 172.21.15.84:0/3113332401 conn(0x560d42c68460 msgr2=0x560d43025a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 -- 172.21.15.84:0/3113332401 shutdown_connections 2024-09-21T08:02:49.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.847+0000 7f87193cf740 1 -- 172.21.15.84:0/3113332401 wait complete. 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 -- start start 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 Processor -- start 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4302e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d4302ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43029990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1b4400 con 0x560d42c53390 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1b3d30 con 0x560d42c4b1b0 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1b0f90 con 0x560d42c74070 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.848+0000 7f87193cf740 10 client.0 _ll_register_callbacks cb 0x7f86f40a9720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4302e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f8702a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d4302ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4302e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35062/0 (socket says 172.21.15.84:35062) 2024-09-21T08:02:49.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 -- 172.21.15.84:0/959132232 learned_addr learned my addr 172.21.15.84:0/959132232 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870be00640 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43029990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 -- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 msgr2=0x560d43029990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43029990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 -- 172.21.15.84:0/959132232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 msgr2=0x560d4302ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d4302ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 -- 172.21.15.84:0/959132232 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d4302f710 con 0x560d42c4b1b0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f870b400640 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4302e9e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f86fc011910 tx=0x7f86fc009a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1579858a6476d137 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.849+0000 7f86f9600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.850+0000 7f86f9600640 1 -- 172.21.15.84:0/959132232 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00f6f0 con 0x560d42c4b1b0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.850+0000 7f86f9600640 1 -- 172.21.15.84:0/959132232 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f86fc02b040 con 0x560d42c4b1b0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.850+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86fc009480 con 0x560d42c4b1b0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.850+0000 7f86f9600640 1 -- 172.21.15.84:0/959132232 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86fc040050 con 0x560d42c4b1b0 2024-09-21T08:02:49.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.850+0000 7f87193cf740 10 client.28361 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.850+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d430a3700 con 0x560d42c4b1b0 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.850+0000 7f86f9600640 1 -- 172.21.15.84:0/959132232 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86fc009480 con 0x560d42c4b1b0 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f86f9600640 1 -- 172.21.15.84:0/959132232 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f86fc018070 con 0x560d42c4b1b0 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f87193cf740 10 client.28361 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f87193cf740 10 client.28361 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f87193cf740 20 client.28361 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f87193cf740 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c07da0 0x560d430a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f87193cf740 4 client.28361 mds_command: new command op to 24712 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 --> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d42f8f9b0 con 0x560d42c07da0 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.851+0000 7f8702a00640 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c07da0 0x560d430a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f8702a00640 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c07da0 0x560d430a5cc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=31df6136b951f55b server_cookie=1bafa321613faa3c in_seq=0 out_seq=0 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f86f9600640 10 client.28361 ms_handle_connect on v2:172.21.15.191:6834/1369621448 2024-09-21T08:02:49.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f86f9600640 1 -- 172.21.15.84:0/959132232 <== mds.4 v2:172.21.15.191:6834/1369621448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d42f8f9b0 con 0x560d42c07da0 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f86f9600640 10 client.28361 handle_command_reply: tid=0 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 client.28361 shutdown 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 msgr2=0x560d4302e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4302e9e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f86fc011910 tx=0x7f86fc009a70 comp rx=0 tx=0).stop 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 shutdown_connections 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:6834/1369621448,v1:172.21.15.191:6835/1369621448] conn(0x560d42c07da0 0x560d430a5cc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d42c74070 0x560d43029990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f86f9600640 0 client.28361 ms_handle_reset on v2:172.21.15.191:6834/1369621448 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560d42c53390 0x560d4302ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 --2- 172.21.15.84:0/959132232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d42c4b1b0 0x560d4302e9e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 >> 172.21.15.84:0/959132232 conn(0x560d42c68460 msgr2=0x560d43017fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 shutdown_connections 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 1 -- 172.21.15.84:0/959132232 wait complete. 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.852+0000 7f87193cf740 20 client.28361 trim_cache size 0 max 16384 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86f00b6590 msgr2=0x7f86f00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86f00b6590 0x7f86f00b8aa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f870402a910 tx=0x7f8704005a40 comp rx=0 tx=0).stop 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1092f0 msgr2=0x7f870c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1092f0 0x7f870c075c50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f86f400e9c0 tx=0x7f86f400ee80 comp rx=0 tx=0).stop 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 shutdown_connections 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f86f00b6590 0x7f86f00b8aa0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f870c109c40 0x7f870c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1092f0 0x7f870c075c50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 --2- 172.21.15.84:0/4263144242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f870c1039b0 0x7f870c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 >> 172.21.15.84:0/4263144242 conn(0x7f870c0ff440 msgr2=0x7f870c108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 shutdown_connections 2024-09-21T08:02:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:48.853+0000 7f8711200640 1 -- 172.21.15.84:0/4263144242 wait complete. 2024-09-21T08:02:49.787 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:49 smithi084 ceph-mon[30411]: pgmap v757: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 156 op/s 2024-09-21T08:02:49.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T08:02:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:50.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:49 smithi162 ceph-mon[34833]: pgmap v757: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 156 op/s 2024-09-21T08:02:50.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:49 smithi191 ceph-mon[34667]: pgmap v757: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 156 op/s 2024-09-21T08:02:50.688 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.699+0000 7f583f400640 1 -- 172.21.15.84:0/852139797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5838110140 msgr2=0x7f5838112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 --2- 172.21.15.84:0/852139797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5838110140 0x7f5838112560 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5830009ca0 tx=0x7f583002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 -- 172.21.15.84:0/852139797 shutdown_connections 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 --2- 172.21.15.84:0/852139797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5838110140 0x7f5838112560 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 --2- 172.21.15.84:0/852139797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58380760a0 0x7f583810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 --2- 172.21.15.84:0/852139797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5838075750 0x7f5838075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 -- 172.21.15.84:0/852139797 >> 172.21.15.84:0/852139797 conn(0x7f58380ff590 msgr2=0x7f58381019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 -- 172.21.15.84:0/852139797 shutdown_connections 2024-09-21T08:02:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.700+0000 7f583f400640 1 -- 172.21.15.84:0/852139797 wait complete. 2024-09-21T08:02:50.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.701+0000 7f583f400640 1 Processor -- start 2024-09-21T08:02:50.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583f400640 1 -- start start 2024-09-21T08:02:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5838075750 0x7f583819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58380760a0 0x7f583819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583f400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838110140 0x7f58381a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583f400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5838115d00 con 0x7f58380760a0 2024-09-21T08:02:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583f400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5838115b80 con 0x7f5838075750 2024-09-21T08:02:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583f400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5838115e80 con 0x7f5838110140 2024-09-21T08:02:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838110140 0x7f58381a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838110140 0x7f58381a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33534/0 (socket says 172.21.15.84:33534) 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583d400640 1 -- 172.21.15.84:0/1193435410 learned_addr learned my addr 172.21.15.84:0/1193435410 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f5837e00640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58380760a0 0x7f583819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.702+0000 7f583ca00640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5838075750 0x7f583819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.703+0000 7f583ca00640 1 -- 172.21.15.84:0/1193435410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838110140 msgr2=0x7f58381a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.703+0000 7f583ca00640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838110140 0x7f58381a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.703+0000 7f583ca00640 1 -- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58380760a0 msgr2=0x7f583819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.703+0000 7f583ca00640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58380760a0 0x7f583819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.703+0000 7f583ca00640 1 -- 172.21.15.84:0/1193435410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58381a2640 con 0x7f5838075750 2024-09-21T08:02:50.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.703+0000 7f583d400640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838110140 0x7f58381a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.703+0000 7f583ca00640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5838075750 0x7f583819c6d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f582c005fd0 tx=0x7f582c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.704+0000 7f5835600640 1 -- 172.21.15.84:0/1193435410 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c009c30 con 0x7f5838075750 2024-09-21T08:02:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.704+0000 7f5835600640 1 -- 172.21.15.84:0/1193435410 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f582c009dd0 con 0x7f5838075750 2024-09-21T08:02:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.704+0000 7f5835600640 1 -- 172.21.15.84:0/1193435410 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c010460 con 0x7f5838075750 2024-09-21T08:02:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.704+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58381a2930 con 0x7f5838075750 2024-09-21T08:02:50.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.704+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58381a9090 con 0x7f5838075750 2024-09-21T08:02:50.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.708+0000 7f5846061740 1 Processor -- start 2024-09-21T08:02:50.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.708+0000 7f5846061740 1 -- start start 2024-09-21T08:02:50.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5846061740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5846061740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5846061740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814810a5f0 0x5581484d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5846061740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558148448ff0 con 0x55814812b2d0 2024-09-21T08:02:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5846061740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558148438420 con 0x558148102410 2024-09-21T08:02:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5846061740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55814843c230 con 0x55814810a5f0 2024-09-21T08:02:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5835600640 1 -- 172.21.15.84:0/1193435410 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f582c003e80 con 0x7f5838075750 2024-09-21T08:02:50.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f583d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f583d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43232/0 (socket says 172.21.15.84:43232) 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f583d400640 1 -- 172.21.15.84:0/4014385657 learned_addr learned my addr 172.21.15.84:0/4014385657 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f5837e00640 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814810a5f0 0x5581484d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.709+0000 7f583ca00640 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f583d400640 1 -- 172.21.15.84:0/4014385657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814810a5f0 msgr2=0x5581484d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f583d400640 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814810a5f0 0x5581484d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f583d400640 1 -- 172.21.15.84:0/4014385657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 msgr2=0x5581484d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f583d400640 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f583d400640 1 -- 172.21.15.84:0/4014385657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581481968b0 con 0x55814812b2d0 2024-09-21T08:02:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f583d400640 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484d1290 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5830009930 tx=0x7f5830009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71412e3e1782d456 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f5829c00640 1 -- 172.21.15.84:0/4014385657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830031650 con 0x55814812b2d0 2024-09-21T08:02:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f5829c00640 1 -- 172.21.15.84:0/4014385657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5830036040 con 0x55814812b2d0 2024-09-21T08:02:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.710+0000 7f5829c00640 1 -- 172.21.15.84:0/4014385657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830004560 con 0x55814812b2d0 2024-09-21T08:02:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 -- 172.21.15.84:0/4014385657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 msgr2=0x5581484d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484d1290 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5830009930 tx=0x7f5830009960 comp rx=0 tx=0).stop 2024-09-21T08:02:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 -- 172.21.15.84:0/4014385657 shutdown_connections 2024-09-21T08:02:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814810a5f0 0x5581484d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484d17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 --2- 172.21.15.84:0/4014385657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484d1290 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 -- 172.21.15.84:0/4014385657 >> 172.21.15.84:0/4014385657 conn(0x55814811f6c0 msgr2=0x5581484cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:50.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 -- 172.21.15.84:0/4014385657 shutdown_connections 2024-09-21T08:02:50.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5846061740 1 -- 172.21.15.84:0/4014385657 wait complete. 2024-09-21T08:02:50.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.712+0000 7f5835600640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f58200b6690 0x7f58200b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.713+0000 7f5835600640 1 -- 172.21.15.84:0/1193435410 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f582c0e7930 con 0x7f5838075750 2024-09-21T08:02:50.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.713+0000 7f5837e00640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f58200b6690 0x7f58200b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.713+0000 7f5846061740 1 -- start start 2024-09-21T08:02:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.713+0000 7f5846061740 1 Processor -- start 2024-09-21T08:02:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5837e00640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f58200b6690 0x7f58200b8ba0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f58381116b0 tx=0x7f5824005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5846061740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558148102410 0x5581484dc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5846061740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484dce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5846061740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5846061740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558148299810 con 0x55814812b2d0 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5846061740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5581483d3550 con 0x55814810a5f0 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5846061740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5581484df890 con 0x558148102410 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5846061740 10 client.0 _ll_register_callbacks cb 0x5581483e3040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558148102410 0x5581484dc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583ca00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558148102410 0x5581484dc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33564/0 (socket says 172.21.15.84:33564) 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583ca00640 1 -- 172.21.15.84:0/3758491219 learned_addr learned my addr 172.21.15.84:0/3758491219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583d400640 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f5837e00640 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484dce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583ca00640 1 -- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 msgr2=0x5581484dce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583ca00640 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484dce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583ca00640 1 -- 172.21.15.84:0/3758491219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 msgr2=0x5581484dd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.714+0000 7f583ca00640 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484dd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f583ca00640 1 -- 172.21.15.84:0/3758491219 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581483c5200 con 0x558148102410 2024-09-21T08:02:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f583ca00640 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558148102410 0x5581484dc930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f582c000c00 tx=0x7f582c0a9410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5639e9468f49bad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f581e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f581e000640 1 -- 172.21.15.84:0/3758491219 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c020070 con 0x558148102410 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5830036040 con 0x558148102410 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f581e000640 1 -- 172.21.15.84:0/3758491219 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f582c0a7b40 con 0x558148102410 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f581e000640 1 -- 172.21.15.84:0/3758491219 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f582c0035f0 con 0x558148102410 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f5846061740 10 client.28390 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.715+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5581484eb5f0 con 0x558148102410 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f581e000640 1 -- 172.21.15.84:0/3758491219 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5830036040 con 0x558148102410 2024-09-21T08:02:50.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f581e000640 1 -- 172.21.15.84:0/3758491219 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f582c094b80 con 0x558148102410 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f5846061740 10 client.28390 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f5846061740 10 client.28390 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f5846061740 20 client.28390 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f5846061740 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480e9c50 0x5581484eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f5846061740 4 client.28390 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.716+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55814844af40 con 0x5581480e9c50 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.717+0000 7f5837e00640 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480e9c50 0x5581484eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.717+0000 7f5837e00640 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480e9c50 0x5581484eeb00 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f73372f9c8b8f9f8 server_cookie=48f1f312e5544dea in_seq=0 out_seq=0 2024-09-21T08:02:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.717+0000 7f581e000640 10 client.28390 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.718+0000 7f581e000640 1 -- 172.21.15.84:0/3758491219 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55814844af40 con 0x5581480e9c50 2024-09-21T08:02:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.718+0000 7f581e000640 10 client.28390 handle_command_reply: tid=0 2024-09-21T08:02:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.718+0000 7f5846061740 1 client.28390 shutdown 2024-09-21T08:02:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558148102410 msgr2=0x5581484dc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558148102410 0x5581484dc930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f582c000c00 tx=0x7f582c0a9410 comp rx=0 tx=0).stop 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 shutdown_connections 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814812b2d0 0x5581484dd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484dce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480e9c50 0x5581484eeb00 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 --2- 172.21.15.84:0/3758491219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558148102410 0x5581484dc930 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 >> 172.21.15.84:0/3758491219 conn(0x55814811f6c0 msgr2=0x5581484d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f581e000640 0 client.28390 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 shutdown_connections 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 1 -- 172.21.15.84:0/3758491219 wait complete. 2024-09-21T08:02:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.719+0000 7f5846061740 20 client.28390 trim_cache size 0 max 16384 2024-09-21T08:02:50.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.738+0000 7f5846061740 1 Processor -- start 2024-09-21T08:02:50.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.738+0000 7f5846061740 1 -- start start 2024-09-21T08:02:50.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f5846061740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558148102410 0x5581484da3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f5846061740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f5846061740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581484f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f5846061740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f58381b3060 con 0x558148102410 2024-09-21T08:02:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f5846061740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58381b4ba0 con 0x55814810a5f0 2024-09-21T08:02:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f5846061740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f58381b3730 con 0x55814812b2d0 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f583ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558148102410 0x5581484da3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f583ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558148102410 0x5581484da3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43254/0 (socket says 172.21.15.84:43254) 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f583ca00640 1 -- 172.21.15.84:0/3702447979 learned_addr learned my addr 172.21.15.84:0/3702447979 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f5837e00640 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.739+0000 7f583d400640 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581484f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f5837e00640 1 -- 172.21.15.84:0/3702447979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 msgr2=0x5581484f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f5837e00640 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581484f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f5837e00640 1 -- 172.21.15.84:0/3702447979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558148102410 msgr2=0x5581484da3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f5837e00640 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558148102410 0x5581484da3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f5837e00640 1 -- 172.21.15.84:0/3702447979 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581484ddbf0 con 0x55814810a5f0 2024-09-21T08:02:50.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f583ca00640 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558148102410 0x5581484da3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:50.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f5837e00640 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484d29d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x5581484ef230 tx=0x7f5824022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af757b98563784c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.740+0000 7f5829200640 1 -- 172.21.15.84:0/3702447979 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824005020 con 0x55814810a5f0 2024-09-21T08:02:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.741+0000 7f5829200640 1 -- 172.21.15.84:0/3702447979 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58240047a0 con 0x55814810a5f0 2024-09-21T08:02:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.741+0000 7f5829200640 1 -- 172.21.15.84:0/3702447979 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582402b6d0 con 0x55814810a5f0 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.741+0000 7f5846061740 1 -- 172.21.15.84:0/3702447979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 msgr2=0x5581484d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.741+0000 7f5846061740 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484d29d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x5581484ef230 tx=0x7f5824022040 comp rx=0 tx=0).stop 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 -- 172.21.15.84:0/3702447979 shutdown_connections 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581484f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55814810a5f0 0x5581484d29d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 --2- 172.21.15.84:0/3702447979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558148102410 0x5581484da3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 -- 172.21.15.84:0/3702447979 >> 172.21.15.84:0/3702447979 conn(0x55814811f6c0 msgr2=0x5581484d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 -- 172.21.15.84:0/3702447979 shutdown_connections 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 -- 172.21.15.84:0/3702447979 wait complete. 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 -- start start 2024-09-21T08:02:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.742+0000 7f5846061740 1 Processor -- start 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5846061740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484e0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5846061740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814810a5f0 0x5581484e0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5846061740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581485594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5846061740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f58381b44d0 con 0x55814810a5f0 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5846061740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58381b3e00 con 0x558148102410 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5846061740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f58381b1060 con 0x55814812b2d0 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5846061740 10 client.0 _ll_register_callbacks cb 0x7f582c0a9ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5837e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814810a5f0 0x5581484e0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f583ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5837e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814810a5f0 0x5581484e0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43270/0 (socket says 172.21.15.84:43270) 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f583d400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581485594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f5837e00640 1 -- 172.21.15.84:0/3803163636 learned_addr learned my addr 172.21.15.84:0/3803163636 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.743+0000 7f583ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484e0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35098/0 (socket says 172.21.15.84:35098) 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.744+0000 7f583d400640 1 -- 172.21.15.84:0/3803163636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 msgr2=0x5581484e0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.744+0000 7f583d400640 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484e0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.744+0000 7f583d400640 1 -- 172.21.15.84:0/3803163636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814810a5f0 msgr2=0x5581484e0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.744+0000 7f583d400640 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814810a5f0 0x5581484e0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.744+0000 7f583d400640 1 -- 172.21.15.84:0/3803163636 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558148559a30 con 0x55814812b2d0 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.744+0000 7f583d400640 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581485594c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5830004af0 tx=0x7f5830004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e48d01c3b8ad4995 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.744+0000 7f581e000640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.745+0000 7f581e000640 1 -- 172.21.15.84:0/3803163636 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830055030 con 0x55814812b2d0 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.745+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58240047a0 con 0x55814812b2d0 2024-09-21T08:02:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.745+0000 7f581e000640 1 -- 172.21.15.84:0/3803163636 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f583004b040 con 0x55814812b2d0 2024-09-21T08:02:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.745+0000 7f581e000640 1 -- 172.21.15.84:0/3803163636 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58300044a0 con 0x55814812b2d0 2024-09-21T08:02:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.745+0000 7f5846061740 10 client.28396 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.745+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55814855ad80 con 0x55814812b2d0 2024-09-21T08:02:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f581e000640 1 -- 172.21.15.84:0/3803163636 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58240047a0 con 0x55814812b2d0 2024-09-21T08:02:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f581e000640 1 -- 172.21.15.84:0/3803163636 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5830044070 con 0x55814812b2d0 2024-09-21T08:02:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f5846061740 10 client.28396 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f5846061740 10 client.28396 resolve_mds: validated gid 24746 aka daemon mds.b 2024-09-21T08:02:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f5846061740 20 client.28396 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f5846061740 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480bf000 0x55814855d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f5846061740 4 client.28396 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5581484469f0 con 0x5581480bf000 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.746+0000 7f583ca00640 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480bf000 0x55814855d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.747+0000 7f583ca00640 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480bf000 0x55814855d260 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44298e0ef7b609da server_cookie=3f8a4b85a2a02b36 in_seq=0 out_seq=0 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.747+0000 7f581e000640 10 client.28396 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.747+0000 7f581e000640 1 -- 172.21.15.84:0/3803163636 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5581484469f0 con 0x5581480bf000 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.747+0000 7f581e000640 10 client.28396 handle_command_reply: tid=0 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.747+0000 7f5846061740 1 client.28396 shutdown 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 msgr2=0x5581485594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581485594c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5830004af0 tx=0x7f5830004180 comp rx=0 tx=0).stop 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 shutdown_connections 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5581480bf000 0x55814855d260 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55814812b2d0 0x5581485594c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55814810a5f0 0x5581484e0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 --2- 172.21.15.84:0/3803163636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558148102410 0x5581484e0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 >> 172.21.15.84:0/3803163636 conn(0x55814811f6c0 msgr2=0x5581484d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f581e000640 0 client.28396 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 shutdown_connections 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 1 -- 172.21.15.84:0/3803163636 wait complete. 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.748+0000 7f5846061740 20 client.28396 trim_cache size 0 max 16384 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 29, 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24746, 2024-09-21T08:02:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 44, 2024-09-21T08:02:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": {} 2024-09-21T08:02:50.753 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:02:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f58200b6690 msgr2=0x7f58200b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f58200b6690 0x7f58200b8ba0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f58381116b0 tx=0x7f5824005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5838075750 msgr2=0x7f583819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5838075750 0x7f583819c6d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f582c005fd0 tx=0x7f582c00dde0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 shutdown_connections 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f58200b6690 0x7f58200b8ba0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838110140 0x7f58381a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58380760a0 0x7f583819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 --2- 172.21.15.84:0/1193435410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5838075750 0x7f583819c6d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 >> 172.21.15.84:0/1193435410 conn(0x7f58380ff590 msgr2=0x7f5838109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 shutdown_connections 2024-09-21T08:02:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:50.749+0000 7f583f400640 1 -- 172.21.15.84:0/1193435410 wait complete. 2024-09-21T08:02:51.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 -- 172.21.15.84:0/2478255939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae410b6d0 msgr2=0x7f0ae410bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/2478255939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae410b6d0 0x7f0ae410bae0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009900 tx=0x7f0acc02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 -- 172.21.15.84:0/2478255939 shutdown_connections 2024-09-21T08:02:51.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/2478255939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ae410c020 0x7f0ae4112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/2478255939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae410b6d0 0x7f0ae410bae0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/2478255939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae4105d90 0x7f0ae41061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 -- 172.21.15.84:0/2478255939 >> 172.21.15.84:0/2478255939 conn(0x7f0ae41017c0 msgr2=0x7f0ae4103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 -- 172.21.15.84:0/2478255939 shutdown_connections 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.405+0000 7f0ae8a00640 1 -- 172.21.15.84:0/2478255939 wait complete. 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.406+0000 7f0ae8a00640 1 Processor -- start 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.406+0000 7f0ae8a00640 1 -- start start 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae4105d90 0x7f0ae419c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae410b6d0 0x7f0ae419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae8a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ae410c020 0x7f0ae41a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae8a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4115ce0 con 0x7f0ae4105d90 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4115b60 con 0x7f0ae410b6d0 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae8a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4115e60 con 0x7f0ae410c020 2024-09-21T08:02:51.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae4105d90 0x7f0ae419c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae4105d90 0x7f0ae419c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43288/0 (socket says 172.21.15.84:43288) 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 -- 172.21.15.84:0/3728499076 learned_addr learned my addr 172.21.15.84:0/3728499076 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ad9400640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae410b6d0 0x7f0ae419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae2800640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ae410c020 0x7f0ae41a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 -- 172.21.15.84:0/3728499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ae410c020 msgr2=0x7f0ae41a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ae410c020 0x7f0ae41a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 -- 172.21.15.84:0/3728499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae410b6d0 msgr2=0x7f0ae419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae410b6d0 0x7f0ae419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.407+0000 7f0ae1e00640 1 -- 172.21.15.84:0/3728499076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae41a26e0 con 0x7f0ae4105d90 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.408+0000 7f0ad9400640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae410b6d0 0x7f0ae419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.408+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae4105d90 0x7f0ae419c770 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400e9f0 tx=0x7f0ad400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.408+0000 7f0adb400640 1 -- 172.21.15.84:0/3728499076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400cd80 con 0x7f0ae4105d90 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.408+0000 7f0adb400640 1 -- 172.21.15.84:0/3728499076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ad40108e0 con 0x7f0ae4105d90 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.408+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae41a29d0 con 0x7f0ae4105d90 2024-09-21T08:02:51.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.408+0000 7f0adb400640 1 -- 172.21.15.84:0/3728499076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4018980 con 0x7f0ae4105d90 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.408+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae41a9130 con 0x7f0ae4105d90 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 Processor -- start 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 -- start start 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0edbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0edc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0edc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5599e0e52fb0 con 0x5599e0b0c1b0 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5599e0e423e0 con 0x5599e0b14390 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0aef6be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5599e0e461f0 con 0x5599e0b35070 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0ae2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0edbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0ae2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0edbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33602/0 (socket says 172.21.15.84:33602) 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.412+0000 7f0ae2800640 1 -- 172.21.15.84:0/1749057935 learned_addr learned my addr 172.21.15.84:0/1749057935 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ad9400640 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0edc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ae2800640 1 -- 172.21.15.84:0/1749057935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 msgr2=0x5599e0edc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ae2800640 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0edc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ae2800640 1 -- 172.21.15.84:0/1749057935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 msgr2=0x5599e0edc2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ae2800640 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0edc2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ae2800640 1 -- 172.21.15.84:0/1749057935 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e0e0ccd0 con 0x5599e0b35070 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ae2800640 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0edbda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009f20 tx=0x7f0adc010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce5381fa5fe0c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0adb400640 1 -- 172.21.15.84:0/3728499076 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f0ad4010430 con 0x7f0ae4105d90 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ad3000640 1 -- 172.21.15.84:0/1749057935 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc011700 con 0x5599e0b35070 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.413+0000 7f0ad3000640 1 -- 172.21.15.84:0/1749057935 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0adc011d50 con 0x5599e0b35070 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0ad3000640 1 -- 172.21.15.84:0/1749057935 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc01cdb0 con 0x5599e0b35070 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0aef6be740 1 -- 172.21.15.84:0/1749057935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 msgr2=0x5599e0edbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0edbda0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009f20 tx=0x7f0adc010860 comp rx=0 tx=0).stop 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0aef6be740 1 -- 172.21.15.84:0/1749057935 shutdown_connections 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0edc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0edc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1749057935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0edbda0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.414+0000 7f0aef6be740 1 -- 172.21.15.84:0/1749057935 >> 172.21.15.84:0/1749057935 conn(0x5599e0b29460 msgr2=0x5599e0ed9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:51.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.415+0000 7f0aef6be740 1 -- 172.21.15.84:0/1749057935 shutdown_connections 2024-09-21T08:02:51.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.415+0000 7f0aef6be740 1 -- 172.21.15.84:0/1749057935 wait complete. 2024-09-21T08:02:51.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.415+0000 7f0adb400640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ac80b6590 0x7f0ac80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.415+0000 7f0adb400640 1 -- 172.21.15.84:0/3728499076 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f0ad40e7f40 con 0x7f0ae4105d90 2024-09-21T08:02:51.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.415+0000 7f0aef6be740 1 -- start start 2024-09-21T08:02:51.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:51 smithi084 ceph-mon[30411]: pgmap v758: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 26 KiB/s rd, 21 KiB/s wr, 204 op/s 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.415+0000 7f0ad9400640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ac80b6590 0x7f0ac80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.415+0000 7f0aef6be740 1 Processor -- start 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0ad9400640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ac80b6590 0x7f0ac80b8aa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009230 tx=0x7f0acc005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0ee75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0ee7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0ef38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0aef6be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5599e0ca3700 con 0x5599e0b0c1b0 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0aef6be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5599e0ddd580 con 0x5599e0b14390 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0aef6be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5599e0eea580 con 0x5599e0b35070 2024-09-21T08:02:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0aef6be740 10 client.0 _ll_register_callbacks cb 0x5599e0ded470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0ae1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0ee75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0ae1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0ee75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43292/0 (socket says 172.21.15.84:43292) 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0ae2800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0ef38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.416+0000 7f0ae1e00640 1 -- 172.21.15.84:0/2152302262 learned_addr learned my addr 172.21.15.84:0/2152302262 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ad9400640 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0ee7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ae2800640 1 -- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 msgr2=0x5599e0ee7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ae2800640 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0ee7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ae2800640 1 -- 172.21.15.84:0/2152302262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 msgr2=0x5599e0ee75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ae2800640 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0ee75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ae2800640 1 -- 172.21.15.84:0/2152302262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e0ba0650 con 0x5599e0b35070 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ae2800640 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0ef38a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0099a0 tx=0x7f0adc01c6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a23e439cc54013 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ac7400640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:51.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ac7400640 1 -- 172.21.15.84:0/2152302262 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc02b060 con 0x5599e0b35070 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0ac7400640 1 -- 172.21.15.84:0/2152302262 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f0adc004c50 con 0x5599e0b35070 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.417+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599e0ddfb90 con 0x5599e0b35070 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0ac7400640 1 -- 172.21.15.84:0/2152302262 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0adc032050 con 0x5599e0b35070 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 10 client.28408 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599e0dfa950 con 0x5599e0b35070 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0ac7400640 1 -- 172.21.15.84:0/2152302262 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5599e0ddfb90 con 0x5599e0b35070 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0ac7400640 1 -- 172.21.15.84:0/2152302262 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0adc005040 con 0x5599e0b35070 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 10 client.28408 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 10 client.28408 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 20 client.28408 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0af39f0 0x5599e0ef9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 4 client.28408 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.418+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599e0e54f00 con 0x5599e0af39f0 2024-09-21T08:02:51.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.419+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0af39f0 0x5599e0ef9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.419+0000 7f0ac7400640 10 client.28408 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.419+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0af39f0 0x5599e0ef9620 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2cbd5a9cd41b3993 server_cookie=618dbba73a005f95 in_seq=0 out_seq=0 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.420+0000 7f0ac7400640 1 -- 172.21.15.84:0/2152302262 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599e0e54f00 con 0x5599e0af39f0 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.420+0000 7f0ac7400640 10 client.28408 handle_command_reply: tid=0 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.420+0000 7f0aef6be740 1 client.28408 shutdown 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 msgr2=0x5599e0ef38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0ef38a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0099a0 tx=0x7f0adc01c6b0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 shutdown_connections 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0af39f0 0x5599e0ef9620 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0ef38a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0ee7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 --2- 172.21.15.84:0/2152302262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0ee75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0ac7400640 0 client.28408 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:02:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 >> 172.21.15.84:0/2152302262 conn(0x5599e0b29460 msgr2=0x5599e0edef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 shutdown_connections 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 1 -- 172.21.15.84:0/2152302262 wait complete. 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.421+0000 7f0aef6be740 20 client.28408 trim_cache size 0 max 16384 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 Processor -- start 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 -- start start 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b0c1b0 0x5599e0edf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b14390 0x5599e0ee47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b35070 0x5599e0ee4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b3150 con 0x5599e0b14390 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b4c90 con 0x5599e0b35070 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.435+0000 7f0aef6be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b3820 con 0x5599e0b0c1b0 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ad9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b14390 0x5599e0ee47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae1e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b0c1b0 0x5599e0edf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ad9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b14390 0x5599e0ee47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43306/0 (socket says 172.21.15.84:43306) 2024-09-21T08:02:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ad9400640 1 -- 172.21.15.84:0/3973642679 learned_addr learned my addr 172.21.15.84:0/3973642679 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae2800640 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b35070 0x5599e0ee4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae1e00640 1 -- 172.21.15.84:0/3973642679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b35070 msgr2=0x5599e0ee4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b35070 0x5599e0ee4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae1e00640 1 -- 172.21.15.84:0/3973642679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b14390 msgr2=0x5599e0ee47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b14390 0x5599e0ee47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae1e00640 1 -- 172.21.15.84:0/3973642679 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e0eddc50 con 0x5599e0b0c1b0 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.436+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b0c1b0 0x5599e0edf5b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40e5900 tx=0x7f0ad40d1040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4bde8280cecd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0ad2600640 1 -- 172.21.15.84:0/3973642679 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40ad510 con 0x5599e0b0c1b0 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0ad2600640 1 -- 172.21.15.84:0/3973642679 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ad40ae100 con 0x5599e0b0c1b0 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0ad2600640 1 -- 172.21.15.84:0/3973642679 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40e5710 con 0x5599e0b0c1b0 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0aef6be740 1 -- 172.21.15.84:0/3973642679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b0c1b0 msgr2=0x5599e0edf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0aef6be740 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b0c1b0 0x5599e0edf5b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40e5900 tx=0x7f0ad40d1040 comp rx=0 tx=0).stop 2024-09-21T08:02:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0aef6be740 1 -- 172.21.15.84:0/3973642679 shutdown_connections 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0aef6be740 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b35070 0x5599e0ee4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0aef6be740 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b14390 0x5599e0ee47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0aef6be740 1 --2- 172.21.15.84:0/3973642679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b0c1b0 0x5599e0edf5b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.437+0000 7f0aef6be740 1 -- 172.21.15.84:0/3973642679 >> 172.21.15.84:0/3973642679 conn(0x5599e0b29460 msgr2=0x5599e0edeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.438+0000 7f0aef6be740 1 -- 172.21.15.84:0/3973642679 shutdown_connections 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.438+0000 7f0aef6be740 1 -- 172.21.15.84:0/3973642679 wait complete. 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.438+0000 7f0aef6be740 1 -- start start 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.438+0000 7f0aef6be740 1 Processor -- start 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0efa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0eface0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0aef6be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0efb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0aef6be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b45c0 con 0x5599e0b0c1b0 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0aef6be740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b3ef0 con 0x5599e0b14390 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0aef6be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41b1150 con 0x5599e0b35070 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0aef6be740 10 client.0 _ll_register_callbacks cb 0x7f0adc01ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0efa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0efa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43316/0 (socket says 172.21.15.84:43316) 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae1e00640 1 -- 172.21.15.84:0/1045639915 learned_addr learned my addr 172.21.15.84:0/1045639915 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae2800640 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0efb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ad9400640 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0eface0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae1e00640 1 -- 172.21.15.84:0/1045639915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 msgr2=0x5599e0efb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0efb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae1e00640 1 -- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 msgr2=0x5599e0eface0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.439+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0eface0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0ae1e00640 1 -- 172.21.15.84:0/1045639915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e0edfaf0 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0ae1e00640 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0efa7a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4000c00 tx=0x7f0ad40e55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe320ef11828681 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0ac7400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0ac7400640 1 -- 172.21.15.84:0/1045639915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40b22d0 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0ac7400640 1 -- 172.21.15.84:0/1045639915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f0ad40c3bb0 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ad40ae100 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0ac7400640 1 -- 172.21.15.84:0/1045639915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ad40e56f0 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0aef6be740 10 client.18021 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.440+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599e0f63fb0 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0ac7400640 1 -- 172.21.15.84:0/1045639915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ad4070030 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0ac7400640 1 -- 172.21.15.84:0/1045639915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0ad40a9350 con 0x5599e0b0c1b0 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0aef6be740 10 client.18021 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0aef6be740 10 client.18021 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0aef6be740 20 client.18021 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:51.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0ac8da0 0x5599e0f66680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0aef6be740 4 client.18021 mds_command: new command op to 24719 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 --> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5599e0e509b0 con 0x5599e0ac8da0 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.441+0000 7f0ad9400640 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0ac8da0 0x5599e0f66680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0ad9400640 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0ac8da0 0x5599e0f66680 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f56978ace94136e0 server_cookie=c08a265cd993c239 in_seq=0 out_seq=0 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0ac7400640 10 client.18021 ms_handle_connect on v2:172.21.15.162:6836/1733531268 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0ac7400640 1 -- 172.21.15.84:0/1045639915 <== mds.3 v2:172.21.15.162:6836/1733531268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5599e0e509b0 con 0x5599e0ac8da0 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0ac7400640 10 client.18021 handle_command_reply: tid=0 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0aef6be740 1 client.18021 shutdown 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 msgr2=0x5599e0efa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0efa7a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4000c00 tx=0x7f0ad40e55f0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 shutdown_connections 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:6836/1733531268,v1:172.21.15.162:6837/1733531268] conn(0x5599e0ac8da0 0x5599e0f66680 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.442+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5599e0b35070 0x5599e0efb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.443+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599e0b14390 0x5599e0eface0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.443+0000 7f0aef6be740 1 --2- 172.21.15.84:0/1045639915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599e0b0c1b0 0x5599e0efa7a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.443+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 >> 172.21.15.84:0/1045639915 conn(0x5599e0b29460 msgr2=0x5599e0ee8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.443+0000 7f0ac7400640 0 client.18021 ms_handle_reset on v2:172.21.15.162:6836/1733531268 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.443+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 shutdown_connections 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.443+0000 7f0aef6be740 1 -- 172.21.15.84:0/1045639915 wait complete. 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.443+0000 7f0aef6be740 20 client.18021 trim_cache size 0 max 16384 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:02:51.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ac80b6590 msgr2=0x7f0ac80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ac80b6590 0x7f0ac80b8aa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009230 tx=0x7f0acc005d50 comp rx=0 tx=0).stop 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae4105d90 msgr2=0x7f0ae419c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae4105d90 0x7f0ae419c770 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400e9f0 tx=0x7f0ad400eeb0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 shutdown_connections 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f0ac80b6590 0x7f0ac80b8aa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ae410c020 0x7f0ae41a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae410b6d0 0x7f0ae419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 --2- 172.21.15.84:0/3728499076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ae4105d90 0x7f0ae419c770 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 >> 172.21.15.84:0/3728499076 conn(0x7f0ae41017c0 msgr2=0x7f0ae4108d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 shutdown_connections 2024-09-21T08:02:51.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:51.444+0000 7f0ae8a00640 1 -- 172.21.15.84:0/3728499076 wait complete. 2024-09-21T08:02:52.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:51 smithi162 ceph-mon[34833]: pgmap v758: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 26 KiB/s rd, 21 KiB/s wr, 204 op/s 2024-09-21T08:02:52.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:51 smithi191 ceph-mon[34667]: pgmap v758: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 26 KiB/s rd, 21 KiB/s wr, 204 op/s 2024-09-21T08:02:52.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T08:02:53.633 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T08:02:53.633 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T08:02:53.649 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T08:02:53.664 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T08:02:53.805 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T08:02:53.805 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T08:02:53.805 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T08:02:53.805 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T08:02:53.806 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:53.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:53 smithi084 ceph-mon[30411]: pgmap v759: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 226 op/s 2024-09-21T08:02:53.888 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T08:02:53.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T08:02:54.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:53 smithi162 ceph-mon[34833]: pgmap v759: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 226 op/s 2024-09-21T08:02:54.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:53 smithi191 ceph-mon[34667]: pgmap v759: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 226 op/s 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 -- 172.21.15.84:0/2821492956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 msgr2=0x7f8b2c10fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 --2- 172.21.15.84:0/2821492956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c10fc30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009900 tx=0x7f8b1402a480 comp rx=0 tx=0).stop 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 -- 172.21.15.84:0/2821492956 shutdown_connections 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 --2- 172.21.15.84:0/2821492956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b2c110170 0x7f8b2c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 --2- 172.21.15.84:0/2821492956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c10fc30 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 --2- 172.21.15.84:0/2821492956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b2c1025c0 0x7f8b2c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 -- 172.21.15.84:0/2821492956 >> 172.21.15.84:0/2821492956 conn(0x7f8b2c0fe420 msgr2=0x7f8b2c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 -- 172.21.15.84:0/2821492956 shutdown_connections 2024-09-21T08:02:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.204+0000 7f8b33800640 1 -- 172.21.15.84:0/2821492956 wait complete. 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.205+0000 7f8b33800640 1 Processor -- start 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.205+0000 7f8b33800640 1 -- start start 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.205+0000 7f8b33800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b2c1025c0 0x7f8b2c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.205+0000 7f8b33800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b33800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b2c110170 0x7f8b2c1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b33800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c115c10 con 0x7f8b2c102f10 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b33800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c115a90 con 0x7f8b2c1025c0 2024-09-21T08:02:54.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b33800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c115d90 con 0x7f8b2c110170 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c19cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43336/0 (socket says 172.21.15.84:43336) 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 -- 172.21.15.84:0/143828628 learned_addr learned my addr 172.21.15.84:0/143828628 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b31800640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b2c110170 0x7f8b2c1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b30e00640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b2c1025c0 0x7f8b2c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 -- 172.21.15.84:0/143828628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b2c110170 msgr2=0x7f8b2c1a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b2c110170 0x7f8b2c1a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 -- 172.21.15.84:0/143828628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b2c1025c0 msgr2=0x7f8b2c19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b2c1025c0 0x7f8b2c19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.206+0000 7f8b23e00640 1 -- 172.21.15.84:0/143828628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c1a25a0 con 0x7f8b2c102f10 2024-09-21T08:02:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.207+0000 7f8b23e00640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c19cc10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8b14005940 tx=0x7f8b140040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.207+0000 7f8b2a000640 1 -- 172.21.15.84:0/143828628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1403f030 con 0x7f8b2c102f10 2024-09-21T08:02:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.207+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c1a2830 con 0x7f8b2c102f10 2024-09-21T08:02:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.207+0000 7f8b2a000640 1 -- 172.21.15.84:0/143828628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b140044c0 con 0x7f8b2c102f10 2024-09-21T08:02:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.207+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c1a9020 con 0x7f8b2c102f10 2024-09-21T08:02:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.207+0000 7f8b2a000640 1 -- 172.21.15.84:0/143828628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14049060 con 0x7f8b2c102f10 2024-09-21T08:02:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.208+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2c1029d0 con 0x7f8b2c102f10 2024-09-21T08:02:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.210+0000 7f8b2a000640 1 -- 172.21.15.84:0/143828628 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8b14042030 con 0x7f8b2c102f10 2024-09-21T08:02:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.213+0000 7f8b2a000640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b100b6680 0x7f8b100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.213+0000 7f8b2a000640 1 -- 172.21.15.84:0/143828628 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f8b14108220 con 0x7f8b2c102f10 2024-09-21T08:02:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.213+0000 7f8b30e00640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b100b6680 0x7f8b100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.214+0000 7f8b30e00640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b100b6680 0x7f8b100b8b90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009bd0 tx=0x7f8b1c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.217+0000 7f8b2a000640 1 -- 172.21.15.84:0/143828628 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b140d2760 con 0x7f8b2c102f10 2024-09-21T08:02:54.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.443+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8b2c112310 con 0x7f8b100b6680 2024-09-21T08:02:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.451+0000 7f8b2a000640 1 -- 172.21.15.84:0/143828628 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f8b2c112310 con 0x7f8b100b6680 2024-09-21T08:02:54.453 INFO:teuthology.orchestra.run.smithi084.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T07:50:44", "first": "2024-09-21T07:51:01", "last": "2024-09-21T08:02:00", "last_pruned": "2024-09-21T08:02:01", "created_count": 12, "pruned_count": 6, "active": true} 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b100b6680 msgr2=0x7f8b100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b100b6680 0x7f8b100b8b90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009bd0 tx=0x7f8b1c005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 msgr2=0x7f8b2c19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c19cc10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8b14005940 tx=0x7f8b140040c0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 shutdown_connections 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8b100b6680 0x7f8b100b8b90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b2c110170 0x7f8b2c1a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b2c102f10 0x7f8b2c19cc10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 --2- 172.21.15.84:0/143828628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b2c1025c0 0x7f8b2c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 >> 172.21.15.84:0/143828628 conn(0x7f8b2c0fe420 msgr2=0x7f8b2c101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 shutdown_connections 2024-09-21T08:02:54.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.455+0000 7f8b33800640 1 -- 172.21.15.84:0/143828628 wait complete. 2024-09-21T08:02:54.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.424+0000 7fd4f6a00640 1 -- 172.21.15.84:0/2200139164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0114280 msgr2=0x7fd4f0116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.424+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/2200139164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0114280 0x7fd4f0116750 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ca0 tx=0x7fd4e802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.425+0000 7fd4f6a00640 1 -- 172.21.15.84:0/2200139164 shutdown_connections 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.425+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/2200139164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0114280 0x7fd4f0116750 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.425+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/2200139164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f0075dd0 0x7fd4f00761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.425+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/2200139164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4f0077380 0x7fd4f00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.425+0000 7fd4f6a00640 1 -- 172.21.15.84:0/2200139164 >> 172.21.15.84:0/2200139164 conn(0x7fd4f00ff440 msgr2=0x7fd4f0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.425+0000 7fd4f6a00640 1 -- 172.21.15.84:0/2200139164 shutdown_connections 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.425+0000 7fd4f6a00640 1 -- 172.21.15.84:0/2200139164 wait complete. 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.426+0000 7fd4f6a00640 1 Processor -- start 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.426+0000 7fd4f6a00640 1 -- start start 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0075dd0 0x7fd4f01a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f0077380 0x7fd4f01a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4f0114280 0x7fd4f01a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f6a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0119f10 con 0x7fd4f0075dd0 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f6a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0119d90 con 0x7fd4f0077380 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f6a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f011a090 con 0x7fd4f0114280 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0075dd0 0x7fd4f01a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0075dd0 0x7fd4f01a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43350/0 (socket says 172.21.15.84:43350) 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f5600640 1 -- 172.21.15.84:0/809430407 learned_addr learned my addr 172.21.15.84:0/809430407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f6000640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4f0114280 0x7fd4f01a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.427+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f0077380 0x7fd4f01a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.428+0000 7fd4f4c00640 1 -- 172.21.15.84:0/809430407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4f0114280 msgr2=0x7fd4f01a60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.428+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4f0114280 0x7fd4f01a60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.428+0000 7fd4f4c00640 1 -- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0075dd0 msgr2=0x7fd4f01a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.428+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0075dd0 0x7fd4f01a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.428+0000 7fd4f4c00640 1 -- 172.21.15.84:0/809430407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f01a6810 con 0x7fd4f0077380 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.428+0000 7fd4f5600640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0075dd0 0x7fd4f01a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.428+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f0077380 0x7fd4f01a0e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00e9c0 tx=0x7fd4dc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.429+0000 7fd4ee000640 1 -- 172.21.15.84:0/809430407 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00ccc0 con 0x7fd4f0077380 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.429+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f01a6b00 con 0x7fd4f0077380 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.429+0000 7fd4ee000640 1 -- 172.21.15.84:0/809430407 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4dc0108e0 con 0x7fd4f0077380 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.429+0000 7fd4ee000640 1 -- 172.21.15.84:0/809430407 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0187a0 con 0x7fd4f0077380 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.429+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f01ad260 con 0x7fd4f0077380 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.432+0000 7fd4fecae740 1 Processor -- start 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.432+0000 7fd4fecae740 1 -- start start 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.432+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a06d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a07270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a077b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4fecae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5637b897dfb0 con 0x5637b86371b0 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4fecae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5637b896d3e0 con 0x5637b863f390 2024-09-21T08:02:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4fecae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5637b89711f0 con 0x5637b8660070 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f6000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a06d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a07270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f6000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a06d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33674/0 (socket says 172.21.15.84:33674) 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f6000640 1 -- 172.21.15.84:0/1960158865 learned_addr learned my addr 172.21.15.84:0/1960158865 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4ee000640 1 -- 172.21.15.84:0/809430407 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fd4dc010430 con 0x7fd4f0077380 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f6000640 1 -- 172.21.15.84:0/1960158865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 msgr2=0x5637b8a077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f6000640 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f6000640 1 -- 172.21.15.84:0/1960158865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 msgr2=0x5637b8a07270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.433+0000 7fd4f6000640 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a07270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.434+0000 7fd4f6000640 1 -- 172.21.15.84:0/1960158865 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b8937cd0 con 0x5637b8660070 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.434+0000 7fd4f5600640 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a07270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.434+0000 7fd4f6000640 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a06d30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ca0 tx=0x7fd4e8009430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1842a0691b5873e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.434+0000 7fd4e2600640 1 -- 172.21.15.84:0/1960158865 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8031cf0 con 0x5637b8660070 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.434+0000 7fd4e2600640 1 -- 172.21.15.84:0/1960158865 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4e8036030 con 0x5637b8660070 2024-09-21T08:02:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.434+0000 7fd4e2600640 1 -- 172.21.15.84:0/1960158865 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8004280 con 0x5637b8660070 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.435+0000 7fd4fecae740 1 -- 172.21.15.84:0/1960158865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 msgr2=0x5637b8a06d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.435+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a06d30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ca0 tx=0x7fd4e8009430 comp rx=0 tx=0).stop 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.435+0000 7fd4fecae740 1 -- 172.21.15.84:0/1960158865 shutdown_connections 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.435+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.435+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a07270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.435+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1960158865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a06d30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.435+0000 7fd4fecae740 1 -- 172.21.15.84:0/1960158865 >> 172.21.15.84:0/1960158865 conn(0x5637b8654460 msgr2=0x5637b8a04bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.436+0000 7fd4fecae740 1 -- 172.21.15.84:0/1960158865 shutdown_connections 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.436+0000 7fd4fecae740 1 -- 172.21.15.84:0/1960158865 wait complete. 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.436+0000 7fd4ee000640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4d80b6690 0x7fd4d80b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.436+0000 7fd4fecae740 1 -- start start 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.436+0000 7fd4fecae740 1 Processor -- start 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.436+0000 7fd4ee000640 1 -- 172.21.15.84:0/809430407 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fd4dc0e7dd0 con 0x7fd4f0077380 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.436+0000 7fd4f6000640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4d80b6690 0x7fd4d80b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a128a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a12de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a1e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4fecae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5637b87ce700 con 0x5637b86371b0 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4fecae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5637b8908580 con 0x5637b863f390 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4fecae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5637b8a15330 con 0x5637b8660070 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4fecae740 10 client.0 _ll_register_callbacks cb 0x5637b8918470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4f6000640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4d80b6690 0x7fd4d80b8ba0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8003c80 tx=0x7fd4e8005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4f5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4f5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a128a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43358/0 (socket says 172.21.15.84:43358) 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4f5600640 1 -- 172.21.15.84:0/495134558 learned_addr learned my addr 172.21.15.84:0/495134558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.437+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a12de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f6000640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a1e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f4c00640 1 -- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 msgr2=0x5637b8a1e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a1e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f4c00640 1 -- 172.21.15.84:0/495134558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 msgr2=0x5637b8a128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a128a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f4c00640 1 -- 172.21.15.84:0/495134558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b86cb650 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f5600640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a12de0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0e5130 tx=0x7fd4dc0ad050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b0f79debdd6b4df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4d6a00640 1 -- 172.21.15.84:0/495134558 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0aed60 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4d6a00640 1 -- 172.21.15.84:0/495134558 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fd4dc0a9230 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.438+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637b890ab90 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4d6a00640 1 -- 172.21.15.84:0/495134558 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4dc0ad3f0 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 10 client.28412 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637b8925950 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4d6a00640 1 -- 172.21.15.84:0/495134558 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5637b890ab90 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4d6a00640 1 -- 172.21.15.84:0/495134558 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd4dc0b34a0 con 0x5637b863f390 2024-09-21T08:02:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 10 client.28412 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 10 client.28412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 20 client.28412 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b861e9f0 0x5637b8a245f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 4 client.28412 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.439+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637b897ff00 con 0x5637b861e9f0 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.440+0000 7fd4f5600640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b861e9f0 0x5637b8a245f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.441+0000 7fd4f5600640 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b861e9f0 0x5637b8a245f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=abc46ca7aa63dc4c server_cookie=299b683b0d430008 in_seq=0 out_seq=0 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.441+0000 7fd4d6a00640 10 client.28412 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.441+0000 7fd4d6a00640 1 -- 172.21.15.84:0/495134558 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637b897ff00 con 0x5637b861e9f0 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4d6a00640 10 client.28412 handle_command_reply: tid=0 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 client.28412 shutdown 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 msgr2=0x5637b8a12de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a12de0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0e5130 tx=0x7fd4dc0ad050 comp rx=0 tx=0).stop 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 shutdown_connections 2024-09-21T08:02:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b861e9f0 0x5637b8a245f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a1e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b863f390 0x5637b8a12de0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 --2- 172.21.15.84:0/495134558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 >> 172.21.15.84:0/495134558 conn(0x5637b8654460 msgr2=0x5637b8a09ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4d6a00640 0 client.28412 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 shutdown_connections 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 1 -- 172.21.15.84:0/495134558 wait complete. 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.442+0000 7fd4fecae740 20 client.28412 trim_cache size 0 max 16384 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 Processor -- start 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 -- start start 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a04c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b863f390 0x5637b8a0bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b8660070 0x5637b8a0c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b7230 con 0x5637b86371b0 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b8d70 con 0x5637b8660070 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.460+0000 7fd4fecae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b7900 con 0x5637b863f390 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a04c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a04c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43362/0 (socket says 172.21.15.84:43362) 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f5600640 1 -- 172.21.15.84:0/3685671911 learned_addr learned my addr 172.21.15.84:0/3685671911 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f6000640 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b8660070 0x5637b8a0c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b863f390 0x5637b8a0bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f4c00640 1 -- 172.21.15.84:0/3685671911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b8660070 msgr2=0x5637b8a0c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b8660070 0x5637b8a0c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f4c00640 1 -- 172.21.15.84:0/3685671911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 msgr2=0x5637b8a04c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a04c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f4c00640 1 -- 172.21.15.84:0/3685671911 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b8a09250 con 0x5637b863f390 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.461+0000 7fd4f5600640 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a04c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.462+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b863f390 0x5637b8a0bfb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0b3810 tx=0x7fd4dc0ad180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65095f3c0072eb3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.462+0000 7fd4e1c00640 1 -- 172.21.15.84:0/3685671911 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0b7250 con 0x5637b863f390 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.462+0000 7fd4e1c00640 1 -- 172.21.15.84:0/3685671911 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4dc0aeb60 con 0x5637b863f390 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.462+0000 7fd4e1c00640 1 -- 172.21.15.84:0/3685671911 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0a9230 con 0x5637b863f390 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 -- 172.21.15.84:0/3685671911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b863f390 msgr2=0x5637b8a0bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b863f390 0x5637b8a0bfb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0b3810 tx=0x7fd4dc0ad180 comp rx=0 tx=0).stop 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 -- 172.21.15.84:0/3685671911 shutdown_connections 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b8660070 0x5637b8a0c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b863f390 0x5637b8a0bfb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 --2- 172.21.15.84:0/3685671911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b86371b0 0x5637b8a04c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 -- 172.21.15.84:0/3685671911 >> 172.21.15.84:0/3685671911 conn(0x5637b8654460 msgr2=0x5637b8a044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 -- 172.21.15.84:0/3685671911 shutdown_connections 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.463+0000 7fd4fecae740 1 -- 172.21.15.84:0/3685671911 wait complete. 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.464+0000 7fd4fecae740 1 -- start start 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.464+0000 7fd4fecae740 1 Processor -- start 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.464+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b86371b0 0x5637b8a1ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b863f390 0x5637b8a29840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4fecae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a29d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4fecae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b86a0 con 0x5637b863f390 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4fecae740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b7fd0 con 0x5637b86371b0 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4fecae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b5230 con 0x5637b8660070 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4fecae740 10 client.0 _ll_register_callbacks cb 0x7fd4dc0a9830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b863f390 0x5637b8a29840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b863f390 0x5637b8a29840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43364/0 (socket says 172.21.15.84:43364) 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 -- 172.21.15.84:0/1083792662 learned_addr learned my addr 172.21.15.84:0/1083792662 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f5600640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b86371b0 0x5637b8a1ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f6000640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a29d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 -- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 msgr2=0x5637b8a29d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a29d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 -- 172.21.15.84:0/1083792662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b86371b0 msgr2=0x5637b8a1ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b86371b0 0x5637b8a1ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f4c00640 1 -- 172.21.15.84:0/1083792662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b8a2a370 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.465+0000 7fd4f5600640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b86371b0 0x5637b8a1ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4f4c00640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b863f390 0x5637b8a29840 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0aab50 tx=0x7fd4dc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120417cb4d5c5775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4d6a00640 1 -- 172.21.15.84:0/1083792662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0c7020 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4d6a00640 1 -- 172.21.15.84:0/1083792662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fd4dc0ac5b0 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4dc0aeb60 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4d6a00640 1 -- 172.21.15.84:0/1083792662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd4dc0b2310 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4fecae740 10 client.18045 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.466+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637b8a173d0 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4d6a00640 1 -- 172.21.15.84:0/1083792662 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4dc0aeb60 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4d6a00640 1 -- 172.21.15.84:0/1083792662 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd4dc0ad8e0 con 0x5637b863f390 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4fecae740 10 client.18045 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4fecae740 10 client.18045 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T08:02:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4fecae740 20 client.18045 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b85f3da0 0x5637b8a91230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4fecae740 4 client.18045 mds_command: new command op to 24724 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 --> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637b897b9b0 con 0x5637b85f3da0 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.467+0000 7fd4f5600640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b85f3da0 0x5637b8a91230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.468+0000 7fd4f5600640 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b85f3da0 0x5637b8a91230 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bcd4bcb372113545 server_cookie=1117ed672f66a7f5 in_seq=0 out_seq=0 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.468+0000 7fd4d6a00640 10 client.18045 ms_handle_connect on v2:172.21.15.191:6836/2311233520 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.468+0000 7fd4d6a00640 1 -- 172.21.15.84:0/1083792662 <== mds.2 v2:172.21.15.191:6836/2311233520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637b897b9b0 con 0x5637b85f3da0 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.468+0000 7fd4d6a00640 10 client.18045 handle_command_reply: tid=0 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.468+0000 7fd4fecae740 1 client.18045 shutdown 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b863f390 msgr2=0x5637b8a29840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b863f390 0x5637b8a29840 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0aab50 tx=0x7fd4dc00ce60 comp rx=0 tx=0).stop 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 shutdown_connections 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:6836/2311233520,v1:172.21.15.191:6837/2311233520] conn(0x5637b85f3da0 0x5637b8a91230 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5637b8660070 0x5637b8a29d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5637b863f390 0x5637b8a29840 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 --2- 172.21.15.84:0/1083792662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637b86371b0 0x5637b8a1ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 >> 172.21.15.84:0/1083792662 conn(0x5637b8654460 msgr2=0x5637b8a03200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4d6a00640 0 client.18045 ms_handle_reset on v2:172.21.15.191:6836/2311233520 2024-09-21T08:02:54.539 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:02:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 shutdown_connections 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 1 -- 172.21.15.84:0/1083792662 wait complete. 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.469+0000 7fd4fecae740 20 client.18045 trim_cache size 0 max 16384 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4d80b6690 msgr2=0x7fd4d80b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4d80b6690 0x7fd4d80b8ba0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8003c80 tx=0x7fd4e8005fd0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f0077380 msgr2=0x7fd4f01a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f0077380 0x7fd4f01a0e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00e9c0 tx=0x7fd4dc00ee80 comp rx=0 tx=0).stop 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 shutdown_connections 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fd4d80b6690 0x7fd4d80b8ba0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4f0114280 0x7fd4f01a60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f0077380 0x7fd4f01a0e40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 --2- 172.21.15.84:0/809430407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f0075dd0 0x7fd4f01a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 >> 172.21.15.84:0/809430407 conn(0x7fd4f00ff440 msgr2=0x7fd4f0110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 shutdown_connections 2024-09-21T08:02:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.470+0000 7fd4f6a00640 1 -- 172.21.15.84:0/809430407 wait complete. 2024-09-21T08:02:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 -- 172.21.15.84:0/342156211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 msgr2=0x7f43481125d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 --2- 172.21.15.84:0/342156211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 0x7f43481125d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4340009ca0 tx=0x7f434002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 -- 172.21.15.84:0/342156211 shutdown_connections 2024-09-21T08:02:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 --2- 172.21.15.84:0/342156211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 0x7f43481125d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 --2- 172.21.15.84:0/342156211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f434810b450 0x7f434810b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 --2- 172.21.15.84:0/342156211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4348105b20 0x7f4348105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 -- 172.21.15.84:0/342156211 >> 172.21.15.84:0/342156211 conn(0x7f4348101560 msgr2=0x7f43481039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 -- 172.21.15.84:0/342156211 shutdown_connections 2024-09-21T08:02:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.704+0000 7f434e200640 1 -- 172.21.15.84:0/342156211 wait complete. 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.705+0000 7f434e200640 1 Processor -- start 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.705+0000 7f434e200640 1 -- start start 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4348105b20 0x7f434819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434e200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f434810b450 0x7f434819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 0x7f43481a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4348115ab0 con 0x7f434810bda0 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4348115930 con 0x7f4348105b20 2024-09-21T08:02:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434e200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4348115c30 con 0x7f434810b450 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 0x7f43481a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 0x7f43481a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43378/0 (socket says 172.21.15.84:43378) 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f4347e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f434810b450 0x7f434819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434d800640 1 -- 172.21.15.84:0/1068659912 learned_addr learned my addr 172.21.15.84:0/1068659912 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f434ce00640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4348105b20 0x7f434819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.706+0000 7f4347e00640 1 -- 172.21.15.84:0/1068659912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4348105b20 msgr2=0x7f434819c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4347e00640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4348105b20 0x7f434819c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4347e00640 1 -- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 msgr2=0x7f43481a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4347e00640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 0x7f43481a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4347e00640 1 -- 172.21.15.84:0/1068659912 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43481a23a0 con 0x7f434810b450 2024-09-21T08:02:54.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4347e00640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f434810b450 0x7f434819ca10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f434806c7d0 tx=0x7f433400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4345600640 1 -- 172.21.15.84:0/1068659912 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433400cc40 con 0x7f434810b450 2024-09-21T08:02:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43481a2690 con 0x7f434810b450 2024-09-21T08:02:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4345600640 1 -- 172.21.15.84:0/1068659912 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43340044d0 con 0x7f434810b450 2024-09-21T08:02:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43481a8e20 con 0x7f434810b450 2024-09-21T08:02:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.707+0000 7f4345600640 1 -- 172.21.15.84:0/1068659912 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433401c070 con 0x7f434810b450 2024-09-21T08:02:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.708+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4348105f30 con 0x7f434810b450 2024-09-21T08:02:54.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.712+0000 7f4345600640 1 -- 172.21.15.84:0/1068659912 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4334005020 con 0x7f434810b450 2024-09-21T08:02:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.713+0000 7f4345600640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43300b6680 0x7f43300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.713+0000 7f4345600640 1 -- 172.21.15.84:0/1068659912 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f43340e7b40 con 0x7f434810b450 2024-09-21T08:02:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.713+0000 7f434ce00640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43300b6680 0x7f43300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.714+0000 7f4345600640 1 -- 172.21.15.84:0/1068659912 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43340add30 con 0x7f434810b450 2024-09-21T08:02:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.714+0000 7f434ce00640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43300b6680 0x7f43300b8b90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f433c009bd0 tx=0x7f433c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:54.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.935+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 --> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f4348063800 con 0x7f43300b6680 2024-09-21T08:02:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.944+0000 7f4345600640 1 -- 172.21.15.84:0/1068659912 <== mgr.14223 v2:172.21.15.84:6800/2805742245 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f4348063800 con 0x7f43300b6680 2024-09-21T08:02:54.946 INFO:teuthology.orchestra.run.smithi084.stdout:/ 1m 6m3h 2024-09-21T08:02:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.946+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43300b6680 msgr2=0x7f43300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.946+0000 7f434e200640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43300b6680 0x7f43300b8b90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f433c009bd0 tx=0x7f433c005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.946+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f434810b450 msgr2=0x7f434819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.946+0000 7f434e200640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f434810b450 0x7f434819ca10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f434806c7d0 tx=0x7f433400ee50 comp rx=0 tx=0).stop 2024-09-21T08:02:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 shutdown_connections 2024-09-21T08:02:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f43300b6680 0x7f43300b8b90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f434810bda0 0x7f43481a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f434810b450 0x7f434819ca10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 --2- 172.21.15.84:0/1068659912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4348105b20 0x7f434819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 >> 172.21.15.84:0/1068659912 conn(0x7f4348101560 msgr2=0x7f434810aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 shutdown_connections 2024-09-21T08:02:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:54.947+0000 7f434e200640 1 -- 172.21.15.84:0/1068659912 wait complete. 2024-09-21T08:02:54.978 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T08:02:54.994 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T08:02:55.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T08:02:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:55.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:55 smithi084 ceph-mon[30411]: from='client.18027 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:55.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:55 smithi084 ceph-mon[30411]: pgmap v760: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 223 op/s 2024-09-21T08:02:56.054 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:55 smithi162 ceph-mon[34833]: from='client.18027 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:56.054 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:55 smithi162 ceph-mon[34833]: pgmap v760: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 223 op/s 2024-09-21T08:02:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:55 smithi191 ceph-mon[34667]: from='client.18027 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:56.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:55 smithi191 ceph-mon[34667]: pgmap v760: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 223 op/s 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 -- 172.21.15.84:0/2585268511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc8105bb0 msgr2=0x7fefc8105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 --2- 172.21.15.84:0/2585268511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc8105bb0 0x7fefc8105fc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009ca0 tx=0x7fefb802a8c0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 -- 172.21.15.84:0/2585268511 shutdown_connections 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 --2- 172.21.15.84:0/2585268511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefc810be40 0x7fefc8112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 --2- 172.21.15.84:0/2585268511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefc810b4f0 0x7fefc810b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 --2- 172.21.15.84:0/2585268511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc8105bb0 0x7fefc8105fc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 -- 172.21.15.84:0/2585268511 >> 172.21.15.84:0/2585268511 conn(0x7fefc8101680 msgr2=0x7fefc8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 -- 172.21.15.84:0/2585268511 shutdown_connections 2024-09-21T08:02:56.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.314+0000 7fefcd600640 1 -- 172.21.15.84:0/2585268511 wait complete. 2024-09-21T08:02:56.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 Processor -- start 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 -- start start 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefc8105bb0 0x7fefc819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefc810b4f0 0x7fefc819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc810be40 0x7fefc81a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8115b00 con 0x7fefc810be40 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8115980 con 0x7fefc8105bb0 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.315+0000 7fefcd600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8115c80 con 0x7fefc810b4f0 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefc7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefc8105bb0 0x7fefc819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefc7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefc8105bb0 0x7fefc819c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:35250/0 (socket says 172.21.15.84:35250) 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefc7e00640 1 -- 172.21.15.84:0/1939543376 learned_addr learned my addr 172.21.15.84:0/1939543376 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:56.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefbf400640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefc810b4f0 0x7fefc819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefccc00640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc810be40 0x7fefc81a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefccc00640 1 -- 172.21.15.84:0/1939543376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefc810b4f0 msgr2=0x7fefc819cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefccc00640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefc810b4f0 0x7fefc819cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefccc00640 1 -- 172.21.15.84:0/1939543376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefc8105bb0 msgr2=0x7fefc819c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefccc00640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefc8105bb0 0x7fefc819c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.316+0000 7fefccc00640 1 -- 172.21.15.84:0/1939543376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc81a24a0 con 0x7fefc810be40 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.317+0000 7fefccc00640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc810be40 0x7fefc81a1d70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fefc000d680 tx=0x7fefc000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.317+0000 7fefc5600640 1 -- 172.21.15.84:0/1939543376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0017070 con 0x7fefc810be40 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.317+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc81a2790 con 0x7fefc810be40 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.317+0000 7fefc5600640 1 -- 172.21.15.84:0/1939543376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefc0009820 con 0x7fefc810be40 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.317+0000 7fefc5600640 1 -- 172.21.15.84:0/1939543376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0004ce0 con 0x7fefc810be40 2024-09-21T08:02:56.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.317+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc81a8ef0 con 0x7fefc810be40 2024-09-21T08:02:56.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 Processor -- start 2024-09-21T08:02:56.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefc5600640 1 -- 172.21.15.84:0/1939543376 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fefc00099d0 con 0x7fefc810be40 2024-09-21T08:02:56.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 -- start start 2024-09-21T08:02:56.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c14d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c15270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c157b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d161b8bfb0 con 0x55d16184d390 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d161b7b3e0 con 0x55d16186e070 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.321+0000 7fefd58db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d161b7f1f0 con 0x55d1618451b0 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c15270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c14d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c15270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33754/0 (socket says 172.21.15.84:33754) 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 -- 172.21.15.84:0/1950148128 learned_addr learned my addr 172.21.15.84:0/1950148128 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:56.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefbf400640 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 -- 172.21.15.84:0/1950148128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 msgr2=0x55d161c14d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c14d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 -- 172.21.15.84:0/1950148128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 msgr2=0x55d161c157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c157b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefc7e00640 1 -- 172.21.15.84:0/1950148128 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d161b45cd0 con 0x55d1618451b0 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.322+0000 7fefbf400640 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c14d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.323+0000 7fefc5600640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefac0b6680 0x7fefac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.323+0000 7fefc7e00640 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c15270 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009920 tx=0x7fefb8009950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3d791c38bea96cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.323+0000 7fefc5600640 1 -- 172.21.15.84:0/1939543376 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fefc00e7320 con 0x7fefc810be40 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.323+0000 7fefbf400640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefac0b6680 0x7fefac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.323+0000 7fefbd200640 1 -- 172.21.15.84:0/1950148128 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8031e30 con 0x55d1618451b0 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.323+0000 7fefbd200640 1 -- 172.21.15.84:0/1950148128 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefb8036030 con 0x55d1618451b0 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.323+0000 7fefbd200640 1 -- 172.21.15.84:0/1950148128 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb80042a0 con 0x55d1618451b0 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 -- 172.21.15.84:0/1950148128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 msgr2=0x55d161c15270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefbf400640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefac0b6680 0x7fefac0b8b90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefc810bdb0 tx=0x7fefb0004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c15270 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009920 tx=0x7fefb8009950 comp rx=0 tx=0).stop 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 -- 172.21.15.84:0/1950148128 shutdown_connections 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c15270 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 --2- 172.21.15.84:0/1950148128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c14d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 -- 172.21.15.84:0/1950148128 >> 172.21.15.84:0/1950148128 conn(0x55d161862460 msgr2=0x55d161c12bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 -- 172.21.15.84:0/1950148128 shutdown_connections 2024-09-21T08:02:56.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.324+0000 7fefd58db740 1 -- 172.21.15.84:0/1950148128 wait complete. 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.325+0000 7fefd58db740 1 -- start start 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.325+0000 7fefd58db740 1 Processor -- start 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefd58db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c29610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefd58db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16184d390 0x55d161c29bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefd58db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16186e070 0x55d161c2ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefd58db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d1619dc700 con 0x55d1618451b0 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefd58db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d161b16580 con 0x55d16184d390 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefd58db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d161c23330 con 0x55d16186e070 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefd58db740 10 client.0 _ll_register_callbacks cb 0x55d161b26470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefccc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16186e070 0x55d161c2ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefbf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16184d390 0x55d161c29bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefccc00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16186e070 0x55d161c2ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33766/0 (socket says 172.21.15.84:33766) 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefccc00640 1 -- 172.21.15.84:0/15046114 learned_addr learned my addr 172.21.15.84:0/15046114 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.326+0000 7fefc7e00640 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c29610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefbf400640 1 -- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16186e070 msgr2=0x55d161c2ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefbf400640 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16186e070 0x55d161c2ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefbf400640 1 -- 172.21.15.84:0/15046114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 msgr2=0x55d161c29610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefbf400640 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c29610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefbf400640 1 -- 172.21.15.84:0/15046114 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1618d9650 con 0x55d16184d390 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefccc00640 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16186e070 0x55d161c2ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefbf400640 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16184d390 0x55d161c29bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fefc806c8c0 tx=0x7fefb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a92ad7a7d4ad6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefb5600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefb5600640 1 -- 172.21.15.84:0/15046114 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0005220 con 0x55d16184d390 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d161b18b90 con 0x55d16184d390 2024-09-21T08:02:56.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.327+0000 7fefb5600640 1 -- 172.21.15.84:0/15046114 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fefb00053c0 con 0x55d16184d390 2024-09-21T08:02:56.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.328+0000 7fefb5600640 1 -- 172.21.15.84:0/15046114 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefb0012e30 con 0x55d16184d390 2024-09-21T08:02:56.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.328+0000 7fefd58db740 10 client.28436 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:56.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.328+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d161b33950 con 0x55d16184d390 2024-09-21T08:02:56.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.328+0000 7fefb5600640 1 -- 172.21.15.84:0/15046114 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d161b18b90 con 0x55d16184d390 2024-09-21T08:02:56.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.328+0000 7fefb5600640 1 -- 172.21.15.84:0/15046114 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fefb0027070 con 0x55d16184d390 2024-09-21T08:02:56.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.329+0000 7fefd58db740 10 client.28436 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:56.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.329+0000 7fefd58db740 10 client.28436 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.329+0000 7fefd58db740 20 client.28436 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.329+0000 7fefd58db740 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d16182c9f0 0x55d161c3af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.329+0000 7fefd58db740 4 client.28436 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.329+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d161b8df00 con 0x55d16182c9f0 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.329+0000 7fefc7e00640 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d16182c9f0 0x55d161c3af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.330+0000 7fefc7e00640 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d16182c9f0 0x55d161c3af70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19a421b866b384c9 server_cookie=d825bbc8ca03914e in_seq=0 out_seq=0 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.330+0000 7fefb5600640 10 client.28436 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefb5600640 1 -- 172.21.15.84:0/15046114 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d161b8df00 con 0x55d16182c9f0 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefb5600640 10 client.28436 handle_command_reply: tid=0 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 client.28436 shutdown 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16184d390 msgr2=0x55d161c29bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16184d390 0x55d161c29bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fefc806c8c0 tx=0x7fefb00046c0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 shutdown_connections 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d16182c9f0 0x55d161c3af70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16186e070 0x55d161c2ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16184d390 0x55d161c29bf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 --2- 172.21.15.84:0/15046114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c29610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 >> 172.21.15.84:0/15046114 conn(0x55d161862460 msgr2=0x55d161c17ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:56.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefb5600640 0 client.28436 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:02:56.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 shutdown_connections 2024-09-21T08:02:56.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 1 -- 172.21.15.84:0/15046114 wait complete. 2024-09-21T08:02:56.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.331+0000 7fefd58db740 20 client.28436 trim_cache size 0 max 16384 2024-09-21T08:02:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.345+0000 7fefd58db740 1 Processor -- start 2024-09-21T08:02:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.345+0000 7fefd58db740 1 -- start start 2024-09-21T08:02:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.345+0000 7fefd58db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c24bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.345+0000 7fefd58db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c22830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.345+0000 7fefd58db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c2f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefd58db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81aea60 con 0x55d16184d390 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefd58db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81b05a0 con 0x55d16186e070 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefd58db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81af130 con 0x55d1618451b0 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefbf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c22830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefbf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c22830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43406/0 (socket says 172.21.15.84:43406) 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefbf400640 1 -- 172.21.15.84:0/2707332597 learned_addr learned my addr 172.21.15.84:0/2707332597 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefc7e00640 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c24bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefccc00640 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c2f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefc7e00640 1 -- 172.21.15.84:0/2707332597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 msgr2=0x55d161c2f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefc7e00640 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c2f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefc7e00640 1 -- 172.21.15.84:0/2707332597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 msgr2=0x55d161c22830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefc7e00640 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c22830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefc7e00640 1 -- 172.21.15.84:0/2707332597 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d161c139e0 con 0x55d1618451b0 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefccc00640 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c2f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.346+0000 7fefbf400640 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c22830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.347+0000 7fefc7e00640 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c24bc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fefb802ade0 tx=0x7fefb8003e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7ee1ed4449f14e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.347+0000 7fefb7e00640 1 -- 172.21.15.84:0/2707332597 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8009360 con 0x55d1618451b0 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.347+0000 7fefb7e00640 1 -- 172.21.15.84:0/2707332597 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefb8036040 con 0x55d1618451b0 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.347+0000 7fefb7e00640 1 -- 172.21.15.84:0/2707332597 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb802f5c0 con 0x55d1618451b0 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 -- 172.21.15.84:0/2707332597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 msgr2=0x55d161c24bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c24bc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fefb802ade0 tx=0x7fefb8003e30 comp rx=0 tx=0).stop 2024-09-21T08:02:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 -- 172.21.15.84:0/2707332597 shutdown_connections 2024-09-21T08:02:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c2f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d16184d390 0x55d161c22830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 --2- 172.21.15.84:0/2707332597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d1618451b0 0x55d161c24bc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 -- 172.21.15.84:0/2707332597 >> 172.21.15.84:0/2707332597 conn(0x55d161862460 msgr2=0x55d161c2eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 -- 172.21.15.84:0/2707332597 shutdown_connections 2024-09-21T08:02:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 -- 172.21.15.84:0/2707332597 wait complete. 2024-09-21T08:02:56.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.348+0000 7fefd58db740 1 -- start start 2024-09-21T08:02:56.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 1 Processor -- start 2024-09-21T08:02:56.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c2faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16184d390 0x55d161c30030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c34940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81afed0 con 0x55d1618451b0 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81af800 con 0x55d16186e070 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81aca60 con 0x55d16184d390 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.349+0000 7fefd58db740 10 client.0 _ll_register_callbacks cb 0x7fefb000bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16184d390 0x55d161c30030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefc7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c2faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16184d390 0x55d161c30030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:33786/0 (socket says 172.21.15.84:33786) 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 -- 172.21.15.84:0/1480148444 learned_addr learned my addr 172.21.15.84:0/1480148444 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefccc00640 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c34940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 -- 172.21.15.84:0/1480148444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 msgr2=0x55d161c34940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c34940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 -- 172.21.15.84:0/1480148444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 msgr2=0x55d161c2faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c2faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 -- 172.21.15.84:0/1480148444 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d161c34f80 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefbf400640 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16184d390 0x55d161c30030 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fefb001a040 tx=0x7fefb001ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d0e0fdb382f5e69 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.350+0000 7fefb5600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefb5600640 1 -- 172.21.15.84:0/1480148444 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb003a030 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb8036040 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefb5600640 1 -- 172.21.15.84:0/1480148444 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fefb0005020 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefb5600640 1 -- 172.21.15.84:0/1480148444 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefb0005220 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefd58db740 10 client.28462 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d161ca5a60 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefb5600640 1 -- 172.21.15.84:0/1480148444 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefb8036040 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefb5600640 1 -- 172.21.15.84:0/1480148444 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fefb0027040 con 0x55d16184d390 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefd58db740 10 client.28462 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.351+0000 7fefd58db740 10 client.28462 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T08:02:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.352+0000 7fefd58db740 20 client.28462 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.352+0000 7fefd58db740 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d161801da0 0x55d161ca82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.352+0000 7fefd58db740 4 client.28462 mds_command: new command op to 24742 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:02:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.352+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 --> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d161b899b0 con 0x55d161801da0 2024-09-21T08:02:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.352+0000 7fefc7e00640 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d161801da0 0x55d161ca82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.352+0000 7fefc7e00640 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d161801da0 0x55d161ca82a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=197e1ee5e844fc49 server_cookie=35bf104bce925466 in_seq=0 out_seq=0 2024-09-21T08:02:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.352+0000 7fefb5600640 10 client.28462 ms_handle_connect on v2:172.21.15.191:6838/2322343723 2024-09-21T08:02:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefb5600640 1 -- 172.21.15.84:0/1480148444 <== mds.1 v2:172.21.15.191:6838/2322343723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d161b899b0 con 0x55d161801da0 2024-09-21T08:02:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefb5600640 10 client.28462 handle_command_reply: tid=0 2024-09-21T08:02:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 client.28462 shutdown 2024-09-21T08:02:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16184d390 msgr2=0x55d161c30030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16184d390 0x55d161c30030 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fefb001a040 tx=0x7fefb001ef40 comp rx=0 tx=0).stop 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 shutdown_connections 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:6838/2322343723,v1:172.21.15.191:6839/2322343723] conn(0x55d161801da0 0x55d161ca82a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d16186e070 0x55d161c34940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d16184d390 0x55d161c30030 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefb5600640 0 client.28462 ms_handle_reset on v2:172.21.15.191:6838/2322343723 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 --2- 172.21.15.84:0/1480148444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1618451b0 0x55d161c2faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 >> 172.21.15.84:0/1480148444 conn(0x55d161862460 msgr2=0x55d161c15d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 shutdown_connections 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 1 -- 172.21.15.84:0/1480148444 wait complete. 2024-09-21T08:02:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.353+0000 7fefd58db740 20 client.28462 trim_cache size 0 max 16384 2024-09-21T08:02:56.359 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:02:56.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefac0b6680 msgr2=0x7fefac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefac0b6680 0x7fefac0b8b90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefc810bdb0 tx=0x7fefb0004730 comp rx=0 tx=0).stop 2024-09-21T08:02:56.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc810be40 msgr2=0x7fefc81a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc810be40 0x7fefc81a1d70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fefc000d680 tx=0x7fefc000db40 comp rx=0 tx=0).stop 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 shutdown_connections 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fefac0b6680 0x7fefac0b8b90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefc810be40 0x7fefc81a1d70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefc810b4f0 0x7fefc819cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 --2- 172.21.15.84:0/1939543376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fefc8105bb0 0x7fefc819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 >> 172.21.15.84:0/1939543376 conn(0x7fefc8101680 msgr2=0x7fefc8103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 shutdown_connections 2024-09-21T08:02:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:56.354+0000 7fefcd600640 1 -- 172.21.15.84:0/1939543376 wait complete. 2024-09-21T08:02:56.983 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:56 smithi084 ceph-mon[30411]: from='client.28444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:57.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:56 smithi162 ceph-mon[34833]: from='client.28444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:57.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T08:02:57.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:56 smithi191 ceph-mon[34667]: from='client.28444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T08:02:57.491 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:02:57.951 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:57 smithi084 ceph-mon[30411]: pgmap v761: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 178 op/s 2024-09-21T08:02:58.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:57 smithi162 ceph-mon[34833]: pgmap v761: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 178 op/s 2024-09-21T08:02:58.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.124+0000 7f238e800640 1 -- 172.21.15.84:0/3717158544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 msgr2=0x7f238810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.124+0000 7f238e800640 1 --2- 172.21.15.84:0/3717158544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 0x7f238810bad0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2370009900 tx=0x7f237002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.124+0000 7f238e800640 1 -- 172.21.15.84:0/3717158544 shutdown_connections 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.124+0000 7f238e800640 1 --2- 172.21.15.84:0/3717158544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f238810c010 0x7f2388112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.124+0000 7f238e800640 1 --2- 172.21.15.84:0/3717158544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 0x7f238810bad0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.124+0000 7f238e800640 1 --2- 172.21.15.84:0/3717158544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2388105d80 0x7f2388106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.124+0000 7f238e800640 1 -- 172.21.15.84:0/3717158544 >> 172.21.15.84:0/3717158544 conn(0x7f2388101810 msgr2=0x7f2388103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.125+0000 7f238e800640 1 -- 172.21.15.84:0/3717158544 shutdown_connections 2024-09-21T08:02:58.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.125+0000 7f238e800640 1 -- 172.21.15.84:0/3717158544 wait complete. 2024-09-21T08:02:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 Processor -- start 2024-09-21T08:02:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 -- start start 2024-09-21T08:02:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2388105d80 0x7f238819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 0x7f238819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f238810c010 0x7f23881a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2388115cd0 con 0x7f238810b6c0 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2388115b50 con 0x7f2388105d80 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f238e800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2388115e50 con 0x7f238810c010 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.126+0000 7f2387400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2388105d80 0x7f238819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f237ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 0x7f238819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2388105d80 0x7f238819c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45014/0 (socket says 172.21.15.84:45014) 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387400640 1 -- 172.21.15.84:0/47941787 learned_addr learned my addr 172.21.15.84:0/47941787 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387e00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f238810c010 0x7f23881a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387e00640 1 -- 172.21.15.84:0/47941787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2388105d80 msgr2=0x7f238819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387e00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2388105d80 0x7f238819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387e00640 1 -- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 msgr2=0x7f238819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387e00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 0x7f238819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387e00640 1 -- 172.21.15.84:0/47941787 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23881a2630 con 0x7f238810c010 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f237ea00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 0x7f238819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.127+0000 7f2387e00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f238810c010 0x7f23881a1f00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f238000da10 tx=0x7f238000ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.128+0000 7f2384c00640 1 -- 172.21.15.84:0/47941787 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238000bd70 con 0x7f238810c010 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.128+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23881a2920 con 0x7f238810c010 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.128+0000 7f2384c00640 1 -- 172.21.15.84:0/47941787 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2380003e20 con 0x7f238810c010 2024-09-21T08:02:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.128+0000 7f2384c00640 1 -- 172.21.15.84:0/47941787 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23800106c0 con 0x7f238810c010 2024-09-21T08:02:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.128+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23881a9080 con 0x7f238810c010 2024-09-21T08:02:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.131+0000 7f23953fe740 1 Processor -- start 2024-09-21T08:02:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f2384c00640 1 -- 172.21.15.84:0/47941787 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f2380004270 con 0x7f238810c010 2024-09-21T08:02:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f23953fe740 1 -- start start 2024-09-21T08:02:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f23953fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e803f070 0x5629e83e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f23953fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f23953fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83e6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f23953fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5629e835cfb0 con 0x5629e80161b0 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f23953fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5629e834c3e0 con 0x5629e801e390 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.132+0000 7f23953fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5629e83501f0 con 0x5629e803f070 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f237ea00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e803f070 0x5629e83e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42102/0 (socket says 172.21.15.84:42102) 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 -- 172.21.15.84:0/1763819700 learned_addr learned my addr 172.21.15.84:0/1763819700 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:58.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f237ea00640 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 -- 172.21.15.84:0/1763819700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e803f070 msgr2=0x5629e83e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e803f070 0x5629e83e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 -- 172.21.15.84:0/1763819700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 msgr2=0x5629e83e6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83e6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 -- 172.21.15.84:0/1763819700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e8316cd0 con 0x5629e80161b0 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.133+0000 7f2387400640 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83e62e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2378009e10 tx=0x7f2378011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f776d88ad92d8927 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.134+0000 7f237cc00640 1 -- 172.21.15.84:0/1763819700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237801e070 con 0x5629e80161b0 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.134+0000 7f237cc00640 1 -- 172.21.15.84:0/1763819700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2378019ae0 con 0x5629e80161b0 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.134+0000 7f237cc00640 1 -- 172.21.15.84:0/1763819700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237800fac0 con 0x5629e80161b0 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.134+0000 7f2384c00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f236c0b6680 0x7f236c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.134+0000 7f2384c00640 1 -- 172.21.15.84:0/47941787 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f23800e7ec0 con 0x7f238810c010 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.134+0000 7f237ea00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f236c0b6680 0x7f236c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 -- 172.21.15.84:0/1763819700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 msgr2=0x5629e83e62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83e62e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2378009e10 tx=0x7f2378011810 comp rx=0 tx=0).stop 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 -- 172.21.15.84:0/1763819700 shutdown_connections 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83e62e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 --2- 172.21.15.84:0/1763819700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e803f070 0x5629e83e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 -- 172.21.15.84:0/1763819700 >> 172.21.15.84:0/1763819700 conn(0x5629e8033460 msgr2=0x5629e83e3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 -- 172.21.15.84:0/1763819700 shutdown_connections 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f23953fe740 1 -- 172.21.15.84:0/1763819700 wait complete. 2024-09-21T08:02:58.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.135+0000 7f237ea00640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f236c0b6680 0x7f236c0b8b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2370009230 tx=0x7f2370031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 -- start start 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 Processor -- start 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83f1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83fd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5629e81ad700 con 0x5629e80161b0 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5629e82e7580 con 0x5629e803f070 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.136+0000 7f23953fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5629e83f4580 con 0x5629e801e390 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f23953fe740 10 client.0 _ll_register_callbacks cb 0x5629e82f7470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42116/0 (socket says 172.21.15.84:42116) 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 -- 172.21.15.84:0/3295289429 learned_addr learned my addr 172.21.15.84:0/3295289429 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f237ea00640 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387e00640 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 -- 172.21.15.84:0/3295289429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 msgr2=0x5629e83f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83f1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 -- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 msgr2=0x5629e83fd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83fd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.137+0000 7f2387400640 1 -- 172.21.15.84:0/3295289429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e80aa650 con 0x5629e80161b0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f2387400640 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83f1550 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f237800f640 tx=0x7f2378005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c91b4d2d1cfe66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f2375600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f2375600640 1 -- 172.21.15.84:0/3295289429 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378027020 con 0x5629e80161b0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f2375600640 1 -- 172.21.15.84:0/3295289429 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f237800fa40 con 0x5629e80161b0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5629e82e9b90 con 0x5629e80161b0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f2375600640 1 -- 172.21.15.84:0/3295289429 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2378032050 con 0x5629e80161b0 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f23953fe740 10 client.18081 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.138+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5629e8304950 con 0x5629e80161b0 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f2375600640 1 -- 172.21.15.84:0/3295289429 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5629e82e9b90 con 0x5629e80161b0 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f2375600640 1 -- 172.21.15.84:0/3295289429 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2378019430 con 0x5629e80161b0 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f23953fe740 10 client.18081 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f23953fe740 10 client.18081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f23953fe740 20 client.18081 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f23953fe740 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7ffd9f0 0x5629e8403620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f23953fe740 4 client.18081 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629e835ef00 con 0x5629e7ffd9f0 2024-09-21T08:02:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.139+0000 7f237ea00640 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7ffd9f0 0x5629e8403620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.140+0000 7f237ea00640 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7ffd9f0 0x5629e8403620 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fca4658b28349e server_cookie=d3be5c021e1f0843 in_seq=0 out_seq=0 2024-09-21T08:02:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.140+0000 7f2375600640 10 client.18081 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f2375600640 1 -- 172.21.15.84:0/3295289429 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629e835ef00 con 0x5629e7ffd9f0 2024-09-21T08:02:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f2375600640 10 client.18081 handle_command_reply: tid=0 2024-09-21T08:02:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 client.18081 shutdown 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 msgr2=0x5629e83f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83f1550 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f237800f640 tx=0x7f2378005730 comp rx=0 tx=0).stop 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 shutdown_connections 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7ffd9f0 0x5629e8403620 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 --2- 172.21.15.84:0/3295289429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83f1550 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f2375600640 0 client.18081 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 >> 172.21.15.84:0/3295289429 conn(0x5629e8033460 msgr2=0x5629e83e8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.141+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 shutdown_connections 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.142+0000 7f23953fe740 1 -- 172.21.15.84:0/3295289429 wait complete. 2024-09-21T08:02:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.142+0000 7f23953fe740 20 client.18081 trim_cache size 0 max 16384 2024-09-21T08:02:58.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:57 smithi191 ceph-mon[34667]: pgmap v761: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 178 op/s 2024-09-21T08:02:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.155+0000 7f23953fe740 1 Processor -- start 2024-09-21T08:02:58.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.155+0000 7f23953fe740 1 -- start start 2024-09-21T08:02:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f23953fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f23953fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f23953fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f23953fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f23881b2f60 con 0x5629e80161b0 2024-09-21T08:02:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f23953fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f23881b4aa0 con 0x5629e803f070 2024-09-21T08:02:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f23953fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f23881b3630 con 0x5629e801e390 2024-09-21T08:02:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83ecd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42118/0 (socket says 172.21.15.84:42118) 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 -- 172.21.15.84:0/4216697618 learned_addr learned my addr 172.21.15.84:0/4216697618 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387e00640 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f237ea00640 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 -- 172.21.15.84:0/4216697618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 msgr2=0x5629e83e74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83e74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 -- 172.21.15.84:0/4216697618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 msgr2=0x5629e83ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83ee740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.156+0000 7f2387400640 1 -- 172.21.15.84:0/4216697618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e83e83b0 con 0x5629e80161b0 2024-09-21T08:02:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.157+0000 7f2387400640 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83ecd00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f237800f3e0 tx=0x7f237800f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac89023ffbcc597 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.157+0000 7f2377e00640 1 -- 172.21.15.84:0/4216697618 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237803b070 con 0x5629e80161b0 2024-09-21T08:02:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.157+0000 7f2377e00640 1 -- 172.21.15.84:0/4216697618 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f237801f040 con 0x5629e80161b0 2024-09-21T08:02:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.157+0000 7f2377e00640 1 -- 172.21.15.84:0/4216697618 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378027050 con 0x5629e80161b0 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 -- 172.21.15.84:0/4216697618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 msgr2=0x5629e83ecd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83ecd00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f237800f3e0 tx=0x7f237800f430 comp rx=0 tx=0).stop 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 -- 172.21.15.84:0/4216697618 shutdown_connections 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e803f070 0x5629e83ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e801e390 0x5629e83e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 --2- 172.21.15.84:0/4216697618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e80161b0 0x5629e83ecd00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 -- 172.21.15.84:0/4216697618 >> 172.21.15.84:0/4216697618 conn(0x5629e8033460 msgr2=0x5629e83e6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 -- 172.21.15.84:0/4216697618 shutdown_connections 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 -- 172.21.15.84:0/4216697618 wait complete. 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.158+0000 7f23953fe740 1 -- start start 2024-09-21T08:02:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 1 Processor -- start 2024-09-21T08:02:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e80161b0 0x5629e83f5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e803f070 0x5629e83f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f23881b43d0 con 0x5629e803f070 2024-09-21T08:02:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f23881b3d00 con 0x5629e801e390 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f23881b0f60 con 0x5629e80161b0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.159+0000 7f23953fe740 10 client.0 _ll_register_callbacks cb 0x7f2370009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e80161b0 0x5629e83f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e80161b0 0x5629e83f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:49052/0 (socket says 172.21.15.84:49052) 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 -- 172.21.15.84:0/2535437909 learned_addr learned my addr 172.21.15.84:0/2535437909 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f237ea00640 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387e00640 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e803f070 0x5629e83f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 -- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 msgr2=0x5629e83f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 -- 172.21.15.84:0/2535437909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e803f070 msgr2=0x5629e83f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e803f070 0x5629e83f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 -- 172.21.15.84:0/2535437909 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e8403a80 con 0x5629e80161b0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2387400640 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e80161b0 0x5629e83f5860 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f237801c040 tx=0x7f2378005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adac48f1dd23ab4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.160+0000 7f2375600640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f2375600640 1 -- 172.21.15.84:0/2535437909 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378027050 con 0x5629e80161b0 2024-09-21T08:02:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f237801f040 con 0x5629e80161b0 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f2375600640 1 -- 172.21.15.84:0/2535437909 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f2378042d90 con 0x5629e80161b0 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f2375600640 1 -- 172.21.15.84:0/2535437909 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2378053050 con 0x5629e80161b0 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 10 client.28480 fetch_fsmap learned FSMap version 29 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5629e846e010 con 0x5629e80161b0 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f2375600640 1 -- 172.21.15.84:0/2535437909 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f237801f040 con 0x5629e80161b0 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f2375600640 1 -- 172.21.15.84:0/2535437909 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2378004bc0 con 0x5629e80161b0 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 10 client.28480 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 10 client.28480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 20 client.28480 populate_metadata read hostname 'smithi084' 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7fd2da0 0x5629e84705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 4 client.28480 mds_command: new command op to 24746 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T08:02:58.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.161+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 --> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629e835a9b0 con 0x5629e7fd2da0 2024-09-21T08:02:58.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.162+0000 7f237ea00640 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7fd2da0 0x5629e84705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.162+0000 7f2375600640 10 client.28480 ms_handle_connect on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.162+0000 7f237ea00640 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7fd2da0 0x5629e84705d0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72fd41ce55e36f63 server_cookie=eb305304b677102e in_seq=0 out_seq=0 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f2375600640 1 -- 172.21.15.84:0/2535437909 <== mds.0 v2:172.21.15.162:6838/3948328826 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629e835a9b0 con 0x5629e7fd2da0 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f2375600640 10 client.28480 handle_command_reply: tid=0 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 client.28480 shutdown 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e80161b0 msgr2=0x5629e83f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e80161b0 0x5629e83f5860 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f237801c040 tx=0x7f2378005780 comp rx=0 tx=0).stop 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 shutdown_connections 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629e803f070 0x5629e83f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5629e801e390 0x5629e83f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.162:6838/3948328826,v1:172.21.15.162:6839/3948328826] conn(0x5629e7fd2da0 0x5629e84705d0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 --2- 172.21.15.84:0/2535437909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629e80161b0 0x5629e83f5860 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f2375600640 0 client.28480 ms_handle_reset on v2:172.21.15.162:6838/3948328826 2024-09-21T08:02:58.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 >> 172.21.15.84:0/2535437909 conn(0x5629e8033460 msgr2=0x5629e83e6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:58.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 shutdown_connections 2024-09-21T08:02:58.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 1 -- 172.21.15.84:0/2535437909 wait complete. 2024-09-21T08:02:58.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.163+0000 7f23953fe740 20 client.28480 trim_cache size 0 max 16384 2024-09-21T08:02:58.168 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f236c0b6680 msgr2=0x7f236c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f236c0b6680 0x7f236c0b8b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2370009230 tx=0x7f2370031400 comp rx=0 tx=0).stop 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f238810c010 msgr2=0x7f23881a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f238810c010 0x7f23881a1f00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f238000da10 tx=0x7f238000ded0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 shutdown_connections 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f236c0b6680 0x7f236c0b8b90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f238810c010 0x7f23881a1f00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f238810b6c0 0x7f238819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 --2- 172.21.15.84:0/47941787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2388105d80 0x7f238819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 >> 172.21.15.84:0/47941787 conn(0x7f2388101810 msgr2=0x7f2388103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 shutdown_connections 2024-09-21T08:02:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:58.164+0000 7f238e800640 1 -- 172.21.15.84:0/47941787 wait complete. 2024-09-21T08:02:58.917 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T08:02:58.918 INFO:tasks.fwd_scrub:done joining 2024-09-21T08:02:58.918 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T08:02:58.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T08:02:59.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.148+0000 7f4e23e00640 1 -- 172.21.15.84:0/1236714016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e24109b70 msgr2=0x7f4e241103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.148+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1236714016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e24109b70 0x7f4e241103a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009ca0 tx=0x7f4e1c02a8b0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.148+0000 7f4e23e00640 1 -- 172.21.15.84:0/1236714016 shutdown_connections 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.148+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1236714016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e24109b70 0x7f4e241103a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.148+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1236714016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e24109220 0x7f4e24109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.148+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1236714016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e241038f0 0x7f4e24103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.148+0000 7f4e23e00640 1 -- 172.21.15.84:0/1236714016 >> 172.21.15.84:0/1236714016 conn(0x7f4e240ff350 msgr2=0x7f4e241017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.149+0000 7f4e23e00640 1 -- 172.21.15.84:0/1236714016 shutdown_connections 2024-09-21T08:02:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.149+0000 7f4e23e00640 1 -- 172.21.15.84:0/1236714016 wait complete. 2024-09-21T08:02:59.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 Processor -- start 2024-09-21T08:02:59.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 -- start start 2024-09-21T08:02:59.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e241038f0 0x7f4e2419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e24109220 0x7f4e2419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e24109b70 0x7f4e2419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24113840 con 0x7f4e241038f0 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241136c0 con 0x7f4e24109220 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241139c0 con 0x7f4e24109b70 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e22a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e241038f0 0x7f4e2419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e22a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e241038f0 0x7f4e2419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42156/0 (socket says 172.21.15.84:42156) 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e22a00640 1 -- 172.21.15.84:0/1238294524 learned_addr learned my addr 172.21.15.84:0/1238294524 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e22000640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e24109220 0x7f4e2419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.150+0000 7f4e23400640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e24109b70 0x7f4e2419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e22a00640 1 -- 172.21.15.84:0/1238294524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e24109b70 msgr2=0x7f4e2419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e22a00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e24109b70 0x7f4e2419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e22a00640 1 -- 172.21.15.84:0/1238294524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e24109220 msgr2=0x7f4e2419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e22a00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e24109220 0x7f4e2419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e22a00640 1 -- 172.21.15.84:0/1238294524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e241a0130 con 0x7f4e241038f0 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e22000640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e24109220 0x7f4e2419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e22a00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e241038f0 0x7f4e2419a200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400e9f0 tx=0x7f4e1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e1b400640 1 -- 172.21.15.84:0/1238294524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1400cd80 con 0x7f4e241038f0 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e1b400640 1 -- 172.21.15.84:0/1238294524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e140108e0 con 0x7f4e241038f0 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e241a0420 con 0x7f4e241038f0 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e1b400640 1 -- 172.21.15.84:0/1238294524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14018980 con 0x7f4e241038f0 2024-09-21T08:02:59.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.151+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e241a6bb0 con 0x7f4e241038f0 2024-09-21T08:02:59.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.152+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e24103d00 con 0x7f4e241038f0 2024-09-21T08:02:59.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.155+0000 7f4e1b400640 1 -- 172.21.15.84:0/1238294524 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f4e14010430 con 0x7f4e241038f0 2024-09-21T08:02:59.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.156+0000 7f4e1b400640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e080b6680 0x7f4e080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.157+0000 7f4e1b400640 1 -- 172.21.15.84:0/1238294524 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f4e140e82e0 con 0x7f4e241038f0 2024-09-21T08:02:59.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.157+0000 7f4e22000640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e080b6680 0x7f4e080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.157+0000 7f4e22000640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e080b6680 0x7f4e080b8b90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4e24102b30 tx=0x7f4e10005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:59.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.159+0000 7f4e1b400640 1 -- 172.21.15.84:0/1238294524 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e140b2820 con 0x7f4e241038f0 2024-09-21T08:02:59.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.349+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e2419b320 con 0x7f4e241038f0 2024-09-21T08:02:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.351+0000 7f4e1b400640 1 -- 172.21.15.84:0/1238294524 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+25326 (secure 0 0 0) 0x7f4e140b7760 con 0x7f4e241038f0 2024-09-21T08:02:59.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:02:59.353 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":100,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T08:02:17.806985+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]},{"pool":4,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e080b6680 msgr2=0x7f4e080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e080b6680 0x7f4e080b8b90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4e24102b30 tx=0x7f4e10005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e241038f0 msgr2=0x7f4e2419a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e241038f0 0x7f4e2419a200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400e9f0 tx=0x7f4e1400eeb0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 shutdown_connections 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f4e080b6680 0x7f4e080b8b90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e24109b70 0x7f4e2419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e24109220 0x7f4e2419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 --2- 172.21.15.84:0/1238294524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e241038f0 0x7f4e2419a200 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 >> 172.21.15.84:0/1238294524 conn(0x7f4e240ff350 msgr2=0x7f4e24108850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 shutdown_connections 2024-09-21T08:02:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.353+0000 7f4e23e00640 1 -- 172.21.15.84:0/1238294524 wait complete. 2024-09-21T08:02:59.381 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:42:36.190783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:47:35.807539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:47:38.820711+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T07:47:47.739225+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T08:02:59.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.599+0000 7f3071000640 1 -- 172.21.15.84:0/1501820458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 msgr2=0x7f306c116880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.599+0000 7f3071000640 1 --2- 172.21.15.84:0/1501820458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 0x7f306c116880 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3064009ca0 tx=0x7f306402a8b0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.600+0000 7f3071000640 1 -- 172.21.15.84:0/1501820458 shutdown_connections 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.600+0000 7f3071000640 1 --2- 172.21.15.84:0/1501820458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 0x7f306c116880 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.600+0000 7f3071000640 1 --2- 172.21.15.84:0/1501820458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f306c078290 0x7f306c113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.600+0000 7f3071000640 1 --2- 172.21.15.84:0/1501820458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c077940 0x7f306c077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.600+0000 7f3071000640 1 -- 172.21.15.84:0/1501820458 >> 172.21.15.84:0/1501820458 conn(0x7f306c1014d0 msgr2=0x7f306c103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.600+0000 7f3071000640 1 -- 172.21.15.84:0/1501820458 shutdown_connections 2024-09-21T08:02:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.600+0000 7f3071000640 1 -- 172.21.15.84:0/1501820458 wait complete. 2024-09-21T08:02:59.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 Processor -- start 2024-09-21T08:02:59.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 -- start start 2024-09-21T08:02:59.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f306c077940 0x7f306c1a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c078290 0x7f306c1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 0x7f306c1a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f306c119e10 con 0x7f306c114460 2024-09-21T08:02:59.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f306c119c90 con 0x7f306c078290 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.601+0000 7f3071000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f306c119f90 con 0x7f306c077940 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c078290 0x7f306c1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f306be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 0x7f306c1a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c078290 0x7f306c1a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45068/0 (socket says 172.21.15.84:45068) 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 -- 172.21.15.84:0/1650057828 learned_addr learned my addr 172.21.15.84:0/1650057828 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f306b400640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f306c077940 0x7f306c1a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 -- 172.21.15.84:0/1650057828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f306c077940 msgr2=0x7f306c1a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f306c077940 0x7f306c1a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 -- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 msgr2=0x7f306c1a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 0x7f306c1a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 -- 172.21.15.84:0/1650057828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c1a6780 con 0x7f306c078290 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3062a00640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c078290 0x7f306c1a0df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f305400e9f0 tx=0x7f305400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3068c00640 1 -- 172.21.15.84:0/1650057828 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305400ccc0 con 0x7f306c078290 2024-09-21T08:02:59.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.602+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c1a6a70 con 0x7f306c078290 2024-09-21T08:02:59.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.603+0000 7f3068c00640 1 -- 172.21.15.84:0/1650057828 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30540108e0 con 0x7f306c078290 2024-09-21T08:02:59.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.603+0000 7f3068c00640 1 -- 172.21.15.84:0/1650057828 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054018860 con 0x7f306c078290 2024-09-21T08:02:59.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.603+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c1ad200 con 0x7f306c078290 2024-09-21T08:02:59.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.604+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c077d50 con 0x7f306c078290 2024-09-21T08:02:59.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.606+0000 7f3068c00640 1 -- 172.21.15.84:0/1650057828 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f3054010430 con 0x7f306c078290 2024-09-21T08:02:59.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.608+0000 7f3068c00640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30500b6680 0x7f30500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:02:59.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.608+0000 7f3068c00640 1 -- 172.21.15.84:0/1650057828 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f30540e8170 con 0x7f306c078290 2024-09-21T08:02:59.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.608+0000 7f306b400640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30500b6680 0x7f30500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:02:59.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.609+0000 7f306b400640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30500b6680 0x7f30500b8b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f305c009bd0 tx=0x7f305c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:02:59.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.610+0000 7f3068c00640 1 -- 172.21.15.84:0/1650057828 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30540b2710 con 0x7f306c078290 2024-09-21T08:02:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.798+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f306c02e640 con 0x7f306c078290 2024-09-21T08:02:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.799+0000 7f3068c00640 1 -- 172.21.15.84:0/1650057828 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) ==== 93+0+10 (secure 0 0 0) 0x7f30540b7650 con 0x7f306c078290 2024-09-21T08:02:59.800 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T08:02:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30500b6680 msgr2=0x7f30500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30500b6680 0x7f30500b8b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f305c009bd0 tx=0x7f305c005f90 comp rx=0 tx=0).stop 2024-09-21T08:02:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c078290 msgr2=0x7f306c1a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:02:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c078290 0x7f306c1a0df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f305400e9f0 tx=0x7f305400eeb0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 shutdown_connections 2024-09-21T08:02:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f30500b6680 0x7f30500b8b90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f306c114460 0x7f306c1a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f306c078290 0x7f306c1a0df0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 --2- 172.21.15.84:0/1650057828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f306c077940 0x7f306c1a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:02:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 >> 172.21.15.84:0/1650057828 conn(0x7f306c1014d0 msgr2=0x7f306c1164a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:02:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 shutdown_connections 2024-09-21T08:02:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:02:59.801+0000 7f3071000640 1 -- 172.21.15.84:0/1650057828 wait complete. 2024-09-21T08:02:59.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.045+0000 7f19e8600640 1 -- 172.21.15.84:0/2317461260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e01093e0 msgr2=0x7f19e01097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.045+0000 7f19e8600640 1 --2- 172.21.15.84:0/2317461260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e01093e0 0x7f19e01097f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009900 tx=0x7f19cc02a3f0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.046+0000 7f19e8600640 1 -- 172.21.15.84:0/2317461260 shutdown_connections 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.046+0000 7f19e8600640 1 --2- 172.21.15.84:0/2317461260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e0109d30 0x7f19e0110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.046+0000 7f19e8600640 1 --2- 172.21.15.84:0/2317461260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e01093e0 0x7f19e01097f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.046+0000 7f19e8600640 1 --2- 172.21.15.84:0/2317461260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0103ab0 0x7f19e0103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.046+0000 7f19e8600640 1 -- 172.21.15.84:0/2317461260 >> 172.21.15.84:0/2317461260 conn(0x7f19e00ff4d0 msgr2=0x7f19e0101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.046+0000 7f19e8600640 1 -- 172.21.15.84:0/2317461260 shutdown_connections 2024-09-21T08:03:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.046+0000 7f19e8600640 1 -- 172.21.15.84:0/2317461260 wait complete. 2024-09-21T08:03:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 Processor -- start 2024-09-21T08:03:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 -- start start 2024-09-21T08:03:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e0103ab0 0x7f19e019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e01093e0 0x7f19e019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0109d30 0x7f19e019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19e01139f0 con 0x7f19e01093e0 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0113870 con 0x7f19e0109d30 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.047+0000 7f19e8600640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0113b70 con 0x7f19e0103ab0 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e01093e0 0x7f19e019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5c00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e0103ab0 0x7f19e019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e01093e0 0x7f19e019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42196/0 (socket says 172.21.15.84:42196) 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 -- 172.21.15.84:0/1605395252 learned_addr learned my addr 172.21.15.84:0/1605395252 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e6600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0109d30 0x7f19e019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 -- 172.21.15.84:0/1605395252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e0103ab0 msgr2=0x7f19e019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e0103ab0 0x7f19e019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 -- 172.21.15.84:0/1605395252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0109d30 msgr2=0x7f19e019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0109d30 0x7f19e019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5200640 1 -- 172.21.15.84:0/1605395252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e01a03a0 con 0x7f19e01093e0 2024-09-21T08:03:00.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e5c00640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e0103ab0 0x7f19e019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:00.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.048+0000 7f19e6600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0109d30 0x7f19e019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:00.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:59 smithi162 ceph-mon[34833]: pgmap v762: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 129 op/s 2024-09-21T08:03:00.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:02:59 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1238294524' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:03:00.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.049+0000 7f19e5200640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e01093e0 0x7f19e019aa10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f19cc02a910 tx=0x7f19cc031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:00.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.049+0000 7f19de000640 1 -- 172.21.15.84:0/1605395252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc03f030 con 0x7f19e01093e0 2024-09-21T08:03:00.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.049+0000 7f19de000640 1 -- 172.21.15.84:0/1605395252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19cc004490 con 0x7f19e01093e0 2024-09-21T08:03:00.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.049+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e01a0630 con 0x7f19e01093e0 2024-09-21T08:03:00.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.049+0000 7f19de000640 1 -- 172.21.15.84:0/1605395252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc035070 con 0x7f19e01093e0 2024-09-21T08:03:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.049+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01a6e20 con 0x7f19e01093e0 2024-09-21T08:03:00.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.051+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e0104d20 con 0x7f19e01093e0 2024-09-21T08:03:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.053+0000 7f19de000640 1 -- 172.21.15.84:0/1605395252 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f19cc042030 con 0x7f19e01093e0 2024-09-21T08:03:00.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:59 smithi084 ceph-mon[30411]: pgmap v762: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 129 op/s 2024-09-21T08:03:00.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:02:59 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1238294524' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:03:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.055+0000 7f19de000640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f19c80b6680 0x7f19c80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.055+0000 7f19de000640 1 -- 172.21.15.84:0/1605395252 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f19cc108280 con 0x7f19e01093e0 2024-09-21T08:03:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.055+0000 7f19e5c00640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f19c80b6680 0x7f19c80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.056+0000 7f19e5c00640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f19c80b6680 0x7f19c80b8b90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009fc0 tx=0x7f19d4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.058+0000 7f19de000640 1 -- 172.21.15.84:0/1605395252 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19cc0ce3e0 con 0x7f19e01093e0 2024-09-21T08:03:00.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:59 smithi191 ceph-mon[34667]: pgmap v762: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 129 op/s 2024-09-21T08:03:00.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:02:59 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1238294524' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:03:00.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.271+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f19e010bb20 con 0x7f19e01093e0 2024-09-21T08:03:00.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.271+0000 7f19de000640 1 -- 172.21.15.84:0/1605395252 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) ==== 104+0+11 (secure 0 0 0) 0x7f19cc0d27c0 con 0x7f19e01093e0 2024-09-21T08:03:00.273 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T08:03:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f19c80b6680 msgr2=0x7f19c80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f19c80b6680 0x7f19c80b8b90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009fc0 tx=0x7f19d4005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e01093e0 msgr2=0x7f19e019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e01093e0 0x7f19e019aa10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f19cc02a910 tx=0x7f19cc031a20 comp rx=0 tx=0).stop 2024-09-21T08:03:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 shutdown_connections 2024-09-21T08:03:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f19c80b6680 0x7f19c80b8b90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0109d30 0x7f19e019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e01093e0 0x7f19e019aa10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 --2- 172.21.15.84:0/1605395252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19e0103ab0 0x7f19e019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.273+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 >> 172.21.15.84:0/1605395252 conn(0x7f19e00ff4d0 msgr2=0x7f19e01018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.274+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 shutdown_connections 2024-09-21T08:03:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.274+0000 7f19e8600640 1 -- 172.21.15.84:0/1605395252 wait complete. 2024-09-21T08:03:00.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T08:03:00.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 -- 172.21.15.84:0/1620696572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d4103ab0 msgr2=0x7f31d4103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 --2- 172.21.15.84:0/1620696572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d4103ab0 0x7f31d4103ec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009900 tx=0x7f31c802a3f0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 -- 172.21.15.84:0/1620696572 shutdown_connections 2024-09-21T08:03:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 --2- 172.21.15.84:0/1620696572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d4109d30 0x7f31d4110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 --2- 172.21.15.84:0/1620696572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d41093e0 0x7f31d41097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 --2- 172.21.15.84:0/1620696572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d4103ab0 0x7f31d4103ec0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 -- 172.21.15.84:0/1620696572 >> 172.21.15.84:0/1620696572 conn(0x7f31d40ff4d0 msgr2=0x7f31d4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 -- 172.21.15.84:0/1620696572 shutdown_connections 2024-09-21T08:03:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.520+0000 7f31dbe00640 1 -- 172.21.15.84:0/1620696572 wait complete. 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.521+0000 7f31dbe00640 1 Processor -- start 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.521+0000 7f31dbe00640 1 -- start start 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d4103ab0 0x7f31d419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d41093e0 0x7f31d419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d4109d30 0x7f31d419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31dbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31d41139f0 con 0x7f31d4109d30 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31dbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4113870 con 0x7f31d4103ab0 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31dbe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4113b70 con 0x7f31d41093e0 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31d9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d4109d30 0x7f31d419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31d9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d4103ab0 0x7f31d419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31d9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d4109d30 0x7f31d419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42220/0 (socket says 172.21.15.84:42220) 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31d9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d4103ab0 0x7f31d419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45100/0 (socket says 172.21.15.84:45100) 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31d9400640 1 -- 172.21.15.84:0/2479886903 learned_addr learned my addr 172.21.15.84:0/2479886903 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.522+0000 7f31d8a00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d41093e0 0x7f31d419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d9400640 1 -- 172.21.15.84:0/2479886903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d41093e0 msgr2=0x7f31d419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d9400640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d41093e0 0x7f31d419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d9400640 1 -- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d4109d30 msgr2=0x7f31d419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d9400640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d4109d30 0x7f31d419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d9400640 1 -- 172.21.15.84:0/2479886903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d41a0360 con 0x7f31d4103ab0 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d9400640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d4103ab0 0x7f31d419a430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005940 tx=0x7f31c80040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d2000640 1 -- 172.21.15.84:0/2479886903 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c803f030 con 0x7f31d4103ab0 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d41a05f0 con 0x7f31d4103ab0 2024-09-21T08:03:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d2000640 1 -- 172.21.15.84:0/2479886903 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c80044c0 con 0x7f31d4103ab0 2024-09-21T08:03:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31d2000640 1 -- 172.21.15.84:0/2479886903 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8035070 con 0x7f31d4103ab0 2024-09-21T08:03:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.523+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d41a6de0 con 0x7f31d4103ab0 2024-09-21T08:03:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.524+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d4103ec0 con 0x7f31d4103ab0 2024-09-21T08:03:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.527+0000 7f31d2000640 1 -- 172.21.15.84:0/2479886903 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f31c8042030 con 0x7f31d4103ab0 2024-09-21T08:03:00.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.529+0000 7f31d2000640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31bc0b6700 0x7f31bc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.529+0000 7f31d2000640 1 -- 172.21.15.84:0/2479886903 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f31c81080a0 con 0x7f31d4103ab0 2024-09-21T08:03:00.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.529+0000 7f31d8a00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31bc0b6700 0x7f31bc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.529+0000 7f31d8a00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31bc0b6700 0x7f31bc0b8c10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f31d4108f30 tx=0x7f31c0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:00.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.531+0000 7f31d2000640 1 -- 172.21.15.84:0/2479886903 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31c80d25e0 con 0x7f31d4103ab0 2024-09-21T08:03:00.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.720+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f31d410bb60 con 0x7f31d4103ab0 2024-09-21T08:03:00.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.721+0000 7f31d2000640 1 -- 172.21.15.84:0/2479886903 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) ==== 100+0+11 (secure 0 0 0) 0x7f31c80d7520 con 0x7f31d4103ab0 2024-09-21T08:03:00.723 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-09-21T08:03:00.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.723+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31bc0b6700 msgr2=0x7f31bc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.723+0000 7f31dbe00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31bc0b6700 0x7f31bc0b8c10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f31d4108f30 tx=0x7f31c0005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.723+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d4103ab0 msgr2=0x7f31d419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.723+0000 7f31dbe00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d4103ab0 0x7f31d419a430 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005940 tx=0x7f31c80040c0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 shutdown_connections 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f31bc0b6700 0x7f31bc0b8c10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d4109d30 0x7f31d419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31d41093e0 0x7f31d419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 --2- 172.21.15.84:0/2479886903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31d4103ab0 0x7f31d419a430 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 >> 172.21.15.84:0/2479886903 conn(0x7f31d40ff4d0 msgr2=0x7f31d41018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 shutdown_connections 2024-09-21T08:03:00.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.724+0000 7f31dbe00640 1 -- 172.21.15.84:0/2479886903 wait complete. 2024-09-21T08:03:00.748 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T08:03:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 -- 172.21.15.84:0/3175488191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed41038f0 msgr2=0x7f9ed4103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/3175488191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed41038f0 0x7f9ed4103d00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009900 tx=0x7f9ec402a410 comp rx=0 tx=0).stop 2024-09-21T08:03:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 -- 172.21.15.84:0/3175488191 shutdown_connections 2024-09-21T08:03:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/3175488191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed4109b70 0x7f9ed41103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/3175488191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ed4109220 0x7f9ed4109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/3175488191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed41038f0 0x7f9ed4103d00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 -- 172.21.15.84:0/3175488191 >> 172.21.15.84:0/3175488191 conn(0x7f9ed40ff350 msgr2=0x7f9ed41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 -- 172.21.15.84:0/3175488191 shutdown_connections 2024-09-21T08:03:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.968+0000 7f9ed3e00640 1 -- 172.21.15.84:0/3175488191 wait complete. 2024-09-21T08:03:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.969+0000 7f9ed3e00640 1 Processor -- start 2024-09-21T08:03:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.969+0000 7f9ed3e00640 1 -- start start 2024-09-21T08:03:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed41038f0 0x7f9ed419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4109220 0x7f9ed419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ed4109b70 0x7f9ed419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4113830 con 0x7f9ed4109220 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41136b0 con 0x7f9ed4109b70 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed3e00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41139b0 con 0x7f9ed41038f0 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4109220 0x7f9ed419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4109220 0x7f9ed419a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42234/0 (socket says 172.21.15.84:42234) 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed2000640 1 -- 172.21.15.84:0/2953691247 learned_addr learned my addr 172.21.15.84:0/2953691247 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed2a00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed41038f0 0x7f9ed419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.970+0000 7f9ed3400640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ed4109b70 0x7f9ed419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed2000640 1 -- 172.21.15.84:0/2953691247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed41038f0 msgr2=0x7f9ed419a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed2000640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed41038f0 0x7f9ed419a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed2000640 1 -- 172.21.15.84:0/2953691247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ed4109b70 msgr2=0x7f9ed419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed2000640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ed4109b70 0x7f9ed419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed2000640 1 -- 172.21.15.84:0/2953691247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed41a01a0 con 0x7f9ed4109220 2024-09-21T08:03:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed2000640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4109220 0x7f9ed419a810 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000e9f0 tx=0x7f9ec000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ecb400640 1 -- 172.21.15.84:0/2953691247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000ccc0 con 0x7f9ed4109220 2024-09-21T08:03:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ecb400640 1 -- 172.21.15.84:0/2953691247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ec00108e0 con 0x7f9ed4109220 2024-09-21T08:03:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed41a0490 con 0x7f9ed4109220 2024-09-21T08:03:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ecb400640 1 -- 172.21.15.84:0/2953691247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0018860 con 0x7f9ed4109220 2024-09-21T08:03:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.971+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed41a6c20 con 0x7f9ed4109220 2024-09-21T08:03:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.972+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed4103d00 con 0x7f9ed4109220 2024-09-21T08:03:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.977+0000 7f9ecb400640 1 -- 172.21.15.84:0/2953691247 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f9ec0010430 con 0x7f9ed4109220 2024-09-21T08:03:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.978+0000 7f9ecb400640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9eb80b6700 0x7f9eb80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.978+0000 7f9ecb400640 1 -- 172.21.15.84:0/2953691247 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7f9ec00e8220 con 0x7f9ed4109220 2024-09-21T08:03:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.978+0000 7f9ed2a00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9eb80b6700 0x7f9eb80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.979+0000 7f9ecb400640 1 -- 172.21.15.84:0/2953691247 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ec00a9fa0 con 0x7f9ed4109220 2024-09-21T08:03:00.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:00.979+0000 7f9ed2a00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9eb80b6700 0x7f9eb80b8c10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4031440 tx=0x7f9ec4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:01.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:00 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1650057828' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:03:01.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:00 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1605395252' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:03:01.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:00 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1650057828' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:03:01.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:00 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1605395252' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:03:01.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:00 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1650057828' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T08:03:01.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:00 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1605395252' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T08:03:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.174+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9ed402e640 con 0x7f9ed4109220 2024-09-21T08:03:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.174+0000 7f9ecb400640 1 -- 172.21.15.84:0/2953691247 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v100) ==== 103+0+11 (secure 0 0 0) 0x7f9ec00b2760 con 0x7f9ed4109220 2024-09-21T08:03:01.177 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T08:03:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9eb80b6700 msgr2=0x7f9eb80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9eb80b6700 0x7f9eb80b8c10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4031440 tx=0x7f9ec4009560 comp rx=0 tx=0).stop 2024-09-21T08:03:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4109220 msgr2=0x7f9ed419a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4109220 0x7f9ed419a810 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000e9f0 tx=0x7f9ec000eeb0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 shutdown_connections 2024-09-21T08:03:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f9eb80b6700 0x7f9eb80b8c10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ed4109b70 0x7f9ed419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4109220 0x7f9ed419a810 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 --2- 172.21.15.84:0/2953691247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed41038f0 0x7f9ed419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.177+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 >> 172.21.15.84:0/2953691247 conn(0x7f9ed40ff350 msgr2=0x7f9ed4101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.178+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 shutdown_connections 2024-09-21T08:03:01.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.178+0000 7f9ed3e00640 1 -- 172.21.15.84:0/2953691247 wait complete. 2024-09-21T08:03:01.201 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T08:03:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 -- 172.21.15.84:0/456077592 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 msgr2=0x7fe954103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 --2- 172.21.15.84:0/456077592 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 0x7fe954103d00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe948009860 tx=0x7fe94802a340 comp rx=0 tx=0).stop 2024-09-21T08:03:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 -- 172.21.15.84:0/456077592 shutdown_connections 2024-09-21T08:03:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 --2- 172.21.15.84:0/456077592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 0x7fe9541103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 --2- 172.21.15.84:0/456077592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe954109220 0x7fe954109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 --2- 172.21.15.84:0/456077592 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 0x7fe954103d00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 -- 172.21.15.84:0/456077592 >> 172.21.15.84:0/456077592 conn(0x7fe9540ff350 msgr2=0x7fe9541017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:01.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.416+0000 7fe95a400640 1 -- 172.21.15.84:0/456077592 shutdown_connections 2024-09-21T08:03:01.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.417+0000 7fe95a400640 1 -- 172.21.15.84:0/456077592 wait complete. 2024-09-21T08:03:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.417+0000 7fe95a400640 1 Processor -- start 2024-09-21T08:03:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe95a400640 1 -- start start 2024-09-21T08:03:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe95a400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 0x7fe95419c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe95a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe954109220 0x7fe95419ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe95a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 0x7fe9541a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe95a400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe954113830 con 0x7fe954109b70 2024-09-21T08:03:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe95a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9541136b0 con 0x7fe954109220 2024-09-21T08:03:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe95a400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe9541139b0 con 0x7fe9541038f0 2024-09-21T08:03:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe959a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 0x7fe9541a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe959000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 0x7fe95419c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe959a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 0x7fe9541a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42250/0 (socket says 172.21.15.84:42250) 2024-09-21T08:03:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe959a00640 1 -- 172.21.15.84:0/200767373 learned_addr learned my addr 172.21.15.84:0/200767373 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.418+0000 7fe953e00640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe954109220 0x7fe95419ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe959000640 1 -- 172.21.15.84:0/200767373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe954109220 msgr2=0x7fe95419ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe959000640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe954109220 0x7fe95419ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe959000640 1 -- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 msgr2=0x7fe9541a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe959000640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 0x7fe9541a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe959000640 1 -- 172.21.15.84:0/200767373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9541a2420 con 0x7fe9541038f0 2024-09-21T08:03:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe959a00640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 0x7fe9541a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:01.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe959000640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 0x7fe95419c4f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe948035040 tx=0x7fe948032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:01.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe951600640 1 -- 172.21.15.84:0/200767373 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948040020 con 0x7fe9541038f0 2024-09-21T08:03:01.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9541a26b0 con 0x7fe9541038f0 2024-09-21T08:03:01.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe951600640 1 -- 172.21.15.84:0/200767373 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe948030d50 con 0x7fe9541038f0 2024-09-21T08:03:01.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.419+0000 7fe951600640 1 -- 172.21.15.84:0/200767373 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948037040 con 0x7fe9541038f0 2024-09-21T08:03:01.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.420+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9541a8ea0 con 0x7fe9541038f0 2024-09-21T08:03:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.420+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe954104b60 con 0x7fe9541038f0 2024-09-21T08:03:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.423+0000 7fe951600640 1 -- 172.21.15.84:0/200767373 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fe948043020 con 0x7fe9541038f0 2024-09-21T08:03:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.424+0000 7fe951600640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe93c0b6680 0x7fe93c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.425+0000 7fe951600640 1 -- 172.21.15.84:0/200767373 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9432+0+0 (secure 0 0 0) 0x7fe948107d50 con 0x7fe9541038f0 2024-09-21T08:03:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.425+0000 7fe953e00640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe93c0b6680 0x7fe93c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.426+0000 7fe953e00640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe93c0b6680 0x7fe93c0b8b90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe954108cb0 tx=0x7fe940009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.427+0000 7fe951600640 1 -- 172.21.15.84:0/200767373 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe94804a020 con 0x7fe9541038f0 2024-09-21T08:03:01.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.661+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe9541a9110 con 0x7fe9541038f0 2024-09-21T08:03:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.671+0000 7fe951600640 1 -- 172.21.15.84:0/200767373 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+834054 (secure 0 0 0) 0x7fe9480cdf90 con 0x7fe9541038f0 2024-09-21T08:03:01.684 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:03:01.684 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:03:01.684 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 25, 2024-09-21T08:03:01.684 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.684 INFO:teuthology.orchestra.run.smithi084.stdout: "active_gid": 14223, 2024-09-21T08:03:01.684 INFO:teuthology.orchestra.run.smithi084.stdout: "active_name": "x", 2024-09-21T08:03:01.684 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addrs": { 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6800", 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2805742245 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6801", 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2805742245 2024-09-21T08:03:01.685 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addr": "172.21.15.84:6801/2805742245", 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "active_change": "2024-09-21T07:40:29.868319+0000", 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "available": true, 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "standbys": [ 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 24157, 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "z", 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr_features": 4540719139924082687, 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.686 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.688 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.689 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.690 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.691 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.692 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.693 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.694 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.700 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.701 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.702 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.703 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.704 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T08:03:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.706 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.707 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.708 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T08:03:01.710 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.711 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.712 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.713 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.714 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.716 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T08:03:01.717 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T08:03:01.718 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.719 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.720 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T08:03:01.721 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:01.722 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.723 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.724 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.725 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T08:03:01.726 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.728 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T08:03:01.728 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T08:03:01.728 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.728 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.728 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.728 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.728 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.729 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T08:03:01.730 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T08:03:01.731 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.732 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.733 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.734 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.735 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.737 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.739 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T08:03:01.740 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.742 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T08:03:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.744 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T08:03:01.747 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T08:03:01.748 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.749 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T08:03:01.750 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.751 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.752 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.753 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.754 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.756 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.757 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.758 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T08:03:01.759 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.760 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.762 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.763 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T08:03:01.764 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.765 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.766 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.767 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.769 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.770 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.771 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.772 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T08:03:01.773 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.776 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T08:03:01.777 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T08:03:01.778 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T08:03:01.779 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.780 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T08:03:01.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.784 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.785 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.786 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.787 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.788 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T08:03:01.789 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.790 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.791 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.792 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.793 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.794 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.795 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.796 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.797 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.798 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.799 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.800 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.801 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.802 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.803 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.804 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.805 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.806 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.807 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.808 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.809 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.810 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.811 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.812 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.813 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T08:03:01.814 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T08:03:01.815 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.816 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.817 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.818 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.819 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.820 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.821 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.822 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.823 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.825 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.826 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.827 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T08:03:01.828 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T08:03:01.829 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T08:03:01.830 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.831 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.833 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.834 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.835 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.836 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T08:03:01.837 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.838 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.840 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.841 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.842 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T08:03:01.843 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.844 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.845 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.846 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.847 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.848 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.849 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.850 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T08:03:01.851 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T08:03:01.852 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.853 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.854 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:01.855 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T08:03:01.857 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.859 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.860 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.861 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.862 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.863 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.864 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.865 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.866 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.868 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.869 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.870 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:01.871 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.873 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.874 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.875 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.877 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.880 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.881 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.882 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.883 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.884 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.887 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.888 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T08:03:01.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.891 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T08:03:01.893 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.894 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:01.895 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.898 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.899 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.900 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.902 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.903 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.904 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.905 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.906 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.907 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T08:03:01.910 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.911 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.912 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T08:03:01.913 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T08:03:01.914 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.915 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.916 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.917 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.919 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.920 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.921 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.922 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.923 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.924 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.925 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T08:03:01.926 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.927 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.928 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.930 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.931 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.933 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.934 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.935 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.936 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T08:03:01.937 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.938 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.940 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.941 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.942 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.943 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.944 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T08:03:01.945 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.947 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.948 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.949 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.950 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.951 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.952 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.954 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.955 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.956 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.957 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.958 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.959 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T08:03:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.963 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.964 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.965 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T08:03:01.966 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.967 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.968 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.969 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.970 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.973 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.974 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.975 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.976 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.977 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.978 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.979 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.980 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.981 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.982 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.983 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.984 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.986 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.987 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.988 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.989 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.990 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.991 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.992 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.993 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:01.994 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.995 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.996 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:01.997 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:01.998 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:01.999 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.000 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.001 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.002 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.003 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.004 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T08:03:02.005 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.006 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.007 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.008 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.009 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.010 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.012 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.013 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.014 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.015 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.016 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.017 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.018 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.019 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T08:03:02.020 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.021 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.024 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.025 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.026 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.028 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.029 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.030 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.032 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.033 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.034 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.035 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.036 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.037 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.038 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.039 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.040 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.041 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.042 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.043 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.044 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:02.045 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.047 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.048 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.049 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.050 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.051 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.052 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.053 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.054 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.055 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.056 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.058 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.059 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.060 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T08:03:02.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.062 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.063 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.064 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.065 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.066 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.067 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.068 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.070 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.071 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.072 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.073 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.074 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.075 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.076 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.077 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.078 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.079 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.080 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T08:03:02.081 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.083 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.085 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.086 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.088 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.089 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.090 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.091 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.092 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.093 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.094 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.095 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.096 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.097 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.098 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.099 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.100 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T08:03:02.101 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.102 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T08:03:02.103 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T08:03:02.104 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T08:03:02.105 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.107 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.108 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.109 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.110 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.111 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.112 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.113 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.114 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.115 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.116 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.117 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.118 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.119 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.120 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.121 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.122 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.123 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.125 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.126 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.127 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.130 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.132 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.133 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.134 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.135 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.137 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.138 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.139 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.140 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.142 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.143 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.144 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.145 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.147 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.148 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T08:03:02.149 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.150 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.152 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.153 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.154 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.155 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.156 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.157 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.158 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.161 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T08:03:02.162 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T08:03:02.163 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.165 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.166 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.167 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.168 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.169 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.170 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.171 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.172 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.173 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.174 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.175 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.177 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T08:03:02.178 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.179 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.181 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.182 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.183 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.184 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.186 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.187 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.188 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.189 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.190 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.191 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.192 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.193 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.194 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.195 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.196 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.197 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.198 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.199 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.200 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.201 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.202 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.203 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.204 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.205 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.206 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.208 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.209 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.210 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.211 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T08:03:02.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T08:03:02.213 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T08:03:02.214 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 24164, 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "y", 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr_features": 4540719139924082687, 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.216 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.218 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.219 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.220 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.223 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.224 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T08:03:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.225 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T08:03:02.226 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.227 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.229 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T08:03:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T08:03:02.231 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T08:03:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.233 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.235 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.236 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T08:03:02.237 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.238 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T08:03:02.240 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T08:03:02.241 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.242 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.243 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.244 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.247 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.248 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.249 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.250 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T08:03:02.251 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.252 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T08:03:02.253 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.254 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.255 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.256 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T08:03:02.257 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.258 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.259 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T08:03:02.260 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.261 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.262 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T08:03:02.263 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T08:03:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T08:03:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T08:03:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.267 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.268 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.269 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.271 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T08:03:02.272 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.274 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T08:03:02.275 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T08:03:02.277 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.278 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.279 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T08:03:02.280 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T08:03:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T08:03:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T08:03:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T08:03:02.290 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.291 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.292 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.293 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.294 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.295 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.297 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.298 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.299 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T08:03:02.300 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.301 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.302 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.303 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.304 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.305 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.306 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.307 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.309 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.310 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.314 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.315 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.316 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.317 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.318 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.319 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.320 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T08:03:02.322 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T08:03:02.324 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.325 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.328 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.329 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.330 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.332 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.333 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.334 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.335 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.336 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.337 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T08:03:02.338 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.339 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T08:03:02.340 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.341 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T08:03:02.342 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.343 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.344 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.345 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.346 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.347 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T08:03:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.349 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.351 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.352 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.353 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.354 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.355 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T08:03:02.357 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.359 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.360 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.361 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.362 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.363 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T08:03:02.364 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.365 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.366 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.367 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:02.368 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.369 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T08:03:02.370 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.371 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.372 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.373 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.374 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.375 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.376 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T08:03:02.377 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T08:03:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.379 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.381 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.382 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.383 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.384 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.385 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T08:03:02.386 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.387 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.389 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.390 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.391 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T08:03:02.392 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.394 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.395 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.396 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.397 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.398 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.399 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.400 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.401 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.402 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.404 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.404 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.404 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.404 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.405 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.405 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.405 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.405 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.406 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.407 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.408 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.409 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.410 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.412 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.413 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.414 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.416 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.417 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.418 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.419 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T08:03:02.420 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.421 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T08:03:02.422 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.425 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T08:03:02.426 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T08:03:02.427 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.428 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.430 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.431 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.432 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.433 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.434 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.435 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.436 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.437 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.438 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.439 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T08:03:02.440 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.441 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.442 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.443 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.444 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.445 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.446 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.447 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.449 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.450 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.451 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.452 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.453 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.454 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.455 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.456 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T08:03:02.457 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.458 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.460 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.461 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.462 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.466 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.467 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.468 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.469 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.470 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.471 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.472 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T08:03:02.473 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.474 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.475 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.477 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.478 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.479 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.480 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.481 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.482 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.484 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.485 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.486 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.487 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.488 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.490 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.491 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T08:03:02.492 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.494 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.495 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.496 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.498 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.499 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.500 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T08:03:02.501 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.502 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.503 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.504 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.505 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.506 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T08:03:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.510 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.511 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.512 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.513 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.514 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.515 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.517 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.518 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.519 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.520 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.521 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.523 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.524 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.525 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.526 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.528 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.529 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.530 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.531 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.532 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.533 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T08:03:02.538 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.539 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.540 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.541 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.542 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.543 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.544 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T08:03:02.545 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T08:03:02.546 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.547 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.549 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.550 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.551 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.552 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.555 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.556 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.557 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.559 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.560 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.561 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.562 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.564 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.566 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.567 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.568 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.569 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.570 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T08:03:02.571 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.573 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.575 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.576 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.577 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.578 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.581 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.582 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.583 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.584 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.585 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.586 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.587 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.589 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.590 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.591 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.592 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.594 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.595 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.596 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.598 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.599 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.600 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.602 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.603 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.604 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.605 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.606 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.607 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.608 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.608 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.609 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.609 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.609 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.610 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.611 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.612 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.612 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T08:03:02.612 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T08:03:02.612 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.613 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.614 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.614 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.614 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.614 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.615 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.616 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.617 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.618 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T08:03:02.619 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.620 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.621 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.622 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.623 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.624 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.626 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.627 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.628 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.629 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.631 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.632 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.634 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.635 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.636 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T08:03:02.638 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.639 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.640 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.641 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.642 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.643 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.644 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.645 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.646 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.647 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.649 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.650 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.651 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.652 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.653 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.654 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.655 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.657 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.658 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.658 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.658 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.658 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T08:03:02.658 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T08:03:02.658 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.660 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.662 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.663 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T08:03:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.667 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.669 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.670 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.671 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.673 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.675 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.676 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.677 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.679 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.682 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.683 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T08:03:02.684 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.685 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.686 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.687 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.688 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.689 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.691 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.692 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.693 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.694 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.696 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.697 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.698 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.699 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.700 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.701 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.702 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T08:03:02.703 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.704 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.705 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.706 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.707 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.708 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.709 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.710 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.711 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.712 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.713 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.714 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.715 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.716 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.717 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T08:03:02.720 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.721 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.722 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T08:03:02.723 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.724 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T08:03:02.726 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.727 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.728 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.729 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.730 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T08:03:02.731 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.733 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.734 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.735 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.737 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.738 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.739 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.741 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.742 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.743 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.744 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.745 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.746 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.748 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.749 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.750 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.752 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.753 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.753 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.753 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.753 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.753 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.753 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.754 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.755 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.756 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.757 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.758 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T08:03:02.759 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.760 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.761 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.762 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.763 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.764 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.765 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T08:03:02.766 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.768 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.769 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.770 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.771 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T08:03:02.772 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.773 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.774 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.775 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.776 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.778 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.779 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.780 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.781 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.782 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.783 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.784 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T08:03:02.785 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "modules": [ 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "dashboard", 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "iostat", 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "nfs", 2024-09-21T08:03:02.787 INFO:teuthology.orchestra.run.smithi084.stdout: "restful", 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "snap_schedule" 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.789 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.790 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.791 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.792 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.793 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.794 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T08:03:02.795 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T08:03:02.798 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.799 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T08:03:02.802 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.803 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.804 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.805 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.806 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.807 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.808 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.809 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.810 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T08:03:02.811 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T08:03:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.812 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T08:03:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T08:03:02.813 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T08:03:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T08:03:02.815 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T08:03:02.816 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.818 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.819 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.820 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.821 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.822 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T08:03:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T08:03:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T08:03:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T08:03:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.845 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.847 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.848 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T08:03:02.849 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T08:03:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T08:03:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.855 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T08:03:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.857 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T08:03:02.858 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.859 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T08:03:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.862 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.863 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T08:03:02.864 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.865 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T08:03:02.866 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.867 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.869 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.871 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.872 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.874 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.875 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.876 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:02.877 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T08:03:02.878 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.879 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.880 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.881 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.882 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.883 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.884 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.885 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.886 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.888 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.889 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.890 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.891 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.892 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T08:03:02.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.895 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.896 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.897 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.898 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T08:03:02.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.900 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.901 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.902 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.903 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.906 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.907 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T08:03:02.908 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.909 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.910 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.911 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T08:03:02.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.914 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.915 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.917 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.918 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.919 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.921 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.922 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.924 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.925 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T08:03:02.928 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.930 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.932 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T08:03:02.933 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.935 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.936 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.937 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.938 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.939 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.942 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.943 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.944 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:02.945 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.946 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T08:03:02.947 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.949 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.950 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.951 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T08:03:02.952 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.953 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T08:03:02.954 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T08:03:02.955 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.958 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.959 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.960 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T08:03:02.961 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.962 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.965 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.966 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.967 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.968 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.969 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T08:03:02.970 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.971 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.972 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.973 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T08:03:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T08:03:02.975 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T08:03:02.976 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.978 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.979 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.980 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.981 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.982 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.983 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.984 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.985 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T08:03:02.988 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.990 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.991 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.992 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.993 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.994 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.995 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:02.996 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T08:03:02.997 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T08:03:02.998 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T08:03:02.999 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.000 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.002 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.003 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.004 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.006 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.007 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.008 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T08:03:03.011 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.012 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.013 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.014 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.015 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.016 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.017 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.017 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T08:03:03.017 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.018 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.020 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.022 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.026 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.028 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T08:03:03.029 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.030 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T08:03:03.031 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T08:03:03.032 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T08:03:03.033 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.034 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.035 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.036 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.037 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.038 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.039 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.040 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.041 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T08:03:03.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T08:03:03.043 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T08:03:03.044 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.045 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.046 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.047 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.048 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.049 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.050 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.051 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.052 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.054 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.055 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.056 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.057 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.058 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.059 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.060 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T08:03:03.061 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.062 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.064 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.065 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.068 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.069 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.070 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.071 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.072 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.073 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.074 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.075 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.076 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.077 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T08:03:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.082 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.083 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.085 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.086 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.087 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.088 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.090 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.091 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.092 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.094 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.095 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.097 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.098 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.100 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.101 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.102 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.103 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.106 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T08:03:03.107 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.108 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.109 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.110 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.111 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.112 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.113 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.114 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.116 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.117 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.118 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.120 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.121 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.122 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.123 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T08:03:03.124 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.125 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.126 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.128 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.129 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.132 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.133 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.134 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.135 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.137 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:03.138 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.139 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T08:03:03.140 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.141 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.142 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T08:03:03.143 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.144 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.145 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.146 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.147 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.148 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.149 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.150 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T08:03:03.151 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.153 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.154 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.156 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.158 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.159 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.160 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.162 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.163 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T08:03:03.164 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T08:03:03.165 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.167 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T08:03:03.168 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.170 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T08:03:03.171 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T08:03:03.172 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.174 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.175 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.176 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.177 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.178 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.179 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.180 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.181 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.182 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T08:03:03.183 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.184 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T08:03:03.186 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.187 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.188 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.189 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.190 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.191 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.192 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.193 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T08:03:03.194 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T08:03:03.195 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.196 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.197 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.198 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.199 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.200 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.202 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.203 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.204 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.207 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.208 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.209 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.210 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.211 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.212 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.213 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.214 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.215 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.216 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.217 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.218 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.219 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.220 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.221 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.222 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.223 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.225 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.226 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T08:03:03.227 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.228 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.230 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.231 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.232 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T08:03:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.236 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.237 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.238 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.240 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.241 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.242 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.244 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.245 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.247 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.250 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.251 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.252 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.253 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.255 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.259 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.260 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.261 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.262 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.263 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.265 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.267 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.268 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.269 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.271 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.272 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.274 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T08:03:03.275 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.277 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.278 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T08:03:03.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T08:03:03.281 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:03.282 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.283 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.285 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.288 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.289 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.290 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.291 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.297 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.298 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.300 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.302 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.304 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.306 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.311 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.313 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.314 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.315 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T08:03:03.316 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.317 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.318 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T08:03:03.319 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T08:03:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T08:03:03.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "services": { 2024-09-21T08:03:03.322 INFO:teuthology.orchestra.run.smithi084.stdout: "dashboard": "https://172.21.15.84:8443/" 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "always_on_modules": { 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "octopus": [ 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pacific": [ 2024-09-21T08:03:03.323 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "quincy": [ 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T08:03:03.324 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "reef": [ 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T08:03:03.325 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "squid": [ 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T08:03:03.326 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "last_failure_osd_epoch": 5, 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "active_clients": [ 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1459844307 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "libcephsqlite", 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3175774447 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T08:03:03.328 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2619465182 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1386360389 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1458318127 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T08:03:03.330 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T08:03:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2595460637 2024-09-21T08:03:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:03.331 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T08:03:03.331 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe93c0b6680 msgr2=0x7fe93c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe93c0b6680 0x7fe93c0b8b90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe954108cb0 tx=0x7fe940009260 comp rx=0 tx=0).stop 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 msgr2=0x7fe95419c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 0x7fe95419c4f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe948035040 tx=0x7fe948032d50 comp rx=0 tx=0).stop 2024-09-21T08:03:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 shutdown_connections 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fe93c0b6680 0x7fe93c0b8b90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe954109b70 0x7fe9541a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe954109220 0x7fe95419ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 --2- 172.21.15.84:0/200767373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9541038f0 0x7fe95419c4f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.678+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 >> 172.21.15.84:0/200767373 conn(0x7fe9540ff350 msgr2=0x7fe95410e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.679+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 shutdown_connections 2024-09-21T08:03:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:01.679+0000 7fe95a400640 1 -- 172.21.15.84:0/200767373 wait complete. 2024-09-21T08:03:03.339 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T08:03:03.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T08:03:03.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:01 smithi084 ceph-mon[30411]: pgmap v763: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 KiB/s wr, 84 op/s 2024-09-21T08:03:03.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:01 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2479886903' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:03:03.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:01 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2953691247' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:03:03.340 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:01 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/200767373' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:01 smithi191 ceph-mon[34667]: pgmap v763: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 KiB/s wr, 84 op/s 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:01 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2479886903' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:01 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2953691247' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:01 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/200767373' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:01 smithi162 ceph-mon[34833]: pgmap v763: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 KiB/s wr, 84 op/s 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:01 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2479886903' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:01 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2953691247' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T08:03:03.341 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:01 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/200767373' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T08:03:03.725 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:04.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:03 smithi084 ceph-mon[30411]: pgmap v764: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.6 KiB/s wr, 36 op/s 2024-09-21T08:03:04.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:03 smithi162 ceph-mon[34833]: pgmap v764: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.6 KiB/s wr, 36 op/s 2024-09-21T08:03:04.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:03 smithi191 ceph-mon[34667]: pgmap v764: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.6 KiB/s wr, 36 op/s 2024-09-21T08:03:04.461 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:03:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 839, 2024-09-21T08:03:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 838, 2024-09-21T08:03:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 283627, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 265661, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 6, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.203279699, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.094845750, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.037164946, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.048790753, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 837, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.189600587, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000226523 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1828, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 1822, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1279315, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 651529, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 3, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.303583996, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.136512593, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.094429935, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.073530526, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1821, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.287880174, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000158089 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 883232, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 157936 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 5, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 195, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1668, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 501621, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 6, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.031138807, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.024507051, 2024-09-21T08:03:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.004023479, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000083010, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 193, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.074693291, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000387011 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 500656 2024-09-21T08:03:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3866, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.172194436, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000044540 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-21T08:03:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 0, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 0, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 0, 2024-09-21T08:03:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 1, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:03:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 0 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 0, 2024-09-21T08:03:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:03:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_write_failed": 0 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 0, 2024-09-21T08:03:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 3, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 0, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 0, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 0, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 0, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 2, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 2, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 0, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 4194304, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 4195203, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 4194892, 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-09-21T08:03:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 3 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 3, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 3, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 0, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 1, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 1, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 0, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 0, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 0, 2024-09-21T08:03:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 115932, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 316420096 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-09-21T08:03:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-09-21T08:03:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 1, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 1, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 0, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 1, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-09-21T08:03:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 1956, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 198231, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 55, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 9456, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 192, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T08:03:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 8672, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 13, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 2389, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 21, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 3, 2024-09-21T08:03:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 2389, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2389, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 36.550374743, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.015299445 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2389, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 2390 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 2389, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 2389, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 0, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-09-21T08:03:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 1549, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 838, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 1, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 0, 2024-09-21T08:03:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-09-21T08:03:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 100, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 14, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 6, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 6, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 0, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 2, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 0 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 0, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-09-21T08:03:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 2668, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1307295, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 2668, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 2668, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1307295, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 2389, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 904, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 2389, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 904, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 2389, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 2389, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 2389, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 2389, 2024-09-21T08:03:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x56089119d450": { 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "trackedop": { 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 0 2024-09-21T08:03:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:04.507 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:03:05.560 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T08:03:05.560 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T08:03:05.560 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-21T08:03:05.560 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-21T08:03:05.560 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-21T08:03:05.560 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:05.560 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:05.560 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T08:03:05.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T08:03:05.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:05 smithi084 ceph-mon[30411]: pgmap v765: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 21 KiB/s rd, 48 KiB/s wr, 30 op/s 2024-09-21T08:03:05.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:05 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:03:05.949 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:06.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:05 smithi162 ceph-mon[34833]: pgmap v765: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 21 KiB/s rd, 48 KiB/s wr, 30 op/s 2024-09-21T08:03:06.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:05 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:03:06.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:05 smithi191 ceph-mon[34667]: pgmap v765: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 21 KiB/s rd, 48 KiB/s wr, 30 op/s 2024-09-21T08:03:06.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:05 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:03:06.685 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:03:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1851, 2024-09-21T08:03:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 1845, 2024-09-21T08:03:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 5549290, 2024-09-21T08:03:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 660564, 2024-09-21T08:03:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 5, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.358857551, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.148578315, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.110273794, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.082050576, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1844, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.380657516, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000206430 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 885024, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 161936 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 662, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 854, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 4742802, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 621890, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 5, 2024-09-21T08:03:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.195187164, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.086656949, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.047670942, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.047902356, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 853, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.148053931, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000173568 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 413216 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 560, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 562, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 4369968, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 178087, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 3, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.116727123, 2024-09-21T08:03:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.041778944, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.032934308, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.032970102, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 560, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.107375531, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000191742 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 4543, 2024-09-21T08:03:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.223989044, 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000049304 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 0, 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 0, 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-09-21T08:03:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 149, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 44, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 105, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 86, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 0, 2024-09-21T08:03:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 2, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 0, 2024-09-21T08:03:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 4, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 234, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 6, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 0 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 0, 2024-09-21T08:03:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-09-21T08:03:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_write_failed": 0 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-09-21T08:03:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 2107, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 0, 2024-09-21T08:03:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 0, 2024-09-21T08:03:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 3, 2024-09-21T08:03:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 39, 2024-09-21T08:03:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-09-21T08:03:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 0, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 15736567, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 17154416, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 17154332, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 2107 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-09-21T08:03:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 106, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 124, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 18, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 13, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 13, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 0, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 149, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 149, 2024-09-21T08:03:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 118296, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 319569920 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 0, 2024-09-21T08:03:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-09-21T08:03:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-09-21T08:03:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 2, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 4, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 2, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 2, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-09-21T08:03:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 1961, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 194299, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 156, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 9456, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 192, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 411363, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 4526, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-09-21T08:03:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 2784, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 26, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 4, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 2784, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2784, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 14.831754428, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.005327497 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2784, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 2785 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 2784, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 2784, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 0, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 1712, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 0, 2024-09-21T08:03:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 1069, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 2, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 0, 2024-09-21T08:03:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-09-21T08:03:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-09-21T08:03:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 100, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 14, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 5, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 5, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 0, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 2, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 0 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-09-21T08:03:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 0, 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 3069, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 14368340, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 3069, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 3069, 2024-09-21T08:03:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 14368340, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 2784, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 12996128, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 2784, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 12996128, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-09-21T08:03:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 2784, 2024-09-21T08:03:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 2784, 2024-09-21T08:03:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 2784, 2024-09-21T08:03:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 2784, 2024-09-21T08:03:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-21T08:03:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-09-21T08:03:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-09-21T08:03:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x5576ab7ed6c0": { 2024-09-21T08:03:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-21T08:03:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-21T08:03:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-21T08:03:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-09-21T08:03:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-09-21T08:03:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "trackedop": { 2024-09-21T08:03:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 0 2024-09-21T08:03:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:06.742 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:03:07.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:03:07.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:03:07.040 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:06 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:03:07.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:03:07.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:03:07.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:06 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:03:07.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:03:07.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:03:07.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:06 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' 2024-09-21T08:03:07.948 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-09-21T08:03:07.948 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-09-21T08:03:07.948 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update=0 2024-09-21T08:03:07.948 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update_receipt=0 2024-09-21T08:03:07.948 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=6 2024-09-21T08:03:07.949 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:07.949 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:07.949 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T08:03:07.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T08:03:07.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:07 smithi084 ceph-mon[30411]: pgmap v766: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-21T08:03:08.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:07 smithi162 ceph-mon[34833]: pgmap v766: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-21T08:03:08.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:07 smithi191 ceph-mon[34667]: pgmap v766: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-21T08:03:08.320 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T08:03:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.003458999, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000532712, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 258, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 253, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 848544, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 155920, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.086491064, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.044314853, 2024-09-21T08:03:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.051691468, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 252, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.045851623, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000181950 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 848544, 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 155920 2024-09-21T08:03:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 6, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 196, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 3312, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 195424, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.033621055, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.025658931, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.005137892, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 195, 2024-09-21T08:03:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.050956738, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000261316 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 195424 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T08:03:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 149735, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 30, 2024-09-21T08:03:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T08:03:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 260, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 812083, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 260, 2024-09-21T08:03:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 260, 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 812083, 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:09.803 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:03:10.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:09 smithi162 ceph-mon[34833]: pgmap v767: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T08:03:10.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:09 smithi162 ceph-mon[34833]: osdmap e101: 12 total, 12 up, 12 in 2024-09-21T08:03:10.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:09 smithi084 ceph-mon[30411]: pgmap v767: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T08:03:10.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:09 smithi084 ceph-mon[30411]: osdmap e101: 12 total, 12 up, 12 in 2024-09-21T08:03:10.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:09 smithi191 ceph-mon[34667]: pgmap v767: 129 pgs: 129 active+clean; 26 GiB data, 59 GiB used, 1013 GiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-21T08:03:10.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:09 smithi191 ceph-mon[34667]: osdmap e101: 12 total, 12 up, 12 in 2024-09-21T08:03:11.285 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T08:03:11.285 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T08:03:11.286 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T08:03:11.286 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T08:03:11.286 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T08:03:11.286 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T08:03:11.286 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T08:03:11.286 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T08:03:11.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T08:03:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:12.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:11 smithi162 ceph-mon[34833]: pgmap v769: 129 pgs: 7 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 103 active+clean; 26 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T08:03:12.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:11 smithi084 ceph-mon[30411]: pgmap v769: 129 pgs: 7 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 103 active+clean; 26 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T08:03:12.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:11 smithi191 ceph-mon[34667]: pgmap v769: 129 pgs: 7 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 103 active+clean; 26 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T08:03:12.890 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T08:03:12.890 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:12.890 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-09-21T08:03:12.890 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-09-21T08:03:12.890 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:03:12.890 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-09-21T08:03:12.890 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.003514404, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.001010640, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:12.891 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 264, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 259, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 850176, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 159760, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T08:03:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.074101097, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.040473633, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.041563078, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 258, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.060452092, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000234310 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 850176, 2024-09-21T08:03:12.893 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 159760 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 6, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 200, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 3312, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 196128, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.034379616, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.026296528, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.005368125, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:12.894 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 199, 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.046617399, 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000234258 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 196128 2024-09-21T08:03:12.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:12.896 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:12.897 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 147920, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 27, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:12.898 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T08:03:12.899 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 266, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 812863, 2024-09-21T08:03:12.900 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 266, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 266, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 812863, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T08:03:12.901 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T08:03:13.660 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T08:03:13.660 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T08:03:13.660 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T08:03:13.660 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T08:03:13.660 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T08:03:13.660 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T08:03:13.661 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T08:03:13.661 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T08:03:13.661 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T08:03:14.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:13 smithi162 ceph-mon[34833]: pgmap v770: 129 pgs: 12 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 85 active+clean; 24 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T08:03:14.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:13 smithi084 ceph-mon[30411]: pgmap v770: 129 pgs: 12 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 85 active+clean; 24 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T08:03:14.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:13 smithi191 ceph-mon[34667]: pgmap v770: 129 pgs: 12 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 85 active+clean; 24 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-21T08:03:14.216 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 6052, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 6486, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1835846, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 12454278, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 179, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 8, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.687496627, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.281365487, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.314915006, 2024-09-21T08:03:15.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.099984303, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6485, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.542835272, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000083706 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5178, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001482210, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000286 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 58912, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 32768 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.414 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 3492, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4125, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1836751, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 6815931, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 61, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 7, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.377668597, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.165742076, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.166661505, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.056155489, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4124, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.858703688, 2024-09-21T08:03:15.415 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000208221 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2857, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000855671, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000299 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 932848, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 185776 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4663, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 5450, 2024-09-21T08:03:15.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1594111, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 2851816, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 18, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 7, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.491763552, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.199085147, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.220907181, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.090384673, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5448, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.746300640, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000136986 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:15.417 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6830, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001419914, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000207 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 392720, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 559424 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:15.418 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2307, 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.154014727, 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000500223 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2524, 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.098863992, 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000039169 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-21T08:03:15.419 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 384, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 384, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 384, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 24.428925736, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.063616994 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 278, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-21T08:03:15.420 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 141, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 48, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 93, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 72, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 2, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 2, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 2, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 978, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 962, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:15.421 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 105, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 419, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 6, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 419, 2024-09-21T08:03:15.422 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 147, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 14, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 133, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 272, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 430, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 493, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 1841, 2024-09-21T08:03:15.423 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 1464, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 8, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 53 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 23, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 48, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 4, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 22, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 18, 2024-09-21T08:03:15.424 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 11, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 342, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 14, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:15.425 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_started": 0, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_write_failed": 0 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 2109, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 1924, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 1924, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 185, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 53, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 57, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 42, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 39, 2024-09-21T08:03:15.426 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 39, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 3, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 1, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 1, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 15736567, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 17154612, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 916, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 3.831715155, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.004183095 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-09-21T08:03:15.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 115, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 147, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 32, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 22, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 22, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 0, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 141, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 159, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 18, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 2, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 56, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 54, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 131968, 2024-09-21T08:03:15.428 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 345915392 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 571, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 384, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 30, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 22, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.020571000, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000935045 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 190, 2024-09-21T08:03:15.429 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.510348961, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002686047 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-21T08:03:15.430 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 86, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.254724249, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002961909 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.432 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 13, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.002316347, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000178180 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 10, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.014369338, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001436933 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 13, 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.087141633, 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.006703202 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000766963, 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000383481 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-21T08:03:15.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.178312137, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.035662427 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.002404505, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001202252 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:15.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.044981186, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.011245296 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.034478855, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.004925550 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001411694, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000705847 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.437 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 10, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.024955684, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002495568 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.438 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 18, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 23.252143184, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 1.291785732 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.439 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 2, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 4, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 2, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 2, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 64, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 32, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 746, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:15.440 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:15.441 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:15.442 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 368545, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 154, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:15.443 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 9696, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 198, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 433837, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 4203, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.444 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 5036, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 13993769, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 33, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 5036, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5036, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 122.571424158, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.024339043 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5036, 2024-09-21T08:03:15.445 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 5699 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 5036, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 448, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 4588, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 256, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 66, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 15, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 917, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 113, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-21T08:03:15.446 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 3113, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 433, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 110, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:15.447 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-21T08:03:15.448 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 101, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 24, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 12, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 12, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 658, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 18 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.449 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 520, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 4, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 2596, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 18, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.450 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 14203, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 3964414, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 14203, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 14203, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 3964414, 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 5036, 2024-09-21T08:03:15.452 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 13996595, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 5036, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 13996595, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:15.453 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 5036, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 5036, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 5036, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 5036, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:15.454 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 18, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 2826, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 18, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2826, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.455 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x5610af16b380": { 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2109, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 12960308, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2109, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 916, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 12960308, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:15.456 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:15.457 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:15.457 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:15.457 INFO:teuthology.orchestra.run.smithi162.stdout: "trackedop": { 2024-09-21T08:03:15.457 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 358 2024-09-21T08:03:15.457 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:15.457 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T08:03:16.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:15 smithi162 ceph-mon[34833]: pgmap v771: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 21 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-21T08:03:16.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:15 smithi084 ceph-mon[30411]: pgmap v771: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 21 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-21T08:03:16.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:15 smithi191 ceph-mon[34667]: pgmap v771: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 21 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 4.7 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-21T08:03:16.360 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T08:03:16.360 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T08:03:16.360 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=23 2024-09-21T08:03:16.360 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-21T08:03:16.360 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T08:03:16.360 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=13 2024-09-21T08:03:16.360 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=7 2024-09-21T08:03:16.360 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T08:03:16.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T08:03:16.654 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T08:03:17.412 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T08:03:17.412 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:17.412 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 2564, 2024-09-21T08:03:17.412 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2566, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 726184, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 815359, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.222248304, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.097113047, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.046560276, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.065048458, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2564, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.079371425, 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000030956 2024-09-21T08:03:17.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:03:17.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.415 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:17.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 8, 2024-09-21T08:03:17.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 202, 2024-09-21T08:03:17.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 3868, 2024-09-21T08:03:17.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 506170, 2024-09-21T08:03:17.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-21T08:03:17.415 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-21T08:03:17.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.017159280, 2024-09-21T08:03:17.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.011667240, 2024-09-21T08:03:17.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.003681800, 2024-09-21T08:03:17.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000065866, 2024-09-21T08:03:17.416 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:17.416 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 201, 2024-09-21T08:03:17.416 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.017177031, 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000085457 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.417 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 505472 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 286, 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 280, 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 886988, 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 163550, 2024-09-21T08:03:17.418 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-21T08:03:17.419 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T08:03:17.419 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.046964003, 2024-09-21T08:03:17.419 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.021822461, 2024-09-21T08:03:17.419 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.034751525, 2024-09-21T08:03:17.419 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000022596, 2024-09-21T08:03:17.419 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:17.420 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 279, 2024-09-21T08:03:17.420 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.015512329, 2024-09-21T08:03:17.420 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000055599 2024-09-21T08:03:17.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.420 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:17.420 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.420 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 886720, 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 163232 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T08:03:17.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4321, 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.102277216, 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000023669 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.422 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-21T08:03:17.423 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-21T08:03:17.424 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-09-21T08:03:17.425 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:17.426 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-21T08:03:17.427 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:03:17.428 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_started": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_write_failed": 0 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-21T08:03:17.429 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 5, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 2, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4195735, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 4195424, 2024-09-21T08:03:17.430 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 5 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 3, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 1, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 1, 2024-09-21T08:03:17.431 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 116752, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 316420096 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-21T08:03:17.432 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.433 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.434 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-21T08:03:17.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.434 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.434 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.434 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-21T08:03:17.434 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.435 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.435 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.435 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:17.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.435 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.435 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-21T08:03:17.436 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.437 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.438 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.439 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-21T08:03:17.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.439 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.439 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.439 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.440 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-21T08:03:17.440 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.440 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.440 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.440 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.440 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-21T08:03:17.440 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.441 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.442 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:17.443 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:17.444 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.445 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.446 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-21T08:03:17.447 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 2206, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:17.448 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:17.449 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:17.450 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 181304, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 46, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 9696, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 198, 2024-09-21T08:03:17.451 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 8672, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 13, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-21T08:03:17.452 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2567, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2567, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2567, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.617965652, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000630294 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2567, 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2568 2024-09-21T08:03:17.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2567, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 2567, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 1677, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 888, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-21T08:03:17.454 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:17.455 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-21T08:03:17.456 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 101, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 15, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 4, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 4, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-21T08:03:17.457 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.458 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2854, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1342519, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2854, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2854, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1342519, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.459 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2567, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 1436, 2024-09-21T08:03:17.460 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2567, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1436, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:17.461 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2567, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2567, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2567, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2567, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55e7ba2495f0": { 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-21T08:03:17.464 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: "trackedop": { 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:17.465 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T08:03:18.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:17 smithi162 ceph-mon[34833]: pgmap v772: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:18.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:17 smithi084 ceph-mon[30411]: pgmap v772: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:18.154 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:17 smithi191 ceph-mon[34667]: pgmap v772: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:18.249 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T08:03:18.249 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T08:03:18.249 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T08:03:18.249 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T08:03:18.249 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-21T08:03:18.249 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:18.249 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:18.249 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T08:03:18.250 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T08:03:18.504 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T08:03:18.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:18 smithi162 ceph-mon[34833]: osdmap e102: 12 total, 12 up, 12 in 2024-09-21T08:03:18.925 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:18 smithi162 ceph-mon[34833]: pgmap v774: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2024-09-21T08:03:19.056 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 108, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 116, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 32785, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 402076, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 43, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 6, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.025678116, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.004447346, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.016600674, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000347873, 2024-09-21T08:03:19.057 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 110, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.020460804, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000186007 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 138, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000036566, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000264 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 736 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.058 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1849, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1398, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 508037, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 697620, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 10, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.164972937, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.087053454, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.088099173, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.004440638, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1399, 2024-09-21T08:03:19.059 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.078133953, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000055849 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2873, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000629975, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000219 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 416528 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 444, 2024-09-21T08:03:19.060 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 432, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 954218, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 247626, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 9, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.059327535, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.027603918, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.042660513, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000179224, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 433, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.037336511, 2024-09-21T08:03:19.061 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000086227 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 206, 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000036364, 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000176 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 905856, 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 167568 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-21T08:03:19.062 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 55, 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001448264, 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000026332 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.063 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-09-21T08:03:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000023565, 2024-09-21T08:03:19.064 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000011782 2024-09-21T08:03:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-21T08:03:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-21T08:03:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-21T08:03:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-21T08:03:19.065 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-21T08:03:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-21T08:03:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:19.066 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 11, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 16, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 16, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 13, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 8, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 3, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 33, 2024-09-21T08:03:19.067 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 28, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 5, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:19.068 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 22, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 10738142814, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 6, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:03:19.069 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 17, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 11, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 12, 2024-09-21T08:03:19.070 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 11, 2024-09-21T08:03:19.071 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 95, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_started": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_write_failed": 0 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-21T08:03:19.072 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 5, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 5, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 2, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 2, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-21T08:03:19.073 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4195735, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.008506281, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002126570 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 20, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 24, 2024-09-21T08:03:19.074 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 4, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 19, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 25, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 6, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 16, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 24, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 8, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-21T08:03:19.075 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 118032, 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 325861376 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 5, 2024-09-21T08:03:19.076 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.077 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:19.078 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.079 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-21T08:03:19.080 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.081 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.081 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.081 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.082 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-21T08:03:19.083 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.084 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:19.085 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.086 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.087 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.088 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-21T08:03:19.089 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 61, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:19.090 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:19.091 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:19.092 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 255125, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 85, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 9696, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 198, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T08:03:19.093 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 83501, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 387, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 40, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 11733, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 33, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 40, 2024-09-21T08:03:19.094 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 40, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.258994414, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.006474860 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 40, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 62 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 40, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 0, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 40, 2024-09-21T08:03:19.095 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 10, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 4, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 7, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 6, 2024-09-21T08:03:19.096 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 20, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:19.097 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-21T08:03:19.098 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 102, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 16, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 9, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 9, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 14, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 1 2024-09-21T08:03:19.099 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-21T08:03:19.100 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2397, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1259984, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2397, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2397, 2024-09-21T08:03:19.101 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1259984, 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:19.102 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 40, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 11733, 2024-09-21T08:03:19.103 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 40, 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 11733, 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:19.104 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 40, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 40, 2024-09-21T08:03:19.105 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 40, 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 40, 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:19.106 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:19.107 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x562a916836c0": { 2024-09-21T08:03:19.108 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 5, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1431, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 5, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:19.109 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 4, 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1431, 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: "trackedop": { 2024-09-21T08:03:19.110 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 106 2024-09-21T08:03:19.111 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:19.111 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T08:03:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:18 smithi191 ceph-mon[34667]: osdmap e102: 12 total, 12 up, 12 in 2024-09-21T08:03:19.155 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:18 smithi191 ceph-mon[34667]: pgmap v774: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2024-09-21T08:03:19.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:18 smithi084 ceph-mon[30411]: osdmap e102: 12 total, 12 up, 12 in 2024-09-21T08:03:19.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:18 smithi084 ceph-mon[30411]: pgmap v774: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2024-09-21T08:03:19.816 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T08:03:19.816 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T08:03:19.816 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T08:03:19.816 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=17 2024-09-21T08:03:19.816 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-21T08:03:19.817 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:19.817 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:19.817 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T08:03:19.817 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T08:03:20.066 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T08:03:20.584 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 885, 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 887, 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 297305, 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 281431, 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.121625695, 2024-09-21T08:03:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.059797969, 2024-09-21T08:03:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.024041993, 2024-09-21T08:03:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.028103954, 2024-09-21T08:03:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 885, 2024-09-21T08:03:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.044890472, 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000050723 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1694, 2024-09-21T08:03:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1891, 2024-09-21T08:03:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 434199, 2024-09-21T08:03:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 1044489, 2024-09-21T08:03:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-21T08:03:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-21T08:03:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.147184395, 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.064935683, 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.030851881, 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.041450482, 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1890, 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.077139850, 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000040814 2024-09-21T08:03:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 507648 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 292, 2024-09-21T08:03:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 286, 2024-09-21T08:03:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 889396, 2024-09-21T08:03:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 166293, 2024-09-21T08:03:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-21T08:03:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.050005200, 2024-09-21T08:03:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.023254786, 2024-09-21T08:03:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.037142199, 2024-09-21T08:03:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000062620, 2024-09-21T08:03:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 285, 2024-09-21T08:03:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.017291766, 2024-09-21T08:03:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000060672 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 888048, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 165328 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4320, 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.116394266, 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000026943 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-21T08:03:20.596 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-09-21T08:03:20.597 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:20.598 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:20.599 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:20.600 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_started": 0, 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_write_failed": 0 2024-09-21T08:03:20.601 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 5, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-21T08:03:20.602 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 2, 2024-09-21T08:03:20.603 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-21T08:03:20.603 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-21T08:03:20.603 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-21T08:03:20.603 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-21T08:03:20.603 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4195735, 2024-09-21T08:03:20.603 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 4195424, 2024-09-21T08:03:20.603 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 5 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 3, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 1, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 1, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 0, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 0, 2024-09-21T08:03:20.604 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 116820, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 316424192 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-21T08:03:20.605 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.606 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.607 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-21T08:03:20.608 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.609 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-21T08:03:20.610 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.610 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.610 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.610 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-21T08:03:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.612 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:20.613 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.614 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.615 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.616 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:20.617 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-21T08:03:20.618 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 2211, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:20.619 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:20.620 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 198231, 2024-09-21T08:03:20.621 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 55, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 9456, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 192, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T08:03:20.622 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 8672, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 13, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2576, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-09-21T08:03:20.623 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2576, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2576, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.567966725, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000608682 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2576, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2577 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2576, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 2576, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-21T08:03:20.624 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 1683, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 891, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-21T08:03:20.625 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-21T08:03:20.626 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 102, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 16, 2024-09-21T08:03:20.627 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 6, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 6, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-21T08:03:20.628 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2867, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1345007, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2867, 2024-09-21T08:03:20.629 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2867, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1345007, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:20.630 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2576, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 1436, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2576, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1436, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:20.631 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2576, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2576, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2576, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2576, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.632 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.633 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55939f0316c0": { 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-21T08:03:20.634 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: "trackedop": { 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T08:03:20.635 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T08:03:21.394 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T08:03:21.394 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T08:03:21.394 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-21T08:03:21.394 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-21T08:03:21.394 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-21T08:03:21.394 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:21.394 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:21.395 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T08:03:21.395 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T08:03:21.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:21 smithi191 ceph-mon[34667]: pgmap v775: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:22.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:21 smithi084 ceph-mon[30411]: pgmap v775: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:22.040 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:03:22.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:21 smithi162 ceph-mon[34833]: pgmap v775: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:22.687 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-21T08:03:22.687 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:22.687 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 479, 2024-09-21T08:03:22.687 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 467, 2024-09-21T08:03:22.687 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 964700, 2024-09-21T08:03:22.687 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 638691, 2024-09-21T08:03:22.687 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 44, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.078970373, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.030283381, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.056162895, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000200979, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 466, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.036438838, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000078194 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 249, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000086284, 2024-09-21T08:03:22.688 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000346 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 911024, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 167888 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1861, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1455, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 508052, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 910417, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 9, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.157794750, 2024-09-21T08:03:22.689 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.077191087, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.088172585, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.005743573, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1453, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.079566720, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000054760 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2927, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000803277, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000274 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 4016, 2024-09-21T08:03:22.690 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 432896 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 88, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 126, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 33574, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 39713, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 9, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.019289492, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.007210347, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.010825218, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000290375, 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:22.691 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 125, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.025021095, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000200168 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 139, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000050472, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000363 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-21T08:03:22.692 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 50, 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.001487023, 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000029740 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2, 2024-09-21T08:03:22.693 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000038340, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000019170 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 7, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 4, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000781893, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000195473 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-21T08:03:22.694 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 3, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 16, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 16, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 13, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 8, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 2, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 2, 2024-09-21T08:03:22.695 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 3, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 41, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 34, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 1, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 5, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:22.696 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 22, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 10738142814, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 6, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:22.697 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 2, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 2, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 0 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 17, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 11, 2024-09-21T08:03:22.698 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 12, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-21T08:03:22.699 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 11, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 95, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_started": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_write_failed": 0 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-21T08:03:22.700 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 4, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 4, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 2, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 2, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 4195594, 2024-09-21T08:03:22.701 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.005453804, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001817934 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 20, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 24, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 4, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 19, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 25, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 6, 2024-09-21T08:03:22.702 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 16, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 24, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 8, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 2, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 2, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 0, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 119204, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 325857280 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 7, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 7, 2024-09-21T08:03:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 20, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 0, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000671657, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000223885 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000110236, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000110236 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.706 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-21T08:03:22.707 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-21T08:03:22.708 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.710 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:22.711 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.712 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.713 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 2, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2024-09-21T08:03:22.715 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 2, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 3, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 1, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 737, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:22.716 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:22.717 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:22.718 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 262405, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 86, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9456, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 192, 2024-09-21T08:03:22.719 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 84157, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 393, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-21T08:03:22.720 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 39, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 11713, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 31, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 39, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 39, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.261995369, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.006717829 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 39, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 62 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 39, 2024-09-21T08:03:22.721 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 39, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 3, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 6, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-09-21T08:03:22.722 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 6, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-21T08:03:22.723 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-21T08:03:22.724 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 102, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 16, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 9, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 9, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 16, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 0, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 1 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.725 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 0, 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2424, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 1268440, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2424, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2424, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1268440, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.727 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 39, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 11713, 2024-09-21T08:03:22.728 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 39, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 11713, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 39, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 39, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 39, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 39, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:22.730 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x55a35db13450": { 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 4, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 1290, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 4, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 3, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1290, 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:22.732 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout: "trackedop": { 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 106 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:22.733 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-21T08:03:23.736 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T08:03:23.736 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T08:03:23.736 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T08:03:23.736 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=17 2024-09-21T08:03:23.736 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-21T08:03:23.736 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:23.736 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:23.736 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T08:03:23.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T08:03:23.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:23 smithi162 ceph-mon[34833]: pgmap v776: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:23.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:23 smithi191 ceph-mon[34667]: pgmap v776: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:23.983 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:03:24.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:23 smithi084 ceph-mon[30411]: pgmap v776: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-21T08:03:24.537 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 374, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 390, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 910946, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 599237, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 44, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.077063918, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.028152940, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.053929260, 2024-09-21T08:03:24.538 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000290664, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 385, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.023518195, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000061086 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 65, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000030598, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000470 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 899968, 2024-09-21T08:03:24.539 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 168848 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1891, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1444, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 525994, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 798049, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 8, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.158251717, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.078251245, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.089237178, 2024-09-21T08:03:24.540 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.005194587, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1444, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.079963926, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000055376 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2992, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000763929, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000255 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T08:03:24.541 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 418080 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 138, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 136, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 54033, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 55169, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 9, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.016834222, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.006112941, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.010561218, 2024-09-21T08:03:24.542 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000447296, 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 137, 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.036795813, 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000268582 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 213, 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000064246, 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000301 2024-09-21T08:03:24.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 45, 2024-09-21T08:03:24.544 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.001495697, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000033237 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000025429, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000012714 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 1, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 0, 2024-09-21T08:03:24.545 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 1, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 16, 2024-09-21T08:03:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 16, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 13, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 8, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 0, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 0, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 3, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 34, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 28, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 1, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 5, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-09-21T08:03:24.547 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 22, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 10738142814, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 6, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:24.548 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:24.549 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 0 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 17, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 11, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 12, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 0, 2024-09-21T08:03:24.550 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 11, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 95, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:24.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_started": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_write_failed": 0 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 3, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 3, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 2, 2024-09-21T08:03:24.552 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 2, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 4195203, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.003596857, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001798428 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.553 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 20, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 24, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 4, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 19, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 25, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 6, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 16, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 24, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 8, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 0, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 0, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 0, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 119272, 2024-09-21T08:03:24.554 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 325853184 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 1, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 1, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 10, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 0, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.555 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.556 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.557 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:24.558 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.559 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.559 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.559 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-21T08:03:24.559 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.559 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-21T08:03:24.560 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.561 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.562 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.563 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.564 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.565 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:24.566 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 1, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 0, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 0, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 769, 2024-09-21T08:03:24.567 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:24.568 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:24.569 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 246949, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 81, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:24.570 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9456, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 192, 2024-09-21T08:03:24.571 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 83525, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 390, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:24.572 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 37, 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 11111, 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 33, 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 37, 2024-09-21T08:03:24.573 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 37, 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.241995709, 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.006540424 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 37, 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 59 2024-09-21T08:03:24.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 37, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 0, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 37, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 0, 2024-09-21T08:03:24.575 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 2, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 6, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 6, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:24.576 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 0, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-21T08:03:24.577 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-21T08:03:24.578 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-21T08:03:24.579 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 102, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 16, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 9, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 9, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-21T08:03:24.580 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 14, 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 0, 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 1 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-21T08:03:24.581 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 0, 2024-09-21T08:03:24.582 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2399, 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 1256051, 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:24.583 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2399, 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2399, 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1256051, 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.584 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:24.585 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 37, 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 11111, 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 37, 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 11111, 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.586 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 37, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 37, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 37, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 37, 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:24.587 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:24.588 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x56285bcf7520": { 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 3, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 899, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:24.589 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 3, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 899, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "trackedop": { 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 106 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:24.590 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-21T08:03:25.262 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T08:03:25.262 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T08:03:25.262 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T08:03:25.262 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=17 2024-09-21T08:03:25.262 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-21T08:03:25.262 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:25.262 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:25.262 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T08:03:25.262 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T08:03:25.512 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:03:25.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:25 smithi191 ceph-mon[34667]: pgmap v777: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:03:26.028 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-21T08:03:26.028 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:26.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1947, 2024-09-21T08:03:26.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1303, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 533662, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 785800, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 42, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.172461009, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.070241884, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.111611852, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.006162806, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1301, 2024-09-21T08:03:26.029 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.079369424, 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000061006 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3044, 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000971313, 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000319 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:26.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 390, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 374, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 943287, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 195587, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 8, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.060195884, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.026881606, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.043073491, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000342870, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 374, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.042551644, 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000113774 2024-09-21T08:03:26.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 113, 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000043097, 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000381 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 917088, 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 167056 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 88, 2024-09-21T08:03:26.032 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 322, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 31194, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 577550, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 13, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.033770701, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.019261636, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.011658988, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000230000, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 320, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.031001948, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000096881 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.033 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 161, 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000054069, 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000335 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 1904, 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 511408 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-21T08:03:26.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 48, 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.002673808, 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000055704 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2, 2024-09-21T08:03:26.035 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000066314, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000033157 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 3, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 2, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000317148, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000158574 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 1, 2024-09-21T08:03:26.036 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 16, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 16, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 13, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 8, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 1, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 1, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 3, 2024-09-21T08:03:26.037 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 36, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 29, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 6, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:26.038 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 22, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 10738142814, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 6, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 1, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:26.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 1, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 1 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 15, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 10, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 12, 2024-09-21T08:03:26.040 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 11, 2024-09-21T08:03:26.041 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 95, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_started": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_write_failed": 0 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 5, 2024-09-21T08:03:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 5, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 2, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 2, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 4195735, 2024-09-21T08:03:26.043 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.008715595, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002178898 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 20, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 24, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 4, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 19, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 24, 2024-09-21T08:03:26.044 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 5, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 16, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 24, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 8, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 1, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 2, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 1, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 118704, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 325857280 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 4, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 3, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 15, 2024-09-21T08:03:26.045 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 0, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000184624, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000184624 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000132524, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000132524 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-21T08:03:26.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.051 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.052 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.053 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:26.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.055 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.056 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 1, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 1, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 1, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 742, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.057 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:26.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:26.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 279237, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 93, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:26.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9456, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 192, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 83845, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 392, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-21T08:03:26.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 40, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 11733, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 27, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 40, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 40, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.270995232, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.006774880 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-21T08:03:26.062 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 40, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 62 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 40, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 0, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 40, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 0, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 4, 2024-09-21T08:03:26.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 7, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 6, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:26.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-21T08:03:26.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 102, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 16, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 10, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 10, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-21T08:03:26.066 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 14, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 0, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 1 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-21T08:03:26.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2421, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 1271077, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2421, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:26.068 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2421, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1271077, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:26.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 40, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 11733, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 40, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 11733, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-21T08:03:26.070 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 40, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 40, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 40, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 40, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.071 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.072 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x5586a0a25450": { 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 5, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 1431, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 5, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 4, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1431, 2024-09-21T08:03:26.073 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: "trackedop": { 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 106 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:26.074 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-21T08:03:26.075 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:25 smithi084 ceph-mon[30411]: pgmap v777: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:03:26.075 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:25 smithi162 ceph-mon[34833]: pgmap v777: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:03:26.854 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T08:03:26.854 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T08:03:26.854 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-21T08:03:26.854 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=15 2024-09-21T08:03:26.854 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T08:03:26.854 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:26.854 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:26.855 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T08:03:26.855 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T08:03:27.100 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:03:27.618 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-21T08:03:27.618 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 293, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 287, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 889794, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 167236, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 5, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 1, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.051131098, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.023520668, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.036901352, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000030967, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 286, 2024-09-21T08:03:27.619 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.015541472, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000054340 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 888960, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 166912 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 742, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 943, 2024-09-21T08:03:27.620 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 182468, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 656059, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 5, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.098835190, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.042465237, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.018955166, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.029459765, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 941, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.038417962, 2024-09-21T08:03:27.621 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000040826 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 420416 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1778, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1778, 2024-09-21T08:03:27.622 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 534595, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 564638, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 4, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 3, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.210682607, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.088072104, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.048811699, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.058571498, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1777, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.073672026, 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000041458 2024-09-21T08:03:27.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-21T08:03:27.624 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:27.625 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:27.625 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4223, 2024-09-21T08:03:27.625 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.134505881, 2024-09-21T08:03:27.625 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000031850 2024-09-21T08:03:27.625 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.625 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 0, 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 0, 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.626 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 0, 2024-09-21T08:03:27.627 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 1, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2024-09-21T08:03:27.628 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:03:27.629 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:03:27.630 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 0 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 0, 2024-09-21T08:03:27.631 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-21T08:03:27.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_started": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_succeeded": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "uninline_write_failed": 0 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 4, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 0, 2024-09-21T08:03:27.633 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 2, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 4195594, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 4195283, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 4 2024-09-21T08:03:27.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 3, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 3, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 1, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 1, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 0, 2024-09-21T08:03:27.635 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 121536, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 316424192 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 0, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 0, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 0, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 0, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 0, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.636 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.639 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.640 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.640 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-21T08:03:27.640 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.640 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.640 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.641 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.643 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-21T08:03:27.644 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.645 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.646 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.647 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 2, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 2, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 0, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 0, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 2238, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-21T08:03:27.648 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:03:27.649 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:03:27.650 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 190145, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 52, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-21T08:03:27.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9456, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 192, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 8672, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 13, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-21T08:03:27.652 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 2516, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 21, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 3, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 2516, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2516, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 8.189856229, 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003255109 2024-09-21T08:03:27.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2516, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2517 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 2516, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 2516, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 0, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 1624, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 0, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 890, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 0, 2024-09-21T08:03:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 1, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-21T08:03:27.655 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-21T08:03:27.656 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 102, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 16, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 5, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 5, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-21T08:03:27.657 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 2, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 0 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-21T08:03:27.658 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2809, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 1336078, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2809, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:27.659 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2809, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1336078, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:27.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2516, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 1295, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2516, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1295, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-21T08:03:27.661 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2516, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 2516, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2516, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 2516, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.662 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.663 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x55fe82937380": { 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-09-21T08:03:27.664 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: "trackedop": { 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-21T08:03:27.665 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-21T08:03:27.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:27 smithi191 ceph-mon[34667]: pgmap v778: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:03:28.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:27 smithi162 ceph-mon[34833]: pgmap v778: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:03:28.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:27 smithi084 ceph-mon[30411]: pgmap v778: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-21T08:03:28.619 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T08:03:28.619 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T08:03:28.619 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-21T08:03:28.619 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-21T08:03:28.619 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-21T08:03:28.619 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-21T08:03:28.619 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T08:03:28.619 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T08:03:28.630 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T08:03:28.630 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T08:03:28.630 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:03:28.676 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T08:03:28.676 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:03:28.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T08:03:29.170 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:29.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 -- 172.21.15.84:0/3683135712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102fe0 msgr2=0x7f5b0010fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:29.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 --2- 172.21.15.84:0/3683135712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102fe0 0x7f5b0010fd00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009900 tx=0x7f5aec02a480 comp rx=0 tx=0).stop 2024-09-21T08:03:29.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 -- 172.21.15.84:0/3683135712 shutdown_connections 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 --2- 172.21.15.84:0/3683135712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b00110240 0x7f5b00112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 --2- 172.21.15.84:0/3683135712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102fe0 0x7f5b0010fd00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 --2- 172.21.15.84:0/3683135712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b00102690 0x7f5b00102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 -- 172.21.15.84:0/3683135712 >> 172.21.15.84:0/3683135712 conn(0x7f5b00079700 msgr2=0x7f5b00079b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.808+0000 7f5b06000640 1 -- 172.21.15.84:0/3683135712 shutdown_connections 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.809+0000 7f5b06000640 1 -- 172.21.15.84:0/3683135712 wait complete. 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.809+0000 7f5b06000640 1 Processor -- start 2024-09-21T08:03:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5b06000640 1 -- start start 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5b06000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102690 0x7f5b0019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5b06000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b00102fe0 0x7f5b0019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5b06000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b00110240 0x7f5b001a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5b06000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00115ce0 con 0x7f5b00102690 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5b06000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00115b60 con 0x7f5b00110240 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5b06000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00115e60 con 0x7f5b00102fe0 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5aff400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102690 0x7f5b0019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5aff400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102690 0x7f5b0019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40232/0 (socket says 172.21.15.84:40232) 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5aff400640 1 -- 172.21.15.84:0/711615578 learned_addr learned my addr 172.21.15.84:0/711615578 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:29.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.810+0000 7f5affe00640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b00110240 0x7f5b001a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5afea00640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b00102fe0 0x7f5b0019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5aff400640 1 -- 172.21.15.84:0/711615578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b00102fe0 msgr2=0x7f5b0019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5aff400640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b00102fe0 0x7f5b0019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5aff400640 1 -- 172.21.15.84:0/711615578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b00110240 msgr2=0x7f5b001a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5aff400640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b00110240 0x7f5b001a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5aff400640 1 -- 172.21.15.84:0/711615578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b001a2640 con 0x7f5b00102690 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5afea00640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b00102fe0 0x7f5b0019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5aff400640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102690 0x7f5b0019c6d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5af000ebc0 tx=0x7f5af000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5af7e00640 1 -- 172.21.15.84:0/711615578 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0010630 con 0x7f5b00102690 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5af7e00640 1 -- 172.21.15.84:0/711615578 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af0010c80 con 0x7f5b00102690 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b001a2930 con 0x7f5b00102690 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.811+0000 7f5af7e00640 1 -- 172.21.15.84:0/711615578 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0018b60 con 0x7f5b00102690 2024-09-21T08:03:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.812+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b001a9090 con 0x7f5b00102690 2024-09-21T08:03:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.813+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0006c210 con 0x7f5b00102690 2024-09-21T08:03:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.815+0000 7f5af7e00640 1 -- 172.21.15.84:0/711615578 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f5af0018d00 con 0x7f5b00102690 2024-09-21T08:03:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.816+0000 7f5af7e00640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ae40b6700 0x7f5ae40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.817+0000 7f5af7e00640 1 -- 172.21.15.84:0/711615578 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9432+0+0 (secure 0 0 0) 0x7f5af00e8300 con 0x7f5b00102690 2024-09-21T08:03:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.817+0000 7f5afea00640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ae40b6700 0x7f5ae40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:29.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.817+0000 7f5afea00640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ae40b6700 0x7f5ae40b8c10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5aec031440 tx=0x7f5aec009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:29.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:29.818+0000 7f5af7e00640 1 -- 172.21.15.84:0/711615578 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5af00ae460 con 0x7f5b00102690 2024-09-21T08:03:29.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:29 smithi191 ceph-mon[34667]: pgmap v779: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 95 B/s wr, 10 op/s 2024-09-21T08:03:30.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.018+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5b00102aa0 con 0x7f5b00102690 2024-09-21T08:03:30.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:29 smithi084 ceph-mon[30411]: pgmap v779: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 95 B/s wr, 10 op/s 2024-09-21T08:03:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.019+0000 7f5af7e00640 1 -- 172.21.15.84:0/711615578 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v102) ==== 81+0+885 (secure 0 0 0) 0x7f5b00102aa0 con 0x7f5b00102690 2024-09-21T08:03:30.021 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2305492953 2024-09-22T07:40:29.868163+0000 2024-09-21T08:03:30.021 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3844740807 2024-09-22T07:40:29.868163+0000 2024-09-21T08:03:30.021 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2263664999 2024-09-22T07:40:29.868163+0000 2024-09-21T08:03:30.021 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/1624480162 2024-09-22T07:38:56.444167+0000 2024-09-21T08:03:30.021 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/1624480162 2024-09-22T07:38:56.444167+0000 2024-09-21T08:03:30.021 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/4171591464 2024-09-22T07:39:25.647588+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/963010449 2024-09-22T07:40:29.868163+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2499433199 2024-09-22T07:38:56.444167+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2887533754 2024-09-22T07:39:25.647588+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3074211591 2024-09-22T07:38:56.444167+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1079969130 2024-09-22T07:38:56.444167+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/4129963413 2024-09-22T07:39:25.647588+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/963010449 2024-09-22T07:40:29.868163+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/4129963413 2024-09-22T07:39:25.647588+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/253258973 2024-09-22T07:39:25.647588+0000 2024-09-21T08:03:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:listed 15 entries 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ae40b6700 msgr2=0x7f5ae40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ae40b6700 0x7f5ae40b8c10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5aec031440 tx=0x7f5aec009680 comp rx=0 tx=0).stop 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102690 msgr2=0x7f5b0019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102690 0x7f5b0019c6d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5af000ebc0 tx=0x7f5af000c6a0 comp rx=0 tx=0).stop 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 shutdown_connections 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f5ae40b6700 0x7f5ae40b8c10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b00110240 0x7f5b001a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b00102fe0 0x7f5b0019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 --2- 172.21.15.84:0/711615578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b00102690 0x7f5b0019c6d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 >> 172.21.15.84:0/711615578 conn(0x7f5b00079700 msgr2=0x7f5b00109dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 shutdown_connections 2024-09-21T08:03:30.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:30.022+0000 7f5b06000640 1 -- 172.21.15.84:0/711615578 wait complete. 2024-09-21T08:03:30.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:29 smithi162 ceph-mon[34833]: pgmap v779: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 95 B/s wr, 10 op/s 2024-09-21T08:03:30.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:30 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/711615578' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:03:30.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:30 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/711615578' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:03:30.921 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T08:03:30.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:03:30.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T08:03:31.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T08:03:31.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:03:31.005 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T08:03:31.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:30 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/711615578' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:03:31.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:03:31.083 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T08:03:31.167 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T08:03:31.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:03:31.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T08:03:31.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:03:31.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-09-21T08:03:31.587 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T08:03:31.602 INFO:tasks.cephadm:Teardown begin 2024-09-21T08:03:31.602 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T08:03:31.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:03:31.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:31 smithi084 ceph-mon[30411]: pgmap v780: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:03:31.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:31 smithi191 ceph-mon[34667]: pgmap v780: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:03:31.980 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:32.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:31 smithi162 ceph-mon[34833]: pgmap v780: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 -- 172.21.15.84:0/1565397469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068077940 msgr2=0x7fa068077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 --2- 172.21.15.84:0/1565397469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068077940 0x7fa068077d50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009900 tx=0x7fa05c02a410 comp rx=0 tx=0).stop 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 -- 172.21.15.84:0/1565397469 shutdown_connections 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 --2- 172.21.15.84:0/1565397469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068114740 0x7fa068116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 --2- 172.21.15.84:0/1565397469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa068078290 0x7fa068114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 --2- 172.21.15.84:0/1565397469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068077940 0x7fa068077d50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 -- 172.21.15.84:0/1565397469 >> 172.21.15.84:0/1565397469 conn(0x7fa068101810 msgr2=0x7fa068103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 -- 172.21.15.84:0/1565397469 shutdown_connections 2024-09-21T08:03:32.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.576+0000 7fa06fa00640 1 -- 172.21.15.84:0/1565397469 wait complete. 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.577+0000 7fa06fa00640 1 Processor -- start 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06fa00640 1 -- start start 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06fa00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068077940 0x7fa0681a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06fa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068078290 0x7fa0681a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa068114740 0x7fa0681a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06fa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa06811a0d0 con 0x7fa068078290 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa068119f50 con 0x7fa068114740 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06fa00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa06811a250 con 0x7fa068077940 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06d000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068077940 0x7fa0681a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa067e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068078290 0x7fa0681a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06d000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068077940 0x7fa0681a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47068/0 (socket says 172.21.15.84:47068) 2024-09-21T08:03:32.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06d000640 1 -- 172.21.15.84:0/2471092689 learned_addr learned my addr 172.21.15.84:0/2471092689 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.578+0000 7fa06da00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa068114740 0x7fa0681a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa067e00640 1 -- 172.21.15.84:0/2471092689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068077940 msgr2=0x7fa0681a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa067e00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068077940 0x7fa0681a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa067e00640 1 -- 172.21.15.84:0/2471092689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa068114740 msgr2=0x7fa0681a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa067e00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa068114740 0x7fa0681a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa067e00640 1 -- 172.21.15.84:0/2471092689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0681a6a50 con 0x7fa068078290 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa06d000640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068077940 0x7fa0681a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa06da00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa068114740 0x7fa0681a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:32.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa067e00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068078290 0x7fa0681a1080 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa06806caa0 tx=0x7fa05400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:32.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa065600640 1 -- 172.21.15.84:0/2471092689 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05400cc40 con 0x7fa068078290 2024-09-21T08:03:32.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0681a6d40 con 0x7fa068078290 2024-09-21T08:03:32.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.579+0000 7fa065600640 1 -- 172.21.15.84:0/2471092689 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa05400cde0 con 0x7fa068078290 2024-09-21T08:03:32.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.580+0000 7fa065600640 1 -- 172.21.15.84:0/2471092689 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054018760 con 0x7fa068078290 2024-09-21T08:03:32.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.580+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0681ad4a0 con 0x7fa068078290 2024-09-21T08:03:32.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.581+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068077d50 con 0x7fa068078290 2024-09-21T08:03:32.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.584+0000 7fa065600640 1 -- 172.21.15.84:0/2471092689 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fa054010a90 con 0x7fa068078290 2024-09-21T08:03:32.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.586+0000 7fa065600640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0500b6680 0x7fa0500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:32.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.587+0000 7fa065600640 1 -- 172.21.15.84:0/2471092689 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9432+0+0 (secure 0 0 0) 0x7fa0540e8260 con 0x7fa068078290 2024-09-21T08:03:32.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.587+0000 7fa06d000640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0500b6680 0x7fa0500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:32.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.587+0000 7fa06d000640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0500b6680 0x7fa0500b8b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa05c031440 tx=0x7fa05c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:32.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.588+0000 7fa065600640 1 -- 172.21.15.84:0/2471092689 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0540b27a0 con 0x7fa068078290 2024-09-21T08:03:32.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.819+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0681a1c10 con 0x7fa068078290 2024-09-21T08:03:32.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.819+0000 7fa065600640 1 -- 172.21.15.84:0/2471092689 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7fa0540b76e0 con 0x7fa068078290 2024-09-21T08:03:32.821 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:03:32.822 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:03:32.822 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:03:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0500b6680 msgr2=0x7fa0500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0500b6680 0x7fa0500b8b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa05c031440 tx=0x7fa05c0058d0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068078290 msgr2=0x7fa0681a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068078290 0x7fa0681a1080 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa06806caa0 tx=0x7fa05400ee50 comp rx=0 tx=0).stop 2024-09-21T08:03:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 shutdown_connections 2024-09-21T08:03:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fa0500b6680 0x7fa0500b8b90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa068114740 0x7fa0681a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068078290 0x7fa0681a1080 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 --2- 172.21.15.84:0/2471092689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa068077940 0x7fa0681a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 >> 172.21.15.84:0/2471092689 conn(0x7fa068101810 msgr2=0x7fa0681167f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.822+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 shutdown_connections 2024-09-21T08:03:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:32.823+0000 7fa06fa00640 1 -- 172.21.15.84:0/2471092689 wait complete. 2024-09-21T08:03:33.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:03:33.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:33 smithi084 ceph-mon[30411]: pgmap v781: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T08:03:33.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:33 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2471092689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:33.903 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:33 smithi162 ceph-mon[34833]: pgmap v781: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T08:03:33.904 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:33 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2471092689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:33.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:33 smithi191 ceph-mon[34667]: pgmap v781: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T08:03:33.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:33 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2471092689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:33.956 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:34.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 -- 172.21.15.84:0/1322952816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90041092d0 msgr2=0x7f90041096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:34.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 --2- 172.21.15.84:0/1322952816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90041092d0 0x7f90041096e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009900 tx=0x7f8ff002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 -- 172.21.15.84:0/1322952816 shutdown_connections 2024-09-21T08:03:34.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 --2- 172.21.15.84:0/1322952816 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9004109c20 0x7f9004110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 --2- 172.21.15.84:0/1322952816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90041092d0 0x7f90041096e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 --2- 172.21.15.84:0/1322952816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9004103990 0x7f9004103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 -- 172.21.15.84:0/1322952816 >> 172.21.15.84:0/1322952816 conn(0x7f90040ff3e0 msgr2=0x7f9004101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:34.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 -- 172.21.15.84:0/1322952816 shutdown_connections 2024-09-21T08:03:34.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.603+0000 7f900ac00640 1 -- 172.21.15.84:0/1322952816 wait complete. 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.604+0000 7f900ac00640 1 Processor -- start 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.604+0000 7f900ac00640 1 -- start start 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f900ac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9004103990 0x7f900419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f900ac00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90041092d0 0x7f900419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f900ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9004109c20 0x7f90041a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f900ac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9004113930 con 0x7f9004103990 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f900ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90041137b0 con 0x7f9004109c20 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f900ac00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9004113ab0 con 0x7f90041092d0 2024-09-21T08:03:34.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f9009800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9004103990 0x7f900419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:34.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f9008e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90041092d0 0x7f900419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:34.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f9008e00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90041092d0 0x7f900419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:47076/0 (socket says 172.21.15.84:47076) 2024-09-21T08:03:34.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f9009800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9004103990 0x7f900419c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40262/0 (socket says 172.21.15.84:40262) 2024-09-21T08:03:34.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f9008e00640 1 -- 172.21.15.84:0/3206771306 learned_addr learned my addr 172.21.15.84:0/3206771306 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:34.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.605+0000 7f900a200640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9004109c20 0x7f90041a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:34.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9008e00640 1 -- 172.21.15.84:0/3206771306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9004109c20 msgr2=0x7f90041a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:34.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9008e00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9004109c20 0x7f90041a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9008e00640 1 -- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9004103990 msgr2=0x7f900419c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:34.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9008e00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9004103990 0x7f900419c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9008e00640 1 -- 172.21.15.84:0/3206771306 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90041a2530 con 0x7f90041092d0 2024-09-21T08:03:34.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f900a200640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9004109c20 0x7f90041a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:34.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9008e00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90041092d0 0x7f900419cb60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005ab0 tx=0x7f8ff0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:34.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9002000640 1 -- 172.21.15.84:0/3206771306 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff003f070 con 0x7f90041092d0 2024-09-21T08:03:34.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90041a27c0 con 0x7f90041092d0 2024-09-21T08:03:34.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041a8f80 con 0x7f90041092d0 2024-09-21T08:03:34.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9002000640 1 -- 172.21.15.84:0/3206771306 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ff0031b50 con 0x7f90041092d0 2024-09-21T08:03:34.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.606+0000 7f9002000640 1 -- 172.21.15.84:0/3206771306 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0049060 con 0x7f90041092d0 2024-09-21T08:03:34.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.607+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004103da0 con 0x7f90041092d0 2024-09-21T08:03:34.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.610+0000 7f9002000640 1 -- 172.21.15.84:0/3206771306 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f8ff0042070 con 0x7f90041092d0 2024-09-21T08:03:34.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.611+0000 7f9002000640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8fec0b6700 0x7f8fec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:34.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.612+0000 7f9002000640 1 -- 172.21.15.84:0/3206771306 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9432+0+0 (secure 0 0 0) 0x7f8ff0108080 con 0x7f90041092d0 2024-09-21T08:03:34.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.612+0000 7f9009800640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8fec0b6700 0x7f8fec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:34.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.612+0000 7f9009800640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8fec0b6700 0x7f8fec0b8c10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80095f0 tx=0x7f8ff8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:34.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.614+0000 7f9002000640 1 -- 172.21.15.84:0/3206771306 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ff00d25c0 con 0x7f90041092d0 2024-09-21T08:03:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.846+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f900419d6f0 con 0x7f90041092d0 2024-09-21T08:03:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.847+0000 7f9002000640 1 -- 172.21.15.84:0/3206771306 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11993 (secure 0 0 0) 0x7f8ff00d7500 con 0x7f90041092d0 2024-09-21T08:03:34.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:03:34.850 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"btime":"2024-09-21T07:50:33:459315+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14685,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1263089342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1263089342},{"type":"v1","addr":"172.21.15.84:6835","nonce":1263089342}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2332299014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2332299014},{"type":"v1","addr":"172.21.15.84:6839","nonce":2332299014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:47:41.706708+0000","modified":"2024-09-21T07:50:33.118994+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24746,"mds_1":24742,"mds_2":24724,"mds_3":24719,"mds_4":24712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14757":{"gid":14757,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6841/1397513983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":1397513983},{"type":"v1","addr":"172.21.15.84:6841","nonce":1397513983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24662":{"gid":24662,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6833/1671465182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1671465182},{"type":"v1","addr":"172.21.15.162:6833","nonce":1671465182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2170041322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2170041322},{"type":"v1","addr":"172.21.15.191:6833","nonce":2170041322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2049364491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2049364491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2049364491}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24697":{"gid":24697,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1436382958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1436382958},{"type":"v1","addr":"172.21.15.84:6837","nonce":1436382958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24712":{"gid":24712,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.191:6835/1369621448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1369621448},{"type":"v1","addr":"172.21.15.191:6835","nonce":1369621448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24719":{"gid":24719,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":21,"addr":"172.21.15.162:6837/1733531268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1733531268},{"type":"v1","addr":"172.21.15.162:6837","nonce":1733531268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24724":{"gid":24724,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.191:6837/2311233520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":2311233520},{"type":"v1","addr":"172.21.15.191:6837","nonce":2311233520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24742":{"gid":24742,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.191:6839/2322343723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2322343723},{"type":"v1","addr":"172.21.15.191:6839","nonce":2322343723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24746":{"gid":24746,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/3948328826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":3948328826},{"type":"v1","addr":"172.21.15.162:6839","nonce":3948328826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24746,"qdb_cluster":[24712,24719,24724,24742,24746]},"id":1}]} 2024-09-21T08:03:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-09-21T08:03:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.849+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8fec0b6700 msgr2=0x7f8fec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.849+0000 7f900ac00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8fec0b6700 0x7f8fec0b8c10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80095f0 tx=0x7f8ff8005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90041092d0 msgr2=0x7f900419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90041092d0 0x7f900419cb60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005ab0 tx=0x7f8ff0003b90 comp rx=0 tx=0).stop 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 shutdown_connections 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f8fec0b6700 0x7f8fec0b8c10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9004109c20 0x7f90041a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90041092d0 0x7f900419cb60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 --2- 172.21.15.84:0/3206771306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9004103990 0x7f900419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 >> 172.21.15.84:0/3206771306 conn(0x7f90040ff3e0 msgr2=0x7f90041089e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 shutdown_connections 2024-09-21T08:03:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:34.850+0000 7f900ac00640 1 -- 172.21.15.84:0/3206771306 wait complete. 2024-09-21T08:03:35.748 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T08:03:35.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:35 smithi191 ceph-mon[34667]: pgmap v782: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T08:03:35.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:35 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3206771306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:36.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:35 smithi162 ceph-mon[34833]: pgmap v782: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T08:03:36.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:35 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3206771306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:36.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:35 smithi084 ceph-mon[30411]: pgmap v782: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T08:03:36.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:35 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3206771306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:03:36.116 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.765+0000 7eff1be00640 1 -- 172.21.15.84:0/2962412074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c1092f0 msgr2=0x7eff1c109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.765+0000 7eff1be00640 1 --2- 172.21.15.84:0/2962412074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c1092f0 0x7eff1c109700 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7eff08009900 tx=0x7eff0802a410 comp rx=0 tx=0).stop 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.765+0000 7eff1be00640 1 -- 172.21.15.84:0/2962412074 shutdown_connections 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.765+0000 7eff1be00640 1 --2- 172.21.15.84:0/2962412074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff1c109c40 0x7eff1c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.765+0000 7eff1be00640 1 --2- 172.21.15.84:0/2962412074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c1092f0 0x7eff1c109700 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.766+0000 7eff1be00640 1 --2- 172.21.15.84:0/2962412074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff1c1039b0 0x7eff1c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.766+0000 7eff1be00640 1 -- 172.21.15.84:0/2962412074 >> 172.21.15.84:0/2962412074 conn(0x7eff1c0ff440 msgr2=0x7eff1c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.766+0000 7eff1be00640 1 -- 172.21.15.84:0/2962412074 shutdown_connections 2024-09-21T08:03:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.766+0000 7eff1be00640 1 -- 172.21.15.84:0/2962412074 wait complete. 2024-09-21T08:03:36.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 Processor -- start 2024-09-21T08:03:36.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 -- start start 2024-09-21T08:03:36.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff1c1039b0 0x7eff1c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff1c1092f0 0x7eff1c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c109c40 0x7eff1c19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c113900 con 0x7eff1c109c40 2024-09-21T08:03:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c113780 con 0x7eff1c1039b0 2024-09-21T08:03:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.767+0000 7eff1be00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c113a80 con 0x7eff1c1092f0 2024-09-21T08:03:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff1c1039b0 0x7eff1c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1a000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff1c1092f0 0x7eff1c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff1c1039b0 0x7eff1c19a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.84:45186/0 (socket says 172.21.15.84:45186) 2024-09-21T08:03:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1aa00640 1 -- 172.21.15.84:0/1346054195 learned_addr learned my addr 172.21.15.84:0/1346054195 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1b400640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c109c40 0x7eff1c19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1a000640 1 -- 172.21.15.84:0/1346054195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff1c1039b0 msgr2=0x7eff1c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1a000640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff1c1039b0 0x7eff1c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1a000640 1 -- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c109c40 msgr2=0x7eff1c19fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1a000640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c109c40 0x7eff1c19fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1a000640 1 -- 172.21.15.84:0/1346054195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c1a0280 con 0x7eff1c1092f0 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.768+0000 7eff1a000640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff1c1092f0 0x7eff1c19a8b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7eff0802a930 tx=0x7eff08031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.769+0000 7eff13400640 1 -- 172.21.15.84:0/1346054195 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0803f070 con 0x7eff1c1092f0 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.769+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c1a0510 con 0x7eff1c1092f0 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.769+0000 7eff13400640 1 -- 172.21.15.84:0/1346054195 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff08004490 con 0x7eff1c1092f0 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.769+0000 7eff13400640 1 -- 172.21.15.84:0/1346054195 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08035070 con 0x7eff1c1092f0 2024-09-21T08:03:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.769+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c1a6cd0 con 0x7eff1c1092f0 2024-09-21T08:03:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.770+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c103dc0 con 0x7eff1c1092f0 2024-09-21T08:03:36.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.772+0000 7eff13400640 1 -- 172.21.15.84:0/1346054195 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7eff0803b460 con 0x7eff1c1092f0 2024-09-21T08:03:36.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.774+0000 7eff13400640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff000b6680 0x7eff000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:36.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.774+0000 7eff13400640 1 -- 172.21.15.84:0/1346054195 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9432+0+0 (secure 0 0 0) 0x7eff08108190 con 0x7eff1c1092f0 2024-09-21T08:03:36.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.774+0000 7eff1aa00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff000b6680 0x7eff000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:36.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.775+0000 7eff1aa00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff000b6680 0x7eff000b8b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009cd0 tx=0x7eff0c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.776+0000 7eff13400640 1 -- 172.21.15.84:0/1346054195 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff080d26d0 con 0x7eff1c1092f0 2024-09-21T08:03:36.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.965+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff1c10ba10 con 0x7eff1c1092f0 2024-09-21T08:03:36.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.967+0000 7eff13400640 1 -- 172.21.15.84:0/1346054195 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+25330 (secure 0 0 0) 0x7eff080d7610 con 0x7eff1c1092f0 2024-09-21T08:03:36.969 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T08:03:36.969 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":102,"fsid":"56620f92-77ec-11ef-baf5-efdc52797490","created":"2024-09-21T07:38:31.274442+0000","modified":"2024-09-21T08:03:17.826728+0000","last_up_change":"2024-09-21T07:46:45.338015+0000","last_in_change":"2024-09-21T07:46:21.028960+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:42:36.190783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:47:35.807539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:47:38.820711+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T07:47:47.739225+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fd6e0b53-9abc-4716-8cf6-4176ac6cb8e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6803","nonce":2767669406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6805","nonce":2767669406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6809","nonce":2767669406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2767669406},{"type":"v1","addr":"172.21.15.84:6807","nonce":2767669406}]},"public_addr":"172.21.15.84:6803/2767669406","cluster_addr":"172.21.15.84:6805/2767669406","heartbeat_back_addr":"172.21.15.84:6809/2767669406","heartbeat_front_addr":"172.21.15.84:6807/2767669406","state":["exists","up"]},{"osd":1,"uuid":"f441b5fe-ade0-49aa-946a-a46da421c736","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6801","nonce":4003571360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6803","nonce":4003571360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6807","nonce":4003571360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":4003571360},{"type":"v1","addr":"172.21.15.162:6805","nonce":4003571360}]},"public_addr":"172.21.15.162:6801/4003571360","cluster_addr":"172.21.15.162:6803/4003571360","heartbeat_back_addr":"172.21.15.162:6807/4003571360","heartbeat_front_addr":"172.21.15.162:6805/4003571360","state":["exists","up"]},{"osd":2,"uuid":"247eb882-3ff7-474e-9367-aaadc4e26a59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6801","nonce":2171931700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6803","nonce":2171931700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6807","nonce":2171931700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2171931700},{"type":"v1","addr":"172.21.15.191:6805","nonce":2171931700}]},"public_addr":"172.21.15.191:6801/2171931700","cluster_addr":"172.21.15.191:6803/2171931700","heartbeat_back_addr":"172.21.15.191:6807/2171931700","heartbeat_front_addr":"172.21.15.191:6805/2171931700","state":["exists","up"]},{"osd":3,"uuid":"b309008a-7e80-4b28-bfa7-9ae80c749072","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6811","nonce":3656047347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6813","nonce":3656047347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6817","nonce":3656047347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3656047347},{"type":"v1","addr":"172.21.15.84:6815","nonce":3656047347}]},"public_addr":"172.21.15.84:6811/3656047347","cluster_addr":"172.21.15.84:6813/3656047347","heartbeat_back_addr":"172.21.15.84:6817/3656047347","heartbeat_front_addr":"172.21.15.84:6815/3656047347","state":["exists","up"]},{"osd":4,"uuid":"ad64fba4-4313-4086-9c0e-67226e9c6b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6809","nonce":1714263086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6811","nonce":1714263086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6815","nonce":1714263086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1714263086},{"type":"v1","addr":"172.21.15.162:6813","nonce":1714263086}]},"public_addr":"172.21.15.162:6809/1714263086","cluster_addr":"172.21.15.162:6811/1714263086","heartbeat_back_addr":"172.21.15.162:6815/1714263086","heartbeat_front_addr":"172.21.15.162:6813/1714263086","state":["exists","up"]},{"osd":5,"uuid":"d23cf2e7-5411-45c7-9a4d-c7ca9eccd062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6809","nonce":2672945398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6811","nonce":2672945398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6815","nonce":2672945398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2672945398},{"type":"v1","addr":"172.21.15.191:6813","nonce":2672945398}]},"public_addr":"172.21.15.191:6809/2672945398","cluster_addr":"172.21.15.191:6811/2672945398","heartbeat_back_addr":"172.21.15.191:6815/2672945398","heartbeat_front_addr":"172.21.15.191:6813/2672945398","state":["exists","up"]},{"osd":6,"uuid":"56fec50e-104d-4e8d-aa85-455f1d25bbcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6819","nonce":3031329443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6821","nonce":3031329443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6825","nonce":3031329443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3031329443},{"type":"v1","addr":"172.21.15.84:6823","nonce":3031329443}]},"public_addr":"172.21.15.84:6819/3031329443","cluster_addr":"172.21.15.84:6821/3031329443","heartbeat_back_addr":"172.21.15.84:6825/3031329443","heartbeat_front_addr":"172.21.15.84:6823/3031329443","state":["exists","up"]},{"osd":7,"uuid":"64539985-2656-47f9-b200-bf9d6cc097a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6817","nonce":328134245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6819","nonce":328134245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6823","nonce":328134245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":328134245},{"type":"v1","addr":"172.21.15.162:6821","nonce":328134245}]},"public_addr":"172.21.15.162:6817/328134245","cluster_addr":"172.21.15.162:6819/328134245","heartbeat_back_addr":"172.21.15.162:6823/328134245","heartbeat_front_addr":"172.21.15.162:6821/328134245","state":["exists","up"]},{"osd":8,"uuid":"3edf476b-1d78-4981-b8fe-c4a12b2f294b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6817","nonce":1349047550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6819","nonce":1349047550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6823","nonce":1349047550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1349047550},{"type":"v1","addr":"172.21.15.191:6821","nonce":1349047550}]},"public_addr":"172.21.15.191:6817/1349047550","cluster_addr":"172.21.15.191:6819/1349047550","heartbeat_back_addr":"172.21.15.191:6823/1349047550","heartbeat_front_addr":"172.21.15.191:6821/1349047550","state":["exists","up"]},{"osd":9,"uuid":"57b9d175-b40d-444d-9ff4-fee6682fb3b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6827","nonce":3430065825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6829","nonce":3430065825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6833","nonce":3430065825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3430065825},{"type":"v1","addr":"172.21.15.84:6831","nonce":3430065825}]},"public_addr":"172.21.15.84:6827/3430065825","cluster_addr":"172.21.15.84:6829/3430065825","heartbeat_back_addr":"172.21.15.84:6833/3430065825","heartbeat_front_addr":"172.21.15.84:6831/3430065825","state":["exists","up"]},{"osd":10,"uuid":"e440b17d-d229-459b-82ab-3f60f7842cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6825","nonce":2712516619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6827","nonce":2712516619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6831","nonce":2712516619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":2712516619},{"type":"v1","addr":"172.21.15.162:6829","nonce":2712516619}]},"public_addr":"172.21.15.162:6825/2712516619","cluster_addr":"172.21.15.162:6827/2712516619","heartbeat_back_addr":"172.21.15.162:6831/2712516619","heartbeat_front_addr":"172.21.15.162:6829/2712516619","state":["exists","up"]},{"osd":11,"uuid":"52ebe031-ba58-4e7f-9172-3a61ac5cedaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6825","nonce":577807248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6827","nonce":577807248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6831","nonce":577807248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":577807248},{"type":"v1","addr":"172.21.15.191:6829","nonce":577807248}]},"public_addr":"172.21.15.191:6825/577807248","cluster_addr":"172.21.15.191:6827/577807248","heartbeat_back_addr":"172.21.15.191:6831/577807248","heartbeat_front_addr":"172.21.15.191:6829/577807248","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:41:44.332928+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:09.148052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:42:34.009363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:05.001887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:31.281227+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:43:56.420900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:27.294878+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:44:53.874891+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:19.885150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:45:50.724818+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:17.493681+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:46:42.808076+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/2305492953":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/3844740807":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2263664999":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6800/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6801/1624480162":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/4171591464":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6801/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:0/2499433199":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/2887533754":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/3074211591":"2024-09-22T07:38:56.444167+0000","172.21.15.84:0/1079969130":"2024-09-22T07:38:56.444167+0000","172.21.15.84:6800/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:6800/963010449":"2024-09-22T07:40:29.868163+0000","172.21.15.84:6801/4129963413":"2024-09-22T07:39:25.647588+0000","172.21.15.84:0/253258973":"2024-09-22T07:39:25.647588+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]},{"pool":4,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff000b6680 msgr2=0x7eff000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff000b6680 0x7eff000b8b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009cd0 tx=0x7eff0c005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff1c1092f0 msgr2=0x7eff1c19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff1c1092f0 0x7eff1c19a8b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7eff0802a930 tx=0x7eff08031a20 comp rx=0 tx=0).stop 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 shutdown_connections 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7eff000b6680 0x7eff000b8b90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff1c109c40 0x7eff1c19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff1c1092f0 0x7eff1c19a8b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 --2- 172.21.15.84:0/1346054195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff1c1039b0 0x7eff1c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:36.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 >> 172.21.15.84:0/1346054195 conn(0x7eff1c0ff440 msgr2=0x7eff1c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:36.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 shutdown_connections 2024-09-21T08:03:36.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:36.970+0000 7eff1be00640 1 -- 172.21.15.84:0/1346054195 wait complete. 2024-09-21T08:03:37.731 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:37 smithi084 ceph-mon[30411]: pgmap v783: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T08:03:37.731 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:37 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/1346054195' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:03:37.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T08:03:37.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:37 smithi191 ceph-mon[34667]: pgmap v783: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T08:03:37.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:37 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/1346054195' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:03:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:37 smithi162 ceph-mon[34833]: pgmap v783: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T08:03:38.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:37 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/1346054195' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:03:38.142 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.815+0000 7f10afe00640 1 -- 172.21.15.84:0/2977740403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b0105bc0 msgr2=0x7f10b0105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.815+0000 7f10afe00640 1 --2- 172.21.15.84:0/2977740403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b0105bc0 0x7f10b0105fd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009900 tx=0x7f10a002a3f0 comp rx=0 tx=0).stop 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.815+0000 7f10afe00640 1 -- 172.21.15.84:0/2977740403 shutdown_connections 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.815+0000 7f10afe00640 1 --2- 172.21.15.84:0/2977740403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b010be50 0x7f10b0112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.815+0000 7f10afe00640 1 --2- 172.21.15.84:0/2977740403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 0x7f10b010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.815+0000 7f10afe00640 1 --2- 172.21.15.84:0/2977740403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b0105bc0 0x7f10b0105fd0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.815+0000 7f10afe00640 1 -- 172.21.15.84:0/2977740403 >> 172.21.15.84:0/2977740403 conn(0x7f10b0101670 msgr2=0x7f10b0103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:38.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.816+0000 7f10afe00640 1 -- 172.21.15.84:0/2977740403 shutdown_connections 2024-09-21T08:03:38.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.816+0000 7f10afe00640 1 -- 172.21.15.84:0/2977740403 wait complete. 2024-09-21T08:03:38.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 Processor -- start 2024-09-21T08:03:38.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 -- start start 2024-09-21T08:03:38.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0105bc0 0x7f10b019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:38.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 0x7f10b019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:38.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b010be50 0x7f10b01a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:38.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0115b60 con 0x7f10b010be50 2024-09-21T08:03:38.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01159e0 con 0x7f10b0105bc0 2024-09-21T08:03:38.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.817+0000 7f10afe00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0115ce0 con 0x7f10b010b500 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 0x7f10b019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10aea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0105bc0 0x7f10b019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 0x7f10b019cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.84:40782/0 (socket says 172.21.15.84:40782) 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 -- 172.21.15.84:0/2289066968 learned_addr learned my addr 172.21.15.84:0/2289066968 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10af400640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b010be50 0x7f10b01a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 -- 172.21.15.84:0/2289066968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0105bc0 msgr2=0x7f10b019c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0105bc0 0x7f10b019c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 -- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b010be50 msgr2=0x7f10b01a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:38.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b010be50 0x7f10b01a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 -- 172.21.15.84:0/2289066968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b01a24a0 con 0x7f10b010b500 2024-09-21T08:03:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.818+0000 7f10ae000640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 0x7f10b019cad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e9c0 tx=0x7f109c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.819+0000 7f10b4a00640 1 -- 172.21.15.84:0/2289066968 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c00ccc0 con 0x7f10b010b500 2024-09-21T08:03:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.819+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b01a2790 con 0x7f10b010b500 2024-09-21T08:03:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.819+0000 7f10b4a00640 1 -- 172.21.15.84:0/2289066968 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f109c0054d0 con 0x7f10b010b500 2024-09-21T08:03:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.819+0000 7f10b4a00640 1 -- 172.21.15.84:0/2289066968 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c010430 con 0x7f10b010b500 2024-09-21T08:03:38.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.819+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b01a8ef0 con 0x7f10b010b500 2024-09-21T08:03:38.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.820+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b0105fd0 con 0x7f10b010b500 2024-09-21T08:03:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.822+0000 7f10b4a00640 1 -- 172.21.15.84:0/2289066968 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f109c005020 con 0x7f10b010b500 2024-09-21T08:03:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.824+0000 7f10b4a00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10940b6680 0x7f10940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:38.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.824+0000 7f10b4a00640 1 -- 172.21.15.84:0/2289066968 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9432+0+0 (secure 0 0 0) 0x7f109c0e8130 con 0x7f10b010b500 2024-09-21T08:03:38.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.824+0000 7f10aea00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10940b6680 0x7f10940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:38.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.825+0000 7f10aea00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10940b6680 0x7f10940b8b90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005ab0 tx=0x7f10a0005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:38.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:38.826+0000 7f10b4a00640 1 -- 172.21.15.84:0/2289066968 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f109c0ae290 con 0x7f10b010b500 2024-09-21T08:03:39.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.052+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f10b010dc80 con 0x7f10b010b500 2024-09-21T08:03:39.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.066+0000 7f10b4a00640 1 -- 172.21.15.84:0/2289066968 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f109c0b2670 con 0x7f10b010b500 2024-09-21T08:03:39.068 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10940b6680 msgr2=0x7f10940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10940b6680 0x7f10940b8b90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005ab0 tx=0x7f10a0005a20 comp rx=0 tx=0).stop 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 msgr2=0x7f10b019cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 0x7f10b019cad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e9c0 tx=0x7f109c00ee80 comp rx=0 tx=0).stop 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 shutdown_connections 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f10940b6680 0x7f10940b8b90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10b010be50 0x7f10b01a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b010b500 0x7f10b019cad0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 --2- 172.21.15.84:0/2289066968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0105bc0 0x7f10b019c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 >> 172.21.15.84:0/2289066968 conn(0x7f10b0101670 msgr2=0x7f10b010ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 shutdown_connections 2024-09-21T08:03:39.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:39.069+0000 7f10afe00640 1 -- 172.21.15.84:0/2289066968 wait complete. 2024-09-21T08:03:39.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a[30407]: 2024-09-21T08:03:39.053+0000 7fd4f8e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:03:39.307 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d[72974]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.307 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d[72974]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.307 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a[74007]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.307 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a[74007]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.404 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f[63502]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f[63502]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mds[63506]: -- 172.21.15.191:0/1439326580 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560436d1d860 con 0x56043aec5180 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f[63502]: starting mds.f at 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c[63767]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c[63767]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mds[63771]: -- 172.21.15.191:0/1011762931 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b84d55860 con 0x561b88efd600 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c[63767]: starting mds.c at 2024-09-21T08:03:39.405 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i[64036]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.406 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i[64036]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.406 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mds[64040]: -- 172.21.15.191:0/4090893163 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56304ef27860 con 0x5630530cf600 2024-09-21T08:03:39.406 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i[64036]: starting mds.i at 2024-09-21T08:03:39.406 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l[63218]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.406 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l[63218]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.406 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mds[63222]: -- 172.21.15.191:0/2646419607 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d4038f860 con 0x557d44537600 2024-09-21T08:03:39.406 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l[63218]: starting mds.l at 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b[64357]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b[64357]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mds[64361]: -- 172.21.15.162:0/246963574 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55918f432ea0 con 0x5591935d1a80 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mds[64361]: -- 172.21.15.162:0/246963574 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55918f429860 con 0x5591935d1a80 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b[64357]: starting mds.b at 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e[63805]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e[63805]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.552 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mds[63809]: -- 172.21.15.162:0/3803103298 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8bf3df860 con 0x55f8c3587600 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e[63805]: starting mds.e at 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h[64087]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h[64087]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mds[64091]: -- 172.21.15.162:0/936988318 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b2c59a1860 con 0x55b2c9b49a80 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h[64087]: starting mds.h at 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k[63520]: ignoring --setuser ceph since I am not root 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k[63520]: ignoring --setgroup ceph since I am not root 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mds[63524]: -- 172.21.15.162:0/1401648593 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55910a630ea0 con 0x55910e7cfa80 2024-09-21T08:03:39.553 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mds[63524]: -- 172.21.15.162:0/1401648593 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55910a627c20 con 0x55910e7cfa80 2024-09-21T08:03:39.554 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k[63520]: starting mds.k at 2024-09-21T08:03:39.633 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mds[72978]: -- 172.21.15.84:0/3712335298 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fdc27bf860 con 0x55fdc6967180 2024-09-21T08:03:39.633 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d[72974]: starting mds.d at 2024-09-21T08:03:39.633 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mds[74014]: -- 172.21.15.84:0/3983316214 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1a1a09c20 con 0x55a1a5bb1600 2024-09-21T08:03:39.633 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a[74007]: starting mds.a at 2024-09-21T08:03:39.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: pgmap v784: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2289066968' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: osdmap e103: 12 total, 12 up, 12 in 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T08:03:39.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:39 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:03:39.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: pgmap v784: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2289066968' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: osdmap e103: 12 total, 12 up, 12 in 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T08:03:39.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:39 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:03:40.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: pgmap v784: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-21T08:03:40.051 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2289066968' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:03:40.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:03:40.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:03:40.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:03:40.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:03:40.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: osdmap e103: 12 total, 12 up, 12 in 2024-09-21T08:03:40.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T08:03:40.052 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:39 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:03:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 -- 172.21.15.84:0/3531923723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac108d00 msgr2=0x7f55ac10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 --2- 172.21.15.84:0/3531923723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac108d00 0x7f55ac10f530 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009ca0 tx=0x7f55a402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:03:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 -- 172.21.15.84:0/3531923723 shutdown_connections 2024-09-21T08:03:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 --2- 172.21.15.84:0/3531923723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac108d00 0x7f55ac10f530 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 --2- 172.21.15.84:0/3531923723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac1083b0 0x7f55ac1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 --2- 172.21.15.84:0/3531923723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55ac102a70 0x7f55ac102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 -- 172.21.15.84:0/3531923723 >> 172.21.15.84:0/3531923723 conn(0x7f55ac0796e0 msgr2=0x7f55ac079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.836+0000 7f55b3800640 1 -- 172.21.15.84:0/3531923723 shutdown_connections 2024-09-21T08:03:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.837+0000 7f55b3800640 1 -- 172.21.15.84:0/3531923723 wait complete. 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 Processor -- start 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 -- start start 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55ac102a70 0x7f55ac19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac1083b0 0x7f55ac19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac108d00 0x7f55ac1a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac113b10 con 0x7f55ac1083b0 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac113990 con 0x7f55ac102a70 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b3800640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac113c90 con 0x7f55ac108d00 2024-09-21T08:03:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55a3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac1083b0 0x7f55ac19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b1800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac108d00 0x7f55ac1a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55b0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55ac102a70 0x7f55ac19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55a3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac1083b0 0x7f55ac19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57334/0 (socket says 172.21.15.84:57334) 2024-09-21T08:03:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.838+0000 7f55a3e00640 1 -- 172.21.15.84:0/899538646 learned_addr learned my addr 172.21.15.84:0/899538646 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.839+0000 7f55b1800640 1 -- 172.21.15.84:0/899538646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55ac102a70 msgr2=0x7f55ac19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.839+0000 7f55b1800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55ac102a70 0x7f55ac19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.839+0000 7f55b1800640 1 -- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac1083b0 msgr2=0x7f55ac19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.839+0000 7f55b1800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac1083b0 0x7f55ac19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.839+0000 7f55b1800640 1 -- 172.21.15.84:0/899538646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac1a2690 con 0x7f55ac108d00 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.839+0000 7f55a3e00640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac1083b0 0x7f55ac19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.839+0000 7f55b1800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac108d00 0x7f55ac1a1f60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55a4005e30 tx=0x7f55a40317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.840+0000 7f55aa000640 1 -- 172.21.15.84:0/899538646 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4003b70 con 0x7f55ac108d00 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.840+0000 7f55aa000640 1 -- 172.21.15.84:0/899538646 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55a4003d10 con 0x7f55ac108d00 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.840+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac1a2920 con 0x7f55ac108d00 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.840+0000 7f55aa000640 1 -- 172.21.15.84:0/899538646 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a402f970 con 0x7f55ac108d00 2024-09-21T08:03:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.840+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac1a90e0 con 0x7f55ac108d00 2024-09-21T08:03:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.841+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac103cf0 con 0x7f55ac108d00 2024-09-21T08:03:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.844+0000 7f55aa000640 1 -- 172.21.15.84:0/899538646 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f55a4004b40 con 0x7f55ac108d00 2024-09-21T08:03:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.845+0000 7f55aa000640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55900b6700 0x7f55900b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.846+0000 7f55aa000640 1 -- 172.21.15.84:0/899538646 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9774+0+0 (secure 0 0 0) 0x7f55a4108d20 con 0x7f55ac108d00 2024-09-21T08:03:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.846+0000 7f55b0e00640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55900b6700 0x7f55900b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.846+0000 7f55b0e00640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55900b6700 0x7f55900b8c10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f559c009bd0 tx=0x7f559c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:40.847+0000 7f55aa000640 1 -- 172.21.15.84:0/899538646 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55a40ced30 con 0x7f55ac108d00 2024-09-21T08:03:41.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:41.077+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f55ac19d850 con 0x7f55ac108d00 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6833/3112199890,v1:172.21.15.191:6835/3112199890] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6832/1484219015,v1:172.21.15.191:6834/1484219015] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6834/343096881,v1:172.21.15.162:6838/343096881] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6832/2457352559,v1:172.21.15.162:6836/2457352559] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6833/853795771,v1:172.21.15.162:6837/853795771] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.162:6835/3116351022,v1:172.21.15.162:6839/3116351022] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6836/421830656,v1:172.21.15.191:6838/421830656] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.191:6837/1167527267,v1:172.21.15.191:6839/1167527267] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.84:6836/4187786597,v1:172.21.15.84:6840/4187786597] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: mds.? [v2:172.21.15.84:6837/3976279733,v1:172.21.15.84:6841/3976279733] up:boot 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T08:03:41.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T08:03:41.406 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:41 smithi191 ceph-mon[34667]: pgmap v786: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6833/3112199890,v1:172.21.15.191:6835/3112199890] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6832/1484219015,v1:172.21.15.191:6834/1484219015] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6834/343096881,v1:172.21.15.162:6838/343096881] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6832/2457352559,v1:172.21.15.162:6836/2457352559] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6833/853795771,v1:172.21.15.162:6837/853795771] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.162:6835/3116351022,v1:172.21.15.162:6839/3116351022] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6836/421830656,v1:172.21.15.191:6838/421830656] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.191:6837/1167527267,v1:172.21.15.191:6839/1167527267] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.84:6836/4187786597,v1:172.21.15.84:6840/4187786597] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: mds.? [v2:172.21.15.84:6837/3976279733,v1:172.21.15.84:6841/3976279733] up:boot 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:03:41.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T08:03:41.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:41 smithi162 ceph-mon[34833]: pgmap v786: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T08:03:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6833/3112199890,v1:172.21.15.191:6835/3112199890] up:boot 2024-09-21T08:03:41.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6832/1484219015,v1:172.21.15.191:6834/1484219015] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6834/343096881,v1:172.21.15.162:6838/343096881] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6832/2457352559,v1:172.21.15.162:6836/2457352559] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6833/853795771,v1:172.21.15.162:6837/853795771] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.162:6835/3116351022,v1:172.21.15.162:6839/3116351022] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6836/421830656,v1:172.21.15.191:6838/421830656] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.191:6837/1167527267,v1:172.21.15.191:6839/1167527267] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.84:6836/4187786597,v1:172.21.15.84:6840/4187786597] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: mds.? [v2:172.21.15.84:6837/3976279733,v1:172.21.15.84:6841/3976279733] up:boot 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:03:41.557 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T08:03:41.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:03:41.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T08:03:41.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T08:03:41.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T08:03:41.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: from='mgr.14223 172.21.15.84:0/2843157688' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T08:03:41.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:41 smithi084 ceph-mon[30411]: pgmap v786: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T08:03:42.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.082+0000 7f55aa000640 1 -- 172.21.15.84:0/899538646 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f55a40d3110 con 0x7f55ac108d00 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55900b6700 msgr2=0x7f55900b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55900b6700 0x7f55900b8c10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f559c009bd0 tx=0x7f559c005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac108d00 msgr2=0x7f55ac1a1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac108d00 0x7f55ac1a1f60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55a4005e30 tx=0x7f55a40317c0 comp rx=0 tx=0).stop 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 shutdown_connections 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f55900b6700 0x7f55900b8c10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac108d00 0x7f55ac1a1f60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac1083b0 0x7f55ac19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 --2- 172.21.15.84:0/899538646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55ac102a70 0x7f55ac19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:42.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 >> 172.21.15.84:0/899538646 conn(0x7f55ac0796e0 msgr2=0x7f55ac1061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:42.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 shutdown_connections 2024-09-21T08:03:42.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:42.085+0000 7f55b3800640 1 -- 172.21.15.84:0/899538646 wait complete. 2024-09-21T08:03:42.357 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:42 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/899538646' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:03:42.358 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:42 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:03:42.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:42 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/899538646' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:03:42.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:42 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:03:42.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:42 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/899538646' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:03:42.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:42 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:03:42.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T08:03:43.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:43 smithi084 ceph-mon[30411]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:03:43.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:43 smithi084 ceph-mon[30411]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:03:43.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:43 smithi084 ceph-mon[30411]: Cluster is now healthy 2024-09-21T08:03:43.306 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:43 smithi084 ceph-mon[30411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:03:43.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:43 smithi084 ceph-mon[30411]: fsmap 12 up:standby 2024-09-21T08:03:43.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:43 smithi084 ceph-mon[30411]: pgmap v787: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T08:03:43.364 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:43.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:43 smithi191 ceph-mon[34667]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:03:43.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:43 smithi191 ceph-mon[34667]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:03:43.404 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:43 smithi191 ceph-mon[34667]: Cluster is now healthy 2024-09-21T08:03:43.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:43 smithi191 ceph-mon[34667]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:03:43.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:43 smithi191 ceph-mon[34667]: fsmap 12 up:standby 2024-09-21T08:03:43.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:43 smithi191 ceph-mon[34667]: pgmap v787: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T08:03:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:43 smithi162 ceph-mon[34833]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:03:43.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:43 smithi162 ceph-mon[34833]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:03:43.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:43 smithi162 ceph-mon[34833]: Cluster is now healthy 2024-09-21T08:03:43.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:43 smithi162 ceph-mon[34833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:03:43.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:43 smithi162 ceph-mon[34833]: fsmap 12 up:standby 2024-09-21T08:03:43.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:43 smithi162 ceph-mon[34833]: pgmap v787: 129 pgs: 129 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.014+0000 7f77fe400640 1 -- 172.21.15.84:0/1069086349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810c010 msgr2=0x7f77f8112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.014+0000 7f77fe400640 1 --2- 172.21.15.84:0/1069086349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810c010 0x7f77f8112840 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009ca0 tx=0x7f77f002a8c0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.014+0000 7f77fe400640 1 -- 172.21.15.84:0/1069086349 shutdown_connections 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.014+0000 7f77fe400640 1 --2- 172.21.15.84:0/1069086349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810c010 0x7f77f8112840 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.014+0000 7f77fe400640 1 --2- 172.21.15.84:0/1069086349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f810b6c0 0x7f77f810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.014+0000 7f77fe400640 1 --2- 172.21.15.84:0/1069086349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f8105d80 0x7f77f8106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.014+0000 7f77fe400640 1 -- 172.21.15.84:0/1069086349 >> 172.21.15.84:0/1069086349 conn(0x7f77f8101810 msgr2=0x7f77f8103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.015+0000 7f77fe400640 1 -- 172.21.15.84:0/1069086349 shutdown_connections 2024-09-21T08:03:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.015+0000 7f77fe400640 1 -- 172.21.15.84:0/1069086349 wait complete. 2024-09-21T08:03:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 Processor -- start 2024-09-21T08:03:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 -- start start 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f8105d80 0x7f77f819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810b6c0 0x7f77f819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f810c010 0x7f77f81a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8115cd0 con 0x7f77f810b6c0 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8115b50 con 0x7f77f810c010 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77fe400640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8115e50 con 0x7f77f8105d80 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.016+0000 7f77f6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810b6c0 0x7f77f819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810b6c0 0x7f77f819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57350/0 (socket says 172.21.15.84:57350) 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 -- 172.21.15.84:0/3606153535 learned_addr learned my addr 172.21.15.84:0/3606153535 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f7400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f8105d80 0x7f77f819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f7e00640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f810c010 0x7f77f81a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 -- 172.21.15.84:0/3606153535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f8105d80 msgr2=0x7f77f819c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f8105d80 0x7f77f819c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 -- 172.21.15.84:0/3606153535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f810c010 msgr2=0x7f77f81a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f810c010 0x7f77f81a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 -- 172.21.15.84:0/3606153535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f81a25f0 con 0x7f77f810b6c0 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77f6a00640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810b6c0 0x7f77f819cc20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9c0 tx=0x7f77e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.017+0000 7f77efe00640 1 -- 172.21.15.84:0/3606153535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e400ccc0 con 0x7f77f810b6c0 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.018+0000 7f77efe00640 1 -- 172.21.15.84:0/3606153535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77e40054d0 con 0x7f77f810b6c0 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.018+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f81a28e0 con 0x7f77f810b6c0 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.018+0000 7f77efe00640 1 -- 172.21.15.84:0/3606153535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4010430 con 0x7f77f810b6c0 2024-09-21T08:03:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.018+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f81a9040 con 0x7f77f810b6c0 2024-09-21T08:03:44.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.019+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f8106190 con 0x7f77f810b6c0 2024-09-21T08:03:44.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.021+0000 7f77efe00640 1 -- 172.21.15.84:0/3606153535 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f77e4005000 con 0x7f77f810b6c0 2024-09-21T08:03:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.022+0000 7f77efe00640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77dc0b6680 0x7f77dc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.023+0000 7f77efe00640 1 -- 172.21.15.84:0/3606153535 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9774+0+0 (secure 0 0 0) 0x7f77e40e8190 con 0x7f77f810b6c0 2024-09-21T08:03:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.023+0000 7f77f7400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77dc0b6680 0x7f77dc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.024+0000 7f77f7400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77dc0b6680 0x7f77dc0b8b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009bd0 tx=0x7f77e8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:44.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.025+0000 7f77efe00640 1 -- 172.21.15.84:0/3606153535 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77e4056710 con 0x7f77f810b6c0 2024-09-21T08:03:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.213+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f77f819d7b0 con 0x7f77f810b6c0 2024-09-21T08:03:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.266+0000 7f77efe00640 1 -- 172.21.15.84:0/3606153535 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) ==== 181+0+0 (secure 0 0 0) 0x7f77f819d7b0 con 0x7f77f810b6c0 2024-09-21T08:03:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2024-09-21T08:03:44.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.269+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77dc0b6680 msgr2=0x7f77dc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.269+0000 7f77fe400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77dc0b6680 0x7f77dc0b8b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009bd0 tx=0x7f77e8005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.269+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810b6c0 msgr2=0x7f77f819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.269+0000 7f77fe400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810b6c0 0x7f77f819cc20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9c0 tx=0x7f77e400ee80 comp rx=0 tx=0).stop 2024-09-21T08:03:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.270+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 shutdown_connections 2024-09-21T08:03:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.270+0000 7f77fe400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f77dc0b6680 0x7f77dc0b8b90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.270+0000 7f77fe400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f810c010 0x7f77f81a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.270+0000 7f77fe400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77f810b6c0 0x7f77f819cc20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.270+0000 7f77fe400640 1 --2- 172.21.15.84:0/3606153535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f8105d80 0x7f77f819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.270+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 >> 172.21.15.84:0/3606153535 conn(0x7f77f8101810 msgr2=0x7f77f810ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.271+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 shutdown_connections 2024-09-21T08:03:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:44.271+0000 7f77fe400640 1 -- 172.21.15.84:0/3606153535 wait complete. 2024-09-21T08:03:44.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:44 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3606153535' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:44.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:44 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3606153535' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:44.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:44 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3606153535' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:45.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T08:03:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:45.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:45 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/3606153535' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:45.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:45 smithi084 ceph-mon[30411]: osdmap e104: 12 total, 12 up, 12 in 2024-09-21T08:03:45.543 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:45 smithi084 ceph-mon[30411]: pgmap v789: 97 pgs: 97 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:45.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:45 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/3606153535' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:45.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:45 smithi162 ceph-mon[34833]: osdmap e104: 12 total, 12 up, 12 in 2024-09-21T08:03:45.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:45 smithi162 ceph-mon[34833]: pgmap v789: 97 pgs: 97 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:45.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:45 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/3606153535' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:45.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:45 smithi191 ceph-mon[34667]: osdmap e104: 12 total, 12 up, 12 in 2024-09-21T08:03:45.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:45 smithi191 ceph-mon[34667]: pgmap v789: 97 pgs: 97 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 -- 172.21.15.84:0/2472715698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 msgr2=0x7f53b810b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 --2- 172.21.15.84:0/2472715698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b810b900 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009900 tx=0x7f53a002a410 comp rx=0 tx=0).stop 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 -- 172.21.15.84:0/2472715698 shutdown_connections 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 --2- 172.21.15.84:0/2472715698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53b810be40 0x7f53b8112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 --2- 172.21.15.84:0/2472715698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b810b900 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 --2- 172.21.15.84:0/2472715698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53b8105bb0 0x7f53b8105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 -- 172.21.15.84:0/2472715698 >> 172.21.15.84:0/2472715698 conn(0x7f53b8101680 msgr2=0x7f53b8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 -- 172.21.15.84:0/2472715698 shutdown_connections 2024-09-21T08:03:46.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.060+0000 7f53b7200640 1 -- 172.21.15.84:0/2472715698 wait complete. 2024-09-21T08:03:46.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.061+0000 7f53b7200640 1 Processor -- start 2024-09-21T08:03:46.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.061+0000 7f53b7200640 1 -- start start 2024-09-21T08:03:46.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53b8105bb0 0x7f53b819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b7200640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53b810be40 0x7f53b81a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8115b00 con 0x7f53b810b4f0 2024-09-21T08:03:46.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8115980 con 0x7f53b8105bb0 2024-09-21T08:03:46.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b7200640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8115c80 con 0x7f53b810be40 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b6800640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53b810be40 0x7f53b81a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b819cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57360/0 (socket says 172.21.15.84:57360) 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 -- 172.21.15.84:0/2422261188 learned_addr learned my addr 172.21.15.84:0/2422261188 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b5e00640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53b8105bb0 0x7f53b819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 -- 172.21.15.84:0/2422261188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53b810be40 msgr2=0x7f53b81a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53b810be40 0x7f53b81a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 -- 172.21.15.84:0/2422261188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53b8105bb0 msgr2=0x7f53b819c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53b8105bb0 0x7f53b819c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53ad400640 1 -- 172.21.15.84:0/2422261188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b81a24a0 con 0x7f53b810b4f0 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.062+0000 7f53b5e00640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53b8105bb0 0x7f53b819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:03:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.063+0000 7f53ad400640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b819cad0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f53a0006010 tx=0x7f53a0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.063+0000 7f53af400640 1 -- 172.21.15.84:0/2422261188 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a003f030 con 0x7f53b810b4f0 2024-09-21T08:03:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.063+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b81a2730 con 0x7f53b810b4f0 2024-09-21T08:03:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.063+0000 7f53af400640 1 -- 172.21.15.84:0/2422261188 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a0003aa0 con 0x7f53b810b4f0 2024-09-21T08:03:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.063+0000 7f53af400640 1 -- 172.21.15.84:0/2422261188 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0035070 con 0x7f53b810b4f0 2024-09-21T08:03:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.063+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b81a8ef0 con 0x7f53b810b4f0 2024-09-21T08:03:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.065+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b8106e30 con 0x7f53b810b4f0 2024-09-21T08:03:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.067+0000 7f53af400640 1 -- 172.21.15.84:0/2422261188 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7f53a0042030 con 0x7f53b810b4f0 2024-09-21T08:03:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.071+0000 7f53af400640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f539c0b6700 0x7f539c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.071+0000 7f53af400640 1 -- 172.21.15.84:0/2422261188 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9249+0+0 (secure 0 0 0) 0x7f53a01081d0 con 0x7f53b810b4f0 2024-09-21T08:03:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.071+0000 7f53b5e00640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f539c0b6700 0x7f539c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:46.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.071+0000 7f53b5e00640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f539c0b6700 0x7f539c0b8c10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009fc0 tx=0x7f53a8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:46.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.072+0000 7f53af400640 1 -- 172.21.15.84:0/2422261188 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53a00d27c0 con 0x7f53b810b4f0 2024-09-21T08:03:46.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.257+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53b8105fc0 con 0x7f53b810b4f0 2024-09-21T08:03:46.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.293+0000 7f53af400640 1 -- 172.21.15.84:0/2422261188 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) ==== 169+0+0 (secure 0 0 0) 0x7f53b8105fc0 con 0x7f53b810b4f0 2024-09-21T08:03:46.293 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2024-09-21T08:03:46.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f539c0b6700 msgr2=0x7f539c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f539c0b6700 0x7f539c0b8c10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009fc0 tx=0x7f53a8005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:46.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 msgr2=0x7f53b819cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b819cad0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f53a0006010 tx=0x7f53a0004060 comp rx=0 tx=0).stop 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 shutdown_connections 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7f539c0b6700 0x7f539c0b8c10 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53b810be40 0x7f53b81a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53b810b4f0 0x7f53b819cad0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 --2- 172.21.15.84:0/2422261188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53b8105bb0 0x7f53b819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.295+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 >> 172.21.15.84:0/2422261188 conn(0x7f53b8101680 msgr2=0x7f53b8103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.296+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 shutdown_connections 2024-09-21T08:03:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:46.296+0000 7f53b7200640 1 -- 172.21.15.84:0/2422261188 wait complete. 2024-09-21T08:03:46.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:46 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2422261188' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:46.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:46 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2422261188' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:46.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:46 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2422261188' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:47.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 56620f92-77ec-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T08:03:47.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:47 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2422261188' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:47.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:47 smithi162 ceph-mon[34833]: osdmap e105: 12 total, 12 up, 12 in 2024-09-21T08:03:47.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:47 smithi162 ceph-mon[34833]: pgmap v791: 33 pgs: 33 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:47 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2422261188' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:47 smithi084 ceph-mon[30411]: osdmap e105: 12 total, 12 up, 12 in 2024-09-21T08:03:47.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:47 smithi084 ceph-mon[30411]: pgmap v791: 33 pgs: 33 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:47.564 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:03:47.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:47 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2422261188' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:47.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:47 smithi191 ceph-mon[34667]: osdmap e105: 12 total, 12 up, 12 in 2024-09-21T08:03:47.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:47 smithi191 ceph-mon[34667]: pgmap v791: 33 pgs: 33 active+clean; 19 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:48.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 -- 172.21.15.84:0/2480789874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174077380 msgr2=0x7fb1740757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 --2- 172.21.15.84:0/2480789874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174077380 0x7fb1740757b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb164009900 tx=0x7fb16402a410 comp rx=0 tx=0).stop 2024-09-21T08:03:48.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 -- 172.21.15.84:0/2480789874 shutdown_connections 2024-09-21T08:03:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 --2- 172.21.15.84:0/2480789874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb174114280 0x7fb174116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 --2- 172.21.15.84:0/2480789874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb174075dd0 0x7fb1740761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 --2- 172.21.15.84:0/2480789874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174077380 0x7fb1740757b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 -- 172.21.15.84:0/2480789874 >> 172.21.15.84:0/2480789874 conn(0x7fb1740ff440 msgr2=0x7fb174101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 -- 172.21.15.84:0/2480789874 shutdown_connections 2024-09-21T08:03:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.216+0000 7fb179a00640 1 -- 172.21.15.84:0/2480789874 wait complete. 2024-09-21T08:03:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.217+0000 7fb179a00640 1 Processor -- start 2024-09-21T08:03:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.217+0000 7fb179a00640 1 -- start start 2024-09-21T08:03:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb179a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174075dd0 0x7fb1741a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb179a00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb174077380 0x7fb1741a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb179a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb174114280 0x7fb1741a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb179a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb174119ec0 con 0x7fb174075dd0 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb179a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb174119d40 con 0x7fb174114280 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb179a00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb17411a040 con 0x7fb174077380 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb173e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174075dd0 0x7fb1741a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb173e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174075dd0 0x7fb1741a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54874/0 (socket says 172.21.15.84:54874) 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb173e00640 1 -- 172.21.15.84:0/2044964355 learned_addr learned my addr 172.21.15.84:0/2044964355 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb179000640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb174114280 0x7fb1741a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.218+0000 7fb173400640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb174077380 0x7fb1741a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb173e00640 1 -- 172.21.15.84:0/2044964355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb174077380 msgr2=0x7fb1741a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb173e00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb174077380 0x7fb1741a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb173e00640 1 -- 172.21.15.84:0/2044964355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb174114280 msgr2=0x7fb1741a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb173e00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb174114280 0x7fb1741a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb173e00640 1 -- 172.21.15.84:0/2044964355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1741a68e0 con 0x7fb174075dd0 2024-09-21T08:03:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb173e00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174075dd0 0x7fb1741a0970 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb164005940 tx=0x7fb164004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb170c00640 1 -- 172.21.15.84:0/2044964355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16403f030 con 0x7fb174075dd0 2024-09-21T08:03:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb170c00640 1 -- 172.21.15.84:0/2044964355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb164003aa0 con 0x7fb174075dd0 2024-09-21T08:03:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.219+0000 7fb170c00640 1 -- 172.21.15.84:0/2044964355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164035070 con 0x7fb174075dd0 2024-09-21T08:03:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.220+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1741a6b70 con 0x7fb174075dd0 2024-09-21T08:03:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.220+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1741ad330 con 0x7fb174075dd0 2024-09-21T08:03:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.221+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1740761e0 con 0x7fb174075dd0 2024-09-21T08:03:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.223+0000 7fb170c00640 1 -- 172.21.15.84:0/2044964355 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154643+0+0 (secure 0 0 0) 0x7fb164042030 con 0x7fb174075dd0 2024-09-21T08:03:48.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.225+0000 7fb170c00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb1580b6680 0x7fb1580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:03:48.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.225+0000 7fb170c00640 1 -- 172.21.15.84:0/2044964355 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8711+0+0 (secure 0 0 0) 0x7fb164108090 con 0x7fb174075dd0 2024-09-21T08:03:48.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.225+0000 7fb173400640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb1580b6680 0x7fb1580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:03:48.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.226+0000 7fb173400640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb1580b6680 0x7fb1580b8b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb174116280 tx=0x7fb160005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:03:48.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.227+0000 7fb170c00640 1 -- 172.21.15.84:0/2044964355 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1640d28a0 con 0x7fb174075dd0 2024-09-21T08:03:48.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.415+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb1741a1aa0 con 0x7fb174075dd0 2024-09-21T08:03:48.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.468+0000 7fb170c00640 1 -- 172.21.15.84:0/2044964355 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v106) ==== 178+0+0 (secure 0 0 0) 0x7fb1640d77e0 con 0x7fb174075dd0 2024-09-21T08:03:48.470 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2024-09-21T08:03:48.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb1580b6680 msgr2=0x7fb1580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb1580b6680 0x7fb1580b8b90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb174116280 tx=0x7fb160005f90 comp rx=0 tx=0).stop 2024-09-21T08:03:48.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174075dd0 msgr2=0x7fb1741a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:03:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174075dd0 0x7fb1741a0970 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb164005940 tx=0x7fb164004270 comp rx=0 tx=0).stop 2024-09-21T08:03:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 shutdown_connections 2024-09-21T08:03:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:6800/2805742245,v1:172.21.15.84:6801/2805742245] conn(0x7fb1580b6680 0x7fb1580b8b90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb174114280 0x7fb1741a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb174077380 0x7fb1741a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 --2- 172.21.15.84:0/2044964355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb174075dd0 0x7fb1741a0970 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:03:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.472+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 >> 172.21.15.84:0/2044964355 conn(0x7fb1740ff440 msgr2=0x7fb174110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:03:48.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.474+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 shutdown_connections 2024-09-21T08:03:48.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T08:03:48.474+0000 7fb179a00640 1 -- 172.21.15.84:0/2044964355 wait complete. 2024-09-21T08:03:48.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:48 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2044964355' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:48.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:48 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2044964355' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:48.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:48 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2044964355' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:03:49.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:03:49.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:03:49.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:03:49.721 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T08:03:49.721 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:03:49.767 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:03:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:49 smithi162 ceph-mon[34833]: from='client.? 172.21.15.84:0/2044964355' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:49 smithi162 ceph-mon[34833]: osdmap e106: 12 total, 12 up, 12 in 2024-09-21T08:03:49.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:49 smithi162 ceph-mon[34833]: pgmap v793: 1 pgs: 1 active+clean; 577 KiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:49 smithi084 ceph-mon[30411]: from='client.? 172.21.15.84:0/2044964355' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:49 smithi084 ceph-mon[30411]: osdmap e106: 12 total, 12 up, 12 in 2024-09-21T08:03:49.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:49 smithi084 ceph-mon[30411]: pgmap v793: 1 pgs: 1 active+clean; 577 KiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:49.886 DEBUG:teuthology.orchestra.run.smithi191:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:03:49.904 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:49 smithi191 ceph-mon[34667]: from='client.? 172.21.15.84:0/2044964355' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:03:49.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:49 smithi191 ceph-mon[34667]: osdmap e106: 12 total, 12 up, 12 in 2024-09-21T08:03:49.905 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:49 smithi191 ceph-mon[34667]: pgmap v793: 1 pgs: 1 active+clean; 577 KiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:03:49.984 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T08:03:49.985 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T08:03:49.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a 2024-09-21T08:03:50.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:50 smithi084 systemd[1]: Stopping Ceph mon.a for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:03:50.806 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a[30407]: 2024-09-21T08:03:50.493+0000 7fd4ffc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:03:50.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a[30407]: 2024-09-21T08:03:50.493+0000 7fd4ffc00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T08:03:50.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:50 smithi084 podman[116489]: 2024-09-21 08:03:50.545322086 +0000 UTC m=+0.208109836 container died 4570a1287a90ec7be917f2ec07f4b43e31e3a8c906cc3c0bb13fb0129c3ac2ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T08:03:51.712 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:51 smithi084 podman[116489]: 2024-09-21 08:03:51.459167783 +0000 UTC m=+1.121955539 container cleanup 4570a1287a90ec7be917f2ec07f4b43e31e3a8c906cc3c0bb13fb0129c3ac2ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T08:03:51.712 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:51 smithi084 bash[116489]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a 2024-09-21T08:03:51.967 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 08:03:51 smithi084 podman[116499]: 2024-09-21 08:03:51.711095123 +0000 UTC m=+1.155186288 container remove 4570a1287a90ec7be917f2ec07f4b43e31e3a8c906cc3c0bb13fb0129c3ac2ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T08:03:51.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T08:03:52.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:03:52.053 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T08:03:52.054 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T08:03:52.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.b 2024-09-21T08:03:52.384 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:52 smithi162 systemd[1]: Stopping Ceph mon.b for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:03:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-b[34829]: 2024-09-21T08:03:52.382+0000 7f9a8b42e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:03:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-b[34829]: 2024-09-21T08:03:52.382+0000 7f9a8b42e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T08:03:52.801 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:52 smithi162 podman[67982]: 2024-09-21 08:03:52.495001875 +0000 UTC m=+0.237707741 container died 0788e5b682ab1d9526d84345d086ad49077703b3e2accd75f94dee981043ad42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T08:03:53.152 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:52 smithi162 podman[67982]: 2024-09-21 08:03:52.891293616 +0000 UTC m=+0.633999482 container cleanup 0788e5b682ab1d9526d84345d086ad49077703b3e2accd75f94dee981043ad42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T08:03:53.152 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 21 08:03:52 smithi162 bash[67982]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-b 2024-09-21T08:03:53.308 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T08:03:53.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:03:53.355 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T08:03:53.355 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T08:03:53.355 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.c 2024-09-21T08:03:53.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:53 smithi191 systemd[1]: Stopping Ceph mon.c for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:03:53.999 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:53 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-c[34663]: 2024-09-21T08:03:53.732+0000 7f2fd2c02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:03:53.999 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:53 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-c[34663]: 2024-09-21T08:03:53.732+0000 7f2fd2c02640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T08:03:54.301 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:53 smithi191 podman[67631]: 2024-09-21 08:03:53.997986517 +0000 UTC m=+0.407648533 container died cedc443a8dfd1cf982cf8f2ef181d2a87de5a3681b43a98699095b740e999807 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:03:54.654 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:54 smithi191 podman[67631]: 2024-09-21 08:03:54.391143764 +0000 UTC m=+0.800805757 container cleanup cedc443a8dfd1cf982cf8f2ef181d2a87de5a3681b43a98699095b740e999807 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T08:03:54.655 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 21 08:03:54 smithi191 bash[67631]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mon-c 2024-09-21T08:03:54.840 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T08:03:54.890 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:03:54.891 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T08:03:54.891 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T08:03:54.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.x 2024-09-21T08:03:55.306 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 08:03:54 smithi084 systemd[1]: Stopping Ceph mgr.x for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:03:55.807 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 08:03:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T08:03:55.317+0000 7f98b0c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:03:55.807 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 08:03:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x[30638]: 2024-09-21T08:03:55.317+0000 7f98b0c00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T08:03:55.807 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 08:03:55 smithi084 podman[116616]: 2024-09-21 08:03:55.43096897 +0000 UTC m=+0.261050483 container died 55ff0ac7caf245e8e18d914ae6dee4f749142647b2096f4a4d9534de3e1cfef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:03:56.226 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 08:03:55 smithi084 podman[116616]: 2024-09-21 08:03:55.965573947 +0000 UTC m=+0.795655442 container cleanup 55ff0ac7caf245e8e18d914ae6dee4f749142647b2096f4a4d9534de3e1cfef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T08:03:56.227 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 08:03:55 smithi084 bash[116616]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x 2024-09-21T08:03:56.508 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 08:03:56 smithi084 podman[116627]: 2024-09-21 08:03:56.225659817 +0000 UTC m=+0.785789102 container remove 55ff0ac7caf245e8e18d914ae6dee4f749142647b2096f4a4d9534de3e1cfef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:03:56.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T08:03:56.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:03:56.618 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T08:03:56.618 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T08:03:56.618 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.y 2024-09-21T08:03:57.051 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 08:03:56 smithi162 systemd[1]: Stopping Ceph mgr.y for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:03:58.551 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 08:03:58 smithi162 podman[68104]: 2024-09-21 08:03:58.270039075 +0000 UTC m=+1.458376401 container died 8bd70be84ff59ae6b9d788fc428e410b7d6997c7f4370587003b95812df3264c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:03:59.051 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 08:03:58 smithi162 podman[68104]: 2024-09-21 08:03:58.813845822 +0000 UTC m=+2.002183145 container cleanup 8bd70be84ff59ae6b9d788fc428e410b7d6997c7f4370587003b95812df3264c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-y, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:03:59.051 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 21 08:03:58 smithi162 bash[68104]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-y 2024-09-21T08:03:59.245 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T08:03:59.280 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:03:59.280 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T08:03:59.280 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T08:03:59.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.z 2024-09-21T08:03:59.625 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 08:03:59 smithi191 systemd[1]: Stopping Ceph mgr.z for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:03:59.904 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 08:03:59 smithi191 podman[67749]: 2024-09-21 08:03:59.625117462 +0000 UTC m=+0.143615174 container died 3da8821866de0469993e4306816416c7c8cee72ecd00f3980fb23f36b72e2159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T08:04:00.315 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 08:04:00 smithi191 podman[67749]: 2024-09-21 08:04:00.021478467 +0000 UTC m=+0.539976210 container cleanup 3da8821866de0469993e4306816416c7c8cee72ecd00f3980fb23f36b72e2159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:00.316 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 21 08:04:00 smithi191 bash[67749]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mgr-z 2024-09-21T08:04:00.461 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T08:04:00.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:04:00.496 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T08:04:00.496 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T08:04:00.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.0 2024-09-21T08:04:00.806 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:00 smithi084 systemd[1]: Stopping Ceph osd.0 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:04:01.806 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0[47744]: 2024-09-21T08:04:01.332+0000 7fb19c800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:04:01.806 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0[47744]: 2024-09-21T08:04:01.332+0000 7fb19c800640 -1 osd.0 106 *** Got signal Terminated *** 2024-09-21T08:04:01.807 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0[47744]: 2024-09-21T08:04:01.332+0000 7fb19c800640 -1 osd.0 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:04:07.556 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:07 smithi084 podman[116733]: 2024-09-21 08:04:07.231937532 +0000 UTC m=+6.440943127 container died 78269d2a9fe0cad627e554e72c13b2fcf6e1bf6901ff75cb8c483ba12eb70335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:04:07.838 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:07 smithi084 podman[116733]: 2024-09-21 08:04:07.812596198 +0000 UTC m=+7.021601792 container cleanup 78269d2a9fe0cad627e554e72c13b2fcf6e1bf6901ff75cb8c483ba12eb70335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T08:04:07.839 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:07 smithi084 bash[116733]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0 2024-09-21T08:04:08.556 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:08 smithi084 podman[116751]: 2024-09-21 08:04:08.098101397 +0000 UTC m=+0.833782797 container remove 78269d2a9fe0cad627e554e72c13b2fcf6e1bf6901ff75cb8c483ba12eb70335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:04:08.969 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:08 smithi084 podman[116836]: 2024-09-21 08:04:08.532282257 +0000 UTC m=+0.027056464 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:04:08.969 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:08 smithi084 podman[116836]: 2024-09-21 08:04:08.649048295 +0000 UTC m=+0.143822486 container create 2c1ac42f431ba7b28efff574a9f81daa418bab8e32f981ed2e936fe59f13839f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:04:08.969 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:08 smithi084 podman[116836]: 2024-09-21 08:04:08.968553291 +0000 UTC m=+0.463327476 container init 2c1ac42f431ba7b28efff574a9f81daa418bab8e32f981ed2e936fe59f13839f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:04:09.306 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:08 smithi084 podman[116836]: 2024-09-21 08:04:08.975356529 +0000 UTC m=+0.470130716 container start 2c1ac42f431ba7b28efff574a9f81daa418bab8e32f981ed2e936fe59f13839f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:04:09.307 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:09 smithi084 podman[116836]: 2024-09-21 08:04:09.085261001 +0000 UTC m=+0.580035197 container attach 2c1ac42f431ba7b28efff574a9f81daa418bab8e32f981ed2e936fe59f13839f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T08:04:09.799 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 08:04:09 smithi084 podman[116836]: 2024-09-21 08:04:09.461658633 +0000 UTC m=+0.956432828 container died 2c1ac42f431ba7b28efff574a9f81daa418bab8e32f981ed2e936fe59f13839f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T08:04:10.247 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T08:04:10.326 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:04:10.326 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T08:04:10.326 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T08:04:10.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.1 2024-09-21T08:04:10.643 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:10 smithi162 systemd[1]: Stopping Ceph osd.1 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:04:11.051 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1[39591]: 2024-09-21T08:04:10.642+0000 7ff0eac48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:04:11.051 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1[39591]: 2024-09-21T08:04:10.642+0000 7ff0eac48640 -1 osd.1 106 *** Got signal Terminated *** 2024-09-21T08:04:11.051 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1[39591]: 2024-09-21T08:04:10.642+0000 7ff0eac48640 -1 osd.1 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:04:16.551 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:16 smithi162 podman[68229]: 2024-09-21 08:04:16.264949996 +0000 UTC m=+5.740281448 container died 74550811a8896ec7e1f88f08b23af6fdf93e6252bee344153b97e78606d32bbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:04:16.936 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:16 smithi162 podman[68229]: 2024-09-21 08:04:16.633490169 +0000 UTC m=+6.108821623 container cleanup 74550811a8896ec7e1f88f08b23af6fdf93e6252bee344153b97e78606d32bbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:04:16.936 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:16 smithi162 bash[68229]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1 2024-09-21T08:04:17.297 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:16 smithi162 podman[68243]: 2024-09-21 08:04:16.935129605 +0000 UTC m=+0.666794902 container remove 74550811a8896ec7e1f88f08b23af6fdf93e6252bee344153b97e78606d32bbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:04:17.551 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:17 smithi162 podman[68333]: 2024-09-21 08:04:17.199164679 +0000 UTC m=+0.015820426 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:04:17.552 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:17 smithi162 podman[68333]: 2024-09-21 08:04:17.311291832 +0000 UTC m=+0.127947623 container create f49215532862c47424e4f7fdae052ec3a010215b1225830c19e3ac51782f6c61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-21T08:04:17.552 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:17 smithi162 podman[68333]: 2024-09-21 08:04:17.505381192 +0000 UTC m=+0.322036934 container init f49215532862c47424e4f7fdae052ec3a010215b1225830c19e3ac51782f6c61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T08:04:17.552 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:17 smithi162 podman[68333]: 2024-09-21 08:04:17.508687175 +0000 UTC m=+0.325342918 container start f49215532862c47424e4f7fdae052ec3a010215b1225830c19e3ac51782f6c61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:04:18.018 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:17 smithi162 podman[68333]: 2024-09-21 08:04:17.589089296 +0000 UTC m=+0.405745054 container attach f49215532862c47424e4f7fdae052ec3a010215b1225830c19e3ac51782f6c61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T08:04:18.018 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 21 08:04:17 smithi162 podman[68333]: 2024-09-21 08:04:17.720393107 +0000 UTC m=+0.537048849 container died f49215532862c47424e4f7fdae052ec3a010215b1225830c19e3ac51782f6c61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T08:04:18.343 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T08:04:18.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:04:18.382 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T08:04:18.382 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T08:04:18.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.2 2024-09-21T08:04:18.709 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:18 smithi191 systemd[1]: Stopping Ceph osd.2 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:04:18.977 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2[39798]: 2024-09-21T08:04:18.706+0000 7f464efab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:04:18.978 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2[39798]: 2024-09-21T08:04:18.706+0000 7f464efab640 -1 osd.2 106 *** Got signal Terminated *** 2024-09-21T08:04:18.978 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2[39798]: 2024-09-21T08:04:18.706+0000 7f464efab640 -1 osd.2 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:04:24.593 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:24 smithi191 podman[67872]: 2024-09-21 08:04:24.28734731 +0000 UTC m=+5.708969572 container died fda7a9a0018ac978bdc52bd74700e3c3c700cf67901d8e4ffe202089ec89258e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T08:04:24.904 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:24 smithi191 podman[67872]: 2024-09-21 08:04:24.683288643 +0000 UTC m=+6.104910950 container cleanup fda7a9a0018ac978bdc52bd74700e3c3c700cf67901d8e4ffe202089ec89258e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T08:04:24.904 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:24 smithi191 bash[67872]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2 2024-09-21T08:04:25.251 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:24 smithi191 podman[67902]: 2024-09-21 08:04:24.943093563 +0000 UTC m=+0.657548720 container remove fda7a9a0018ac978bdc52bd74700e3c3c700cf67901d8e4ffe202089ec89258e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T08:04:25.556 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:25 smithi191 podman[67990]: 2024-09-21 08:04:25.153530465 +0000 UTC m=+0.015842514 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:04:25.556 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:25 smithi191 podman[67990]: 2024-09-21 08:04:25.294149313 +0000 UTC m=+0.156461395 container create 288e285b57f8a87fed9fd1c254def91813326cd35a409be017aa3c91d1c76a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:04:25.556 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:25 smithi191 podman[67990]: 2024-09-21 08:04:25.555149734 +0000 UTC m=+0.417461774 container init 288e285b57f8a87fed9fd1c254def91813326cd35a409be017aa3c91d1c76a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T08:04:25.904 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:25 smithi191 podman[67990]: 2024-09-21 08:04:25.558724367 +0000 UTC m=+0.421036407 container start 288e285b57f8a87fed9fd1c254def91813326cd35a409be017aa3c91d1c76a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:25.905 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:25 smithi191 podman[67990]: 2024-09-21 08:04:25.638415536 +0000 UTC m=+0.500727588 container attach 288e285b57f8a87fed9fd1c254def91813326cd35a409be017aa3c91d1c76a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T08:04:25.905 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 21 08:04:25 smithi191 podman[67990]: 2024-09-21 08:04:25.796897352 +0000 UTC m=+0.659209399 container died 288e285b57f8a87fed9fd1c254def91813326cd35a409be017aa3c91d1c76a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:26.492 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T08:04:26.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:04:26.531 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T08:04:26.531 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T08:04:26.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.3 2024-09-21T08:04:26.980 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:26 smithi084 systemd[1]: Stopping Ceph osd.3 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:04:27.306 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:26 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T08:04:26.977+0000 7f69cee00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:04:27.306 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:26 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T08:04:26.977+0000 7f69cee00640 -1 osd.3 106 *** Got signal Terminated *** 2024-09-21T08:04:27.306 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:26 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T08:04:26.977+0000 7f69cee00640 -1 osd.3 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:04:28.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:28.406+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:28.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:28.231+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:29.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:29.380+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:29.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:29.192+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:29.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:29.371+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:30.056 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:29 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T08:04:29.569+0000 7f69ca800640 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.687889+0000 front 2024-09-21T08:04:04.687924+0000 (oldest deadline 2024-09-21T08:04:28.688810+0000) 2024-09-21T08:04:30.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:30.373+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:30.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:30.242+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:30.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:30.347+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:31.056 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:30 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T08:04:30.589+0000 7f69ca800640 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.687889+0000 front 2024-09-21T08:04:04.687924+0000 (oldest deadline 2024-09-21T08:04:28.688810+0000) 2024-09-21T08:04:31.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:30 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:30.836+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:31.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:31.418+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:31.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:31.290+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:31.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:31.385+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:31.847 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3[54314]: 2024-09-21T08:04:31.555+0000 7f69ca800640 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.687889+0000 front 2024-09-21T08:04:04.687924+0000 (oldest deadline 2024-09-21T08:04:28.688810+0000) 2024-09-21T08:04:32.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:31 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:31.846+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:32.404 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:32.297+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:32.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:32.111+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:32.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:32 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:32.344+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:32.904 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:32.451+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:33.306 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:32 smithi084 podman[116952]: 2024-09-21 08:04:32.968165998 +0000 UTC m=+6.132537181 container died 0632356be670489e0f189d2388c4e99296facb55617d66222ef557bad90447de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T08:04:33.307 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:32 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:32.810+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:33.406 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:33.319+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:33.406 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:33.128+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:33.761 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:33 smithi084 podman[116952]: 2024-09-21 08:04:33.541458095 +0000 UTC m=+6.705829275 container cleanup 0632356be670489e0f189d2388c4e99296facb55617d66222ef557bad90447de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T08:04:33.761 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:33 smithi084 bash[116952]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3 2024-09-21T08:04:33.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:33 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:33.306+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:33.904 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:33.403+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:34.056 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:33 smithi084 podman[116978]: 2024-09-21 08:04:33.759936464 +0000 UTC m=+0.769221857 container remove 0632356be670489e0f189d2388c4e99296facb55617d66222ef557bad90447de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T08:04:34.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:33 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:33.800+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:34.404 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:34.122+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:34.405 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:34.370+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:34.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:34.334+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:34.556 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:34 smithi084 podman[117069]: 2024-09-21 08:04:34.206783117 +0000 UTC m=+0.027179650 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:04:34.556 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:34 smithi084 podman[117069]: 2024-09-21 08:04:34.319230403 +0000 UTC m=+0.139626919 container create 0c495d2d8509ef9ca90262af50e1cc3e7f6264cc5e8e3e25f2cbffad80b7587e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T08:04:34.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:34 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:34.320+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:34.855 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:34 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:34.833+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:34.855 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:34 smithi084 podman[117069]: 2024-09-21 08:04:34.588479629 +0000 UTC m=+0.408876150 container init 0c495d2d8509ef9ca90262af50e1cc3e7f6264cc5e8e3e25f2cbffad80b7587e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:34.855 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:34 smithi084 podman[117069]: 2024-09-21 08:04:34.595023882 +0000 UTC m=+0.415420400 container start 0c495d2d8509ef9ca90262af50e1cc3e7f6264cc5e8e3e25f2cbffad80b7587e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T08:04:34.856 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:34 smithi084 podman[117069]: 2024-09-21 08:04:34.713489084 +0000 UTC m=+0.533885627 container attach 0c495d2d8509ef9ca90262af50e1cc3e7f6264cc5e8e3e25f2cbffad80b7587e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:34.856 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 08:04:34 smithi084 podman[117069]: 2024-09-21 08:04:34.854853268 +0000 UTC m=+0.675249794 container died 0c495d2d8509ef9ca90262af50e1cc3e7f6264cc5e8e3e25f2cbffad80b7587e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T08:04:35.379 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:35.292+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:35.380 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:35.090+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:35.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:35.378+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:35.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T08:04:35.767 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:04:35.768 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T08:04:35.768 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T08:04:35.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.4 2024-09-21T08:04:35.796 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:35 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:35.349+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:36.051 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:35 smithi162 systemd[1]: Stopping Ceph osd.4 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:04:36.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:35 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:35.870+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:36.359 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:36.250+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:36.359 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:36.042+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:36.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:36 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:36.321+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:36.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:36 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T08:04:36.078+0000 7f3c4ba56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:04:36.551 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:36 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T08:04:36.078+0000 7f3c4ba56640 -1 osd.4 106 *** Got signal Terminated *** 2024-09-21T08:04:36.552 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:36 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T08:04:36.078+0000 7f3c4ba56640 -1 osd.4 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:04:36.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:36.357+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:37.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:36 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:36.883+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:37.318 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:37.231+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:37.318 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:36.993+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:37.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:37.317+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:37.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:37 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:37.371+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:38.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:37 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:37.841+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:38.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:37 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:37.842+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:38.366 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:38.029+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:38.366 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:38.243+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:38.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:38.365+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:38.801 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:38 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:38.361+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:38.853 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:38 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:38.609+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:39.288 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:39.028+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:39.288 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:39.028+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:39.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:38 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T08:04:38.925+0000 7f3c44039640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.287149+0000 front 2024-09-21T08:04:15.287177+0000 (oldest deadline 2024-09-21T08:04:38.187306+0000) 2024-09-21T08:04:39.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:38 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:38.854+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:39.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:38 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:38.833+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:39.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:38 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:38.833+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:39.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:39.357+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:39.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:39.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:39.568+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:39.802 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:39.333+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:39.802 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:39.333+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:40.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:39.885+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:40.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:39.794+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:40.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:39 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:39.794+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:40.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:39 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T08:04:39.936+0000 7f3c44039640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.287149+0000 front 2024-09-21T08:04:15.287177+0000 (oldest deadline 2024-09-21T08:04:38.187306+0000) 2024-09-21T08:04:40.325 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:40 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:40.252+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:40.326 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:40 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:40.011+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:40.326 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:40 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:40.011+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:40.648 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:40 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:40.538+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:40.648 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:40 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:40.329+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:40.648 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:40 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:40.329+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:40.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:40 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:40.324+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:41.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:40 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:40.890+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:41.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:40 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:40.792+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:41.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:40 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:40.792+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:41.298 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:41.263+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:41.298 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:41.017+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:41.298 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:41.017+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:41.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:40 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4[45852]: 2024-09-21T08:04:40.907+0000 7f3c44039640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.287149+0000 front 2024-09-21T08:04:15.287177+0000 (oldest deadline 2024-09-21T08:04:38.187306+0000) 2024-09-21T08:04:41.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:41 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:41.492+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:41.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:41 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:41.300+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:41.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:41 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:41.300+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:41.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:41.296+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:41.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:41.296+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:42.030 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:41 smithi162 podman[68452]: 2024-09-21 08:04:41.717639636 +0000 UTC m=+5.754479312 container died f6bdc0eecf3637ad5b8632fc6ba73ac4bbd833a8aa36f0a56ad325c2ae6fc26c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:42.273 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:41.997+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:42.273 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:41 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:41.997+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:42.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:42 smithi162 podman[68452]: 2024-09-21 08:04:42.12790329 +0000 UTC m=+6.164742965 container cleanup f6bdc0eecf3637ad5b8632fc6ba73ac4bbd833a8aa36f0a56ad325c2ae6fc26c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:04:42.301 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:42 smithi162 bash[68452]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4 2024-09-21T08:04:42.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:41 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:41.886+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:42.307 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:41 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:41.827+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:42.307 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:41 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:41.827+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:42.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:42 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:42.312+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:42.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:42 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:42.271+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:42.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:42 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:42.271+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:42.780 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:42 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:42.537+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:42.781 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:42 smithi162 podman[68469]: 2024-09-21 08:04:42.371239062 +0000 UTC m=+0.657330882 container remove f6bdc0eecf3637ad5b8632fc6ba73ac4bbd833a8aa36f0a56ad325c2ae6fc26c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-21T08:04:42.781 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:42 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:42.309+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:42.781 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:42 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:42.309+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:43.051 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:42 smithi162 podman[68557]: 2024-09-21 08:04:42.78025531 +0000 UTC m=+0.099937007 container create a155667e8700745e33c0f3747be013803541b2b8d11db91366079f48155a98d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T08:04:43.052 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:42 smithi162 podman[68557]: 2024-09-21 08:04:42.697256147 +0000 UTC m=+0.016937850 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:04:43.052 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:42 smithi162 podman[68557]: 2024-09-21 08:04:42.949798226 +0000 UTC m=+0.269479933 container init a155667e8700745e33c0f3747be013803541b2b8d11db91366079f48155a98d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T08:04:43.052 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:42 smithi162 podman[68557]: 2024-09-21 08:04:42.953426761 +0000 UTC m=+0.273108450 container start a155667e8700745e33c0f3747be013803541b2b8d11db91366079f48155a98d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T08:04:43.052 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:43 smithi162 podman[68557]: 2024-09-21 08:04:43.024347296 +0000 UTC m=+0.344029003 container attach a155667e8700745e33c0f3747be013803541b2b8d11db91366079f48155a98d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T08:04:43.254 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:42 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:42.970+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:43.255 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:42 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:42.970+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:43.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:42 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:42.863+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:43.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:42 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:42.854+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:43.307 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:42 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:42.854+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:43.494 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 21 08:04:43 smithi162 podman[68557]: 2024-09-21 08:04:43.147528306 +0000 UTC m=+0.467210006 container died a155667e8700745e33c0f3747be013803541b2b8d11db91366079f48155a98d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:04:43.494 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:43 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:43.334+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:43.494 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:43 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:43.334+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:43.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:43 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:43.314+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:43.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:43 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:43.253+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:43.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:43 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:43.253+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:43.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:43 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:43.492+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:43.854 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T08:04:43.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:04:43.935 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T08:04:43.935 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T08:04:43.935 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.5 2024-09-21T08:04:44.245 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:43 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:43.980+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:44.246 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:43 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:43.980+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:44.246 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:43 smithi191 systemd[1]: Stopping Ceph osd.5 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:04:44.246 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:44.207+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:44.246 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:44.207+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:44.246 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:44.244+0000 7fdd51060640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:04:44.246 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:44.244+0000 7fdd51060640 -1 osd.5 106 *** Got signal Terminated *** 2024-09-21T08:04:44.246 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:44.244+0000 7fdd51060640 -1 osd.5 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:04:44.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:43 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:43.818+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:44.307 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:43 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:43.861+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:44.307 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:43 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:43.861+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:44.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:44.344+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:44.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:44 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:44.446+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:44.802 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:44 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:44.339+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:44.802 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:44 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:44.339+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:45.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:44 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:44.818+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:45.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:44 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:44.861+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:45.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:44 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:44.861+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:45.306 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:44 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:44.861+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:45.321 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:45 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:45.184+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:45.322 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:45 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:45.184+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:45.322 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:45 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:45.184+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:23.594805+0000 front 2024-09-21T08:04:23.594762+0000 (oldest deadline 2024-09-21T08:04:44.694987+0000) 2024-09-21T08:04:45.322 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:44.965+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:45.322 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:44 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:44.965+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:45.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:45 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:45.432+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:45.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:45 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:45.291+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:45.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:45 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:45.291+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:45.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:45 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:45.320+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:46.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:45 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:45.779+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:46.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:45 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:45.864+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:46.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:45 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:45.864+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:46.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:45 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:45.864+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:46.362 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:45 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:45.957+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:46.363 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:45 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:45.957+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:46.363 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:46 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:46.200+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:46.363 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:46 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:46.200+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:46.363 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:46 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:46.200+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:23.594805+0000 front 2024-09-21T08:04:23.594762+0000 (oldest deadline 2024-09-21T08:04:44.694987+0000) 2024-09-21T08:04:46.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:46 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:46.480+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:46.552 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:46 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:46.480+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:46.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:46 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:46.269+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:46.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:46 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:46.269+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:46.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:46 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:46.269+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:46.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:46 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:46.361+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:47.058 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:46 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:46.769+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:47.058 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:46 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:46.903+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:47.058 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:46 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:46.903+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:47.058 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:46 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:46.903+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:47.380 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:46 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:46.998+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:47.381 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:46 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:46.998+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:47.381 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:47 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:47.241+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:47.381 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:47 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:47.241+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:47.381 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:47 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:47.241+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:23.594805+0000 front 2024-09-21T08:04:23.594762+0000 (oldest deadline 2024-09-21T08:04:44.694987+0000) 2024-09-21T08:04:47.507 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:47 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:47.240+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:47.508 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:47 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:47.240+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:47.508 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:47 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:47.240+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:47.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:47 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:47.379+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:47.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:47 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:47.506+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:47.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:47 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:47.506+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:48.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:47 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:47.799+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:48.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:47 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:47.799+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:48.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:47 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:47.868+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:48.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:47 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:47.868+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:48.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:47 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:47.868+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:48.405 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:48 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:48.217+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:48.405 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:48 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:48.217+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:48.405 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:48 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:48.217+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:23.594805+0000 front 2024-09-21T08:04:23.594762+0000 (oldest deadline 2024-09-21T08:04:44.694987+0000) 2024-09-21T08:04:48.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:48 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:48.017+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:48.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:48 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:48.017+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:48.533 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:48 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:48.244+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:48.533 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:48 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:48.244+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:48.533 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:48 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:48.244+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:48.676 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:48 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:48.421+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:48.676 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:48 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:48.421+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:48.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:48 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:48.531+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:48.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:48 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:48.531+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:49.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:48 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:48.782+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:49.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:48 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:48.782+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:49.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:48 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:48.869+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:49.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:48 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:48.869+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:49.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:48 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:48.869+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:49.373 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:49 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:49.016+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:49.374 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:49 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:49.016+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:49.374 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:49 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:49.244+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:04.292023+0000 front 2024-09-21T08:04:04.291874+0000 (oldest deadline 2024-09-21T08:04:28.392081+0000) 2024-09-21T08:04:49.374 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:49 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:49.244+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:15.394174+0000 front 2024-09-21T08:04:15.393937+0000 (oldest deadline 2024-09-21T08:04:41.293710+0000) 2024-09-21T08:04:49.374 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:49 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5[46351]: 2024-09-21T08:04:49.244+0000 7fdd4d64b640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:23.594805+0000 front 2024-09-21T08:04:23.594762+0000 (oldest deadline 2024-09-21T08:04:44.694987+0000) 2024-09-21T08:04:49.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:49 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:49.528+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:49.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:49 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:49.528+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:49.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:49 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:49.289+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:49.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:49 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:49.289+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:49.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:49 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:49.289+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:49.650 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:49 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:49.372+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:49.651 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:49 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:49.372+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:50.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:49 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:49.750+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:50.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:49 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:49.750+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:50.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:49 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:49.846+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:50.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:49 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:49.846+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:50.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:49 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:49.846+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:50.359 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:50 smithi191 podman[68091]: 2024-09-21 08:04:50.056909541 +0000 UTC m=+5.931571337 container died bfb9ea43309d0c8d6c626fd2e355810936f27ea50534dcf08273a6df8f327237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T08:04:50.359 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:50 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:50.031+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:50.359 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:50 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:50.031+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:50.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:50 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:50.485+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:50.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:50 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:50.485+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:50.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:50 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:50.264+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:50.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:50 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:50.264+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:50.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:50 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:50.264+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:50.654 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:50 smithi191 podman[68091]: 2024-09-21 08:04:50.478299739 +0000 UTC m=+6.352961535 container cleanup bfb9ea43309d0c8d6c626fd2e355810936f27ea50534dcf08273a6df8f327237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:50.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:50 smithi191 bash[68091]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5 2024-09-21T08:04:50.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:50 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:50.357+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:50.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:50 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:50.357+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:51.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:50.743+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:51.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:50.743+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:51.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:50.839+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:51.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:50.839+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:51.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:50 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:50.839+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:51.074 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:50 smithi191 podman[68117]: 2024-09-21 08:04:50.696551637 +0000 UTC m=+0.639088404 container remove bfb9ea43309d0c8d6c626fd2e355810936f27ea50534dcf08273a6df8f327237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:04:51.325 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:51 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:51.073+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:51.325 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:51 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:51.073+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:51.325 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:51 smithi191 podman[68208]: 2024-09-21 08:04:51.088855798 +0000 UTC m=+0.112040673 container create 6d639bb178feb1041a513a9faac667f30c64ffcd9241857f64f2a31ccaf58d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:04:51.326 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:51 smithi191 podman[68208]: 2024-09-21 08:04:50.992790255 +0000 UTC m=+0.015975143 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:04:51.326 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:51 smithi191 podman[68208]: 2024-09-21 08:04:51.324771837 +0000 UTC m=+0.347956725 container init 6d639bb178feb1041a513a9faac667f30c64ffcd9241857f64f2a31ccaf58d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:04:51.480 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:51 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:51.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:51.480 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:51 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:51.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:51.481 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:51 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:51.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:51.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:51 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:51.406+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:51.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:51 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:51.406+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:51.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:51 smithi191 podman[68208]: 2024-09-21 08:04:51.328177416 +0000 UTC m=+0.351362304 container start 6d639bb178feb1041a513a9faac667f30c64ffcd9241857f64f2a31ccaf58d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:04:51.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:51 smithi191 podman[68208]: 2024-09-21 08:04:51.433197072 +0000 UTC m=+0.456381962 container attach 6d639bb178feb1041a513a9faac667f30c64ffcd9241857f64f2a31ccaf58d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T08:04:51.655 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 21 08:04:51 smithi191 podman[68208]: 2024-09-21 08:04:51.517877323 +0000 UTC m=+0.541062212 container died 6d639bb178feb1041a513a9faac667f30c64ffcd9241857f64f2a31ccaf58d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:04:51.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:51 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:51.479+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:51.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:51 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:51.479+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:52.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:51 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:51.699+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:52.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:51 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:51.699+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:52.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:51 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:51.834+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:52.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:51 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:51.834+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:52.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:51 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:51.834+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:52.154 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:52 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:52.101+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:52.154 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:52 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:52.101+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:52.186 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T08:04:52.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:04:52.226 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T08:04:52.226 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T08:04:52.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.6 2024-09-21T08:04:52.523 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:52.186+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:52.523 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:52.186+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:52.524 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:52.186+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:52.556 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:52 smithi084 systemd[1]: Stopping Ceph osd.6 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:04:52.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:52 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:52.389+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:52.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:52 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:52.389+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:52.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:52.522+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:52.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:52 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:52.522+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:53.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:52.659+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:53.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:52.659+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:53.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:52.639+0000 7fcc04200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:04:53.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:52.639+0000 7fcc04200640 -1 osd.6 106 *** Got signal Terminated *** 2024-09-21T08:04:53.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:52.639+0000 7fcc04200640 -1 osd.6 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:04:53.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:52.869+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:53.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:52.869+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:53.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:52.869+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:53.404 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:53 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:53.146+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:53.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:53 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:53.146+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:53.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:53 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:53.341+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:53.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:53 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:53.341+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:53.490 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:53 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:53.218+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:53.490 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:53 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:53.218+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:53.490 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:53 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:53.218+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:53.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:53 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:53.489+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:53.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:53 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:53.489+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:54.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:53 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:53.661+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:54.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:53 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:53.661+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:54.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:53 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:53.844+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:54.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:53 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:53.844+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:54.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:53 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:53.844+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:54.538 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:54 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:54.187+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:54.538 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:54 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:54.187+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:54.538 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:54 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:54.187+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:54.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:54 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:54.170+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:54.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:54 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:54.170+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:54.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:54 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:54.307+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:54.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:54 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:54.307+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:54.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:54 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:54.307+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:04:54.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:54 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:54.537+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:54.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:54 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:54.537+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:55.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:54 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:54.860+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:55.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:54 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:54.860+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:55.056 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:54 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:54.860+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:55.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:54 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:54.615+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:55.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:54 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:54.615+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:55.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:54 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:54.615+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:04:55.511 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:55 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:55.214+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:55.512 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:55 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:55.214+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:55.512 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:55 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:55.214+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:55.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:55 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:55.171+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:55.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:55 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:55.171+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:55.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:55 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:55.295+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:55.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:55 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:55.295+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:55.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:55 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:55.295+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:04:55.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:55 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:55.511+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:55.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:55 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:55.511+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:56.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:55.631+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:56.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:55.631+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:56.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:55.631+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:04:56.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:55.834+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:56.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:55.834+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:56.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:55.834+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:56.057 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:55 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:55.834+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:29.843758+0000 front 2024-09-21T08:04:29.843571+0000 (oldest deadline 2024-09-21T08:04:55.143671+0000) 2024-09-21T08:04:56.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:56 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:56.463+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:56.552 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:56 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:56.463+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:56.552 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:56 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:56.463+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:04:56.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:56 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:56.214+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:56.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:56 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:56.214+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:56.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:56 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:56.214+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:56.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:56 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:56.214+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:04:56.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:56 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:56.186+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:56.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:56 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:56.186+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:56.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:56 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:56.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:56.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:56 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:56.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:56.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:56 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:56.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:04:56.958 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:56.666+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:56.958 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:56.666+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:56.958 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:56.666+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:04:56.958 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:56.857+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.840121+0000 front 2024-09-21T08:04:05.839895+0000 (oldest deadline 2024-09-21T08:04:29.939898+0000) 2024-09-21T08:04:56.959 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:56.857+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.241364+0000 front 2024-09-21T08:04:12.241255+0000 (oldest deadline 2024-09-21T08:04:38.141176+0000) 2024-09-21T08:04:56.959 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:56.857+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:19.842246+0000 front 2024-09-21T08:04:19.842213+0000 (oldest deadline 2024-09-21T08:04:44.542410+0000) 2024-09-21T08:04:56.959 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6[60954]: 2024-09-21T08:04:56.857+0000 7fcbffc00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:29.843758+0000 front 2024-09-21T08:04:29.843571+0000 (oldest deadline 2024-09-21T08:04:55.143671+0000) 2024-09-21T08:04:57.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:57 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:57.441+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:57.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:57 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:57.441+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:57.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:57 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:57.441+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:04:57.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:57 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:57.223+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:57.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:57 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:57.223+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:57.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:57 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:57.223+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:57.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:57 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:57.223+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:04:57.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:57.221+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:57.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:57.221+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:57.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:57.221+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:04:57.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:57.338+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:57.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:57.338+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:57.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:57 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:57.338+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:04:58.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:57 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:57.686+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:58.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:57 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:57.686+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:58.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:57 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:57.686+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:04:58.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:58.415+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:58.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:58.415+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:58.552 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:58.415+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:04:58.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:58.256+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:58.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:58.256+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:58.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:58.256+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:58.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:58 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:58.256+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:04:58.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:58 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:58.242+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:58.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:58 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:58.242+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:58.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:58 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:58.242+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:04:58.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:58 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:58.376+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:58.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:58 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:58.376+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:58.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:58 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:58.376+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:04:58.806 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:58 smithi084 podman[117171]: 2024-09-21 08:04:58.581343315 +0000 UTC m=+6.077482343 container died b068cbd80411b6206a3af48741f53c95976608f2e3a1c5293cf72d1381450131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T08:04:58.806 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:58.690+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:58.807 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:58.690+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:58.807 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:58 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:58.690+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:04:59.404 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:59 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:59.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:04:59.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:59 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:59.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:04:59.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:04:59 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:04:59.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:04:59.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:59 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:59.291+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:04:59.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:59 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:59.291+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:04:59.405 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:04:59 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:04:59.291+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:04:59.439 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:59 smithi084 podman[117171]: 2024-09-21 08:04:59.169968181 +0000 UTC m=+6.666107245 container cleanup b068cbd80411b6206a3af48741f53c95976608f2e3a1c5293cf72d1381450131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T08:04:59.439 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:59 smithi084 bash[117171]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6 2024-09-21T08:04:59.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:59.438+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:04:59.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:59.438+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:04:59.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:04:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:04:59.438+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:04:59.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:59.258+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:04:59.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:59.258+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:04:59.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:59.258+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:04:59.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:04:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:04:59.258+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:04:59.806 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:59 smithi084 podman[117202]: 2024-09-21 08:04:59.437984479 +0000 UTC m=+0.847843195 container remove b068cbd80411b6206a3af48741f53c95976608f2e3a1c5293cf72d1381450131 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T08:04:59.806 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:59 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:59.681+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:04:59.806 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:59 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:59.681+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:04:59.807 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:04:59 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:04:59.681+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:00.209 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:59 smithi084 podman[117288]: 2024-09-21 08:04:59.771488882 +0000 UTC m=+0.026880039 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:05:00.209 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:04:59 smithi084 podman[117288]: 2024-09-21 08:04:59.888992749 +0000 UTC m=+0.144383884 container create e06d18eb678ea143d14cbdba386447647b667a6536c9decac937346f603f3a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T08:05:00.209 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:05:00 smithi084 podman[117288]: 2024-09-21 08:05:00.208196863 +0000 UTC m=+0.463588024 container init e06d18eb678ea143d14cbdba386447647b667a6536c9decac937346f603f3a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T08:05:00.475 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:05:00 smithi084 podman[117288]: 2024-09-21 08:05:00.214979636 +0000 UTC m=+0.470370772 container start e06d18eb678ea143d14cbdba386447647b667a6536c9decac937346f603f3a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T08:05:00.475 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:05:00 smithi084 podman[117288]: 2024-09-21 08:05:00.349857851 +0000 UTC m=+0.605248988 container attach e06d18eb678ea143d14cbdba386447647b667a6536c9decac937346f603f3a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T08:05:00.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:00 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:00.486+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:05:00.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:00 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:00.486+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:05:00.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:00 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:00.486+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:05:00.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:00 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:00.259+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:00.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:00 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:00.259+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:00.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:00 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:00.259+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:00.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:00 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:00.259+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:00.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:00 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:00.301+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:00.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:00 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:00.301+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:00.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:00 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:00.301+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:00.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:00 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:00.371+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:00.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:00 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:00.371+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:00.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:00 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:00.371+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:00.806 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 08:05:00 smithi084 podman[117288]: 2024-09-21 08:05:00.474641355 +0000 UTC m=+0.730032505 container died e06d18eb678ea143d14cbdba386447647b667a6536c9decac937346f603f3a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:05:00.806 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:00 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:00.718+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:00.807 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:00 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:00.718+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:00.807 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:00 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:00.718+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:01.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T08:05:01.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:01.290 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T08:05:01.290 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T08:05:01.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.7 2024-09-21T08:05:01.521 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:01 smithi162 systemd[1]: Stopping Ceph osd.7 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:01.521 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:01.244+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:01.521 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:01.244+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:01.521 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:01.244+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:01.521 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:01.244+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:01.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:01 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:01.300+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:01.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:01 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:01.300+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:01.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:01 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:01.300+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:01.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:01 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:01.392+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:01.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:01 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:01.392+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:01.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:01 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:01.392+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:01.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:01.519+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:05:01.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:01.519+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:05:01.801 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:01.519+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:05:01.802 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:01.620+0000 7f2797b67640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:01.802 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:01.620+0000 7f2797b67640 -1 osd.7 106 *** Got signal Terminated *** 2024-09-21T08:05:01.802 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:01 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:01.620+0000 7f2797b67640 -1 osd.7 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:05:02.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:01.726+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:02.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:01.726+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:02.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:01 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:01.726+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:02.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:02.233+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:02.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:02.233+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:02.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:02.233+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:02.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:02.233+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:02.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:02 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:02.326+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:02.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:02 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:02.326+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:02.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:02 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:02.326+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:02.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:02 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:02.370+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:02.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:02 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:02.370+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:02.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:02 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:02.370+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:03.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:02.568+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:05:03.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:02.568+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:05:03.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:02.569+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:05:03.052 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:02 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:02.569+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:40.601057+0000 front 2024-09-21T08:04:40.601151+0000 (oldest deadline 2024-09-21T08:05:02.301091+0000) 2024-09-21T08:05:03.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:02 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:02.741+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:03.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:02 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:02.741+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:03.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:02 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:02.741+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:03.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:03.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:03.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:03.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:03.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:03.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:03.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:03.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:03.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:03 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:03.331+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:03.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:03 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:03.331+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:03.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:03 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:03.331+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:03.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:03 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:03.331+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:03.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:03 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:03.361+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:03.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:03 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:03.361+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:03.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:03 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:03.361+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:04.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:03.568+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:05:04.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:03.568+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:05:04.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:03.568+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:05:04.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:03 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:03.568+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:40.601057+0000 front 2024-09-21T08:04:40.601151+0000 (oldest deadline 2024-09-21T08:05:02.301091+0000) 2024-09-21T08:05:04.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:03 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:03.727+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:04.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:03 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:03.727+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:04.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:03 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:03.727+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:04.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:04.197+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:04.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:04.197+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:04.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:04.197+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:04.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:04.197+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:04.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:04.197+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:04.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:04.300+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:04.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:04.300+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:04.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:04.300+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:04.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:04.300+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:04.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:04.314+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:04.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:04.314+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:04.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:04.314+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:04.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:04 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:04.314+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:05.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:04.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:05:05.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:04.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:05:05.052 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:04.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:05:05.052 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:04.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:40.601057+0000 front 2024-09-21T08:04:40.601151+0000 (oldest deadline 2024-09-21T08:05:02.301091+0000) 2024-09-21T08:05:05.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:04.694+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:05.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:04.694+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:05.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:04.694+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:05.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:04 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:04.694+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:05.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:05.182+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:05.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:05.182+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:05.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:05.182+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:05.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:05.182+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:05.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:05.182+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:05.336+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:05.336+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:05.336+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:05.337+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:05.277+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:05.277+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:05.277+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:05.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:05 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:05.277+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:06.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:05.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:05:06.052 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:05.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:05:06.052 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:05.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:05:06.052 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:05 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:05.590+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:40.601057+0000 front 2024-09-21T08:04:40.601151+0000 (oldest deadline 2024-09-21T08:05:02.301091+0000) 2024-09-21T08:05:06.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:05 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:05.688+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:06.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:05 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:05.688+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:06.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:05 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:05.688+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:06.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:05 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:05.688+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:06.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:06.195+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:06.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:06.195+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:06.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:06.195+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:06.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:06.195+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:06.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:06.195+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:06.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:06.327+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:06.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:06.327+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:06.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:06.327+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:06.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:06.327+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:06.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:06.272+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:06.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:06.272+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:06.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:06.272+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:06.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:06 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:06.272+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:07.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:06.552+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.897578+0000 front 2024-09-21T08:04:14.897701+0000 (oldest deadline 2024-09-21T08:04:37.797806+0000) 2024-09-21T08:05:07.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:06.552+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.799316+0000 front 2024-09-21T08:04:21.799229+0000 (oldest deadline 2024-09-21T08:04:45.899234+0000) 2024-09-21T08:05:07.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:06.552+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:30.600249+0000 front 2024-09-21T08:04:30.600307+0000 (oldest deadline 2024-09-21T08:04:55.900183+0000) 2024-09-21T08:05:07.051 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:06 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7[52347]: 2024-09-21T08:05:06.552+0000 7f279014a640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:40.601057+0000 front 2024-09-21T08:04:40.601151+0000 (oldest deadline 2024-09-21T08:05:02.301091+0000) 2024-09-21T08:05:07.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:06 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:06.662+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:07.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:06 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:06.662+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:07.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:06 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:06.662+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:07.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:06 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:06.662+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:07.551 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:07 smithi162 podman[68672]: 2024-09-21 08:05:07.308679478 +0000 UTC m=+5.822870719 container died 6fdfbafae77cdb1a1ce7090845f3d14d003b4407eb27e7d95bf026249edd4d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T08:05:07.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:07 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:07.232+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:07.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:07 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:07.232+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:07.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:07 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:07.232+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:07.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:07 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:07.232+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:07.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:07 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:07.232+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:07.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:07.364+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:07.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:07.364+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:07.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:07.364+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:07.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:07.364+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:07.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:07.305+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:07.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:07.305+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:07.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:07.305+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:07.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:07 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:07.305+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:07.951 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:07 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:07.666+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:07.952 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:07 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:07.666+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:07.952 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:07 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:07.666+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:07.952 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:07 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:07.666+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:07.956 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:07 smithi162 podman[68672]: 2024-09-21 08:05:07.67082652 +0000 UTC m=+6.185017759 container cleanup 6fdfbafae77cdb1a1ce7090845f3d14d003b4407eb27e7d95bf026249edd4d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T08:05:07.956 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:07 smithi162 bash[68672]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7 2024-09-21T08:05:08.270 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:07 smithi162 podman[68688]: 2024-09-21 08:05:07.955527867 +0000 UTC m=+0.649207207 container remove 6fdfbafae77cdb1a1ce7090845f3d14d003b4407eb27e7d95bf026249edd4d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T08:05:08.270 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:08.192+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:08.270 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:08.192+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:08.270 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:08.192+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:08.270 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:08.192+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:08.270 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:08.192+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:08.543 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:08 smithi162 podman[68776]: 2024-09-21 08:05:08.172015251 +0000 UTC m=+0.015972162 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:05:08.543 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:08 smithi162 podman[68776]: 2024-09-21 08:05:08.300185796 +0000 UTC m=+0.144142752 container create d8b754383c9f18550306f69072c614493cbe29f1bbec287cd70934fa648f1f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:05:08.543 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:08 smithi162 podman[68776]: 2024-09-21 08:05:08.54232763 +0000 UTC m=+0.386284540 container init d8b754383c9f18550306f69072c614493cbe29f1bbec287cd70934fa648f1f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:08.404+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:08.404+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:08.404+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:08.404+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:08.345+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:08.345+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:08.345+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:08.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:08 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:08.345+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:08.802 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:08 smithi162 podman[68776]: 2024-09-21 08:05:08.545758599 +0000 UTC m=+0.389715518 container start d8b754383c9f18550306f69072c614493cbe29f1bbec287cd70934fa648f1f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:05:08.802 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:08 smithi162 podman[68776]: 2024-09-21 08:05:08.617401093 +0000 UTC m=+0.461358008 container attach d8b754383c9f18550306f69072c614493cbe29f1bbec287cd70934fa648f1f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T08:05:08.802 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:08 smithi162 podman[68776]: 2024-09-21 08:05:08.736707186 +0000 UTC m=+0.580664097 container died d8b754383c9f18550306f69072c614493cbe29f1bbec287cd70934fa648f1f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:05:09.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:08 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:08.706+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:09.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:08 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:08.706+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:09.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:08 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:08.706+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:09.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:08 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:08.706+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:09.291 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 21 08:05:09 smithi162 podman[68799]: 2024-09-21 08:05:09.288016697 +0000 UTC m=+0.545955724 container remove d8b754383c9f18550306f69072c614493cbe29f1bbec287cd70934fa648f1f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T08:05:09.291 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:09 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:09.205+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:09.291 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:09 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:09.205+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:09.291 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:09 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:09.205+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:09.291 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:09 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:09.205+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:09.291 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:09 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:09.205+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:09.315 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T08:05:09.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:09.354 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T08:05:09.354 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T08:05:09.354 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.8 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:09.317+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:09.317+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:09.317+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:09.317+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:09.396+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:09.396+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:09.396+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:09.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:09.396+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:09.656 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 systemd[1]: Stopping Ceph osd.8 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:10.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:09 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:09.724+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:10.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:09 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:09.724+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:10.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:09 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:09.724+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:10.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:09 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:09.724+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:10.154 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:09.680+0000 7fce8b311640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:10.154 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:09.680+0000 7fce8b311640 -1 osd.8 106 *** Got signal Terminated *** 2024-09-21T08:05:10.154 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:09 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:09.680+0000 7fce8b311640 -1 osd.8 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:05:10.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:10.239+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:10.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:10.239+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:10.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:10.239+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:10.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:10.239+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:10.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:10 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:10.239+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:10.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:10.292+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:10.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:10.292+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:10.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:10.292+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:10.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:10.292+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:10.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:10.432+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:10.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:10.432+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:10.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:10.432+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:10.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:10 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:10.432+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:11.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:10 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:10.682+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:11.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:10 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:10.682+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:11.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:10 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:10.682+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:11.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:10 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:10.682+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:11.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:11 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:11.221+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:11.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:11 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:11.221+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:11.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:11 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:11.221+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:11.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:11 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:11.221+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:11.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:11 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:11.221+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:11.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:11.418+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:11.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:11.418+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:11.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:11.418+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:11.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:11.418+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:11.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:11.266+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:11.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:11.266+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:11.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:11.266+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:11.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:11 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:11.266+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:12.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:11 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:11.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:12.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:11 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:11.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:12.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:11 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:11.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:12.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:11 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:11.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:12.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:12.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:12.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:12.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:12.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:12.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:12.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:12.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:12.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:12.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:12.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:12.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:12.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:12.413+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:12.413+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:12.413+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:12.413+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:12.247+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:12.247+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:12.247+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:12.247+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:12.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:12 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:12.247+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:13.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:12 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:12.629+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:13.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:12 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:12.629+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:13.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:12 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:12.629+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:13.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:12 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:12.629+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:13.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:13 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:13.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:13.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:13 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:13.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:13.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:13 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:13.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:13.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:13 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:13.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:13.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:13 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:13.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:13.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:13 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:13.224+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:13.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:13.415+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:13.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:13.415+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:13.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:13.415+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:13.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:13.415+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:13.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:13.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:13.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:13.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:13.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:13.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:13.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:13.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:13.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:13 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:13.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:14.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:13 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:13.630+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:14.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:13 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:13.630+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:14.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:13 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:13.630+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:14.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:13 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:13.630+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:14.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:13 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:13.630+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:14.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:14 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:14.248+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:14.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:14 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:14.248+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:14.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:14 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:14.248+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:14.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:14 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:14.248+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:14.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:14 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:14.248+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:14.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:14 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:14.248+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:14.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:14.457+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:05.859926+0000 front 2024-09-21T08:04:05.859907+0000 (oldest deadline 2024-09-21T08:04:31.760013+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:14.457+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.861145+0000 front 2024-09-21T08:04:12.861284+0000 (oldest deadline 2024-09-21T08:04:38.661773+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:14.457+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.464683+0000 front 2024-09-21T08:04:31.464842+0000 (oldest deadline 2024-09-21T08:04:56.764504+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:14.457+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:36.764958+0000 front 2024-09-21T08:04:36.765011+0000 (oldest deadline 2024-09-21T08:05:02.664972+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8[52545]: 2024-09-21T08:05:14.457+0000 7fce878fc640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.766754+0000 front 2024-09-21T08:04:47.766691+0000 (oldest deadline 2024-09-21T08:05:13.666770+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:14.246+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:14.246+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:14.246+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:14.246+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:14.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:14 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:14.246+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:15.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:14 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:14.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:15.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:14 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:14.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:15.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:14 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:14.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:15.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:14 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:14.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:15.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:14 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:14.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:15.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:15 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:15.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:15.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:15 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:15.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:15.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:15 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:15.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:15.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:15 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:15.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:15.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:15 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:15.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:15.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:15 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:15.216+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:15.654 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:15 smithi191 podman[68310]: 2024-09-21 08:05:15.354194085 +0000 UTC m=+5.799965683 container died f3d62387517c4317e26263d4e0d573be2e5b8b1a218978dc9e72b83f1ae6e4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:05:15.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:15 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:15.197+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:15.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:15 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:15.197+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:15.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:15 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:15.197+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:15.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:15 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:15.197+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:15.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:15 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:15.197+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:16.016 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:15 smithi191 podman[68310]: 2024-09-21 08:05:15.746899358 +0000 UTC m=+6.192671001 container cleanup f3d62387517c4317e26263d4e0d573be2e5b8b1a218978dc9e72b83f1ae6e4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T08:05:16.016 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:15 smithi191 bash[68310]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8 2024-09-21T08:05:16.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:15 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:15.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:16.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:15 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:15.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:16.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:15 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:15.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:16.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:15 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:15.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:16.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:15 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:15.642+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:16.353 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:16 smithi191 podman[68325]: 2024-09-21 08:05:16.014986784 +0000 UTC m=+0.655125619 container remove f3d62387517c4317e26263d4e0d573be2e5b8b1a218978dc9e72b83f1ae6e4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T08:05:16.354 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:16 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:16.203+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:16.354 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:16 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:16.204+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:16.354 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:16 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:16.204+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:16.354 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:16 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:16.204+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:16.354 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:16 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:16.204+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:16.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:16.211+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:16.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:16.211+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:16.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:16.211+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:16.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:16.211+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:16.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:16.211+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:16.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:16 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:16.211+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:16.644 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:16 smithi191 podman[68415]: 2024-09-21 08:05:16.255193525 +0000 UTC m=+0.015887051 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:05:16.644 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:16 smithi191 podman[68415]: 2024-09-21 08:05:16.387101867 +0000 UTC m=+0.147795386 container create 60f6a798b600fa10256726d8c938e44ecc939985422f1f3dae7abf27ac490f64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T08:05:16.644 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:16 smithi191 podman[68415]: 2024-09-21 08:05:16.643303803 +0000 UTC m=+0.403997324 container init 60f6a798b600fa10256726d8c938e44ecc939985422f1f3dae7abf27ac490f64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T08:05:16.904 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:16 smithi191 podman[68415]: 2024-09-21 08:05:16.6470327 +0000 UTC m=+0.407726221 container start 60f6a798b600fa10256726d8c938e44ecc939985422f1f3dae7abf27ac490f64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T08:05:16.905 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:16 smithi191 podman[68415]: 2024-09-21 08:05:16.743334325 +0000 UTC m=+0.504027845 container attach 60f6a798b600fa10256726d8c938e44ecc939985422f1f3dae7abf27ac490f64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:05:16.905 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 21 08:05:16 smithi191 podman[68415]: 2024-09-21 08:05:16.834046159 +0000 UTC m=+0.594739682 container died 60f6a798b600fa10256726d8c938e44ecc939985422f1f3dae7abf27ac490f64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T08:05:17.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:16 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:16.654+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:17.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:16 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:16.654+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:17.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:16 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:16.654+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:17.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:16 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:16.654+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:17.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:16 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:16.654+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:17.404 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:17 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:17.250+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:17.404 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:17 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:17.250+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:17.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:17 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:17.250+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:17.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:17 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:17.250+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:17.405 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:17 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:17.250+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:17.488 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T08:05:17.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:17.527 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T08:05:17.527 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T08:05:17.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.9 2024-09-21T08:05:17.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:17 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:17.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:17.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:17 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:17.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:17.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:17 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:17.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:17.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:17 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:17.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:17.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:17 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:17.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:17.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:17 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:17.219+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:17.958 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 systemd[1]: Stopping Ceph osd.9 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:17.958 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.618+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:17.959 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.618+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:17.959 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.618+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:17.959 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.618+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:17.959 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.618+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:18.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.956+0000 7fb660e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:18.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.956+0000 7fb660e00640 -1 osd.9 106 *** Got signal Terminated *** 2024-09-21T08:05:18.306 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:17 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:17.956+0000 7fb660e00640 -1 osd.9 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:05:18.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:18.260+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:18.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:18.260+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:18.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:18.260+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:18.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:18.260+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:18.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:18.260+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:18.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:18 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:18.260+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:18.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:18.274+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:18.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:18.274+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:18.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:18.274+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:18.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:18.274+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:18.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:18 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:18.274+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:19.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:18 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:18.640+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:19.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:18 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:18.640+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:19.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:18 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:18.640+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:19.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:18 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:18.640+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:19.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:18 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:18.640+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:19.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:19 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:19.225+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:19.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:19 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:19.225+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:19.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:19 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:19.225+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:19.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:19 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:19.225+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:19.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:19 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:19.225+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:19.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:19 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:19.225+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:19.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:19 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:19.259+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:19.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:19 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:19.259+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:19.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:19 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:19.259+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:19.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:19 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:19.259+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:19.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:19 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:19.259+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:20.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:19 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:19.644+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:20.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:19 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:19.644+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:20.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:19 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:19.644+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:20.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:19 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:19.644+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:20.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:19 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:19.644+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:20.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:20 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:20.207+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:20.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:20 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:20.207+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:20.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:20 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:20.207+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:20.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:20 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:20.207+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:20.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:20 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:20.207+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:20.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:20 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:20.207+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:20.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:20 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:20.207+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:20.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:20.291+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:20.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:20.291+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:20.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:20.291+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:20.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:20.291+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:20.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:20.291+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:20.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:20.291+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:21.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:20 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:20.623+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:21.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:20 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:20.623+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:21.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:20 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:20.623+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:21.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:20 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:20.623+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:21.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:20 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:20.623+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:21.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:20 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:20.623+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:53.337174+0000 front 2024-09-21T08:04:53.337258+0000 (oldest deadline 2024-09-21T08:05:19.737599+0000) 2024-09-21T08:05:21.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:21 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:21.213+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:21.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:21 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:21.213+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:21.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:21 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:21.213+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:21.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:21 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:21.213+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:21.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:21 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:21.213+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:21.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:21 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:21.213+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:21.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:21 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:21.213+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:21.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:21 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:21.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:21.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:21 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:21.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:21.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:21 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:21.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:21.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:21 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:21.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:21.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:21 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:21.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:21.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:21 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:21.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:22.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:21 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:21.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:22.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:21 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:21.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:22.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:21 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:21.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:22.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:21 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:21.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:22.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:21 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:21.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:22.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:21 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:21.672+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:53.337174+0000 front 2024-09-21T08:04:53.337258+0000 (oldest deadline 2024-09-21T08:05:19.737599+0000) 2024-09-21T08:05:22.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:22 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:22.209+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:22.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:22 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:22.209+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:22.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:22 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:22.209+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:22.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:22 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:22.209+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:22.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:22 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:22.209+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:22.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:22 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:22.209+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:22.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:22 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:22.209+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:22.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:22 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:22.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:22.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:22 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:22.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:22.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:22 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:22.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:22.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:22 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:22.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:22.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:22 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:22.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:22.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:22 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:22.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:23.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:22 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:22.636+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:12.728236+0000 front 2024-09-21T08:04:12.728202+0000 (oldest deadline 2024-09-21T08:04:37.428483+0000) 2024-09-21T08:05:23.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:22 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:22.636+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.530373+0000 front 2024-09-21T08:04:21.530313+0000 (oldest deadline 2024-09-21T08:04:47.430415+0000) 2024-09-21T08:05:23.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:22 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:22.636+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:27.931719+0000 front 2024-09-21T08:04:27.931489+0000 (oldest deadline 2024-09-21T08:04:53.831585+0000) 2024-09-21T08:05:23.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:22 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:22.636+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:38.334254+0000 front 2024-09-21T08:04:38.333998+0000 (oldest deadline 2024-09-21T08:05:04.234136+0000) 2024-09-21T08:05:23.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:22 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:22.636+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.636003+0000 front 2024-09-21T08:04:47.635840+0000 (oldest deadline 2024-09-21T08:05:12.836398+0000) 2024-09-21T08:05:23.057 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:22 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9[67183]: 2024-09-21T08:05:22.636+0000 7fb657800640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:53.337174+0000 front 2024-09-21T08:04:53.337258+0000 (oldest deadline 2024-09-21T08:05:19.737599+0000) 2024-09-21T08:05:23.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:23 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:23.203+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:23.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:23 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:23.203+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:23.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:23 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:23.203+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:23.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:23 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:23.203+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:23.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:23 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:23.203+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:23.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:23 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:23.203+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:23.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:23 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:23.203+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:23.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:23 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:23.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:23.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:23 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:23.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:23.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:23 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:23.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:23.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:23 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:23.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:23.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:23 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:23.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:23.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:23 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:23.284+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:24.222 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:23 smithi084 podman[117393]: 2024-09-21 08:05:23.92575843 +0000 UTC m=+6.120176070 container died 87ec6e727544a9e5a22b6fae90f44b156e8689ee3a1a25e1f7d5a487239f6b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T08:05:24.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:24 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:24.164+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:24.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:24 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:24.164+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:24.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:24 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:24.164+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:24.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:24 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:24.164+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:24.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:24 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:24.164+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:24.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:24 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:24.164+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:24.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:24 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:24.164+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:24.556 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:24 smithi084 podman[117393]: 2024-09-21 08:05:24.437243786 +0000 UTC m=+6.631661424 container cleanup 87ec6e727544a9e5a22b6fae90f44b156e8689ee3a1a25e1f7d5a487239f6b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:05:24.556 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:24 smithi084 bash[117393]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9 2024-09-21T08:05:24.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:24.249+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:24.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:24.249+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:24.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:24.249+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:24.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:24.249+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:24.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:24.249+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:24.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:24.249+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:25.056 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:24 smithi084 podman[117411]: 2024-09-21 08:05:24.655357659 +0000 UTC m=+0.717876560 container remove 87ec6e727544a9e5a22b6fae90f44b156e8689ee3a1a25e1f7d5a487239f6b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T08:05:25.468 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:25 smithi084 podman[117500]: 2024-09-21 08:05:25.094988218 +0000 UTC m=+0.026820736 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:05:25.468 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:25 smithi084 podman[117500]: 2024-09-21 08:05:25.206261624 +0000 UTC m=+0.138094127 container create baad30911aa5ecb8e9f993fbc325a27768a5309adcc12db8b5ee79db88b2e2be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T08:05:25.468 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:25 smithi084 podman[117500]: 2024-09-21 08:05:25.467497511 +0000 UTC m=+0.399330031 container init baad30911aa5ecb8e9f993fbc325a27768a5309adcc12db8b5ee79db88b2e2be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:05:25.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:25 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:25.124+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:25.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:25 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:25.124+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:25.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:25 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:25.124+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:25.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:25 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:25.124+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:25.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:25 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:25.124+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:25.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:25 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:25.124+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:25.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:25 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:25.124+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:25.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:25 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:25.257+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:25.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:25 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:25.257+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:25.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:25 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:25.257+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:25.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:25 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:25.257+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:25.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:25 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:25.257+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:25.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:25 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:25.257+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:25.733 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:25 smithi084 podman[117500]: 2024-09-21 08:05:25.474263125 +0000 UTC m=+0.406095624 container start baad30911aa5ecb8e9f993fbc325a27768a5309adcc12db8b5ee79db88b2e2be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T08:05:25.734 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:25 smithi084 podman[117500]: 2024-09-21 08:05:25.550529859 +0000 UTC m=+0.482362372 container attach baad30911aa5ecb8e9f993fbc325a27768a5309adcc12db8b5ee79db88b2e2be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:05:26.053 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 08:05:25 smithi084 podman[117500]: 2024-09-21 08:05:25.733520695 +0000 UTC m=+0.665353203 container died baad30911aa5ecb8e9f993fbc325a27768a5309adcc12db8b5ee79db88b2e2be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T08:05:26.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T08:05:26.549 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:26.549 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T08:05:26.549 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T08:05:26.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.10 2024-09-21T08:05:26.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.152+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:26.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.152+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:26.553 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.152+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:26.553 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.152+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:26.553 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.152+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:26.553 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.152+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:26.553 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.152+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:26.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:26 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:26.211+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:26.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:26 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:26.211+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:26.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:26 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:26.211+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:26.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:26 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:26.211+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:26.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:26 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:26.211+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:26.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:26 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:26.211+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:26.832 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 systemd[1]: Stopping Ceph osd.10 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:26.832 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.830+0000 7f25ec06b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:27.177 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.830+0000 7f25ec06b640 -1 osd.10 106 *** Got signal Terminated *** 2024-09-21T08:05:27.177 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:26 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:26.830+0000 7f25ec06b640 -1 osd.10 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:05:27.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:27 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:27.176+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:27.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:27 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:27.176+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:27.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:27 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:27.176+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:27.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:27 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:27.176+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:27.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:27 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:27.176+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:27.553 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:27 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:27.176+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:27.553 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:27 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:27.176+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:27.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:27 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:27.167+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:27.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:27 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:27.167+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:27.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:27 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:27.167+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:27.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:27 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:27.167+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:27.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:27 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:27.167+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:27.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:27 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:27.167+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:28.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:28.179+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:28.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:28.179+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:28.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:28.179+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:28.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:28.179+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:28.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:28.179+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:28.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:28.179+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:28.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:28 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:28.179+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:28.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:28.216+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:28.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:28.216+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:28.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:28.216+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:28.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:28.216+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:28.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:28.216+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:28.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:28.216+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:29.471 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:29.208+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:29.472 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:29.208+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:29.472 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:29.208+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:29.472 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:29.208+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:29.472 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:29.208+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:29.472 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:29.208+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:29.472 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:29 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:29.208+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:29.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:29.241+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:29.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:29.241+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:29.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:29.241+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:29.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:29.241+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:29.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:29.241+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:29.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:29.241+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:29.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:29 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:29.241+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:30.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:30.217+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:30.551 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:30.217+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:30.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:30.217+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:30.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:30.217+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:30.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:30.217+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:30.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:30.217+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:30.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:30 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:30.217+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:30.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:30.265+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:30.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:30.265+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:30.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:30.265+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:30.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:30.265+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:30.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:30.265+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:30.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:30.265+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:30.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:30 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:30.265+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:31.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:31.262+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.001633+0000 front 2024-09-21T08:04:01.001557+0000 (oldest deadline 2024-09-21T08:04:29.202507+0000) 2024-09-21T08:05:31.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:31.262+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-21T08:04:14.503579+0000 front 2024-09-21T08:04:14.503878+0000 (oldest deadline 2024-09-21T08:04:39.203795+0000) 2024-09-21T08:05:31.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:31.262+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:22.104753+0000 front 2024-09-21T08:04:22.105114+0000 (oldest deadline 2024-09-21T08:04:46.204854+0000) 2024-09-21T08:05:31.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:31.262+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.906965+0000 front 2024-09-21T08:04:31.907070+0000 (oldest deadline 2024-09-21T08:04:55.406747+0000) 2024-09-21T08:05:31.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:31.262+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.107560+0000 front 2024-09-21T08:04:37.107616+0000 (oldest deadline 2024-09-21T08:05:04.108084+0000) 2024-09-21T08:05:31.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:31.262+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:48.209288+0000 front 2024-09-21T08:04:48.209303+0000 (oldest deadline 2024-09-21T08:05:12.209543+0000) 2024-09-21T08:05:31.552 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:31 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10[59002]: 2024-09-21T08:05:31.262+0000 7f25e464e640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:56.910608+0000 front 2024-09-21T08:04:56.910654+0000 (oldest deadline 2024-09-21T08:05:19.810362+0000) 2024-09-21T08:05:31.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:31.218+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:31.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:31.218+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:31.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:31.218+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:31.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:31.218+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:31.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:31.218+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:31.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:31.218+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:31.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:31 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:31.218+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:32.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:32.207+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:32.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:32.207+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:32.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:32.207+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:32.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:32.207+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:32.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:32.207+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:32.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:32.207+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:32.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:32 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:32.207+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:32.748 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:32 smithi162 podman[68880]: 2024-09-21 08:05:32.485401556 +0000 UTC m=+5.744954156 container died a4d9f347792438f41ff8722164c6f532c0890d099e8c6d7d9ce3b52644e01291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T08:05:33.039 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:32 smithi162 podman[68880]: 2024-09-21 08:05:32.82107179 +0000 UTC m=+6.080624372 container cleanup a4d9f347792438f41ff8722164c6f532c0890d099e8c6d7d9ce3b52644e01291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:05:33.040 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:32 smithi162 bash[68880]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10 2024-09-21T08:05:33.301 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:33 smithi162 podman[68907]: 2024-09-21 08:05:33.039088045 +0000 UTC m=+0.556347952 container remove a4d9f347792438f41ff8722164c6f532c0890d099e8c6d7d9ce3b52644e01291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T08:05:33.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:33.237+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:33.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:33.237+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:33.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:33.237+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:33.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:33.237+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:33.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:33.237+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:33.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:33.237+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:33.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:33 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:33.237+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:33.701 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:33 smithi162 podman[68995]: 2024-09-21 08:05:33.334066416 +0000 UTC m=+0.015927205 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:05:33.701 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:33 smithi162 podman[68995]: 2024-09-21 08:05:33.440001091 +0000 UTC m=+0.121861871 container create 65dd0e306c4472fcef5f71366ef3ff06ce07eb039449939d9b395ea38edb150b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-21T08:05:33.701 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:33 smithi162 podman[68995]: 2024-09-21 08:05:33.633888483 +0000 UTC m=+0.315749263 container init 65dd0e306c4472fcef5f71366ef3ff06ce07eb039449939d9b395ea38edb150b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T08:05:33.701 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:33 smithi162 podman[68995]: 2024-09-21 08:05:33.637264751 +0000 UTC m=+0.319125531 container start 65dd0e306c4472fcef5f71366ef3ff06ce07eb039449939d9b395ea38edb150b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T08:05:33.701 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:33 smithi162 podman[68995]: 2024-09-21 08:05:33.700437798 +0000 UTC m=+0.382298583 container attach 65dd0e306c4472fcef5f71366ef3ff06ce07eb039449939d9b395ea38edb150b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T08:05:34.051 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:33 smithi162 podman[68995]: 2024-09-21 08:05:33.829078866 +0000 UTC m=+0.510939658 container died 65dd0e306c4472fcef5f71366ef3ff06ce07eb039449939d9b395ea38edb150b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:05:34.379 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 21 08:05:34 smithi162 podman[69019]: 2024-09-21 08:05:34.361748279 +0000 UTC m=+0.526536864 container remove 65dd0e306c4472fcef5f71366ef3ff06ce07eb039449939d9b395ea38edb150b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:05:34.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T08:05:34.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:34.422 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T08:05:34.423 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T08:05:34.423 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.11 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.238+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:34.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 systemd[1]: Stopping Ceph osd.11 for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:35.154 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.715+0000 7f5eeb22e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:35.154 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.715+0000 7f5eeb22e640 -1 osd.11 106 *** Got signal Terminated *** 2024-09-21T08:05:35.154 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:34 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:34.715+0000 7f5eeb22e640 -1 osd.11 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:05:35.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:35.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:35.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:35.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:35.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:35.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:35.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:35.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:35.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:35.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:35.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:35.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:35.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:35 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:35.286+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:36.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:36.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:36.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:36.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:36.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:36.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:36.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:36.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:36.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:36.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:36.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:36.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:36.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:36 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:36.300+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:37.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:37.306+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:37.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:37.306+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:37.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:37.306+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:37.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:37.306+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:37.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:37.306+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:37.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:37.306+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:37.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:37 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:37.306+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:38.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:38.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:38.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:38.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:38.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:38.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:38.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:38.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:38 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:38.351+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6820 osd.8 since back 2024-09-21T08:05:08.834054+0000 front 2024-09-21T08:05:08.834082+0000 (oldest deadline 2024-09-21T08:05:38.234560+0000) 2024-09-21T08:05:39.654 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.335+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T08:04:01.522534+0000 front 2024-09-21T08:04:01.522390+0000 (oldest deadline 2024-09-21T08:04:27.422445+0000) 2024-09-21T08:05:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.335+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-21T08:04:21.925746+0000 front 2024-09-21T08:04:21.925774+0000 (oldest deadline 2024-09-21T08:04:47.825918+0000) 2024-09-21T08:05:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.335+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T08:04:31.927082+0000 front 2024-09-21T08:04:31.927108+0000 (oldest deadline 2024-09-21T08:04:54.227043+0000) 2024-09-21T08:05:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.335+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-21T08:04:37.628711+0000 front 2024-09-21T08:04:37.628679+0000 (oldest deadline 2024-09-21T08:05:03.528658+0000) 2024-09-21T08:05:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.335+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-21T08:04:47.629356+0000 front 2024-09-21T08:04:47.629403+0000 (oldest deadline 2024-09-21T08:05:11.729481+0000) 2024-09-21T08:05:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.336+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T08:04:55.532121+0000 front 2024-09-21T08:04:55.532035+0000 (oldest deadline 2024-09-21T08:05:20.231881+0000) 2024-09-21T08:05:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.336+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-21T08:05:05.333647+0000 front 2024-09-21T08:05:05.333630+0000 (oldest deadline 2024-09-21T08:05:28.833638+0000) 2024-09-21T08:05:39.655 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:39 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11[58789]: 2024-09-21T08:05:39.336+0000 7f5ee3811640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.191:6820 osd.8 since back 2024-09-21T08:05:08.834054+0000 front 2024-09-21T08:05:08.834082+0000 (oldest deadline 2024-09-21T08:05:38.234560+0000) 2024-09-21T08:05:40.550 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:40 smithi191 podman[68531]: 2024-09-21 08:05:40.289821418 +0000 UTC m=+5.670753053 container died d26ef2fd853faa979852293c8c7d38cce2ca6550e43eb569f1916701a7bdc509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T08:05:40.904 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:40 smithi191 podman[68531]: 2024-09-21 08:05:40.66469437 +0000 UTC m=+6.045626004 container cleanup d26ef2fd853faa979852293c8c7d38cce2ca6550e43eb569f1916701a7bdc509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:05:40.904 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:40 smithi191 bash[68531]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11 2024-09-21T08:05:41.270 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:40 smithi191 podman[68546]: 2024-09-21 08:05:40.924353702 +0000 UTC m=+0.631877479 container remove d26ef2fd853faa979852293c8c7d38cce2ca6550e43eb569f1916701a7bdc509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T08:05:41.528 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:41 smithi191 podman[68637]: 2024-09-21 08:05:41.172252161 +0000 UTC m=+0.015231345 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:05:41.528 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:41 smithi191 podman[68637]: 2024-09-21 08:05:41.291739892 +0000 UTC m=+0.134719107 container create 713ed5b7f5f345fcee74b94d17890ff2d9ef3852fe2d0263f36c680a1a09d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T08:05:41.528 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:41 smithi191 podman[68637]: 2024-09-21 08:05:41.52737157 +0000 UTC m=+0.370350744 container init 713ed5b7f5f345fcee74b94d17890ff2d9ef3852fe2d0263f36c680a1a09d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T08:05:41.904 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:41 smithi191 podman[68637]: 2024-09-21 08:05:41.530773078 +0000 UTC m=+0.373752249 container start 713ed5b7f5f345fcee74b94d17890ff2d9ef3852fe2d0263f36c680a1a09d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T08:05:41.905 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:41 smithi191 podman[68637]: 2024-09-21 08:05:41.618991946 +0000 UTC m=+0.461971125 container attach 713ed5b7f5f345fcee74b94d17890ff2d9ef3852fe2d0263f36c680a1a09d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T08:05:41.905 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:41 smithi191 podman[68637]: 2024-09-21 08:05:41.720992531 +0000 UTC m=+0.563971700 container died 713ed5b7f5f345fcee74b94d17890ff2d9ef3852fe2d0263f36c680a1a09d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:05:42.265 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 21 08:05:42 smithi191 podman[68659]: 2024-09-21 08:05:42.247052632 +0000 UTC m=+0.519935677 container remove 713ed5b7f5f345fcee74b94d17890ff2d9ef3852fe2d0263f36c680a1a09d8f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T08:05:42.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T08:05:42.308 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:42.308 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T08:05:42.308 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T08:05:42.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.a 2024-09-21T08:05:42.735 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:05:42 smithi084 systemd[1]: Stopping Ceph mds.a for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:43.056 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:05:42 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a[74007]: 2024-09-21T08:05:42.732+0000 7ff391200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:43.056 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:05:42 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a[74007]: 2024-09-21T08:05:42.732+0000 7ff391200640 -1 mds.a *** got signal Terminated *** 2024-09-21T08:05:47.031 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:05:46 smithi084 podman[117614]: 2024-09-21 08:05:46.765079099 +0000 UTC m=+4.170318114 container died 3ac567c58e638e94e65fe799f979e3946a860334175f574e89c601b4a451321a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:05:47.306 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:05:47 smithi084 podman[117614]: 2024-09-21 08:05:47.14555571 +0000 UTC m=+4.550794724 container cleanup 3ac567c58e638e94e65fe799f979e3946a860334175f574e89c601b4a451321a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T08:05:47.306 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:05:47 smithi084 bash[117614]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a 2024-09-21T08:05:47.611 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 08:05:47 smithi084 podman[117627]: 2024-09-21 08:05:47.347759316 +0000 UTC m=+0.574109641 container remove 3ac567c58e638e94e65fe799f979e3946a860334175f574e89c601b4a451321a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T08:05:47.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T08:05:47.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:47.702 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T08:05:47.702 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T08:05:47.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.d 2024-09-21T08:05:48.056 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:05:47 smithi084 systemd[1]: Stopping Ceph mds.d for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:48.556 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:05:48 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d[72974]: 2024-09-21T08:05:48.092+0000 7f7fcd800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:48.556 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:05:48 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d[72974]: 2024-09-21T08:05:48.092+0000 7f7fcd800640 -1 mds.d *** got signal Terminated *** 2024-09-21T08:05:51.625 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:05:51 smithi084 podman[117734]: 2024-09-21 08:05:51.35415563 +0000 UTC m=+3.383057655 container died 691526cb28b5aacf7ed3391ce138b3f85160f5ba514b5b156b73bdf0ede325b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T08:05:52.047 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:05:51 smithi084 podman[117734]: 2024-09-21 08:05:51.744914041 +0000 UTC m=+3.773816075 container cleanup 691526cb28b5aacf7ed3391ce138b3f85160f5ba514b5b156b73bdf0ede325b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:05:52.047 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 08:05:51 smithi084 bash[117734]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-d 2024-09-21T08:05:52.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T08:05:52.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:52.301 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T08:05:52.301 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T08:05:52.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.g 2024-09-21T08:05:52.556 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 08:05:52 smithi084 systemd[1]: Stopping Ceph mds.g for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:53.056 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 08:05:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g[73697]: 2024-09-21T08:05:52.726+0000 7f389fc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:53.056 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 08:05:52 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g[73697]: 2024-09-21T08:05:52.726+0000 7f389fc00640 -1 mds.g *** got signal Terminated *** 2024-09-21T08:05:55.284 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 08:05:55 smithi084 podman[117856]: 2024-09-21 08:05:55.009242396 +0000 UTC m=+2.403532215 container died 321154123d54bfd8eda21dcbbe4f834ca845ab7f66418d574e4b77cebec96ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T08:05:55.556 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 08:05:55 smithi084 podman[117856]: 2024-09-21 08:05:55.390087964 +0000 UTC m=+2.784377782 container cleanup 321154123d54bfd8eda21dcbbe4f834ca845ab7f66418d574e4b77cebec96ba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:05:55.556 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 08:05:55 smithi084 bash[117856]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-g 2024-09-21T08:05:55.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T08:05:55.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:55.959 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T08:05:55.959 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T08:05:55.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.j 2024-09-21T08:05:56.306 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 08:05:56 smithi084 systemd[1]: Stopping Ceph mds.j for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:05:56.806 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 08:05:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j[72586]: 2024-09-21T08:05:56.438+0000 7f9e4a400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:05:56.806 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 08:05:56 smithi084 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j[72586]: 2024-09-21T08:05:56.438+0000 7f9e4a400640 -1 mds.j *** got signal Terminated *** 2024-09-21T08:05:58.614 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 08:05:58 smithi084 podman[117976]: 2024-09-21 08:05:58.31203223 +0000 UTC m=+2.047408322 container died 45ec1b410ce861bf72dde676da877d13b9e7cc2c4e79b8c2eede38ce6c3f2b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T08:05:59.056 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 08:05:58 smithi084 podman[117976]: 2024-09-21 08:05:58.827382993 +0000 UTC m=+2.562759084 container cleanup 45ec1b410ce861bf72dde676da877d13b9e7cc2c4e79b8c2eede38ce6c3f2b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:05:59.056 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 08:05:58 smithi084 bash[117976]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-j 2024-09-21T08:05:59.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T08:05:59.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:05:59.380 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T08:05:59.380 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T08:05:59.380 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.b 2024-09-21T08:05:59.770 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:05:59 smithi162 systemd[1]: Stopping Ceph mds.b for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:00.029 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:05:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b[64357]: 2024-09-21T08:05:59.767+0000 7f98411b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:00.030 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:05:59 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b[64357]: 2024-09-21T08:05:59.767+0000 7f98411b1640 -1 mds.b *** got signal Terminated *** 2024-09-21T08:06:03.503 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:06:03 smithi162 podman[69099]: 2024-09-21 08:06:03.161983391 +0000 UTC m=+3.590223858 container died 491d461f3f5208b187539805f58c7b6d9db44d6ffcad5707c2f98f1bdc22087d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T08:06:03.795 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:06:03 smithi162 podman[69099]: 2024-09-21 08:06:03.60199661 +0000 UTC m=+4.030237034 container cleanup 491d461f3f5208b187539805f58c7b6d9db44d6ffcad5707c2f98f1bdc22087d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T08:06:03.795 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:06:03 smithi162 bash[69099]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b 2024-09-21T08:06:04.038 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T08:06:04.051 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:06:03 smithi162 podman[69125]: 2024-09-21 08:06:03.794755477 +0000 UTC m=+0.622850866 container remove 491d461f3f5208b187539805f58c7b6d9db44d6ffcad5707c2f98f1bdc22087d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-b, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:06:04.051 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:06:04 smithi162 systemd[1]: ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.b.service: Deactivated successfully. 2024-09-21T08:06:04.051 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:06:04 smithi162 systemd[1]: Stopped Ceph mds.b for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T08:06:04.051 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 21 08:06:04 smithi162 systemd[1]: ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.b.service: Consumed 9.478s CPU time. 2024-09-21T08:06:04.075 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:04.075 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T08:06:04.075 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T08:06:04.076 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.e 2024-09-21T08:06:04.390 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:06:04 smithi162 systemd[1]: Stopping Ceph mds.e for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:04.801 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:06:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e[63805]: 2024-09-21T08:06:04.388+0000 7f655278d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:04.801 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:06:04 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e[63805]: 2024-09-21T08:06:04.388+0000 7f655278d640 -1 mds.e *** got signal Terminated *** 2024-09-21T08:06:07.439 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:06:07 smithi162 podman[69233]: 2024-09-21 08:06:07.170837952 +0000 UTC m=+2.875269133 container died 35cb94b081882b2c82015e62655683c6db33f2c8de90cacea27ff4f2ca0399c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T08:06:07.439 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:06:07 smithi162 podman[69233]: 2024-09-21 08:06:07.438480652 +0000 UTC m=+3.142911901 container cleanup 35cb94b081882b2c82015e62655683c6db33f2c8de90cacea27ff4f2ca0399c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:06:07.690 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 21 08:06:07 smithi162 bash[69233]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-e 2024-09-21T08:06:07.813 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T08:06:07.847 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:07.847 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T08:06:07.848 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T08:06:07.848 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.h 2024-09-21T08:06:08.051 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:06:07 smithi162 systemd[1]: Stopping Ceph mds.h for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:08.551 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:06:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h[64087]: 2024-09-21T08:06:08.167+0000 7f63e1ef1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:08.551 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:06:08 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h[64087]: 2024-09-21T08:06:08.167+0000 7f63e1ef1640 -1 mds.h *** got signal Terminated *** 2024-09-21T08:06:11.470 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:06:11 smithi162 podman[69357]: 2024-09-21 08:06:11.1707988 +0000 UTC m=+3.106938789 container died f2f6c6e8ea9455ea8b9c21e2da9e60bff9fd6164154d190ca36fcb1888898444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T08:06:11.777 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:06:11 smithi162 podman[69357]: 2024-09-21 08:06:11.550645512 +0000 UTC m=+3.486785501 container cleanup f2f6c6e8ea9455ea8b9c21e2da9e60bff9fd6164154d190ca36fcb1888898444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T08:06:11.777 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 21 08:06:11 smithi162 bash[69357]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-h 2024-09-21T08:06:11.905 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T08:06:11.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:11.937 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T08:06:11.937 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T08:06:11.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.k 2024-09-21T08:06:12.051 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:06:12 smithi162 systemd[1]: Stopping Ceph mds.k for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:12.801 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:06:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k[63520]: 2024-09-21T08:06:12.304+0000 7ff3fc0d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:12.801 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:06:12 smithi162 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k[63520]: 2024-09-21T08:06:12.304+0000 7ff3fc0d9640 -1 mds.k *** got signal Terminated *** 2024-09-21T08:06:15.497 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:06:15 smithi162 podman[69480]: 2024-09-21 08:06:15.163997169 +0000 UTC m=+3.004648260 container died c6a3b88a787d8d72e510a219053030b4a535974364256efcb6b1f164cfa8ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T08:06:15.801 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:06:15 smithi162 podman[69480]: 2024-09-21 08:06:15.58699496 +0000 UTC m=+3.427646052 container cleanup c6a3b88a787d8d72e510a219053030b4a535974364256efcb6b1f164cfa8ddc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:06:15.801 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 21 08:06:15 smithi162 bash[69480]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-k 2024-09-21T08:06:16.055 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T08:06:16.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:16.088 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T08:06:16.088 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T08:06:16.088 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.c 2024-09-21T08:06:16.388 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:06:16 smithi191 systemd[1]: Stopping Ceph mds.c for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:16.654 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:06:16 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c[63767]: 2024-09-21T08:06:16.386+0000 7f40abdb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:16.654 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:06:16 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c[63767]: 2024-09-21T08:06:16.386+0000 7f40abdb4640 -1 mds.c *** got signal Terminated *** 2024-09-21T08:06:19.620 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:06:19 smithi191 podman[68740]: 2024-09-21 08:06:19.183588471 +0000 UTC m=+2.906055376 container died a161ce33b4df8a2a9dafc984d7c44c94f2425ebd8db89d77229091934cb391ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T08:06:19.904 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:06:19 smithi191 podman[68740]: 2024-09-21 08:06:19.702588667 +0000 UTC m=+3.425055568 container cleanup a161ce33b4df8a2a9dafc984d7c44c94f2425ebd8db89d77229091934cb391ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T08:06:19.904 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 21 08:06:19 smithi191 bash[68740]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-c 2024-09-21T08:06:20.139 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T08:06:20.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:20.173 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T08:06:20.174 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T08:06:20.174 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.f 2024-09-21T08:06:20.508 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:06:20 smithi191 systemd[1]: Stopping Ceph mds.f for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:20.904 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:06:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f[63502]: 2024-09-21T08:06:20.505+0000 7f88a389d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:20.905 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:06:20 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f[63502]: 2024-09-21T08:06:20.505+0000 7f88a389d640 -1 mds.f *** got signal Terminated *** 2024-09-21T08:06:23.442 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:06:23 smithi191 podman[68861]: 2024-09-21 08:06:23.158227178 +0000 UTC m=+2.764449345 container died ee23b80f296306a649356e8d7bd7f150f11764b03183b19f042ffedca31035e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:06:23.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:06:23 smithi191 podman[68861]: 2024-09-21 08:06:23.531690533 +0000 UTC m=+3.137912688 container cleanup ee23b80f296306a649356e8d7bd7f150f11764b03183b19f042ffedca31035e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T08:06:23.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 21 08:06:23 smithi191 bash[68861]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-f 2024-09-21T08:06:23.914 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T08:06:23.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:23.947 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T08:06:23.947 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T08:06:23.947 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.i 2024-09-21T08:06:24.154 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:24 smithi191 systemd[1]: Stopping Ceph mds.i for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:24.654 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i[64036]: 2024-09-21T08:06:24.250+0000 7f4f6ead3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:24.654 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:24 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i[64036]: 2024-09-21T08:06:24.250+0000 7f4f6ead3640 -1 mds.i *** got signal Terminated *** 2024-09-21T08:06:27.412 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:27 smithi191 podman[68983]: 2024-09-21 08:06:27.160777339 +0000 UTC m=+3.000047318 container died cd175deb20a899473f75db35850915ea0942b9107299de38db0e44786519aa64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T08:06:27.670 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:27 smithi191 podman[68983]: 2024-09-21 08:06:27.493551075 +0000 UTC m=+3.332821056 container cleanup cd175deb20a899473f75db35850915ea0942b9107299de38db0e44786519aa64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T08:06:27.670 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:27 smithi191 bash[68983]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i 2024-09-21T08:06:27.917 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T08:06:27.937 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:27 smithi191 podman[68996]: 2024-09-21 08:06:27.66982818 +0000 UTC m=+0.506155137 container remove cd175deb20a899473f75db35850915ea0942b9107299de38db0e44786519aa64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:06:27.937 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:27 smithi191 systemd[1]: ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.i.service: Deactivated successfully. 2024-09-21T08:06:27.938 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:27 smithi191 systemd[1]: Stopped Ceph mds.i for 56620f92-77ec-11ef-baf5-efdc52797490. 2024-09-21T08:06:27.938 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 21 08:06:27 smithi191 systemd[1]: ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.i.service: Consumed 2.350s CPU time. 2024-09-21T08:06:27.948 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:27.948 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T08:06:27.949 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T08:06:27.949 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.l 2024-09-21T08:06:28.273 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:06:28 smithi191 systemd[1]: Stopping Ceph mds.l for 56620f92-77ec-11ef-baf5-efdc52797490... 2024-09-21T08:06:28.654 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:06:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l[63218]: 2024-09-21T08:06:28.271+0000 7ff635d91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:06:28.654 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:06:28 smithi191 ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l[63218]: 2024-09-21T08:06:28.271+0000 7ff635d91640 -1 mds.l *** got signal Terminated *** 2024-09-21T08:06:31.490 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:06:31 smithi191 podman[69104]: 2024-09-21 08:06:31.181384732 +0000 UTC m=+3.019133913 container died 3ff5971ba17a7618c8e10787ba10da41ada2a8f81f7e7cf2d19d99c524f70fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T08:06:31.824 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:06:31 smithi191 podman[69104]: 2024-09-21 08:06:31.489304009 +0000 UTC m=+3.327053198 container cleanup 3ff5971ba17a7618c8e10787ba10da41ada2a8f81f7e7cf2d19d99c524f70fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:06:31.824 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:06:31 smithi191 bash[69104]: ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l 2024-09-21T08:06:31.824 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 21 08:06:31 smithi191 podman[69118]: 2024-09-21 08:06:31.698128221 +0000 UTC m=+0.509250176 container remove 3ff5971ba17a7618c8e10787ba10da41ada2a8f81f7e7cf2d19d99c524f70fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-56620f92-77ec-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T08:06:31.841 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-56620f92-77ec-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T08:06:31.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:06:31.872 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T08:06:31.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56620f92-77ec-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T08:06:32.148 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T08:06:36.131 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56620f92-77ec-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T08:06:36.333 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T08:06:39.025 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56620f92-77ec-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T08:06:39.228 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T08:06:41.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:06:41.764 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:06:41.797 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:06:41.823 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T08:06:41.825 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi084/crash 2024-09-21T08:06:41.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash -- . 2024-09-21T08:06:41.881 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:06:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:06:41.885 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi162/crash 2024-09-21T08:06:41.886 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash -- . 2024-09-21T08:06:41.937 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:06:41.937 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:06:41.939 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi191/crash 2024-09-21T08:06:41.940 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash -- . 2024-09-21T08:06:41.976 INFO:teuthology.orchestra.run.smithi191.stderr:tar: /var/lib/ceph/56620f92-77ec-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:06:41.977 INFO:teuthology.orchestra.run.smithi191.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:06:41.978 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T08:06:41.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T08:06:42.110 INFO:tasks.cephadm:Compressing logs... 2024-09-21T08:06:42.111 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:06:42.114 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:06:42.117 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:06:42.142 INFO:teuthology.orchestra.run.smithi191.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T08:06:42.142 INFO:teuthology.orchestra.run.smithi191.stderr:: No such file or directory 2024-09-21T08:06:42.142 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T08:06:42.143 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T08:06:42.143 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T08:06:42.143 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T08:06:42.145 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T08:06:42.145 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T08:06:42.145 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T08:06:42.146 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log 2024-09-21T08:06:42.146 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.2.log: /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T08:06:42.146 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T08:06:42.146 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T08:06:42.146 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T08:06:42.146 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.8.log: /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T08:06:42.146 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:06:42.147 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T08:06:42.147 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-21T08:06:42.147 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T08:06:42.147 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose --/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T08:06:42.147 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T08:06:42.147 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T08:06:42.150 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T08:06:42.150 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.b.log: /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T08:06:42.151 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:06:42.166 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 81.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:06:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T08:06:42.179 INFO:teuthology.orchestra.run.smithi084.stderr:: No such file or directory 2024-09-21T08:06:42.179 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T08:06:42.180 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T08:06:42.181 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T08:06:42.181 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T08:06:42.182 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T08:06:42.183 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T08:06:42.184 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T08:06:42.184 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T08:06:42.185 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T08:06:42.186 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log 2024-09-21T08:06:42.187 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T08:06:42.187 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T08:06:42.188 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T08:06:42.189 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T08:06:42.190 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:06:42.192 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.9% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T08:06:42.196 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T08:06:42.204 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T08:06:42.214 INFO:teuthology.orchestra.run.smithi162.stderr: 94.4% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T08:06:42.260 INFO:teuthology.orchestra.run.smithi084.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T08:06:42.271 INFO:teuthology.orchestra.run.smithi191.stderr: 81.4% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:06:42.272 INFO:teuthology.orchestra.run.smithi191.stderr: 86.8% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T08:06:42.287 INFO:teuthology.orchestra.run.smithi162.stderr: 91.0% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T08:06:42.295 INFO:teuthology.orchestra.run.smithi162.stderr: 92.7% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T08:06:42.305 INFO:teuthology.orchestra.run.smithi162.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:06:42.313 INFO:teuthology.orchestra.run.smithi191.stderr: 91.0% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T08:06:42.325 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T08:06:42.359 INFO:teuthology.orchestra.run.smithi084.stderr: 84.1% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:06:42.398 INFO:teuthology.orchestra.run.smithi191.stderr: 92.8% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T08:06:42.411 INFO:teuthology.orchestra.run.smithi191.stderr: 92.7% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T08:06:42.420 INFO:teuthology.orchestra.run.smithi191.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:06:42.432 INFO:teuthology.orchestra.run.smithi191.stderr: 90.2% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T08:06:42.436 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T08:06:42.443 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T08:06:42.450 INFO:teuthology.orchestra.run.smithi084.stderr: 90.0% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T08:06:42.450 INFO:teuthology.orchestra.run.smithi084.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:06:42.453 INFO:teuthology.orchestra.run.smithi162.stderr: 86.8% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T08:06:42.454 INFO:teuthology.orchestra.run.smithi162.stderr: 90.1% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T08:06:42.471 INFO:teuthology.orchestra.run.smithi191.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T08:06:42.493 INFO:teuthology.orchestra.run.smithi162.stderr: 94.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T08:06:42.526 INFO:teuthology.orchestra.run.smithi191.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T08:06:42.596 INFO:teuthology.orchestra.run.smithi162.stderr: 92.8% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T08:06:42.856 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T08:06:43.037 INFO:teuthology.orchestra.run.smithi191.stderr: 91.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T08:06:43.451 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T08:06:44.639 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T08:06:45.350 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T08:06:47.594 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T08:07:11.343 INFO:teuthology.orchestra.run.smithi162.stderr: 92.7% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T08:07:27.904 INFO:teuthology.orchestra.run.smithi191.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T08:07:45.070 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T08:07:46.894 INFO:teuthology.orchestra.run.smithi191.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T08:07:47.416 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T08:07:53.981 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T08:07:53.982 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-21T08:07:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:real 1m11.850s 2024-09-21T08:07:53.983 INFO:teuthology.orchestra.run.smithi162.stderr:user 3m25.167s 2024-09-21T08:07:53.983 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m6.896s 2024-09-21T08:07:54.439 INFO:teuthology.orchestra.run.smithi191.stderr: 92.6% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T08:08:16.772 INFO:teuthology.orchestra.run.smithi191.stderr: 92.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T08:08:16.774 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-09-21T08:08:16.774 INFO:teuthology.orchestra.run.smithi191.stderr:real 1m34.642s 2024-09-21T08:08:16.774 INFO:teuthology.orchestra.run.smithi191.stderr:user 3m31.177s 2024-09-21T08:08:16.774 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m7.293s 2024-09-21T08:10:27.083 INFO:teuthology.orchestra.run.smithi084.stderr: 92.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T08:10:52.252 INFO:teuthology.orchestra.run.smithi084.stderr: 92.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T08:11:34.383 INFO:teuthology.orchestra.run.smithi084.stderr: 92.5% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T08:11:57.043 INFO:teuthology.orchestra.run.smithi084.stderr: 92.4% -- replaced with /var/log/ceph/56620f92-77ec-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T08:11:57.046 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-09-21T08:11:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:real 5m14.904s 2024-09-21T08:11:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:user 4m11.878s 2024-09-21T08:11:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m28.251s 2024-09-21T08:11:57.048 INFO:tasks.cephadm:Archiving logs... 2024-09-21T08:11:57.048 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi084/log 2024-09-21T08:11:57.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:12:36.911 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi162/log 2024-09-21T08:12:36.912 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:13:08.943 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi191/log 2024-09-21T08:13:08.944 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:13:42.282 INFO:tasks.cephadm:Removing cluster... 2024-09-21T08:13:42.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56620f92-77ec-11ef-baf5-efdc52797490 --force 2024-09-21T08:13:42.561 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T08:13:43.885 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56620f92-77ec-11ef-baf5-efdc52797490 --force 2024-09-21T08:13:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T08:13:44.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 56620f92-77ec-11ef-baf5-efdc52797490 --force 2024-09-21T08:13:44.826 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 56620f92-77ec-11ef-baf5-efdc52797490 2024-09-21T08:13:45.362 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T08:13:45.363 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:13:45.403 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:13:45.420 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:13:45.437 INFO:tasks.cephadm:Teardown complete 2024-09-21T08:13:45.437 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T08:13:45.449 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T08:13:45.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:13:45.453 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:13:45.463 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:13:45.603 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T08:13:45.615 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T08:13:45.615 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:13:45.619 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:13:45.621 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:13:45.634 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:13:45.635 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:13:45.639 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:13:45.639 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-21T08:13:45.639 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +5186ns[+7101ns] +/- 64ms 2024-09-21T08:13:45.639 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -102us[ -102us] +/- 73ms 2024-09-21T08:13:45.640 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +151us[ +151us] +/- 62ms 2024-09-21T08:13:45.640 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:13:45.650 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:13:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:13:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-21T08:13:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -26us[ -14us] +/- 64ms 2024-09-21T08:13:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -113us[ -113us] +/- 73ms 2024-09-21T08:13:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +121us[ +121us] +/- 62ms 2024-09-21T08:13:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:13:45.662 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:13:45.663 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T08:13:45.663 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 -17us[ -11us] +/- 64ms 2024-09-21T08:13:45.663 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -103us[ -103us] +/- 73ms 2024-09-21T08:13:45.663 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +159us[ +159us] +/- 62ms 2024-09-21T08:13:45.663 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:13:45.663 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T08:13:45.673 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T08:13:45.674 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T08:13:45.706 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:13:45.896 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:13:45.983 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:13:46.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:13:46.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:13:46.136 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:13:46.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:13:46.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:13:46.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:13:46.194 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T08:13:46.206 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T08:13:46.234 INFO:teuthology.task.internal:Duration was 2577.620164 seconds 2024-09-21T08:13:46.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T08:13:46.267 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T08:13:46.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:13:46.272 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:13:46.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:13:46.326 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:13:46.354 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:13:46.371 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:13:46.704 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T08:13:46.704 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T08:13:46.704 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:13:46.753 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T08:13:46.754 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:13:46.788 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-09-21T08:13:46.788 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:13:46.820 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T08:13:46.821 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:13:46.825 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:13:46.831 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:13:46.887 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T08:13:46.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:13:46.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:13:46.898 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:13:48.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T08:13:48.344 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T08:13:48.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:13:48.414 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:13:48.457 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:13:48.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T08:13:48.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:13:48.521 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:13:48.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:13:48.552 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-21T08:13:48.562 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-09-21T08:13:48.594 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-09-21T08:13:48.625 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:13:48.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:13:48.659 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:13:48.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:13:48.676 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:13:48.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:13:48.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T08:13:48.706 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T08:13:48.708 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi084 2024-09-21T08:13:48.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:13:48.809 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi162 2024-09-21T08:13:48.809 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:13:48.850 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913612/remote/smithi191 2024-09-21T08:13:48.850 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:13:48.889 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T08:13:48.889 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:13:48.894 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:13:48.896 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:13:48.939 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T08:13:48.955 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T08:13:48.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T08:13:48.987 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T08:13:48.987 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:13:48.991 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:13:48.994 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:13:49.007 INFO:teuthology.orchestra.run.smithi162.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:13 /home/ubuntu/cephtest 2024-09-21T08:13:49.009 INFO:teuthology.orchestra.run.smithi191.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:13 /home/ubuntu/cephtest 2024-09-21T08:13:49.022 INFO:teuthology.orchestra.run.smithi084.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:13 /home/ubuntu/cephtest 2024-09-21T08:13:49.024 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T08:13:49.043 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T08:13:49.123 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} duration: 2577.6201639175415 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T08:13:49.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:13:49.212 INFO:teuthology.run:pass